[2025-10-06T17:00:02.034882] [INFO ] [MAIN ] Using last completed trading day: 2025-10-06 [2025-10-06T17:00:02.336578] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-06T17:00:02.336823] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-06T17:00:02.594729] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-06T17:00:02.595446] [WARN ] [STATE ] State set to: RUNNING [2025-10-06T17:00:02.595531] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-06T17:00:02.595579] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-06T17:00:02.595705] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-06T17:00:02.595798] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-06T17:00:04.049806] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-06T17:00:04.050048] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-06T17:00:04.050361] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-06T17:00:04.051340] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-06T17:00:04.051418] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-06T17:00:04.051466] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-06T17:00:04.051545] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-06T17:00:04.051591] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-06T17:00:04.051631] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-06T17:00:04.052233] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-06T17:00:04.052299] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-06T17:00:04.052523] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-06T17:00:04.052579] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-06T17:00:04.052625] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-06T17:00:04.052714] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-06T17:00:04.091802] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-06T17:00:04.119326] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-06T17:00:04.119530] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-06T17:00:04.119569] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-06T17:00:04.119599] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-06T17:00:04.119681] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-06T17:00:04.120069] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-06T17:00:04.120107] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-06T17:00:04.120139] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-10-06T17:00:04.120167] [INFO ] [MAIN ] Running in parallel mode [2025-10-06T17:00:04.120372] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-10-06T17:00:04.738503] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:04.824373] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:04.892359] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:04.903348] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-06T17:00:04.926548] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:04.927181] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-06T17:00:04.927252] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-06T17:00:04.927057] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-06T17:00:04.928658] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-06T17:00:04.928829] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-06T17:00:04.928946] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-06T17:00:04.929003] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-06T17:00:04.950576] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-06T17:00:04.965638] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-06T17:00:04.972495] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-06T17:00:04.983366] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-06T17:00:05.374729] [DEBUG] [LOCAL ] A: Loaded 51488 existing records from primary storage. [2025-10-06T17:00:05.382135] [DEBUG] [LOCAL ] AA: Loaded 54395 existing records from primary storage. [2025-10-06T17:00:05.410512] [INFO ] [MAIN ] AA: Loaded 54395 existing records. [2025-10-06T17:00:05.423548] [INFO ] [MAIN ] A: Loaded 51488 existing records. [2025-10-06T17:00:06.198106] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:06.225387] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-06T17:00:06.194017] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:00:06.264936] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:00:06.265718] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-06T17:00:06.265564] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-06T17:00:06.287722] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:06.288040] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-06T17:00:06.287932] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-06T17:00:06.288405] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-06T17:00:06.289946] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-06T17:00:06.290083] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-06T17:00:06.290162] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-06T17:00:06.290335] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-06T17:00:06.636618] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:00:06.662828] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-06T17:00:06.790796] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:00:06.851963] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-06T17:00:06.902411] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:00:06.876268] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-06T17:00:06.913296] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-06T17:00:06.961889] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-06T17:00:06.962050] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-06T17:00:06.967516] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-06T17:00:06.989933] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-06T17:00:07.052003] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 2.8s. Estimated remaining: 1h 55m 48s. Rate: 20.5 symbols/min [2025-10-06T17:00:07.073685] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:07.124727] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-06T17:00:07.191714] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:07.216976] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-06T17:00:07.325240] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:07.361183] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-06T17:00:07.362444] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-06T17:00:07.385393] [DEBUG] [LOCAL ] AAP: Loaded 52648 existing records from primary storage. [2025-10-06T17:00:07.385850] [INFO ] [MAIN ] AAP: Loaded 52648 existing records. [2025-10-06T17:00:07.559773] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:00:07.560029] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-06T17:00:07.560080] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-06T17:00:07.560498] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-06T17:00:07.560559] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-06T17:00:07.750209] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-06T17:00:07.798274] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-06T17:00:07.949073] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:07.949471] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-06T17:00:08.257562] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-06T17:00:08.258757] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-06T17:00:08.746824] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-06T17:00:08.748024] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-06T17:00:08.986806] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-06T17:00:08.987927] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-06T17:00:09.150188] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-06T17:00:09.160900] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-06T17:00:09.213567] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-06T17:00:09.225042] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-06T17:00:09.245478] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-06T17:00:09.246591] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-06T17:00:09.747524] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-06T17:00:09.748747] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-06T17:00:09.800029] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T17:00:09.811203] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-06T17:00:10.070497] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-06T17:00:10.071768] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-06T17:00:10.418711] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-06T17:00:10.420037] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-06T17:00:10.784175] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T17:00:10.794626] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-06T17:00:10.874797] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T17:00:10.875754] [INFO ] [REMOTE ] AAM: Full fetch complete (939 records). [2025-10-06T17:00:10.875835] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-06T17:00:10.876258] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:00:10.876345] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:00:10.876390] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:00:10.876458] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-06T17:00:10.876526] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-06T17:00:10.876563] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-06T17:00:10.876602] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-06T17:00:10.876690] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 6.7s. Estimated remaining: 2h 13m 23s. Rate: 17.8 symbols/min [2025-10-06T17:00:11.048821] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T17:00:11.106841] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-06T17:00:11.129224] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:11.171745] [DEBUG] [LOCAL ] AAT: Loaded 30838 existing records from primary storage. [2025-10-06T17:00:11.172106] [INFO ] [MAIN ] AAT: Loaded 30838 existing records. [2025-10-06T17:00:11.379340] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:00:11.379684] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-06T17:00:11.379857] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-06T17:00:11.380750] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-06T17:00:11.380926] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-06T17:00:11.805956] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:11.801163] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-06T17:00:11.806499] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-06T17:00:11.818174] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-06T17:00:12.510591] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T17:00:12.520797] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-06T17:00:13.009470] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-06T17:00:13.021687] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-06T17:00:13.155338] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T17:00:13.161346] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-06T17:00:13.502435] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T17:00:13.512132] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-06T17:00:14.257358] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T17:00:14.268972] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-06T17:00:14.336510] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T17:00:14.342478] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-06T17:00:14.774809] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T17:00:14.786606] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-06T17:00:15.875383] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-06T17:00:15.891073] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-06T17:00:15.932311] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T17:00:15.955198] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T17:00:15.963742] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-06T17:00:15.963144] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-06T17:00:16.958337] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-06T17:00:16.971249] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-06T17:00:17.373795] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T17:00:17.383595] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-06T17:00:17.506147] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T17:00:17.518486] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-06T17:00:18.972758] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (3.08 seconds). [2025-10-06T17:00:18.986047] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-06T17:00:19.540024] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-06T17:00:19.551597] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-06T17:00:19.779271] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-06T17:00:19.787501] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-06T17:00:20.002732] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-10-06T17:00:20.014397] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-06T17:00:20.845979] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T17:00:20.853236] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-06T17:00:21.151874] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-06T17:00:21.193866] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-06T17:00:21.195618] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T17:00:21.209503] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-06T17:00:21.847361] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T17:00:21.862855] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-06T17:00:21.905522] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T17:00:21.912121] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-06T17:00:22.862685] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T17:00:22.876679] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-06T17:00:22.983669] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T17:00:22.996295] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-06T17:00:23.092375] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-06T17:00:23.099638] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-06T17:00:24.290736] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-06T17:00:24.309348] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-06T17:00:24.439460] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T17:00:24.451686] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-06T17:00:24.488078] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T17:00:24.498432] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-06T17:00:24.833917] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T17:00:24.846861] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-06T17:00:25.817811] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T17:00:25.826253] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-06T17:00:26.082827] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T17:00:26.104488] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T17:00:26.109733] [INFO ] [REMOTE ] A: Full fetch complete (73138 records). [2025-10-06T17:00:26.109259] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-06T17:00:26.110908] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-06T17:00:26.525875] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-06T17:00:26.542559] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-06T17:00:26.543868] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-06T17:00:26.543983] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-06T17:00:26.559824] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-06T17:00:26.570557] [DEBUG] [LOCAL ] A: Trimmed 73138 records to 50749 (keeping 200 days of data) [2025-10-06T17:00:26.572282] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-06T17:00:26.921093] [DEBUG] [LOCAL ] A: Primary data saved (50749 records). [2025-10-06T17:00:26.921293] [INFO ] [MAIN ] A: Full history saved. [2025-10-06T17:00:26.921722] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. A took 22.8s. Estimated remaining: 4h 59m 58s. Rate: 7.9 symbols/min [2025-10-06T17:00:27.046424] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T17:00:27.102257] [INFO ] [REMOTE ] AAT: Full fetch complete (42757 records). [2025-10-06T17:00:27.124719] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:27.124930] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-06T17:00:27.125751] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-06T17:00:27.125832] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-06T17:00:27.125962] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-06T17:00:27.126008] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-06T17:00:27.126055] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-06T17:00:27.126092] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-06T17:00:27.954631] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-06T17:00:27.954121] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:27.955354] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-06T17:00:27.956082] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-06T17:00:27.956725] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-06T17:00:27.956840] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-06T17:00:27.960053] [DEBUG] [LOCAL ] AAT: Trimmed 42757 records to 30297 (keeping 200 days of data) [2025-10-06T17:00:28.176984] [DEBUG] [LOCAL ] AAT: Primary data saved (30297 records). [2025-10-06T17:00:28.177213] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-06T17:00:28.177348] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAT took 17.3s. Estimated remaining: 3h 57m 16s. Rate: 10.0 symbols/min [2025-10-06T17:00:28.293824] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:00:28.306517] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-06T17:00:28.311070] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:00:28.322822] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-06T17:00:28.344611] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:00:28.365766] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-06T17:00:28.394998] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:28.395394] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-06T17:00:28.433288] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-06T17:00:28.433520] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-06T17:00:28.433972] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAUC took 1.5s. Estimated remaining: 3h 11m 45s. Rate: 12.3 symbols/min [2025-10-06T17:00:28.436130] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-06T17:00:28.502512] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-06T17:00:28.696891] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:28.698355] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-06T17:00:28.698058] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-06T17:00:28.698485] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-06T17:00:28.699392] [DEBUG] [LOCAL ] AB: Loaded 27775 existing records from primary storage. [2025-10-06T17:00:28.710753] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-06T17:00:28.711476] [INFO ] [MAIN ] AB: Loaded 27775 existing records. [2025-10-06T17:00:28.711596] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-06T17:00:28.761767] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-06T17:00:28.749862] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-06T17:00:28.763895] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-06T17:00:29.069857] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:00:29.080574] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-06T17:00:29.085842] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-06T17:00:29.091669] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-06T17:00:29.091748] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-06T17:00:29.662564] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:29.683910] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-06T17:00:29.784838] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:29.785236] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-06T17:00:30.497783] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-06T17:00:30.501891] [INFO ] [REMOTE ] AA: Full fetch complete (77540 records). [2025-10-06T17:00:30.502060] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-06T17:00:30.832506] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-06T17:00:30.862892] [INFO ] [REMOTE ] AAP: Full fetch complete (75011 records). [2025-10-06T17:00:30.888525] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-06T17:00:30.976220] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-06T17:00:30.988089] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-06T17:00:31.017455] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-06T17:00:31.034323] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-06T17:00:31.119493] [DEBUG] [LOCAL ] AA: Trimmed 77540 records to 53616 (keeping 200 days of data) [2025-10-06T17:00:31.503368] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-06T17:00:31.503557] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-06T17:00:31.504518] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-06T17:00:31.505205] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-06T17:00:31.518539] [DEBUG] [LOCAL ] AAP: Trimmed 75011 records to 51911 (keeping 200 days of data) [2025-10-06T17:00:31.607888] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T17:00:31.655750] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-06T17:00:32.057051] [DEBUG] [LOCAL ] AA: Primary data saved (53616 records). [2025-10-06T17:00:32.058912] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-06T17:00:32.059595] [INFO ] [MAIN ] AA: Full history saved. [2025-10-06T17:00:32.073278] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-06T17:00:32.070797] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AA took 27.9s. Estimated remaining: 3h 3m 37s. Rate: 12.9 symbols/min [2025-10-06T17:00:32.262686] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:32.355147] [DEBUG] [LOCAL ] ABCB: Loaded 30916 existing records from primary storage. [2025-10-06T17:00:32.362847] [DEBUG] [LOCAL ] AAP: Primary data saved (51911 records). [2025-10-06T17:00:32.363496] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-06T17:00:32.363986] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AAP took 25.3s. Estimated remaining: 2h 38m 58s. Rate: 14.9 symbols/min [2025-10-06T17:00:32.363387] [INFO ] [MAIN ] ABCB: Loaded 30916 existing records. [2025-10-06T17:00:32.741889] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:32.751621] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:00:32.752563] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-06T17:00:32.752696] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-06T17:00:32.753203] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-06T17:00:32.753292] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-06T17:00:33.129060] [DEBUG] [LOCAL ] ABEV: Loaded 54058 existing records from primary storage. [2025-10-06T17:00:33.188494] [INFO ] [MAIN ] ABEV: Loaded 54058 existing records. [2025-10-06T17:00:33.296802] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:33.306188] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-06T17:00:33.331520] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-06T17:00:33.385342] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-06T17:00:33.473782] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:00:33.474115] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-06T17:00:33.474217] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-06T17:00:33.474585] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-06T17:00:33.474683] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-06T17:00:33.871359] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:33.871922] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-06T17:00:34.073907] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-06T17:00:34.084539] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-06T17:00:34.552695] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T17:00:34.558864] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-06T17:00:35.024470] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T17:00:35.033711] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-06T17:00:35.524460] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T17:00:35.558195] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-06T17:00:35.563542] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T17:00:35.574967] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-06T17:00:35.933451] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-06T17:00:35.943697] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-06T17:00:36.629739] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T17:00:36.640178] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-06T17:00:36.798479] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T17:00:36.804952] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-06T17:00:37.483099] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-06T17:00:37.494093] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-06T17:00:37.974200] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-06T17:00:37.981977] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-06T17:00:38.049322] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-06T17:00:38.061089] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-06T17:00:38.224000] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T17:00:38.232837] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-06T17:00:38.921900] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-06T17:00:38.932291] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-06T17:00:39.069251] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T17:00:39.077600] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-06T17:00:39.470009] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T17:00:39.476230] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-06T17:00:40.241631] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T17:00:40.248136] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-06T17:00:40.418587] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T17:00:40.430904] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-06T17:00:40.526627] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-06T17:00:40.538183] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-06T17:00:40.666427] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T17:00:40.672221] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-06T17:00:41.322207] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T17:00:41.327997] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-06T17:00:41.598413] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T17:00:41.604458] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-06T17:00:42.340091] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T17:00:42.358447] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-06T17:00:42.400870] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T17:00:42.432483] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T17:00:42.443970] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-06T17:00:42.444635] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-06T17:00:42.461330] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T17:00:42.468632] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-06T17:00:43.225066] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-06T17:00:43.230630] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-06T17:00:43.737315] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T17:00:43.744042] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-06T17:00:43.955941] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T17:00:43.968006] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-06T17:00:43.997579] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T17:00:44.010077] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-06T17:00:44.059181] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T17:00:44.060912] [INFO ] [REMOTE ] AB: Full fetch complete (45402 records). [2025-10-06T17:00:44.061011] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-06T17:00:44.434485] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-06T17:00:44.434579] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-06T17:00:44.435030] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-06T17:00:44.435094] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-06T17:00:44.436048] [DEBUG] [LOCAL ] AB: Trimmed 45402 records to 26855 (keeping 200 days of data) [2025-10-06T17:00:44.602068] [DEBUG] [LOCAL ] AB: Primary data saved (26855 records). [2025-10-06T17:00:44.602251] [INFO ] [MAIN ] AB: Full history saved. [2025-10-06T17:00:44.602396] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 16.4s. Estimated remaining: 3h 19m 17s. Rate: 11.9 symbols/min [2025-10-06T17:00:44.771598] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:44.771779] [DEBUG] [LOCAL ] ABG: No existing data file found in primary storage. [2025-10-06T17:00:44.771825] [WARN ] [MAIN ] ABG: No existing data found, performing full refresh instead. [2025-10-06T17:00:44.771942] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-06T17:00:44.771986] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-06T17:00:44.772030] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-06T17:00:44.772076] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-06T17:00:45.128005] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:45.128471] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-06T17:00:45.288372] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T17:00:45.295479] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-06T17:00:45.616047] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T17:00:45.626814] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-06T17:00:46.152254] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-06T17:00:46.165907] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-06T17:00:46.291073] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T17:00:46.294788] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-06T17:00:46.300147] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T17:00:46.302436] [INFO ] [REMOTE ] ABCB: Full fetch complete (44572 records). [2025-10-06T17:00:46.302540] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-06T17:00:46.682213] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-06T17:00:46.682318] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-06T17:00:46.682812] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-06T17:00:46.682878] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-06T17:00:46.684130] [DEBUG] [LOCAL ] ABCB: Trimmed 44572 records to 30452 (keeping 200 days of data) [2025-10-06T17:00:46.881145] [DEBUG] [LOCAL ] ABCB: Primary data saved (30452 records). [2025-10-06T17:00:46.881319] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-06T17:00:46.882468] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 14.8s. Estimated remaining: 3h 7m 3s. Rate: 12.6 symbols/min [2025-10-06T17:00:47.050740] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:47.087508] [DEBUG] [LOCAL ] ABM: Loaded 32469 existing records from primary storage. [2025-10-06T17:00:47.087876] [INFO ] [MAIN ] ABM: Loaded 32469 existing records. [2025-10-06T17:00:47.341478] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:00:47.341945] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-06T17:00:47.342104] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-06T17:00:47.342447] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-06T17:00:47.342526] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-06T17:00:47.470613] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T17:00:47.514980] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-06T17:00:47.758617] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:47.773023] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-06T17:00:47.776280] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-06T17:00:47.789667] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-06T17:00:47.823463] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T17:00:47.835023] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-06T17:00:48.670145] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T17:00:48.674056] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-06T17:00:49.218086] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T17:00:49.246384] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-06T17:00:49.248830] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T17:00:49.256107] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-06T17:00:49.484875] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T17:00:49.496783] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-06T17:00:49.640514] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T17:00:49.646275] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-06T17:00:50.137071] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T17:00:50.140271] [INFO ] [REMOTE ] ABBV: Full fetch complete (77720 records). [2025-10-06T17:00:50.140429] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-06T17:00:50.554884] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T17:00:50.586192] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-06T17:00:50.586010] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-06T17:00:50.587202] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-06T17:00:50.588233] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-06T17:00:50.588410] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-06T17:00:50.590394] [DEBUG] [LOCAL ] ABBV: Trimmed 77720 records to 53685 (keeping 200 days of data) [2025-10-06T17:00:50.945146] [DEBUG] [LOCAL ] ABBV: Primary data saved (53685 records). [2025-10-06T17:00:50.945415] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-06T17:00:50.945518] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABBV took 22.5s. Estimated remaining: 3h 4m 15s. Rate: 12.8 symbols/min [2025-10-06T17:00:51.074128] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T17:00:51.121537] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-06T17:00:51.156071] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:51.193401] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-06T17:00:51.206397] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-06T17:00:51.252065] [DEBUG] [LOCAL ] ABR: Loaded 52754 existing records from primary storage. [2025-10-06T17:00:51.252487] [INFO ] [MAIN ] ABR: Loaded 52754 existing records. [2025-10-06T17:00:51.428146] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:00:51.428408] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-06T17:00:51.428458] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-06T17:00:51.428868] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-06T17:00:51.428928] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-06T17:00:51.807005] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:51.821242] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-06T17:00:51.823148] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T17:00:51.830675] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-06T17:00:51.897438] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T17:00:51.901155] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-06T17:00:52.626182] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T17:00:52.629587] [INFO ] [REMOTE ] ABEV: Full fetch complete (76831 records). [2025-10-06T17:00:52.629814] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-06T17:00:52.630841] [FATAL] [VALIDATOR ] ABEV: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:00:52.630944] [FATAL] [MAIN ] ABEV: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:00:52.631034] [WARN ] [MAIN ] ABEV: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:00:52.631126] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-06T17:00:52.631253] [DEBUG] [LOCAL ] ABEV: No primary data file found to delete. [2025-10-06T17:00:52.631317] [INFO ] [LOCAL ] ABEV: Starting deletion of derivative data. [2025-10-06T17:00:52.631677] [DEBUG] [LOCAL ] ABEV: Deleted derivative data file. [2025-10-06T17:00:52.631781] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABEV took 20.3s. Estimated remaining: 2h 53m 28s. Rate: 13.6 symbols/min [2025-10-06T17:00:52.875296] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:52.886709] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T17:00:52.891330] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-06T17:00:52.957605] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-10-06T17:00:52.958225] [INFO ] [MAIN ] ABT: Loaded 54400 existing records. [2025-10-06T17:00:53.171315] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:00:53.171664] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-06T17:00:53.171743] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-06T17:00:53.172181] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-06T17:00:53.172259] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-06T17:00:53.299863] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-06T17:00:53.341456] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-06T17:00:53.594591] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:53.595331] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-06T17:00:53.617622] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T17:00:53.624892] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-06T17:00:53.702497] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T17:00:53.715939] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-06T17:00:54.742891] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T17:00:54.770242] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-06T17:00:54.776994] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T17:00:54.786949] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-06T17:00:55.513466] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T17:00:55.525523] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-06T17:00:55.616053] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-06T17:00:55.627204] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-06T17:00:55.876509] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T17:00:55.880695] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-06T17:00:55.929490] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T17:00:55.935389] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-06T17:00:56.893860] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T17:00:56.895548] [INFO ] [REMOTE ] ABG: Full fetch complete (26696 records). [2025-10-06T17:00:56.895685] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-06T17:00:57.335239] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-06T17:00:57.339714] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T17:00:57.338834] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-06T17:00:57.348463] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-06T17:00:57.347840] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-06T17:00:57.348792] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-06T17:00:57.407364] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-06T17:00:57.409067] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T17:00:57.430726] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-06T17:00:57.431735] [DEBUG] [LOCAL ] ABG: Trimmed 26696 records to 18626 (keeping 200 days of data) [2025-10-06T17:00:57.432028] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-06T17:00:57.554594] [DEBUG] [LOCAL ] ABG: Primary data saved (18626 records). [2025-10-06T17:00:57.554977] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-06T17:00:57.555154] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABG took 13.0s. Estimated remaining: 2h 55m 4s. Rate: 13.5 symbols/min [2025-10-06T17:00:57.735840] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:00:57.760782] [DEBUG] [LOCAL ] ACA: Loaded 23677 existing records from primary storage. [2025-10-06T17:00:57.761120] [INFO ] [MAIN ] ACA: Loaded 23677 existing records. [2025-10-06T17:00:57.950868] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:00:57.951177] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-06T17:00:57.951240] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-06T17:00:57.951795] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-06T17:00:57.951874] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-06T17:00:58.321987] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:00:58.322362] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-06T17:00:58.740106] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T17:00:58.747499] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-06T17:00:59.012321] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T17:00:59.024224] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-06T17:00:59.145155] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T17:00:59.155427] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-06T17:00:59.497075] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T17:00:59.501838] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-06T17:01:00.248412] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T17:01:00.255453] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-06T17:01:00.607060] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T17:01:00.613460] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-06T17:01:01.787031] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-06T17:01:01.799110] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-06T17:01:01.935135] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-10-06T17:01:01.949001] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-06T17:01:02.206546] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-06T17:01:02.214988] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-06T17:01:02.480180] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-06T17:01:02.485721] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-06T17:01:03.407814] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T17:01:03.409718] [INFO ] [REMOTE ] ABM: Full fetch complete (44786 records). [2025-10-06T17:01:03.409817] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-06T17:01:03.410445] [FATAL] [VALIDATOR ] ABM: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:01:03.410531] [FATAL] [MAIN ] ABM: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:01:03.410574] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:01:03.410664] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-06T17:01:03.410785] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-06T17:01:03.410843] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-10-06T17:01:03.411021] [DEBUG] [LOCAL ] ABM: Deleted derivative data file. [2025-10-06T17:01:03.412089] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 16.5s. Estimated remaining: 2h 59m 15s. Rate: 13.2 symbols/min [2025-10-06T17:01:03.601629] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:01:03.637015] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T17:01:03.649396] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-06T17:01:03.683425] [DEBUG] [LOCAL ] ACCO: Loaded 37807 existing records from primary storage. [2025-10-06T17:01:03.683814] [INFO ] [MAIN ] ACCO: Loaded 37807 existing records. [2025-10-06T17:01:03.875166] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:01:03.875534] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-06T17:01:03.875698] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-06T17:01:03.876057] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-06T17:01:03.876218] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-06T17:01:04.019774] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T17:01:04.049513] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-06T17:01:04.355138] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:01:04.355583] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-06T17:01:04.955098] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-10-06T17:01:04.966238] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-06T17:01:05.302754] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T17:01:05.315316] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-06T17:01:05.469323] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-06T17:01:05.475807] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-06T17:01:05.512974] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T17:01:05.520465] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-06T17:01:06.575581] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T17:01:06.582142] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-06T17:01:06.664627] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T17:01:06.676352] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-06T17:01:06.998310] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-06T17:01:07.008804] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-06T17:01:07.269348] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-06T17:01:07.280614] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-06T17:01:07.688744] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T17:01:07.694041] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-06T17:01:08.173993] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T17:01:08.181988] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-06T17:01:08.724286] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-06T17:01:08.737768] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-06T17:01:08.927781] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T17:01:08.933325] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-06T17:01:09.308911] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-06T17:01:09.425595] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-06T17:01:09.639077] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T17:01:10.225608] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-06T17:01:10.262543] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T17:01:10.583900] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T17:01:11.025499] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-06T17:01:11.378868] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T17:01:11.805549] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T17:01:11.825470] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-06T17:01:12.625504] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-06T17:01:12.813493] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T17:01:13.349459] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T17:01:13.425481] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-06T17:01:14.225551] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-06T17:01:14.438841] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T17:01:15.025529] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-06T17:01:15.124333] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T17:01:15.670811] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T17:01:15.674147] [INFO ] [REMOTE ] ABT: Full fetch complete (77596 records). [2025-10-06T17:01:15.674347] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-06T17:01:15.825934] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-06T17:01:16.022324] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-06T17:01:16.089037] [INFO ] [REMOTE ] ABR: Full fetch complete (75263 records). [2025-10-06T17:01:16.112095] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-06T17:01:16.116579] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-06T17:01:16.116873] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-06T17:01:16.117733] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-06T17:01:16.123549] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-06T17:01:16.217930] [DEBUG] [LOCAL ] ABT: Trimmed 77596 records to 53620 (keeping 200 days of data) [2025-10-06T17:01:16.626746] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-06T17:01:16.677341] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-06T17:01:16.678933] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-06T17:01:16.680900] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-06T17:01:16.681209] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-06T17:01:16.686743] [DEBUG] [LOCAL ] ABR: Trimmed 75263 records to 52007 (keeping 200 days of data) [2025-10-06T17:01:16.944500] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T17:01:17.278457] [DEBUG] [LOCAL ] ABT: Primary data saved (53620 records). [2025-10-06T17:01:17.280068] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-06T17:01:17.280218] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ABT took 24.6s. Estimated remaining: 3h 25m 17s. Rate: 11.5 symbols/min [2025-10-06T17:01:17.426908] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-06T17:01:17.482578] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:01:17.484999] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-06T17:01:17.486784] [DEBUG] [LOCAL ] ABR: Primary data saved (52007 records). [2025-10-06T17:01:17.486634] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-06T17:01:17.487415] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-06T17:01:17.487278] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-06T17:01:17.489002] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABR took 26.5s. Estimated remaining: 3h 12m 4s. Rate: 12.3 symbols/min [2025-10-06T17:01:17.534330] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-06T17:01:17.556208] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-06T17:01:17.561756] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-06T17:01:17.807366] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:01:17.857485] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-10-06T17:01:17.908498] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-10-06T17:01:17.908851] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-06T17:01:17.917700] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-06T17:01:17.917892] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-06T17:01:17.917960] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-06T17:01:18.152433] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:01:18.227410] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-06T17:01:18.407466] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T17:01:18.453914] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:01:18.469257] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-06T17:01:18.470718] [INFO ] [REMOTE ] ACA: Full fetch complete (34260 records). [2025-10-06T17:01:18.470797] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-06T17:01:18.471300] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:01:18.471477] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:01:18.471568] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:01:18.471660] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-06T17:01:18.471757] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-06T17:01:18.471796] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-06T17:01:18.472012] [DEBUG] [LOCAL ] ACA: Deleted derivative data file. [2025-10-06T17:01:18.472106] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ACA took 20.9s. Estimated remaining: 3h 2m 24s. Rate: 12.9 symbols/min [2025-10-06T17:01:18.644729] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:01:18.697364] [DEBUG] [LOCAL ] ACI: Loaded 54030 existing records from primary storage. [2025-10-06T17:01:18.697800] [INFO ] [MAIN ] ACI: Loaded 54030 existing records. [2025-10-06T17:01:18.878092] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:01:18.878422] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-06T17:01:18.878490] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-06T17:01:18.879089] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-06T17:01:18.879162] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-06T17:01:19.030627] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-06T17:01:19.285121] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:01:19.585425] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T17:01:19.825532] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-06T17:01:20.450959] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T17:01:20.582051] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-06T17:01:20.625528] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-06T17:01:21.425548] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-06T17:01:21.766966] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-06T17:01:22.225531] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-06T17:01:23.025548] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-06T17:01:23.518452] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-06T17:01:23.825539] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-06T17:01:24.066754] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T17:01:24.123281] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-06T17:01:24.625520] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-06T17:01:24.966916] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T17:01:25.425522] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-06T17:01:25.989777] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T17:01:25.992054] [INFO ] [REMOTE ] ACCO: Full fetch complete (54009 records). [2025-10-06T17:01:25.992255] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-06T17:01:26.231173] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-06T17:01:26.388351] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-06T17:01:26.388489] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-06T17:01:26.389087] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-06T17:01:26.389155] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-06T17:01:26.390499] [DEBUG] [LOCAL ] ACCO: Trimmed 54009 records to 37176 (keeping 200 days of data) [2025-10-06T17:01:26.608016] [DEBUG] [LOCAL ] ACCO: Primary data saved (37176 records). [2025-10-06T17:01:26.608295] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-06T17:01:26.609241] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 23.2s. Estimated remaining: 3h 10m 22s. Rate: 12.4 symbols/min [2025-10-06T17:01:26.789632] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:01:26.809144] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T17:01:26.871516] [DEBUG] [LOCAL ] ACM: Loaded 43665 existing records from primary storage. [2025-10-06T17:01:26.872009] [INFO ] [MAIN ] ACM: Loaded 43665 existing records. [2025-10-06T17:01:27.030639] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-06T17:01:27.051628] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:01:27.052678] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-06T17:01:27.052740] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-06T17:01:27.053117] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-06T17:01:27.053177] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-06T17:01:27.402579] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:01:27.825514] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-06T17:01:28.005426] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T17:01:28.241159] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T17:01:28.625528] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-06T17:01:29.401258] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T17:01:29.425477] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-06T17:01:29.858435] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T17:01:30.225558] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-06T17:01:31.025524] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-06T17:01:31.122992] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T17:01:31.825550] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-06T17:01:32.625556] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-06T17:01:32.714509] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T17:01:32.769709] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-06T17:01:33.419074] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T17:01:33.427351] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-06T17:01:33.551675] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T17:01:34.225526] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-06T17:01:35.025596] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-06T17:01:35.383413] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-06T17:01:35.825511] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-06T17:01:36.005507] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-06T17:01:36.625571] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-06T17:01:36.737566] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T17:01:37.425552] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-06T17:01:37.477983] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T17:01:38.225577] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-06T17:01:38.950095] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-06T17:01:39.005194] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T17:01:39.007094] [INFO ] [REMOTE ] ACEL: Full fetch complete (38721 records). [2025-10-06T17:01:39.007219] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-06T17:01:39.030632] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-06T17:01:39.365489] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T17:01:39.453732] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-06T17:01:39.453838] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-06T17:01:39.454259] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-06T17:01:39.454301] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-06T17:01:39.455231] [DEBUG] [LOCAL ] ACEL: Trimmed 38721 records to 26688 (keeping 200 days of data) [2025-10-06T17:01:39.611509] [DEBUG] [LOCAL ] ACEL: Primary data saved (26688 records). [2025-10-06T17:01:39.611708] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-06T17:01:39.611804] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 22.3s. Estimated remaining: 3h 28m 3s. Rate: 11.3 symbols/min [2025-10-06T17:01:39.777922] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:01:39.830637] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-06T17:01:39.834259] [DEBUG] [LOCAL ] ACN: Loaded 54205 existing records from primary storage. [2025-10-06T17:01:39.834744] [INFO ] [MAIN ] ACN: Loaded 54205 existing records. [2025-10-06T17:01:40.059801] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:01:40.060490] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-06T17:01:40.060575] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-06T17:01:40.061228] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-06T17:01:40.061288] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-06T17:01:40.496773] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:01:40.625490] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-06T17:01:41.425503] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-06T17:01:41.591383] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-06T17:01:41.639622] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T17:01:42.225599] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-06T17:01:42.436218] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T17:01:43.025500] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-06T17:01:43.277942] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T17:01:43.825578] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-06T17:01:44.524668] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-06T17:01:44.625496] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-06T17:01:44.947772] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-06T17:01:45.433721] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-06T17:01:45.456988] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T17:01:45.910547] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-06T17:01:46.225570] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-06T17:01:47.025583] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-06T17:01:47.499906] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-06T17:01:47.613814] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T17:01:47.825564] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-06T17:01:48.625494] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-06T17:01:48.758434] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T17:01:49.425526] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-06T17:01:49.509146] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T17:01:50.225545] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-06T17:01:51.016954] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T17:01:51.027162] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-06T17:01:51.290860] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-06T17:01:51.825550] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-06T17:01:51.851403] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T17:01:51.854975] [INFO ] [REMOTE ] ACM: Full fetch complete (62784 records). [2025-10-06T17:01:51.855195] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-06T17:01:52.245348] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-06T17:01:52.245464] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-06T17:01:52.246234] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-06T17:01:52.246308] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-06T17:01:52.247804] [DEBUG] [LOCAL ] ACM: Trimmed 62784 records to 43034 (keeping 200 days of data) [2025-10-06T17:01:52.523876] [DEBUG] [LOCAL ] ACM: Primary data saved (43034 records). [2025-10-06T17:01:52.524045] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-06T17:01:52.525302] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACM took 25.9s. Estimated remaining: 3h 43m 39s. Rate: 10.5 symbols/min [2025-10-06T17:01:52.625771] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-06T17:01:52.702790] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:01:52.732432] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T17:01:52.773590] [DEBUG] [LOCAL ] ACP: Loaded 31458 existing records from primary storage. [2025-10-06T17:01:52.773948] [INFO ] [MAIN ] ACP: Loaded 31458 existing records. [2025-10-06T17:01:52.948824] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:01:52.949110] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-06T17:01:52.949164] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-06T17:01:52.949515] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-06T17:01:52.949581] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-06T17:01:53.306411] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:01:53.425597] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-06T17:01:54.230350] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-06T17:01:54.237375] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T17:01:54.565561] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-06T17:01:55.025534] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-06T17:01:55.089042] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T17:01:55.459617] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T17:01:55.825574] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-06T17:01:56.439448] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T17:01:56.625536] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-06T17:01:57.131036] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T17:01:57.425582] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-06T17:01:58.225565] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-06T17:01:58.501311] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T17:01:59.025498] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-06T17:01:59.398905] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T17:01:59.825591] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-06T17:02:00.625548] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-06T17:02:00.672607] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-06T17:02:00.675747] [INFO ] [REMOTE ] ACI: Full fetch complete (77045 records). [2025-10-06T17:02:00.675914] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-06T17:02:01.084828] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-06T17:02:01.085070] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-06T17:02:01.085907] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-06T17:02:01.086049] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-06T17:02:01.119126] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-10-06T17:02:01.119327] [DEBUG] [LOCAL ] ACI: Trimmed 77045 records to 53254 (keeping 200 days of data) [2025-10-06T17:02:01.430682] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-06T17:02:01.456077] [DEBUG] [LOCAL ] ACI: Primary data saved (53254 records). [2025-10-06T17:02:01.456258] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-06T17:02:01.456350] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACI took 43.0s. Estimated remaining: 3h 49m 53s. Rate: 10.2 symbols/min [2025-10-06T17:02:01.637989] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:02:01.647042] [DEBUG] [LOCAL ] ACR: Loaded 6006 existing records from primary storage. [2025-10-06T17:02:01.647343] [INFO ] [MAIN ] ACR: Loaded 6006 existing records. [2025-10-06T17:02:01.843402] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:02:01.844023] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-06T17:02:01.844283] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-06T17:02:01.844772] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-06T17:02:01.844838] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-06T17:02:02.132073] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T17:02:02.235915] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-06T17:02:02.334493] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:02:02.338859] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-06T17:02:03.025580] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-06T17:02:03.434123] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T17:02:03.825516] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-06T17:02:03.858284] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-06T17:02:03.971259] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-06T17:02:04.625561] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-06T17:02:05.425593] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-06T17:02:05.933900] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-06T17:02:06.225548] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-06T17:02:07.036405] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-06T17:02:07.038405] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T17:02:07.128266] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-06T17:02:07.132117] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-06T17:02:07.132318] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-06T17:02:07.519844] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-06T17:02:07.519948] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-06T17:02:07.520695] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-06T17:02:07.520766] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-06T17:02:07.522776] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-06T17:02:07.736923] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-06T17:02:07.838639] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-06T17:02:07.867996] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-06T17:02:07.868184] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-06T17:02:07.868267] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 50.4s. Estimated remaining: 3h 50m 48s. Rate: 10.2 symbols/min [2025-10-06T17:02:08.036069] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:02:08.068191] [DEBUG] [LOCAL ] ACRE: Loaded 34079 existing records from primary storage. [2025-10-06T17:02:08.068526] [INFO ] [MAIN ] ACRE: Loaded 34079 existing records. [2025-10-06T17:02:08.250702] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:02:08.251097] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-06T17:02:08.251150] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-06T17:02:08.251436] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-06T17:02:08.251496] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-06T17:02:08.573806] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-06T17:02:08.630602] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-06T17:02:08.704915] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:02:09.249001] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T17:02:09.309274] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-06T17:02:09.425534] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-06T17:02:10.225511] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-06T17:02:10.292685] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-06T17:02:11.025538] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-06T17:02:11.723216] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T17:02:11.825550] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-06T17:02:12.357294] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-06T17:02:12.625534] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-06T17:02:13.425507] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-06T17:02:13.572900] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T17:02:14.013880] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-06T17:02:14.225535] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-06T17:02:14.739858] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-06T17:02:14.918833] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-06T17:02:15.025479] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-06T17:02:15.825519] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-06T17:02:16.625506] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-06T17:02:16.749182] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-06T17:02:16.752293] [INFO ] [REMOTE ] ACN: Full fetch complete (77148 records). [2025-10-06T17:02:16.752447] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-06T17:02:17.159215] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-06T17:02:17.189248] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-06T17:02:17.189394] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-06T17:02:17.190301] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-06T17:02:17.190441] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-06T17:02:17.192260] [DEBUG] [LOCAL ] ACN: Trimmed 77148 records to 53428 (keeping 200 days of data) [2025-10-06T17:02:17.410093] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T17:02:17.425620] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-06T17:02:17.533524] [DEBUG] [LOCAL ] ACN: Primary data saved (53428 records). [2025-10-06T17:02:17.533715] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-06T17:02:17.533820] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 37.9s. Estimated remaining: 3h 57m 25s. Rate: 9.9 symbols/min [2025-10-06T17:02:17.701599] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:02:17.711681] [DEBUG] [LOCAL ] ACV: Loaded 7512 existing records from primary storage. [2025-10-06T17:02:17.711918] [INFO ] [MAIN ] ACV: Loaded 7512 existing records. [2025-10-06T17:02:17.891001] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:02:17.891283] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-06T17:02:17.891354] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-06T17:02:17.891518] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-06T17:02:17.891575] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-06T17:02:18.072144] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-06T17:02:18.230616] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-06T17:02:18.279080] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:02:19.025527] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-06T17:02:19.701065] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T17:02:19.825531] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-06T17:02:19.876394] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T17:02:20.625527] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-06T17:02:21.356439] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-06T17:02:21.425567] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-06T17:02:22.086640] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T17:02:22.225562] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-06T17:02:22.804766] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T17:02:22.846748] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T17:02:23.025531] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-06T17:02:23.623273] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T17:02:23.825559] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-06T17:02:24.625608] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-06T17:02:25.269896] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T17:02:25.425547] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-06T17:02:25.541989] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-06T17:02:26.225527] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-06T17:02:26.389064] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T17:02:26.391308] [INFO ] [REMOTE ] ACP: Full fetch complete (47067 records). [2025-10-06T17:02:26.391395] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-06T17:02:26.764877] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-06T17:02:26.764979] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-06T17:02:26.765521] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-06T17:02:26.765589] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-06T17:02:26.766593] [DEBUG] [LOCAL ] ACP: Trimmed 47067 records to 30961 (keeping 200 days of data) [2025-10-06T17:02:26.941228] [DEBUG] [LOCAL ] ACP: Primary data saved (30961 records). [2025-10-06T17:02:26.941383] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-06T17:02:26.941470] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACP took 34.4s. Estimated remaining: 4h 3m 0s. Rate: 9.7 symbols/min [2025-10-06T17:02:27.030784] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-06T17:02:27.078541] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-06T17:02:27.133838] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:02:27.183632] [DEBUG] [LOCAL ] ACVA: Loaded 49976 existing records from primary storage. [2025-10-06T17:02:27.184107] [INFO ] [MAIN ] ACVA: Loaded 49976 existing records. [2025-10-06T17:02:27.400420] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:02:27.400760] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-06T17:02:27.400826] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-06T17:02:27.401258] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-06T17:02:27.401317] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-06T17:02:27.746051] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-06T17:02:27.779916] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:02:27.825503] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-06T17:02:28.522946] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-06T17:02:28.625540] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-06T17:02:29.145759] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T17:02:29.146593] [INFO ] [REMOTE ] ACR: Full fetch complete (8608 records). [2025-10-06T17:02:29.146696] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-06T17:02:29.430800] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-06T17:02:29.509358] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-06T17:02:29.509442] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-06T17:02:29.509625] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-06T17:02:29.509713] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-06T17:02:29.510132] [DEBUG] [LOCAL ] ACR: Trimmed 8608 records to 5753 (keeping 200 days of data) [2025-10-06T17:02:29.545132] [DEBUG] [LOCAL ] ACR: Primary data saved (5753 records). [2025-10-06T17:02:29.545232] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-06T17:02:29.545308] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACR took 28.1s. Estimated remaining: 3h 57m 1s. Rate: 9.9 symbols/min [2025-10-06T17:02:29.716343] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:02:29.716713] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-06T17:02:29.716769] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-06T17:02:29.716881] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-06T17:02:29.716922] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-06T17:02:29.716962] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-06T17:02:29.716994] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-06T17:02:30.097468] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:02:30.225690] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-06T17:02:30.444561] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:02:30.445046] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-06T17:02:30.445121] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:02:30.445165] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-06T17:02:30.445226] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:02:30.445304] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-06T17:02:30.445378] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-06T17:02:30.445415] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-06T17:02:30.445471] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-06T17:02:30.445527] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. AD took 0.9s. Estimated remaining: 3h 48m 51s. Rate: 10.3 symbols/min [2025-10-06T17:02:30.659113] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:02:30.713569] [DEBUG] [LOCAL ] ADC: Loaded 46854 existing records from primary storage. [2025-10-06T17:02:30.714009] [INFO ] [MAIN ] ADC: Loaded 46854 existing records. [2025-10-06T17:02:30.924909] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:02:30.925210] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-06T17:02:30.925260] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-06T17:02:30.925801] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-06T17:02:30.925869] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-06T17:02:31.035893] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-06T17:02:31.217963] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T17:02:31.343291] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:02:31.825555] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-06T17:02:32.625511] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-06T17:02:32.741293] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T17:02:33.313872] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T17:02:33.314544] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T17:02:33.425577] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-06T17:02:34.225596] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-06T17:02:34.805768] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-06T17:02:34.805453] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T17:02:35.025575] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-06T17:02:35.825545] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-06T17:02:36.463370] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T17:02:36.625568] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-06T17:02:37.206720] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T17:02:37.295554] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-06T17:02:37.425611] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-06T17:02:38.225640] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-06T17:02:39.037568] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-06T17:02:39.040625] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T17:02:39.712959] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T17:02:39.825559] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-06T17:02:39.867849] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-06T17:02:40.625622] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-06T17:02:41.329942] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T17:02:41.425535] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-06T17:02:42.202452] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T17:02:42.225474] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-06T17:02:42.275353] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-06T17:02:43.025526] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-06T17:02:43.748926] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T17:02:43.804409] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T17:02:43.805931] [INFO ] [REMOTE ] ACV: Full fetch complete (10024 records). [2025-10-06T17:02:43.806022] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-06T17:02:43.807298] [FATAL] [VALIDATOR ] ACV: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:02:43.807559] [FATAL] [MAIN ] ACV: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:02:43.807663] [WARN ] [MAIN ] ACV: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:02:43.807752] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-06T17:02:43.807834] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-06T17:02:43.807874] [INFO ] [LOCAL ] ACV: Starting deletion of derivative data. [2025-10-06T17:02:43.808210] [DEBUG] [LOCAL ] ACV: Deleted derivative data file. [2025-10-06T17:02:43.808334] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACV took 26.3s. Estimated remaining: 4h 0m 3s. Rate: 9.8 symbols/min [2025-10-06T17:02:43.830636] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-06T17:02:43.984923] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:02:44.020314] [DEBUG] [LOCAL ] ADCT: Loaded 35209 existing records from primary storage. [2025-10-06T17:02:44.020694] [INFO ] [MAIN ] ADCT: Loaded 35209 existing records. [2025-10-06T17:02:44.207743] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:02:44.208120] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-06T17:02:44.208184] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-06T17:02:44.208588] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-06T17:02:44.208712] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-06T17:02:44.578468] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:02:44.625491] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-06T17:02:45.112057] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T17:02:45.114323] [INFO ] [REMOTE ] ACRE: Full fetch complete (50531 records). [2025-10-06T17:02:45.114436] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-06T17:02:45.431282] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-06T17:02:45.525105] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-06T17:02:45.525222] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-06T17:02:45.525769] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-06T17:02:45.525836] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-06T17:02:45.527060] [DEBUG] [LOCAL ] ACRE: Trimmed 50531 records to 33652 (keeping 200 days of data) [2025-10-06T17:02:45.719254] [DEBUG] [LOCAL ] ACRE: Primary data saved (33652 records). [2025-10-06T17:02:45.719422] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-06T17:02:45.720416] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACRE took 37.9s. Estimated remaining: 3h 53m 49s. Rate: 10.0 symbols/min [2025-10-06T17:02:45.891766] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:02:45.943023] [DEBUG] [LOCAL ] ADM: Loaded 54167 existing records from primary storage. [2025-10-06T17:02:45.943385] [INFO ] [MAIN ] ADM: Loaded 54167 existing records. [2025-10-06T17:02:46.120987] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:02:46.121200] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-06T17:02:46.121248] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-06T17:02:46.121541] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-06T17:02:46.121606] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-06T17:02:46.230611] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-06T17:02:46.487334] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:02:46.512730] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-06T17:02:47.025547] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-06T17:02:47.122490] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T17:02:47.599718] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T17:02:47.825573] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-06T17:02:48.477390] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T17:02:48.625507] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-06T17:02:49.425496] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-06T17:02:49.878302] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-06T17:02:50.225500] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-06T17:02:50.291128] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T17:02:51.025589] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-06T17:02:51.567815] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-06T17:02:51.825516] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-06T17:02:52.053287] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-06T17:02:52.625547] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-06T17:02:52.755505] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T17:02:53.273009] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T17:02:53.425552] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-06T17:02:54.073479] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T17:02:54.225554] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-06T17:02:55.034018] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-06T17:02:55.054402] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T17:02:55.756085] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T17:02:55.825548] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-06T17:02:56.625630] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-06T17:02:56.672235] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T17:02:57.324385] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T17:02:57.425757] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-06T17:02:57.841547] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T17:02:58.225545] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-06T17:02:59.025486] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-06T17:02:59.234974] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T17:02:59.825521] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-06T17:02:59.918050] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T17:03:00.167008] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T17:03:00.625535] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-06T17:03:01.425598] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-06T17:03:01.809433] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-06T17:03:02.225591] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-06T17:03:02.612837] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-06T17:03:03.025589] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-06T17:03:03.090781] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T17:03:03.828862] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-06T17:03:03.841438] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T17:03:04.625576] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-06T17:03:04.860127] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T17:03:05.255613] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T17:03:05.425729] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-06T17:03:06.164584] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T17:03:06.225481] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-06T17:03:07.025526] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-06T17:03:07.340444] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-06T17:03:07.825521] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-06T17:03:07.888909] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T17:03:08.276294] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T17:03:08.279316] [INFO ] [REMOTE ] ADC: Full fetch complete (66322 records). [2025-10-06T17:03:08.279438] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-06T17:03:08.631081] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-06T17:03:08.676616] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-06T17:03:08.676746] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-06T17:03:08.677396] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-06T17:03:08.677460] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-06T17:03:08.679853] [DEBUG] [LOCAL ] ADC: Trimmed 66322 records to 46204 (keeping 200 days of data) [2025-10-06T17:03:08.959376] [DEBUG] [LOCAL ] ADC: Primary data saved (46204 records). [2025-10-06T17:03:08.959543] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-06T17:03:08.961230] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ADC took 38.5s. Estimated remaining: 4h 17m 47s. Rate: 9.1 symbols/min [2025-10-06T17:03:09.130763] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:03:09.177412] [DEBUG] [LOCAL ] ADNT: Loaded 47831 existing records from primary storage. [2025-10-06T17:03:09.177881] [INFO ] [MAIN ] ADNT: Loaded 47831 existing records. [2025-10-06T17:03:09.353755] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:03:09.353988] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-06T17:03:09.354037] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-06T17:03:09.354355] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-06T17:03:09.354413] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-06T17:03:09.430606] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-06T17:03:09.713706] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:03:09.836434] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-06T17:03:10.225538] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-06T17:03:10.558021] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-06T17:03:10.673988] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-06T17:03:11.025537] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-06T17:03:11.794158] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T17:03:11.825699] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-06T17:03:12.285051] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T17:03:12.288064] [INFO ] [REMOTE ] ACVA: Full fetch complete (70482 records). [2025-10-06T17:03:12.288174] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-06T17:03:12.634798] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-06T17:03:12.696023] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-06T17:03:12.696131] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-06T17:03:12.696815] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-06T17:03:12.696881] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-06T17:03:12.698500] [DEBUG] [LOCAL ] ACVA: Trimmed 70482 records to 49225 (keeping 200 days of data) [2025-10-06T17:03:12.993224] [DEBUG] [LOCAL ] ACVA: Primary data saved (49225 records). [2025-10-06T17:03:12.993401] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-06T17:03:12.993497] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ACVA took 46.1s. Estimated remaining: 4h 14m 13s. Rate: 9.2 symbols/min [2025-10-06T17:03:13.186761] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:03:13.240701] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T17:03:13.277220] [DEBUG] [LOCAL ] ADT: Loaded 54224 existing records from primary storage. [2025-10-06T17:03:13.277787] [INFO ] [MAIN ] ADT: Loaded 54224 existing records. [2025-10-06T17:03:13.432742] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-06T17:03:13.465296] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:03:13.465712] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-06T17:03:13.465770] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-06T17:03:13.466328] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-06T17:03:13.466385] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-06T17:03:13.824534] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:03:14.075552] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T17:03:14.225575] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-06T17:03:14.959006] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T17:03:15.025583] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-06T17:03:15.688926] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T17:03:15.825508] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-06T17:03:16.423091] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T17:03:16.625547] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-06T17:03:16.866999] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-06T17:03:16.869347] [INFO ] [REMOTE ] ADCT: Full fetch complete (51126 records). [2025-10-06T17:03:16.869537] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-06T17:03:16.870340] [FATAL] [VALIDATOR ] ADCT: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:03:16.870443] [FATAL] [MAIN ] ADCT: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:03:16.870486] [WARN ] [MAIN ] ADCT: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:03:16.870534] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-06T17:03:16.870640] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-06T17:03:16.870744] [INFO ] [LOCAL ] ADCT: Starting deletion of derivative data. [2025-10-06T17:03:16.871173] [DEBUG] [LOCAL ] ADCT: Deleted derivative data file. [2025-10-06T17:03:16.871306] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADCT took 33.1s. Estimated remaining: 4h 10m 41s. Rate: 9.3 symbols/min [2025-10-06T17:03:17.046884] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:03:17.078443] [DEBUG] [LOCAL ] ADX: Loaded 27928 existing records from primary storage. [2025-10-06T17:03:17.078793] [INFO ] [MAIN ] ADX: Loaded 27928 existing records. [2025-10-06T17:03:17.256954] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:03:17.257243] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-06T17:03:17.257298] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-06T17:03:17.257636] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-06T17:03:17.257736] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-06T17:03:17.430762] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-06T17:03:17.645691] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:03:18.225486] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-06T17:03:18.504172] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T17:03:19.025545] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-06T17:03:19.464663] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-06T17:03:19.825513] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-06T17:03:19.872440] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T17:03:20.370964] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T17:03:20.625495] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-06T17:03:21.387080] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T17:03:21.425500] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-06T17:03:22.044860] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T17:03:22.225520] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-06T17:03:23.025579] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-06T17:03:23.093218] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T17:03:23.517365] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T17:03:23.825539] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-06T17:03:24.625510] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-06T17:03:24.679293] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T17:03:25.139728] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T17:03:25.425537] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-06T17:03:26.225502] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-06T17:03:26.475801] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T17:03:26.785191] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-06T17:03:27.025592] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-06T17:03:27.831278] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-06T17:03:27.837582] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T17:03:28.625480] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-06T17:03:28.667258] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T17:03:28.921243] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T17:03:29.425557] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-06T17:03:30.225506] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-06T17:03:30.414796] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-06T17:03:30.417882] [INFO ] [REMOTE ] ADM: Full fetch complete (77251 records). [2025-10-06T17:03:30.418030] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-06T17:03:30.856146] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-06T17:03:30.856399] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-06T17:03:30.858135] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-06T17:03:30.858238] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-06T17:03:30.860071] [DEBUG] [LOCAL ] ADM: Trimmed 77251 records to 53390 (keeping 200 days of data) [2025-10-06T17:03:31.053881] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-06T17:03:31.219953] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T17:03:31.259568] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T17:03:31.275937] [DEBUG] [LOCAL ] ADM: Primary data saved (53390 records). [2025-10-06T17:03:31.276121] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-06T17:03:31.277405] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADM took 45.6s. Estimated remaining: 4h 20m 37s. Rate: 9.0 symbols/min [2025-10-06T17:03:31.471068] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:03:31.525310] [DEBUG] [LOCAL ] AEE: Loaded 50827 existing records from primary storage. [2025-10-06T17:03:31.525690] [INFO ] [MAIN ] AEE: Loaded 50827 existing records. [2025-10-06T17:03:31.700396] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:03:31.700688] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-06T17:03:31.700753] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-06T17:03:31.701246] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-06T17:03:31.701315] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-06T17:03:31.838379] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-06T17:03:32.053298] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:03:32.625532] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-06T17:03:32.968203] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T17:03:33.027406] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T17:03:33.425588] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-06T17:03:34.225502] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-06T17:03:34.323584] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T17:03:35.025574] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-06T17:03:35.183376] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T17:03:35.825524] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-06T17:03:35.875767] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T17:03:36.360747] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T17:03:36.625500] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-06T17:03:36.992832] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-06T17:03:37.425586] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-06T17:03:38.225514] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-06T17:03:38.345127] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T17:03:38.392693] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T17:03:39.025538] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-06T17:03:39.789800] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T17:03:39.825593] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-06T17:03:40.005081] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-06T17:03:40.007000] [INFO ] [REMOTE ] ADX: Full fetch complete (41917 records). [2025-10-06T17:03:40.007075] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-06T17:03:40.386203] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-06T17:03:40.386314] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-06T17:03:40.386786] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-06T17:03:40.386848] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-06T17:03:40.387986] [DEBUG] [LOCAL ] ADX: Trimmed 41917 records to 27478 (keeping 200 days of data) [2025-10-06T17:03:40.554198] [DEBUG] [LOCAL ] ADX: Primary data saved (27478 records). [2025-10-06T17:03:40.554369] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-06T17:03:40.554453] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADX took 23.7s. Estimated remaining: 4h 23m 40s. Rate: 8.9 symbols/min [2025-10-06T17:03:40.630603] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-06T17:03:40.729339] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:03:40.739435] [DEBUG] [LOCAL ] AEFC: Loaded 8584 existing records from primary storage. [2025-10-06T17:03:40.739691] [INFO ] [MAIN ] AEFC: Loaded 8584 existing records. [2025-10-06T17:03:40.920880] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:03:40.921310] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-06T17:03:40.921393] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-06T17:03:40.921681] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-06T17:03:40.921740] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-06T17:03:41.081472] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T17:03:41.158333] [INFO ] [REMOTE ] ADNT: Full fetch complete (67934 records). [2025-10-06T17:03:41.184389] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-06T17:03:41.430702] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-06T17:03:41.460049] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:03:41.730094] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-06T17:03:41.730226] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-06T17:03:41.731017] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-06T17:03:41.731089] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-06T17:03:41.733107] [DEBUG] [LOCAL ] ADNT: Trimmed 67934 records to 47236 (keeping 200 days of data) [2025-10-06T17:03:42.023880] [DEBUG] [LOCAL ] ADNT: Primary data saved (47236 records). [2025-10-06T17:03:42.024060] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-06T17:03:42.024805] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADNT took 33.1s. Estimated remaining: 4h 17m 18s. Rate: 9.1 symbols/min [2025-10-06T17:03:42.208523] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:03:42.225503] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-06T17:03:42.262441] [DEBUG] [LOCAL ] AEG: Loaded 50249 existing records from primary storage. [2025-10-06T17:03:42.262885] [INFO ] [MAIN ] AEG: Loaded 50249 existing records. [2025-10-06T17:03:42.456301] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:03:42.456867] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-06T17:03:42.457093] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-06T17:03:42.457477] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-06T17:03:42.457543] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-06T17:03:42.592776] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-06T17:03:42.879997] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:03:43.025495] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-06T17:03:43.173299] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-06T17:03:43.227332] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T17:03:43.825550] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-06T17:03:44.542127] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-06T17:03:44.625503] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-06T17:03:44.737205] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T17:03:45.395673] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-06T17:03:45.425561] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-06T17:03:46.179230] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T17:03:46.225541] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-06T17:03:47.025580] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-06T17:03:47.825544] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-06T17:03:48.610425] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-06T17:03:48.625489] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-06T17:03:48.840264] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-06T17:03:49.063242] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-10-06T17:03:49.405718] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T17:03:49.425470] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-06T17:03:50.136754] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T17:03:50.225592] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-06T17:03:51.025592] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-06T17:03:51.825527] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-06T17:03:51.934442] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T17:03:52.582805] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T17:03:52.611678] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T17:03:52.625492] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-06T17:03:53.425558] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-06T17:03:54.044514] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T17:03:54.225536] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-06T17:03:54.325680] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-06T17:03:55.025628] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-06T17:03:55.825509] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-06T17:03:56.060526] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T17:03:56.421888] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T17:03:56.625515] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-06T17:03:56.970576] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T17:03:57.425532] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-06T17:03:58.225530] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-06T17:03:58.397988] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T17:03:59.025560] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-06T17:03:59.069398] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T17:03:59.074229] [INFO ] [REMOTE ] ADT: Full fetch complete (77188 records). [2025-10-06T17:03:59.074487] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-06T17:03:59.484495] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-06T17:03:59.484668] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-06T17:03:59.485702] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-06T17:03:59.485810] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-06T17:03:59.487768] [DEBUG] [LOCAL ] ADT: Trimmed 77188 records to 53450 (keeping 200 days of data) [2025-10-06T17:03:59.602333] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T17:03:59.825765] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-06T17:03:59.848903] [DEBUG] [LOCAL ] ADT: Primary data saved (53450 records). [2025-10-06T17:03:59.849027] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-06T17:03:59.850305] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADT took 46.9s. Estimated remaining: 4h 30m 3s. Rate: 8.7 symbols/min [2025-10-06T17:04:00.018855] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:04:00.082454] [DEBUG] [LOCAL ] AEM: Loaded 54239 existing records from primary storage. [2025-10-06T17:04:00.082883] [INFO ] [MAIN ] AEM: Loaded 54239 existing records. [2025-10-06T17:04:00.277516] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:04:00.277897] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-06T17:04:00.277975] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-06T17:04:00.278707] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-06T17:04:00.278805] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-06T17:04:00.602563] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T17:04:00.591446] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T17:04:00.614154] [INFO ] [REMOTE ] AEFC: Full fetch complete (12040 records). [2025-10-06T17:04:00.625530] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-06T17:04:00.627081] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-06T17:04:00.806830] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:04:01.124765] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-06T17:04:01.124867] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-06T17:04:01.125086] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-06T17:04:01.125125] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-06T17:04:01.125680] [DEBUG] [LOCAL ] AEFC: Trimmed 12040 records to 8467 (keeping 200 days of data) [2025-10-06T17:04:01.176459] [DEBUG] [LOCAL ] AEFC: Primary data saved (8467 records). [2025-10-06T17:04:01.176623] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-06T17:04:01.176761] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEFC took 20.6s. Estimated remaining: 4h 23m 42s. Rate: 8.9 symbols/min [2025-10-06T17:04:01.343362] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:04:01.398236] [DEBUG] [LOCAL ] AEO: Loaded 54337 existing records from primary storage. [2025-10-06T17:04:01.398669] [INFO ] [MAIN ] AEO: Loaded 54337 existing records. [2025-10-06T17:04:01.430701] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-06T17:04:01.591396] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:04:01.591844] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-06T17:04:01.591921] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-06T17:04:01.592905] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-06T17:04:01.592967] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-06T17:04:01.976917] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:04:02.225543] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-06T17:04:02.369017] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-06T17:04:03.025541] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-06T17:04:03.550755] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-06T17:04:03.825516] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-06T17:04:04.064617] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T17:04:04.625494] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-06T17:04:04.948206] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-06T17:04:05.425518] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-06T17:04:05.762615] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-06T17:04:06.225540] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-06T17:04:06.351508] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T17:04:07.025500] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-06T17:04:07.330276] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T17:04:07.825571] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-06T17:04:08.126408] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-06T17:04:08.625613] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-06T17:04:08.904101] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T17:04:09.277033] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T17:04:09.280004] [INFO ] [REMOTE ] AEE: Full fetch complete (72684 records). [2025-10-06T17:04:09.280112] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-06T17:04:09.433511] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-06T17:04:09.694489] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-06T17:04:09.694598] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-06T17:04:09.695396] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-06T17:04:09.695466] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-06T17:04:09.697074] [DEBUG] [LOCAL ] AEE: Trimmed 72684 records to 50105 (keeping 200 days of data) [2025-10-06T17:04:10.034344] [DEBUG] [LOCAL ] AEE: Primary data saved (50105 records). [2025-10-06T17:04:10.034542] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-06T17:04:10.035970] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEE took 38.8s. Estimated remaining: 4h 25m 50s. Rate: 8.8 symbols/min [2025-10-06T17:04:10.219443] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:04:10.225532] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-06T17:04:10.279357] [DEBUG] [LOCAL ] AER: Loaded 49029 existing records from primary storage. [2025-10-06T17:04:10.279867] [INFO ] [MAIN ] AER: Loaded 49029 existing records. [2025-10-06T17:04:10.477229] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:04:10.477626] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-06T17:04:10.477807] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-06T17:04:10.478367] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-06T17:04:10.478430] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-06T17:04:10.701448] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-06T17:04:10.963187] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:04:11.000307] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T17:04:11.025493] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-06T17:04:11.825563] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-06T17:04:12.128337] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-06T17:04:12.533309] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T17:04:12.625563] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-06T17:04:13.114468] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T17:04:13.425571] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-06T17:04:14.225559] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-06T17:04:14.624129] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-06T17:04:15.025552] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-06T17:04:15.362773] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-06T17:04:15.547188] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T17:04:15.825556] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-06T17:04:16.625575] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-06T17:04:16.790017] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T17:04:17.425533] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-06T17:04:17.928164] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-06T17:04:18.224142] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-06T17:04:18.226014] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-06T17:04:18.227814] [INFO ] [REMOTE ] AEG: Full fetch complete (69989 records). [2025-10-06T17:04:18.227907] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-06T17:04:18.229017] [FATAL] [VALIDATOR ] AEG: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:04:18.229235] [FATAL] [MAIN ] AEG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:04:18.229308] [WARN ] [MAIN ] AEG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:04:18.229394] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-06T17:04:18.229500] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-06T17:04:18.229556] [INFO ] [LOCAL ] AEG: Starting deletion of derivative data. [2025-10-06T17:04:18.229880] [DEBUG] [LOCAL ] AEG: Deleted derivative data file. [2025-10-06T17:04:18.230495] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 36.2s. Estimated remaining: 4h 27m 10s. Rate: 8.7 symbols/min [2025-10-06T17:04:19.025577] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-06T17:04:19.264315] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T17:04:19.825564] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-06T17:04:20.658146] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-06T17:04:20.670549] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-06T17:04:20.943268] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-06T17:04:21.425539] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-06T17:04:21.790172] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-06T17:04:22.225544] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-06T17:04:22.434527] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T17:04:23.003492] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T17:04:23.025471] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-06T17:04:23.825618] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-06T17:04:24.014053] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T17:04:24.625489] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-06T17:04:25.048444] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-06T17:04:25.425540] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-06T17:04:25.867523] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-06T17:04:26.225526] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-06T17:04:26.642580] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-06T17:04:27.025477] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-06T17:04:27.230063] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T17:04:27.825490] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-06T17:04:28.122784] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T17:04:28.625594] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-06T17:04:29.080769] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-06T17:04:29.252703] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T17:04:29.425544] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-06T17:04:30.225556] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-06T17:04:30.566807] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T17:04:31.025550] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-06T17:04:31.503488] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-06T17:04:31.825542] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-06T17:04:31.952503] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T17:04:32.625634] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-06T17:04:32.652062] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T17:04:32.656080] [INFO ] [REMOTE ] AEM: Full fetch complete (77176 records). [2025-10-06T17:04:32.656270] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-06T17:04:33.047706] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-06T17:04:33.047810] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-06T17:04:33.048552] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-06T17:04:33.048596] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-06T17:04:33.050296] [DEBUG] [LOCAL ] AEM: Trimmed 77176 records to 53460 (keeping 200 days of data) [2025-10-06T17:04:33.397326] [DEBUG] [LOCAL ] AEM: Primary data saved (53460 records). [2025-10-06T17:04:33.397561] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-06T17:04:33.398796] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 33.5s. Estimated remaining: 4h 35m 32s. Rate: 8.5 symbols/min [2025-10-06T17:04:33.579792] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-06T17:04:33.582958] [INFO ] [REMOTE ] AEO: Full fetch complete (77446 records). [2025-10-06T17:04:33.583107] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-06T17:04:33.973087] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-06T17:04:33.973195] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-06T17:04:33.973962] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-06T17:04:33.974031] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-06T17:04:33.975719] [DEBUG] [LOCAL ] AEO: Trimmed 77446 records to 53561 (keeping 200 days of data) [2025-10-06T17:04:34.243028] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T17:04:34.256672] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-06T17:04:34.380255] [DEBUG] [LOCAL ] AEO: Primary data saved (53561 records). [2025-10-06T17:04:34.380493] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-06T17:04:34.380619] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AEO took 33.2s. Estimated remaining: 4h 29m 20s. Rate: 8.7 symbols/min [2025-10-06T17:04:35.887749] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T17:04:35.900094] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-06T17:04:37.142351] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T17:04:37.145139] [INFO ] [REMOTE ] AER: Full fetch complete (69578 records). [2025-10-06T17:04:37.145287] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-06T17:04:37.539345] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-06T17:04:37.539480] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-06T17:04:37.540173] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-06T17:04:37.540238] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-06T17:04:37.541734] [DEBUG] [LOCAL ] AER: Trimmed 69578 records to 48299 (keeping 200 days of data) [2025-10-06T17:04:37.856351] [DEBUG] [LOCAL ] AER: Primary data saved (48299 records). [2025-10-06T17:04:37.856512] [INFO ] [MAIN ] AER: Full history saved. [2025-10-06T17:04:37.857507] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AER took 27.8s. Estimated remaining: 4h 25m 52s. Rate: 8.8 symbols/min [2025-10-06T17:04:38.459336] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:04:38.628626] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-06T17:04:38.661537] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-06T17:04:38.668357] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:04:38.687568] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-06T17:04:38.705283] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:04:38.723224] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-06T17:04:38.723102] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:04:38.723779] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-06T17:04:38.724459] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-06T17:04:38.842973] [DEBUG] [LOCAL ] AFB: Loaded 11614 existing records from primary storage. [2025-10-06T17:04:38.852164] [INFO ] [MAIN ] AFB: Loaded 11614 existing records. [2025-10-06T17:04:39.253340] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-10-06T17:04:39.296139] [INFO ] [MAIN ] AES: Loaded 54450 existing records. [2025-10-06T17:04:39.341680] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:04:39.365096] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-06T17:04:39.411983] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-06T17:04:39.386509] [DEBUG] [LOCAL ] AESI: Loaded 50229 existing records from primary storage. [2025-10-06T17:04:39.458372] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-06T17:04:39.495729] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-06T17:04:39.490432] [INFO ] [MAIN ] AESI: Loaded 50229 existing records. [2025-10-06T17:04:39.553713] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:04:39.587421] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-06T17:04:39.978942] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:04:39.974223] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:04:40.018596] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-06T17:04:40.039170] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-06T17:04:40.039004] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-06T17:04:40.072492] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:04:40.080072] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:04:40.104589] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-06T17:04:40.090256] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-06T17:04:40.110186] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-06T17:04:40.115531] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-06T17:04:40.110117] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-06T17:04:40.161450] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-06T17:04:40.161852] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-06T17:04:40.115712] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:04:40.276634] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-06T17:04:40.373013] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-06T17:04:40.413451] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-06T17:04:40.468311] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-06T17:04:40.473831] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.6s. Estimated remaining: 4h 21m 45s. Rate: 8.9 symbols/min [2025-10-06T17:04:40.504203] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:04:40.558415] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-06T17:04:41.006534] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:04:41.262400] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:04:41.283542] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-06T17:04:41.346736] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:04:41.347942] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-06T17:04:41.361564] [DEBUG] [LOCAL ] AFG: Loaded 32819 existing records from primary storage. [2025-10-06T17:04:41.362013] [INFO ] [MAIN ] AFG: Loaded 32819 existing records. [2025-10-06T17:04:41.591116] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:04:41.591383] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-06T17:04:41.591434] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-06T17:04:41.591823] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-06T17:04:41.591940] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-06T17:04:41.701519] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T17:04:41.731833] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-06T17:04:42.017972] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:04:42.018404] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-06T17:04:42.612008] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T17:04:42.617297] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-06T17:04:42.863705] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T17:04:42.877139] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-06T17:04:42.921411] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T17:04:42.929498] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-06T17:04:43.225309] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-06T17:04:43.229074] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-06T17:04:43.607523] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-06T17:04:43.618944] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-06T17:04:44.091735] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T17:04:44.097554] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-06T17:04:44.181820] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-06T17:04:44.257430] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T17:04:44.625594] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-06T17:04:45.288124] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T17:04:45.425554] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-06T17:04:45.562797] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-06T17:04:45.591783] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T17:04:46.225579] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-06T17:04:47.026483] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-06T17:04:47.027390] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-06T17:04:47.263569] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-06T17:04:47.825565] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-06T17:04:48.605503] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-06T17:04:48.625467] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-06T17:04:48.666325] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T17:04:49.425512] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-06T17:04:49.504579] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T17:04:50.225602] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-06T17:04:51.025513] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-06T17:04:51.095234] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T17:04:51.473296] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-06T17:04:51.825530] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-06T17:04:52.441545] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T17:04:52.473954] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-06T17:04:52.625530] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-06T17:04:53.425507] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-06T17:04:53.577806] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T17:04:53.579280] [INFO ] [REMOTE ] AFB: Full fetch complete (16716 records). [2025-10-06T17:04:53.579373] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-06T17:04:53.952140] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-06T17:04:53.952255] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-06T17:04:53.952555] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-06T17:04:53.952630] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-06T17:04:53.954111] [DEBUG] [LOCAL ] AFB: Trimmed 16716 records to 11448 (keeping 200 days of data) [2025-10-06T17:04:54.022901] [DEBUG] [LOCAL ] AFB: Primary data saved (11448 records). [2025-10-06T17:04:54.023063] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-06T17:04:54.023169] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFB took 16.1s. Estimated remaining: 4h 27m 56s. Rate: 8.7 symbols/min [2025-10-06T17:04:54.200509] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:04:54.200738] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-06T17:04:54.200788] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-06T17:04:54.200908] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-06T17:04:54.200951] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-06T17:04:54.200993] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-06T17:04:54.201027] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-06T17:04:54.234211] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-06T17:04:54.557958] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:04:55.025512] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-06T17:04:55.365187] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T17:04:55.557313] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T17:04:55.825563] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-06T17:04:56.530627] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T17:04:56.625542] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-06T17:04:57.258792] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-06T17:04:57.425535] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-06T17:04:57.785565] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-06T17:04:57.828488] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-06T17:04:58.225553] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-06T17:04:59.025567] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-06T17:04:59.825545] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-06T17:05:00.256472] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-06T17:05:00.272343] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-06T17:05:00.329824] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T17:05:00.625525] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-06T17:05:01.425610] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-06T17:05:01.595450] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T17:05:02.225535] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-06T17:05:03.025586] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-06T17:05:03.533082] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T17:05:03.587513] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-06T17:05:03.604835] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-06T17:05:03.825532] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-06T17:05:04.384700] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T17:05:04.625700] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-06T17:05:05.425577] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-06T17:05:05.999261] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T17:05:06.225539] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-06T17:05:06.581849] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-06T17:05:07.025591] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-06T17:05:07.558206] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-06T17:05:07.825510] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-06T17:05:07.851577] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-06T17:05:08.625571] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-06T17:05:09.209434] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T17:05:09.425597] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-06T17:05:10.224733] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T17:05:10.234590] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-06T17:05:10.697457] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-06T17:05:10.802138] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T17:05:11.025600] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-06T17:05:11.825545] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-06T17:05:12.625497] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-06T17:05:13.032482] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-06T17:05:13.159262] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-06T17:05:13.308542] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T17:05:13.425531] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-06T17:05:13.958629] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T17:05:13.959385] [INFO ] [REMOTE ] AFGB: Full fetch complete (3680 records). [2025-10-06T17:05:13.959455] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-06T17:05:14.230684] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-06T17:05:14.325368] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-06T17:05:14.325464] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-06T17:05:14.325600] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-06T17:05:14.325639] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-06T17:05:14.326056] [DEBUG] [LOCAL ] AFGB: Trimmed 3680 records to 2324 (keeping 200 days of data) [2025-10-06T17:05:14.340310] [DEBUG] [LOCAL ] AFGB: Primary data saved (2324 records). [2025-10-06T17:05:14.340379] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-06T17:05:14.340442] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AFGB took 20.3s. Estimated remaining: 4h 39m 55s. Rate: 8.3 symbols/min [2025-10-06T17:05:14.506289] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:05:14.511732] [DEBUG] [LOCAL ] AFGC: Loaded 2568 existing records from primary storage. [2025-10-06T17:05:14.511898] [INFO ] [MAIN ] AFGC: Loaded 2568 existing records. [2025-10-06T17:05:14.685279] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:05:14.685575] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-06T17:05:14.685683] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-06T17:05:14.685938] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-06T17:05:14.686018] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-06T17:05:15.031407] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-06T17:05:15.068622] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:05:15.825530] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-06T17:05:15.992618] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T17:05:16.393686] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-06T17:05:16.440865] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T17:05:16.443224] [INFO ] [REMOTE ] AFG: Full fetch complete (46110 records). [2025-10-06T17:05:16.443324] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-06T17:05:16.639124] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-06T17:05:16.861691] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-06T17:05:16.861821] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-06T17:05:16.862381] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-06T17:05:16.862425] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-06T17:05:16.863841] [DEBUG] [LOCAL ] AFG: Trimmed 46110 records to 32332 (keeping 200 days of data) [2025-10-06T17:05:17.070066] [DEBUG] [LOCAL ] AFG: Primary data saved (32332 records). [2025-10-06T17:05:17.070858] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-06T17:05:17.071104] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFG took 36.6s. Estimated remaining: 4h 35m 51s. Rate: 8.4 symbols/min [2025-10-06T17:05:17.244664] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:05:17.250549] [DEBUG] [LOCAL ] AFGD: Loaded 1836 existing records from primary storage. [2025-10-06T17:05:17.250759] [INFO ] [MAIN ] AFGD: Loaded 1836 existing records. [2025-10-06T17:05:17.432695] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-06T17:05:17.444276] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:05:17.444825] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-06T17:05:17.444926] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-06T17:05:17.445131] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-06T17:05:17.445192] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-06T17:05:17.835771] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:05:17.873507] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-06T17:05:18.225488] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-06T17:05:18.482407] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T17:05:18.702033] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-06T17:05:19.025611] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-06T17:05:19.825539] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-06T17:05:20.269590] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T17:05:20.625563] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-06T17:05:20.903613] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-06T17:05:20.907919] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-10-06T17:05:20.908082] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-06T17:05:21.037327] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-06T17:05:21.351994] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-06T17:05:21.352120] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-06T17:05:21.353098] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-06T17:05:21.353172] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-06T17:05:21.355462] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 53670 (keeping 200 days of data) [2025-10-06T17:05:21.447570] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-06T17:05:21.683049] [DEBUG] [LOCAL ] AES: Primary data saved (53670 records). [2025-10-06T17:05:21.683222] [INFO ] [MAIN ] AES: Full history saved. [2025-10-06T17:05:21.683311] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AES took 43.8s. Estimated remaining: 4h 33m 34s. Rate: 8.5 symbols/min [2025-10-06T17:05:21.850158] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:05:21.855191] [DEBUG] [LOCAL ] AFGE: Loaded 2471 existing records from primary storage. [2025-10-06T17:05:21.855346] [INFO ] [MAIN ] AFGE: Loaded 2471 existing records. [2025-10-06T17:05:21.972466] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-06T17:05:22.054995] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:05:22.055259] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-06T17:05:22.055307] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-06T17:05:22.055508] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-06T17:05:22.055566] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-06T17:05:22.232247] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-06T17:05:22.446975] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:05:22.763206] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-06T17:05:23.025569] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-06T17:05:23.357246] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-06T17:05:23.825568] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-06T17:05:24.312986] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-06T17:05:24.625592] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-06T17:05:25.061111] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-06T17:05:25.425575] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-06T17:05:26.225574] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-06T17:05:26.684190] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-06T17:05:27.025586] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-06T17:05:27.237160] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-06T17:05:27.521066] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-06T17:05:27.825547] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-06T17:05:28.386969] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-06T17:05:28.625719] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-06T17:05:29.244111] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-06T17:05:29.425556] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-06T17:05:29.766204] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-06T17:05:30.225577] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-06T17:05:30.639146] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-06T17:05:31.025532] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-06T17:05:31.474488] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-06T17:05:31.825541] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-06T17:05:32.210476] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T17:05:32.211247] [INFO ] [REMOTE ] AFGC: Full fetch complete (3720 records). [2025-10-06T17:05:32.211322] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-06T17:05:32.574057] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-06T17:05:32.574171] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-06T17:05:32.574310] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-06T17:05:32.574353] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-06T17:05:32.574744] [DEBUG] [LOCAL ] AFGC: Trimmed 3720 records to 2551 (keeping 200 days of data) [2025-10-06T17:05:32.590956] [DEBUG] [LOCAL ] AFGC: Primary data saved (2551 records). [2025-10-06T17:05:32.591052] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-06T17:05:32.591126] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGC took 18.3s. Estimated remaining: 4h 36m 42s. Rate: 8.4 symbols/min [2025-10-06T17:05:32.630665] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-06T17:05:32.771827] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:05:32.830576] [DEBUG] [LOCAL ] AFL: Loaded 53923 existing records from primary storage. [2025-10-06T17:05:32.831099] [INFO ] [MAIN ] AFL: Loaded 53923 existing records. [2025-10-06T17:05:33.016132] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:05:33.016423] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-06T17:05:33.016496] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-06T17:05:33.016840] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-06T17:05:33.016902] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-06T17:05:33.124833] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-06T17:05:33.384315] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:05:33.425516] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-06T17:05:33.794068] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-06T17:05:34.225559] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-06T17:05:35.025610] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-06T17:05:35.825501] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-06T17:05:36.083736] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T17:05:36.276545] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-06T17:05:36.598744] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T17:05:36.625498] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-06T17:05:37.425607] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-06T17:05:37.964586] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-06T17:05:38.225611] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-06T17:05:38.544774] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-06T17:05:38.548196] [INFO ] [REMOTE ] AESI: Full fetch complete (70569 records). [2025-10-06T17:05:38.548381] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-06T17:05:38.982532] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-06T17:05:38.982685] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-06T17:05:38.983531] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-06T17:05:38.983583] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-06T17:05:38.985457] [DEBUG] [LOCAL ] AESI: Trimmed 70569 records to 49538 (keeping 200 days of data) [2025-10-06T17:05:39.043210] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-06T17:05:39.314317] [DEBUG] [LOCAL ] AESI: Primary data saved (49538 records). [2025-10-06T17:05:39.314516] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-06T17:05:39.315947] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AESI took 1m 1s. Estimated remaining: 4h 36m 14s. Rate: 8.4 symbols/min [2025-10-06T17:05:39.505238] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:05:39.568954] [DEBUG] [LOCAL ] AG: Loaded 54422 existing records from primary storage. [2025-10-06T17:05:39.569442] [INFO ] [MAIN ] AG: Loaded 54422 existing records. [2025-10-06T17:05:39.684084] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T17:05:39.696377] [INFO ] [REMOTE ] AFGD: Full fetch complete (3101 records). [2025-10-06T17:05:39.726446] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-06T17:05:39.783869] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:05:39.847633] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-06T17:05:39.853050] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-06T17:05:39.836852] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-06T17:05:39.869540] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-06T17:05:39.880752] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-06T17:05:40.481929] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-06T17:05:40.511959] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-06T17:05:40.519094] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-06T17:05:40.519369] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-06T17:05:40.521046] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-06T17:05:40.522236] [DEBUG] [LOCAL ] AFGD: Trimmed 3101 records to 1805 (keeping 200 days of data) [2025-10-06T17:05:40.534456] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-06T17:05:40.621264] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:05:40.628013] [DEBUG] [LOCAL ] AFGD: Primary data saved (1805 records). [2025-10-06T17:05:40.627076] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-06T17:05:40.628909] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-06T17:05:40.628995] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGD took 23.6s. Estimated remaining: 4h 31m 26s. Rate: 8.6 symbols/min [2025-10-06T17:05:40.796319] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:05:40.839668] [DEBUG] [LOCAL ] AGCO: Loaded 42995 existing records from primary storage. [2025-10-06T17:05:40.840034] [INFO ] [MAIN ] AGCO: Loaded 42995 existing records. [2025-10-06T17:05:41.018725] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:05:41.019007] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-06T17:05:41.019069] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-06T17:05:41.019338] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-06T17:05:41.019394] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-06T17:05:41.122967] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-06T17:05:41.372544] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:05:41.425476] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-06T17:05:42.225604] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-06T17:05:42.740385] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-06T17:05:43.025500] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-06T17:05:43.081310] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T17:05:43.825522] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-06T17:05:44.625506] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-06T17:05:44.742037] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T17:05:45.095216] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-06T17:05:45.326714] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T17:05:45.425507] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-06T17:05:46.225533] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-06T17:05:47.025508] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-06T17:05:47.344710] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T17:05:47.825504] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-06T17:05:48.080515] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-06T17:05:48.201434] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T17:05:48.625623] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-06T17:05:49.425541] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-06T17:05:49.633469] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T17:05:49.970064] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-06T17:05:50.225584] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-06T17:05:50.556715] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-06T17:05:51.025541] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-06T17:05:51.825567] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-06T17:05:52.136576] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T17:05:52.625510] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-06T17:05:52.878824] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T17:05:53.087319] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T17:05:53.425533] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-06T17:05:54.225504] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-06T17:05:54.438588] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T17:05:54.600673] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T17:05:55.025605] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-06T17:05:55.825598] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-06T17:05:56.267409] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-06T17:05:56.625574] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-06T17:05:57.155226] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-06T17:05:57.382573] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-06T17:05:57.425565] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-06T17:05:57.877408] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-06T17:05:58.225559] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-06T17:05:58.461872] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T17:05:58.755560] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-06T17:05:59.025559] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-06T17:05:59.825520] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-06T17:06:00.479607] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T17:06:00.625626] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-06T17:06:01.425594] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-06T17:06:02.068941] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-06T17:06:02.225549] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-06T17:06:02.290072] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T17:06:02.759360] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-06T17:06:03.025538] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-06T17:06:03.825553] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-06T17:06:04.158707] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-06T17:06:04.509583] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T17:06:04.625526] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-06T17:06:05.425604] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-06T17:06:05.564935] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-06T17:06:06.225500] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-06T17:06:06.685676] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-06T17:06:07.025802] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-06T17:06:07.213840] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T17:06:07.375053] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-06T17:06:07.399799] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-06T17:06:07.825550] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-06T17:06:08.625597] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-06T17:06:08.746139] [DEBUG] [REMOTE ] AGCO: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-06T17:06:08.746603] [WARN ] [REMOTE ] AGCO: No data returned for month 2025-09 [2025-10-06T17:06:08.746776] [FATAL] [REMOTE ] AGCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:06:08.746885] [FATAL] [MAIN ] AGCO: Failed to fetch primary data. [2025-10-06T17:06:08.746941] [WARN ] [MAIN ] AGCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:06:08.747024] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-06T17:06:08.747148] [DEBUG] [LOCAL ] AGCO: No primary data file found to delete. [2025-10-06T17:06:08.747219] [INFO ] [LOCAL ] AGCO: Starting deletion of derivative data. [2025-10-06T17:06:08.751058] [DEBUG] [LOCAL ] AGCO: Deleted derivative data file. [2025-10-06T17:06:08.751333] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AGCO took 28.1s. Estimated remaining: 4h 47m 59s. Rate: 8.1 symbols/min [2025-10-06T17:06:08.938703] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:06:08.938978] [DEBUG] [LOCAL ] AGD: No existing data file found in primary storage. [2025-10-06T17:06:08.939025] [WARN ] [MAIN ] AGD: No existing data found, performing full refresh instead. [2025-10-06T17:06:08.939149] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-06T17:06:08.939190] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-06T17:06:08.939232] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-10-06T17:06:08.939263] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-06T17:06:09.309142] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:06:09.425504] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-06T17:06:09.475173] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-06T17:06:09.478383] [INFO ] [REMOTE ] AFL: Full fetch complete (76912 records). [2025-10-06T17:06:09.478578] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-06T17:06:09.872816] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-06T17:06:09.872935] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-06T17:06:09.873772] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-06T17:06:09.873843] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-06T17:06:09.875444] [DEBUG] [LOCAL ] AFL: Trimmed 76912 records to 53156 (keeping 200 days of data) [2025-10-06T17:06:10.225500] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-06T17:06:10.232987] [DEBUG] [LOCAL ] AFL: Primary data saved (53156 records). [2025-10-06T17:06:10.233202] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-06T17:06:10.234105] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 37.6s. Estimated remaining: 4h 43m 15s. Rate: 8.2 symbols/min [2025-10-06T17:06:10.423803] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:06:10.452019] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-06T17:06:10.495217] [DEBUG] [LOCAL ] AGI: Loaded 54194 existing records from primary storage. [2025-10-06T17:06:10.495599] [INFO ] [MAIN ] AGI: Loaded 54194 existing records. [2025-10-06T17:06:10.671609] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:06:10.672038] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-06T17:06:10.672101] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-06T17:06:10.672940] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-06T17:06:10.673002] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-06T17:06:11.024716] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:06:11.025480] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-06T17:06:11.825548] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-06T17:06:12.625550] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-06T17:06:12.693609] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-06T17:06:12.730679] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T17:06:12.930588] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T17:06:13.202470] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-06T17:06:13.203259] [INFO ] [REMOTE ] AFGE: Full fetch complete (3467 records). [2025-10-06T17:06:13.203333] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-06T17:06:13.435249] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-06T17:06:13.561506] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-06T17:06:13.561592] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-06T17:06:13.561739] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-06T17:06:13.561801] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-06T17:06:13.562143] [DEBUG] [LOCAL ] AFGE: Trimmed 3467 records to 2441 (keeping 200 days of data) [2025-10-06T17:06:13.577718] [DEBUG] [LOCAL ] AFGE: Primary data saved (2441 records). [2025-10-06T17:06:13.577790] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-06T17:06:13.577861] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AFGE took 51.9s. Estimated remaining: 4h 40m 7s. Rate: 8.3 symbols/min [2025-10-06T17:06:13.745988] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:06:13.794757] [DEBUG] [LOCAL ] AGL: Loaded 53221 existing records from primary storage. [2025-10-06T17:06:13.795160] [INFO ] [MAIN ] AGL: Loaded 53221 existing records. [2025-10-06T17:06:13.972451] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:06:13.972741] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-06T17:06:13.972804] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-06T17:06:13.973135] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-06T17:06:13.973193] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-06T17:06:14.230842] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-06T17:06:14.326795] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:06:15.025544] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-06T17:06:15.055449] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-06T17:06:15.417386] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-06T17:06:15.825550] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-06T17:06:16.625504] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-06T17:06:16.714681] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-06T17:06:16.807469] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T17:06:17.425600] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-06T17:06:18.225593] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-06T17:06:18.655550] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-06T17:06:18.659147] [INFO ] [REMOTE ] AG: Full fetch complete (77610 records). [2025-10-06T17:06:18.659362] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-06T17:06:19.040988] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-06T17:06:19.067313] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-06T17:06:19.067490] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-06T17:06:19.068411] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-06T17:06:19.068639] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-06T17:06:19.070517] [DEBUG] [LOCAL ] AG: Trimmed 77610 records to 53642 (keeping 200 days of data) [2025-10-06T17:06:19.202710] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T17:06:19.454163] [DEBUG] [LOCAL ] AG: Primary data saved (53642 records). [2025-10-06T17:06:19.454375] [INFO ] [MAIN ] AG: Full history saved. [2025-10-06T17:06:19.456256] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AG took 40.1s. Estimated remaining: 4h 38m 59s. Rate: 8.3 symbols/min [2025-10-06T17:06:19.646337] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:06:19.661675] [DEBUG] [LOCAL ] AGM: Loaded 10383 existing records from primary storage. [2025-10-06T17:06:19.661986] [INFO ] [MAIN ] AGM: Loaded 10383 existing records. [2025-10-06T17:06:19.830684] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-06T17:06:19.879122] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:06:19.879485] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-06T17:06:19.879571] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-06T17:06:19.879934] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-06T17:06:19.880019] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-06T17:06:20.186459] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T17:06:20.243754] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-06T17:06:20.388667] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:06:20.625802] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-06T17:06:21.317840] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T17:06:21.425557] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-06T17:06:21.472377] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T17:06:22.225601] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-06T17:06:23.025533] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-06T17:06:23.423460] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T17:06:23.492269] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-06T17:06:23.665693] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-06T17:06:23.825594] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-06T17:06:24.625567] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-06T17:06:25.425485] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-06T17:06:25.453483] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-06T17:06:25.836393] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T17:06:26.225558] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-06T17:06:26.935776] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T17:06:27.025483] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-06T17:06:27.238064] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-06T17:06:27.825529] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-06T17:06:28.625599] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-06T17:06:28.849629] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T17:06:29.306328] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-06T17:06:29.425603] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-06T17:06:29.711964] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T17:06:30.225594] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-06T17:06:30.821589] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T17:06:31.025566] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-06T17:06:31.241098] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T17:06:31.825572] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-06T17:06:32.625590] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-06T17:06:32.828375] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T17:06:32.830074] [INFO ] [REMOTE ] AGD: Full fetch complete (25756 records). [2025-10-06T17:06:32.830186] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-06T17:06:33.193753] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-06T17:06:33.256309] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-06T17:06:33.256426] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-06T17:06:33.256823] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-06T17:06:33.256889] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-06T17:06:33.257907] [DEBUG] [LOCAL ] AGD: Trimmed 25756 records to 18278 (keeping 200 days of data) [2025-10-06T17:06:33.374191] [DEBUG] [LOCAL ] AGD: Primary data saved (18278 records). [2025-10-06T17:06:33.374425] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-06T17:06:33.374538] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGD took 24.6s. Estimated remaining: 4h 43m 44s. Rate: 8.2 symbols/min [2025-10-06T17:06:33.438754] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-06T17:06:33.550126] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:06:33.580931] [DEBUG] [LOCAL ] AGO: Loaded 28380 existing records from primary storage. [2025-10-06T17:06:33.581250] [INFO ] [MAIN ] AGO: Loaded 28380 existing records. [2025-10-06T17:06:33.756416] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:06:33.756743] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-06T17:06:33.756799] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-06T17:06:33.757003] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-06T17:06:33.757062] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-06T17:06:34.154298] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:06:34.225511] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-06T17:06:34.373946] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T17:06:35.028247] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-06T17:06:35.031810] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T17:06:35.477494] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T17:06:35.825558] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-06T17:06:36.625490] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-06T17:06:36.748822] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T17:06:37.403444] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T17:06:37.425488] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-06T17:06:37.561188] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T17:06:38.085628] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-06T17:06:38.225558] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-06T17:06:39.025547] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-06T17:06:39.825538] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-06T17:06:40.318530] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-06T17:06:40.625498] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-06T17:06:40.700242] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-06T17:06:40.919412] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T17:06:41.425530] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-06T17:06:41.842122] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T17:06:42.225583] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-06T17:06:42.990753] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-06T17:06:42.995196] [INFO ] [REMOTE ] AGI: Full fetch complete (76851 records). [2025-10-06T17:06:42.995442] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-06T17:06:43.037546] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-06T17:06:43.358515] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T17:06:43.453545] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-06T17:06:43.453710] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-06T17:06:43.454670] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-06T17:06:43.454786] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-06T17:06:43.457347] [DEBUG] [LOCAL ] AGI: Trimmed 76851 records to 53420 (keeping 200 days of data) [2025-10-06T17:06:43.826634] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-06T17:06:43.826294] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T17:06:43.837344] [DEBUG] [LOCAL ] AGI: Primary data saved (53420 records). [2025-10-06T17:06:43.837887] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-06T17:06:43.839101] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGI took 33.6s. Estimated remaining: 4h 45m 51s. Rate: 8.1 symbols/min [2025-10-06T17:06:44.046890] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:06:44.088164] [DEBUG] [LOCAL ] AGRO: Loaded 33939 existing records from primary storage. [2025-10-06T17:06:44.088545] [INFO ] [MAIN ] AGRO: Loaded 33939 existing records. [2025-10-06T17:06:44.293163] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:06:44.293506] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-06T17:06:44.293563] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-06T17:06:44.294150] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-06T17:06:44.294213] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-06T17:06:44.632392] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-06T17:06:44.844194] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:06:45.151541] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T17:06:45.425562] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-06T17:06:46.225532] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-06T17:06:46.525218] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T17:06:46.972532] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T17:06:47.025520] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-06T17:06:47.744313] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T17:06:47.814549] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-06T17:06:47.825465] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-06T17:06:48.625500] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-06T17:06:48.638691] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T17:06:49.425548] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-06T17:06:49.605676] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T17:06:50.225603] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-06T17:06:50.725174] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T17:06:51.025484] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-06T17:06:51.105859] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T17:06:51.825550] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-06T17:06:52.323928] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T17:06:52.625571] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-06T17:06:52.647576] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T17:06:53.425594] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-06T17:06:54.225606] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-06T17:06:54.289184] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T17:06:54.292299] [INFO ] [REMOTE ] AGL: Full fetch complete (75566 records). [2025-10-06T17:06:54.292418] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-06T17:06:54.735948] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-06T17:06:54.736078] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-06T17:06:54.736884] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-06T17:06:54.736961] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-06T17:06:54.756583] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-06T17:06:54.763636] [DEBUG] [LOCAL ] AGL: Trimmed 75566 records to 52469 (keeping 200 days of data) [2025-10-06T17:06:54.980666] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-06T17:06:55.025738] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-06T17:06:55.068458] [DEBUG] [LOCAL ] AGL: Primary data saved (52469 records). [2025-10-06T17:06:55.068574] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-06T17:06:55.068675] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGL took 41.5s. Estimated remaining: 4h 48m 25s. Rate: 8.0 symbols/min [2025-10-06T17:06:55.233437] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:06:55.273504] [DEBUG] [LOCAL ] AGX: Loaded 33569 existing records from primary storage. [2025-10-06T17:06:55.273995] [INFO ] [MAIN ] AGX: Loaded 33569 existing records. [2025-10-06T17:06:55.449554] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:06:55.449807] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-06T17:06:55.449857] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-06T17:06:55.450095] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-06T17:06:55.450155] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-06T17:06:55.798583] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:06:55.827368] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T17:06:55.827165] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-06T17:06:55.829562] [INFO ] [REMOTE ] AGM: Full fetch complete (12943 records). [2025-10-06T17:06:55.829635] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-06T17:06:56.189835] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-06T17:06:56.189926] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-06T17:06:56.190150] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-06T17:06:56.190189] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-06T17:06:56.190759] [DEBUG] [LOCAL ] AGM: Trimmed 12943 records to 10345 (keeping 200 days of data) [2025-10-06T17:06:56.269860] [DEBUG] [LOCAL ] AGM: Primary data saved (10345 records). [2025-10-06T17:06:56.270115] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-06T17:06:56.270243] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGM took 36.8s. Estimated remaining: 4h 43m 58s. Rate: 8.2 symbols/min [2025-10-06T17:06:56.452009] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:06:56.498991] [DEBUG] [LOCAL ] AHH: Loaded 41619 existing records from primary storage. [2025-10-06T17:06:56.499392] [INFO ] [MAIN ] AHH: Loaded 41619 existing records. [2025-10-06T17:06:56.640891] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-06T17:06:56.688455] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:06:56.688827] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-06T17:06:56.688881] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-06T17:06:56.689140] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-06T17:06:56.689200] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-06T17:06:57.090959] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T17:06:57.094783] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:06:57.425567] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-06T17:06:58.225553] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-06T17:06:58.265462] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T17:06:58.629945] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T17:06:59.025536] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-06T17:06:59.733960] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T17:06:59.825482] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-06T17:07:00.546853] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T17:07:00.625504] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-06T17:07:01.425625] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-06T17:07:01.617495] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T17:07:02.032189] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T17:07:02.225599] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-06T17:07:02.581277] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T17:07:02.583565] [INFO ] [REMOTE ] AGO: Full fetch complete (39247 records). [2025-10-06T17:07:02.584003] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-06T17:07:02.585591] [FATAL] [VALIDATOR ] AGO: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:07:02.585741] [FATAL] [MAIN ] AGO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:07:02.585828] [WARN ] [MAIN ] AGO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:07:02.585883] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-06T17:07:02.585966] [DEBUG] [LOCAL ] AGO: No primary data file found to delete. [2025-10-06T17:07:02.586024] [INFO ] [LOCAL ] AGO: Starting deletion of derivative data. [2025-10-06T17:07:02.586372] [DEBUG] [LOCAL ] AGO: Deleted derivative data file. [2025-10-06T17:07:02.586493] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 29.2s. Estimated remaining: 4h 43m 8s. Rate: 8.2 symbols/min [2025-10-06T17:07:02.773248] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:07:02.773571] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-06T17:07:02.773624] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-06T17:07:02.773764] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-06T17:07:02.773807] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-06T17:07:02.773848] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-06T17:07:02.773883] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-06T17:07:03.031123] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-06T17:07:03.132418] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:07:03.432952] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T17:07:03.825570] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-06T17:07:04.625516] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-06T17:07:04.856364] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:07:04.856764] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-06T17:07:04.856865] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:07:04.856918] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-06T17:07:04.856982] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:07:04.857059] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-06T17:07:04.857168] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-06T17:07:04.857241] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-06T17:07:04.857298] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-06T17:07:04.857355] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AHL took 2.3s. Estimated remaining: 4h 39m 39s. Rate: 8.3 symbols/min [2025-10-06T17:07:05.067377] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:07:05.071844] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-06T17:07:05.132483] [DEBUG] [LOCAL ] AHR: Loaded 49849 existing records from primary storage. [2025-10-06T17:07:05.133014] [INFO ] [MAIN ] AHR: Loaded 49849 existing records. [2025-10-06T17:07:05.273567] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T17:07:05.367958] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:07:05.368291] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-06T17:07:05.368353] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-06T17:07:05.368732] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-06T17:07:05.368791] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-06T17:07:05.432966] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-06T17:07:05.756684] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:07:06.225552] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-06T17:07:06.975233] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T17:07:07.025529] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-06T17:07:07.825584] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-06T17:07:07.857165] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T17:07:08.413443] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T17:07:08.625618] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-06T17:07:09.244364] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T17:07:09.425581] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-06T17:07:09.966545] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T17:07:10.225553] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-06T17:07:11.025489] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-06T17:07:11.220145] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T17:07:11.825579] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-06T17:07:12.050174] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T17:07:12.497819] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T17:07:12.625601] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-06T17:07:13.376331] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T17:07:13.425559] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-06T17:07:13.650135] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T17:07:14.225562] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-06T17:07:15.025579] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-06T17:07:15.157241] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T17:07:15.781348] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-06T17:07:15.825524] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-06T17:07:16.349834] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T17:07:16.352242] [INFO ] [REMOTE ] AGRO: Full fetch complete (49496 records). [2025-10-06T17:07:16.352363] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-06T17:07:16.635202] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-06T17:07:16.779192] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-06T17:07:16.779315] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-06T17:07:16.779981] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-06T17:07:16.780054] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-06T17:07:16.781841] [DEBUG] [LOCAL ] AGRO: Trimmed 49496 records to 33335 (keeping 200 days of data) [2025-10-06T17:07:16.997865] [DEBUG] [LOCAL ] AGRO: Primary data saved (33335 records). [2025-10-06T17:07:16.998156] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-06T17:07:16.998340] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGRO took 33.2s. Estimated remaining: 4h 42m 43s. Rate: 8.2 symbols/min [2025-10-06T17:07:17.196707] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:07:17.207270] [DEBUG] [LOCAL ] AHT: Loaded 6250 existing records from primary storage. [2025-10-06T17:07:17.207496] [INFO ] [MAIN ] AHT: Loaded 6250 existing records. [2025-10-06T17:07:17.409505] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:07:17.409975] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-06T17:07:17.410051] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-06T17:07:17.410616] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-06T17:07:17.410736] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-06T17:07:17.432298] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-06T17:07:17.549072] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T17:07:17.853801] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:07:18.225544] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-06T17:07:18.365872] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T17:07:19.025536] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-06T17:07:19.237872] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T17:07:19.825507] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-06T17:07:19.866202] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T17:07:19.915254] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T17:07:20.625603] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-06T17:07:21.387181] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-06T17:07:21.425530] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-06T17:07:22.172966] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T17:07:22.222013] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T17:07:22.228433] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-06T17:07:23.025594] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-06T17:07:23.777829] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T17:07:23.825515] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-06T17:07:24.143357] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T17:07:24.245484] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-06T17:07:24.625581] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-06T17:07:25.425555] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-06T17:07:26.180161] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T17:07:26.222285] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T17:07:26.232758] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-06T17:07:27.025553] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-06T17:07:27.736454] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T17:07:27.825534] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-06T17:07:28.585853] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T17:07:28.625491] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-06T17:07:29.425507] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-06T17:07:29.676768] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T17:07:29.887578] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T17:07:30.225553] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-06T17:07:30.643302] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T17:07:30.645440] [INFO ] [REMOTE ] AGX: Full fetch complete (48769 records). [2025-10-06T17:07:30.645535] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-06T17:07:31.038928] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-06T17:07:31.096776] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-06T17:07:31.096879] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-06T17:07:31.097572] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-06T17:07:31.097637] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-06T17:07:31.099379] [DEBUG] [LOCAL ] AGX: Trimmed 48769 records to 33146 (keeping 200 days of data) [2025-10-06T17:07:31.318066] [DEBUG] [LOCAL ] AGX: Primary data saved (33146 records). [2025-10-06T17:07:31.318238] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-06T17:07:31.321161] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AGX took 36.3s. Estimated remaining: 4h 47m 5s. Rate: 8.1 symbols/min [2025-10-06T17:07:31.495439] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:07:31.549997] [DEBUG] [LOCAL ] AI: Loaded 54530 existing records from primary storage. [2025-10-06T17:07:31.550381] [INFO ] [MAIN ] AI: Loaded 54530 existing records. [2025-10-06T17:07:31.731277] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:07:31.731917] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-06T17:07:31.732000] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-06T17:07:31.732352] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-06T17:07:31.732468] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-06T17:07:31.835122] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-06T17:07:31.867546] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T17:07:32.133834] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:07:32.557607] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T17:07:32.625506] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-06T17:07:32.674891] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T17:07:33.292478] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T17:07:33.425520] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-06T17:07:33.900107] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-06T17:07:34.225562] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-06T17:07:34.951813] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-06T17:07:35.025595] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-06T17:07:35.825569] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-06T17:07:36.435868] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T17:07:36.625583] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-06T17:07:37.425518] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-06T17:07:37.514374] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T17:07:38.225581] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-06T17:07:38.881384] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T17:07:38.989242] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-06T17:07:39.025508] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-06T17:07:39.680242] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T17:07:39.683233] [INFO ] [REMOTE ] AHR: Full fetch complete (70807 records). [2025-10-06T17:07:39.683372] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-06T17:07:39.832466] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-06T17:07:40.079215] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-06T17:07:40.079310] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-06T17:07:40.080161] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-06T17:07:40.080228] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-06T17:07:40.081749] [DEBUG] [LOCAL ] AHR: Trimmed 70807 records to 49133 (keeping 200 days of data) [2025-10-06T17:07:40.379419] [DEBUG] [LOCAL ] AHR: Primary data saved (49133 records). [2025-10-06T17:07:40.379568] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-06T17:07:40.379696] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHR took 35.5s. Estimated remaining: 4h 47m 58s. Rate: 8.0 symbols/min [2025-10-06T17:07:40.547877] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:07:40.548085] [DEBUG] [LOCAL ] AIG: No existing data file found in primary storage. [2025-10-06T17:07:40.548141] [WARN ] [MAIN ] AIG: No existing data found, performing full refresh instead. [2025-10-06T17:07:40.548254] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-06T17:07:40.548296] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-06T17:07:40.548340] [DEBUG] [LOCAL ] AIG: No primary data file found to delete. [2025-10-06T17:07:40.548371] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-06T17:07:40.628828] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-06T17:07:40.701741] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-06T17:07:40.921733] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:07:41.359403] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-06T17:07:41.425539] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-06T17:07:42.046043] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T17:07:42.048631] [INFO ] [REMOTE ] AHH: Full fetch complete (60145 records). [2025-10-06T17:07:42.048810] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-06T17:07:42.230972] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-06T17:07:42.445245] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-06T17:07:42.445332] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-06T17:07:42.445956] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-06T17:07:42.446019] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-06T17:07:42.447291] [DEBUG] [LOCAL ] AHH: Trimmed 60145 records to 40877 (keeping 200 days of data) [2025-10-06T17:07:42.686063] [DEBUG] [LOCAL ] AHH: Primary data saved (40877 records). [2025-10-06T17:07:42.686223] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-06T17:07:42.686349] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHH took 46.4s. Estimated remaining: 4h 44m 38s. Rate: 8.1 symbols/min [2025-10-06T17:07:42.857940] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:07:42.858210] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-06T17:07:42.858327] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-06T17:07:42.858463] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-06T17:07:42.858527] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-06T17:07:42.858614] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-06T17:07:42.858792] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-06T17:07:43.034268] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-06T17:07:43.250591] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:07:43.244705] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T17:07:43.298718] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T17:07:43.299558] [INFO ] [REMOTE ] AHT: Full fetch complete (9290 records). [2025-10-06T17:07:43.299625] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-06T17:07:43.663169] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-06T17:07:43.663262] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-06T17:07:43.663485] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-06T17:07:43.663546] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-06T17:07:43.663998] [DEBUG] [LOCAL ] AHT: Trimmed 9290 records to 6203 (keeping 200 days of data) [2025-10-06T17:07:43.699533] [DEBUG] [LOCAL ] AHT: Primary data saved (6203 records). [2025-10-06T17:07:43.699702] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-06T17:07:43.699799] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AHT took 26.7s. Estimated remaining: 4h 40m 37s. Rate: 8.2 symbols/min [2025-10-06T17:07:43.839814] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-06T17:07:43.873345] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:07:43.899458] [DEBUG] [LOCAL ] AIN: Loaded 24987 existing records from primary storage. [2025-10-06T17:07:43.899796] [INFO ] [MAIN ] AIN: Loaded 24987 existing records. [2025-10-06T17:07:44.078145] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:07:44.078430] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-06T17:07:44.078500] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-06T17:07:44.079012] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-06T17:07:44.079086] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-06T17:07:44.494562] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:07:44.625475] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-06T17:07:45.425548] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-06T17:07:45.716766] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-06T17:07:45.782133] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:07:45.782462] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-06T17:07:45.782555] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:07:45.782602] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-06T17:07:45.782635] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:07:45.782720] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-06T17:07:45.782789] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-06T17:07:45.782823] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-06T17:07:45.782885] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-06T17:07:45.782952] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AII took 3.1s. Estimated remaining: 4h 37m 21s. Rate: 8.3 symbols/min [2025-10-06T17:07:45.960956] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:07:45.967267] [DEBUG] [LOCAL ] AIO: No existing data file found in primary storage. [2025-10-06T17:07:45.976928] [WARN ] [MAIN ] AIO: No existing data found, performing full refresh instead. [2025-10-06T17:07:45.977189] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-06T17:07:45.977262] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-06T17:07:45.977376] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-10-06T17:07:45.977618] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-06T17:07:45.989533] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T17:07:46.088577] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-06T17:07:46.234338] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-06T17:07:46.384110] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:07:47.025635] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-06T17:07:47.825539] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-06T17:07:48.044306] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T17:07:48.587151] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-06T17:07:48.624898] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-06T17:07:48.629951] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-06T17:07:49.425548] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-06T17:07:49.697094] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T17:07:50.225691] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-06T17:07:51.025531] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-06T17:07:51.172554] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T17:07:51.253314] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T17:07:51.825566] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-06T17:07:52.625594] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-06T17:07:53.261255] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-06T17:07:53.425511] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-06T17:07:53.568746] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T17:07:53.721842] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T17:07:54.225540] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-06T17:07:55.025545] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-06T17:07:55.825557] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-06T17:07:55.907195] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-06T17:07:56.099417] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T17:07:56.367780] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T17:07:56.625532] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-06T17:07:56.744146] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-06T17:07:57.425590] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-06T17:07:58.225565] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-06T17:07:58.666698] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T17:07:58.851690] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-06T17:07:59.025485] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-06T17:07:59.328582] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-06T17:07:59.825512] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-06T17:08:00.625549] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-06T17:08:00.975969] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T17:08:01.425539] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-06T17:08:01.823011] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-06T17:08:02.005028] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T17:08:02.225591] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-06T17:08:02.393041] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T17:08:03.025525] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-06T17:08:03.825506] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-06T17:08:04.102735] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T17:08:04.625488] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-06T17:08:04.725379] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-06T17:08:05.425497] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-06T17:08:05.620974] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T17:08:05.886698] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T17:08:06.225575] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-06T17:08:07.025589] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-06T17:08:07.518210] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T17:08:07.825484] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-06T17:08:07.874524] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-06T17:08:08.427501] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T17:08:08.625482] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-06T17:08:08.636409] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T17:08:09.425532] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-06T17:08:10.225485] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-06T17:08:10.347329] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T17:08:10.571341] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-06T17:08:10.574461] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-06T17:08:10.574595] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-06T17:08:10.992048] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-06T17:08:10.992218] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-06T17:08:10.994311] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-06T17:08:10.994411] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-06T17:08:10.996468] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53752 (keeping 200 days of data) [2025-10-06T17:08:11.053121] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-06T17:08:11.368330] [DEBUG] [LOCAL ] AI: Primary data saved (53752 records). [2025-10-06T17:08:11.368632] [INFO ] [MAIN ] AI: Full history saved. [2025-10-06T17:08:11.369576] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AI took 40.0s. Estimated remaining: 4h 48m 6s. Rate: 8.0 symbols/min [2025-10-06T17:08:11.540942] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:08:11.541137] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-10-06T17:08:11.541173] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-10-06T17:08:11.541366] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-06T17:08:11.541446] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-06T17:08:11.541536] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-06T17:08:11.541581] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-06T17:08:11.829161] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-06T17:08:11.907112] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:08:12.050203] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-06T17:08:12.106587] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T17:08:12.108544] [INFO ] [REMOTE ] AIN: Full fetch complete (33548 records). [2025-10-06T17:08:12.108619] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-06T17:08:12.487444] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-06T17:08:12.487603] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-06T17:08:12.488217] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-06T17:08:12.488296] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-06T17:08:12.496926] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-06T17:08:12.500354] [DEBUG] [LOCAL ] AIN: Trimmed 33548 records to 24606 (keeping 200 days of data) [2025-10-06T17:08:12.626608] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-06T17:08:12.654183] [DEBUG] [LOCAL ] AIN: Primary data saved (24606 records). [2025-10-06T17:08:12.654279] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-06T17:08:12.654356] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIN took 29.0s. Estimated remaining: 4h 44m 22s. Rate: 8.1 symbols/min [2025-10-06T17:08:12.831692] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:08:12.858142] [DEBUG] [LOCAL ] AIT: Loaded 27793 existing records from primary storage. [2025-10-06T17:08:12.858469] [INFO ] [MAIN ] AIT: Loaded 27793 existing records. [2025-10-06T17:08:13.036720] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:08:13.037005] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-06T17:08:13.037072] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-06T17:08:13.037456] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-06T17:08:13.037516] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-06T17:08:13.391253] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:08:13.425482] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-06T17:08:14.225552] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-06T17:08:14.456037] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T17:08:14.743489] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T17:08:15.025490] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-06T17:08:15.171333] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-06T17:08:15.825544] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-06T17:08:16.314199] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-06T17:08:16.625554] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-06T17:08:17.425537] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-06T17:08:17.595605] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T17:08:17.748466] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T17:08:18.156416] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-06T17:08:18.225547] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-06T17:08:19.025533] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-06T17:08:19.712330] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T17:08:19.715680] [INFO ] [REMOTE ] AIG: Full fetch complete (77382 records). [2025-10-06T17:08:19.715814] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-06T17:08:19.830692] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-06T17:08:20.141071] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-06T17:08:20.141193] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-06T17:08:20.142059] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-06T17:08:20.142185] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-06T17:08:20.144016] [DEBUG] [LOCAL ] AIG: Trimmed 77382 records to 53472 (keeping 200 days of data) [2025-10-06T17:08:20.287181] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T17:08:20.510827] [DEBUG] [LOCAL ] AIG: Primary data saved (53472 records). [2025-10-06T17:08:20.510991] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-06T17:08:20.511079] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIG took 40.1s. Estimated remaining: 4h 44m 30s. Rate: 8.1 symbols/min [2025-10-06T17:08:20.630677] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-06T17:08:20.685442] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:08:20.722628] [DEBUG] [LOCAL ] AIV: Loaded 41125 existing records from primary storage. [2025-10-06T17:08:20.722986] [INFO ] [MAIN ] AIV: Loaded 41125 existing records. [2025-10-06T17:08:20.801002] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T17:08:20.828923] [INFO ] [REMOTE ] AIO: Full fetch complete (20144 records). [2025-10-06T17:08:20.829105] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-06T17:08:21.059232] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:08:21.079765] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-06T17:08:21.079864] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-06T17:08:21.095074] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-06T17:08:21.117909] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-06T17:08:21.428423] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-06T17:08:21.518807] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-06T17:08:21.532930] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-06T17:08:21.545488] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-06T17:08:21.567946] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-06T17:08:21.638858] [DEBUG] [LOCAL ] AIO: Trimmed 20144 records to 13376 (keeping 200 days of data) [2025-10-06T17:08:21.860516] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:08:21.880607] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T17:08:21.900161] [DEBUG] [LOCAL ] AIO: Primary data saved (13376 records). [2025-10-06T17:08:21.900288] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-06T17:08:21.900360] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIO took 36.1s. Estimated remaining: 4h 40m 59s. Rate: 8.2 symbols/min [2025-10-06T17:08:22.072928] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:08:22.105853] [DEBUG] [LOCAL ] AIZ: Loaded 30255 existing records from primary storage. [2025-10-06T17:08:22.106158] [INFO ] [MAIN ] AIZ: Loaded 30255 existing records. [2025-10-06T17:08:22.230754] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-06T17:08:22.287852] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:08:22.288074] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-06T17:08:22.288123] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-06T17:08:22.288420] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-06T17:08:22.288478] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-06T17:08:22.647661] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:08:22.910241] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T17:08:23.025488] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-06T17:08:23.531017] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T17:08:23.825533] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-06T17:08:24.046016] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T17:08:24.625543] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-06T17:08:25.118255] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T17:08:25.425539] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-06T17:08:26.076460] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T17:08:26.225552] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-06T17:08:26.753213] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T17:08:27.025533] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-06T17:08:27.214584] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T17:08:27.825568] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-06T17:08:28.345679] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T17:08:28.625623] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-06T17:08:29.226115] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T17:08:29.425591] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-06T17:08:29.854120] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T17:08:30.225543] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-06T17:08:30.784610] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-06T17:08:31.025573] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-06T17:08:31.567930] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T17:08:31.825542] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-06T17:08:32.442174] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T17:08:32.625607] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-06T17:08:32.897581] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T17:08:33.425572] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-06T17:08:34.064411] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T17:08:34.225506] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-06T17:08:34.420847] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T17:08:34.422477] [INFO ] [REMOTE ] AIT: Full fetch complete (39324 records). [2025-10-06T17:08:34.422559] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-06T17:08:34.793926] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-06T17:08:34.794026] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-06T17:08:34.794479] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-06T17:08:34.794520] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-06T17:08:34.795406] [DEBUG] [LOCAL ] AIT: Trimmed 39324 records to 27295 (keeping 200 days of data) [2025-10-06T17:08:34.966772] [DEBUG] [LOCAL ] AIT: Primary data saved (27295 records). [2025-10-06T17:08:34.966921] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-06T17:08:34.967004] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIT took 22.3s. Estimated remaining: 4h 44m 3s. Rate: 8.1 symbols/min [2025-10-06T17:08:35.035363] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-06T17:08:35.151906] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:08:35.158819] [DEBUG] [LOCAL ] AIZN: Loaded 4108 existing records from primary storage. [2025-10-06T17:08:35.159025] [INFO ] [MAIN ] AIZN: Loaded 4108 existing records. [2025-10-06T17:08:35.341344] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:08:35.341829] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-06T17:08:35.341983] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-06T17:08:35.342327] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-06T17:08:35.342389] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-06T17:08:35.481286] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T17:08:35.718794] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:08:35.825490] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-06T17:08:36.311274] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-06T17:08:36.336684] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-06T17:08:36.625548] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-06T17:08:37.425567] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-06T17:08:38.030755] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T17:08:38.094172] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T17:08:38.225528] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-06T17:08:39.025538] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-06T17:08:39.712992] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T17:08:39.825531] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-06T17:08:40.421296] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T17:08:40.532801] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T17:08:40.625539] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-06T17:08:41.425544] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-06T17:08:42.106346] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T17:08:42.225503] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-06T17:08:42.575463] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T17:08:43.025552] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-06T17:08:43.402010] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-06T17:08:43.688208] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T17:08:43.825553] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-06T17:08:44.625546] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-06T17:08:45.051639] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T17:08:45.425594] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-06T17:08:45.983117] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T17:08:46.006749] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-06T17:08:46.225558] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-06T17:08:46.861396] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-06T17:08:47.025562] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-06T17:08:47.825519] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-06T17:08:48.209063] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-06T17:08:48.630711] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-06T17:08:48.640181] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T17:08:49.425535] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-06T17:08:49.987663] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-06T17:08:50.067378] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T17:08:50.225517] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-06T17:08:51.025527] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-06T17:08:51.498384] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T17:08:51.825542] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-06T17:08:52.397637] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-06T17:08:52.485276] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T17:08:52.625537] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-06T17:08:53.425592] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-06T17:08:53.973678] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T17:08:53.977087] [INFO ] [REMOTE ] AIR: Full fetch complete (39469 records). [2025-10-06T17:08:53.977231] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-06T17:08:54.106276] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-06T17:08:54.235370] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-06T17:08:54.405427] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-06T17:08:54.405527] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-06T17:08:54.406053] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-06T17:08:54.406138] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-06T17:08:54.407139] [DEBUG] [LOCAL ] AIR: Trimmed 39469 records to 28637 (keeping 200 days of data) [2025-10-06T17:08:54.591730] [DEBUG] [LOCAL ] AIR: Primary data saved (28637 records). [2025-10-06T17:08:54.591989] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-06T17:08:54.592142] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIR took 43.2s. Estimated remaining: 4h 50m 37s. Rate: 7.9 symbols/min [2025-10-06T17:08:54.774533] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:08:54.830394] [DEBUG] [LOCAL ] AJG: Loaded 47485 existing records from primary storage. [2025-10-06T17:08:54.830841] [INFO ] [MAIN ] AJG: Loaded 47485 existing records. [2025-10-06T17:08:54.932097] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T17:08:55.030775] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-06T17:08:55.036965] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:08:55.038352] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-06T17:08:55.038406] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-06T17:08:55.038733] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-06T17:08:55.038792] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-06T17:08:55.413168] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:08:55.695702] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T17:08:55.696732] [INFO ] [REMOTE ] AIZN: Full fetch complete (5884 records). [2025-10-06T17:08:55.696809] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-06T17:08:55.697284] [FATAL] [VALIDATOR ] AIZN: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:08:55.697436] [FATAL] [MAIN ] AIZN: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:08:55.697483] [WARN ] [MAIN ] AIZN: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:08:55.697521] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-06T17:08:55.697584] [DEBUG] [LOCAL ] AIZN: No primary data file found to delete. [2025-10-06T17:08:55.697620] [INFO ] [LOCAL ] AIZN: Starting deletion of derivative data. [2025-10-06T17:08:55.697941] [DEBUG] [LOCAL ] AIZN: Deleted derivative data file. [2025-10-06T17:08:55.698041] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIZN took 20.7s. Estimated remaining: 4h 47m 0s. Rate: 8.0 symbols/min [2025-10-06T17:08:55.830728] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-06T17:08:55.897443] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:08:55.897714] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-06T17:08:55.897772] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-06T17:08:55.897893] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-06T17:08:55.897937] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-06T17:08:55.897982] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-06T17:08:55.898017] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-06T17:08:56.278564] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:08:56.625569] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-06T17:08:57.426377] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-06T17:08:57.432848] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T17:08:58.225521] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-06T17:08:58.359530] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T17:08:58.769960] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-06T17:08:59.025593] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-06T17:08:59.098883] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T17:08:59.411814] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-06T17:08:59.825554] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-06T17:09:00.625561] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-06T17:09:01.318932] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T17:09:01.425547] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-06T17:09:01.486634] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T17:09:02.225578] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-06T17:09:02.841563] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T17:09:03.025587] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-06T17:09:03.274513] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T17:09:03.276561] [INFO ] [REMOTE ] AIZ: Full fetch complete (42899 records). [2025-10-06T17:09:03.276694] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-06T17:09:03.683791] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-06T17:09:03.683890] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-06T17:09:03.684564] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-06T17:09:03.684632] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-06T17:09:03.685845] [DEBUG] [LOCAL ] AIZ: Trimmed 42899 records to 29808 (keeping 200 days of data) [2025-10-06T17:09:03.845271] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-06T17:09:03.888312] [DEBUG] [LOCAL ] AIZ: Primary data saved (29808 records). [2025-10-06T17:09:03.888503] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-06T17:09:03.888628] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZ took 42.0s. Estimated remaining: 4h 47m 15s. Rate: 8.0 symbols/min [2025-10-06T17:09:04.069279] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:09:04.118143] [DEBUG] [LOCAL ] AKR: Loaded 46431 existing records from primary storage. [2025-10-06T17:09:04.118606] [INFO ] [MAIN ] AKR: Loaded 46431 existing records. [2025-10-06T17:09:04.302569] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:09:04.302840] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-06T17:09:04.302890] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-06T17:09:04.303231] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-06T17:09:04.303290] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-06T17:09:04.614996] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T17:09:04.626064] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-06T17:09:04.642410] [INFO ] [REMOTE ] AIV: Full fetch complete (60029 records). [2025-10-06T17:09:04.667799] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-06T17:09:04.708034] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:09:05.138737] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-06T17:09:05.138861] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-06T17:09:05.139623] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-06T17:09:05.139726] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-06T17:09:05.141498] [DEBUG] [LOCAL ] AIV: Trimmed 60029 records to 40739 (keeping 200 days of data) [2025-10-06T17:09:05.235291] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T17:09:05.396180] [DEBUG] [LOCAL ] AIV: Primary data saved (40739 records). [2025-10-06T17:09:05.396589] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-06T17:09:05.396782] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIV took 44.9s. Estimated remaining: 4h 43m 59s. Rate: 8.1 symbols/min [2025-10-06T17:09:05.436055] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-06T17:09:05.579274] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:09:05.613836] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T17:09:05.666567] [DEBUG] [LOCAL ] AL: Loaded 44986 existing records from primary storage. [2025-10-06T17:09:05.667030] [INFO ] [MAIN ] AL: Loaded 44986 existing records. [2025-10-06T17:09:05.859940] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:09:05.860216] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-06T17:09:05.860269] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-06T17:09:05.860558] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-06T17:09:05.860618] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-06T17:09:05.971172] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-06T17:09:06.241345] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-06T17:09:06.252857] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:09:06.826014] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-06T17:09:07.025572] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-06T17:09:07.825518] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-06T17:09:08.625566] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-06T17:09:08.855351] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T17:09:09.205010] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T17:09:09.425558] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-06T17:09:09.754324] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-06T17:09:09.792198] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-06T17:09:10.225579] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-06T17:09:10.613356] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-06T17:09:11.025567] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-06T17:09:11.825528] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-06T17:09:12.170721] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-06T17:09:12.416023] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T17:09:12.625558] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-06T17:09:12.979320] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-06T17:09:12.980076] [INFO ] [REMOTE ] AKA: Full fetch complete (2399 records). [2025-10-06T17:09:12.980148] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-06T17:09:13.172538] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T17:09:13.172816] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:09:13.172863] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:09:13.172936] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-06T17:09:13.173010] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-06T17:09:13.173046] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-06T17:09:13.173084] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-06T17:09:13.173145] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AKA took 17.5s. Estimated remaining: 4h 44m 3s. Rate: 8.1 symbols/min [2025-10-06T17:09:13.356046] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:09:13.418533] [DEBUG] [LOCAL ] ALB: Loaded 54012 existing records from primary storage. [2025-10-06T17:09:13.419007] [INFO ] [MAIN ] ALB: Loaded 54012 existing records. [2025-10-06T17:09:13.430770] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-06T17:09:13.648029] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:09:13.648294] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-06T17:09:13.648341] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-06T17:09:13.648862] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-06T17:09:13.648926] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-06T17:09:14.002008] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:09:14.225527] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-06T17:09:15.025622] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-06T17:09:15.353585] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-06T17:09:15.825557] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-06T17:09:15.944446] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T17:09:16.625572] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-06T17:09:16.689775] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T17:09:17.425718] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-06T17:09:17.542625] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T17:09:18.225502] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-06T17:09:18.540996] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T17:09:18.955738] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T17:09:19.025528] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-06T17:09:19.508781] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T17:09:19.825565] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-06T17:09:20.114348] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-06T17:09:20.625564] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-06T17:09:21.425506] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-06T17:09:21.768138] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T17:09:22.225497] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-06T17:09:22.502103] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-06T17:09:23.032949] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-06T17:09:23.049441] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T17:09:23.523591] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-06T17:09:23.825552] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-06T17:09:24.625498] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-06T17:09:24.878381] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T17:09:25.231098] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T17:09:25.425588] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-06T17:09:25.927734] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-06T17:09:26.225542] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-06T17:09:27.025543] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-06T17:09:27.538376] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T17:09:27.627744] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-06T17:09:27.825521] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-06T17:09:28.625497] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-06T17:09:28.723871] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T17:09:29.345734] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T17:09:29.425538] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-06T17:09:30.225561] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-06T17:09:30.677569] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-06T17:09:31.025503] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-06T17:09:31.286780] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-06T17:09:31.825562] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-06T17:09:31.880248] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T17:09:32.625499] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-06T17:09:32.718866] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T17:09:33.340561] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-06T17:09:33.425472] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-06T17:09:34.133930] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T17:09:34.225517] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-06T17:09:34.982701] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T17:09:35.025473] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-06T17:09:35.470083] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-06T17:09:35.825531] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-06T17:09:36.620283] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T17:09:36.630538] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-06T17:09:37.425633] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-06T17:09:37.989019] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-06T17:09:38.225619] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-06T17:09:38.299526] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T17:09:38.975944] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T17:09:38.980325] [INFO ] [REMOTE ] AL: Full fetch complete (62822 records). [2025-10-06T17:09:38.980555] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-06T17:09:39.030927] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-06T17:09:39.462257] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T17:09:39.506783] [INFO ] [REMOTE ] AKR: Full fetch complete (65133 records). [2025-10-06T17:09:39.531169] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-06T17:09:39.558275] [FATAL] [VALIDATOR ] AKR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:09:39.575917] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-06T17:09:39.576285] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-06T17:09:39.577246] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-06T17:09:39.576145] [FATAL] [MAIN ] AKR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:09:39.577499] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-06T17:09:39.577419] [WARN ] [MAIN ] AKR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:09:39.577908] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-06T17:09:39.578086] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-10-06T17:09:39.578153] [INFO ] [LOCAL ] AKR: Starting deletion of derivative data. [2025-10-06T17:09:39.578978] [DEBUG] [LOCAL ] AKR: Deleted derivative data file. [2025-10-06T17:09:39.579188] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AKR took 35.7s. Estimated remaining: 4h 53m 37s. Rate: 7.8 symbols/min [2025-10-06T17:09:39.585440] [DEBUG] [LOCAL ] AL: Trimmed 62822 records to 44414 (keeping 200 days of data) [2025-10-06T17:09:39.830728] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-06T17:09:39.918601] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:09:40.124449] [DEBUG] [LOCAL ] ALC: Loaded 51600 existing records from primary storage. [2025-10-06T17:09:40.126597] [INFO ] [MAIN ] ALC: Loaded 51600 existing records. [2025-10-06T17:09:40.209457] [DEBUG] [LOCAL ] AL: Primary data saved (44414 records). [2025-10-06T17:09:40.226519] [INFO ] [MAIN ] AL: Full history saved. [2025-10-06T17:09:40.238693] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AL took 34.8s. Estimated remaining: 4h 49m 57s. Rate: 7.9 symbols/min [2025-10-06T17:09:40.465023] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:09:40.500209] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-06T17:09:40.501025] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-06T17:09:40.519075] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-06T17:09:40.519213] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-06T17:09:40.519000] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:09:40.830007] [DEBUG] [LOCAL ] ALE: Loaded 31333 existing records from primary storage. [2025-10-06T17:09:40.846855] [INFO ] [MAIN ] ALE: Loaded 31333 existing records. [2025-10-06T17:09:41.033568] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:09:41.047144] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-06T17:09:41.133451] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:09:41.133853] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-06T17:09:41.133915] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-06T17:09:41.134298] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-06T17:09:41.134390] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-06T17:09:41.519952] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:09:41.520835] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-06T17:09:41.580817] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-06T17:09:41.814149] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T17:09:42.225587] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-06T17:09:42.509976] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T17:09:42.822083] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T17:09:43.025569] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-06T17:09:43.825497] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-06T17:09:44.189264] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T17:09:44.465102] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T17:09:44.625502] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-06T17:09:45.018908] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T17:09:45.425537] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-06T17:09:46.225572] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-06T17:09:46.348312] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T17:09:46.856235] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T17:09:46.859500] [INFO ] [REMOTE ] AJG: Full fetch complete (69387 records). [2025-10-06T17:09:46.859638] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-06T17:09:47.046220] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-06T17:09:47.269974] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-06T17:09:47.270135] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-06T17:09:47.270997] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-06T17:09:47.271070] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-06T17:09:47.272635] [DEBUG] [LOCAL ] AJG: Trimmed 69387 records to 46800 (keeping 200 days of data) [2025-10-06T17:09:47.380205] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T17:09:47.587265] [DEBUG] [LOCAL ] AJG: Primary data saved (46800 records). [2025-10-06T17:09:47.587446] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-06T17:09:47.588434] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AJG took 53.0s. Estimated remaining: 4h 49m 43s. Rate: 7.9 symbols/min [2025-10-06T17:09:47.825551] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-06T17:09:48.625520] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-06T17:09:48.972882] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-06T17:09:49.425589] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-06T17:09:49.663030] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-06T17:09:50.225503] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-06T17:09:50.447881] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-06T17:09:50.805695] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T17:09:51.025583] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-06T17:09:51.825554] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-06T17:09:52.355275] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-06T17:09:52.359020] [INFO ] [REMOTE ] ALB: Full fetch complete (76866 records). [2025-10-06T17:09:52.359246] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-06T17:09:52.833068] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-06T17:09:52.833384] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-06T17:09:52.834389] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-06T17:09:52.834489] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-06T17:09:52.839441] [DEBUG] [LOCAL ] ALB: Trimmed 76866 records to 53274 (keeping 200 days of data) [2025-10-06T17:09:52.977540] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-06T17:09:53.004129] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-06T17:09:53.022826] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T17:09:53.262977] [DEBUG] [LOCAL ] ALB: Primary data saved (53274 records). [2025-10-06T17:09:53.263170] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-06T17:09:53.263262] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALB took 40.1s. Estimated remaining: 4h 48m 39s. Rate: 7.9 symbols/min [2025-10-06T17:09:53.425535] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-06T17:09:54.532017] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T17:09:54.537627] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-06T17:09:54.897124] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T17:09:55.025481] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-06T17:09:56.007294] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T17:09:56.015248] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-06T17:09:56.765234] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T17:09:56.776355] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-06T17:09:57.248039] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T17:09:57.425554] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-06T17:09:58.419525] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T17:09:58.430536] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-06T17:09:58.488427] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T17:09:59.025628] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-06T17:10:00.103762] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T17:10:00.115587] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-06T17:10:00.313175] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T17:10:00.316112] [INFO ] [REMOTE ] ALE: Full fetch complete (43270 records). [2025-10-06T17:10:00.316247] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-06T17:10:00.746713] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-06T17:10:00.746836] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-06T17:10:00.747537] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-06T17:10:00.747605] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-06T17:10:00.748854] [DEBUG] [LOCAL ] ALE: Trimmed 43270 records to 31117 (keeping 200 days of data) [2025-10-06T17:10:00.955628] [DEBUG] [LOCAL ] ALE: Primary data saved (31117 records). [2025-10-06T17:10:00.955835] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-06T17:10:00.955979] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALE took 20.7s. Estimated remaining: 4h 48m 36s. Rate: 7.9 symbols/min [2025-10-06T17:10:02.207730] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-06T17:10:02.219428] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-06T17:10:04.072199] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T17:10:04.085499] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-06T17:10:05.718527] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T17:10:05.722085] [INFO ] [REMOTE ] ALC: Full fetch complete (73081 records). [2025-10-06T17:10:05.722244] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-06T17:10:06.150883] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-06T17:10:06.151001] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-06T17:10:06.151800] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-06T17:10:06.151872] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-06T17:10:06.153519] [DEBUG] [LOCAL ] ALC: Trimmed 73081 records to 50954 (keeping 200 days of data) [2025-10-06T17:10:06.461805] [DEBUG] [LOCAL ] ALC: Primary data saved (50954 records). [2025-10-06T17:10:06.462002] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-06T17:10:06.462114] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALC took 26.9s. Estimated remaining: 4h 47m 30s. Rate: 8.0 symbols/min [2025-10-06T17:10:07.153555] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:10:07.266904] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:10:07.263807] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:10:07.289000] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:10:07.303992] [DEBUG] [LOCAL ] ALG: Loaded 10359 existing records from primary storage. [2025-10-06T17:10:07.304529] [INFO ] [MAIN ] ALG: Loaded 10359 existing records. [2025-10-06T17:10:07.460698] [DEBUG] [LOCAL ] ALEX: Loaded 31583 existing records from primary storage. [2025-10-06T17:10:07.549900] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:10:07.520043] [INFO ] [MAIN ] ALEX: Loaded 31583 existing records. [2025-10-06T17:10:07.551574] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-06T17:10:07.572009] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-06T17:10:07.646467] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-06T17:10:07.620135] [DEBUG] [LOCAL ] ALK: Loaded 53834 existing records from primary storage. [2025-10-06T17:10:07.675140] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-06T17:10:07.697525] [INFO ] [MAIN ] ALK: Loaded 53834 existing records. [2025-10-06T17:10:07.704602] [DEBUG] [LOCAL ] ALIT: Loaded 53540 existing records from primary storage. [2025-10-06T17:10:07.794924] [INFO ] [MAIN ] ALIT: Loaded 53540 existing records. [2025-10-06T17:10:08.153082] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:10:08.213433] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-06T17:10:08.280870] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-06T17:10:08.371890] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-06T17:10:08.432740] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-06T17:10:08.432604] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:10:08.444493] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:10:08.484475] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-06T17:10:08.484672] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-06T17:10:08.498998] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-06T17:10:08.484834] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-06T17:10:08.520706] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-06T17:10:08.509805] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-06T17:10:08.553766] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-06T17:10:08.559127] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-06T17:10:08.986236] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:10:09.012839] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-06T17:10:09.581627] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:10:09.641018] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-06T17:10:09.718994] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:10:09.741076] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-06T17:10:09.817031] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:10:09.817448] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-06T17:10:10.291257] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T17:10:10.294242] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-06T17:10:11.129429] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T17:10:11.137333] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-06T17:10:11.173517] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T17:10:11.178707] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-06T17:10:11.238029] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T17:10:11.250577] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-06T17:10:11.889842] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-06T17:10:11.900529] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-06T17:10:12.037996] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T17:10:12.042979] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-06T17:10:12.372024] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T17:10:12.378447] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-06T17:10:12.974240] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T17:10:12.985131] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-06T17:10:13.019011] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T17:10:13.022833] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-06T17:10:13.654844] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T17:10:13.655733] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-06T17:10:13.673837] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-06T17:10:13.675000] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-06T17:10:13.749208] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T17:10:14.225718] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-06T17:10:14.517599] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T17:10:15.025482] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-06T17:10:15.070868] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T17:10:15.120527] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T17:10:15.304073] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T17:10:15.825551] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-06T17:10:16.625591] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-06T17:10:16.678862] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T17:10:17.425516] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-06T17:10:17.542019] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T17:10:18.094810] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T17:10:18.225558] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-06T17:10:18.645567] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T17:10:19.025586] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-06T17:10:19.504978] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-06T17:10:19.715757] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-06T17:10:19.825563] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-06T17:10:20.625576] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-06T17:10:20.744696] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-06T17:10:21.425561] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-06T17:10:21.643464] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T17:10:21.871075] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-06T17:10:22.225544] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-06T17:10:22.981992] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T17:10:22.983148] [INFO ] [REMOTE ] ALG: Full fetch complete (15819 records). [2025-10-06T17:10:22.983223] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-06T17:10:23.035694] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-06T17:10:23.365710] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-06T17:10:23.365811] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-06T17:10:23.366102] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-06T17:10:23.366142] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-06T17:10:23.366680] [DEBUG] [LOCAL ] ALG: Trimmed 15819 records to 10048 (keeping 200 days of data) [2025-10-06T17:10:23.429391] [DEBUG] [LOCAL ] ALG: Primary data saved (10048 records). [2025-10-06T17:10:23.429565] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-06T17:10:23.429672] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALG took 17.0s. Estimated remaining: 4h 51m 49s. Rate: 7.8 symbols/min [2025-10-06T17:10:23.604710] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:10:23.660553] [DEBUG] [LOCAL ] ALL: Loaded 50729 existing records from primary storage. [2025-10-06T17:10:23.660979] [INFO ] [MAIN ] ALL: Loaded 50729 existing records. [2025-10-06T17:10:23.831564] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-06T17:10:23.836917] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:10:23.838117] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-06T17:10:23.838182] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-06T17:10:23.838817] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-06T17:10:23.838906] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-06T17:10:24.227277] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:10:24.625512] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-06T17:10:25.084046] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-06T17:10:25.425509] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-06T17:10:25.824492] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-06T17:10:26.225506] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-06T17:10:26.503550] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T17:10:27.025505] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-06T17:10:27.237537] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T17:10:27.841227] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-06T17:10:27.844598] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T17:10:28.625561] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-06T17:10:28.811721] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T17:10:29.262505] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T17:10:29.425537] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-06T17:10:30.225501] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-06T17:10:30.367453] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T17:10:30.478973] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T17:10:31.025551] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-06T17:10:31.818522] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T17:10:31.829240] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-06T17:10:32.280245] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-06T17:10:32.625533] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-06T17:10:33.425506] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-06T17:10:33.815058] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T17:10:34.028862] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T17:10:34.225552] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-06T17:10:34.640521] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T17:10:34.643784] [INFO ] [REMOTE ] ALEX: Full fetch complete (44723 records). [2025-10-06T17:10:34.643888] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-06T17:10:35.015534] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-06T17:10:35.015670] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-06T17:10:35.016180] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-06T17:10:35.016223] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-06T17:10:35.017231] [DEBUG] [LOCAL ] ALEX: Trimmed 44723 records to 31205 (keeping 200 days of data) [2025-10-06T17:10:35.070567] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-06T17:10:35.206088] [DEBUG] [LOCAL ] ALEX: Primary data saved (31205 records). [2025-10-06T17:10:35.206256] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-06T17:10:35.206341] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 28.7s. Estimated remaining: 4h 53m 37s. Rate: 7.8 symbols/min [2025-10-06T17:10:35.388743] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:10:35.436877] [DEBUG] [LOCAL ] ALLE: Loaded 45291 existing records from primary storage. [2025-10-06T17:10:35.437248] [INFO ] [MAIN ] ALLE: Loaded 45291 existing records. [2025-10-06T17:10:35.627280] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:10:35.628022] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-06T17:10:35.628086] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-06T17:10:35.629119] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-06T17:10:35.629180] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-06T17:10:35.832249] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-06T17:10:36.015118] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:10:36.089872] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T17:10:36.594823] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T17:10:36.625586] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-06T17:10:37.425549] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-06T17:10:37.632252] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-06T17:10:38.174827] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T17:10:38.225513] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-06T17:10:39.025609] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-06T17:10:39.294795] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-06T17:10:39.775170] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T17:10:39.825498] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-06T17:10:40.625554] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-06T17:10:40.666672] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T17:10:41.358007] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T17:10:41.425566] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-06T17:10:42.225525] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-06T17:10:42.373705] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-06T17:10:42.376951] [INFO ] [REMOTE ] ALK: Full fetch complete (76837 records). [2025-10-06T17:10:42.377079] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-06T17:10:42.844845] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-06T17:10:42.845013] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-06T17:10:42.846315] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-06T17:10:42.846473] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-06T17:10:42.849530] [DEBUG] [LOCAL ] ALK: Trimmed 76837 records to 53058 (keeping 200 days of data) [2025-10-06T17:10:43.043831] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-06T17:10:43.210998] [DEBUG] [LOCAL ] ALK: Primary data saved (53058 records). [2025-10-06T17:10:43.211255] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-06T17:10:43.211490] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALK took 36.7s. Estimated remaining: 4h 53m 37s. Rate: 7.8 symbols/min [2025-10-06T17:10:43.384989] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-06T17:10:43.455774] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:10:43.512973] [DEBUG] [LOCAL ] ALLY: Loaded 53994 existing records from primary storage. [2025-10-06T17:10:43.513367] [INFO ] [MAIN ] ALLY: Loaded 53994 existing records. [2025-10-06T17:10:43.723082] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:10:43.723472] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-06T17:10:43.723638] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-06T17:10:43.724328] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-06T17:10:43.724485] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-06T17:10:43.826146] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-06T17:10:43.926024] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T17:10:44.165452] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:10:44.625520] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-06T17:10:44.805728] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T17:10:45.425521] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-06T17:10:45.553462] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T17:10:46.225510] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-06T17:10:46.694713] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-06T17:10:46.903218] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T17:10:47.025572] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-06T17:10:47.790966] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T17:10:47.825472] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-06T17:10:48.625564] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-06T17:10:48.805184] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T17:10:49.227991] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T17:10:49.425577] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-06T17:10:50.225578] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-06T17:10:50.295294] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T17:10:51.025505] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-06T17:10:51.115970] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T17:10:51.825508] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-06T17:10:52.186803] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T17:10:52.625561] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-06T17:10:52.715840] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T17:10:53.425580] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-06T17:10:53.675356] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T17:10:54.225600] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-06T17:10:54.410598] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T17:10:54.982258] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T17:10:55.025535] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-06T17:10:55.825581] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-06T17:10:56.098441] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T17:10:56.559286] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T17:10:56.625593] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-06T17:10:57.044146] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T17:10:57.047786] [INFO ] [REMOTE ] ALL: Full fetch complete (72387 records). [2025-10-06T17:10:57.048002] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-06T17:10:57.430773] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-06T17:10:57.530079] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-06T17:10:57.530203] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-06T17:10:57.531555] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-06T17:10:57.531638] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-06T17:10:57.533957] [DEBUG] [LOCAL ] ALL: Trimmed 72387 records to 49926 (keeping 200 days of data) [2025-10-06T17:10:57.878160] [DEBUG] [LOCAL ] ALL: Primary data saved (49926 records). [2025-10-06T17:10:57.878329] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-06T17:10:57.878424] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALL took 34.4s. Estimated remaining: 4h 56m 39s. Rate: 7.7 symbols/min [2025-10-06T17:10:58.062361] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:10:58.110096] [DEBUG] [LOCAL ] ALSN: Loaded 43927 existing records from primary storage. [2025-10-06T17:10:58.110609] [INFO ] [MAIN ] ALSN: Loaded 43927 existing records. [2025-10-06T17:10:58.229759] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-06T17:10:58.306902] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:10:58.307394] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-06T17:10:58.307608] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-06T17:10:58.332871] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-06T17:10:58.333158] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-06T17:10:58.381747] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T17:10:58.736312] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:10:59.025551] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-06T17:10:59.559687] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-06T17:10:59.825497] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-06T17:10:59.909083] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-06T17:10:59.913529] [INFO ] [REMOTE ] ALIT: Full fetch complete (76434 records). [2025-10-06T17:10:59.913837] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-06T17:11:00.360153] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-06T17:11:00.361098] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T17:11:00.361322] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-06T17:11:00.364928] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-06T17:11:00.365220] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-06T17:11:00.365703] [INFO ] [REMOTE ] ALLE: Full fetch complete (64685 records). [2025-10-06T17:11:00.365884] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-06T17:11:00.426607] [DEBUG] [LOCAL ] ALIT: Trimmed 76434 records to 52768 (keeping 200 days of data) [2025-10-06T17:11:00.626676] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-06T17:11:01.057407] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-06T17:11:01.060666] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-06T17:11:01.068994] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-06T17:11:01.069465] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-06T17:11:01.075134] [DEBUG] [LOCAL ] ALLE: Trimmed 64685 records to 44573 (keeping 200 days of data) [2025-10-06T17:11:01.302914] [DEBUG] [LOCAL ] ALIT: Primary data saved (52768 records). [2025-10-06T17:11:01.304107] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-06T17:11:01.304777] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALIT took 54.8s. Estimated remaining: 4h 54m 34s. Rate: 7.8 symbols/min [2025-10-06T17:11:01.507403] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:11:01.639236] [DEBUG] [LOCAL ] ALTG: Loaded 23811 existing records from primary storage. [2025-10-06T17:11:01.641898] [INFO ] [MAIN ] ALTG: Loaded 23811 existing records. [2025-10-06T17:11:01.887992] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:11:01.899473] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-06T17:11:01.907297] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-06T17:11:01.921998] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-06T17:11:01.922146] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-06T17:11:02.137468] [DEBUG] [LOCAL ] ALLE: Primary data saved (44573 records). [2025-10-06T17:11:02.173167] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-06T17:11:02.186767] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-06T17:11:02.196121] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALLE took 27.0s. Estimated remaining: 4h 51m 25s. Rate: 7.8 symbols/min [2025-10-06T17:11:02.248633] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-06T17:11:02.583274] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:11:02.617779] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-06T17:11:02.658343] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:11:02.675614] [DEBUG] [LOCAL ] ALUR: Loaded 10863 existing records from primary storage. [2025-10-06T17:11:02.676040] [INFO ] [MAIN ] ALUR: Loaded 10863 existing records. [2025-10-06T17:11:02.872118] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-06T17:11:02.922528] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:11:02.922807] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-06T17:11:02.922871] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-06T17:11:02.923074] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-06T17:11:02.923134] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-06T17:11:03.031512] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-06T17:11:03.307727] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:11:03.710682] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-06T17:11:03.825525] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-06T17:11:04.013919] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T17:11:04.625516] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-06T17:11:04.736186] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T17:11:04.856319] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T17:11:05.425534] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-06T17:11:06.225544] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-06T17:11:06.412489] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T17:11:06.853861] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-06T17:11:07.025614] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-06T17:11:07.726930] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T17:11:07.825556] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-06T17:11:08.017293] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T17:11:08.625558] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-06T17:11:08.867122] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T17:11:09.425541] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-06T17:11:09.931147] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T17:11:10.225577] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-06T17:11:11.025519] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-06T17:11:11.061164] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T17:11:11.398548] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T17:11:11.825561] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-06T17:11:12.625546] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-06T17:11:12.899596] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-06T17:11:12.926251] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T17:11:13.425554] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-06T17:11:13.663707] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-06T17:11:14.225575] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-06T17:11:15.025612] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-06T17:11:15.464950] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-06T17:11:15.540895] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-06T17:11:15.544133] [INFO ] [REMOTE ] ALLY: Full fetch complete (76938 records). [2025-10-06T17:11:15.544271] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-06T17:11:15.830825] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-06T17:11:16.042614] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-06T17:11:16.042766] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-06T17:11:16.043630] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-06T17:11:16.043723] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-06T17:11:16.045833] [DEBUG] [LOCAL ] ALLY: Trimmed 76938 records to 53227 (keeping 200 days of data) [2025-10-06T17:11:16.364838] [DEBUG] [LOCAL ] ALLY: Primary data saved (53227 records). [2025-10-06T17:11:16.365043] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-06T17:11:16.365142] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLY took 33.2s. Estimated remaining: 4h 54m 8s. Rate: 7.8 symbols/min [2025-10-06T17:11:16.540617] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:11:16.585587] [DEBUG] [LOCAL ] ALV: Loaded 42942 existing records from primary storage. [2025-10-06T17:11:16.585949] [INFO ] [MAIN ] ALV: Loaded 42942 existing records. [2025-10-06T17:11:16.630730] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-06T17:11:16.781754] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:11:16.783355] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-06T17:11:16.783706] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-06T17:11:16.784722] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-06T17:11:16.784864] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-06T17:11:16.993242] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T17:11:17.093865] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T17:11:17.268512] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:11:17.425562] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-06T17:11:17.682329] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T17:11:18.225519] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-06T17:11:18.585171] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-06T17:11:18.970178] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T17:11:19.025499] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-06T17:11:19.825545] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-06T17:11:20.087949] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T17:11:20.625556] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-06T17:11:21.431231] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-06T17:11:21.442961] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T17:11:21.481326] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T17:11:22.225546] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-06T17:11:22.913238] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T17:11:23.025526] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-06T17:11:23.206384] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-06T17:11:23.209127] [INFO ] [REMOTE ] ALTG: Full fetch complete (33682 records). [2025-10-06T17:11:23.209355] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-06T17:11:23.598159] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-06T17:11:23.598308] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-06T17:11:23.598822] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-06T17:11:23.598893] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-06T17:11:23.600081] [DEBUG] [LOCAL ] ALTG: Trimmed 33682 records to 23567 (keeping 200 days of data) [2025-10-06T17:11:23.764815] [DEBUG] [LOCAL ] ALTG: Primary data saved (23567 records). [2025-10-06T17:11:23.765066] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-06T17:11:23.765194] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALTG took 22.5s. Estimated remaining: 4h 53m 52s. Rate: 7.8 symbols/min [2025-10-06T17:11:23.835163] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-06T17:11:23.953819] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:11:23.963872] [DEBUG] [LOCAL ] ALX: Loaded 6349 existing records from primary storage. [2025-10-06T17:11:23.964173] [INFO ] [MAIN ] ALX: Loaded 6349 existing records. [2025-10-06T17:11:24.262241] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:11:24.262605] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-06T17:11:24.262721] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-06T17:11:24.262940] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-06T17:11:24.263010] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-06T17:11:24.538392] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T17:11:24.633575] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-06T17:11:24.830492] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T17:11:24.947547] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:11:25.425551] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-06T17:11:26.225549] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-06T17:11:26.292988] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-06T17:11:26.320778] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T17:11:26.811979] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T17:11:27.025547] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-06T17:11:27.825536] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-06T17:11:27.910223] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T17:11:28.320270] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-06T17:11:28.625555] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-06T17:11:29.425558] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-06T17:11:30.056460] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-06T17:11:30.225637] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-06T17:11:30.288489] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T17:11:30.899550] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-06T17:11:30.900967] [INFO ] [REMOTE ] ALUR: Full fetch complete (20162 records). [2025-10-06T17:11:30.901048] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-06T17:11:31.030881] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-06T17:11:31.304028] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-06T17:11:31.304121] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-06T17:11:31.304516] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-06T17:11:31.304583] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-06T17:11:31.305322] [DEBUG] [LOCAL ] ALUR: Trimmed 20162 records to 10746 (keeping 200 days of data) [2025-10-06T17:11:31.372750] [DEBUG] [LOCAL ] ALUR: Primary data saved (10746 records). [2025-10-06T17:11:31.372941] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-06T17:11:31.373046] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALUR took 29.2s. Estimated remaining: 4h 53m 41s. Rate: 7.8 symbols/min [2025-10-06T17:11:31.558446] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:11:31.618715] [DEBUG] [LOCAL ] AM: Loaded 52803 existing records from primary storage. [2025-10-06T17:11:31.619146] [INFO ] [MAIN ] AM: Loaded 52803 existing records. [2025-10-06T17:11:31.792435] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:11:31.792755] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-06T17:11:31.792809] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-06T17:11:31.793290] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-06T17:11:31.793348] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-06T17:11:31.835516] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-06T17:11:32.165022] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:11:32.630795] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-06T17:11:32.650383] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T17:11:33.425550] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-06T17:11:33.526428] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T17:11:33.965190] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-06T17:11:34.225514] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-06T17:11:34.274038] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T17:11:35.025563] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-06T17:11:35.577454] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T17:11:35.825527] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-06T17:11:36.302257] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-06T17:11:36.625592] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-06T17:11:36.689559] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T17:11:37.221469] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-06T17:11:37.425541] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-06T17:11:38.225564] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-06T17:11:38.700105] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T17:11:38.702880] [INFO ] [REMOTE ] ALSN: Full fetch complete (62170 records). [2025-10-06T17:11:38.703004] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-06T17:11:39.037838] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-06T17:11:39.095088] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-06T17:11:39.095208] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-06T17:11:39.095931] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-06T17:11:39.096002] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-06T17:11:39.097549] [DEBUG] [LOCAL ] ALSN: Trimmed 62170 records to 43330 (keeping 200 days of data) [2025-10-06T17:11:39.372539] [DEBUG] [LOCAL ] ALSN: Primary data saved (43330 records). [2025-10-06T17:11:39.373201] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-06T17:11:39.373430] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALSN took 41.5s. Estimated remaining: 4h 53m 41s. Rate: 7.8 symbols/min [2025-10-06T17:11:39.549697] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:11:39.585752] [DEBUG] [LOCAL ] AMBC: Loaded 37179 existing records from primary storage. [2025-10-06T17:11:39.586080] [INFO ] [MAIN ] AMBC: Loaded 37179 existing records. [2025-10-06T17:11:39.765502] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:11:39.765904] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-06T17:11:39.766023] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-06T17:11:39.766546] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-06T17:11:39.766607] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-06T17:11:39.832390] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-06T17:11:40.175000] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-06T17:11:40.180944] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:11:40.368714] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T17:11:40.469839] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-06T17:11:40.625618] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-06T17:11:41.425622] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-06T17:11:42.225509] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-06T17:11:42.316176] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T17:11:42.845609] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T17:11:43.025596] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-06T17:11:43.289689] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T17:11:43.825521] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-06T17:11:44.276493] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T17:11:44.625541] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-06T17:11:45.424567] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T17:11:45.433186] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-06T17:11:46.225517] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-06T17:11:46.289821] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-06T17:11:46.842070] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-06T17:11:47.014262] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-06T17:11:47.025458] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-06T17:11:47.825731] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-06T17:11:48.501455] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T17:11:48.625537] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-06T17:11:49.425533] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-06T17:11:49.511502] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T17:11:50.088350] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T17:11:50.194460] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T17:11:50.225480] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-06T17:11:50.970778] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-06T17:11:51.025606] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-06T17:11:51.752710] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T17:11:51.825516] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-06T17:11:52.613850] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T17:11:52.614906] [INFO ] [REMOTE ] ALX: Full fetch complete (7265 records). [2025-10-06T17:11:52.614975] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-06T17:11:52.635745] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-06T17:11:52.975945] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-06T17:11:52.976052] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-06T17:11:52.976280] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-06T17:11:52.976322] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-06T17:11:52.976783] [DEBUG] [LOCAL ] ALX: Trimmed 7265 records to 6403 (keeping 200 days of data) [2025-10-06T17:11:53.019250] [DEBUG] [LOCAL ] ALX: Primary data saved (6403 records). [2025-10-06T17:11:53.019435] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-06T17:11:53.019529] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 29.3s. Estimated remaining: 4h 56m 1s. Rate: 7.7 symbols/min [2025-10-06T17:11:53.189312] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:11:53.232012] [DEBUG] [LOCAL ] AMBP: Loaded 45523 existing records from primary storage. [2025-10-06T17:11:53.232382] [INFO ] [MAIN ] AMBP: Loaded 45523 existing records. [2025-10-06T17:11:53.431521] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-06T17:11:53.438985] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:11:53.440529] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-06T17:11:53.440638] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-06T17:11:53.441110] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-06T17:11:53.441173] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-06T17:11:53.844535] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:11:54.167062] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T17:11:54.225530] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-06T17:11:54.911048] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T17:11:55.025528] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-06T17:11:55.811255] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T17:11:55.825480] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-06T17:11:56.403672] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T17:11:56.625531] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-06T17:11:57.181144] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T17:11:57.183623] [INFO ] [REMOTE ] ALV: Full fetch complete (61757 records). [2025-10-06T17:11:57.183753] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-06T17:11:57.430751] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-06T17:11:57.637243] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-06T17:11:57.637380] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-06T17:11:57.638307] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-06T17:11:57.638379] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-06T17:11:57.640124] [DEBUG] [LOCAL ] ALV: Trimmed 61757 records to 42223 (keeping 200 days of data) [2025-10-06T17:11:57.922589] [DEBUG] [LOCAL ] ALV: Primary data saved (42223 records). [2025-10-06T17:11:57.922814] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-06T17:11:57.922937] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALV took 41.6s. Estimated remaining: 4h 54m 42s. Rate: 7.7 symbols/min [2025-10-06T17:11:58.111665] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:11:58.111943] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-06T17:11:58.112013] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-06T17:11:58.112172] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-06T17:11:58.112245] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-06T17:11:58.112308] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-06T17:11:58.112346] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-06T17:11:58.232420] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-06T17:11:58.505210] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:11:58.542092] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-06T17:11:58.828003] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T17:11:59.025558] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-06T17:11:59.223975] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:11:59.224365] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-06T17:11:59.224465] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:11:59.224514] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-06T17:11:59.224573] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:11:59.224671] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-06T17:11:59.224762] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-06T17:11:59.224800] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-06T17:11:59.224839] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-06T17:11:59.224887] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AMBQ took 1.3s. Estimated remaining: 4h 51m 56s. Rate: 7.8 symbols/min [2025-10-06T17:11:59.407027] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:11:59.461232] [DEBUG] [LOCAL ] AMC: Loaded 54540 existing records from primary storage. [2025-10-06T17:11:59.461714] [INFO ] [MAIN ] AMC: Loaded 54540 existing records. [2025-10-06T17:11:59.670444] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:11:59.690830] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-06T17:11:59.691685] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-06T17:11:59.692730] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-06T17:11:59.692616] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-06T17:11:59.692882] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-06T17:11:59.830625] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-06T17:12:00.062209] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:12:00.625554] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-06T17:12:01.425505] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-06T17:12:01.632783] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T17:12:02.225515] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-06T17:12:02.405858] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T17:12:03.025546] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-06T17:12:03.574940] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-06T17:12:03.788574] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-06T17:12:03.825481] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-06T17:12:04.625498] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-06T17:12:04.788512] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T17:12:05.425544] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-06T17:12:05.811699] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-06T17:12:06.141427] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T17:12:06.225562] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-06T17:12:07.025567] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-06T17:12:07.133112] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T17:12:07.616516] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T17:12:07.825530] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-06T17:12:08.618496] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T17:12:08.630098] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-06T17:12:09.425546] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-06T17:12:09.871019] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T17:12:09.874400] [INFO ] [REMOTE ] AMBC: Full fetch complete (51418 records). [2025-10-06T17:12:09.874502] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-06T17:12:10.226782] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-06T17:12:10.270858] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-06T17:12:10.271044] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-06T17:12:10.271628] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-06T17:12:10.271832] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-06T17:12:10.298995] [DEBUG] [LOCAL ] AMBC: Trimmed 51418 records to 36473 (keeping 200 days of data) [2025-10-06T17:12:10.300492] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-06T17:12:10.509059] [DEBUG] [LOCAL ] AMBC: Primary data saved (36473 records). [2025-10-06T17:12:10.509231] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-06T17:12:10.509319] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBC took 31.1s. Estimated remaining: 4h 53m 16s. Rate: 7.8 symbols/min [2025-10-06T17:12:10.675099] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:12:10.725509] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-10-06T17:12:10.725903] [INFO ] [MAIN ] AMCR: Loaded 54449 existing records. [2025-10-06T17:12:10.905840] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:12:10.906150] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-06T17:12:10.906207] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-06T17:12:10.906434] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-06T17:12:10.906492] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-06T17:12:11.080828] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-06T17:12:11.267019] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:12:11.300230] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-06T17:12:11.825553] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-06T17:12:12.021781] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-06T17:12:12.625595] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-06T17:12:13.425627] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-06T17:12:13.599263] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-06T17:12:13.641066] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T17:12:14.174717] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T17:12:14.225547] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-06T17:12:15.025574] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-06T17:12:15.548609] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-06T17:12:15.683490] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-06T17:12:15.825541] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-06T17:12:16.625613] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-06T17:12:17.277478] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T17:12:17.281055] [INFO ] [REMOTE ] AM: Full fetch complete (75603 records). [2025-10-06T17:12:17.281253] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-06T17:12:17.430681] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-06T17:12:17.781592] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-06T17:12:17.787080] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-06T17:12:17.788001] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-06T17:12:17.788449] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-06T17:12:17.792196] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-06T17:12:17.805128] [DEBUG] [LOCAL ] AM: Trimmed 75603 records to 52028 (keeping 200 days of data) [2025-10-06T17:12:18.096963] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T17:12:18.211459] [DEBUG] [LOCAL ] AM: Primary data saved (52028 records). [2025-10-06T17:12:18.211677] [INFO ] [MAIN ] AM: Full history saved. [2025-10-06T17:12:18.212783] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AM took 46.8s. Estimated remaining: 4h 53m 7s. Rate: 7.8 symbols/min [2025-10-06T17:12:18.235212] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-06T17:12:18.420189] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:12:18.479639] [DEBUG] [LOCAL ] AME: Loaded 49208 existing records from primary storage. [2025-10-06T17:12:18.480057] [INFO ] [MAIN ] AME: Loaded 49208 existing records. [2025-10-06T17:12:18.661940] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:12:18.662214] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-06T17:12:18.662265] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-06T17:12:18.662576] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-06T17:12:18.662634] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-06T17:12:19.027625] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:12:19.027865] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-06T17:12:19.152130] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T17:12:19.825554] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-06T17:12:20.550595] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T17:12:20.622376] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-06T17:12:20.633118] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-06T17:12:21.425518] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-06T17:12:21.464058] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T17:12:21.976914] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T17:12:22.225578] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-06T17:12:23.025544] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-06T17:12:23.598727] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T17:12:23.672881] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-06T17:12:23.825532] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-06T17:12:24.625552] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-06T17:12:24.909832] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T17:12:25.425621] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-06T17:12:26.231465] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-06T17:12:26.247224] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-06T17:12:26.347833] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T17:12:26.780057] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T17:12:26.782850] [INFO ] [REMOTE ] AMBP: Full fetch complete (65631 records). [2025-10-06T17:12:26.783001] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-06T17:12:27.035544] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-06T17:12:27.251344] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-06T17:12:27.251469] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-06T17:12:27.252254] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-06T17:12:27.252332] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-06T17:12:27.254028] [DEBUG] [LOCAL ] AMBP: Trimmed 65631 records to 44851 (keeping 200 days of data) [2025-10-06T17:12:27.517981] [DEBUG] [LOCAL ] AMBP: Primary data saved (44851 records). [2025-10-06T17:12:27.518194] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-06T17:12:27.518321] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBP took 34.5s. Estimated remaining: 4h 53m 37s. Rate: 7.7 symbols/min [2025-10-06T17:12:27.690403] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:12:27.713382] [DEBUG] [LOCAL ] AMG: Loaded 20722 existing records from primary storage. [2025-10-06T17:12:27.713744] [INFO ] [MAIN ] AMG: Loaded 20722 existing records. [2025-10-06T17:12:27.828030] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-06T17:12:27.910486] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:12:27.910846] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-06T17:12:27.910896] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-06T17:12:27.911230] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-06T17:12:27.911288] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-06T17:12:28.299342] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:12:28.350568] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-06T17:12:28.625537] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-06T17:12:29.421525] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-06T17:12:29.432085] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-06T17:12:29.470932] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T17:12:30.105799] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T17:12:30.225522] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-06T17:12:30.266714] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-06T17:12:31.025703] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-06T17:12:31.825546] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-06T17:12:31.962115] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T17:12:32.625720] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-06T17:12:32.902447] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T17:12:33.425600] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-06T17:12:34.226173] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-06T17:12:34.229113] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-06T17:12:34.483324] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T17:12:34.867940] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T17:12:34.959149] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T17:12:35.025542] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-06T17:12:35.825572] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-06T17:12:36.135070] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T17:12:36.625566] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-06T17:12:37.425495] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-06T17:12:37.832276] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-06T17:12:37.892739] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-06T17:12:37.896359] [INFO ] [REMOTE ] AMC: Full fetch complete (77924 records). [2025-10-06T17:12:37.896538] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-06T17:12:38.230680] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-06T17:12:38.285681] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-06T17:12:38.285776] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-06T17:12:38.286545] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-06T17:12:38.286588] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-06T17:12:38.288260] [DEBUG] [LOCAL ] AMC: Trimmed 77924 records to 53761 (keeping 200 days of data) [2025-10-06T17:12:38.585707] [DEBUG] [LOCAL ] AMC: Primary data saved (53761 records). [2025-10-06T17:12:38.585856] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-06T17:12:38.585937] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMC took 39.4s. Estimated remaining: 4h 54m 47s. Rate: 7.7 symbols/min [2025-10-06T17:12:38.759778] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:12:38.811540] [DEBUG] [LOCAL ] AMH: Loaded 52479 existing records from primary storage. [2025-10-06T17:12:38.811957] [INFO ] [MAIN ] AMH: Loaded 52479 existing records. [2025-10-06T17:12:38.989063] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:12:38.989413] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-06T17:12:38.989665] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-06T17:12:38.990224] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-06T17:12:38.990282] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-06T17:12:39.032630] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-06T17:12:39.317136] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T17:12:39.408976] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:12:39.422946] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-06T17:12:39.825545] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-06T17:12:40.625539] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-06T17:12:40.697372] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T17:12:41.425535] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-06T17:12:41.688958] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T17:12:42.142899] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T17:12:42.225546] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-06T17:12:43.025598] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-06T17:12:43.381416] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T17:12:43.825560] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-06T17:12:44.147420] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-06T17:12:44.283872] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T17:12:44.625634] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-06T17:12:45.425706] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-06T17:12:45.952212] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-06T17:12:45.956798] [INFO ] [REMOTE ] AMCR: Full fetch complete (77679 records). [2025-10-06T17:12:45.957029] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-06T17:12:46.205337] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T17:12:46.244994] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-06T17:12:46.405612] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-06T17:12:46.405766] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-06T17:12:46.406816] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-06T17:12:46.406895] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-06T17:12:46.409018] [DEBUG] [LOCAL ] AMCR: Trimmed 77679 records to 53669 (keeping 200 days of data) [2025-10-06T17:12:46.737864] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-10-06T17:12:46.738314] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-06T17:12:46.738488] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMCR took 36.2s. Estimated remaining: 4h 54m 48s. Rate: 7.7 symbols/min [2025-10-06T17:12:46.926132] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:12:46.967034] [DEBUG] [LOCAL ] AMN: Loaded 42418 existing records from primary storage. [2025-10-06T17:12:46.967415] [INFO ] [MAIN ] AMN: Loaded 42418 existing records. [2025-10-06T17:12:47.027362] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-06T17:12:47.175589] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:12:47.192543] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-06T17:12:47.192701] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-06T17:12:47.193165] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-06T17:12:47.193576] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-06T17:12:47.200233] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T17:12:47.585182] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:12:47.825535] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-06T17:12:48.005343] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T17:12:48.222794] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-06T17:12:48.625560] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-06T17:12:49.416388] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T17:12:49.425523] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-06T17:12:49.670575] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T17:12:50.225554] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-06T17:12:50.959376] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T17:12:51.025563] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-06T17:12:51.606800] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T17:12:51.825535] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-06T17:12:52.625540] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-06T17:12:52.869163] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T17:12:53.425608] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-06T17:12:53.642696] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-06T17:12:54.225583] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-06T17:12:54.438379] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T17:12:54.655898] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-06T17:12:55.025597] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-06T17:12:55.825587] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-06T17:12:56.286675] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-06T17:12:56.289766] [INFO ] [REMOTE ] AME: Full fetch complete (69877 records). [2025-10-06T17:12:56.289917] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-06T17:12:56.634526] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-06T17:12:56.694692] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-06T17:12:56.694849] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-06T17:12:56.695742] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-06T17:12:56.695895] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-06T17:12:56.722417] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T17:12:56.722879] [DEBUG] [LOCAL ] AME: Trimmed 69877 records to 48595 (keeping 200 days of data) [2025-10-06T17:12:57.046741] [DEBUG] [LOCAL ] AME: Primary data saved (48595 records). [2025-10-06T17:12:57.046936] [INFO ] [MAIN ] AME: Full history saved. [2025-10-06T17:12:57.047857] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AME took 38.8s. Estimated remaining: 4h 55m 38s. Rate: 7.7 symbols/min [2025-10-06T17:12:57.243947] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:12:57.290624] [DEBUG] [LOCAL ] AMP: Loaded 32637 existing records from primary storage. [2025-10-06T17:12:57.291007] [INFO ] [MAIN ] AMP: Loaded 32637 existing records. [2025-10-06T17:12:57.429878] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-06T17:12:57.496171] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:12:57.496559] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-06T17:12:57.496632] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-06T17:12:57.496989] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-06T17:12:57.497138] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-06T17:12:57.668435] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T17:12:57.708374] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T17:12:57.752632] [INFO ] [REMOTE ] AMG: Full fetch complete (29898 records). [2025-10-06T17:12:57.763304] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-06T17:12:58.202029] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:12:58.230667] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-06T17:12:58.414183] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-06T17:12:58.414291] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-06T17:12:58.415066] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-06T17:12:58.415132] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-06T17:12:58.416021] [DEBUG] [LOCAL ] AMG: Trimmed 29898 records to 20292 (keeping 200 days of data) [2025-10-06T17:12:58.568139] [DEBUG] [LOCAL ] AMG: Primary data saved (20292 records). [2025-10-06T17:12:58.568321] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-06T17:12:58.568421] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMG took 31.0s. Estimated remaining: 4h 53m 8s. Rate: 7.7 symbols/min [2025-10-06T17:12:58.786365] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:12:58.843021] [DEBUG] [LOCAL ] AMPX: Loaded 53077 existing records from primary storage. [2025-10-06T17:12:58.843437] [INFO ] [MAIN ] AMPX: Loaded 53077 existing records. [2025-10-06T17:12:59.050769] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-06T17:12:59.050583] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:12:59.051847] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-06T17:12:59.053329] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-06T17:12:59.053970] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-06T17:12:59.054111] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-06T17:12:59.183302] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T17:12:59.529276] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:12:59.659890] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T17:12:59.825565] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-06T17:13:00.393089] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T17:13:00.625561] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-06T17:13:01.425600] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-06T17:13:02.225613] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-06T17:13:02.436360] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-06T17:13:02.658815] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-06T17:13:03.025549] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-06T17:13:03.169435] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T17:13:03.825558] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-06T17:13:04.000191] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T17:13:04.095897] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-06T17:13:04.625542] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-06T17:13:05.425541] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-06T17:13:05.738996] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-06T17:13:05.799789] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T17:13:06.225533] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-06T17:13:07.025553] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-06T17:13:07.135136] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T17:13:07.825504] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-06T17:13:08.048434] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-06T17:13:08.625529] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-06T17:13:09.015089] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T17:13:09.425544] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-06T17:13:10.225562] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-06T17:13:10.300489] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-06T17:13:10.526476] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T17:13:11.025544] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-06T17:13:11.139933] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T17:13:11.772823] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T17:13:11.825529] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-06T17:13:12.625566] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-06T17:13:12.915585] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T17:13:13.425545] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-06T17:13:14.178908] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T17:13:14.224961] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-06T17:13:14.231046] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-06T17:13:15.025500] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-06T17:13:15.080779] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T17:13:15.825506] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-06T17:13:15.997158] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T17:13:16.625575] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-06T17:13:16.831630] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T17:13:17.195567] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T17:13:17.425617] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-06T17:13:18.021924] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T17:13:18.024997] [INFO ] [REMOTE ] AMN: Full fetch complete (60446 records). [2025-10-06T17:13:18.025134] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-06T17:13:18.227731] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-06T17:13:18.466324] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-06T17:13:18.466427] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-06T17:13:18.467210] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-06T17:13:18.467278] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-06T17:13:18.469341] [DEBUG] [LOCAL ] AMN: Trimmed 60446 records to 41794 (keeping 200 days of data) [2025-10-06T17:13:18.731725] [DEBUG] [LOCAL ] AMN: Primary data saved (41794 records). [2025-10-06T17:13:18.731889] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-06T17:13:18.732006] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMN took 32.0s. Estimated remaining: 4h 57m 39s. Rate: 7.6 symbols/min [2025-10-06T17:13:18.921204] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:13:18.964339] [DEBUG] [LOCAL ] AMPY: Loaded 38558 existing records from primary storage. [2025-10-06T17:13:18.964734] [INFO ] [MAIN ] AMPY: Loaded 38558 existing records. [2025-10-06T17:13:19.034704] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-06T17:13:19.147268] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-06T17:13:19.176933] [INFO ] [REMOTE ] AMH: Full fetch complete (74820 records). [2025-10-06T17:13:19.176722] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:13:19.177299] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-06T17:13:19.177510] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-06T17:13:19.177622] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-06T17:13:19.178340] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-06T17:13:19.178424] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-06T17:13:20.032067] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:13:20.032447] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-06T17:13:20.032900] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-06T17:13:20.033029] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-06T17:13:20.035187] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-06T17:13:20.035616] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-06T17:13:20.037974] [DEBUG] [LOCAL ] AMH: Trimmed 74820 records to 51739 (keeping 200 days of data) [2025-10-06T17:13:20.394622] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-06T17:13:20.422251] [DEBUG] [LOCAL ] AMH: Primary data saved (51739 records). [2025-10-06T17:13:20.422485] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-06T17:13:20.422674] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMH took 41.8s. Estimated remaining: 4h 55m 14s. Rate: 7.7 symbols/min [2025-10-06T17:13:20.619533] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:13:20.625503] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-06T17:13:20.657467] [DEBUG] [LOCAL ] AMR: Loaded 29401 existing records from primary storage. [2025-10-06T17:13:20.657838] [INFO ] [MAIN ] AMR: Loaded 29401 existing records. [2025-10-06T17:13:20.861475] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:13:20.861785] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-06T17:13:20.861854] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-06T17:13:20.862273] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-06T17:13:20.862340] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-06T17:13:21.190730] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-06T17:13:21.324615] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:13:21.326948] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T17:13:21.425515] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-06T17:13:22.225551] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-06T17:13:22.490866] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T17:13:22.965696] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-06T17:13:23.025531] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-06T17:13:23.618622] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T17:13:23.825550] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-06T17:13:24.099573] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T17:13:24.625693] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-06T17:13:25.235769] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T17:13:25.425602] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-06T17:13:25.875870] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-06T17:13:26.225636] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-06T17:13:27.025627] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-06T17:13:27.285068] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T17:13:27.280254] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T17:13:27.825555] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-06T17:13:28.622197] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T17:13:28.631175] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-06T17:13:28.957784] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T17:13:29.425557] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-06T17:13:30.143047] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T17:13:30.146392] [INFO ] [REMOTE ] AMP: Full fetch complete (47602 records). [2025-10-06T17:13:30.146540] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-06T17:13:30.230788] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-06T17:13:30.560170] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-06T17:13:30.560290] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-06T17:13:30.561023] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-06T17:13:30.561092] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-06T17:13:30.562480] [DEBUG] [LOCAL ] AMP: Trimmed 47602 records to 32047 (keeping 200 days of data) [2025-10-06T17:13:30.779610] [DEBUG] [LOCAL ] AMP: Primary data saved (32047 records). [2025-10-06T17:13:30.779802] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-06T17:13:30.780682] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMP took 33.7s. Estimated remaining: 4h 56m 2s. Rate: 7.7 symbols/min [2025-10-06T17:13:30.968611] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:13:31.013886] [DEBUG] [LOCAL ] AMRC: Loaded 38763 existing records from primary storage. [2025-10-06T17:13:31.014249] [INFO ] [MAIN ] AMRC: Loaded 38763 existing records. [2025-10-06T17:13:31.052248] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-06T17:13:31.217667] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:13:31.218070] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-06T17:13:31.218130] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-06T17:13:31.218418] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-06T17:13:31.218508] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-06T17:13:31.687865] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:13:31.690268] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T17:13:31.730078] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-06T17:13:31.825509] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-06T17:13:32.614856] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-06T17:13:32.625471] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-06T17:13:33.425596] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-06T17:13:33.925178] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-06T17:13:33.929466] [INFO ] [REMOTE ] AMPX: Full fetch complete (74825 records). [2025-10-06T17:13:33.929718] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-06T17:13:34.089200] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-06T17:13:34.225696] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-06T17:13:34.430394] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-06T17:13:34.430585] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-06T17:13:34.431841] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-06T17:13:34.431926] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-06T17:13:34.434412] [DEBUG] [LOCAL ] AMPX: Trimmed 74825 records to 52317 (keeping 200 days of data) [2025-10-06T17:13:34.680090] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T17:13:34.797687] [DEBUG] [LOCAL ] AMPX: Primary data saved (52317 records). [2025-10-06T17:13:34.797860] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-06T17:13:34.797979] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPX took 36.2s. Estimated remaining: 4h 54m 31s. Rate: 7.7 symbols/min [2025-10-06T17:13:34.983113] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:13:34.983353] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-06T17:13:34.983410] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-06T17:13:34.983537] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-06T17:13:34.983581] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-06T17:13:34.983624] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-06T17:13:34.983692] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-06T17:13:35.030744] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-06T17:13:35.372896] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:13:35.403525] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T17:13:35.825530] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-06T17:13:36.023902] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:13:36.024257] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-06T17:13:36.024351] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:13:36.024431] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-06T17:13:36.024505] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:13:36.024581] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-06T17:13:36.024673] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-06T17:13:36.024733] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-06T17:13:36.024812] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-06T17:13:36.024893] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMRZ took 1.2s. Estimated remaining: 4h 52m 2s. Rate: 7.8 symbols/min [2025-10-06T17:13:36.223461] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:13:36.281294] [DEBUG] [LOCAL ] AMT: Loaded 53193 existing records from primary storage. [2025-10-06T17:13:36.281741] [INFO ] [MAIN ] AMT: Loaded 53193 existing records. [2025-10-06T17:13:36.478603] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:13:36.479050] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-06T17:13:36.479149] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-06T17:13:36.479582] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-06T17:13:36.479691] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-06T17:13:36.628073] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-06T17:13:36.653614] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T17:13:36.905736] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:13:37.425587] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-06T17:13:37.976148] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T17:13:38.225508] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-06T17:13:38.537846] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T17:13:39.025620] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-06T17:13:39.834935] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-06T17:13:39.857695] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T17:13:40.136924] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T17:13:40.625545] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-06T17:13:41.313714] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T17:13:41.425537] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-06T17:13:42.225519] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-06T17:13:42.289836] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T17:13:42.713331] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T17:13:43.025510] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-06T17:13:43.115121] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T17:13:43.825516] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-06T17:13:44.625500] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-06T17:13:44.664934] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T17:13:45.256743] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-06T17:13:45.425566] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-06T17:13:46.225532] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-06T17:13:46.274969] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T17:13:46.936957] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T17:13:46.940464] [INFO ] [REMOTE ] AMPY: Full fetch complete (51836 records). [2025-10-06T17:13:46.940605] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-06T17:13:47.030679] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-06T17:13:47.380945] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-06T17:13:47.381779] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-06T17:13:47.382633] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-06T17:13:47.383627] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T17:13:47.383750] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-06T17:13:47.391989] [DEBUG] [LOCAL ] AMPY: Trimmed 51836 records to 38281 (keeping 200 days of data) [2025-10-06T17:13:47.628231] [DEBUG] [LOCAL ] AMPY: Primary data saved (38281 records). [2025-10-06T17:13:47.628426] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-06T17:13:47.628545] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMPY took 28.9s. Estimated remaining: 4h 53m 17s. Rate: 7.7 symbols/min [2025-10-06T17:13:47.830958] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-06T17:13:47.834492] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:13:47.859732] [DEBUG] [LOCAL ] AMTB: Loaded 20620 existing records from primary storage. [2025-10-06T17:13:47.860084] [INFO ] [MAIN ] AMTB: Loaded 20620 existing records. [2025-10-06T17:13:48.060518] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:13:48.060847] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-06T17:13:48.060904] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-06T17:13:48.061256] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-06T17:13:48.061319] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-06T17:13:48.445047] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:13:48.529355] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T17:13:48.625495] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-06T17:13:49.265504] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T17:13:49.425563] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-06T17:13:50.225537] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-06T17:13:50.443890] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T17:13:50.487718] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T17:13:51.025590] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-06T17:13:51.481530] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T17:13:51.825554] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-06T17:13:52.625556] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-06T17:13:52.805810] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T17:13:52.840050] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T17:13:53.425543] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-06T17:13:54.109199] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T17:13:54.225584] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-06T17:13:55.025585] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-06T17:13:55.267775] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T17:13:55.305347] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T17:13:55.825549] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-06T17:13:56.583789] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T17:13:56.625491] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-06T17:13:56.807963] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T17:13:57.425546] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-06T17:13:58.170590] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T17:13:58.225518] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-06T17:13:58.583971] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T17:13:59.025611] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-06T17:13:59.736624] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T17:13:59.825550] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-06T17:13:59.884690] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T17:14:00.625609] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-06T17:14:01.360211] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T17:14:01.363067] [INFO ] [REMOTE ] AMRC: Full fetch complete (53332 records). [2025-10-06T17:14:01.363207] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-06T17:14:01.431120] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-06T17:14:01.835290] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-06T17:14:01.835402] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-06T17:14:01.836214] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-06T17:14:01.836298] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-06T17:14:01.838113] [DEBUG] [LOCAL ] AMRC: Trimmed 53332 records to 38127 (keeping 200 days of data) [2025-10-06T17:14:02.084285] [DEBUG] [LOCAL ] AMRC: Primary data saved (38127 records). [2025-10-06T17:14:02.084515] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-06T17:14:02.085492] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMRC took 31.3s. Estimated remaining: 4h 55m 30s. Rate: 7.7 symbols/min [2025-10-06T17:14:02.228816] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-06T17:14:02.278186] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:14:02.286381] [DEBUG] [LOCAL ] AMTD: Loaded 3698 existing records from primary storage. [2025-10-06T17:14:02.286667] [INFO ] [MAIN ] AMTD: Loaded 3698 existing records. [2025-10-06T17:14:02.483432] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:14:02.483727] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-06T17:14:02.484004] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-06T17:14:02.484272] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-06T17:14:02.484364] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-06T17:14:02.671898] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-06T17:14:02.879376] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T17:14:02.952808] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:14:03.025541] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-06T17:14:03.467739] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-06T17:14:03.825526] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-06T17:14:04.625559] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-06T17:14:04.834825] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-06T17:14:04.962368] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T17:14:04.964568] [INFO ] [REMOTE ] AMR: Full fetch complete (40285 records). [2025-10-06T17:14:04.964789] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-06T17:14:05.286154] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-06T17:14:05.384711] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-06T17:14:05.384808] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-06T17:14:05.385408] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-06T17:14:05.385474] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-06T17:14:05.386587] [DEBUG] [LOCAL ] AMR: Trimmed 40285 records to 29056 (keeping 200 days of data) [2025-10-06T17:14:05.437414] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-06T17:14:05.574573] [DEBUG] [LOCAL ] AMR: Primary data saved (29056 records). [2025-10-06T17:14:05.574807] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-06T17:14:05.574956] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMR took 45.2s. Estimated remaining: 4h 53m 52s. Rate: 7.7 symbols/min [2025-10-06T17:14:05.754030] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:14:05.805618] [DEBUG] [LOCAL ] AMTM: Loaded 51421 existing records from primary storage. [2025-10-06T17:14:05.806031] [INFO ] [MAIN ] AMTM: Loaded 51421 existing records. [2025-10-06T17:14:05.996493] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:14:05.996822] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-06T17:14:05.996872] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-06T17:14:05.997191] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-06T17:14:05.997250] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-06T17:14:06.230737] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-06T17:14:06.381075] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:14:06.487709] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T17:14:06.789794] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T17:14:07.025538] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-06T17:14:07.825505] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-06T17:14:08.129723] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T17:14:08.625533] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-06T17:14:09.425544] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-06T17:14:09.732522] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-06T17:14:09.777475] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-06T17:14:10.225544] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-06T17:14:11.030680] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-06T17:14:11.052507] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T17:14:11.607837] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T17:14:11.611940] [INFO ] [REMOTE ] AMT: Full fetch complete (76022 records). [2025-10-06T17:14:11.612161] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-06T17:14:11.692012] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-06T17:14:11.829944] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-06T17:14:12.058872] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-06T17:14:12.058975] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-06T17:14:12.059820] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-06T17:14:12.059892] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-06T17:14:12.061752] [DEBUG] [LOCAL ] AMT: Trimmed 76022 records to 52434 (keeping 200 days of data) [2025-10-06T17:14:12.422220] [DEBUG] [LOCAL ] AMT: Primary data saved (52434 records). [2025-10-06T17:14:12.422392] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-06T17:14:12.422504] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMT took 36.4s. Estimated remaining: 4h 53m 24s. Rate: 7.7 symbols/min [2025-10-06T17:14:12.625747] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-06T17:14:12.627999] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:14:12.642439] [DEBUG] [LOCAL ] AMWL: Loaded 9067 existing records from primary storage. [2025-10-06T17:14:12.642801] [INFO ] [MAIN ] AMWL: Loaded 9067 existing records. [2025-10-06T17:14:12.839153] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:14:12.839442] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-06T17:14:12.839496] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-06T17:14:12.839704] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-06T17:14:12.839762] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-06T17:14:13.003038] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T17:14:13.159086] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-06T17:14:13.267055] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:14:13.425545] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-06T17:14:14.225618] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-06T17:14:15.025678] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-06T17:14:15.293708] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T17:14:15.610504] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-06T17:14:15.825535] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-06T17:14:15.918892] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-06T17:14:15.920817] [INFO ] [REMOTE ] AMTB: Full fetch complete (29888 records). [2025-10-06T17:14:15.920929] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-06T17:14:16.318968] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-06T17:14:16.319058] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-06T17:14:16.319849] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-06T17:14:16.319918] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-06T17:14:16.320992] [DEBUG] [LOCAL ] AMTB: Trimmed 29888 records to 20474 (keeping 200 days of data) [2025-10-06T17:14:16.454185] [DEBUG] [LOCAL ] AMTB: Primary data saved (20474 records). [2025-10-06T17:14:16.454361] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-06T17:14:16.454518] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTB took 28.8s. Estimated remaining: 4h 51m 59s. Rate: 7.7 symbols/min [2025-10-06T17:14:16.635948] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-06T17:14:16.642146] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:14:16.695964] [DEBUG] [LOCAL ] AMX: Loaded 49863 existing records from primary storage. [2025-10-06T17:14:16.696379] [INFO ] [MAIN ] AMX: Loaded 49863 existing records. [2025-10-06T17:14:16.873207] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:14:16.873468] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-06T17:14:16.873517] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-06T17:14:16.873962] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-06T17:14:16.874022] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-06T17:14:17.122754] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-06T17:14:17.241634] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:14:17.425522] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-06T17:14:17.590206] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-06T17:14:18.193931] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T17:14:18.225637] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-06T17:14:19.025699] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-06T17:14:19.348580] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-06T17:14:19.825561] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-06T17:14:19.891010] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T17:14:20.464194] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-06T17:14:20.625569] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-06T17:14:21.122192] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-06T17:14:21.425618] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-06T17:14:22.225592] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-06T17:14:22.241406] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-06T17:14:22.829963] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T17:14:23.025580] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-06T17:14:23.825550] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-06T17:14:24.414246] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T17:14:24.494143] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T17:14:24.625594] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-06T17:14:25.425511] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-06T17:14:25.503443] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-06T17:14:26.225548] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-06T17:14:26.990946] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-06T17:14:26.993290] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T17:14:27.025494] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-06T17:14:27.825542] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-06T17:14:28.638215] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-06T17:14:28.655742] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T17:14:28.652170] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T17:14:29.283540] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T17:14:29.284535] [INFO ] [REMOTE ] AMTD: Full fetch complete (5576 records). [2025-10-06T17:14:29.284608] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-06T17:14:29.439342] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-06T17:14:29.683774] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-06T17:14:29.683875] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-06T17:14:29.684108] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-06T17:14:29.684151] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-06T17:14:29.684814] [DEBUG] [LOCAL ] AMTD: Trimmed 5576 records to 3680 (keeping 200 days of data) [2025-10-06T17:14:29.706970] [DEBUG] [LOCAL ] AMTD: Primary data saved (3680 records). [2025-10-06T17:14:29.707160] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-06T17:14:29.707272] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMTD took 27.6s. Estimated remaining: 4h 53m 44s. Rate: 7.7 symbols/min [2025-10-06T17:14:29.898249] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:14:29.943316] [DEBUG] [LOCAL ] AN: Loaded 32323 existing records from primary storage. [2025-10-06T17:14:29.943699] [INFO ] [MAIN ] AN: Loaded 32323 existing records. [2025-10-06T17:14:30.136419] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:14:30.136857] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-06T17:14:30.136919] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-06T17:14:30.138089] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-06T17:14:30.138154] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-06T17:14:30.235805] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T17:14:30.229184] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-06T17:14:30.549178] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:14:31.025606] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-06T17:14:31.825519] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-06T17:14:32.162437] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-06T17:14:32.592198] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T17:14:32.625582] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-06T17:14:33.402937] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T17:14:33.425546] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-06T17:14:33.834887] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T17:14:34.225577] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-06T17:14:34.884498] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-06T17:14:35.025600] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-06T17:14:35.109056] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T17:14:35.825538] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-06T17:14:36.147803] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T17:14:36.625552] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-06T17:14:37.141030] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T17:14:37.425603] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-06T17:14:37.620449] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T17:14:38.225591] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-06T17:14:38.548899] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-06T17:14:39.025547] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-06T17:14:39.584342] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T17:14:39.825568] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-06T17:14:40.550612] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T17:14:40.625504] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-06T17:14:40.710071] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T17:14:41.425555] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-06T17:14:42.225574] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-06T17:14:42.442513] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T17:14:43.025491] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-06T17:14:43.073916] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-06T17:14:43.079912] [INFO ] [REMOTE ] AMWL: Full fetch complete (14235 records). [2025-10-06T17:14:43.080193] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-06T17:14:43.085062] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T17:14:43.479262] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-06T17:14:43.479365] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-06T17:14:43.479944] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-06T17:14:43.480023] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-06T17:14:43.481201] [DEBUG] [LOCAL ] AMWL: Trimmed 14235 records to 9077 (keeping 200 days of data) [2025-10-06T17:14:43.536407] [DEBUG] [LOCAL ] AMWL: Primary data saved (9077 records). [2025-10-06T17:14:43.536672] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-06T17:14:43.536809] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMWL took 31.1s. Estimated remaining: 4h 55m 38s. Rate: 7.6 symbols/min [2025-10-06T17:14:43.727662] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:14:43.795299] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-10-06T17:14:43.795841] [INFO ] [MAIN ] ANET: Loaded 54546 existing records. [2025-10-06T17:14:43.831425] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-06T17:14:43.989903] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:14:43.990152] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-06T17:14:43.990201] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-06T17:14:43.990942] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-06T17:14:43.991001] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-06T17:14:44.411141] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:14:44.625535] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-06T17:14:44.715236] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T17:14:45.425502] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-06T17:14:45.425442] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T17:14:46.225581] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-06T17:14:46.385702] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T17:14:47.025543] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-06T17:14:47.317576] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T17:14:47.516291] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-06T17:14:47.825572] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-06T17:14:48.625580] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-06T17:14:49.358027] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-06T17:14:49.399556] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T17:14:49.425497] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-06T17:14:50.199242] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T17:14:50.225488] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-06T17:14:51.025606] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-06T17:14:51.512863] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T17:14:51.515554] [INFO ] [REMOTE ] AMX: Full fetch complete (70398 records). [2025-10-06T17:14:51.515775] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-06T17:14:51.516552] [FATAL] [VALIDATOR ] AMX: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:14:51.516728] [FATAL] [MAIN ] AMX: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:14:51.516771] [WARN ] [MAIN ] AMX: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:14:51.516812] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-06T17:14:51.516879] [DEBUG] [LOCAL ] AMX: No primary data file found to delete. [2025-10-06T17:14:51.516914] [INFO ] [LOCAL ] AMX: Starting deletion of derivative data. [2025-10-06T17:14:51.517265] [DEBUG] [LOCAL ] AMX: Deleted derivative data file. [2025-10-06T17:14:51.517367] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMX took 35.1s. Estimated remaining: 4h 55m 32s. Rate: 7.6 symbols/min [2025-10-06T17:14:51.690816] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:14:51.747303] [DEBUG] [LOCAL ] ANF: Loaded 52869 existing records from primary storage. [2025-10-06T17:14:51.747780] [INFO ] [MAIN ] ANF: Loaded 52869 existing records. [2025-10-06T17:14:51.831126] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-06T17:14:51.956220] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:14:51.956628] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-06T17:14:51.956767] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-06T17:14:51.957473] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-06T17:14:51.957542] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-06T17:14:52.175329] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-06T17:14:52.392698] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:14:52.625536] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-06T17:14:52.728960] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-06T17:14:52.732545] [INFO ] [REMOTE ] AMTM: Full fetch complete (73959 records). [2025-10-06T17:14:52.732863] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-06T17:14:53.189439] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-06T17:14:53.190080] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-06T17:14:53.191082] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-06T17:14:53.193322] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-06T17:14:53.193166] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T17:14:53.202225] [DEBUG] [LOCAL ] AMTM: Trimmed 73959 records to 50676 (keeping 200 days of data) [2025-10-06T17:14:53.425862] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-06T17:14:53.522303] [DEBUG] [LOCAL ] AMTM: Primary data saved (50676 records). [2025-10-06T17:14:53.522497] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-06T17:14:53.522599] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMTM took 47.9s. Estimated remaining: 4h 53m 29s. Rate: 7.7 symbols/min [2025-10-06T17:14:53.724067] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:14:53.724358] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-06T17:14:53.724459] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-06T17:14:53.724625] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-06T17:14:53.724723] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-06T17:14:53.724785] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-06T17:14:53.724890] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-06T17:14:54.147550] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:14:54.225685] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-06T17:14:54.880351] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T17:14:55.030248] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-06T17:14:55.044046] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-06T17:14:55.249818] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:14:55.250159] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-06T17:14:55.250321] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:14:55.250371] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-06T17:14:55.250431] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:14:55.250503] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-06T17:14:55.250584] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-06T17:14:55.250638] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-06T17:14:55.250733] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-06T17:14:55.250786] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. ANGX took 1.7s. Estimated remaining: 4h 51m 22s. Rate: 7.7 symbols/min [2025-10-06T17:14:55.432477] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:14:55.432727] [DEBUG] [LOCAL ] ANRO: No existing data file found in primary storage. [2025-10-06T17:14:55.432777] [WARN ] [MAIN ] ANRO: No existing data found, performing full refresh instead. [2025-10-06T17:14:55.432898] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-06T17:14:55.432939] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-06T17:14:55.432980] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-06T17:14:55.433044] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-06T17:14:55.809967] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:14:55.825541] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-06T17:14:56.055846] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T17:14:56.625557] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-06T17:14:57.125236] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T17:14:57.425545] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-06T17:14:58.225555] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-06T17:14:58.791590] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-06T17:14:59.025546] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-06T17:14:59.319568] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T17:14:59.534287] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-06T17:14:59.825525] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-06T17:15:00.625536] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-06T17:15:01.279002] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T17:15:01.425526] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-06T17:15:01.678204] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-06T17:15:02.225535] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-06T17:15:02.482908] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-06T17:15:02.654809] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T17:15:02.657151] [INFO ] [REMOTE ] AN: Full fetch complete (47492 records). [2025-10-06T17:15:02.657251] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-06T17:15:03.029273] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-06T17:15:03.064433] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-06T17:15:03.064556] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-06T17:15:03.065407] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-06T17:15:03.065592] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-06T17:15:03.066992] [DEBUG] [LOCAL ] AN: Trimmed 47492 records to 31749 (keeping 200 days of data) [2025-10-06T17:15:03.271491] [DEBUG] [LOCAL ] AN: Primary data saved (31749 records). [2025-10-06T17:15:03.271760] [INFO ] [MAIN ] AN: Full history saved. [2025-10-06T17:15:03.271867] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. AN took 33.6s. Estimated remaining: 4h 51m 19s. Rate: 7.7 symbols/min [2025-10-06T17:15:03.452532] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:15:03.477107] [DEBUG] [LOCAL ] ANVS: Loaded 23555 existing records from primary storage. [2025-10-06T17:15:03.477424] [INFO ] [MAIN ] ANVS: Loaded 23555 existing records. [2025-10-06T17:15:03.661006] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:15:03.661258] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-06T17:15:03.661303] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-06T17:15:03.661787] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-06T17:15:03.661848] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-06T17:15:03.825638] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-06T17:15:04.054392] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:15:04.625508] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-06T17:15:04.661638] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-06T17:15:04.948465] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T17:15:05.112357] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-06T17:15:05.425556] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-06T17:15:06.174950] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T17:15:06.225562] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-06T17:15:06.909047] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T17:15:07.025588] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-06T17:15:07.825527] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-06T17:15:08.429491] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-06T17:15:08.449463] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T17:15:08.625587] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-06T17:15:09.425564] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-06T17:15:09.854035] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-06T17:15:09.913108] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-06T17:15:10.225602] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-06T17:15:10.751368] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T17:15:11.025695] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-06T17:15:11.825562] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-06T17:15:12.471131] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T17:15:12.592542] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-06T17:15:12.625483] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-06T17:15:12.995191] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T17:15:13.425603] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-06T17:15:14.225572] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-06T17:15:14.653603] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T17:15:14.786941] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-06T17:15:15.025543] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-06T17:15:15.825576] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-06T17:15:16.004822] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-06T17:15:16.625595] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-06T17:15:16.971948] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T17:15:17.138465] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-06T17:15:17.425564] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-06T17:15:18.225512] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-06T17:15:18.532723] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-06T17:15:19.025602] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-06T17:15:19.526763] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-06T17:15:19.536362] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-06T17:15:19.545804] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-06T17:15:19.547611] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T17:15:19.834977] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-06T17:15:19.985367] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-06T17:15:19.985480] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-06T17:15:19.986357] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-06T17:15:19.986425] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-06T17:15:19.988542] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 53766 (keeping 200 days of data) [2025-10-06T17:15:20.338175] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-06T17:15:20.338559] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-06T17:15:20.338711] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANET took 36.8s. Estimated remaining: 4h 54m 11s. Rate: 7.7 symbols/min [2025-10-06T17:15:20.625537] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-06T17:15:20.804425] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T17:15:20.937595] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T17:15:21.425600] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-06T17:15:21.830933] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T17:15:22.225565] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-06T17:15:23.025588] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-06T17:15:23.176440] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T17:15:23.220446] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T17:15:23.811104] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T17:15:23.825482] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-06T17:15:24.598372] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-06T17:15:24.625478] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-06T17:15:25.425543] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-06T17:15:25.559682] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T17:15:25.561912] [INFO ] [REMOTE ] ANRO: Full fetch complete (29535 records). [2025-10-06T17:15:25.562020] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-06T17:15:25.979119] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-06T17:15:25.979245] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-06T17:15:25.979721] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-06T17:15:25.979810] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-06T17:15:25.981214] [DEBUG] [LOCAL ] ANRO: Trimmed 29535 records to 19075 (keeping 200 days of data) [2025-10-06T17:15:26.086714] [DEBUG] [LOCAL ] ANRO: Primary data saved (19075 records). [2025-10-06T17:15:26.086900] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-06T17:15:26.086984] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANRO took 30.8s. Estimated remaining: 4h 53m 23s. Rate: 7.7 symbols/min [2025-10-06T17:15:26.225747] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-06T17:15:26.795295] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T17:15:27.025621] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-06T17:15:28.283129] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T17:15:28.289914] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-06T17:15:28.346135] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-06T17:15:28.349191] [INFO ] [REMOTE ] ANF: Full fetch complete (75608 records). [2025-10-06T17:15:28.349313] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-06T17:15:28.733460] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-06T17:15:28.733561] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-06T17:15:28.734329] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-06T17:15:28.734394] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-06T17:15:28.736057] [DEBUG] [LOCAL ] ANF: Trimmed 75608 records to 52099 (keeping 200 days of data) [2025-10-06T17:15:29.072896] [DEBUG] [LOCAL ] ANF: Primary data saved (52099 records). [2025-10-06T17:15:29.073091] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-06T17:15:29.073183] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANF took 37.6s. Estimated remaining: 4h 51m 44s. Rate: 7.7 symbols/min [2025-10-06T17:15:29.405404] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T17:15:29.411290] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-06T17:15:30.374582] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T17:15:30.379432] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-06T17:15:31.334943] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T17:15:31.336739] [INFO ] [REMOTE ] ANVS: Full fetch complete (36230 records). [2025-10-06T17:15:31.336828] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-06T17:15:31.719520] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-06T17:15:31.719612] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-06T17:15:31.720179] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-06T17:15:31.720249] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-06T17:15:31.721337] [DEBUG] [LOCAL ] ANVS: Trimmed 36230 records to 23133 (keeping 200 days of data) [2025-10-06T17:15:31.867100] [DEBUG] [LOCAL ] ANVS: Primary data saved (23133 records). [2025-10-06T17:15:31.867286] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-06T17:15:31.867407] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANVS took 28.6s. Estimated remaining: 4h 50m 3s. Rate: 7.8 symbols/min [2025-10-06T17:15:32.546763] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:15:32.641683] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:15:32.665333] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:15:32.665580] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-06T17:15:32.686346] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-06T17:15:32.689930] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-06T17:15:32.690049] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-06T17:15:32.697722] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-06T17:15:32.716062] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:15:32.716357] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-06T17:15:32.843061] [DEBUG] [LOCAL ] AOMR: Loaded 16719 existing records from primary storage. [2025-10-06T17:15:32.867626] [INFO ] [MAIN ] AOMR: Loaded 16719 existing records. [2025-10-06T17:15:33.028500] [DEBUG] [LOCAL ] AOD: Loaded 30678 existing records from primary storage. [2025-10-06T17:15:33.090613] [INFO ] [MAIN ] AOD: Loaded 30678 existing records. [2025-10-06T17:15:33.325041] [DEBUG] [LOCAL ] AON: Loaded 45997 existing records from primary storage. [2025-10-06T17:15:33.390457] [INFO ] [MAIN ] AON: Loaded 45997 existing records. [2025-10-06T17:15:33.523129] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:15:33.575910] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:15:33.586357] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-06T17:15:33.586698] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-06T17:15:33.601396] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-06T17:15:33.673998] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:15:33.674639] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-06T17:15:33.674312] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-06T17:15:33.680395] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-06T17:15:33.675084] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-06T17:15:33.821255] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:15:33.802420] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-06T17:15:33.843362] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-06T17:15:33.838025] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-06T17:15:33.843487] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-06T17:15:33.883891] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-06T17:15:33.872221] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:15:33.899449] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-06T17:15:33.972997] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-06T17:15:34.077348] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:15:34.154586] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-06T17:15:34.265712] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:15:34.296330] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-06T17:15:34.311946] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-06T17:15:34.364508] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-06T17:15:34.442196] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-06T17:15:34.489929] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.6s. Estimated remaining: 4h 48m 20s. Rate: 7.8 symbols/min [2025-10-06T17:15:34.658716] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:15:34.710942] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-06T17:15:34.870838] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:15:34.901361] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-06T17:15:35.033384] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:15:35.070063] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:15:35.070557] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-06T17:15:35.108281] [DEBUG] [LOCAL ] AORT: Loaded 29872 existing records from primary storage. [2025-10-06T17:15:35.108694] [INFO ] [MAIN ] AORT: Loaded 29872 existing records. [2025-10-06T17:15:35.327965] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:15:35.328254] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-06T17:15:35.328304] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-06T17:15:35.328521] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-06T17:15:35.328580] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-06T17:15:35.683710] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:15:35.684085] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-06T17:15:35.731028] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-06T17:15:35.734233] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-06T17:15:36.228227] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-06T17:15:36.234868] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-06T17:15:36.244113] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-06T17:15:36.247855] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-06T17:15:36.354025] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T17:15:36.625553] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-06T17:15:36.766399] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-06T17:15:36.851829] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T17:15:37.425603] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-06T17:15:37.552607] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T17:15:38.011315] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T17:15:38.225719] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-06T17:15:38.592169] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-06T17:15:39.025570] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-06T17:15:39.747897] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T17:15:39.825564] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-06T17:15:40.269212] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T17:15:40.625562] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-06T17:15:41.425517] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-06T17:15:41.475084] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T17:15:42.004837] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T17:15:42.225552] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-06T17:15:42.592773] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T17:15:43.025605] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-06T17:15:43.500465] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T17:15:43.718360] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-06T17:15:43.825475] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-06T17:15:44.625716] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-06T17:15:44.795169] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-06T17:15:45.425536] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-06T17:15:45.995230] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T17:15:46.225568] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-06T17:15:47.025544] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-06T17:15:47.319441] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T17:15:47.782464] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T17:15:47.825485] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-06T17:15:47.840503] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T17:15:48.625542] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-06T17:15:49.366931] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T17:15:49.425550] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-06T17:15:49.827205] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T17:15:50.050176] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-06T17:15:50.225555] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-06T17:15:51.025548] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-06T17:15:51.336144] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T17:15:51.825511] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-06T17:15:52.595147] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T17:15:52.625471] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-06T17:15:52.653622] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-06T17:15:53.425544] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-06T17:15:54.210706] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T17:15:54.225465] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-06T17:15:54.757791] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-06T17:15:55.025530] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-06T17:15:55.455724] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T17:15:55.574022] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-06T17:15:55.825524] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-06T17:15:56.625501] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-06T17:15:56.784214] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T17:15:57.425490] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-06T17:15:58.225555] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-06T17:15:58.401434] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T17:15:58.463210] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T17:15:59.025619] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-06T17:15:59.367614] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-06T17:15:59.825555] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-06T17:16:00.539760] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T17:16:00.625609] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-06T17:16:00.929754] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T17:16:00.931202] [INFO ] [REMOTE ] AOMR: Full fetch complete (23179 records). [2025-10-06T17:16:00.931313] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-06T17:16:01.305058] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-06T17:16:01.305177] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-06T17:16:01.305530] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-06T17:16:01.305571] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-06T17:16:01.306576] [DEBUG] [LOCAL ] AOMR: Trimmed 23179 records to 16487 (keeping 200 days of data) [2025-10-06T17:16:01.407561] [DEBUG] [LOCAL ] AOMR: Primary data saved (16487 records). [2025-10-06T17:16:01.407807] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-06T17:16:01.407916] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOMR took 29.5s. Estimated remaining: 4h 54m 7s. Rate: 7.6 symbols/min [2025-10-06T17:16:01.430678] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-06T17:16:01.589892] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:16:01.642732] [DEBUG] [LOCAL ] AOS: Loaded 49496 existing records from primary storage. [2025-10-06T17:16:01.643238] [INFO ] [MAIN ] AOS: Loaded 49496 existing records. [2025-10-06T17:16:01.827426] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:16:01.827729] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-06T17:16:01.827788] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-06T17:16:01.828101] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-06T17:16:01.828158] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-06T17:16:02.193581] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:16:02.225520] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-06T17:16:02.342506] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-06T17:16:02.345421] [INFO ] [REMOTE ] AON: Full fetch complete (64721 records). [2025-10-06T17:16:02.345598] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-06T17:16:02.750038] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T17:16:02.801498] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-06T17:16:02.801632] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-06T17:16:02.802832] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-06T17:16:02.802906] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-06T17:16:02.804550] [DEBUG] [LOCAL ] AON: Trimmed 64721 records to 45253 (keeping 200 days of data) [2025-10-06T17:16:03.026531] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-06T17:16:03.099504] [DEBUG] [LOCAL ] AON: Primary data saved (45253 records). [2025-10-06T17:16:03.099743] [INFO ] [MAIN ] AON: Full history saved. [2025-10-06T17:16:03.100623] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AON took 31.2s. Estimated remaining: 4h 52m 7s. Rate: 7.7 symbols/min [2025-10-06T17:16:03.279793] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:16:03.290722] [DEBUG] [LOCAL ] AP: Loaded 7267 existing records from primary storage. [2025-10-06T17:16:03.291008] [INFO ] [MAIN ] AP: Loaded 7267 existing records. [2025-10-06T17:16:03.478415] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:16:03.478810] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-06T17:16:03.478883] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-06T17:16:03.479168] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-06T17:16:03.479228] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-06T17:16:03.830760] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-06T17:16:03.935431] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:16:04.065776] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T17:16:04.299136] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T17:16:04.303741] [INFO ] [REMOTE ] AOD: Full fetch complete (44447 records). [2025-10-06T17:16:04.303952] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-06T17:16:04.630862] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-06T17:16:04.844379] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-06T17:16:04.844495] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-06T17:16:04.845192] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-06T17:16:04.845314] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-06T17:16:04.846599] [DEBUG] [LOCAL ] AOD: Trimmed 44447 records to 30491 (keeping 200 days of data) [2025-10-06T17:16:05.036059] [DEBUG] [LOCAL ] AOD: Primary data saved (30491 records). [2025-10-06T17:16:05.053337] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-06T17:16:05.054412] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AOD took 33.2s. Estimated remaining: 4h 50m 13s. Rate: 7.7 symbols/min [2025-10-06T17:16:05.055941] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T17:16:05.240225] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:16:05.282899] [DEBUG] [LOCAL ] APAM: Loaded 36607 existing records from primary storage. [2025-10-06T17:16:05.283343] [INFO ] [MAIN ] APAM: Loaded 36607 existing records. [2025-10-06T17:16:05.430741] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-06T17:16:05.489923] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:16:05.490187] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-06T17:16:05.490237] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-06T17:16:05.490685] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-06T17:16:05.490745] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-06T17:16:05.875403] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:16:06.225512] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-06T17:16:06.263038] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-06T17:16:06.384697] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T17:16:07.025581] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-06T17:16:07.632016] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T17:16:07.698420] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T17:16:07.825515] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-06T17:16:08.625599] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-06T17:16:09.425620] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-06T17:16:09.471854] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T17:16:10.200430] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T17:16:10.225470] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-06T17:16:10.891639] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T17:16:11.025502] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-06T17:16:11.045749] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-06T17:16:11.628502] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T17:16:11.825523] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-06T17:16:12.625617] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-06T17:16:12.965306] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T17:16:12.967312] [INFO ] [REMOTE ] AORT: Full fetch complete (42049 records). [2025-10-06T17:16:12.967418] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-06T17:16:13.278777] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-06T17:16:13.387365] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-06T17:16:13.387559] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-06T17:16:13.388130] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-06T17:16:13.388194] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-06T17:16:13.389161] [DEBUG] [LOCAL ] AORT: Trimmed 42049 records to 29334 (keeping 200 days of data) [2025-10-06T17:16:13.435149] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-06T17:16:13.562496] [DEBUG] [LOCAL ] AORT: Primary data saved (29334 records). [2025-10-06T17:16:13.562696] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-06T17:16:13.562801] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AORT took 39.1s. Estimated remaining: 4h 50m 19s. Rate: 7.7 symbols/min [2025-10-06T17:16:13.733813] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:16:13.734033] [DEBUG] [LOCAL ] APD: No existing data file found in primary storage. [2025-10-06T17:16:13.734071] [WARN ] [MAIN ] APD: No existing data found, performing full refresh instead. [2025-10-06T17:16:13.734185] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-06T17:16:13.734225] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-06T17:16:13.734265] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-10-06T17:16:13.734296] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-06T17:16:14.103696] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:16:14.225549] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-06T17:16:15.025551] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-06T17:16:15.440940] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-06T17:16:15.602863] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-06T17:16:15.825504] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-06T17:16:16.306303] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-06T17:16:16.625576] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-06T17:16:17.425513] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-06T17:16:17.535632] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T17:16:17.571519] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-06T17:16:18.225545] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-06T17:16:19.025521] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-06T17:16:19.046885] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T17:16:19.825532] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-06T17:16:19.959478] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T17:16:20.050446] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T17:16:20.625571] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-06T17:16:21.127104] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-06T17:16:21.425569] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-06T17:16:22.225552] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-06T17:16:22.318146] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T17:16:22.996507] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T17:16:23.025503] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-06T17:16:23.825549] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-06T17:16:23.962815] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T17:16:24.464106] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T17:16:24.625612] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-06T17:16:25.377828] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T17:16:25.425510] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-06T17:16:25.629760] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T17:16:26.225614] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-06T17:16:26.795766] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T17:16:27.025608] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-06T17:16:27.598445] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T17:16:27.825537] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-06T17:16:28.050156] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T17:16:28.625557] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-06T17:16:29.434923] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-06T17:16:29.445416] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T17:16:29.446314] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-06T17:16:30.225539] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-06T17:16:31.025500] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-06T17:16:31.208803] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T17:16:31.643630] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T17:16:31.825533] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-06T17:16:32.625506] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-06T17:16:32.819471] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T17:16:32.851875] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-06T17:16:33.271460] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T17:16:33.272405] [INFO ] [REMOTE ] AP: Full fetch complete (8962 records). [2025-10-06T17:16:33.272474] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-06T17:16:33.432847] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-06T17:16:33.642984] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-06T17:16:33.643094] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-06T17:16:33.643378] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-06T17:16:33.643422] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-06T17:16:33.643953] [DEBUG] [LOCAL ] AP: Trimmed 8962 records to 7211 (keeping 200 days of data) [2025-10-06T17:16:33.684005] [DEBUG] [LOCAL ] AP: Primary data saved (7211 records). [2025-10-06T17:16:33.684172] [INFO ] [MAIN ] AP: Full history saved. [2025-10-06T17:16:33.684275] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 30.6s. Estimated remaining: 4h 53m 52s. Rate: 7.6 symbols/min [2025-10-06T17:16:33.876137] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:16:33.932529] [DEBUG] [LOCAL ] APG: Loaded 50954 existing records from primary storage. [2025-10-06T17:16:33.932980] [INFO ] [MAIN ] APG: Loaded 50954 existing records. [2025-10-06T17:16:34.107003] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:16:34.107280] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-06T17:16:34.107371] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-06T17:16:34.107774] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-06T17:16:34.107834] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-06T17:16:34.230735] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-06T17:16:34.464050] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:16:34.779954] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T17:16:34.782631] [INFO ] [REMOTE ] APAM: Full fetch complete (51833 records). [2025-10-06T17:16:34.782779] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-06T17:16:35.036413] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-06T17:16:35.174665] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-06T17:16:35.174772] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-06T17:16:35.175375] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-06T17:16:35.175418] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-06T17:16:35.176621] [DEBUG] [LOCAL ] APAM: Trimmed 51833 records to 36068 (keeping 200 days of data) [2025-10-06T17:16:35.401833] [DEBUG] [LOCAL ] APAM: Primary data saved (36068 records). [2025-10-06T17:16:35.402023] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-06T17:16:35.402120] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. APAM took 30.3s. Estimated remaining: 4h 51m 55s. Rate: 7.7 symbols/min [2025-10-06T17:16:35.573490] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:16:35.632886] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-10-06T17:16:35.633386] [INFO ] [MAIN ] APH: Loaded 54471 existing records. [2025-10-06T17:16:35.811826] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:16:35.812220] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-06T17:16:35.812301] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-06T17:16:35.812851] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-06T17:16:35.812913] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-06T17:16:35.844164] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-06T17:16:36.221004] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:16:36.238602] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-06T17:16:36.630741] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-06T17:16:36.646194] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T17:16:37.425600] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-06T17:16:37.502055] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T17:16:38.225518] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-06T17:16:38.305521] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T17:16:39.025507] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-06T17:16:39.266684] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-06T17:16:39.825497] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-06T17:16:40.070982] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T17:16:40.614375] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T17:16:40.625752] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-06T17:16:41.427191] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-06T17:16:41.430079] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T17:16:42.032078] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T17:16:42.225597] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-06T17:16:43.025555] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-06T17:16:43.071242] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T17:16:43.825492] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-06T17:16:43.895303] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T17:16:44.613105] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T17:16:44.625468] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-06T17:16:45.386754] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T17:16:45.425551] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-06T17:16:46.105585] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T17:16:46.108613] [INFO ] [REMOTE ] APD: Full fetch complete (66790 records). [2025-10-06T17:16:46.108864] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-06T17:16:46.230741] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-06T17:16:46.502180] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-06T17:16:46.502292] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-06T17:16:46.503051] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-06T17:16:46.503119] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-06T17:16:46.504608] [DEBUG] [LOCAL ] APD: Trimmed 66790 records to 45311 (keeping 200 days of data) [2025-10-06T17:16:46.798027] [DEBUG] [LOCAL ] APD: Primary data saved (45311 records). [2025-10-06T17:16:46.798230] [INFO ] [MAIN ] APD: Full history saved. [2025-10-06T17:16:46.798338] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APD took 33.2s. Estimated remaining: 4h 52m 50s. Rate: 7.7 symbols/min [2025-10-06T17:16:46.969898] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:16:46.970276] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-10-06T17:16:46.970355] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-10-06T17:16:46.970601] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-06T17:16:46.970777] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-06T17:16:46.970844] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-06T17:16:46.970880] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-06T17:16:47.032621] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-06T17:16:47.343401] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:16:47.389085] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-06T17:16:47.825533] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-06T17:16:47.946395] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T17:16:48.625501] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-06T17:16:48.770676] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T17:16:49.425500] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-06T17:16:49.787833] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-06T17:16:50.082907] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T17:16:50.088437] [INFO ] [REMOTE ] AOS: Full fetch complete (70311 records). [2025-10-06T17:16:50.088620] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-06T17:16:50.089543] [FATAL] [VALIDATOR ] AOS: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:16:50.089660] [FATAL] [MAIN ] AOS: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:16:50.089721] [WARN ] [MAIN ] AOS: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:16:50.089766] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-06T17:16:50.089850] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-06T17:16:50.089917] [INFO ] [LOCAL ] AOS: Starting deletion of derivative data. [2025-10-06T17:16:50.090227] [DEBUG] [LOCAL ] AOS: Deleted derivative data file. [2025-10-06T17:16:50.090356] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. AOS took 48.7s. Estimated remaining: 4h 51m 24s. Rate: 7.7 symbols/min [2025-10-06T17:16:50.233414] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-06T17:16:50.265853] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:16:50.266003] [DEBUG] [LOCAL ] APO: No existing data file found in primary storage. [2025-10-06T17:16:50.266061] [WARN ] [MAIN ] APO: No existing data found, performing full refresh instead. [2025-10-06T17:16:50.266180] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-06T17:16:50.266257] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-06T17:16:50.266326] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-10-06T17:16:50.266376] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-06T17:16:50.616217] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:16:50.840948] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T17:16:51.025518] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-06T17:16:51.825521] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-06T17:16:52.422367] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-06T17:16:52.625592] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-06T17:16:52.981725] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-06T17:16:53.430932] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-06T17:16:53.445771] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T17:16:54.225584] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-06T17:16:54.598854] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-06T17:16:55.025612] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-06T17:16:55.239513] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T17:16:55.825524] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-06T17:16:56.127055] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T17:16:56.625536] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-06T17:16:56.882041] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T17:16:57.425609] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-06T17:16:57.515708] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T17:16:58.225532] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-06T17:16:58.395782] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T17:16:59.025553] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-06T17:16:59.153041] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T17:16:59.825517] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-06T17:16:59.962378] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T17:17:00.625624] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-06T17:17:01.191934] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-06T17:17:01.425511] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-06T17:17:01.737013] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-06T17:17:02.225493] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-06T17:17:02.309959] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T17:17:03.025538] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-06T17:17:03.316064] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T17:17:03.426281] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T17:17:03.429379] [INFO ] [REMOTE ] APG: Full fetch complete (71768 records). [2025-10-06T17:17:03.429526] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-06T17:17:03.840119] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-06T17:17:03.843889] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-06T17:17:03.845049] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-06T17:17:03.845884] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-06T17:17:03.846067] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-06T17:17:03.847535] [DEBUG] [LOCAL ] APG: Trimmed 71768 records to 50360 (keeping 200 days of data) [2025-10-06T17:17:04.142352] [DEBUG] [LOCAL ] APG: Primary data saved (50360 records). [2025-10-06T17:17:04.142517] [INFO ] [MAIN ] APG: Full history saved. [2025-10-06T17:17:04.143419] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APG took 30.5s. Estimated remaining: 4h 53m 4s. Rate: 7.6 symbols/min [2025-10-06T17:17:04.332347] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:17:04.344904] [DEBUG] [LOCAL ] APOS: Loaded 7664 existing records from primary storage. [2025-10-06T17:17:04.345238] [INFO ] [MAIN ] APOS: Loaded 7664 existing records. [2025-10-06T17:17:04.527567] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:17:04.527907] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-06T17:17:04.527962] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-06T17:17:04.528186] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-06T17:17:04.528246] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-06T17:17:04.631393] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-06T17:17:04.961573] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:17:05.085074] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-06T17:17:05.425572] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-06T17:17:05.918573] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-06T17:17:06.225599] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-06T17:17:06.749574] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-06T17:17:07.018325] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-06T17:17:07.025468] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-06T17:17:07.466586] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-06T17:17:07.632311] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T17:17:07.825537] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-06T17:17:08.625599] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-06T17:17:09.269092] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-06T17:17:09.425489] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-06T17:17:09.694239] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-06T17:17:10.225584] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-06T17:17:11.025564] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-06T17:17:11.131878] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T17:17:11.134436] [INFO ] [REMOTE ] APH: Full fetch complete (77301 records). [2025-10-06T17:17:11.134591] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-06T17:17:11.135339] [FATAL] [VALIDATOR ] APH: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:17:11.135483] [FATAL] [MAIN ] APH: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:17:11.135526] [WARN ] [MAIN ] APH: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:17:11.135566] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-06T17:17:11.135630] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-06T17:17:11.135703] [INFO ] [LOCAL ] APH: Starting deletion of derivative data. [2025-10-06T17:17:11.136035] [DEBUG] [LOCAL ] APH: Deleted derivative data file. [2025-10-06T17:17:11.136132] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 35.7s. Estimated remaining: 4h 52m 41s. Rate: 7.7 symbols/min [2025-10-06T17:17:11.313197] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:17:11.362450] [DEBUG] [LOCAL ] APTV: Loaded 52852 existing records from primary storage. [2025-10-06T17:17:11.362853] [INFO ] [MAIN ] APTV: Loaded 52852 existing records. [2025-10-06T17:17:11.545778] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:17:11.552827] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-06T17:17:11.552724] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-06T17:17:11.555408] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-06T17:17:11.556051] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-06T17:17:11.556112] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-06T17:17:11.828697] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-06T17:17:11.922279] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:17:11.973481] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T17:17:12.625555] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-06T17:17:13.383601] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T17:17:13.425599] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-06T17:17:13.692253] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T17:17:14.155706] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-06T17:17:14.225472] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-06T17:17:14.716626] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-06T17:17:15.025581] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-06T17:17:15.825553] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-06T17:17:16.356520] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-06T17:17:16.625556] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-06T17:17:16.861633] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T17:17:17.425531] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-06T17:17:18.225515] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-06T17:17:18.296199] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T17:17:19.025578] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-06T17:17:19.404555] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-06T17:17:19.719815] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T17:17:19.767513] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T17:17:19.825538] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-06T17:17:20.625529] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-06T17:17:21.425556] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-06T17:17:21.715755] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T17:17:22.225611] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-06T17:17:22.376196] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T17:17:22.394788] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T17:17:23.025587] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-06T17:17:23.697905] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-06T17:17:23.699206] [INFO ] [REMOTE ] APOS: Full fetch complete (10385 records). [2025-10-06T17:17:23.699318] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-06T17:17:23.700172] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:17:23.700364] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:17:23.700590] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:17:23.700694] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-06T17:17:23.716901] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-06T17:17:23.730426] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-06T17:17:23.732633] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T17:17:23.732727] [DEBUG] [LOCAL ] APOS: Deleted derivative data file. [2025-10-06T17:17:23.732996] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APOS took 19.6s. Estimated remaining: 4h 53m 54s. Rate: 7.6 symbols/min [2025-10-06T17:17:23.827685] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-06T17:17:23.955200] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:17:23.955434] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-06T17:17:23.955470] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-06T17:17:23.955609] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-06T17:17:23.955676] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-06T17:17:23.955739] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-06T17:17:23.955773] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-06T17:17:24.311292] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:17:24.625537] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-06T17:17:25.425579] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-06T17:17:25.554332] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-06T17:17:25.557745] [INFO ] [REMOTE ] APO: Full fetch complete (77291 records). [2025-10-06T17:17:25.557869] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-06T17:17:25.945753] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-06T17:17:25.945873] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-06T17:17:25.946673] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-06T17:17:25.946804] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-06T17:17:25.948465] [DEBUG] [LOCAL ] APO: Trimmed 77291 records to 53383 (keeping 200 days of data) [2025-10-06T17:17:26.197811] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T17:17:26.225761] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-06T17:17:26.340627] [DEBUG] [LOCAL ] APO: Primary data saved (53383 records). [2025-10-06T17:17:26.340848] [INFO ] [MAIN ] APO: Full history saved. [2025-10-06T17:17:26.340998] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APO took 36.3s. Estimated remaining: 4h 52m 18s. Rate: 7.7 symbols/min [2025-10-06T17:17:26.519496] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:17:26.528140] [DEBUG] [LOCAL ] AQNB: Loaded 4198 existing records from primary storage. [2025-10-06T17:17:26.528442] [INFO ] [MAIN ] AQNB: Loaded 4198 existing records. [2025-10-06T17:17:26.710722] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:17:26.711042] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-06T17:17:26.711091] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-06T17:17:26.711706] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-06T17:17:26.711767] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-06T17:17:27.030835] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-06T17:17:27.092761] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:17:27.190598] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T17:17:27.825548] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-06T17:17:28.142639] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T17:17:28.455160] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T17:17:28.625532] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-06T17:17:29.425559] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-06T17:17:29.536613] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T17:17:30.225603] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-06T17:17:30.412482] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T17:17:30.997523] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T17:17:31.025470] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-06T17:17:31.825517] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-06T17:17:31.889933] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T17:17:32.584965] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-06T17:17:32.625583] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-06T17:17:32.801709] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T17:17:33.425551] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-06T17:17:33.869329] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-06T17:17:34.115534] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T17:17:34.118475] [INFO ] [REMOTE ] APLE: Full fetch complete (73946 records). [2025-10-06T17:17:34.118602] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-06T17:17:34.119835] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:17:34.120020] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:17:34.120092] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:17:34.120147] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-06T17:17:34.120214] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-06T17:17:34.120251] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-10-06T17:17:34.120292] [DEBUG] [LOCAL ] APLE: No derivative data file found to delete. [2025-10-06T17:17:34.120364] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APLE took 47.3s. Estimated remaining: 4h 52m 9s. Rate: 7.7 symbols/min [2025-10-06T17:17:34.229004] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-06T17:17:34.307271] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:17:34.368562] [DEBUG] [LOCAL ] AR: Loaded 54363 existing records from primary storage. [2025-10-06T17:17:34.369102] [INFO ] [MAIN ] AR: Loaded 54363 existing records. [2025-10-06T17:17:34.559205] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:17:34.559475] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-06T17:17:34.559524] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-06T17:17:34.560022] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-06T17:17:34.560083] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-06T17:17:34.955401] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:17:35.025564] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-06T17:17:35.475968] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-06T17:17:35.825555] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-06T17:17:36.083802] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T17:17:36.435203] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T17:17:36.625543] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-06T17:17:37.425567] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-06T17:17:37.459012] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-06T17:17:38.225526] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-06T17:17:38.793597] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-06T17:17:39.025505] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-06T17:17:39.270589] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T17:17:39.636605] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-06T17:17:39.825547] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-06T17:17:40.625543] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-06T17:17:41.180783] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-06T17:17:41.425516] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-06T17:17:41.824155] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-06T17:17:42.225556] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-06T17:17:43.025558] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-06T17:17:43.202064] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T17:17:43.825506] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-06T17:17:43.929465] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T17:17:44.251549] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T17:17:44.625512] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-06T17:17:44.862072] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T17:17:45.425532] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-06T17:17:46.225494] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-06T17:17:46.358201] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T17:17:46.578435] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-06T17:17:47.025498] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-06T17:17:47.200438] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-06T17:17:47.825539] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-06T17:17:48.625585] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-06T17:17:48.668053] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T17:17:49.430605] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-06T17:17:49.452018] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T17:17:50.132780] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T17:17:50.133614] [INFO ] [REMOTE ] AQNB: Full fetch complete (5671 records). [2025-10-06T17:17:50.133720] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-06T17:17:50.230694] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-06T17:17:50.383538] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-06T17:17:50.542586] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-06T17:17:50.542714] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-06T17:17:50.542942] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-06T17:17:50.542983] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-06T17:17:50.543349] [DEBUG] [LOCAL ] AQNB: Trimmed 5671 records to 4138 (keeping 200 days of data) [2025-10-06T17:17:50.568802] [DEBUG] [LOCAL ] AQNB: Primary data saved (4138 records). [2025-10-06T17:17:50.568899] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-06T17:17:50.568982] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQNB took 24.2s. Estimated remaining: 4h 54m 24s. Rate: 7.6 symbols/min [2025-10-06T17:17:50.735049] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:17:50.781514] [DEBUG] [LOCAL ] ARCO: Loaded 44983 existing records from primary storage. [2025-10-06T17:17:50.782053] [INFO ] [MAIN ] ARCO: Loaded 44983 existing records. [2025-10-06T17:17:50.956768] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:17:50.957143] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-06T17:17:50.957209] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-06T17:17:50.957490] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-06T17:17:50.957549] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-06T17:17:51.030615] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-06T17:17:51.307625] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:17:51.825500] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-06T17:17:51.934717] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T17:17:52.625517] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-06T17:17:52.888079] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-06T17:17:53.248719] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T17:17:53.425548] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-06T17:17:54.225509] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-06T17:17:54.346754] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T17:17:54.627480] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-06T17:17:55.025557] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-06T17:17:55.825554] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-06T17:17:56.058284] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T17:17:56.625567] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-06T17:17:56.659100] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T17:17:56.662449] [INFO ] [REMOTE ] APTV: Full fetch complete (75885 records). [2025-10-06T17:17:56.662777] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-06T17:17:57.060263] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-06T17:17:57.060406] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-06T17:17:57.061292] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-06T17:17:57.061400] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-06T17:17:57.063184] [DEBUG] [LOCAL ] APTV: Trimmed 75885 records to 52044 (keeping 200 days of data) [2025-10-06T17:17:57.372630] [DEBUG] [LOCAL ] APTV: Primary data saved (52044 records). [2025-10-06T17:17:57.372834] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-06T17:17:57.372924] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. APTV took 46.2s. Estimated remaining: 4h 53m 58s. Rate: 7.6 symbols/min [2025-10-06T17:17:57.440595] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-06T17:17:57.482224] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T17:17:57.498605] [INFO ] [REMOTE ] AQN: Full fetch complete (75288 records). [2025-10-06T17:17:57.509563] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-06T17:17:57.678403] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:17:57.891491] [DEBUG] [LOCAL ] ARDC: Loaded 15051 existing records from primary storage. [2025-10-06T17:17:57.908632] [INFO ] [MAIN ] ARDC: Loaded 15051 existing records. [2025-10-06T17:17:58.226900] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-06T17:17:58.227095] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-06T17:17:58.228129] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-06T17:17:58.226613] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:17:58.228477] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-06T17:17:58.228585] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-06T17:17:58.228848] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-06T17:17:58.229251] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-06T17:17:58.229326] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-06T17:17:58.342931] [DEBUG] [LOCAL ] AQN: Trimmed 75288 records to 51873 (keeping 200 days of data) [2025-10-06T17:17:58.689841] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-06T17:17:58.733525] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-06T17:17:58.803192] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:17:58.939036] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T17:17:59.035292] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-06T17:17:59.060404] [DEBUG] [LOCAL ] AQN: Primary data saved (51873 records). [2025-10-06T17:17:59.060538] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-06T17:17:59.060618] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQN took 35.3s. Estimated remaining: 4h 52m 9s. Rate: 7.6 symbols/min [2025-10-06T17:17:59.242937] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:17:59.274077] [DEBUG] [LOCAL ] ARDT: Loaded 28156 existing records from primary storage. [2025-10-06T17:17:59.274435] [INFO ] [MAIN ] ARDT: Loaded 28156 existing records. [2025-10-06T17:17:59.452541] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:17:59.452820] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-06T17:17:59.452871] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-06T17:17:59.453094] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-06T17:17:59.453154] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-06T17:17:59.827586] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-06T17:17:59.827507] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:18:00.150195] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T17:18:00.252345] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T17:18:00.625597] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-06T17:18:00.886632] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-06T17:18:01.425596] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-06T17:18:01.673791] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T17:18:02.225545] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-06T17:18:02.251017] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T17:18:03.025586] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-06T17:18:03.825503] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-06T17:18:04.079750] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T17:18:04.617156] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-06T17:18:04.625477] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-06T17:18:04.748555] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T17:18:05.425579] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-06T17:18:05.647526] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T17:18:06.225547] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-06T17:18:06.455540] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T17:18:07.025570] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-06T17:18:07.825569] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-06T17:18:08.018550] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T17:18:08.196513] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-06T17:18:08.625497] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-06T17:18:09.023053] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T17:18:09.425551] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-06T17:18:10.225557] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-06T17:18:10.286481] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T17:18:10.790611] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T17:18:11.025556] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-06T17:18:11.825505] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-06T17:18:12.008182] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T17:18:12.151706] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-06T17:18:12.625549] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-06T17:18:13.408546] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T17:18:13.425467] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-06T17:18:13.968130] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-06T17:18:14.225594] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-06T17:18:14.890207] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T17:18:15.025487] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-06T17:18:15.114664] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-06T17:18:15.825526] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-06T17:18:16.447137] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T17:18:16.625499] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-06T17:18:16.971212] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T17:18:17.425591] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-06T17:18:17.908370] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T17:18:18.225583] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-06T17:18:19.025579] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-06T17:18:19.238166] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T17:18:19.543560] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T17:18:19.546567] [INFO ] [REMOTE ] ARCO: Full fetch complete (65304 records). [2025-10-06T17:18:19.546772] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-06T17:18:19.850940] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-06T17:18:19.833673] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-06T17:18:19.986001] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-06T17:18:19.986143] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-06T17:18:19.986908] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-06T17:18:19.986995] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-06T17:18:19.988754] [DEBUG] [LOCAL ] ARCO: Trimmed 65304 records to 44349 (keeping 200 days of data) [2025-10-06T17:18:20.260228] [DEBUG] [LOCAL ] ARCO: Primary data saved (44349 records). [2025-10-06T17:18:20.260412] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-06T17:18:20.260507] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. ARCO took 29.7s. Estimated remaining: 4h 55m 37s. Rate: 7.6 symbols/min [2025-10-06T17:18:20.432539] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:18:20.488513] [DEBUG] [LOCAL ] ARE: Loaded 51371 existing records from primary storage. [2025-10-06T17:18:20.489036] [INFO ] [MAIN ] ARE: Loaded 51371 existing records. [2025-10-06T17:18:20.630779] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-06T17:18:20.695968] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:18:20.696174] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-06T17:18:20.696222] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-06T17:18:20.696739] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-06T17:18:20.696798] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-06T17:18:21.048999] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:18:21.082579] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T17:18:21.425485] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-06T17:18:21.542930] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T17:18:22.225585] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-06T17:18:22.587060] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T17:18:23.025524] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-06T17:18:23.786551] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T17:18:23.789757] [INFO ] [REMOTE ] AR: Full fetch complete (77545 records). [2025-10-06T17:18:23.789899] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-06T17:18:23.832356] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-06T17:18:24.184208] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-06T17:18:24.184385] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-06T17:18:24.185255] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-06T17:18:24.185322] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-06T17:18:24.187006] [DEBUG] [LOCAL ] AR: Trimmed 77545 records to 53587 (keeping 200 days of data) [2025-10-06T17:18:24.275366] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T17:18:24.278415] [INFO ] [REMOTE ] ARDC: Full fetch complete (20921 records). [2025-10-06T17:18:24.278898] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-06T17:18:24.627055] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-06T17:18:24.699812] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-06T17:18:24.700204] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-06T17:18:24.700997] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-06T17:18:24.701384] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-06T17:18:24.704428] [DEBUG] [LOCAL ] ARDC: Trimmed 20921 records to 14954 (keeping 200 days of data) [2025-10-06T17:18:24.805470] [DEBUG] [LOCAL ] ARDC: Primary data saved (14954 records). [2025-10-06T17:18:24.806219] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-06T17:18:24.806599] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 27.4s. Estimated remaining: 4h 54m 34s. Rate: 7.6 symbols/min [2025-10-06T17:18:25.079842] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:18:25.142121] [DEBUG] [LOCAL ] ARES: Loaded 50322 existing records from primary storage. [2025-10-06T17:18:25.145009] [INFO ] [MAIN ] ARES: Loaded 50322 existing records. [2025-10-06T17:18:25.412421] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:18:25.413797] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-06T17:18:25.415249] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-06T17:18:25.420838] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-06T17:18:25.421064] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-06T17:18:25.425343] [DEBUG] [LOCAL ] AR: Primary data saved (53587 records). [2025-10-06T17:18:25.430825] [INFO ] [MAIN ] AR: Full history saved. [2025-10-06T17:18:25.454152] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. AR took 51.3s. Estimated remaining: 4h 52m 31s. Rate: 7.6 symbols/min [2025-10-06T17:18:25.559288] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T17:18:25.676887] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-06T17:18:25.884068] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:18:26.036593] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:18:26.072881] [DEBUG] [LOCAL ] ARI: Loaded 44168 existing records from primary storage. [2025-10-06T17:18:26.073313] [INFO ] [MAIN ] ARI: Loaded 44168 existing records. [2025-10-06T17:18:26.230765] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-06T17:18:26.276407] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:18:26.276770] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-06T17:18:26.276833] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-06T17:18:26.277359] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-06T17:18:26.277419] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-06T17:18:26.673490] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:18:26.705223] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-06T17:18:27.030734] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-06T17:18:27.035280] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T17:18:27.765401] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T17:18:27.825539] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-06T17:18:28.625743] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-06T17:18:28.670491] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T17:18:29.425494] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-06T17:18:29.530575] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T17:18:29.727804] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T17:18:30.225547] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-06T17:18:31.026937] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-06T17:18:31.031219] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T17:18:31.825521] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-06T17:18:31.874697] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T17:18:32.625495] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-06T17:18:32.743082] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T17:18:33.425520] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-06T17:18:33.475716] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T17:18:34.052589] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T17:18:34.225522] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-06T17:18:35.025497] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-06T17:18:35.248093] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T17:18:35.825501] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-06T17:18:36.107185] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-06T17:18:36.479630] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T17:18:36.625526] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-06T17:18:37.425555] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-06T17:18:37.805527] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-06T17:18:38.226426] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-06T17:18:38.229271] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T17:18:38.656574] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T17:18:38.658738] [INFO ] [REMOTE ] ARDT: Full fetch complete (41494 records). [2025-10-06T17:18:38.658824] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-06T17:18:39.030701] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-06T17:18:39.110700] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-06T17:18:39.110834] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-06T17:18:39.111528] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-06T17:18:39.111597] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-06T17:18:39.112593] [DEBUG] [LOCAL ] ARDT: Trimmed 41494 records to 27708 (keeping 200 days of data) [2025-10-06T17:18:39.299563] [DEBUG] [LOCAL ] ARDT: Primary data saved (27708 records). [2025-10-06T17:18:39.299832] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-06T17:18:39.299960] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 40.2s. Estimated remaining: 4h 53m 57s. Rate: 7.6 symbols/min [2025-10-06T17:18:39.515731] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:18:39.515960] [DEBUG] [LOCAL ] ARIS: No existing data file found in primary storage. [2025-10-06T17:18:39.516006] [WARN ] [MAIN ] ARIS: No existing data found, performing full refresh instead. [2025-10-06T17:18:39.516129] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-06T17:18:39.516235] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-06T17:18:39.516314] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-10-06T17:18:39.516349] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-06T17:18:39.830710] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-06T17:18:39.903557] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:18:40.229683] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-06T17:18:40.625628] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-06T17:18:40.931761] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T17:18:41.425514] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-06T17:18:41.663232] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T17:18:41.920534] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T17:18:42.225610] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-06T17:18:42.858921] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T17:18:43.025584] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-06T17:18:43.815624] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T17:18:43.825466] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-06T17:18:44.625503] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-06T17:18:44.689522] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T17:18:45.358907] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T17:18:45.425591] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-06T17:18:46.225558] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-06T17:18:46.457828] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-06T17:18:47.025512] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-06T17:18:47.132815] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T17:18:47.825516] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-06T17:18:48.139084] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-06T17:18:48.429109] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-06T17:18:48.625525] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-06T17:18:49.398864] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T17:18:49.425533] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-06T17:18:50.212631] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T17:18:50.225470] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-06T17:18:50.893849] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T17:18:51.025555] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-06T17:18:51.792406] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T17:18:51.825542] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-06T17:18:52.625488] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-06T17:18:52.655548] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T17:18:53.425555] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-06T17:18:53.506713] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T17:18:54.225507] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-06T17:18:54.505471] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T17:18:54.913787] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T17:18:55.025610] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-06T17:18:55.705241] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T17:18:55.825561] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-06T17:18:56.424736] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T17:18:56.427389] [INFO ] [REMOTE ] ARI: Full fetch complete (62774 records). [2025-10-06T17:18:56.428194] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-06T17:18:56.626259] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-06T17:18:56.880614] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-06T17:18:56.880761] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-06T17:18:56.881592] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-06T17:18:56.881684] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-06T17:18:56.883445] [DEBUG] [LOCAL ] ARI: Trimmed 62774 records to 43598 (keeping 200 days of data) [2025-10-06T17:18:57.183022] [DEBUG] [LOCAL ] ARI: Primary data saved (43598 records). [2025-10-06T17:18:57.183236] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-06T17:18:57.183362] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARI took 31.7s. Estimated remaining: 4h 56m 26s. Rate: 7.5 symbols/min [2025-10-06T17:18:57.454690] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-06T17:18:57.458254] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:18:57.515152] [DEBUG] [LOCAL ] ARLO: Loaded 44465 existing records from primary storage. [2025-10-06T17:18:57.515725] [INFO ] [MAIN ] ARLO: Loaded 44465 existing records. [2025-10-06T17:18:57.785638] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:18:57.786453] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-06T17:18:57.786580] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-06T17:18:57.790360] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T17:18:57.790486] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-06T17:18:57.790735] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-06T17:18:58.228205] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-06T17:18:58.333158] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T17:18:58.398565] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:18:58.675522] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T17:18:58.678529] [INFO ] [REMOTE ] ARES: Full fetch complete (70445 records). [2025-10-06T17:18:58.678693] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-06T17:18:58.679392] [FATAL] [VALIDATOR ] ARES: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:18:58.679479] [FATAL] [MAIN ] ARES: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:18:58.679522] [WARN ] [MAIN ] ARES: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:18:58.679561] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-06T17:18:58.679637] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-06T17:18:58.679765] [INFO ] [LOCAL ] ARES: Starting deletion of derivative data. [2025-10-06T17:18:58.680134] [DEBUG] [LOCAL ] ARES: Deleted derivative data file. [2025-10-06T17:18:58.680234] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 33.9s. Estimated remaining: 4h 54m 37s. Rate: 7.6 symbols/min [2025-10-06T17:18:58.885407] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:18:58.936741] [DEBUG] [LOCAL ] ARMK: Loaded 51071 existing records from primary storage. [2025-10-06T17:18:58.937135] [INFO ] [MAIN ] ARMK: Loaded 51071 existing records. [2025-10-06T17:18:59.033803] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-06T17:18:59.114876] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:18:59.115121] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-06T17:18:59.115173] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-06T17:18:59.115667] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-06T17:18:59.115728] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-06T17:18:59.462491] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:18:59.825546] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-06T17:18:59.850227] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-06T17:18:59.853252] [INFO ] [REMOTE ] ARE: Full fetch complete (72674 records). [2025-10-06T17:18:59.853362] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-06T17:19:00.244017] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-06T17:19:00.244122] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-06T17:19:00.245019] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-06T17:19:00.245087] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-06T17:19:00.248919] [DEBUG] [LOCAL ] ARE: Trimmed 72674 records to 50684 (keeping 200 days of data) [2025-10-06T17:19:00.582300] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T17:19:00.605395] [DEBUG] [LOCAL ] ARE: Primary data saved (50684 records). [2025-10-06T17:19:00.605580] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-06T17:19:00.605715] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARE took 40.3s. Estimated remaining: 4h 52m 56s. Rate: 7.6 symbols/min [2025-10-06T17:19:00.630685] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-06T17:19:00.781249] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:19:00.827034] [DEBUG] [LOCAL ] AROC: Loaded 49675 existing records from primary storage. [2025-10-06T17:19:00.827413] [INFO ] [MAIN ] AROC: Loaded 49675 existing records. [2025-10-06T17:19:01.019582] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:19:01.019907] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-06T17:19:01.019962] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-06T17:19:01.020193] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-06T17:19:01.020253] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-06T17:19:01.398614] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:19:01.425465] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-06T17:19:01.568509] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T17:19:02.148461] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T17:19:02.225613] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-06T17:19:03.033317] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-06T17:19:03.043332] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T17:19:03.830611] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-06T17:19:03.844941] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T17:19:04.616595] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T17:19:04.625463] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-06T17:19:05.425494] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-06T17:19:05.514931] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T17:19:06.086105] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T17:19:06.225522] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-06T17:19:07.025501] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-06T17:19:07.058431] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T17:19:07.541622] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T17:19:07.825535] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-06T17:19:08.441574] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T17:19:08.444431] [INFO ] [REMOTE ] ARIS: Full fetch complete (60800 records). [2025-10-06T17:19:08.444545] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-06T17:19:08.631325] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-06T17:19:08.826541] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-10-06T17:19:08.826638] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-10-06T17:19:08.827409] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-10-06T17:19:08.827472] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-10-06T17:19:08.828779] [DEBUG] [LOCAL ] ARIS: Trimmed 60800 records to 42261 (keeping 200 days of data) [2025-10-06T17:19:09.086999] [DEBUG] [LOCAL ] ARIS: Primary data saved (42261 records). [2025-10-06T17:19:09.087192] [INFO ] [MAIN ] ARIS: Full history saved. [2025-10-06T17:19:09.087277] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARIS took 29.8s. Estimated remaining: 4h 52m 57s. Rate: 7.6 symbols/min [2025-10-06T17:19:09.258022] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:19:09.310105] [DEBUG] [LOCAL ] ARR: Loaded 52803 existing records from primary storage. [2025-10-06T17:19:09.310513] [INFO ] [MAIN ] ARR: Loaded 52803 existing records. [2025-10-06T17:19:09.426442] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-06T17:19:09.506030] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:19:09.506486] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-06T17:19:09.506668] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-06T17:19:09.507181] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-06T17:19:09.507261] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-06T17:19:09.636451] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T17:19:09.896033] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:19:10.225577] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-06T17:19:10.399407] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T17:19:11.025589] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-06T17:19:11.328016] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-06T17:19:11.825589] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-06T17:19:12.382395] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-06T17:19:12.458383] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T17:19:12.625555] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-06T17:19:13.425528] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-06T17:19:13.532863] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T17:19:14.225550] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-06T17:19:14.526745] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T17:19:15.025495] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-06T17:19:15.026329] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T17:19:15.622912] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T17:19:15.825524] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-06T17:19:16.625506] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-06T17:19:16.667893] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T17:19:17.430605] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-06T17:19:17.444855] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T17:19:17.961418] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T17:19:18.225558] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-06T17:19:19.025558] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-06T17:19:19.321093] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T17:19:19.805181] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T17:19:19.825493] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-06T17:19:20.362548] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-06T17:19:20.625537] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-06T17:19:21.424355] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T17:19:21.433541] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-06T17:19:22.225496] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-06T17:19:22.593819] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-06T17:19:23.002625] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T17:19:23.025482] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-06T17:19:23.525867] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T17:19:23.825534] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-06T17:19:24.625584] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-06T17:19:24.843246] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T17:19:25.207911] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T17:19:25.425545] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-06T17:19:26.225505] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-06T17:19:26.266033] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T17:19:27.025564] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-06T17:19:27.096550] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T17:19:27.825507] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-06T17:19:28.284074] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-06T17:19:28.403161] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T17:19:28.407454] [INFO ] [REMOTE ] ARLO: Full fetch complete (62898 records). [2025-10-06T17:19:28.407594] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-06T17:19:28.630807] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-06T17:19:28.814872] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-06T17:19:28.814975] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-06T17:19:28.815758] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-06T17:19:28.815824] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-06T17:19:28.817419] [DEBUG] [LOCAL ] ARLO: Trimmed 62898 records to 43824 (keeping 200 days of data) [2025-10-06T17:19:29.088841] [DEBUG] [LOCAL ] ARLO: Primary data saved (43824 records). [2025-10-06T17:19:29.089357] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-06T17:19:29.089492] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 31.9s. Estimated remaining: 4h 55m 54s. Rate: 7.5 symbols/min [2025-10-06T17:19:29.296936] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:19:29.335899] [DEBUG] [LOCAL ] ARW: Loaded 33549 existing records from primary storage. [2025-10-06T17:19:29.336253] [INFO ] [MAIN ] ARW: Loaded 33549 existing records. [2025-10-06T17:19:29.429383] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-06T17:19:29.528560] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:19:29.529250] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-06T17:19:29.529363] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-06T17:19:29.530263] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-06T17:19:29.530336] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-06T17:19:29.781187] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-06T17:19:29.952354] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:19:30.135312] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T17:19:30.138378] [INFO ] [REMOTE ] ARMK: Full fetch complete (72640 records). [2025-10-06T17:19:30.138515] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-06T17:19:30.234819] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-06T17:19:30.583808] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-06T17:19:30.583925] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-06T17:19:30.584893] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-06T17:19:30.584965] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-06T17:19:30.587325] [DEBUG] [LOCAL ] ARMK: Trimmed 72640 records to 50402 (keeping 200 days of data) [2025-10-06T17:19:30.931700] [DEBUG] [LOCAL ] ARMK: Primary data saved (50402 records). [2025-10-06T17:19:30.931906] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-06T17:19:30.932021] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARMK took 32.3s. Estimated remaining: 4h 54m 13s. Rate: 7.6 symbols/min [2025-10-06T17:19:31.030696] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-06T17:19:31.135978] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:19:31.136471] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-06T17:19:31.136718] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-06T17:19:31.136903] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-06T17:19:31.137096] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-06T17:19:31.137230] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-06T17:19:31.137329] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-06T17:19:31.382166] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T17:19:31.609334] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:19:31.825547] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-06T17:19:31.961218] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T17:19:32.035107] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:19:32.035693] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-06T17:19:32.035812] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:19:32.035902] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-06T17:19:32.035984] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:19:32.036077] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-06T17:19:32.036172] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-06T17:19:32.036227] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-06T17:19:32.036285] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-06T17:19:32.036360] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARX took 1.1s. Estimated remaining: 4h 52m 22s. Rate: 7.6 symbols/min [2025-10-06T17:19:32.236630] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:19:32.291680] [DEBUG] [LOCAL ] AS: Loaded 53862 existing records from primary storage. [2025-10-06T17:19:32.292093] [INFO ] [MAIN ] AS: Loaded 53862 existing records. [2025-10-06T17:19:32.493228] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:19:32.493797] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-06T17:19:32.493893] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-06T17:19:32.512809] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-06T17:19:32.513346] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-06T17:19:32.514016] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T17:19:32.630821] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-06T17:19:32.918472] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:19:33.425545] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-06T17:19:33.744137] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T17:19:34.225536] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-06T17:19:34.820788] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T17:19:35.025543] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-06T17:19:35.217937] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T17:19:35.825547] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-06T17:19:36.625613] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-06T17:19:36.721182] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-06T17:19:36.724405] [INFO ] [REMOTE ] AROC: Full fetch complete (70953 records). [2025-10-06T17:19:36.724576] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-06T17:19:37.206825] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T17:19:37.207538] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-06T17:19:37.215094] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-06T17:19:37.216895] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-06T17:19:37.216991] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-06T17:19:37.219366] [DEBUG] [LOCAL ] AROC: Trimmed 70953 records to 48939 (keeping 200 days of data) [2025-10-06T17:19:37.449472] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-06T17:19:37.563883] [DEBUG] [LOCAL ] AROC: Primary data saved (48939 records). [2025-10-06T17:19:37.564085] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-06T17:19:37.564194] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. AROC took 37.0s. Estimated remaining: 4h 51m 39s. Rate: 7.6 symbols/min [2025-10-06T17:19:37.761829] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:19:37.780161] [DEBUG] [LOCAL ] ASA: Loaded 14433 existing records from primary storage. [2025-10-06T17:19:37.780473] [INFO ] [MAIN ] ASA: Loaded 14433 existing records. [2025-10-06T17:19:37.975361] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:19:37.975707] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-06T17:19:37.975777] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-06T17:19:37.976125] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-06T17:19:37.976187] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-06T17:19:38.259026] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-06T17:19:38.381591] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:19:38.417890] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T17:19:38.920096] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T17:19:39.025593] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-06T17:19:39.825531] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-06T17:19:39.997305] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T17:19:40.054500] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T17:19:40.625551] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-06T17:19:40.879967] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T17:19:41.425525] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-06T17:19:41.502479] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T17:19:42.225551] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-06T17:19:43.008639] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T17:19:43.025474] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-06T17:19:43.140722] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T17:19:43.737846] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-06T17:19:43.825605] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-06T17:19:44.625597] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-06T17:19:44.813780] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T17:19:45.425612] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-06T17:19:45.941089] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-06T17:19:46.225526] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-06T17:19:46.442485] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T17:19:47.025549] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-06T17:19:47.762942] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T17:19:47.825509] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-06T17:19:48.625559] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-06T17:19:48.768095] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-06T17:19:49.194787] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T17:19:49.425570] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-06T17:19:50.008984] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T17:19:50.225685] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-06T17:19:51.025696] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-06T17:19:51.167546] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T17:19:51.426267] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-06T17:19:51.825558] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-06T17:19:52.625527] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-06T17:19:52.666812] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T17:19:53.047527] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-06T17:19:53.425550] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-06T17:19:53.936767] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-06T17:19:54.225595] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-06T17:19:55.025498] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-06T17:19:55.439270] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-06T17:19:55.591816] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T17:19:55.825550] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-06T17:19:55.910349] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T17:19:56.625564] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-06T17:19:57.425518] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-06T17:19:57.579542] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T17:19:57.685163] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T17:19:58.225552] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-06T17:19:58.614200] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T17:19:58.616909] [INFO ] [REMOTE ] ARW: Full fetch complete (48002 records). [2025-10-06T17:19:58.617026] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-06T17:19:59.012615] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-06T17:19:59.012800] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-06T17:19:59.013364] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-06T17:19:59.013421] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-06T17:19:59.014557] [DEBUG] [LOCAL ] ARW: Trimmed 48002 records to 32957 (keeping 200 days of data) [2025-10-06T17:19:59.064382] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-06T17:19:59.212331] [DEBUG] [LOCAL ] ARW: Primary data saved (32957 records). [2025-10-06T17:19:59.212505] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-06T17:19:59.212595] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARW took 30.1s. Estimated remaining: 4h 54m 55s. Rate: 7.5 symbols/min [2025-10-06T17:19:59.379329] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:19:59.432907] [DEBUG] [LOCAL ] ASAN: Loaded 53500 existing records from primary storage. [2025-10-06T17:19:59.433334] [INFO ] [MAIN ] ASAN: Loaded 53500 existing records. [2025-10-06T17:19:59.613256] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:19:59.613557] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-06T17:19:59.613611] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-06T17:19:59.613891] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-06T17:19:59.613950] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-06T17:19:59.830739] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-06T17:20:00.016421] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:20:00.025600] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-06T17:20:00.028923] [INFO ] [REMOTE ] ARR: Full fetch complete (75256 records). [2025-10-06T17:20:00.029072] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-06T17:20:00.267494] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T17:20:00.301363] [INFO ] [REMOTE ] ASA: Full fetch complete (19126 records). [2025-10-06T17:20:00.321784] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-06T17:20:00.642997] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-06T17:20:00.743691] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-06T17:20:00.756026] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-06T17:20:00.786769] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-06T17:20:00.803030] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-06T17:20:00.898707] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-06T17:20:00.889813] [DEBUG] [LOCAL ] ARR: Trimmed 75256 records to 52043 (keeping 200 days of data) [2025-10-06T17:20:00.899101] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-06T17:20:00.899349] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-06T17:20:00.899427] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-06T17:20:00.900371] [DEBUG] [LOCAL ] ASA: Trimmed 19126 records to 14356 (keeping 200 days of data) [2025-10-06T17:20:01.110673] [DEBUG] [LOCAL ] ASA: Primary data saved (14356 records). [2025-10-06T17:20:01.110931] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-06T17:20:01.111052] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ASA took 23.5s. Estimated remaining: 4h 53m 18s. Rate: 7.6 symbols/min [2025-10-06T17:20:01.384941] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:20:01.540226] [DEBUG] [LOCAL ] ASB: Loaded 50265 existing records from primary storage. [2025-10-06T17:20:01.540365] [DEBUG] [LOCAL ] ARR: Primary data saved (52043 records). [2025-10-06T17:20:01.540938] [INFO ] [MAIN ] ASB: Loaded 50265 existing records. [2025-10-06T17:20:01.574006] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-06T17:20:01.613841] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. ARR took 52.5s. Estimated remaining: 4h 51m 22s. Rate: 7.6 symbols/min [2025-10-06T17:20:01.842018] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:20:01.863282] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-06T17:20:01.916366] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:20:01.912785] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-06T17:20:01.917392] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-06T17:20:01.917555] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-06T17:20:02.000398] [DEBUG] [LOCAL ] ASBA: Loaded 3492 existing records from primary storage. [2025-10-06T17:20:02.016918] [INFO ] [MAIN ] ASBA: Loaded 3492 existing records. [2025-10-06T17:20:02.483919] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:20:02.516572] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-06T17:20:02.527956] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-06T17:20:02.541665] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-06T17:20:02.541829] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-06T17:20:02.536238] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-06T17:20:02.660021] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:20:02.665517] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-06T17:20:02.680283] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-06T17:20:03.075163] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:20:03.075579] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-06T17:20:03.670465] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-10-06T17:20:03.828615] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-06T17:20:03.829529] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-06T17:20:04.216314] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T17:20:04.608666] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-06T17:20:04.625467] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-06T17:20:05.331738] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T17:20:05.425517] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-06T17:20:06.225492] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T17:20:06.225584] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-06T17:20:06.847046] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T17:20:07.025505] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-06T17:20:07.217712] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T17:20:07.825556] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-06T17:20:08.220309] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T17:20:08.625529] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-06T17:20:09.337614] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T17:20:09.425547] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-06T17:20:10.225579] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-06T17:20:10.295300] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T17:20:10.804229] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T17:20:11.025562] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-06T17:20:11.255698] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T17:20:11.825710] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-06T17:20:12.400485] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T17:20:12.625528] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-06T17:20:13.024820] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-06T17:20:13.425534] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-06T17:20:14.230732] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-06T17:20:14.257144] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T17:20:15.025517] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-06T17:20:15.263339] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T17:20:15.776152] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T17:20:15.825543] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-06T17:20:15.939763] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-06T17:20:16.625607] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-06T17:20:17.425531] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-06T17:20:17.568881] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T17:20:18.005860] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-06T17:20:18.007450] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T17:20:18.225547] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-06T17:20:19.025558] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-06T17:20:19.493444] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-06T17:20:19.825542] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-06T17:20:20.300465] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-06T17:20:20.625592] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-06T17:20:21.192840] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-06T17:20:21.425593] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-06T17:20:21.480274] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-06T17:20:21.483611] [INFO ] [REMOTE ] AS: Full fetch complete (76567 records). [2025-10-06T17:20:21.483803] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-06T17:20:21.881042] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-06T17:20:21.881141] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-06T17:20:21.881997] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-06T17:20:21.882076] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-06T17:20:21.883588] [DEBUG] [LOCAL ] AS: Trimmed 76567 records to 53091 (keeping 200 days of data) [2025-10-06T17:20:22.062051] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T17:20:22.196439] [DEBUG] [LOCAL ] AS: Primary data saved (53091 records). [2025-10-06T17:20:22.196614] [INFO ] [MAIN ] AS: Full history saved. [2025-10-06T17:20:22.196728] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. AS took 50.2s. Estimated remaining: 4h 54m 18s. Rate: 7.5 symbols/min [2025-10-06T17:20:22.230739] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-06T17:20:22.371636] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:20:22.410381] [DEBUG] [LOCAL ] ASC: Loaded 37981 existing records from primary storage. [2025-10-06T17:20:22.410804] [INFO ] [MAIN ] ASC: Loaded 37981 existing records. [2025-10-06T17:20:22.614878] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:20:22.615269] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-06T17:20:22.615351] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-06T17:20:22.615811] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-06T17:20:22.615870] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-06T17:20:22.904778] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T17:20:22.981224] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:20:23.025498] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-06T17:20:23.825539] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-06T17:20:24.345116] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T17:20:24.625556] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-06T17:20:25.425555] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-06T17:20:25.753980] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-06T17:20:25.819623] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T17:20:26.225528] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-06T17:20:27.025176] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T17:20:27.035517] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-06T17:20:27.825484] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-06T17:20:28.197308] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T17:20:28.251488] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-06T17:20:28.625551] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-06T17:20:29.425613] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-06T17:20:29.472478] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T17:20:29.722281] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T17:20:30.225561] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-06T17:20:30.867780] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T17:20:30.868681] [INFO ] [REMOTE ] ASBA: Full fetch complete (5239 records). [2025-10-06T17:20:30.868753] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-06T17:20:31.026733] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-06T17:20:31.146213] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T17:20:31.282490] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-06T17:20:31.282581] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-06T17:20:31.282748] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-06T17:20:31.282828] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-06T17:20:31.283202] [DEBUG] [LOCAL ] ASBA: Trimmed 5239 records to 3477 (keeping 200 days of data) [2025-10-06T17:20:31.305722] [DEBUG] [LOCAL ] ASBA: Primary data saved (3477 records). [2025-10-06T17:20:31.305907] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-06T17:20:31.306004] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASBA took 29.7s. Estimated remaining: 4h 54m 27s. Rate: 7.5 symbols/min [2025-10-06T17:20:31.473384] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:20:31.494326] [DEBUG] [LOCAL ] ASG: Loaded 20131 existing records from primary storage. [2025-10-06T17:20:31.494610] [INFO ] [MAIN ] ASG: Loaded 20131 existing records. [2025-10-06T17:20:31.669771] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:20:31.669996] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-06T17:20:31.670042] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-06T17:20:31.670260] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-06T17:20:31.670318] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-06T17:20:31.834574] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-06T17:20:32.039965] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:20:32.566435] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-06T17:20:32.625545] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-06T17:20:33.425578] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-06T17:20:33.662451] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-06T17:20:33.739905] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T17:20:34.225553] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-06T17:20:35.025539] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-06T17:20:35.318362] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T17:20:35.801536] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T17:20:35.805008] [INFO ] [REMOTE ] ASB: Full fetch complete (71713 records). [2025-10-06T17:20:35.805179] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-06T17:20:35.836254] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-06T17:20:36.199683] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-06T17:20:36.199798] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-06T17:20:36.200554] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-06T17:20:36.200599] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-06T17:20:36.202135] [DEBUG] [LOCAL ] ASB: Trimmed 71713 records to 49543 (keeping 200 days of data) [2025-10-06T17:20:36.507213] [DEBUG] [LOCAL ] ASB: Primary data saved (49543 records). [2025-10-06T17:20:36.507374] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-06T17:20:36.507508] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASB took 35.4s. Estimated remaining: 4h 53m 39s. Rate: 7.5 symbols/min [2025-10-06T17:20:36.629591] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-06T17:20:36.680159] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:20:36.706440] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T17:20:36.734145] [DEBUG] [LOCAL ] ASGI: Loaded 23076 existing records from primary storage. [2025-10-06T17:20:36.734455] [INFO ] [MAIN ] ASGI: Loaded 23076 existing records. [2025-10-06T17:20:36.915571] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:20:36.916505] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-06T17:20:36.916570] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-06T17:20:36.917029] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-06T17:20:36.917126] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-06T17:20:37.268892] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:20:37.425581] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-06T17:20:37.630901] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-06T17:20:37.634673] [INFO ] [REMOTE ] ASAN: Full fetch complete (76529 records). [2025-10-06T17:20:37.634868] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-06T17:20:38.019307] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T17:20:38.088986] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-06T17:20:38.089106] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-06T17:20:38.089958] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-06T17:20:38.090025] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-06T17:20:38.091593] [DEBUG] [LOCAL ] ASAN: Trimmed 76529 records to 52722 (keeping 200 days of data) [2025-10-06T17:20:38.258201] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-06T17:20:38.407844] [DEBUG] [LOCAL ] ASAN: Primary data saved (52722 records). [2025-10-06T17:20:38.408049] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-06T17:20:38.408162] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASAN took 39.2s. Estimated remaining: 4h 52m 5s. Rate: 7.6 symbols/min [2025-10-06T17:20:38.599962] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:20:38.624312] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-06T17:20:38.665136] [DEBUG] [LOCAL ] ASGN: Loaded 36722 existing records from primary storage. [2025-10-06T17:20:38.665500] [INFO ] [MAIN ] ASGN: Loaded 36722 existing records. [2025-10-06T17:20:38.839264] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:20:38.839572] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-06T17:20:38.839619] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-06T17:20:38.840023] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-06T17:20:38.840082] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-06T17:20:39.035987] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-06T17:20:39.195886] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:20:39.413883] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T17:20:39.825582] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-06T17:20:40.598198] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T17:20:40.625470] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-06T17:20:40.656801] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T17:20:41.425588] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-06T17:20:41.790948] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T17:20:42.225537] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-06T17:20:42.801345] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T17:20:43.025577] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-06T17:20:43.555936] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T17:20:43.558339] [INFO ] [REMOTE ] ASC: Full fetch complete (56502 records). [2025-10-06T17:20:43.558481] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-06T17:20:43.835291] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-06T17:20:43.937619] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-06T17:20:43.937746] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-06T17:20:43.938371] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-06T17:20:43.938413] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-06T17:20:43.939606] [DEBUG] [LOCAL ] ASC: Trimmed 56502 records to 37386 (keeping 200 days of data) [2025-10-06T17:20:44.163919] [DEBUG] [LOCAL ] ASC: Primary data saved (37386 records). [2025-10-06T17:20:44.164155] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-06T17:20:44.164253] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASC took 22.0s. Estimated remaining: 4h 51m 27s. Rate: 7.6 symbols/min [2025-10-06T17:20:44.402718] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T17:20:44.625593] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-06T17:20:45.140830] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T17:20:45.425542] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-06T17:20:45.775106] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-06T17:20:46.225620] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-06T17:20:46.437990] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T17:20:47.025541] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-06T17:20:47.242119] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T17:20:47.825621] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-06T17:20:48.437036] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T17:20:48.625550] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-06T17:20:48.908224] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T17:20:49.425585] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-06T17:20:49.894232] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-06T17:20:50.225589] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-06T17:20:50.625701] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T17:20:51.025543] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-06T17:20:51.755270] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T17:20:51.825475] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-06T17:20:52.054595] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T17:20:52.625555] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-06T17:20:53.082130] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T17:20:53.425628] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-06T17:20:53.468805] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-06T17:20:54.225606] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-06T17:20:54.917982] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-06T17:20:55.025608] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-06T17:20:55.310528] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T17:20:55.825488] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-06T17:20:56.293294] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-06T17:20:56.520440] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-06T17:20:56.625551] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-06T17:20:57.425551] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-06T17:20:58.074763] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T17:20:58.225524] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-06T17:20:58.338741] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T17:20:59.025577] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-06T17:20:59.208989] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-06T17:20:59.825619] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-06T17:21:00.152813] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T17:21:00.625600] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-06T17:21:01.425551] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-06T17:21:01.679613] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T17:21:01.938238] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T17:21:02.225560] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-06T17:21:02.608740] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-06T17:21:03.025575] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-06T17:21:03.642306] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T17:21:03.825495] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-06T17:21:03.896889] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T17:21:03.898437] [INFO ] [REMOTE ] ASG: Full fetch complete (31174 records). [2025-10-06T17:21:03.898541] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-06T17:21:04.268073] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-06T17:21:04.268165] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-06T17:21:04.268661] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-06T17:21:04.268725] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-06T17:21:04.269461] [DEBUG] [LOCAL ] ASG: Trimmed 31174 records to 19758 (keeping 200 days of data) [2025-10-06T17:21:04.379126] [DEBUG] [LOCAL ] ASG: Primary data saved (19758 records). [2025-10-06T17:21:04.379298] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-06T17:21:04.379387] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASG took 33.1s. Estimated remaining: 4h 54m 12s. Rate: 7.5 symbols/min [2025-10-06T17:21:04.625567] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-06T17:21:05.269600] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T17:21:05.272388] [INFO ] [REMOTE ] ASGN: Full fetch complete (52524 records). [2025-10-06T17:21:05.272545] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-06T17:21:05.679972] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-06T17:21:05.680086] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-06T17:21:05.680741] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-06T17:21:05.680867] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-06T17:21:05.682223] [DEBUG] [LOCAL ] ASGN: Trimmed 52524 records to 36354 (keeping 200 days of data) [2025-10-06T17:21:05.913567] [DEBUG] [LOCAL ] ASGN: Primary data saved (36354 records). [2025-10-06T17:21:05.914447] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-06T17:21:05.914686] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-06T17:21:05.922503] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASGN took 27.5s. Estimated remaining: 4h 52m 34s. Rate: 7.6 symbols/min [2025-10-06T17:21:05.923876] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-06T17:21:07.099286] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T17:21:07.101066] [INFO ] [REMOTE ] ASGI: Full fetch complete (33589 records). [2025-10-06T17:21:07.101160] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-06T17:21:07.498353] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-06T17:21:07.498486] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-06T17:21:07.499010] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-06T17:21:07.499080] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-06T17:21:07.500208] [DEBUG] [LOCAL ] ASGI: Trimmed 33589 records to 22716 (keeping 200 days of data) [2025-10-06T17:21:07.656173] [DEBUG] [LOCAL ] ASGI: Primary data saved (22716 records). [2025-10-06T17:21:07.656373] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-06T17:21:07.656500] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGI took 31.1s. Estimated remaining: 4h 51m 0s. Rate: 7.6 symbols/min [2025-10-06T17:21:08.250555] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:21:08.291252] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:21:08.316548] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:21:08.321907] [DEBUG] [LOCAL ] ASIX: No existing data file found in primary storage. [2025-10-06T17:21:08.344516] [WARN ] [MAIN ] ASIX: No existing data found, performing full refresh instead. [2025-10-06T17:21:08.351971] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-06T17:21:08.382619] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:21:08.378022] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-06T17:21:08.384819] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-10-06T17:21:08.384881] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-06T17:21:08.517131] [DEBUG] [LOCAL ] ASR: Loaded 9420 existing records from primary storage. [2025-10-06T17:21:08.528336] [INFO ] [MAIN ] ASR: Loaded 9420 existing records. [2025-10-06T17:21:08.682549] [DEBUG] [LOCAL ] ASH: Loaded 38329 existing records from primary storage. [2025-10-06T17:21:08.761697] [INFO ] [MAIN ] ASH: Loaded 38329 existing records. [2025-10-06T17:21:08.875839] [DEBUG] [LOCAL ] ASPN: Loaded 50328 existing records from primary storage. [2025-10-06T17:21:08.912251] [INFO ] [MAIN ] ASPN: Loaded 50328 existing records. [2025-10-06T17:21:09.151002] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:21:09.193581] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-06T17:21:09.240632] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:21:09.224595] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-06T17:21:09.256612] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-06T17:21:09.281795] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-06T17:21:09.297970] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-06T17:21:09.350802] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:21:09.464052] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-06T17:21:09.463963] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:21:09.488846] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-06T17:21:09.496221] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-06T17:21:09.483466] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-06T17:21:09.520877] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-06T17:21:09.521014] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-06T17:21:09.545435] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-06T17:21:09.568222] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-06T17:21:10.459143] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:21:10.551812] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-06T17:21:10.674815] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:21:10.683378] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:21:10.684180] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-06T17:21:10.695404] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-06T17:21:10.699448] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T17:21:10.703549] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-06T17:21:11.522296] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T17:21:11.524609] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-06T17:21:11.722772] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T17:21:11.726965] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-06T17:21:12.069785] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T17:21:12.077018] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-06T17:21:12.256445] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T17:21:12.579628] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T17:21:12.603392] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T17:21:12.625475] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-06T17:21:13.221044] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T17:21:13.425549] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-06T17:21:13.684062] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T17:21:14.225546] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-06T17:21:14.256049] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T17:21:15.025591] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-06T17:21:15.706676] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T17:21:15.825544] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-06T17:21:16.625527] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-06T17:21:16.712133] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T17:21:17.337197] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T17:21:17.425524] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-06T17:21:17.577150] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-06T17:21:18.225559] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-06T17:21:18.930182] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T17:21:19.025499] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-06T17:21:19.359101] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T17:21:19.825567] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-06T17:21:20.625493] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-06T17:21:20.811167] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T17:21:21.420046] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T17:21:21.428272] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-06T17:21:21.449275] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T17:21:22.225499] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-06T17:21:22.617492] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T17:21:23.025542] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-06T17:21:23.753748] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T17:21:23.830253] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-06T17:21:23.835142] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-06T17:21:24.510172] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-06T17:21:24.625529] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-06T17:21:25.425442] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-06T17:21:25.822985] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-06T17:21:26.225538] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-06T17:21:26.912981] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T17:21:27.026611] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-06T17:21:27.029873] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T17:21:27.825532] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-06T17:21:28.486483] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T17:21:28.618407] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-06T17:21:28.625459] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-06T17:21:29.425583] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-06T17:21:29.457122] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-06T17:21:30.225567] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-06T17:21:30.314351] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T17:21:31.029750] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-06T17:21:31.032795] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-06T17:21:31.825545] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-06T17:21:32.239567] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T17:21:32.625547] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-06T17:21:33.264573] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T17:21:33.265575] [INFO ] [REMOTE ] ASR: Full fetch complete (12443 records). [2025-10-06T17:21:33.265679] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-06T17:21:33.430136] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-06T17:21:33.567854] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T17:21:33.685585] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-06T17:21:33.685717] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-06T17:21:33.686044] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-06T17:21:33.686088] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-06T17:21:33.686737] [DEBUG] [LOCAL ] ASR: Trimmed 12443 records to 9308 (keeping 200 days of data) [2025-10-06T17:21:33.749250] [DEBUG] [LOCAL ] ASR: Primary data saved (9308 records). [2025-10-06T17:21:33.749479] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-06T17:21:33.749601] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 26.1s. Estimated remaining: 4h 55m 2s. Rate: 7.5 symbols/min [2025-10-06T17:21:33.922052] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:21:33.975398] [DEBUG] [LOCAL ] ASX: Loaded 53615 existing records from primary storage. [2025-10-06T17:21:33.975852] [INFO ] [MAIN ] ASX: Loaded 53615 existing records. [2025-10-06T17:21:34.151633] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:21:34.151985] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-06T17:21:34.152035] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-06T17:21:34.152461] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-06T17:21:34.152520] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-06T17:21:34.230686] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-06T17:21:34.510971] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:21:35.025588] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-06T17:21:35.093768] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T17:21:35.439190] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T17:21:35.441142] [INFO ] [REMOTE ] ASIX: Full fetch complete (30412 records). [2025-10-06T17:21:35.441253] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-06T17:21:35.820612] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-06T17:21:35.820739] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-06T17:21:35.821185] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-06T17:21:35.821229] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-06T17:21:35.822122] [DEBUG] [LOCAL ] ASIX: Trimmed 30412 records to 22788 (keeping 200 days of data) [2025-10-06T17:21:35.873417] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-06T17:21:35.962414] [DEBUG] [LOCAL ] ASIX: Primary data saved (22788 records). [2025-10-06T17:21:35.962590] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-06T17:21:35.962693] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 28.3s. Estimated remaining: 4h 53m 35s. Rate: 7.5 symbols/min [2025-10-06T17:21:36.132169] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:21:36.174922] [DEBUG] [LOCAL ] ATEN: Loaded 39883 existing records from primary storage. [2025-10-06T17:21:36.175328] [INFO ] [MAIN ] ATEN: Loaded 39883 existing records. [2025-10-06T17:21:36.352339] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:21:36.352584] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-06T17:21:36.352630] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-06T17:21:36.353020] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-06T17:21:36.353078] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-06T17:21:36.631862] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-06T17:21:36.715786] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:21:36.892693] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T17:21:36.895426] [INFO ] [REMOTE ] ASH: Full fetch complete (55173 records). [2025-10-06T17:21:36.922941] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-06T17:21:36.934280] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T17:21:37.353628] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-06T17:21:37.353775] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-06T17:21:37.354394] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-06T17:21:37.354457] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-06T17:21:37.355632] [DEBUG] [LOCAL ] ASH: Trimmed 55173 records to 37623 (keeping 200 days of data) [2025-10-06T17:21:37.443756] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-06T17:21:37.589849] [DEBUG] [LOCAL ] ASH: Primary data saved (37623 records). [2025-10-06T17:21:37.590047] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-06T17:21:37.590141] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASH took 29.9s. Estimated remaining: 4h 52m 1s. Rate: 7.6 symbols/min [2025-10-06T17:21:37.767039] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:21:37.800450] [DEBUG] [LOCAL ] ATGE: Loaded 31813 existing records from primary storage. [2025-10-06T17:21:37.800815] [INFO ] [MAIN ] ATGE: Loaded 31813 existing records. [2025-10-06T17:21:37.990922] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:21:37.991201] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-06T17:21:37.991257] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-06T17:21:37.991700] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-06T17:21:37.991760] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-06T17:21:38.226703] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-06T17:21:38.405442] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:21:38.434553] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T17:21:39.013447] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T17:21:39.025474] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-06T17:21:39.825547] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-06T17:21:40.073733] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-06T17:21:40.450319] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T17:21:40.625540] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-06T17:21:40.907363] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-06T17:21:41.425600] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-06T17:21:42.225529] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-06T17:21:42.323867] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T17:21:42.775035] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-06T17:21:43.025561] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-06T17:21:43.825590] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-06T17:21:44.049636] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T17:21:44.625567] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-06T17:21:44.931675] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T17:21:45.229099] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T17:21:45.425601] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-06T17:21:46.068602] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T17:21:46.225636] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-06T17:21:47.025626] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-06T17:21:47.376368] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T17:21:47.671795] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T17:21:47.825529] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-06T17:21:48.625559] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-06T17:21:48.800625] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T17:21:49.425593] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-06T17:21:49.804611] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-06T17:21:50.225504] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-06T17:21:50.338638] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T17:21:51.025549] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-06T17:21:51.167899] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T17:21:51.423401] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T17:21:51.825552] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-06T17:21:52.529512] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T17:21:52.625608] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-06T17:21:53.425636] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-06T17:21:53.714444] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T17:21:54.225527] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-06T17:21:54.255699] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T17:21:54.920282] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T17:21:55.025559] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-06T17:21:55.642138] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T17:21:55.825586] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-06T17:21:56.474148] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T17:21:56.625713] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-06T17:21:57.425613] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-06T17:21:57.474754] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-06T17:21:57.478332] [INFO ] [REMOTE ] ASPN: Full fetch complete (72366 records). [2025-10-06T17:21:57.478515] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-06T17:21:57.909216] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-06T17:21:57.909337] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-06T17:21:57.910907] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-06T17:21:57.910988] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-06T17:21:57.913716] [DEBUG] [LOCAL ] ASPN: Trimmed 72366 records to 49662 (keeping 200 days of data) [2025-10-06T17:21:58.225742] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-06T17:21:58.232493] [DEBUG] [LOCAL ] ASPN: Primary data saved (49662 records). [2025-10-06T17:21:58.232929] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-06T17:21:58.233062] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 50.6s. Estimated remaining: 4h 54m 44s. Rate: 7.5 symbols/min [2025-10-06T17:21:58.432632] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:21:58.472592] [DEBUG] [LOCAL ] ATHM: Loaded 32487 existing records from primary storage. [2025-10-06T17:21:58.473209] [INFO ] [MAIN ] ATHM: Loaded 32487 existing records. [2025-10-06T17:21:58.710241] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:21:58.724215] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-06T17:21:58.724942] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-06T17:21:58.727257] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-06T17:21:58.727315] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-06T17:21:58.738746] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-06T17:21:59.027417] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-06T17:21:59.034890] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T17:21:59.156436] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:21:59.581506] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T17:21:59.825583] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-06T17:22:00.625573] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-06T17:22:00.802493] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T17:22:01.425558] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-06T17:22:01.869267] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-06T17:22:02.225542] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-06T17:22:02.278486] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T17:22:03.025575] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-06T17:22:03.179528] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T17:22:03.625839] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T17:22:03.825601] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-06T17:22:04.401805] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T17:22:04.625728] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-06T17:22:05.292085] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T17:22:05.425538] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-06T17:22:05.709785] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T17:22:06.225606] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-06T17:22:06.842256] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T17:22:07.025600] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-06T17:22:07.649032] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T17:22:07.825553] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-06T17:22:08.330882] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T17:22:08.333303] [INFO ] [REMOTE ] ATEN: Full fetch complete (57259 records). [2025-10-06T17:22:08.333460] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-06T17:22:08.632170] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-06T17:22:08.770905] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-06T17:22:08.771232] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-06T17:22:08.771905] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-06T17:22:08.771969] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-06T17:22:08.773316] [DEBUG] [LOCAL ] ATEN: Trimmed 57259 records to 39011 (keeping 200 days of data) [2025-10-06T17:22:09.020575] [DEBUG] [LOCAL ] ATEN: Primary data saved (39011 records). [2025-10-06T17:22:09.020785] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-06T17:22:09.021749] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ATEN took 33.1s. Estimated remaining: 4h 55m 14s. Rate: 7.5 symbols/min [2025-10-06T17:22:09.195089] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:22:09.230873] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T17:22:09.243580] [DEBUG] [LOCAL ] ATHS: Loaded 7008 existing records from primary storage. [2025-10-06T17:22:09.243891] [INFO ] [MAIN ] ATHS: Loaded 7008 existing records. [2025-10-06T17:22:09.418365] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:22:09.418670] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-06T17:22:09.418733] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-06T17:22:09.418933] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-06T17:22:09.418990] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-06T17:22:09.431469] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-06T17:22:09.783792] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:22:10.225586] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-06T17:22:10.339767] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T17:22:10.343146] [INFO ] [REMOTE ] ASX: Full fetch complete (76589 records). [2025-10-06T17:22:10.343362] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-06T17:22:10.764781] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-06T17:22:10.764914] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-06T17:22:10.765960] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-06T17:22:10.766055] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-06T17:22:10.768358] [DEBUG] [LOCAL ] ASX: Trimmed 76589 records to 52844 (keeping 200 days of data) [2025-10-06T17:22:11.031530] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-06T17:22:11.054041] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T17:22:11.148420] [DEBUG] [LOCAL ] ASX: Primary data saved (52844 records). [2025-10-06T17:22:11.148614] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-06T17:22:11.148752] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ASX took 37.4s. Estimated remaining: 4h 53m 47s. Rate: 7.5 symbols/min [2025-10-06T17:22:11.330920] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:22:11.331542] [DEBUG] [LOCAL ] ATI: No existing data file found in primary storage. [2025-10-06T17:22:11.331743] [WARN ] [MAIN ] ATI: No existing data found, performing full refresh instead. [2025-10-06T17:22:11.338611] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-06T17:22:11.346322] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-06T17:22:11.348564] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-10-06T17:22:11.348686] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-06T17:22:11.355180] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T17:22:11.766024] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:22:11.825510] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-06T17:22:12.013842] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T17:22:12.625540] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-06T17:22:13.425507] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-06T17:22:13.614290] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T17:22:13.776808] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T17:22:14.225559] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-06T17:22:14.451156] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T17:22:14.453498] [INFO ] [REMOTE ] ATGE: Full fetch complete (46285 records). [2025-10-06T17:22:14.453633] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-06T17:22:14.970612] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-06T17:22:14.970772] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-06T17:22:14.971432] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-06T17:22:14.971499] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-06T17:22:14.972953] [DEBUG] [LOCAL ] ATGE: Trimmed 46285 records to 31195 (keeping 200 days of data) [2025-10-06T17:22:15.030909] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-06T17:22:15.196104] [DEBUG] [LOCAL ] ATGE: Primary data saved (31195 records). [2025-10-06T17:22:15.196319] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-06T17:22:15.196436] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATGE took 37.6s. Estimated remaining: 4h 52m 47s. Rate: 7.5 symbols/min [2025-10-06T17:22:15.385396] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:22:15.420478] [DEBUG] [LOCAL ] ATKR: Loaded 36223 existing records from primary storage. [2025-10-06T17:22:15.420939] [INFO ] [MAIN ] ATKR: Loaded 36223 existing records. [2025-10-06T17:22:15.603054] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:22:15.603451] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-06T17:22:15.603591] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-06T17:22:15.610753] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-06T17:22:15.616019] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-06T17:22:15.704628] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T17:22:15.830718] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-06T17:22:16.052848] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:22:16.516480] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-06T17:22:16.616853] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T17:22:16.628291] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-06T17:22:17.425535] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-06T17:22:17.726101] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T17:22:18.225576] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-06T17:22:19.025511] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-06T17:22:19.065776] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T17:22:19.585997] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-06T17:22:19.821892] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T17:22:19.829703] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-06T17:22:20.628390] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-06T17:22:20.630956] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-06T17:22:21.425607] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-06T17:22:22.140067] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T17:22:22.225529] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-06T17:22:23.025539] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-06T17:22:23.199315] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T17:22:23.780419] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T17:22:23.825530] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-06T17:22:23.913893] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T17:22:24.625599] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-06T17:22:25.252951] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T17:22:25.343068] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-06T17:22:25.425561] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-06T17:22:26.225516] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-06T17:22:26.627118] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T17:22:27.025905] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-06T17:22:27.592975] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T17:22:27.759540] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T17:22:27.761667] [INFO ] [REMOTE ] ATHM: Full fetch complete (50835 records). [2025-10-06T17:22:27.761809] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-06T17:22:27.831164] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-06T17:22:28.190697] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-06T17:22:28.190825] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-06T17:22:28.191427] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-06T17:22:28.191472] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-06T17:22:28.192916] [DEBUG] [LOCAL ] ATHM: Trimmed 50835 records to 31969 (keeping 200 days of data) [2025-10-06T17:22:28.380295] [DEBUG] [LOCAL ] ATHM: Primary data saved (31969 records). [2025-10-06T17:22:28.380483] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-06T17:22:28.380607] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHM took 30.1s. Estimated remaining: 4h 53m 47s. Rate: 7.5 symbols/min [2025-10-06T17:22:28.559306] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:22:28.601158] [DEBUG] [LOCAL ] ATMU: Loaded 39950 existing records from primary storage. [2025-10-06T17:22:28.601551] [INFO ] [MAIN ] ATMU: Loaded 39950 existing records. [2025-10-06T17:22:28.634764] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-06T17:22:28.789450] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:22:28.789682] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-06T17:22:28.789749] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-06T17:22:28.790176] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-06T17:22:28.790234] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-06T17:22:29.157355] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:22:29.407521] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-06T17:22:29.434754] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-06T17:22:29.440826] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T17:22:30.225708] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-06T17:22:30.939543] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T17:22:30.995684] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T17:22:31.025498] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-06T17:22:31.825547] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-06T17:22:32.498494] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-06T17:22:32.625468] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-06T17:22:32.785632] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T17:22:33.347629] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T17:22:33.425482] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-06T17:22:34.225586] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-06T17:22:35.025563] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-06T17:22:35.125147] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T17:22:35.825510] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-06T17:22:35.920519] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T17:22:36.486828] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T17:22:36.625542] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-06T17:22:37.196583] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T17:22:37.318877] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-06T17:22:37.425551] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-06T17:22:38.225557] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-06T17:22:38.782065] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T17:22:38.783012] [INFO ] [REMOTE ] ATHS: Full fetch complete (9878 records). [2025-10-06T17:22:38.783088] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-06T17:22:38.900004] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T17:22:38.929869] [INFO ] [REMOTE ] ATI: Full fetch complete (73958 records). [2025-10-06T17:22:38.955948] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-06T17:22:39.029544] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-06T17:22:39.447368] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-06T17:22:39.480080] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-06T17:22:39.497510] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-06T17:22:39.508581] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-06T17:22:39.519857] [DEBUG] [LOCAL ] ATHS: Trimmed 9878 records to 6841 (keeping 200 days of data) [2025-10-06T17:22:39.654620] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-06T17:22:39.655865] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-06T17:22:39.657910] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-06T17:22:39.659969] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-06T17:22:39.666138] [DEBUG] [LOCAL ] ATHS: Primary data saved (6841 records). [2025-10-06T17:22:39.666314] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-06T17:22:39.666499] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHS took 30.6s. Estimated remaining: 4h 54m 22s. Rate: 7.5 symbols/min [2025-10-06T17:22:39.738051] [DEBUG] [LOCAL ] ATI: Trimmed 73958 records to 51479 (keeping 200 days of data) [2025-10-06T17:22:39.836389] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-06T17:22:39.948312] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:22:40.117617] [DEBUG] [LOCAL ] ATO: Loaded 42462 existing records from primary storage. [2025-10-06T17:22:40.121951] [INFO ] [MAIN ] ATO: Loaded 42462 existing records. [2025-10-06T17:22:40.315899] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:22:40.316676] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-06T17:22:40.318760] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-06T17:22:40.347837] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-06T17:22:40.353584] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-06T17:22:40.700942] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T17:22:40.757743] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-06T17:22:40.803456] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:22:40.806753] [DEBUG] [LOCAL ] ATI: Primary data saved (51479 records). [2025-10-06T17:22:40.806846] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-06T17:22:40.806911] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATI took 29.7s. Estimated remaining: 4h 52m 45s. Rate: 7.5 symbols/min [2025-10-06T17:22:40.978187] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:22:40.978399] [DEBUG] [LOCAL ] ATR: No existing data file found in primary storage. [2025-10-06T17:22:40.978454] [WARN ] [MAIN ] ATR: No existing data found, performing full refresh instead. [2025-10-06T17:22:40.978570] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-06T17:22:40.978611] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-06T17:22:40.978680] [DEBUG] [LOCAL ] ATR: No primary data file found to delete. [2025-10-06T17:22:40.978744] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-06T17:22:41.342131] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:22:41.364426] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T17:22:41.425533] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-06T17:22:42.203040] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T17:22:42.225528] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-06T17:22:42.473437] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T17:22:43.025566] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-06T17:22:43.357862] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T17:22:43.825538] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-06T17:22:44.205838] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T17:22:44.625556] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-06T17:22:45.138484] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T17:22:45.425608] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-06T17:22:46.174486] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T17:22:46.225586] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-06T17:22:47.025724] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-06T17:22:47.076258] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T17:22:47.310560] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T17:22:47.825566] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-06T17:22:48.284826] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T17:22:48.625561] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-06T17:22:49.068374] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-06T17:22:49.425560] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-06T17:22:49.894569] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T17:22:50.225586] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-06T17:22:51.025583] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-06T17:22:51.066052] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T17:22:51.139927] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-06T17:22:51.825577] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-06T17:22:52.472791] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T17:22:52.625575] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-06T17:22:53.425550] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-06T17:22:54.225557] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-06T17:23:05.882264] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (12.46 seconds). [2025-10-06T17:23:05.913261] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-06T17:23:05.916592] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (13.29 seconds). [2025-10-06T17:23:05.925247] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-06T17:23:06.456889] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (12.23 seconds). [2025-10-06T17:23:06.463503] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-06T17:23:07.057181] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T17:23:07.065261] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-06T17:23:07.165857] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (15.34 seconds). [2025-10-06T17:23:07.176139] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-06T17:23:07.590925] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T17:23:07.600482] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-06T17:23:07.652378] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T17:23:07.662989] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-06T17:23:08.424580] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-06T17:23:08.434442] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-06T17:23:08.726074] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T17:23:08.735232] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-06T17:23:08.829286] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T17:23:08.841178] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-06T17:23:09.272985] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T17:23:09.289633] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-06T17:23:09.815126] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T17:23:09.822578] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-06T17:23:09.963044] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T17:23:09.971901] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-06T17:23:10.295167] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T17:23:10.304333] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-06T17:23:10.485236] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T17:23:10.496013] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-06T17:23:11.160066] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T17:23:11.167395] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-06T17:23:11.260750] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T17:23:11.270030] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-06T17:23:11.716991] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T17:23:11.720304] [INFO ] [REMOTE ] ATKR: Full fetch complete (53714 records). [2025-10-06T17:23:11.720436] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-06T17:23:12.030137] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T17:23:12.075131] [INFO ] [REMOTE ] ATMU: Full fetch complete (56740 records). [2025-10-06T17:23:12.085723] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-06T17:23:12.284294] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-06T17:23:12.308041] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-06T17:23:12.311871] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T17:23:12.314905] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-06T17:23:12.331965] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-06T17:23:12.332430] [INFO ] [REMOTE ] ATR: Full fetch complete (43757 records). [2025-10-06T17:23:12.343101] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-06T17:23:12.433933] [DEBUG] [LOCAL ] ATKR: Trimmed 53714 records to 35582 (keeping 200 days of data) [2025-10-06T17:23:13.045747] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-06T17:23:13.065949] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-06T17:23:13.067215] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-06T17:23:13.082014] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-06T17:23:13.122496] [DEBUG] [LOCAL ] ATMU: Trimmed 56740 records to 39252 (keeping 200 days of data) [2025-10-06T17:23:13.435922] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-06T17:23:13.437524] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-06T17:23:13.442817] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-06T17:23:13.454295] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-06T17:23:13.459142] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-06T17:23:13.463523] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-06T17:23:13.469248] [DEBUG] [LOCAL ] ATR: Trimmed 43757 records to 30579 (keeping 200 days of data) [2025-10-06T17:23:13.744827] [DEBUG] [LOCAL ] ATKR: Primary data saved (35582 records). [2025-10-06T17:23:13.751099] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-06T17:23:13.755253] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 58.6s. Estimated remaining: 4h 57m 58s. Rate: 7.4 symbols/min [2025-10-06T17:23:13.805495] [DEBUG] [LOCAL ] ATMU: Primary data saved (39252 records). [2025-10-06T17:23:13.831369] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-06T17:23:13.860442] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATMU took 45.5s. Estimated remaining: 4h 56m 8s. Rate: 7.4 symbols/min [2025-10-06T17:23:14.069997] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:23:14.206499] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:23:14.231630] [DEBUG] [LOCAL ] ATS: Loaded 18034 existing records from primary storage. [2025-10-06T17:23:14.233109] [INFO ] [MAIN ] ATS: Loaded 18034 existing records. [2025-10-06T17:23:14.472179] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:23:14.476343] [DEBUG] [LOCAL ] ATR: Primary data saved (30579 records). [2025-10-06T17:23:14.478773] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-06T17:23:14.478462] [DEBUG] [LOCAL ] ATUS: Loaded 49993 existing records from primary storage. [2025-10-06T17:23:14.479000] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-06T17:23:14.479390] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATR took 33.7s. Estimated remaining: 4h 54m 25s. Rate: 7.5 symbols/min [2025-10-06T17:23:14.485572] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-06T17:23:14.485440] [INFO ] [MAIN ] ATUS: Loaded 49993 existing records. [2025-10-06T17:23:14.534164] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-06T17:23:14.588593] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-06T17:23:14.990970] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T17:23:14.977827] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:23:15.028460] [INFO ] [REMOTE ] ATO: Full fetch complete (60560 records). [2025-10-06T17:23:15.073547] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-06T17:23:15.043384] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:23:15.084700] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-06T17:23:15.170675] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-06T17:23:15.236316] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-06T17:23:15.276624] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-06T17:23:15.645944] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:23:15.646098] [DEBUG] [LOCAL ] AU: Loaded 53773 existing records from primary storage. [2025-10-06T17:23:15.673176] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-06T17:23:15.679038] [INFO ] [MAIN ] AU: Loaded 53773 existing records. [2025-10-06T17:23:16.201066] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-06T17:23:16.247294] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-06T17:23:16.260436] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-06T17:23:16.259276] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:23:16.266757] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-06T17:23:16.261316] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-06T17:23:16.272337] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-06T17:23:16.288948] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-06T17:23:16.344317] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-06T17:23:16.396670] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:23:16.402462] [DEBUG] [LOCAL ] ATO: Trimmed 60560 records to 41911 (keeping 200 days of data) [2025-10-06T17:23:16.410784] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-06T17:23:16.893928] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:23:16.896321] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-06T17:23:17.073229] [DEBUG] [LOCAL ] ATO: Primary data saved (41911 records). [2025-10-06T17:23:17.073631] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-06T17:23:17.074763] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATO took 37.4s. Estimated remaining: 4h 53m 8s. Rate: 7.5 symbols/min [2025-10-06T17:23:17.251699] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:23:17.263096] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T17:23:17.267790] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-06T17:23:17.319042] [DEBUG] [LOCAL ] AUB: Loaded 46979 existing records from primary storage. [2025-10-06T17:23:17.319450] [INFO ] [MAIN ] AUB: Loaded 46979 existing records. [2025-10-06T17:23:17.505506] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:23:17.505899] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-06T17:23:17.505950] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-06T17:23:17.506329] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-06T17:23:17.506388] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-06T17:23:17.889957] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:23:17.890479] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-06T17:23:17.921694] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T17:23:17.931811] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-06T17:23:18.267281] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-06T17:23:18.272155] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-06T17:23:18.943887] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-06T17:23:18.955110] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-06T17:23:19.210811] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T17:23:19.214933] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-06T17:23:19.492089] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T17:23:19.500884] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-06T17:23:19.592289] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T17:23:19.603214] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-06T17:23:20.207705] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T17:23:20.214151] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-06T17:23:20.881927] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-06T17:23:20.893508] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-06T17:23:20.940848] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T17:23:20.946493] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-06T17:23:20.992264] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T17:23:21.001414] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-06T17:23:21.047493] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T17:23:21.425566] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-06T17:23:21.696927] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T17:23:22.085199] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T17:23:22.225580] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-06T17:23:22.761048] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-06T17:23:22.847158] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T17:23:23.025586] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-06T17:23:23.825507] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-06T17:23:23.873935] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T17:23:24.625555] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-06T17:23:24.675976] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T17:23:25.425731] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-06T17:23:25.834805] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-06T17:23:26.225537] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-06T17:23:26.310618] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T17:23:27.025521] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-06T17:23:27.095186] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T17:23:27.143230] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T17:23:27.825564] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-06T17:23:28.398528] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T17:23:28.625503] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-06T17:23:28.983510] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T17:23:29.425600] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-06T17:23:30.225519] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-06T17:23:30.478453] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T17:23:30.653571] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-06T17:23:31.025549] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-06T17:23:31.783381] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T17:23:31.825478] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-06T17:23:31.903964] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T17:23:32.625592] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-06T17:23:33.425559] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-06T17:23:33.487310] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T17:23:34.225573] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-06T17:23:34.279225] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T17:23:35.025591] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-06T17:23:35.033170] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T17:23:35.034672] [INFO ] [REMOTE ] ATS: Full fetch complete (25687 records). [2025-10-06T17:23:35.034760] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-06T17:23:35.448830] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-06T17:23:35.448972] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-06T17:23:35.449600] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-06T17:23:35.449876] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-06T17:23:35.451510] [DEBUG] [LOCAL ] ATS: Trimmed 25687 records to 17765 (keeping 200 days of data) [2025-10-06T17:23:35.574144] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-06T17:23:35.609982] [DEBUG] [LOCAL ] ATS: Primary data saved (17765 records). [2025-10-06T17:23:35.610207] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-06T17:23:35.610339] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 21.9s. Estimated remaining: 4h 55m 12s. Rate: 7.4 symbols/min [2025-10-06T17:23:35.825541] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:23:35.825722] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-06T17:23:35.836449] [DEBUG] [LOCAL ] AUNA: Loaded 5004 existing records from primary storage. [2025-10-06T17:23:35.836807] [INFO ] [MAIN ] AUNA: Loaded 5004 existing records. [2025-10-06T17:23:36.044034] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:23:36.044321] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-06T17:23:36.044373] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-06T17:23:36.044705] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-06T17:23:36.044766] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-06T17:23:36.448135] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:23:36.579243] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T17:23:36.625519] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-06T17:23:37.425569] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-06T17:23:37.902883] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-06T17:23:38.156914] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T17:23:38.225636] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-06T17:23:39.025522] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-06T17:23:39.146475] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T17:23:39.825502] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-06T17:23:39.869868] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-06T17:23:40.156053] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-06T17:23:40.625617] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-06T17:23:41.229983] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T17:23:41.234565] [INFO ] [REMOTE ] AUB: Full fetch complete (65802 records). [2025-10-06T17:23:41.234821] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-06T17:23:41.437210] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-06T17:23:41.717162] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-06T17:23:41.717277] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-06T17:23:41.718126] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-06T17:23:41.718193] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-06T17:23:41.720016] [DEBUG] [LOCAL ] AUB: Trimmed 65802 records to 46259 (keeping 200 days of data) [2025-10-06T17:23:42.021725] [DEBUG] [LOCAL ] AUB: Primary data saved (46259 records). [2025-10-06T17:23:42.021900] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-06T17:23:42.022710] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. AUB took 24.9s. Estimated remaining: 4h 54m 43s. Rate: 7.4 symbols/min [2025-10-06T17:23:42.146612] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-06T17:23:42.222243] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:23:42.225516] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-06T17:23:42.270361] [DEBUG] [LOCAL ] AVA: Loaded 39939 existing records from primary storage. [2025-10-06T17:23:42.270849] [INFO ] [MAIN ] AVA: Loaded 39939 existing records. [2025-10-06T17:23:42.481692] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:23:42.482130] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-06T17:23:42.482206] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-06T17:23:42.482488] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-06T17:23:42.482598] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-06T17:23:42.790299] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-06T17:23:42.857493] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-06T17:23:42.945990] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:23:43.025591] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-06T17:23:43.578819] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-06T17:23:43.825532] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-06T17:23:44.226547] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-06T17:23:44.625564] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-06T17:23:45.425541] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-06T17:23:45.783514] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T17:23:45.991506] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-06T17:23:46.225568] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-06T17:23:47.025602] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-06T17:23:47.827321] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-06T17:23:47.835907] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T17:23:48.418716] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T17:23:48.625603] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-06T17:23:49.425500] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-06T17:23:49.973727] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-06T17:23:50.023078] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T17:23:50.027265] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T17:23:50.225549] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-06T17:23:51.025608] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-06T17:23:51.825553] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-06T17:23:52.164252] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-06T17:23:52.168427] [INFO ] [REMOTE ] AU: Full fetch complete (76287 records). [2025-10-06T17:23:52.168629] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-06T17:23:52.621767] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T17:23:52.636913] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-06T17:23:52.676614] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-06T17:23:52.676754] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-06T17:23:52.677823] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-06T17:23:52.678376] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-06T17:23:52.680548] [DEBUG] [LOCAL ] AU: Trimmed 76287 records to 52996 (keeping 200 days of data) [2025-10-06T17:23:53.056579] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T17:23:53.077127] [DEBUG] [LOCAL ] AU: Primary data saved (52996 records). [2025-10-06T17:23:53.077284] [INFO ] [MAIN ] AU: Full history saved. [2025-10-06T17:23:53.077393] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AU took 38.6s. Estimated remaining: 4h 55m 13s. Rate: 7.4 symbols/min [2025-10-06T17:23:53.262861] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:23:53.275464] [DEBUG] [LOCAL ] AVAL: Loaded 8914 existing records from primary storage. [2025-10-06T17:23:53.275800] [INFO ] [MAIN ] AVAL: Loaded 8914 existing records. [2025-10-06T17:23:53.358312] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-06T17:23:53.430737] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-06T17:23:53.473674] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:23:53.474068] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-06T17:23:53.474121] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-06T17:23:53.474300] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-06T17:23:53.474341] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-06T17:23:53.824804] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:23:54.225593] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-06T17:23:55.025549] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-06T17:23:55.145570] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T17:23:55.680633] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T17:23:55.684219] [INFO ] [REMOTE ] ATUS: Full fetch complete (71057 records). [2025-10-06T17:23:55.684332] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-06T17:23:55.830636] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-06T17:23:56.126152] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-06T17:23:56.126275] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-06T17:23:56.127089] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-06T17:23:56.127161] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-06T17:23:56.128763] [DEBUG] [LOCAL ] ATUS: Trimmed 71057 records to 49415 (keeping 200 days of data) [2025-10-06T17:23:56.408561] [DEBUG] [LOCAL ] ATUS: Primary data saved (49415 records). [2025-10-06T17:23:56.408772] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-06T17:23:56.408874] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. ATUS took 42.5s. Estimated remaining: 4h 54m 6s. Rate: 7.5 symbols/min [2025-10-06T17:23:56.515923] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T17:23:56.583484] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-06T17:23:56.601408] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:23:56.627427] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-06T17:23:56.648220] [DEBUG] [LOCAL ] AVB: Loaded 42525 existing records from primary storage. [2025-10-06T17:23:56.648704] [INFO ] [MAIN ] AVB: Loaded 42525 existing records. [2025-10-06T17:23:56.822758] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:23:56.823151] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-06T17:23:56.823206] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-06T17:23:56.823551] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-06T17:23:56.823611] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-06T17:23:57.196737] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:23:57.344198] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-06T17:23:57.425477] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-06T17:23:57.962634] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T17:23:57.963614] [INFO ] [REMOTE ] AUNA: Full fetch complete (7779 records). [2025-10-06T17:23:57.963719] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-06T17:23:58.230800] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-06T17:23:58.328013] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-06T17:23:58.328107] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-06T17:23:58.328346] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-06T17:23:58.328415] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-06T17:23:58.328846] [DEBUG] [LOCAL ] AUNA: Trimmed 7779 records to 4983 (keeping 200 days of data) [2025-10-06T17:23:58.356147] [DEBUG] [LOCAL ] AUNA: Primary data saved (4983 records). [2025-10-06T17:23:58.356223] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-06T17:23:58.356298] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AUNA took 22.7s. Estimated remaining: 4h 52m 43s. Rate: 7.5 symbols/min [2025-10-06T17:23:58.526415] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:23:58.526628] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-06T17:23:58.526703] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-06T17:23:58.526848] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-06T17:23:58.526893] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-06T17:23:58.526936] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-06T17:23:58.526971] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-06T17:23:58.880718] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:23:59.025551] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-06T17:23:59.777776] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T17:23:59.825485] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-06T17:23:59.947418] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T17:24:00.625534] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-06T17:24:00.902567] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:24:00.902960] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-06T17:24:00.903050] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:24:00.903097] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-06T17:24:00.903129] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:24:00.903170] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-06T17:24:00.903231] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-06T17:24:00.903266] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-06T17:24:00.903323] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-06T17:24:00.903393] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVBC took 2.5s. Estimated remaining: 4h 51m 29s. Rate: 7.5 symbols/min [2025-10-06T17:24:01.040745] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T17:24:01.099875] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:24:01.122576] [DEBUG] [LOCAL ] AVD: Loaded 22804 existing records from primary storage. [2025-10-06T17:24:01.122866] [INFO ] [MAIN ] AVD: Loaded 22804 existing records. [2025-10-06T17:24:01.298706] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:24:01.298978] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-06T17:24:01.299025] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-06T17:24:01.299341] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-06T17:24:01.299400] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-06T17:24:01.436140] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-06T17:24:01.654659] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:24:02.225537] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-06T17:24:03.030742] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-06T17:24:03.048442] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T17:24:03.154352] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T17:24:03.825531] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-06T17:24:04.298451] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T17:24:04.625536] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-06T17:24:05.309178] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T17:24:05.425536] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-06T17:24:05.471097] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-06T17:24:06.225539] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-06T17:24:06.637821] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T17:24:07.025617] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-06T17:24:07.825511] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-06T17:24:07.928209] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T17:24:08.593505] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T17:24:08.625486] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-06T17:24:08.869436] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T17:24:09.425581] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-06T17:24:10.225508] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-06T17:24:10.259246] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T17:24:10.317919] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T17:24:11.025550] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-06T17:24:11.226513] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T17:24:11.825578] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-06T17:24:12.266042] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T17:24:12.625554] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-06T17:24:13.258698] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-06T17:24:13.425550] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-06T17:24:14.225525] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-06T17:24:14.270719] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T17:24:14.765065] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-06T17:24:15.017131] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T17:24:15.025903] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-06T17:24:15.825558] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-06T17:24:16.367407] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-06T17:24:16.625538] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-06T17:24:17.195349] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-06T17:24:17.426437] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-06T17:24:17.530754] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-06T17:24:18.176445] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T17:24:18.225499] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-06T17:24:18.970319] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T17:24:19.025495] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-06T17:24:19.724115] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T17:24:19.825559] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-06T17:24:20.625559] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-06T17:24:21.425576] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-06T17:24:21.732748] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-06T17:24:21.773773] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T17:24:22.225588] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-06T17:24:22.286085] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T17:24:22.287516] [INFO ] [REMOTE ] AVAL: Full fetch complete (14661 records). [2025-10-06T17:24:22.287600] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-06T17:24:22.288356] [FATAL] [VALIDATOR ] AVAL: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:24:22.288511] [FATAL] [MAIN ] AVAL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:24:22.288568] [WARN ] [MAIN ] AVAL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:24:22.288635] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-06T17:24:22.288785] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-06T17:24:22.288840] [INFO ] [LOCAL ] AVAL: Starting deletion of derivative data. [2025-10-06T17:24:22.289355] [DEBUG] [LOCAL ] AVAL: Deleted derivative data file. [2025-10-06T17:24:22.289489] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVAL took 29.2s. Estimated remaining: 4h 54m 3s. Rate: 7.4 symbols/min [2025-10-06T17:24:22.475914] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:24:22.495903] [DEBUG] [LOCAL ] AVK: Loaded 18373 existing records from primary storage. [2025-10-06T17:24:22.496188] [INFO ] [MAIN ] AVK: Loaded 18373 existing records. [2025-10-06T17:24:22.671385] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:24:22.671678] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-06T17:24:22.671738] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-06T17:24:22.671991] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-06T17:24:22.672048] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-06T17:24:23.028972] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-06T17:24:23.033639] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:24:23.830512] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-06T17:24:23.834436] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-06T17:24:24.220707] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T17:24:24.625512] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-06T17:24:24.713472] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-06T17:24:25.425475] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-06T17:24:25.504400] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T17:24:26.225590] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-06T17:24:26.430603] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T17:24:27.025520] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-06T17:24:27.825504] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-06T17:24:27.902833] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T17:24:27.904108] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T17:24:28.625568] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-06T17:24:29.271882] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T17:24:29.275761] [INFO ] [REMOTE ] AVB: Full fetch complete (58814 records). [2025-10-06T17:24:29.275886] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-06T17:24:29.430790] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-06T17:24:29.697897] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T17:24:29.717888] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-06T17:24:29.718435] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-06T17:24:29.719289] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-06T17:24:29.719360] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-06T17:24:29.720948] [DEBUG] [LOCAL ] AVB: Trimmed 58814 records to 42045 (keeping 200 days of data) [2025-10-06T17:24:30.019599] [DEBUG] [LOCAL ] AVB: Primary data saved (42045 records). [2025-10-06T17:24:30.019818] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-06T17:24:30.019969] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVB took 33.6s. Estimated remaining: 4h 53m 51s. Rate: 7.4 symbols/min [2025-10-06T17:24:30.228502] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:24:30.228578] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-06T17:24:30.269575] [DEBUG] [LOCAL ] AVNS: Loaded 34232 existing records from primary storage. [2025-10-06T17:24:30.269982] [INFO ] [MAIN ] AVNS: Loaded 34232 existing records. [2025-10-06T17:24:30.495171] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:24:30.495451] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-06T17:24:30.495500] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-06T17:24:30.495865] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-06T17:24:30.495925] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-06T17:24:30.914679] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:24:30.916172] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T17:24:31.025577] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-06T17:24:31.483890] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T17:24:31.486457] [INFO ] [REMOTE ] AVA: Full fetch complete (55751 records). [2025-10-06T17:24:31.486570] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-06T17:24:31.830762] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-06T17:24:31.973547] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-06T17:24:31.973701] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-06T17:24:31.974620] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-06T17:24:31.974711] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-06T17:24:31.976136] [DEBUG] [LOCAL ] AVA: Trimmed 55751 records to 39355 (keeping 200 days of data) [2025-10-06T17:24:32.237263] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-06T17:24:32.281520] [DEBUG] [LOCAL ] AVA: Primary data saved (39355 records). [2025-10-06T17:24:32.281743] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-06T17:24:32.281852] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVA took 50.3s. Estimated remaining: 4h 52m 34s. Rate: 7.5 symbols/min [2025-10-06T17:24:32.505759] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:24:32.550363] [DEBUG] [LOCAL ] AVNT: Loaded 39711 existing records from primary storage. [2025-10-06T17:24:32.550798] [INFO ] [MAIN ] AVNT: Loaded 39711 existing records. [2025-10-06T17:24:32.630732] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-06T17:24:32.789320] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:24:32.790101] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-06T17:24:32.790371] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-06T17:24:32.790962] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-06T17:24:32.791049] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-06T17:24:32.930090] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T17:24:33.259167] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:24:33.425490] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-06T17:24:33.546574] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-06T17:24:34.225544] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-06T17:24:34.755811] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T17:24:35.025550] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-06T17:24:35.320196] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T17:24:35.825563] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-06T17:24:35.844845] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T17:24:35.846314] [INFO ] [REMOTE ] AVD: Full fetch complete (33566 records). [2025-10-06T17:24:35.846413] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-06T17:24:36.220099] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-06T17:24:36.220209] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-06T17:24:36.220696] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-06T17:24:36.220782] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-06T17:24:36.221846] [DEBUG] [LOCAL ] AVD: Trimmed 33566 records to 22424 (keeping 200 days of data) [2025-10-06T17:24:36.354305] [DEBUG] [LOCAL ] AVD: Primary data saved (22424 records). [2025-10-06T17:24:36.354476] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-06T17:24:36.354565] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVD took 35.5s. Estimated remaining: 4h 51m 39s. Rate: 7.5 symbols/min [2025-10-06T17:24:36.532531] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:24:36.595479] [DEBUG] [LOCAL ] AVTR: Loaded 54342 existing records from primary storage. [2025-10-06T17:24:36.595994] [INFO ] [MAIN ] AVTR: Loaded 54342 existing records. [2025-10-06T17:24:36.636045] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-06T17:24:36.832116] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:24:36.832429] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-06T17:24:36.832504] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-06T17:24:36.832970] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-06T17:24:36.833032] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-06T17:24:37.285862] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:24:37.425504] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-06T17:24:37.521979] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-06T17:24:37.523548] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T17:24:38.225509] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-06T17:24:38.610301] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T17:24:39.025598] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-06T17:24:39.360071] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T17:24:39.825510] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-06T17:24:39.995093] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T17:24:40.625626] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-06T17:24:41.425619] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-06T17:24:41.578602] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T17:24:42.030559] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T17:24:42.225483] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-06T17:24:42.621846] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-06T17:24:43.025527] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-06T17:24:43.825520] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-06T17:24:43.884754] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T17:24:44.129263] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T17:24:44.625605] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-06T17:24:45.020454] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-06T17:24:45.425539] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-06T17:24:45.662336] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-06T17:24:45.664087] [INFO ] [REMOTE ] AVK: Full fetch complete (26855 records). [2025-10-06T17:24:45.664322] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-06T17:24:46.022454] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-06T17:24:46.022549] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-06T17:24:46.022955] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-06T17:24:46.023018] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-06T17:24:46.023747] [DEBUG] [LOCAL ] AVK: Trimmed 26855 records to 18166 (keeping 200 days of data) [2025-10-06T17:24:46.134034] [DEBUG] [LOCAL ] AVK: Primary data saved (18166 records). [2025-10-06T17:24:46.134205] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-06T17:24:46.134290] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVK took 23.8s. Estimated remaining: 4h 51m 52s. Rate: 7.5 symbols/min [2025-10-06T17:24:46.230671] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-06T17:24:46.309852] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:24:46.354541] [DEBUG] [LOCAL ] AVY: Loaded 38061 existing records from primary storage. [2025-10-06T17:24:46.354953] [INFO ] [MAIN ] AVY: Loaded 38061 existing records. [2025-10-06T17:24:46.529156] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:24:46.529430] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-06T17:24:46.529479] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-06T17:24:46.529928] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-06T17:24:46.529989] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-06T17:24:46.927221] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:24:46.950008] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T17:24:47.025582] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-06T17:24:47.825562] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-06T17:24:47.966125] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T17:24:48.328199] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T17:24:48.625578] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-06T17:24:48.973805] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T17:24:49.425582] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-06T17:24:50.230754] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-06T17:24:50.245932] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T17:24:50.962385] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T17:24:51.025486] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-06T17:24:51.053167] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-06T17:24:51.825591] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-06T17:24:52.499704] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T17:24:52.625542] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-06T17:24:53.425568] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-06T17:24:53.607523] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T17:24:53.800141] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-06T17:24:54.225531] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-06T17:24:54.773846] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T17:24:55.025567] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-06T17:24:55.628295] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T17:24:55.825554] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-06T17:24:56.585452] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T17:24:56.625479] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-06T17:24:57.323451] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T17:24:57.425530] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-06T17:24:57.688997] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T17:24:58.225543] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-06T17:24:58.803386] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T17:24:59.025516] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-06T17:24:59.825512] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-06T17:24:59.949418] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T17:25:00.377515] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T17:25:00.625539] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-06T17:25:01.397788] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-06T17:25:01.400419] [INFO ] [REMOTE ] AVNS: Full fetch complete (48434 records). [2025-10-06T17:25:01.400579] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-06T17:25:01.430698] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-06T17:25:01.823759] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-06T17:25:01.823873] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-06T17:25:01.824562] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-06T17:25:01.824630] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-06T17:25:01.826165] [DEBUG] [LOCAL ] AVNS: Trimmed 48434 records to 33703 (keeping 200 days of data) [2025-10-06T17:25:02.042111] [DEBUG] [LOCAL ] AVNS: Primary data saved (33703 records). [2025-10-06T17:25:02.042293] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-06T17:25:02.042395] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNS took 32.0s. Estimated remaining: 4h 53m 17s. Rate: 7.5 symbols/min [2025-10-06T17:25:02.210183] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:25:02.225893] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-06T17:25:02.238499] [DEBUG] [LOCAL ] AWF: Loaded 24788 existing records from primary storage. [2025-10-06T17:25:02.238895] [INFO ] [MAIN ] AWF: Loaded 24788 existing records. [2025-10-06T17:25:02.432501] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:25:02.432778] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-06T17:25:02.432848] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-06T17:25:02.433147] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-06T17:25:02.433206] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-06T17:25:02.851727] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:25:02.878965] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-06T17:25:03.025557] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-06T17:25:03.825520] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-06T17:25:03.933129] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-06T17:25:04.141683] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-06T17:25:04.625581] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-06T17:25:04.777927] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T17:25:05.173290] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T17:25:05.425611] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-06T17:25:06.225553] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-06T17:25:06.356780] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T17:25:06.535629] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T17:25:07.025599] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-06T17:25:07.584311] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T17:25:07.825552] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-06T17:25:08.613825] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T17:25:08.625771] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-06T17:25:09.028300] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T17:25:09.425588] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-06T17:25:10.225585] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-06T17:25:10.408616] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T17:25:10.951553] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-06T17:25:11.025543] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-06T17:25:11.584453] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T17:25:11.588150] [INFO ] [REMOTE ] AVY: Full fetch complete (56360 records). [2025-10-06T17:25:11.588363] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-06T17:25:11.830613] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-06T17:25:11.980100] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-06T17:25:11.980191] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-06T17:25:11.980824] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-06T17:25:11.980903] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-06T17:25:11.982057] [DEBUG] [LOCAL ] AVY: Trimmed 56360 records to 37507 (keeping 200 days of data) [2025-10-06T17:25:12.220812] [DEBUG] [LOCAL ] AVY: Primary data saved (37507 records). [2025-10-06T17:25:12.220981] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-06T17:25:12.221065] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVY took 26.1s. Estimated remaining: 4h 53m 33s. Rate: 7.4 symbols/min [2025-10-06T17:25:12.391943] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:25:12.416191] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T17:25:12.446722] [DEBUG] [LOCAL ] AWI: Loaded 25738 existing records from primary storage. [2025-10-06T17:25:12.447014] [INFO ] [MAIN ] AWI: Loaded 25738 existing records. [2025-10-06T17:25:12.628970] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:25:12.629591] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-06T17:25:12.629138] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-06T17:25:12.630161] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-06T17:25:12.631284] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-06T17:25:12.631365] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-06T17:25:12.986004] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:25:13.425570] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-06T17:25:13.720833] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T17:25:13.746251] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T17:25:14.225531] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-06T17:25:15.026083] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-06T17:25:15.025996] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T17:25:15.602351] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T17:25:15.825547] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-06T17:25:16.010282] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T17:25:16.625545] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-06T17:25:17.074322] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T17:25:17.076695] [INFO ] [REMOTE ] AVNT: Full fetch complete (56242 records). [2025-10-06T17:25:17.076785] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-06T17:25:17.077481] [FATAL] [VALIDATOR ] AVNT: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:25:17.077676] [FATAL] [MAIN ] AVNT: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:25:17.077766] [WARN ] [MAIN ] AVNT: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:25:17.077859] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-06T17:25:17.077961] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-10-06T17:25:17.078008] [INFO ] [LOCAL ] AVNT: Starting deletion of derivative data. [2025-10-06T17:25:17.078263] [DEBUG] [LOCAL ] AVNT: Deleted derivative data file. [2025-10-06T17:25:17.078837] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVNT took 44.8s. Estimated remaining: 4h 52m 48s. Rate: 7.5 symbols/min [2025-10-06T17:25:17.244682] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:25:17.244885] [DEBUG] [LOCAL ] AWK: No existing data file found in primary storage. [2025-10-06T17:25:17.244940] [WARN ] [MAIN ] AWK: No existing data found, performing full refresh instead. [2025-10-06T17:25:17.245055] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-06T17:25:17.245108] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-06T17:25:17.245155] [DEBUG] [LOCAL ] AWK: No primary data file found to delete. [2025-10-06T17:25:17.245187] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-06T17:25:17.430784] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-06T17:25:17.594385] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:25:18.225563] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-06T17:25:18.409134] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-06T17:25:18.412396] [INFO ] [REMOTE ] AVTR: Full fetch complete (77442 records). [2025-10-06T17:25:18.412568] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-06T17:25:18.854521] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-06T17:25:18.854680] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-06T17:25:18.861453] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-06T17:25:18.872254] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-06T17:25:18.874291] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T17:25:18.881396] [DEBUG] [LOCAL ] AVTR: Trimmed 77442 records to 53567 (keeping 200 days of data) [2025-10-06T17:25:19.051713] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-06T17:25:19.225248] [DEBUG] [LOCAL ] AVTR: Primary data saved (53567 records). [2025-10-06T17:25:19.225421] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-06T17:25:19.225513] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVTR took 42.9s. Estimated remaining: 4h 51m 32s. Rate: 7.5 symbols/min [2025-10-06T17:25:19.364382] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T17:25:19.441874] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:25:19.468476] [DEBUG] [LOCAL ] AWP: Loaded 21755 existing records from primary storage. [2025-10-06T17:25:19.468824] [INFO ] [MAIN ] AWP: Loaded 21755 existing records. [2025-10-06T17:25:19.663422] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:25:19.663783] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-06T17:25:19.663860] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-06T17:25:19.664172] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-06T17:25:19.664232] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-06T17:25:19.836028] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-06T17:25:20.055033] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:25:20.235711] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T17:25:20.625534] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-06T17:25:21.425493] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-06T17:25:21.542930] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T17:25:21.793460] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T17:25:22.225538] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-06T17:25:22.643462] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T17:25:23.025550] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-06T17:25:23.825588] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-06T17:25:23.954563] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T17:25:24.086205] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T17:25:24.625574] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-06T17:25:25.221391] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T17:25:25.425559] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-06T17:25:26.225510] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-06T17:25:26.256274] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T17:25:26.589595] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T17:25:27.025703] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-06T17:25:27.707315] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T17:25:27.825547] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-06T17:25:28.625521] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-06T17:25:28.742865] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T17:25:28.985096] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T17:25:29.425550] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-06T17:25:29.527000] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T17:25:30.225544] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-06T17:25:30.489432] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T17:25:31.025561] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-06T17:25:31.318031] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-06T17:25:31.825535] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-06T17:25:32.235425] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T17:25:32.625488] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-06T17:25:33.021883] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T17:25:33.425490] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-06T17:25:33.493490] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-06T17:25:34.225561] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-06T17:25:34.474091] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T17:25:35.025533] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-06T17:25:35.322501] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T17:25:35.825566] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-06T17:25:36.350732] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T17:25:36.625565] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-06T17:25:37.087077] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T17:25:37.425534] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-06T17:25:37.917017] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-06T17:25:38.225544] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-06T17:25:38.771550] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T17:25:39.025556] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-06T17:25:39.203308] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-06T17:25:39.205324] [INFO ] [REMOTE ] AWI: Full fetch complete (35707 records). [2025-10-06T17:25:39.205420] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-06T17:25:39.614863] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-06T17:25:39.614975] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-06T17:25:39.615515] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-06T17:25:39.615579] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-06T17:25:39.616583] [DEBUG] [LOCAL ] AWI: Trimmed 35707 records to 25311 (keeping 200 days of data) [2025-10-06T17:25:39.786298] [DEBUG] [LOCAL ] AWI: Primary data saved (25311 records). [2025-10-06T17:25:39.786501] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-06T17:25:39.786615] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWI took 27.6s. Estimated remaining: 4h 53m 48s. Rate: 7.4 symbols/min [2025-10-06T17:25:39.830723] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-06T17:25:40.017606] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:25:40.052715] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-06T17:25:40.082133] [DEBUG] [LOCAL ] AWR: Loaded 22954 existing records from primary storage. [2025-10-06T17:25:40.082507] [INFO ] [MAIN ] AWR: Loaded 22954 existing records. [2025-10-06T17:25:40.305690] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:25:40.306044] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-06T17:25:40.306115] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-06T17:25:40.306427] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-06T17:25:40.306502] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-06T17:25:40.630708] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-06T17:25:40.906569] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:25:40.943522] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-06T17:25:41.425594] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-06T17:25:41.726375] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T17:25:41.728215] [INFO ] [REMOTE ] AWF: Full fetch complete (36181 records). [2025-10-06T17:25:41.728294] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-06T17:25:42.097604] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-06T17:25:42.097771] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-06T17:25:42.098325] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-06T17:25:42.098412] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-06T17:25:42.099342] [DEBUG] [LOCAL ] AWF: Trimmed 36181 records to 24363 (keeping 200 days of data) [2025-10-06T17:25:42.234225] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-06T17:25:42.251342] [DEBUG] [LOCAL ] AWF: Primary data saved (24363 records). [2025-10-06T17:25:42.251468] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-06T17:25:42.251549] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWF took 40.2s. Estimated remaining: 4h 52m 36s. Rate: 7.5 symbols/min [2025-10-06T17:25:42.404511] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T17:25:42.440364] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:25:42.467559] [DEBUG] [LOCAL ] AX: Loaded 28727 existing records from primary storage. [2025-10-06T17:25:42.467876] [INFO ] [MAIN ] AX: Loaded 28727 existing records. [2025-10-06T17:25:42.644138] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:25:42.644405] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-06T17:25:42.644455] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-06T17:25:42.644777] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-06T17:25:42.644848] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-06T17:25:42.999192] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:25:43.025475] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-06T17:25:43.693803] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T17:25:43.825529] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-06T17:25:44.441583] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T17:25:44.625525] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-06T17:25:44.830708] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-06T17:25:45.425555] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-06T17:25:45.794931] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-06T17:25:46.225528] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-06T17:25:47.025533] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-06T17:25:47.200291] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T17:25:47.363668] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-06T17:25:47.825508] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-06T17:25:48.090379] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-06T17:25:48.625548] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-06T17:25:49.076487] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-06T17:25:49.425534] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-06T17:25:49.717412] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T17:25:49.719981] [INFO ] [REMOTE ] AWP: Full fetch complete (32232 records). [2025-10-06T17:25:49.720109] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-06T17:25:50.134070] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-06T17:25:50.134236] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-06T17:25:50.134914] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-06T17:25:50.134986] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-06T17:25:50.136606] [DEBUG] [LOCAL ] AWP: Trimmed 32232 records to 21465 (keeping 200 days of data) [2025-10-06T17:25:50.226179] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-06T17:25:50.278622] [DEBUG] [LOCAL ] AWP: Primary data saved (21465 records). [2025-10-06T17:25:50.278837] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-06T17:25:50.278950] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 31.1s. Estimated remaining: 4h 52m 27s. Rate: 7.5 symbols/min [2025-10-06T17:25:50.474459] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:25:50.530536] [DEBUG] [LOCAL ] AXL: Loaded 51239 existing records from primary storage. [2025-10-06T17:25:50.531000] [INFO ] [MAIN ] AXL: Loaded 51239 existing records. [2025-10-06T17:25:50.736778] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:25:50.737161] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-06T17:25:50.737241] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-06T17:25:50.737538] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-06T17:25:50.737601] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-06T17:25:51.027928] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-06T17:25:51.191149] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:25:51.223742] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T17:25:51.261321] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T17:25:51.825531] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-06T17:25:52.473094] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T17:25:52.625525] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-06T17:25:53.367233] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T17:25:53.425488] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-06T17:25:53.564717] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T17:25:54.225542] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-06T17:25:54.334250] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-06T17:25:55.025510] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-06T17:25:55.825566] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-06T17:25:55.888027] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T17:25:56.553493] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T17:25:56.625487] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-06T17:25:57.010091] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T17:25:57.425580] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-06T17:25:57.460279] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T17:25:58.225559] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-06T17:25:58.509585] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T17:25:59.025546] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-06T17:25:59.378987] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T17:25:59.825542] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-06T17:26:00.625484] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-06T17:26:00.716812] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T17:26:01.425574] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-06T17:26:01.518297] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T17:26:02.225546] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-06T17:26:02.455026] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-06T17:26:03.025505] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-06T17:26:03.099433] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T17:26:03.825528] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-06T17:26:04.118042] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-06T17:26:04.246681] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T17:26:04.625487] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-06T17:26:05.006695] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-06T17:26:05.425549] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-06T17:26:05.668024] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T17:26:06.225556] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-06T17:26:06.416165] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-06T17:26:06.418200] [INFO ] [REMOTE ] AWR: Full fetch complete (32244 records). [2025-10-06T17:26:06.418312] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-06T17:26:06.807854] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-06T17:26:06.807946] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-06T17:26:06.808454] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-06T17:26:06.808519] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-06T17:26:06.809372] [DEBUG] [LOCAL ] AWR: Trimmed 32244 records to 22676 (keeping 200 days of data) [2025-10-06T17:26:06.951974] [DEBUG] [LOCAL ] AWR: Primary data saved (22676 records). [2025-10-06T17:26:06.952185] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-06T17:26:06.952324] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWR took 27.2s. Estimated remaining: 4h 53m 57s. Rate: 7.4 symbols/min [2025-10-06T17:26:07.030667] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-06T17:26:07.128041] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:26:07.183827] [DEBUG] [LOCAL ] AXP: Loaded 53964 existing records from primary storage. [2025-10-06T17:26:07.184233] [INFO ] [MAIN ] AXP: Loaded 53964 existing records. [2025-10-06T17:26:07.360334] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:26:07.360561] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-06T17:26:07.360618] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-06T17:26:07.360940] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-06T17:26:07.361005] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-06T17:26:07.717495] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:26:07.830608] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-06T17:26:07.848435] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T17:26:08.603454] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-06T17:26:08.606364] [INFO ] [REMOTE ] AWK: Full fetch complete (70703 records). [2025-10-06T17:26:08.606484] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-06T17:26:08.630721] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-06T17:26:08.910592] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T17:26:08.938728] [INFO ] [REMOTE ] AX: Full fetch complete (42572 records). [2025-10-06T17:26:08.964215] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-06T17:26:09.033999] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-06T17:26:09.059099] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-06T17:26:09.073863] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-06T17:26:09.095297] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-06T17:26:09.176917] [DEBUG] [LOCAL ] AWK: Trimmed 70703 records to 48662 (keeping 200 days of data) [2025-10-06T17:26:09.434058] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-06T17:26:09.545058] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-06T17:26:09.545373] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-06T17:26:09.546692] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-06T17:26:09.547026] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-06T17:26:09.550689] [DEBUG] [LOCAL ] AX: Trimmed 42572 records to 28224 (keeping 200 days of data) [2025-10-06T17:26:09.843747] [DEBUG] [LOCAL ] AX: Primary data saved (28224 records). [2025-10-06T17:26:09.844340] [INFO ] [MAIN ] AX: Full history saved. [2025-10-06T17:26:09.845008] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AX took 27.6s. Estimated remaining: 4h 52m 50s. Rate: 7.4 symbols/min [2025-10-06T17:26:10.028809] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:26:10.036790] [DEBUG] [LOCAL ] AXR: Loaded 3061 existing records from primary storage. [2025-10-06T17:26:10.037264] [INFO ] [MAIN ] AXR: Loaded 3061 existing records. [2025-10-06T17:26:10.264914] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:26:10.276782] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-06T17:26:10.277149] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-06T17:26:10.278342] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-06T17:26:10.278986] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-06T17:26:10.584803] [DEBUG] [LOCAL ] AWK: Primary data saved (48662 records). [2025-10-06T17:26:10.595216] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-06T17:26:10.600460] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AWK took 53.5s. Estimated remaining: 4h 51m 20s. Rate: 7.5 symbols/min [2025-10-06T17:26:10.763055] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:26:10.814702] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-06T17:26:10.904316] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:26:10.978157] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T17:26:10.975090] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-06T17:26:11.030594] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-06T17:26:11.032890] [DEBUG] [LOCAL ] AXS: Loaded 38977 existing records from primary storage. [2025-10-06T17:26:11.033233] [INFO ] [MAIN ] AXS: Loaded 38977 existing records. [2025-10-06T17:26:11.216539] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:26:11.216847] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-06T17:26:11.216964] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-06T17:26:11.217229] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-06T17:26:11.217286] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-06T17:26:11.514226] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-06T17:26:11.577401] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:26:11.825591] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-06T17:26:12.491592] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-06T17:26:12.625530] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-06T17:26:12.839946] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T17:26:13.425559] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-06T17:26:14.231635] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-06T17:26:14.233529] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T17:26:14.706896] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-06T17:26:15.025500] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-06T17:26:15.128524] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T17:26:15.825595] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-06T17:26:16.500534] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-06T17:26:16.625577] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-06T17:26:17.361681] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T17:26:17.425504] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-06T17:26:18.225598] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-06T17:26:18.519542] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T17:26:18.813060] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T17:26:18.824223] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-06T17:26:19.025600] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-06T17:26:19.825564] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-06T17:26:20.625502] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-06T17:26:20.769623] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-06T17:26:21.371490] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T17:26:21.425485] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-06T17:26:22.225559] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-06T17:26:22.344596] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T17:26:22.508186] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-06T17:26:22.890492] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-06T17:26:23.025574] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-06T17:26:23.544697] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-06T17:26:23.825527] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-06T17:26:24.398580] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-06T17:26:24.625546] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-06T17:26:25.425559] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-06T17:26:26.225553] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-06T17:26:26.407350] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T17:26:26.725477] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T17:26:27.025597] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-06T17:26:27.825495] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-06T17:26:28.204468] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-06T17:26:28.625525] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-06T17:26:28.766427] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T17:26:29.184555] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T17:26:29.425576] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-06T17:26:30.225707] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-06T17:26:30.796267] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-06T17:26:30.969522] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T17:26:31.025487] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-06T17:26:31.122566] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-06T17:26:31.825537] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-06T17:26:32.515262] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T17:26:32.625629] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-06T17:26:33.266778] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T17:26:33.357293] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T17:26:33.362061] [INFO ] [REMOTE ] AXL: Full fetch complete (72738 records). [2025-10-06T17:26:33.362303] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-06T17:26:33.430792] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-06T17:26:33.791684] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-06T17:26:33.791795] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-06T17:26:33.792576] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-06T17:26:33.792621] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-06T17:26:33.794693] [DEBUG] [LOCAL ] AXL: Trimmed 72738 records to 50503 (keeping 200 days of data) [2025-10-06T17:26:34.079987] [DEBUG] [LOCAL ] AXL: Primary data saved (50503 records). [2025-10-06T17:26:34.080162] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-06T17:26:34.080251] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 43.8s. Estimated remaining: 4h 54m 4s. Rate: 7.4 symbols/min [2025-10-06T17:26:34.231158] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-06T17:26:34.251182] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:26:34.252495] [DEBUG] [LOCAL ] AXTA: No existing data file found in primary storage. [2025-10-06T17:26:34.252544] [WARN ] [MAIN ] AXTA: No existing data found, performing full refresh instead. [2025-10-06T17:26:34.252683] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-06T17:26:34.252738] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-06T17:26:34.252781] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-10-06T17:26:34.252814] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-06T17:26:34.610488] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:26:35.025565] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-06T17:26:35.657311] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-06T17:26:35.834927] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-06T17:26:35.859113] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-06T17:26:35.896521] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T17:26:36.385319] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T17:26:36.386096] [INFO ] [REMOTE ] AXR: Full fetch complete (4751 records). [2025-10-06T17:26:36.386181] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-06T17:26:36.631723] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-06T17:26:36.792971] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-06T17:26:36.793064] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-06T17:26:36.793304] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-06T17:26:36.793345] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-06T17:26:36.793913] [DEBUG] [LOCAL ] AXR: Trimmed 4751 records to 3009 (keeping 200 days of data) [2025-10-06T17:26:36.814621] [DEBUG] [LOCAL ] AXR: Primary data saved (3009 records). [2025-10-06T17:26:36.814810] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-06T17:26:36.814913] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 27.0s. Estimated remaining: 4h 52m 56s. Rate: 7.4 symbols/min [2025-10-06T17:26:37.425593] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-06T17:26:38.077523] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T17:26:38.080077] [INFO ] [REMOTE ] AXS: Full fetch complete (55752 records). [2025-10-06T17:26:38.080184] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-06T17:26:38.231459] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-06T17:26:38.480057] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-06T17:26:38.480226] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-06T17:26:38.482479] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-06T17:26:38.482677] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-06T17:26:38.484462] [DEBUG] [LOCAL ] AXS: Trimmed 55752 records to 38503 (keeping 200 days of data) [2025-10-06T17:26:38.752787] [DEBUG] [LOCAL ] AXS: Primary data saved (38503 records). [2025-10-06T17:26:38.752992] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-06T17:26:38.753857] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXS took 28.1s. Estimated remaining: 4h 51m 41s. Rate: 7.4 symbols/min [2025-10-06T17:26:39.409911] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-06T17:26:39.422064] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-06T17:26:39.947871] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T17:26:39.958064] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-06T17:26:41.483614] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T17:26:41.493718] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-06T17:26:41.882620] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-06T17:26:41.894444] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-06T17:26:43.111486] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T17:26:43.122080] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-06T17:26:43.873763] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T17:26:43.885670] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-06T17:26:44.574472] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T17:26:44.589512] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-06T17:26:46.032207] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-06T17:26:46.043692] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-06T17:26:46.280300] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T17:26:46.291399] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-06T17:26:47.634035] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T17:26:47.637405] [INFO ] [REMOTE ] AXP: Full fetch complete (76922 records). [2025-10-06T17:26:47.637625] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-06T17:26:47.771086] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T17:26:47.811182] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-06T17:26:48.073811] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-06T17:26:48.073912] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-06T17:26:48.074701] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-06T17:26:48.074766] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-06T17:26:48.076226] [DEBUG] [LOCAL ] AXP: Trimmed 76922 records to 53176 (keeping 200 days of data) [2025-10-06T17:26:48.410809] [DEBUG] [LOCAL ] AXP: Primary data saved (53176 records). [2025-10-06T17:26:48.411045] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-06T17:26:48.411147] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXP took 41.5s. Estimated remaining: 4h 51m 50s. Rate: 7.4 symbols/min [2025-10-06T17:26:49.450549] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T17:26:49.461406] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-06T17:26:51.213768] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T17:26:51.225262] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-06T17:26:52.851049] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T17:26:52.862443] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-06T17:26:54.549392] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T17:26:54.561039] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-06T17:26:56.172359] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-06T17:26:56.175727] [INFO ] [REMOTE ] AXTA: Full fetch complete (75113 records). [2025-10-06T17:26:56.176097] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-06T17:26:56.582758] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-06T17:26:56.582941] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-06T17:26:56.583901] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-06T17:26:56.583978] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-06T17:26:56.585773] [DEBUG] [LOCAL ] AXTA: Trimmed 75113 records to 52142 (keeping 200 days of data) [2025-10-06T17:26:56.891785] [DEBUG] [LOCAL ] AXTA: Primary data saved (52142 records). [2025-10-06T17:26:56.891955] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-06T17:26:56.892036] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 22.8s. Estimated remaining: 4h 51m 47s. Rate: 7.4 symbols/min [2025-10-06T17:26:57.414283] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:26:57.527453] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:26:57.519026] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:26:57.533360] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-06T17:26:57.538718] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-06T17:26:57.538812] [DEBUG] [LOCAL ] AYI: No existing data file found in primary storage. [2025-10-06T17:26:57.539111] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-06T17:26:57.544335] [WARN ] [MAIN ] AYI: No existing data found, performing full refresh instead. [2025-10-06T17:26:57.544694] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-06T17:26:57.573365] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-06T17:26:57.575705] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-06T17:26:57.576021] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-06T17:26:57.576136] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-06T17:26:57.596846] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:26:57.596934] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-10-06T17:26:57.602516] [DEBUG] [LOCAL ] AZZ: No existing data file found in primary storage. [2025-10-06T17:26:57.602638] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-06T17:26:57.691811] [DEBUG] [LOCAL ] AZO: Loaded 11424 existing records from primary storage. [2025-10-06T17:26:57.718808] [INFO ] [MAIN ] AZO: Loaded 11424 existing records. [2025-10-06T17:26:57.642315] [WARN ] [MAIN ] AZZ: No existing data found, performing full refresh instead. [2025-10-06T17:26:57.787242] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-06T17:26:57.894020] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-06T17:26:57.979398] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-10-06T17:26:58.140293] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-06T17:26:58.242488] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:26:58.273547] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-06T17:26:58.347493] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-06T17:26:58.434426] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-06T17:26:58.515465] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-06T17:26:58.732790] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:26:58.792192] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-06T17:26:58.872585] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:26:58.904258] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-06T17:26:59.245955] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:26:59.256556] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-06T17:26:59.312308] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:26:59.312801] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-06T17:26:59.935463] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-06T17:26:59.942556] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-06T17:27:00.044523] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T17:27:00.052591] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-06T17:27:00.327225] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T17:27:00.331740] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-06T17:27:00.544890] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T17:27:00.548304] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-06T17:27:01.025698] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T17:27:01.032951] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-06T17:27:01.365089] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T17:27:01.368232] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-06T17:27:01.467688] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:27:01.468079] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-06T17:27:01.468172] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:27:01.468256] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-06T17:27:01.468418] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:27:01.468526] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-06T17:27:01.468616] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-06T17:27:01.468791] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-06T17:27:01.468882] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-06T17:27:01.468953] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. B took 4.5s. Estimated remaining: 4h 51m 1s. Rate: 7.5 symbols/min [2025-10-06T17:27:01.596146] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T17:27:01.642451] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-06T17:27:01.681526] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:27:01.690153] [DEBUG] [LOCAL ] BA: No existing data file found in primary storage. [2025-10-06T17:27:01.690940] [WARN ] [MAIN ] BA: No existing data found, performing full refresh instead. [2025-10-06T17:27:01.694298] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-06T17:27:01.694502] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-06T17:27:01.694177] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T17:27:01.695064] [DEBUG] [LOCAL ] BA: No primary data file found to delete. [2025-10-06T17:27:01.700080] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-06T17:27:01.700467] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-06T17:27:02.117841] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:27:02.118265] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-06T17:27:02.282230] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-06T17:27:02.284812] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-06T17:27:02.807320] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T17:27:02.812025] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-06T17:27:02.885806] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T17:27:02.890788] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-06T17:27:03.196765] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T17:27:03.201754] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-06T17:27:03.820964] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-06T17:27:03.826279] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-06T17:27:03.892316] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T17:27:04.202900] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-06T17:27:04.540856] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-06T17:27:04.625473] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-06T17:27:04.996139] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T17:27:05.425551] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-06T17:27:06.225567] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-06T17:27:06.499806] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T17:27:06.893077] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-06T17:27:07.028080] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-06T17:27:07.031173] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-06T17:27:07.825535] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-06T17:27:08.518301] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T17:27:08.621638] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T17:27:08.625803] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-06T17:27:09.425497] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-06T17:27:09.505499] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T17:27:10.225562] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-06T17:27:10.519783] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T17:27:11.025581] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-06T17:27:11.210197] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T17:27:11.825559] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-06T17:27:11.900438] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T17:27:12.625553] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-06T17:27:12.670178] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T17:27:13.425490] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-06T17:27:13.461830] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T17:27:14.225700] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-06T17:27:14.328236] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T17:27:15.025584] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-06T17:27:15.825492] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-06T17:27:16.198274] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-06T17:27:16.490894] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-06T17:27:16.625523] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-06T17:27:16.682268] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T17:27:16.683313] [INFO ] [REMOTE ] AZO: Full fetch complete (16067 records). [2025-10-06T17:27:16.683406] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-06T17:27:16.684141] [FATAL] [VALIDATOR ] AZO: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:27:16.684227] [FATAL] [MAIN ] AZO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:27:16.684291] [WARN ] [MAIN ] AZO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:27:16.684358] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-06T17:27:16.684426] [DEBUG] [LOCAL ] AZO: No primary data file found to delete. [2025-10-06T17:27:16.684463] [INFO ] [LOCAL ] AZO: Starting deletion of derivative data. [2025-10-06T17:27:16.684818] [DEBUG] [LOCAL ] AZO: Deleted derivative data file. [2025-10-06T17:27:16.684924] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZO took 19.8s. Estimated remaining: 4h 52m 10s. Rate: 7.4 symbols/min [2025-10-06T17:27:16.853973] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:27:16.913064] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-10-06T17:27:16.913424] [INFO ] [MAIN ] BABA: Loaded 54600 existing records. [2025-10-06T17:27:17.098693] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:27:17.098982] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-06T17:27:17.099036] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-06T17:27:17.099351] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-06T17:27:17.099412] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-06T17:27:17.430343] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-06T17:27:17.533575] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:27:17.899463] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-06T17:27:18.225569] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-06T17:27:19.025585] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-06T17:27:19.825516] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-06T17:27:19.893896] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-06T17:27:20.135558] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T17:27:20.137400] [INFO ] [REMOTE ] AZZ: Full fetch complete (30954 records). [2025-10-06T17:27:20.137482] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-06T17:27:20.535638] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-06T17:27:20.535869] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-06T17:27:20.536778] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-06T17:27:20.536951] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-06T17:27:20.539087] [DEBUG] [LOCAL ] AZZ: Trimmed 30954 records to 21927 (keeping 200 days of data) [2025-10-06T17:27:20.668300] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-06T17:27:20.675239] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-06T17:27:20.739237] [DEBUG] [LOCAL ] AZZ: Primary data saved (21927 records). [2025-10-06T17:27:20.739423] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-06T17:27:20.739518] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AZZ took 23.8s. Estimated remaining: 4h 51m 19s. Rate: 7.4 symbols/min [2025-10-06T17:27:20.925250] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:27:20.942206] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-06T17:27:21.009729] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-10-06T17:27:21.010208] [INFO ] [MAIN ] BAC: Loaded 54588 existing records. [2025-10-06T17:27:21.200588] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:27:21.200925] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-06T17:27:21.200995] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-06T17:27:21.201485] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-06T17:27:21.201545] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-06T17:27:21.430775] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-06T17:27:21.575823] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:27:22.225620] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-06T17:27:23.025562] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-06T17:27:23.289735] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-06T17:27:23.318844] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T17:27:23.825515] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-06T17:27:23.890276] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-06T17:27:24.625605] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-06T17:27:25.425562] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-06T17:27:25.477549] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-06T17:27:26.225618] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-06T17:27:26.413916] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-06T17:27:26.646393] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-06T17:27:26.810917] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-06T17:27:27.025557] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-06T17:27:27.825541] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-06T17:27:28.105906] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T17:27:28.108207] [INFO ] [REMOTE ] AYI: Full fetch complete (37107 records). [2025-10-06T17:27:28.108321] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-06T17:27:28.498140] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-06T17:27:28.498302] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-06T17:27:28.498913] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-06T17:27:28.498993] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-06T17:27:28.500087] [DEBUG] [LOCAL ] AYI: Trimmed 37107 records to 25228 (keeping 200 days of data) [2025-10-06T17:27:28.626404] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-06T17:27:28.627272] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-06T17:27:28.702055] [DEBUG] [LOCAL ] AYI: Primary data saved (25228 records). [2025-10-06T17:27:28.702226] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-06T17:27:28.702306] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AYI took 31.8s. Estimated remaining: 4h 51m 10s. Rate: 7.4 symbols/min [2025-10-06T17:27:28.870467] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:27:28.923475] [DEBUG] [LOCAL ] BAH: Loaded 52444 existing records from primary storage. [2025-10-06T17:27:28.923915] [INFO ] [MAIN ] BAH: Loaded 52444 existing records. [2025-10-06T17:27:29.102551] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:27:29.102830] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-06T17:27:29.102879] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-06T17:27:29.103280] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-06T17:27:29.103337] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-06T17:27:29.426932] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-06T17:27:29.455197] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:27:30.027897] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-06T17:27:30.225544] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-06T17:27:31.025555] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-06T17:27:31.306156] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-06T17:27:31.498543] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-10-06T17:27:31.825604] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-06T17:27:32.430335] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-06T17:27:32.625514] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-06T17:27:32.755751] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T17:27:33.425595] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-06T17:27:34.225547] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-06T17:27:34.522272] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-06T17:27:35.025545] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-06T17:27:35.027513] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-06T17:27:35.754579] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T17:27:35.825542] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-06T17:27:35.865909] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-06T17:27:36.625528] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-06T17:27:37.421846] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-06T17:27:37.425881] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-06T17:27:38.225500] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-06T17:27:38.409991] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-06T17:27:38.932880] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T17:27:39.025502] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-06T17:27:39.265836] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-06T17:27:39.825530] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-06T17:27:40.427970] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T17:27:40.430669] [INFO ] [REMOTE ] BA: Full fetch complete (77534 records). [2025-10-06T17:27:40.430820] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-06T17:27:40.432058] [FATAL] [VALIDATOR ] BA: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:27:40.432312] [FATAL] [MAIN ] BA: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:27:40.432496] [WARN ] [MAIN ] BA: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:27:40.432746] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-06T17:27:40.432878] [DEBUG] [LOCAL ] BA: No primary data file found to delete. [2025-10-06T17:27:40.433059] [INFO ] [LOCAL ] BA: Starting deletion of derivative data. [2025-10-06T17:27:40.433156] [DEBUG] [LOCAL ] BA: No derivative data file found to delete. [2025-10-06T17:27:40.433303] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BA took 39.0s. Estimated remaining: 4h 51m 40s. Rate: 7.4 symbols/min [2025-10-06T17:27:40.621956] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:27:40.625503] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-06T17:27:40.665690] [DEBUG] [LOCAL ] BAK: Loaded 39773 existing records from primary storage. [2025-10-06T17:27:40.694815] [INFO ] [MAIN ] BAK: Loaded 39773 existing records. [2025-10-06T17:27:40.741455] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-06T17:27:40.916167] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:27:40.933370] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-06T17:27:40.933491] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-06T17:27:40.934256] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-06T17:27:40.934327] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-06T17:27:40.935426] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T17:27:41.351841] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:27:41.425511] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-06T17:27:42.225544] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-06T17:27:42.826556] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-06T17:27:43.025510] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-06T17:27:43.127783] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T17:27:43.603799] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T17:27:43.825526] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-06T17:27:44.625545] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-06T17:27:45.052437] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-06T17:27:45.425500] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-06T17:27:45.637263] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T17:27:45.670379] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T17:27:46.225547] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-06T17:27:47.025519] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-06T17:27:47.825505] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-06T17:27:48.132481] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-06T17:27:48.176813] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-06T17:27:48.625493] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-06T17:27:49.189030] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-06T17:27:49.425518] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-06T17:27:49.508663] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-06T17:27:50.225534] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-06T17:27:50.754819] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-06T17:27:50.941198] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T17:27:51.025566] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-06T17:27:51.825583] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-06T17:27:52.625580] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-06T17:27:52.973119] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-06T17:27:53.280704] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-06T17:27:53.402402] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T17:27:53.425486] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-06T17:27:54.225537] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-06T17:27:54.513172] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-06T17:27:54.547217] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-06T17:27:55.025523] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-06T17:27:55.825541] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-06T17:27:56.515543] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T17:27:56.516807] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-06T17:27:56.529854] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-06T17:27:56.530764] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-06T17:27:56.631457] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-06T17:27:56.937593] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-06T17:27:56.937729] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-06T17:27:56.938572] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-06T17:27:56.938619] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-06T17:27:56.940227] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-10-06T17:27:57.284461] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-06T17:27:57.284637] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-06T17:27:57.284778] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BAC took 36.5s. Estimated remaining: 4h 53m 4s. Rate: 7.4 symbols/min [2025-10-06T17:27:57.439028] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-06T17:27:57.466854] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:27:57.524240] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T17:27:57.551780] [DEBUG] [LOCAL ] BALL: Loaded 52561 existing records from primary storage. [2025-10-06T17:27:57.552553] [INFO ] [MAIN ] BALL: Loaded 52561 existing records. [2025-10-06T17:27:57.730282] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:27:57.730602] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-06T17:27:57.730680] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-06T17:27:57.730982] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-06T17:27:57.731046] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-06T17:27:58.081808] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:27:58.225537] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-06T17:27:58.999218] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T17:27:59.025467] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-06T17:27:59.262940] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-06T17:27:59.576686] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T17:27:59.825491] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-06T17:28:00.426364] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-06T17:28:00.625481] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-06T17:28:01.425487] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-06T17:28:01.584772] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-06T17:28:01.587869] [INFO ] [REMOTE ] BAH: Full fetch complete (74887 records). [2025-10-06T17:28:01.588019] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-06T17:28:01.991157] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-06T17:28:01.991349] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-06T17:28:01.992198] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-06T17:28:01.992262] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-06T17:28:01.993815] [DEBUG] [LOCAL ] BAH: Trimmed 74887 records to 51690 (keeping 200 days of data) [2025-10-06T17:28:02.234886] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-06T17:28:02.242687] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T17:28:02.358184] [DEBUG] [LOCAL ] BAH: Primary data saved (51690 records). [2025-10-06T17:28:02.358364] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-06T17:28:02.358451] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAH took 33.7s. Estimated remaining: 4h 52m 24s. Rate: 7.4 symbols/min [2025-10-06T17:28:02.528672] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:28:02.528952] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-06T17:28:02.529010] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-06T17:28:02.529148] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-06T17:28:02.529228] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-06T17:28:02.529349] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-06T17:28:02.529406] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-06T17:28:02.885356] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:28:03.025497] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-06T17:28:03.072211] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T17:28:03.825523] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-06T17:28:04.550210] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-06T17:28:04.552953] [INFO ] [REMOTE ] BAK: Full fetch complete (57143 records). [2025-10-06T17:28:04.553076] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-06T17:28:04.630622] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-06T17:28:04.935517] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-06T17:28:04.935613] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-06T17:28:04.936341] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-06T17:28:04.936404] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-06T17:28:04.937767] [DEBUG] [LOCAL ] BAK: Trimmed 57143 records to 39287 (keeping 200 days of data) [2025-10-06T17:28:05.047368] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-06T17:28:05.052083] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-06T17:28:05.053321] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-06T17:28:05.554384] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-06T17:28:05.556093] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-06T17:28:05.558296] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-06T17:28:05.559020] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-06T17:28:05.565811] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-10-06T17:28:05.709289] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T17:28:05.722917] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-06T17:28:05.743560] [DEBUG] [LOCAL ] BAK: Primary data saved (39287 records). [2025-10-06T17:28:05.744297] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-06T17:28:05.744676] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAK took 25.3s. Estimated remaining: 4h 51m 27s. Rate: 7.4 symbols/min [2025-10-06T17:28:05.881309] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T17:28:05.949751] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:28:06.094770] [DEBUG] [LOCAL ] BAM: Loaded 52767 existing records from primary storage. [2025-10-06T17:28:06.095917] [INFO ] [MAIN ] BAM: Loaded 52767 existing records. [2025-10-06T17:28:06.227786] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-06T17:28:06.287146] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:28:06.288698] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-06T17:28:06.289035] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-06T17:28:06.290015] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-06T17:28:06.290378] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-06T17:28:06.671900] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:28:06.775034] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-06T17:28:06.775219] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-06T17:28:06.776160] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BABA took 50.1s. Estimated remaining: 4h 50m 6s. Rate: 7.5 symbols/min [2025-10-06T17:28:06.942618] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:28:06.995311] [DEBUG] [LOCAL ] BANC: Loaded 52011 existing records from primary storage. [2025-10-06T17:28:06.995703] [INFO ] [MAIN ] BANC: Loaded 52011 existing records. [2025-10-06T17:28:07.027153] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-06T17:28:07.177873] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:28:07.178236] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-06T17:28:07.178317] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-06T17:28:07.178714] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-06T17:28:07.178775] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-06T17:28:07.550846] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:28:07.554031] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T17:28:07.586905] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-06T17:28:07.825479] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-06T17:28:08.565055] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T17:28:08.625540] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-06T17:28:09.188682] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-06T17:28:09.425547] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-06T17:28:09.573355] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T17:28:09.903282] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-06T17:28:10.225545] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-06T17:28:11.025522] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-06T17:28:11.825536] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-06T17:28:11.959032] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T17:28:12.515934] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-06T17:28:12.625507] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-06T17:28:12.823612] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T17:28:13.425537] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-06T17:28:13.545569] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T17:28:14.225598] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-06T17:28:14.936368] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T17:28:15.025540] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-06T17:28:15.683863] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-06T17:28:15.825534] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-06T17:28:16.625484] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-06T17:28:16.743173] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T17:28:16.768462] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T17:28:17.425585] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-06T17:28:18.225525] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-06T17:28:18.274193] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-06T17:28:18.398949] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T17:28:19.025578] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-06T17:28:19.427639] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-06T17:28:19.778422] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T17:28:19.825497] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-06T17:28:20.625547] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-06T17:28:21.425522] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-06T17:28:21.519809] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T17:28:22.225529] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-06T17:28:22.355830] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T17:28:22.989621] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T17:28:23.025486] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-06T17:28:23.825515] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-06T17:28:23.992550] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T17:28:24.625511] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-06T17:28:24.725823] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T17:28:25.425548] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-06T17:28:25.671409] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T17:28:26.028762] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T17:28:26.225535] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-06T17:28:27.025513] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-06T17:28:27.412741] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-06T17:28:27.534915] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T17:28:27.825531] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-06T17:28:28.467190] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T17:28:28.625500] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-06T17:28:29.151382] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T17:28:29.425552] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-06T17:28:30.225497] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-06T17:28:30.435887] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-06T17:28:31.025555] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-06T17:28:31.159589] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T17:28:31.825569] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-06T17:28:31.912754] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-06T17:28:31.915783] [INFO ] [REMOTE ] BALL: Full fetch complete (75361 records). [2025-10-06T17:28:31.915939] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-06T17:28:32.315883] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-06T17:28:32.315987] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-06T17:28:32.316826] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-06T17:28:32.316898] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-06T17:28:32.321043] [DEBUG] [LOCAL ] BALL: Trimmed 75361 records to 51811 (keeping 200 days of data) [2025-10-06T17:28:32.626781] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-06T17:28:32.642447] [DEBUG] [LOCAL ] BALL: Primary data saved (51811 records). [2025-10-06T17:28:32.643100] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-06T17:28:32.643388] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BALL took 35.4s. Estimated remaining: 4h 53m 2s. Rate: 7.4 symbols/min [2025-10-06T17:28:32.821360] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:28:32.859758] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-06T17:28:32.892501] [DEBUG] [LOCAL ] BAP: Loaded 26537 existing records from primary storage. [2025-10-06T17:28:32.892846] [INFO ] [MAIN ] BAP: Loaded 26537 existing records. [2025-10-06T17:28:33.066257] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:28:33.066511] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-06T17:28:33.066560] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-06T17:28:33.066958] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-06T17:28:33.067015] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-06T17:28:33.426313] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:28:33.426406] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-06T17:28:33.499315] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-06T17:28:33.603776] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-06T17:28:34.225546] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-06T17:28:35.018049] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T17:28:35.023803] [INFO ] [REMOTE ] BAM: Full fetch complete (74445 records). [2025-10-06T17:28:35.024095] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-06T17:28:35.030854] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-06T17:28:35.565755] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-06T17:28:35.565889] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-06T17:28:35.566820] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-06T17:28:35.566898] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-06T17:28:35.568854] [DEBUG] [LOCAL ] BAM: Trimmed 74445 records to 52007 (keeping 200 days of data) [2025-10-06T17:28:35.825667] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-06T17:28:35.873021] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T17:28:35.880469] [INFO ] [REMOTE ] BALY: Full fetch complete (16803 records). [2025-10-06T17:28:35.896517] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-06T17:28:36.100756] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T17:28:36.103481] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:28:36.108316] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:28:36.109794] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-06T17:28:36.112901] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-06T17:28:36.113335] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-06T17:28:36.113995] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-06T17:28:36.114438] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BALY took 33.8s. Estimated remaining: 4h 52m 6s. Rate: 7.4 symbols/min [2025-10-06T17:28:36.149330] [DEBUG] [LOCAL ] BAM: Primary data saved (52007 records). [2025-10-06T17:28:36.208680] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-06T17:28:36.225923] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BAM took 30.5s. Estimated remaining: 4h 50m 36s. Rate: 7.4 symbols/min [2025-10-06T17:28:36.290322] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-06T17:28:36.445282] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:28:36.547181] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:28:36.580793] [DEBUG] [LOCAL ] BARK: Loaded 38579 existing records from primary storage. [2025-10-06T17:28:36.581206] [INFO ] [MAIN ] BARK: Loaded 38579 existing records. [2025-10-06T17:28:36.645713] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-06T17:28:36.783627] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:28:36.797788] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-06T17:28:36.799000] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-06T17:28:36.799981] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-06T17:28:36.800194] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-06T17:28:36.800106] [DEBUG] [LOCAL ] BAX: Loaded 54272 existing records from primary storage. [2025-10-06T17:28:36.831331] [INFO ] [MAIN ] BAX: Loaded 54272 existing records. [2025-10-06T17:28:37.218386] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:28:37.276546] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-06T17:28:37.288979] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-06T17:28:37.322964] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-06T17:28:37.323083] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-06T17:28:37.554287] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:28:37.557209] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-06T17:28:37.558611] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T17:28:37.843791] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:28:38.225520] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-06T17:28:38.379441] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T17:28:39.025488] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-06T17:28:39.181293] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T17:28:39.370313] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T17:28:39.825498] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-06T17:28:40.624538] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T17:28:40.634404] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-06T17:28:41.049455] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T17:28:41.425538] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-06T17:28:42.225600] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-06T17:28:42.589839] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-06T17:28:42.620438] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T17:28:42.623485] [INFO ] [REMOTE ] BANC: Full fetch complete (74308 records). [2025-10-06T17:28:42.623622] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-06T17:28:43.011909] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-06T17:28:43.012010] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-06T17:28:43.012818] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-06T17:28:43.012890] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-06T17:28:43.014407] [DEBUG] [LOCAL ] BANC: Trimmed 74308 records to 51268 (keeping 200 days of data) [2025-10-06T17:28:43.065949] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-06T17:28:43.374684] [DEBUG] [LOCAL ] BANC: Primary data saved (51268 records). [2025-10-06T17:28:43.374991] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-06T17:28:43.375542] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BANC took 36.6s. Estimated remaining: 4h 50m 19s. Rate: 7.4 symbols/min [2025-10-06T17:28:43.536966] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T17:28:43.573968] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:28:43.626785] [DEBUG] [LOCAL ] BB: Loaded 53710 existing records from primary storage. [2025-10-06T17:28:43.627185] [INFO ] [MAIN ] BB: Loaded 53710 existing records. [2025-10-06T17:28:43.800160] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:28:43.800438] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-06T17:28:43.800506] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-06T17:28:43.801215] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-06T17:28:43.801274] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-06T17:28:43.831432] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-06T17:28:44.152218] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:28:44.605715] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T17:28:44.625469] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-06T17:28:45.384345] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T17:28:45.425488] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-06T17:28:46.121818] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T17:28:46.225556] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-06T17:28:47.025502] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-06T17:28:47.149311] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T17:28:47.825562] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-06T17:28:48.296194] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-06T17:28:48.373559] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-06T17:28:48.625570] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-06T17:28:49.227523] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T17:28:49.425583] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-06T17:28:49.762596] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T17:28:50.225532] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-06T17:28:51.025622] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-06T17:28:51.315068] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T17:28:51.477000] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T17:28:51.825527] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-06T17:28:52.625544] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-06T17:28:52.758263] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T17:28:53.425591] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-06T17:28:53.607251] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-06T17:28:53.640687] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T17:28:54.225539] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-06T17:28:55.025576] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-06T17:28:55.532176] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-06T17:28:55.825485] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-06T17:28:56.258865] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-06T17:28:56.526443] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T17:28:56.625472] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-06T17:28:57.425486] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-06T17:28:57.970898] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-06T17:28:58.034773] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T17:28:58.225487] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-06T17:28:58.737230] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T17:28:59.025600] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-06T17:28:59.825508] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-06T17:28:59.953475] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T17:29:00.625587] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-06T17:29:01.311779] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-06T17:29:01.411632] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T17:29:01.425473] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-06T17:29:01.864364] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-06T17:29:02.225583] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-06T17:29:02.784005] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T17:29:02.786730] [INFO ] [REMOTE ] BARK: Full fetch complete (56189 records). [2025-10-06T17:29:02.786933] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-06T17:29:03.038196] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-06T17:29:03.175679] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-06T17:29:03.175860] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-06T17:29:03.176574] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-06T17:29:03.176682] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-06T17:29:03.193539] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T17:29:03.199501] [DEBUG] [LOCAL ] BARK: Trimmed 56189 records to 37923 (keeping 200 days of data) [2025-10-06T17:29:03.416508] [DEBUG] [LOCAL ] BARK: Primary data saved (37923 records). [2025-10-06T17:29:03.416711] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-06T17:29:03.416808] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BARK took 27.3s. Estimated remaining: 4h 52m 11s. Rate: 7.4 symbols/min [2025-10-06T17:29:03.598024] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:29:03.650236] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-10-06T17:29:03.650625] [INFO ] [MAIN ] BBAI: Loaded 54600 existing records. [2025-10-06T17:29:03.830614] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-06T17:29:03.830519] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:29:03.831894] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-06T17:29:03.831948] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-06T17:29:03.832263] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-06T17:29:03.832321] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-06T17:29:04.196975] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:29:04.625504] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-06T17:29:04.989742] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-06T17:29:05.151623] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T17:29:05.425580] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-06T17:29:06.225534] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-06T17:29:06.599572] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-06T17:29:07.025502] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-06T17:29:07.179058] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-06T17:29:07.402317] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T17:29:07.825562] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-06T17:29:08.625603] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-06T17:29:08.953571] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-06T17:29:09.425559] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-06T17:29:09.621168] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T17:29:09.644596] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T17:29:09.646335] [INFO ] [REMOTE ] BAP: Full fetch complete (37576 records). [2025-10-06T17:29:09.646412] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-06T17:29:10.012973] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-06T17:29:10.013057] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-06T17:29:10.013515] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-06T17:29:10.013555] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-06T17:29:10.014459] [DEBUG] [LOCAL ] BAP: Trimmed 37576 records to 26098 (keeping 200 days of data) [2025-10-06T17:29:10.170766] [DEBUG] [LOCAL ] BAP: Primary data saved (26098 records). [2025-10-06T17:29:10.170918] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-06T17:29:10.171001] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BAP took 37.5s. Estimated remaining: 4h 51m 49s. Rate: 7.4 symbols/min [2025-10-06T17:29:10.233400] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-06T17:29:10.348246] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:29:10.387266] [DEBUG] [LOCAL ] BBAR: Loaded 42223 existing records from primary storage. [2025-10-06T17:29:10.387594] [INFO ] [MAIN ] BBAR: Loaded 42223 existing records. [2025-10-06T17:29:10.562614] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:29:10.562905] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-06T17:29:10.562960] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-06T17:29:10.564327] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-06T17:29:10.564389] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-06T17:29:10.913430] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:29:11.025511] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-06T17:29:11.545095] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-06T17:29:11.825528] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-06T17:29:11.894533] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T17:29:11.897904] [INFO ] [REMOTE ] BAX: Full fetch complete (77441 records). [2025-10-06T17:29:11.898050] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-06T17:29:12.293154] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-06T17:29:12.293279] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-06T17:29:12.294148] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-06T17:29:12.294288] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-06T17:29:12.296068] [DEBUG] [LOCAL ] BAX: Trimmed 77441 records to 53502 (keeping 200 days of data) [2025-10-06T17:29:12.412291] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T17:29:12.635551] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-06T17:29:12.661381] [DEBUG] [LOCAL ] BAX: Primary data saved (53502 records). [2025-10-06T17:29:12.661511] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-06T17:29:12.661611] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BAX took 36.4s. Estimated remaining: 4h 50m 45s. Rate: 7.4 symbols/min [2025-10-06T17:29:12.835742] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:29:12.889795] [DEBUG] [LOCAL ] BBD: Loaded 53976 existing records from primary storage. [2025-10-06T17:29:12.890132] [INFO ] [MAIN ] BBD: Loaded 53976 existing records. [2025-10-06T17:29:13.065549] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:29:13.065818] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-06T17:29:13.065876] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-06T17:29:13.066221] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-06T17:29:13.066286] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-06T17:29:13.425370] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:29:13.425679] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-06T17:29:13.774545] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T17:29:13.968350] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T17:29:14.225563] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-06T17:29:15.025595] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-06T17:29:15.736198] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T17:29:15.825572] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-06T17:29:15.976392] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-06T17:29:16.625509] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-06T17:29:16.964538] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T17:29:17.007709] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-06T17:29:17.425591] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-06T17:29:18.225523] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-06T17:29:18.718795] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-06T17:29:18.943633] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T17:29:19.025493] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-06T17:29:19.825503] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-06T17:29:20.018453] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T17:29:20.580560] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-06T17:29:20.625590] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-06T17:29:21.425539] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-06T17:29:21.759932] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-06T17:29:21.763005] [INFO ] [REMOTE ] BB: Full fetch complete (76997 records). [2025-10-06T17:29:21.763160] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-06T17:29:22.198346] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-06T17:29:22.214486] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-06T17:29:22.226000] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-06T17:29:22.230402] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-06T17:29:22.232630] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-06T17:29:22.235343] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T17:29:22.247561] [DEBUG] [LOCAL ] BB: Trimmed 76997 records to 52943 (keeping 200 days of data) [2025-10-06T17:29:22.556335] [DEBUG] [LOCAL ] BB: Primary data saved (52943 records). [2025-10-06T17:29:22.556501] [INFO ] [MAIN ] BB: Full history saved. [2025-10-06T17:29:22.556588] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BB took 39.2s. Estimated remaining: 4h 50m 55s. Rate: 7.4 symbols/min [2025-10-06T17:29:22.728284] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:29:22.764601] [DEBUG] [LOCAL ] BBDC: Loaded 33442 existing records from primary storage. [2025-10-06T17:29:22.765151] [INFO ] [MAIN ] BBDC: Loaded 33442 existing records. [2025-10-06T17:29:22.945500] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:29:22.945819] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-06T17:29:22.945932] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-06T17:29:22.946248] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-06T17:29:22.946306] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-06T17:29:23.037682] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-06T17:29:23.308858] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:29:23.825560] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-06T17:29:23.870373] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-06T17:29:23.918081] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T17:29:24.625493] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-06T17:29:24.827814] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T17:29:24.910701] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-06T17:29:25.425538] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-06T17:29:26.225555] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-06T17:29:26.924920] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-06T17:29:26.999502] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T17:29:27.025491] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-06T17:29:27.500935] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T17:29:27.825570] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-06T17:29:28.625511] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-06T17:29:28.736086] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T17:29:29.425545] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-06T17:29:30.000289] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T17:29:30.225535] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-06T17:29:30.562853] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-06T17:29:31.025506] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-06T17:29:31.130492] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T17:29:31.586815] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-06T17:29:31.825539] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-06T17:29:32.461534] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T17:29:32.625522] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-06T17:29:33.425547] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-06T17:29:34.225495] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-06T17:29:34.479335] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T17:29:34.700457] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-10-06T17:29:34.770976] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T17:29:35.025588] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-06T17:29:35.653454] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-06T17:29:35.825539] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-06T17:29:36.625580] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-06T17:29:36.688736] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T17:29:36.691483] [INFO ] [REMOTE ] BBAR: Full fetch complete (60980 records). [2025-10-06T17:29:36.691602] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-06T17:29:37.123595] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-06T17:29:37.123826] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-06T17:29:37.124556] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-06T17:29:37.124634] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-06T17:29:37.126340] [DEBUG] [LOCAL ] BBAR: Trimmed 60980 records to 41588 (keeping 200 days of data) [2025-10-06T17:29:37.366152] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-06T17:29:37.419913] [DEBUG] [LOCAL ] BBAR: Primary data saved (41588 records). [2025-10-06T17:29:37.420088] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-06T17:29:37.420184] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 27.2s. Estimated remaining: 4h 51m 53s. Rate: 7.4 symbols/min [2025-10-06T17:29:37.432479] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-06T17:29:37.601742] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:29:37.609350] [DEBUG] [LOCAL ] BBDO: Loaded 5032 existing records from primary storage. [2025-10-06T17:29:37.609570] [INFO ] [MAIN ] BBDO: Loaded 5032 existing records. [2025-10-06T17:29:37.795242] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:29:37.795535] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-06T17:29:37.795585] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-06T17:29:37.795822] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-06T17:29:37.795882] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-06T17:29:38.180618] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:29:38.225352] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T17:29:38.225668] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-06T17:29:38.505355] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T17:29:39.025531] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-06T17:29:39.050089] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T17:29:39.825539] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-06T17:29:40.442208] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T17:29:40.625512] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-06T17:29:41.425518] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-06T17:29:41.677687] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T17:29:41.876761] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T17:29:42.156788] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T17:29:42.225549] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-06T17:29:43.025537] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-06T17:29:43.548293] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T17:29:43.825551] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-06T17:29:44.625626] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-06T17:29:44.993918] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T17:29:45.425534] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-06T17:29:45.502661] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-06T17:29:46.006064] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T17:29:46.009691] [INFO ] [REMOTE ] BBD: Full fetch complete (77111 records). [2025-10-06T17:29:46.009908] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-06T17:29:46.230745] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-06T17:29:46.439362] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-06T17:29:46.439472] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-06T17:29:46.440396] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-06T17:29:46.440467] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-06T17:29:46.442386] [DEBUG] [LOCAL ] BBD: Trimmed 77111 records to 53215 (keeping 200 days of data) [2025-10-06T17:29:46.664299] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T17:29:46.669857] [INFO ] [REMOTE ] BBDC: Full fetch complete (48607 records). [2025-10-06T17:29:46.670544] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-06T17:29:46.796353] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-06T17:29:47.037167] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-06T17:29:47.212459] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-06T17:29:47.212918] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-06T17:29:47.214041] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-06T17:29:47.214999] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-06T17:29:47.218942] [DEBUG] [LOCAL ] BBDC: Trimmed 48607 records to 32900 (keeping 200 days of data) [2025-10-06T17:29:47.276523] [DEBUG] [LOCAL ] BBD: Primary data saved (53215 records). [2025-10-06T17:29:47.286851] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-06T17:29:47.315723] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBD took 34.7s. Estimated remaining: 4h 52m 3s. Rate: 7.4 symbols/min [2025-10-06T17:29:47.561273] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:29:47.563038] [DEBUG] [LOCAL ] BBN: No existing data file found in primary storage. [2025-10-06T17:29:47.563376] [WARN ] [MAIN ] BBN: No existing data found, performing full refresh instead. [2025-10-06T17:29:47.564184] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-06T17:29:47.564604] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-06T17:29:47.566458] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-06T17:29:47.566930] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-06T17:29:47.826814] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-06T17:29:48.072077] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:29:48.097398] [DEBUG] [LOCAL ] BBDC: Primary data saved (32900 records). [2025-10-06T17:29:48.097505] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-06T17:29:48.098218] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBDC took 25.5s. Estimated remaining: 4h 50m 42s. Rate: 7.4 symbols/min [2025-10-06T17:29:48.284311] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:29:48.284575] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-06T17:29:48.284626] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-06T17:29:48.284767] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-06T17:29:48.284808] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-06T17:29:48.284849] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-06T17:29:48.284881] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-06T17:29:48.574255] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T17:29:48.630609] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-06T17:29:48.696823] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:29:49.425498] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-06T17:29:49.571817] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-06T17:29:49.617157] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:29:49.617543] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-06T17:29:49.617667] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:29:49.617738] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-06T17:29:49.617777] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:29:49.617848] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-06T17:29:49.617919] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-06T17:29:49.617972] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-06T17:29:49.618057] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-06T17:29:49.618119] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBT took 1.5s. Estimated remaining: 4h 49m 30s. Rate: 7.4 symbols/min [2025-10-06T17:29:49.801631] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:29:49.812741] [DEBUG] [LOCAL ] BBU: Loaded 4913 existing records from primary storage. [2025-10-06T17:29:49.813054] [INFO ] [MAIN ] BBU: Loaded 4913 existing records. [2025-10-06T17:29:49.978550] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T17:29:50.044674] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:29:50.044945] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-06T17:29:50.044998] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-06T17:29:50.045209] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-06T17:29:50.045269] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-06T17:29:50.230602] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-06T17:29:50.426829] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:29:51.025520] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-06T17:29:51.695083] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-06T17:29:51.825539] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-06T17:29:52.625534] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-06T17:29:52.803717] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T17:29:53.051113] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-06T17:29:53.425563] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-06T17:29:53.445715] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T17:29:54.225522] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-06T17:29:54.353500] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T17:29:54.846563] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T17:29:55.025566] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-06T17:29:55.680147] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-06T17:29:55.825590] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-06T17:29:56.625546] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-06T17:29:57.425523] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-06T17:29:57.686521] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T17:29:58.095637] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T17:29:58.225510] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-06T17:29:58.624187] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-06T17:29:58.891994] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-06T17:29:59.025530] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-06T17:29:59.600516] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-06T17:29:59.825568] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-06T17:30:00.625516] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-06T17:30:01.182350] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T17:30:01.425598] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-06T17:30:01.720779] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T17:30:02.225525] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-06T17:30:02.541827] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-06T17:30:03.025581] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-06T17:30:03.066842] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T17:30:03.825568] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-06T17:30:04.625556] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-06T17:30:04.920801] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T17:30:05.136842] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-06T17:30:05.425722] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-06T17:30:06.078379] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (3.05 seconds). [2025-10-06T17:30:06.225518] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-06T17:30:06.453968] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T17:30:07.025515] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-06T17:30:07.825508] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-06T17:30:08.067534] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T17:30:08.297074] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-06T17:30:08.625503] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-06T17:30:09.095040] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-06T17:30:09.212269] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-06T17:30:09.215370] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-06T17:30:09.215537] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-06T17:30:09.430780] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-06T17:30:09.602586] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-06T17:30:09.602701] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-06T17:30:09.603519] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-06T17:30:09.603601] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-06T17:30:09.605186] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-06T17:30:09.921185] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-06T17:30:09.921431] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-06T17:30:09.921537] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBAI took 1m 7s. Estimated remaining: 4h 51m 20s. Rate: 7.4 symbols/min [2025-10-06T17:30:10.089851] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:30:10.104712] [DEBUG] [LOCAL ] BBUC: Loaded 13645 existing records from primary storage. [2025-10-06T17:30:10.105023] [INFO ] [MAIN ] BBUC: Loaded 13645 existing records. [2025-10-06T17:30:10.230761] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-06T17:30:10.287372] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:30:10.291267] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-06T17:30:10.291410] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T17:30:10.291582] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-06T17:30:10.294160] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-06T17:30:10.294222] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-06T17:30:10.645621] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:30:11.025543] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-06T17:30:11.310686] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T17:30:11.311987] [INFO ] [REMOTE ] BBN: Full fetch complete (26263 records). [2025-10-06T17:30:11.312067] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-06T17:30:11.312617] [FATAL] [VALIDATOR ] BBN: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:30:11.312725] [FATAL] [MAIN ] BBN: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:30:11.312768] [WARN ] [MAIN ] BBN: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:30:11.312834] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-06T17:30:11.312976] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-06T17:30:11.313038] [INFO ] [LOCAL ] BBN: Starting deletion of derivative data. [2025-10-06T17:30:11.313099] [DEBUG] [LOCAL ] BBN: No derivative data file found to delete. [2025-10-06T17:30:11.313179] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBN took 24.0s. Estimated remaining: 4h 50m 7s. Rate: 7.4 symbols/min [2025-10-06T17:30:11.512961] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-06T17:30:11.547831] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:30:11.548062] [DEBUG] [LOCAL ] BBVA: No existing data file found in primary storage. [2025-10-06T17:30:11.548119] [WARN ] [MAIN ] BBVA: No existing data found, performing full refresh instead. [2025-10-06T17:30:11.548239] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-06T17:30:11.548281] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-06T17:30:11.548326] [DEBUG] [LOCAL ] BBVA: No primary data file found to delete. [2025-10-06T17:30:11.548378] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-06T17:30:11.830605] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-06T17:30:12.008152] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:30:12.545091] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T17:30:12.546084] [INFO ] [REMOTE ] BBDO: Full fetch complete (7638 records). [2025-10-06T17:30:12.546155] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-06T17:30:12.630634] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-06T17:30:12.909671] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-06T17:30:12.909776] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-06T17:30:12.909978] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-06T17:30:12.910019] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-06T17:30:12.910439] [DEBUG] [LOCAL ] BBDO: Trimmed 7638 records to 4950 (keeping 200 days of data) [2025-10-06T17:30:12.941115] [DEBUG] [LOCAL ] BBDO: Primary data saved (4950 records). [2025-10-06T17:30:12.941291] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-06T17:30:12.941382] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBDO took 35.5s. Estimated remaining: 4h 48m 57s. Rate: 7.4 symbols/min [2025-10-06T17:30:13.120033] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:30:13.120289] [DEBUG] [LOCAL ] BBW: No existing data file found in primary storage. [2025-10-06T17:30:13.120327] [WARN ] [MAIN ] BBW: No existing data found, performing full refresh instead. [2025-10-06T17:30:13.120450] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-06T17:30:13.120492] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-06T17:30:13.120533] [DEBUG] [LOCAL ] BBW: No primary data file found to delete. [2025-10-06T17:30:13.120567] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-06T17:30:13.430724] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-06T17:30:13.497192] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:30:14.225512] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-06T17:30:14.245101] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T17:30:14.560460] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-06T17:30:15.025576] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-06T17:30:15.825528] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-06T17:30:16.625530] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-06T17:30:16.745959] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T17:30:17.036528] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-06T17:30:17.221987] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T17:30:17.313583] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T17:30:17.425554] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-06T17:30:18.225548] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-06T17:30:19.025534] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-06T17:30:19.078960] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T17:30:19.404905] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T17:30:19.825577] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-06T17:30:20.332568] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T17:30:20.625623] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-06T17:30:21.425532] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-06T17:30:21.464849] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T17:30:21.660128] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T17:30:22.225505] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-06T17:30:22.627465] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T17:30:23.025589] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-06T17:30:23.828794] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-06T17:30:23.832762] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T17:30:24.353567] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-06T17:30:24.625554] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-06T17:30:24.767356] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T17:30:25.425598] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-06T17:30:25.872355] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-06T17:30:26.225598] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-06T17:30:27.025533] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-06T17:30:27.111065] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T17:30:27.214761] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T17:30:27.825514] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-06T17:30:27.983382] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T17:30:28.625547] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-06T17:30:29.313218] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T17:30:29.314459] [INFO ] [REMOTE ] BBU: Full fetch complete (6824 records). [2025-10-06T17:30:29.314534] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-06T17:30:29.427220] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-06T17:30:29.710857] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-06T17:30:29.716734] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-06T17:30:29.725528] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-06T17:30:29.726125] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-06T17:30:29.726201] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-06T17:30:29.726969] [DEBUG] [LOCAL ] BBU: Trimmed 6824 records to 4930 (keeping 200 days of data) [2025-10-06T17:30:29.757167] [DEBUG] [LOCAL ] BBU: Primary data saved (4930 records). [2025-10-06T17:30:29.757271] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-06T17:30:29.757363] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBU took 40.1s. Estimated remaining: 4h 50m 13s. Rate: 7.4 symbols/min [2025-10-06T17:30:29.928293] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:30:29.997032] [DEBUG] [LOCAL ] BBWI: Loaded 54360 existing records from primary storage. [2025-10-06T17:30:29.997456] [INFO ] [MAIN ] BBWI: Loaded 54360 existing records. [2025-10-06T17:30:30.177450] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:30:30.177740] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-06T17:30:30.177797] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-06T17:30:30.179600] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-06T17:30:30.179690] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-06T17:30:30.237012] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-06T17:30:30.564304] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:30:30.788295] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T17:30:31.025530] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-06T17:30:31.825535] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-06T17:30:31.974691] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-06T17:30:32.180636] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-06T17:30:32.625591] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-06T17:30:33.425484] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-06T17:30:33.484774] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-06T17:30:33.678937] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T17:30:34.225551] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-06T17:30:34.416993] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T17:30:35.025533] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-06T17:30:35.825541] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-06T17:30:36.016755] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T17:30:36.631291] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-06T17:30:36.659118] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T17:30:36.905124] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T17:30:37.425560] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-06T17:30:38.225501] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-06T17:30:38.333596] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T17:30:38.402263] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-06T17:30:39.025581] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-06T17:30:39.825561] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-06T17:30:39.977355] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T17:30:40.553046] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T17:30:40.625482] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-06T17:30:41.324190] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T17:30:41.327180] [INFO ] [REMOTE ] BBVA: Full fetch complete (71587 records). [2025-10-06T17:30:41.327324] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-06T17:30:41.426414] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-06T17:30:41.719144] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-06T17:30:41.719241] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-06T17:30:41.720013] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-06T17:30:41.720080] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-06T17:30:41.721637] [DEBUG] [LOCAL ] BBVA: Trimmed 71587 records to 49200 (keeping 200 days of data) [2025-10-06T17:30:42.030076] [DEBUG] [LOCAL ] BBVA: Primary data saved (49200 records). [2025-10-06T17:30:42.030280] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-06T17:30:42.030395] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBVA took 30.7s. Estimated remaining: 4h 50m 44s. Rate: 7.4 symbols/min [2025-10-06T17:30:42.174168] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T17:30:42.203185] [INFO ] [REMOTE ] BBW: Full fetch complete (39416 records). [2025-10-06T17:30:42.204301] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-06T17:30:42.222038] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:30:42.234447] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-06T17:30:42.454082] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T17:30:42.624441] [DEBUG] [LOCAL ] BBY: Loaded 54237 existing records from primary storage. [2025-10-06T17:30:42.640262] [INFO ] [MAIN ] BBY: Loaded 54237 existing records. [2025-10-06T17:30:42.804868] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-06T17:30:42.804992] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-06T17:30:42.805875] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-06T17:30:42.805964] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-06T17:30:42.856121] [DEBUG] [LOCAL ] BBW: Trimmed 39416 records to 26836 (keeping 200 days of data) [2025-10-06T17:30:42.936912] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:30:42.945820] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-06T17:30:42.945882] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-06T17:30:42.977756] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-06T17:30:42.978342] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-06T17:30:43.032756] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-06T17:30:43.352958] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:30:43.420191] [DEBUG] [LOCAL ] BBW: Primary data saved (26836 records). [2025-10-06T17:30:43.420364] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-06T17:30:43.420448] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBW took 30.5s. Estimated remaining: 4h 49m 32s. Rate: 7.4 symbols/min [2025-10-06T17:30:43.590495] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:30:43.633742] [DEBUG] [LOCAL ] BC: Loaded 44767 existing records from primary storage. [2025-10-06T17:30:43.634134] [INFO ] [MAIN ] BC: Loaded 44767 existing records. [2025-10-06T17:30:43.818108] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:30:43.818780] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-06T17:30:43.818866] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-06T17:30:43.820268] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-06T17:30:43.820332] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-06T17:30:43.852467] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-06T17:30:43.940251] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-06T17:30:44.202707] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:30:44.233822] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-06T17:30:44.625612] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-06T17:30:45.425520] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-06T17:30:45.752723] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T17:30:46.232877] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-06T17:30:46.250103] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T17:30:46.370064] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T17:30:47.025545] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-06T17:30:47.825503] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-06T17:30:48.149565] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T17:30:48.625551] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-06T17:30:48.789575] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T17:30:49.122934] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T17:30:49.342619] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-06T17:30:49.345500] [INFO ] [REMOTE ] BBUC: Full fetch complete (18310 records). [2025-10-06T17:30:49.345749] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-06T17:30:49.430629] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-06T17:30:49.714559] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-06T17:30:49.714672] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-06T17:30:49.715031] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-06T17:30:49.715071] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-06T17:30:49.715618] [DEBUG] [LOCAL ] BBUC: Trimmed 18310 records to 13388 (keeping 200 days of data) [2025-10-06T17:30:49.801523] [DEBUG] [LOCAL ] BBUC: Primary data saved (13388 records). [2025-10-06T17:30:49.801718] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-06T17:30:49.801813] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBUC took 39.9s. Estimated remaining: 4h 49m 8s. Rate: 7.4 symbols/min [2025-10-06T17:30:49.968865] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:30:50.006888] [DEBUG] [LOCAL ] BCAT: Loaded 34696 existing records from primary storage. [2025-10-06T17:30:50.007253] [INFO ] [MAIN ] BCAT: Loaded 34696 existing records. [2025-10-06T17:30:50.185182] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:30:50.185407] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-06T17:30:50.185453] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-06T17:30:50.186590] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-06T17:30:50.186684] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-06T17:30:50.230756] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-06T17:30:50.535172] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:30:51.025538] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-06T17:30:51.137251] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T17:30:51.809996] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T17:30:51.825482] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-06T17:30:52.440590] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T17:30:52.625597] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-06T17:30:53.425512] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-06T17:30:53.732870] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-06T17:30:54.236026] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-06T17:30:54.242449] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T17:30:54.950365] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T17:30:55.025558] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-06T17:30:55.719895] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T17:30:55.825543] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-06T17:30:56.625554] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-06T17:30:56.930639] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-06T17:30:57.211761] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T17:30:57.425535] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-06T17:30:58.225561] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-06T17:30:58.630770] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T17:30:59.025547] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-06T17:30:59.280920] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T17:30:59.708484] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T17:30:59.825546] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-06T17:31:00.111082] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-06T17:31:00.625543] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-06T17:31:01.425524] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-06T17:31:01.579160] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T17:31:01.974219] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-06T17:31:02.225544] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-06T17:31:02.862598] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T17:31:03.025494] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-06T17:31:03.825503] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-06T17:31:03.935083] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T17:31:03.938687] [INFO ] [REMOTE ] BBWI: Full fetch complete (77434 records). [2025-10-06T17:31:03.938825] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-06T17:31:04.412568] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-06T17:31:04.412820] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-06T17:31:04.413823] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-06T17:31:04.413919] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-06T17:31:04.415414] [DEBUG] [LOCAL ] BBWI: Trimmed 77434 records to 53581 (keeping 200 days of data) [2025-10-06T17:31:04.636549] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-06T17:31:04.693708] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T17:31:04.802670] [DEBUG] [LOCAL ] BBWI: Primary data saved (53581 records). [2025-10-06T17:31:04.802867] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-06T17:31:04.803723] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBWI took 35.0s. Estimated remaining: 4h 50m 4s. Rate: 7.4 symbols/min [2025-10-06T17:31:04.976438] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:31:05.008016] [DEBUG] [LOCAL ] BCC: Loaded 28698 existing records from primary storage. [2025-10-06T17:31:05.008324] [INFO ] [MAIN ] BCC: Loaded 28698 existing records. [2025-10-06T17:31:05.197788] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:31:05.198035] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-06T17:31:05.198085] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-06T17:31:05.199065] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-06T17:31:05.199127] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-06T17:31:05.430267] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-06T17:31:05.610238] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:31:05.638188] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T17:31:06.225562] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-06T17:31:07.037103] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-06T17:31:07.074802] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-06T17:31:07.148678] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T17:31:07.240896] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-06T17:31:07.825548] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-06T17:31:08.626255] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-06T17:31:08.626158] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T17:31:09.406568] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T17:31:09.425528] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-06T17:31:10.225583] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-06T17:31:10.357870] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T17:31:10.955545] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T17:31:11.025532] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-06T17:31:11.640430] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T17:31:11.825539] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-06T17:31:12.387543] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T17:31:12.391041] [INFO ] [REMOTE ] BC: Full fetch complete (63736 records). [2025-10-06T17:31:12.391212] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-06T17:31:12.633947] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-06T17:31:12.825774] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-06T17:31:12.825897] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-06T17:31:12.826698] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-06T17:31:12.826771] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-06T17:31:12.828416] [DEBUG] [LOCAL ] BC: Trimmed 63736 records to 44177 (keeping 200 days of data) [2025-10-06T17:31:13.227077] [DEBUG] [LOCAL ] BC: Primary data saved (44177 records). [2025-10-06T17:31:13.227368] [INFO ] [MAIN ] BC: Full history saved. [2025-10-06T17:31:13.227531] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BC took 29.8s. Estimated remaining: 4h 49m 59s. Rate: 7.4 symbols/min [2025-10-06T17:31:13.426521] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-06T17:31:13.496998] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:31:13.534975] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T17:31:13.602924] [DEBUG] [LOCAL ] BCE: Loaded 52991 existing records from primary storage. [2025-10-06T17:31:13.603337] [INFO ] [MAIN ] BCE: Loaded 52991 existing records. [2025-10-06T17:31:13.802365] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:31:13.802738] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-06T17:31:13.802794] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-06T17:31:13.804465] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-06T17:31:13.804532] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-06T17:31:14.203243] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:31:14.225490] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-06T17:31:14.652418] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-06T17:31:14.795010] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T17:31:15.025548] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-06T17:31:15.825526] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-06T17:31:15.987927] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T17:31:16.625498] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-06T17:31:16.975139] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T17:31:17.154135] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T17:31:17.425526] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-06T17:31:18.225550] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-06T17:31:18.385400] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T17:31:19.011766] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T17:31:19.025463] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-06T17:31:19.295093] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T17:31:19.825527] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-06T17:31:20.169038] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-06T17:31:20.625544] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-06T17:31:21.425514] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-06T17:31:21.467685] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T17:31:21.909170] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-06T17:31:22.225528] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-06T17:31:22.364758] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T17:31:22.367181] [INFO ] [REMOTE ] BCAT: Full fetch complete (50117 records). [2025-10-06T17:31:22.367270] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-06T17:31:22.750572] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-06T17:31:22.750687] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-06T17:31:22.751321] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-06T17:31:22.751385] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-06T17:31:22.752404] [DEBUG] [LOCAL ] BCAT: Trimmed 50117 records to 34068 (keeping 200 days of data) [2025-10-06T17:31:22.969718] [DEBUG] [LOCAL ] BCAT: Primary data saved (34068 records). [2025-10-06T17:31:22.969899] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-06T17:31:22.969994] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BCAT took 33.2s. Estimated remaining: 4h 50m 6s. Rate: 7.4 symbols/min [2025-10-06T17:31:23.030624] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-06T17:31:23.151121] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:31:23.178714] [DEBUG] [LOCAL ] BCH: Loaded 30138 existing records from primary storage. [2025-10-06T17:31:23.179018] [INFO ] [MAIN ] BCH: Loaded 30138 existing records. [2025-10-06T17:31:23.352121] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:31:23.352374] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-06T17:31:23.352423] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-06T17:31:23.353408] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-06T17:31:23.353469] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-06T17:31:23.708045] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:31:23.825546] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-06T17:31:24.003328] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T17:31:24.259353] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T17:31:24.625557] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-06T17:31:25.149190] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T17:31:25.425534] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-06T17:31:26.225500] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-06T17:31:26.450366] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T17:31:27.025488] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-06T17:31:27.314612] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T17:31:27.353437] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-06T17:31:27.825529] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-06T17:31:28.625501] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-06T17:31:28.716037] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-06T17:31:28.719331] [INFO ] [REMOTE ] BBY: Full fetch complete (77235 records). [2025-10-06T17:31:28.719500] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-06T17:31:29.182091] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-06T17:31:29.178223] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T17:31:29.182220] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-06T17:31:29.188286] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-06T17:31:29.189038] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-06T17:31:29.190897] [DEBUG] [LOCAL ] BBY: Trimmed 77235 records to 53463 (keeping 200 days of data) [2025-10-06T17:31:29.425531] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-06T17:31:29.535053] [DEBUG] [LOCAL ] BBY: Primary data saved (53463 records). [2025-10-06T17:31:29.535234] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-06T17:31:29.535322] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BBY took 47.5s. Estimated remaining: 4h 49m 43s. Rate: 7.4 symbols/min [2025-10-06T17:31:29.721026] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:31:29.749906] [DEBUG] [LOCAL ] BCO: Loaded 26271 existing records from primary storage. [2025-10-06T17:31:29.750256] [INFO ] [MAIN ] BCO: Loaded 26271 existing records. [2025-10-06T17:31:29.971477] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:31:29.971813] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-06T17:31:29.971863] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-06T17:31:29.972697] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-06T17:31:29.972766] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-06T17:31:30.227242] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-06T17:31:30.330339] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:31:30.379535] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T17:31:30.715250] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-06T17:31:31.025536] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-06T17:31:31.469047] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T17:31:31.825556] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-06T17:31:32.625499] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-06T17:31:32.715269] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T17:31:33.126220] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T17:31:33.425524] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-06T17:31:33.785437] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T17:31:34.225576] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-06T17:31:34.804933] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T17:31:35.025487] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-06T17:31:35.464627] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T17:31:35.825571] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-06T17:31:36.539577] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T17:31:36.625550] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-06T17:31:37.425533] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-06T17:31:37.729922] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T17:31:37.886714] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-06T17:31:38.225485] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-06T17:31:38.464050] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-06T17:31:39.025552] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-06T17:31:39.357731] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T17:31:39.360883] [INFO ] [REMOTE ] BCC: Full fetch complete (40897 records). [2025-10-06T17:31:39.361190] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-06T17:31:39.733055] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-06T17:31:39.733184] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-06T17:31:39.733699] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-06T17:31:39.733763] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-06T17:31:39.734733] [DEBUG] [LOCAL ] BCC: Trimmed 40897 records to 28240 (keeping 200 days of data) [2025-10-06T17:31:39.836749] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-06T17:31:39.872299] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-06T17:31:39.962735] [DEBUG] [LOCAL ] BCC: Primary data saved (28240 records). [2025-10-06T17:31:39.962952] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-06T17:31:39.963065] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 35.2s. Estimated remaining: 4h 49m 56s. Rate: 7.4 symbols/min [2025-10-06T17:31:40.148729] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:31:40.213064] [DEBUG] [LOCAL ] BCS: Loaded 54229 existing records from primary storage. [2025-10-06T17:31:40.213567] [INFO ] [MAIN ] BCS: Loaded 54229 existing records. [2025-10-06T17:31:40.411152] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:31:40.411512] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-06T17:31:40.411586] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-06T17:31:40.412094] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-06T17:31:40.412154] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-06T17:31:40.635037] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-06T17:31:40.782500] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:31:41.425499] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-06T17:31:41.635248] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T17:31:41.930313] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T17:31:42.225551] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-06T17:31:43.025582] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-06T17:31:43.226887] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T17:31:43.825550] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-06T17:31:44.091766] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-06T17:31:44.290985] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T17:31:44.625555] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-06T17:31:45.430723] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-06T17:31:45.453711] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T17:31:46.127999] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T17:31:46.131290] [INFO ] [REMOTE ] BCE: Full fetch complete (75974 records). [2025-10-06T17:31:46.131449] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-06T17:31:46.230757] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-06T17:31:46.587385] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-06T17:31:46.587993] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-06T17:31:46.589047] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-06T17:31:46.589140] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-06T17:31:46.591751] [DEBUG] [LOCAL ] BCE: Trimmed 75974 records to 52216 (keeping 200 days of data) [2025-10-06T17:31:46.858283] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-06T17:31:46.977065] [DEBUG] [LOCAL ] BCE: Primary data saved (52216 records). [2025-10-06T17:31:46.977263] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-06T17:31:46.977367] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCE took 33.7s. Estimated remaining: 4h 49m 38s. Rate: 7.4 symbols/min [2025-10-06T17:31:47.030872] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-06T17:31:47.174936] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:31:47.215360] [DEBUG] [LOCAL ] BCSF: Loaded 28192 existing records from primary storage. [2025-10-06T17:31:47.215866] [INFO ] [MAIN ] BCSF: Loaded 28192 existing records. [2025-10-06T17:31:47.454532] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:31:47.454929] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-06T17:31:47.454994] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-06T17:31:47.456129] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-06T17:31:47.456206] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-06T17:31:47.830620] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-06T17:31:47.908427] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:31:48.110508] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-06T17:31:48.195160] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T17:31:48.625554] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-06T17:31:48.913628] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T17:31:49.425591] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-06T17:31:50.225564] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-06T17:31:50.309121] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T17:31:50.428515] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T17:31:51.025560] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-06T17:31:51.546618] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T17:31:51.825569] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-06T17:31:52.598779] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T17:31:52.625486] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-06T17:31:53.052436] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-06T17:31:53.425565] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-06T17:31:53.999094] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T17:31:54.225549] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-06T17:31:54.664854] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T17:31:54.667541] [INFO ] [REMOTE ] BCH: Full fetch complete (40919 records). [2025-10-06T17:31:54.667637] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-06T17:31:55.037353] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-06T17:31:55.095407] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-06T17:31:55.095513] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-06T17:31:55.096201] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-06T17:31:55.096273] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-06T17:31:55.097549] [DEBUG] [LOCAL ] BCH: Trimmed 40919 records to 29704 (keeping 200 days of data) [2025-10-06T17:31:55.285761] [DEBUG] [LOCAL ] BCH: Primary data saved (29704 records). [2025-10-06T17:31:55.285937] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-06T17:31:55.286037] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCH took 32.3s. Estimated remaining: 4h 49m 31s. Rate: 7.4 symbols/min [2025-10-06T17:31:55.491114] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T17:31:55.495476] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:31:55.526226] [DEBUG] [LOCAL ] BCX: Loaded 22000 existing records from primary storage. [2025-10-06T17:31:55.526578] [INFO ] [MAIN ] BCX: Loaded 22000 existing records. [2025-10-06T17:31:55.724375] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:31:55.724697] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-06T17:31:55.724772] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-06T17:31:55.725083] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-06T17:31:55.725143] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-06T17:31:55.830772] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-06T17:31:56.136930] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:31:56.155476] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T17:31:56.625579] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-06T17:31:57.425518] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-06T17:31:57.936408] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T17:31:57.935793] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-06T17:31:58.225499] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-06T17:31:58.377202] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T17:31:59.025486] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-06T17:31:59.486824] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T17:31:59.825547] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-06T17:32:00.158781] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T17:32:00.625591] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-06T17:32:01.425552] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-06T17:32:01.513139] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T17:32:02.225571] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-06T17:32:02.549762] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-06T17:32:02.864208] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T17:32:03.025496] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-06T17:32:03.173847] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T17:32:03.176274] [INFO ] [REMOTE ] BCO: Full fetch complete (36598 records). [2025-10-06T17:32:03.176777] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-06T17:32:03.587624] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-06T17:32:03.587766] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-06T17:32:03.588337] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-06T17:32:03.588383] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-06T17:32:03.589866] [DEBUG] [LOCAL ] BCO: Trimmed 36598 records to 25863 (keeping 200 days of data) [2025-10-06T17:32:03.763298] [DEBUG] [LOCAL ] BCO: Primary data saved (25863 records). [2025-10-06T17:32:03.763503] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-06T17:32:03.763626] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCO took 34.2s. Estimated remaining: 4h 49m 26s. Rate: 7.4 symbols/min [2025-10-06T17:32:03.834117] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-06T17:32:03.962784] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:32:03.991804] [DEBUG] [LOCAL ] BDC: Loaded 24963 existing records from primary storage. [2025-10-06T17:32:03.992188] [INFO ] [MAIN ] BDC: Loaded 24963 existing records. [2025-10-06T17:32:04.190203] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:32:04.190573] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-06T17:32:04.190627] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-06T17:32:04.190981] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-06T17:32:04.191046] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-06T17:32:04.472850] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T17:32:04.629171] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:32:04.625599] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-06T17:32:05.076523] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T17:32:05.425609] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-06T17:32:05.943035] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T17:32:06.141108] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T17:32:06.225570] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-06T17:32:07.025552] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-06T17:32:07.388627] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T17:32:07.825555] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-06T17:32:08.625581] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-06T17:32:09.016040] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T17:32:09.130697] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-06T17:32:09.425547] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-06T17:32:09.507968] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-06T17:32:10.225625] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-06T17:32:11.025484] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-06T17:32:11.339607] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-06T17:32:11.424693] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-06T17:32:11.825553] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-06T17:32:12.265975] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T17:32:12.625584] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-06T17:32:13.425564] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-06T17:32:13.795481] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-06T17:32:13.999560] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T17:32:14.225554] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-06T17:32:14.714194] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-06T17:32:15.025544] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-06T17:32:15.825594] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-06T17:32:16.174578] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-06T17:32:16.178101] [INFO ] [REMOTE ] BCS: Full fetch complete (77331 records). [2025-10-06T17:32:16.178243] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-06T17:32:16.520023] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T17:32:16.556086] [INFO ] [REMOTE ] BCSF: Full fetch complete (38623 records). [2025-10-06T17:32:16.572594] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-06T17:32:16.632882] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-06T17:32:16.658241] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-06T17:32:16.672033] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-06T17:32:16.704244] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-06T17:32:16.740793] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-06T17:32:16.816807] [DEBUG] [LOCAL ] BCS: Trimmed 77331 records to 53449 (keeping 200 days of data) [2025-10-06T17:32:17.166563] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T17:32:17.211835] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-06T17:32:17.212937] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-06T17:32:17.214267] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-06T17:32:17.214679] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-06T17:32:17.218270] [DEBUG] [LOCAL ] BCSF: Trimmed 38623 records to 27719 (keeping 200 days of data) [2025-10-06T17:32:17.426186] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-06T17:32:17.595141] [DEBUG] [LOCAL ] BCSF: Primary data saved (27719 records). [2025-10-06T17:32:17.595991] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-06T17:32:17.599422] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCSF took 30.6s. Estimated remaining: 4h 50m 9s. Rate: 7.4 symbols/min [2025-10-06T17:32:17.683228] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T17:32:17.717664] [DEBUG] [LOCAL ] BCS: Primary data saved (53449 records). [2025-10-06T17:32:17.717900] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-06T17:32:17.719438] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCS took 37.8s. Estimated remaining: 4h 48m 49s. Rate: 7.4 symbols/min [2025-10-06T17:32:18.225610] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-06T17:32:18.713163] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-06T17:32:19.025687] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-06T17:32:19.375515] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T17:32:19.825563] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-06T17:32:20.444109] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-06T17:32:20.625584] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-06T17:32:20.992675] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T17:32:21.425782] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-06T17:32:21.747964] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-06T17:32:22.130667] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-06T17:32:22.225617] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-06T17:32:23.025515] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-06T17:32:23.340543] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T17:32:23.806182] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-06T17:32:23.825559] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-06T17:32:24.625552] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-06T17:32:24.990210] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T17:32:25.425539] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-06T17:32:25.825195] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T17:32:25.828086] [INFO ] [REMOTE ] BCX: Full fetch complete (33955 records). [2025-10-06T17:32:25.828324] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-06T17:32:26.251304] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-06T17:32:26.251511] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-06T17:32:26.252148] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-06T17:32:26.252234] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-06T17:32:26.253909] [DEBUG] [LOCAL ] BCX: Trimmed 33955 records to 21592 (keeping 200 days of data) [2025-10-06T17:32:26.371423] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T17:32:26.383300] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-06T17:32:26.417914] [DEBUG] [LOCAL ] BCX: Primary data saved (21592 records). [2025-10-06T17:32:26.418068] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-06T17:32:26.418170] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCX took 31.1s. Estimated remaining: 4h 48m 46s. Rate: 7.4 symbols/min [2025-10-06T17:32:27.234297] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-06T17:32:27.240586] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-06T17:32:28.238463] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T17:32:28.240481] [INFO ] [REMOTE ] BDC: Full fetch complete (35973 records). [2025-10-06T17:32:28.240579] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-06T17:32:28.643437] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-06T17:32:28.643528] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-06T17:32:28.644034] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-06T17:32:28.644098] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-06T17:32:28.644978] [DEBUG] [LOCAL ] BDC: Trimmed 35973 records to 24628 (keeping 200 days of data) [2025-10-06T17:32:28.814268] [DEBUG] [LOCAL ] BDC: Primary data saved (24628 records). [2025-10-06T17:32:28.814466] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-06T17:32:28.814561] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 25.1s. Estimated remaining: 4h 47m 47s. Rate: 7.4 symbols/min [2025-10-06T17:32:29.517307] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:32:29.564466] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:32:29.566945] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:32:29.673142] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:32:29.730738] [DEBUG] [LOCAL ] BDJ: Loaded 29333 existing records from primary storage. [2025-10-06T17:32:29.731424] [INFO ] [MAIN ] BDJ: Loaded 29333 existing records. [2025-10-06T17:32:29.863923] [DEBUG] [LOCAL ] BDX: Loaded 53085 existing records from primary storage. [2025-10-06T17:32:29.898832] [INFO ] [MAIN ] BDX: Loaded 53085 existing records. [2025-10-06T17:32:29.957953] [DEBUG] [LOCAL ] BDN: Loaded 48182 existing records from primary storage. [2025-10-06T17:32:30.007989] [INFO ] [MAIN ] BDN: Loaded 48182 existing records. [2025-10-06T17:32:30.104409] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:32:30.202605] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-10-06T17:32:30.177633] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-06T17:32:30.217272] [INFO ] [MAIN ] BE: Loaded 54433 existing records. [2025-10-06T17:32:30.247929] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-06T17:32:30.362056] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-06T17:32:30.473313] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:32:30.463004] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-06T17:32:30.516209] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-06T17:32:30.567368] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-06T17:32:30.570754] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:32:30.594433] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-06T17:32:30.613417] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-06T17:32:30.618827] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-06T17:32:30.724787] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-06T17:32:30.819907] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:32:30.835749] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-06T17:32:30.857440] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-06T17:32:30.868055] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-06T17:32:30.902484] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-06T17:32:30.960726] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-06T17:32:31.081517] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-06T17:32:32.104220] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:32:32.129986] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:32:32.177036] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-06T17:32:32.173194] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-06T17:32:32.338353] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:32:32.357229] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-06T17:32:32.378105] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:32:32.378446] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-06T17:32:33.576491] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T17:32:33.583377] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-06T17:32:34.108380] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-06T17:32:34.121855] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-06T17:32:34.380175] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-06T17:32:34.390191] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-06T17:32:34.513365] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-06T17:32:34.525045] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-06T17:32:34.562017] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T17:32:34.568698] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-06T17:32:35.737796] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T17:32:35.745357] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-06T17:32:35.916096] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T17:32:35.928866] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-06T17:32:35.955710] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T17:32:36.274543] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T17:32:36.625503] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-06T17:32:36.999198] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-06T17:32:37.425554] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-06T17:32:37.532474] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T17:32:38.225501] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-06T17:32:38.691513] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-06T17:32:38.987284] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T17:32:39.025494] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-06T17:32:39.618281] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T17:32:39.825564] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-06T17:32:40.628599] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-06T17:32:40.638063] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T17:32:41.008706] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T17:32:41.425621] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-06T17:32:42.232753] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-06T17:32:42.240434] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T17:32:43.006886] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T17:32:43.025490] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-06T17:32:43.825480] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-06T17:32:44.357042] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-06T17:32:44.418678] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-06T17:32:44.625544] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-06T17:32:45.157379] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-06T17:32:45.425617] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-06T17:32:46.225544] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-06T17:32:46.296365] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T17:32:46.957246] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T17:32:47.025564] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-06T17:32:47.825536] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-06T17:32:48.228508] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-06T17:32:48.625518] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-06T17:32:48.676882] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T17:32:49.430753] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-06T17:32:49.451393] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T17:32:50.225505] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-06T17:32:50.330328] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T17:32:50.674724] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-06T17:32:51.025556] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-06T17:32:51.825566] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-06T17:32:51.881152] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T17:32:52.357208] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T17:32:52.625554] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-06T17:32:53.425504] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-06T17:32:53.652115] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T17:32:53.759203] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T17:32:54.225544] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-06T17:32:54.947722] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T17:32:55.025607] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-06T17:32:55.825576] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-06T17:32:56.581258] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-06T17:32:56.625580] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-06T17:32:57.019041] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T17:32:57.425498] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-06T17:32:57.531562] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T17:32:58.225560] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-06T17:32:58.459619] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T17:32:58.461699] [INFO ] [REMOTE ] BDJ: Full fetch complete (42918 records). [2025-10-06T17:32:58.461800] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-06T17:32:58.955187] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-06T17:32:58.955403] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-06T17:32:58.956242] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-06T17:32:58.956497] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-06T17:32:58.993983] [DEBUG] [LOCAL ] BDJ: Trimmed 42918 records to 28945 (keeping 200 days of data) [2025-10-06T17:32:58.996958] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-06T17:32:59.066965] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-06T17:32:59.211855] [DEBUG] [LOCAL ] BDJ: Primary data saved (28945 records). [2025-10-06T17:32:59.212042] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-06T17:32:59.212164] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 30.4s. Estimated remaining: 4h 50m 56s. Rate: 7.3 symbols/min [2025-10-06T17:32:59.401763] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:32:59.401972] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-06T17:32:59.402027] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-06T17:32:59.402148] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-06T17:32:59.402188] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-06T17:32:59.402228] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-06T17:32:59.402280] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-06T17:32:59.765843] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:32:59.806479] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T17:32:59.825515] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-06T17:33:00.420780] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-06T17:33:00.625552] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-06T17:33:01.425558] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-06T17:33:01.669982] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-06T17:33:01.764108] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-06T17:33:02.225571] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-06T17:33:02.380227] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T17:33:02.468489] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-06T17:33:03.025582] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-06T17:33:03.514557] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-06T17:33:03.825545] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-06T17:33:04.625585] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-06T17:33:05.279107] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T17:33:05.285194] [INFO ] [REMOTE ] BDN: Full fetch complete (69244 records). [2025-10-06T17:33:05.285512] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-06T17:33:05.430763] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-06T17:33:05.729320] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-06T17:33:05.729435] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-06T17:33:05.730414] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-06T17:33:05.730489] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-06T17:33:05.732402] [DEBUG] [LOCAL ] BDN: Trimmed 69244 records to 47524 (keeping 200 days of data) [2025-10-06T17:33:05.962003] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T17:33:05.982452] [INFO ] [REMOTE ] BDX: Full fetch complete (75685 records). [2025-10-06T17:33:05.985755] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-06T17:33:06.243188] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-06T17:33:06.454041] [DEBUG] [LOCAL ] BDN: Primary data saved (47524 records). [2025-10-06T17:33:06.453936] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-06T17:33:06.454194] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-06T17:33:06.454376] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDN took 37.6s. Estimated remaining: 4h 50m 40s. Rate: 7.3 symbols/min [2025-10-06T17:33:06.454278] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-06T17:33:06.455604] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-06T17:33:06.499200] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-06T17:33:06.563909] [DEBUG] [LOCAL ] BDX: Trimmed 75685 records to 52322 (keeping 200 days of data) [2025-10-06T17:33:06.728354] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:33:06.734314] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-06T17:33:06.882176] [DEBUG] [LOCAL ] BEKE: Loaded 54017 existing records from primary storage. [2025-10-06T17:33:06.908835] [INFO ] [MAIN ] BEKE: Loaded 54017 existing records. [2025-10-06T17:33:07.033426] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-06T17:33:07.139464] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:33:07.141520] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-06T17:33:07.141984] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-06T17:33:07.143198] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-06T17:33:07.143280] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-06T17:33:07.480006] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-06T17:33:07.661823] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:33:07.677420] [DEBUG] [LOCAL ] BDX: Primary data saved (52322 records). [2025-10-06T17:33:07.677538] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-06T17:33:07.677624] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDX took 38.9s. Estimated remaining: 4h 49m 30s. Rate: 7.4 symbols/min [2025-10-06T17:33:07.815101] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-06T17:33:07.834191] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-06T17:33:07.877281] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:33:07.877676] [INFO ] [REMOTE ] BE: Full fetch complete (77272 records). [2025-10-06T17:33:07.878121] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-06T17:33:07.879784] [FATAL] [VALIDATOR ] BE: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:33:07.879985] [FATAL] [MAIN ] BE: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:33:07.880057] [WARN ] [MAIN ] BE: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:33:07.880133] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-06T17:33:07.880360] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-06T17:33:07.880419] [INFO ] [LOCAL ] BE: Starting deletion of derivative data. [2025-10-06T17:33:07.880849] [DEBUG] [LOCAL ] BE: Deleted derivative data file. [2025-10-06T17:33:07.880962] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BE took 39.1s. Estimated remaining: 4h 48m 13s. Rate: 7.4 symbols/min [2025-10-06T17:33:08.072152] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:33:08.115022] [DEBUG] [LOCAL ] BEN: Loaded 53814 existing records from primary storage. [2025-10-06T17:33:08.115591] [INFO ] [MAIN ] BEN: Loaded 53814 existing records. [2025-10-06T17:33:08.345873] [DEBUG] [LOCAL ] BEP: Loaded 39305 existing records from primary storage. [2025-10-06T17:33:08.344452] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:33:08.346297] [INFO ] [MAIN ] BEP: Loaded 39305 existing records. [2025-10-06T17:33:08.390484] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-06T17:33:08.418268] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-06T17:33:08.452162] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-06T17:33:08.468152] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-06T17:33:08.660105] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:33:08.660201] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-06T17:33:08.679579] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-06T17:33:08.712372] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-06T17:33:08.788437] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-06T17:33:08.826429] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-06T17:33:09.080526] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-06T17:33:09.088447] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:33:09.356943] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:33:09.425503] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-06T17:33:09.686333] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T17:33:10.225586] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-06T17:33:10.638959] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-06T17:33:10.860925] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T17:33:11.025592] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-06T17:33:11.825546] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-06T17:33:12.625509] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-06T17:33:12.873974] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-06T17:33:12.916931] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T17:33:13.425499] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-06T17:33:13.571612] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T17:33:14.225543] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-06T17:33:15.025546] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-06T17:33:15.163089] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T17:33:15.825520] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-06T17:33:15.926075] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T17:33:16.625533] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-06T17:33:16.851784] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T17:33:16.951172] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-06T17:33:17.277885] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T17:33:17.425530] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-06T17:33:17.839855] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-06T17:33:17.840597] [INFO ] [REMOTE ] BEDU: Full fetch complete (1396 records). [2025-10-06T17:33:17.840715] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-06T17:33:18.028121] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-06T17:33:18.028402] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:33:18.028473] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:33:18.028545] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-06T17:33:18.028619] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-06T17:33:18.028691] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-06T17:33:18.028767] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-06T17:33:18.028837] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 18.8s. Estimated remaining: 4h 48m 22s. Rate: 7.4 symbols/min [2025-10-06T17:33:18.201085] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:33:18.231532] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-06T17:33:18.252048] [DEBUG] [LOCAL ] BEPC: Loaded 47157 existing records from primary storage. [2025-10-06T17:33:18.252433] [INFO ] [MAIN ] BEPC: Loaded 47157 existing records. [2025-10-06T17:33:18.447308] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:33:18.447891] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-06T17:33:18.447972] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-06T17:33:18.448610] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-06T17:33:18.448723] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-06T17:33:18.885798] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:33:19.025503] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-06T17:33:19.825511] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-06T17:33:19.870902] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T17:33:20.633068] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-06T17:33:20.652634] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T17:33:21.425549] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-06T17:33:22.034053] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-06T17:33:22.225518] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-06T17:33:22.351165] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T17:33:22.889393] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T17:33:23.025541] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-06T17:33:23.825495] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-06T17:33:24.217974] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-06T17:33:24.604242] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T17:33:24.625477] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-06T17:33:25.425547] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-06T17:33:25.755455] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-06T17:33:26.223722] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T17:33:26.232266] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-06T17:33:26.482438] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T17:33:27.025532] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-06T17:33:27.825511] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-06T17:33:27.964550] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T17:33:28.625515] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-06T17:33:28.781887] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T17:33:29.419992] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T17:33:29.432276] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-06T17:33:30.225554] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-06T17:33:30.574723] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-06T17:33:30.946972] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T17:33:31.025506] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-06T17:33:31.825554] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-06T17:33:32.045848] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T17:33:32.373311] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T17:33:32.625551] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-06T17:33:33.425625] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-06T17:33:33.856503] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-06T17:33:34.234740] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-06T17:33:34.243559] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T17:33:35.025587] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-06T17:33:35.248180] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T17:33:35.825564] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-06T17:33:36.105052] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-06T17:33:36.599347] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T17:33:36.625496] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-06T17:33:37.425626] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-06T17:33:37.788581] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T17:33:38.021600] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-06T17:33:38.225548] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-06T17:33:38.579544] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T17:33:39.025577] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-06T17:33:39.290685] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T17:33:39.825549] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-06T17:33:40.556385] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T17:33:40.625480] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-06T17:33:41.425629] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-06T17:33:41.718830] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T17:33:42.225624] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-06T17:33:42.339004] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T17:33:42.697978] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T17:33:42.701834] [INFO ] [REMOTE ] BEP: Full fetch complete (58530 records). [2025-10-06T17:33:42.702008] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-06T17:33:43.030771] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-06T17:33:43.113394] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-06T17:33:43.113525] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-06T17:33:43.114430] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-06T17:33:43.114512] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-06T17:33:43.116736] [DEBUG] [LOCAL ] BEP: Trimmed 58530 records to 38802 (keeping 200 days of data) [2025-10-06T17:33:43.372417] [DEBUG] [LOCAL ] BEP: Primary data saved (38802 records). [2025-10-06T17:33:43.372608] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-06T17:33:43.372743] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEP took 35.5s. Estimated remaining: 4h 50m 43s. Rate: 7.3 symbols/min [2025-10-06T17:33:43.558282] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:33:43.567030] [DEBUG] [LOCAL ] BEPH: Loaded 5430 existing records from primary storage. [2025-10-06T17:33:43.567266] [INFO ] [MAIN ] BEPH: Loaded 5430 existing records. [2025-10-06T17:33:43.760758] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:33:43.760991] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-06T17:33:43.761040] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-06T17:33:43.761352] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-06T17:33:43.761412] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-06T17:33:43.828002] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-06T17:33:44.152918] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:33:44.188372] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T17:33:44.622232] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T17:33:44.625510] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-06T17:33:44.626544] [INFO ] [REMOTE ] BEKE: Full fetch complete (77188 records). [2025-10-06T17:33:44.627699] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-06T17:33:45.039266] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-06T17:33:45.039365] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-06T17:33:45.040208] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-06T17:33:45.040273] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-06T17:33:45.042480] [DEBUG] [LOCAL ] BEKE: Trimmed 77188 records to 53233 (keeping 200 days of data) [2025-10-06T17:33:45.368892] [DEBUG] [LOCAL ] BEKE: Primary data saved (53233 records). [2025-10-06T17:33:45.369055] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-06T17:33:45.369156] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEKE took 38.9s. Estimated remaining: 4h 49m 41s. Rate: 7.3 symbols/min [2025-10-06T17:33:45.431636] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-06T17:33:45.576722] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:33:45.580674] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T17:33:45.597461] [DEBUG] [LOCAL ] BEPI: Loaded 3576 existing records from primary storage. [2025-10-06T17:33:45.597710] [INFO ] [MAIN ] BEPI: Loaded 3576 existing records. [2025-10-06T17:33:45.774530] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:33:45.774806] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-06T17:33:45.774906] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-06T17:33:45.775084] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-06T17:33:45.775140] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-06T17:33:46.161938] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:33:46.188847] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T17:33:46.192812] [INFO ] [REMOTE ] BEN: Full fetch complete (76904 records). [2025-10-06T17:33:46.193013] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-06T17:33:46.230626] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-06T17:33:46.614249] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-06T17:33:46.614371] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-06T17:33:46.615401] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-06T17:33:46.615493] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-06T17:33:46.617612] [DEBUG] [LOCAL ] BEN: Trimmed 76904 records to 53043 (keeping 200 days of data) [2025-10-06T17:33:46.973206] [DEBUG] [LOCAL ] BEN: Primary data saved (53043 records). [2025-10-06T17:33:46.973526] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-06T17:33:46.973681] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEN took 39.3s. Estimated remaining: 4h 48m 37s. Rate: 7.4 symbols/min [2025-10-06T17:33:47.032021] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-06T17:33:47.083225] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T17:33:47.193490] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:33:47.200230] [DEBUG] [LOCAL ] BEPJ: Loaded 3166 existing records from primary storage. [2025-10-06T17:33:47.200445] [INFO ] [MAIN ] BEPJ: Loaded 3166 existing records. [2025-10-06T17:33:47.387048] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:33:47.387392] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-06T17:33:47.387499] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-06T17:33:47.387760] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-06T17:33:47.387823] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-06T17:33:47.802329] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:33:47.825533] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-06T17:33:47.976865] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-06T17:33:48.438374] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-06T17:33:48.488091] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T17:33:48.625546] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-06T17:33:49.425625] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-06T17:33:49.878962] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T17:33:49.882273] [INFO ] [REMOTE ] BEPC: Full fetch complete (68598 records). [2025-10-06T17:33:49.882432] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-06T17:33:50.091031] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-06T17:33:50.230763] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-06T17:33:50.330157] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-06T17:33:50.330271] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-06T17:33:50.331589] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-06T17:33:50.331715] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-06T17:33:50.333704] [DEBUG] [LOCAL ] BEPC: Trimmed 68598 records to 46439 (keeping 200 days of data) [2025-10-06T17:33:50.661426] [DEBUG] [LOCAL ] BEPC: Primary data saved (46439 records). [2025-10-06T17:33:50.661621] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-06T17:33:50.661761] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPC took 32.6s. Estimated remaining: 4h 47m 50s. Rate: 7.4 symbols/min [2025-10-06T17:33:50.850307] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:33:50.855186] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T17:33:50.898634] [DEBUG] [LOCAL ] BFAM: Loaded 33682 existing records from primary storage. [2025-10-06T17:33:50.899017] [INFO ] [MAIN ] BFAM: Loaded 33682 existing records. [2025-10-06T17:33:51.038934] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-06T17:33:51.085262] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:33:51.085779] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-06T17:33:51.085843] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-06T17:33:51.086281] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-06T17:33:51.086341] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-06T17:33:51.486706] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:33:51.643697] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T17:33:51.825505] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-06T17:33:52.257746] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-06T17:33:52.625753] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-06T17:33:53.166535] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-06T17:33:53.425564] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-06T17:33:53.985122] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T17:33:54.225593] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-06T17:33:54.595447] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-06T17:33:55.025562] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-06T17:33:55.825538] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-06T17:33:56.488272] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-06T17:33:56.597201] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T17:33:56.625482] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-06T17:33:57.425489] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-06T17:33:57.829928] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-06T17:33:57.890378] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-06T17:33:58.225576] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-06T17:33:59.025554] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-06T17:33:59.515898] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T17:33:59.704074] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-06T17:33:59.825558] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-06T17:34:00.625526] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-06T17:34:00.776946] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-06T17:34:01.336755] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T17:34:01.425598] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-06T17:34:02.130719] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-06T17:34:02.225619] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-06T17:34:03.025572] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-06T17:34:03.501966] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-06T17:34:03.590065] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-06T17:34:03.825544] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-06T17:34:04.625561] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-06T17:34:05.138913] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-06T17:34:05.229493] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T17:34:05.425539] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-06T17:34:05.902047] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-06T17:34:06.225541] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-06T17:34:06.698846] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-06T17:34:07.025605] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-06T17:34:07.572081] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-06T17:34:07.825560] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-06T17:34:08.458011] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-06T17:34:08.625592] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-06T17:34:09.425553] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-06T17:34:10.067890] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T17:34:10.105151] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-06T17:34:10.225486] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-06T17:34:10.774456] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T17:34:10.775569] [INFO ] [REMOTE ] BEPI: Full fetch complete (4915 records). [2025-10-06T17:34:10.775712] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-06T17:34:11.032615] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-06T17:34:11.152363] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-06T17:34:11.152451] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-06T17:34:11.152602] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-06T17:34:11.152661] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-06T17:34:11.153090] [DEBUG] [LOCAL ] BEPI: Trimmed 4915 records to 3572 (keeping 200 days of data) [2025-10-06T17:34:11.175168] [DEBUG] [LOCAL ] BEPI: Primary data saved (3572 records). [2025-10-06T17:34:11.175324] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-06T17:34:11.175413] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPI took 25.8s. Estimated remaining: 4h 49m 27s. Rate: 7.3 symbols/min [2025-10-06T17:34:11.348347] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:34:11.391632] [DEBUG] [LOCAL ] BFH: Loaded 42221 existing records from primary storage. [2025-10-06T17:34:11.392029] [INFO ] [MAIN ] BFH: Loaded 42221 existing records. [2025-10-06T17:34:11.569004] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:34:11.569241] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-06T17:34:11.569290] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-06T17:34:11.569705] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-06T17:34:11.569764] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-06T17:34:11.830800] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-06T17:34:11.850361] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-06T17:34:11.935409] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:34:12.489303] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-06T17:34:12.625556] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-06T17:34:13.425556] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-06T17:34:14.036904] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-06T17:34:14.225502] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-06T17:34:14.304119] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T17:34:14.834199] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T17:34:15.025595] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-06T17:34:15.825530] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-06T17:34:16.278364] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-06T17:34:16.397625] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-06T17:34:16.625537] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-06T17:34:17.227110] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T17:34:17.228048] [INFO ] [REMOTE ] BEPH: Full fetch complete (7714 records). [2025-10-06T17:34:17.228117] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-06T17:34:17.433361] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-06T17:34:17.613341] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-06T17:34:17.613452] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-06T17:34:17.613809] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-06T17:34:17.613873] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-06T17:34:17.614312] [DEBUG] [LOCAL ] BEPH: Trimmed 7714 records to 5361 (keeping 200 days of data) [2025-10-06T17:34:17.651018] [DEBUG] [LOCAL ] BEPH: Primary data saved (5361 records). [2025-10-06T17:34:17.651203] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-06T17:34:17.651311] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPH took 34.3s. Estimated remaining: 4h 49m 5s. Rate: 7.3 symbols/min [2025-10-06T17:34:17.828248] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:34:17.828507] [DEBUG] [LOCAL ] BFK: No existing data file found in primary storage. [2025-10-06T17:34:17.828566] [WARN ] [MAIN ] BFK: No existing data found, performing full refresh instead. [2025-10-06T17:34:17.828722] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-06T17:34:17.828774] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-06T17:34:17.828817] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-06T17:34:17.828850] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-06T17:34:17.995579] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T17:34:18.223606] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:34:18.225500] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-06T17:34:18.650281] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-06T17:34:19.025549] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-06T17:34:19.825524] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-06T17:34:20.441931] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T17:34:20.625512] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-06T17:34:21.294530] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-06T17:34:21.295266] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4478 records). [2025-10-06T17:34:21.295335] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-06T17:34:21.295876] [FATAL] [VALIDATOR ] BEPJ: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:34:21.295974] [FATAL] [MAIN ] BEPJ: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:34:21.296070] [WARN ] [MAIN ] BEPJ: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:34:21.296164] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-06T17:34:21.296244] [DEBUG] [LOCAL ] BEPJ: No primary data file found to delete. [2025-10-06T17:34:21.296293] [INFO ] [LOCAL ] BEPJ: Starting deletion of derivative data. [2025-10-06T17:34:21.296555] [DEBUG] [LOCAL ] BEPJ: Deleted derivative data file. [2025-10-06T17:34:21.296689] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BEPJ took 34.3s. Estimated remaining: 4h 48m 18s. Rate: 7.3 symbols/min [2025-10-06T17:34:21.432752] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-06T17:34:21.500872] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:34:21.502658] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T17:34:21.559875] [DEBUG] [LOCAL ] BFLY: Loaded 52549 existing records from primary storage. [2025-10-06T17:34:21.560240] [INFO ] [MAIN ] BFLY: Loaded 52549 existing records. [2025-10-06T17:34:21.735834] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:34:21.736065] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-06T17:34:21.736112] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-06T17:34:21.736350] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-06T17:34:21.736406] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-06T17:34:22.106306] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:34:22.225507] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-06T17:34:22.685168] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T17:34:23.025511] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-06T17:34:23.829303] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-06T17:34:23.831018] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T17:34:23.963003] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T17:34:24.625638] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-06T17:34:25.418753] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-06T17:34:25.420586] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T17:34:25.429932] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-06T17:34:26.225542] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-06T17:34:26.564789] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T17:34:27.025513] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-06T17:34:27.501140] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T17:34:27.825545] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-06T17:34:28.394241] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-06T17:34:28.625528] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-06T17:34:29.346334] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T17:34:29.425491] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-06T17:34:29.585206] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T17:34:30.225528] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-06T17:34:30.983856] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T17:34:31.025472] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-06T17:34:31.117241] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T17:34:31.799523] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-06T17:34:31.825472] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-06T17:34:32.625532] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-06T17:34:32.791663] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T17:34:33.425542] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-06T17:34:34.225589] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-06T17:34:34.473025] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T17:34:34.794003] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T17:34:34.796260] [INFO ] [REMOTE ] BFAM: Full fetch complete (47067 records). [2025-10-06T17:34:34.796354] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-06T17:34:35.032409] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-06T17:34:35.173853] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-06T17:34:35.173944] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-06T17:34:35.174525] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-06T17:34:35.174566] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-06T17:34:35.175606] [DEBUG] [LOCAL ] BFAM: Trimmed 47067 records to 33360 (keeping 200 days of data) [2025-10-06T17:34:35.385365] [DEBUG] [LOCAL ] BFAM: Primary data saved (33360 records). [2025-10-06T17:34:35.385535] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-06T17:34:35.385624] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFAM took 44.7s. Estimated remaining: 4h 48m 60s. Rate: 7.3 symbols/min [2025-10-06T17:34:35.556085] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:34:35.567621] [DEBUG] [LOCAL ] BFS: Loaded 9281 existing records from primary storage. [2025-10-06T17:34:35.567900] [INFO ] [MAIN ] BFS: Loaded 9281 existing records. [2025-10-06T17:34:35.746727] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:34:35.747130] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-06T17:34:35.747216] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-06T17:34:35.747503] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-06T17:34:35.747560] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-06T17:34:35.830896] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-06T17:34:35.898987] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-06T17:34:36.128043] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:34:36.157730] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-06T17:34:36.625577] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-06T17:34:37.425562] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-06T17:34:37.572558] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T17:34:37.802690] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T17:34:38.225495] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-06T17:34:38.256638] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-06T17:34:39.025552] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-06T17:34:39.695285] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-06T17:34:39.825494] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-06T17:34:40.524982] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T17:34:40.576739] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T17:34:40.625475] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-06T17:34:41.425535] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-06T17:34:42.225513] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-06T17:34:42.235741] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-06T17:34:42.440508] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T17:34:42.886715] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-06T17:34:43.025568] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-06T17:34:43.756771] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T17:34:43.825522] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-06T17:34:44.625513] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-06T17:34:44.695106] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-06T17:34:45.425558] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-06T17:34:46.225500] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-06T17:34:46.535784] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T17:34:46.603315] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-06T17:34:47.025618] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-06T17:34:47.565104] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-06T17:34:47.825500] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-06T17:34:47.862092] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T17:34:48.625569] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-06T17:34:48.880232] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T17:34:49.381953] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T17:34:49.383266] [INFO ] [REMOTE ] BFK: Full fetch complete (19247 records). [2025-10-06T17:34:49.383395] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-06T17:34:49.430593] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-06T17:34:49.754513] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-06T17:34:49.754722] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-06T17:34:49.755068] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-06T17:34:49.755111] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-06T17:34:49.755753] [DEBUG] [LOCAL ] BFK: Trimmed 19247 records to 13725 (keeping 200 days of data) [2025-10-06T17:34:49.837434] [DEBUG] [LOCAL ] BFK: Primary data saved (13725 records). [2025-10-06T17:34:49.837610] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-06T17:34:49.837760] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFK took 32.2s. Estimated remaining: 4h 49m 44s. Rate: 7.3 symbols/min [2025-10-06T17:34:50.003087] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:34:50.017755] [DEBUG] [LOCAL ] BFZ: Loaded 12261 existing records from primary storage. [2025-10-06T17:34:50.018002] [INFO ] [MAIN ] BFZ: Loaded 12261 existing records. [2025-10-06T17:34:50.191782] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:34:50.192047] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-06T17:34:50.192095] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-06T17:34:50.192381] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-06T17:34:50.192439] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-06T17:34:50.234315] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-06T17:34:50.549906] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:34:51.025514] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-06T17:34:51.160668] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T17:34:51.352756] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-06T17:34:51.825539] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-06T17:34:52.388245] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T17:34:52.625502] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-06T17:34:52.635246] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-06T17:34:53.425567] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-06T17:34:53.748495] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T17:34:54.215352] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-06T17:34:54.225464] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-06T17:34:54.899204] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-06T17:34:54.900313] [INFO ] [REMOTE ] BFS: Full fetch complete (12766 records). [2025-10-06T17:34:54.900382] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-06T17:34:55.036538] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-06T17:34:55.256291] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-06T17:34:55.256376] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-06T17:34:55.256664] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-06T17:34:55.256725] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-06T17:34:55.257209] [DEBUG] [LOCAL ] BFS: Trimmed 12766 records to 9256 (keeping 200 days of data) [2025-10-06T17:34:55.311388] [DEBUG] [LOCAL ] BFS: Primary data saved (9256 records). [2025-10-06T17:34:55.311520] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-06T17:34:55.311604] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFS took 19.9s. Estimated remaining: 4h 49m 13s. Rate: 7.3 symbols/min [2025-10-06T17:34:55.479816] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:34:55.533248] [DEBUG] [LOCAL ] BG: Loaded 51115 existing records from primary storage. [2025-10-06T17:34:55.533669] [INFO ] [MAIN ] BG: Loaded 51115 existing records. [2025-10-06T17:34:55.709445] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:34:55.709714] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-06T17:34:55.709802] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-06T17:34:55.710098] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-06T17:34:55.710170] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-06T17:34:55.846931] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-06T17:34:56.101150] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:34:56.625543] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-06T17:34:56.958747] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-06T17:34:57.158171] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-06T17:34:57.425534] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-06T17:34:58.069145] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T17:34:58.171472] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T17:34:58.225551] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-06T17:34:59.025545] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-06T17:34:59.826610] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-06T17:35:00.007558] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-06T17:35:00.014043] [INFO ] [REMOTE ] BFLY: Full fetch complete (75301 records). [2025-10-06T17:35:00.014376] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-06T17:35:00.633375] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-06T17:35:00.661331] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-06T17:35:00.661522] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-06T17:35:00.662441] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-06T17:35:00.662830] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-06T17:35:00.665694] [DEBUG] [LOCAL ] BFLY: Trimmed 75301 records to 51804 (keeping 200 days of data) [2025-10-06T17:35:00.862530] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-06T17:35:01.013017] [DEBUG] [LOCAL ] BFLY: Primary data saved (51804 records). [2025-10-06T17:35:01.013215] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-06T17:35:01.013324] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFLY took 39.7s. Estimated remaining: 4h 48m 44s. Rate: 7.3 symbols/min [2025-10-06T17:35:01.204519] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:35:01.225017] [DEBUG] [LOCAL ] BGB: Loaded 17901 existing records from primary storage. [2025-10-06T17:35:01.225348] [INFO ] [MAIN ] BGB: Loaded 17901 existing records. [2025-10-06T17:35:01.414713] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T17:35:01.431353] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-06T17:35:01.445635] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:35:01.447608] [INFO ] [REMOTE ] BFH: Full fetch complete (59477 records). [2025-10-06T17:35:01.447876] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-06T17:35:01.448337] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-06T17:35:01.448976] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-06T17:35:01.450058] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-06T17:35:01.450159] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-06T17:35:01.449978] [FATAL] [VALIDATOR ] BFH: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:35:01.487839] [FATAL] [MAIN ] BFH: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:35:01.528858] [WARN ] [MAIN ] BFH: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:35:01.560008] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-06T17:35:01.573511] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-10-06T17:35:01.579550] [INFO ] [LOCAL ] BFH: Starting deletion of derivative data. [2025-10-06T17:35:01.606366] [DEBUG] [LOCAL ] BFH: Deleted derivative data file. [2025-10-06T17:35:01.634804] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFH took 50.5s. Estimated remaining: 4h 47m 33s. Rate: 7.4 symbols/min [2025-10-06T17:35:02.048135] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:35:02.121723] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:35:02.122953] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T17:35:02.148123] [DEBUG] [LOCAL ] BGH: Loaded 17279 existing records from primary storage. [2025-10-06T17:35:02.148482] [INFO ] [MAIN ] BGH: Loaded 17279 existing records. [2025-10-06T17:35:02.230786] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-06T17:35:02.341676] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:35:02.341932] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-06T17:35:02.341980] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-06T17:35:02.342253] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-06T17:35:02.342312] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-06T17:35:02.694101] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:35:03.025542] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-06T17:35:03.271777] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T17:35:03.658024] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-06T17:35:03.736761] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-06T17:35:03.825542] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-06T17:35:04.625509] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-06T17:35:04.703409] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T17:35:05.428204] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-06T17:35:05.425597] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-06T17:35:06.225515] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-06T17:35:06.248831] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-06T17:35:07.025587] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-06T17:35:07.825503] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-06T17:35:08.105335] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T17:35:08.165343] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T17:35:08.625557] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-06T17:35:08.870521] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T17:35:09.425565] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-06T17:35:09.607282] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T17:35:10.225555] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-06T17:35:11.025507] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-06T17:35:11.298933] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T17:35:11.339564] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T17:35:11.825542] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-06T17:35:11.920620] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T17:35:12.625550] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-06T17:35:13.408936] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T17:35:13.425475] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-06T17:35:13.574693] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T17:35:14.195332] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T17:35:14.225501] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-06T17:35:15.025555] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-06T17:35:15.150914] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T17:35:15.825515] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-06T17:35:15.867975] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T17:35:16.625567] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-06T17:35:17.425530] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-06T17:35:17.501865] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T17:35:17.612070] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-06T17:35:18.225500] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-06T17:35:18.333065] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-06T17:35:19.025602] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-06T17:35:19.825485] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-06T17:35:19.872952] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T17:35:20.090816] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-06T17:35:20.523295] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T17:35:20.625518] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-06T17:35:21.425535] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-06T17:35:21.441438] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T17:35:21.442695] [INFO ] [REMOTE ] BFZ: Full fetch complete (17984 records). [2025-10-06T17:35:21.442769] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-06T17:35:21.826084] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-06T17:35:21.826220] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-06T17:35:21.826818] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-06T17:35:21.826885] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-06T17:35:21.828033] [DEBUG] [LOCAL ] BFZ: Trimmed 17984 records to 11936 (keeping 200 days of data) [2025-10-06T17:35:21.900951] [DEBUG] [LOCAL ] BFZ: Primary data saved (11936 records). [2025-10-06T17:35:21.901122] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-06T17:35:21.901217] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFZ took 32.1s. Estimated remaining: 4h 49m 4s. Rate: 7.3 symbols/min [2025-10-06T17:35:22.078126] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:35:22.078481] [DEBUG] [LOCAL ] BGR: No existing data file found in primary storage. [2025-10-06T17:35:22.078743] [WARN ] [MAIN ] BGR: No existing data found, performing full refresh instead. [2025-10-06T17:35:22.078978] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-06T17:35:22.079092] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-06T17:35:22.079188] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-10-06T17:35:22.084544] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-06T17:35:22.156932] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T17:35:22.239559] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-06T17:35:22.466750] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:35:23.025612] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-06T17:35:23.554245] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-06T17:35:23.825575] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-06T17:35:24.625594] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-06T17:35:24.769421] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T17:35:24.802820] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T17:35:25.425591] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-06T17:35:25.702813] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-06T17:35:26.225565] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-06T17:35:27.025503] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-06T17:35:27.168772] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T17:35:27.438297] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T17:35:27.825498] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-06T17:35:27.987583] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T17:35:28.527554] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T17:35:28.625583] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-06T17:35:29.425518] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-06T17:35:29.561412] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T17:35:29.563205] [INFO ] [REMOTE ] BGH: Full fetch complete (22583 records). [2025-10-06T17:35:29.563283] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-06T17:35:29.929040] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-06T17:35:29.929140] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-06T17:35:29.929523] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-06T17:35:29.929566] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-06T17:35:29.930362] [DEBUG] [LOCAL ] BGH: Trimmed 22583 records to 17115 (keeping 200 days of data) [2025-10-06T17:35:30.036837] [DEBUG] [LOCAL ] BGH: Primary data saved (17115 records). [2025-10-06T17:35:30.037155] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-06T17:35:30.037282] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGH took 28.4s. Estimated remaining: 4h 48m 56s. Rate: 7.3 symbols/min [2025-10-06T17:35:30.213088] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:35:30.225553] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-06T17:35:30.263319] [DEBUG] [LOCAL ] BGS: Loaded 51155 existing records from primary storage. [2025-10-06T17:35:30.263830] [INFO ] [MAIN ] BGS: Loaded 51155 existing records. [2025-10-06T17:35:30.386959] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T17:35:30.460060] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:35:30.460333] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-06T17:35:30.460385] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-06T17:35:30.460792] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-06T17:35:30.460879] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-06T17:35:30.825397] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:35:31.025624] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-06T17:35:31.384375] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T17:35:31.825543] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-06T17:35:32.625498] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-06T17:35:32.730962] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-06T17:35:32.820605] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T17:35:33.425577] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-06T17:35:33.936390] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T17:35:33.938868] [INFO ] [REMOTE ] BG: Full fetch complete (72399 records). [2025-10-06T17:35:33.938983] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-06T17:35:33.939843] [FATAL] [VALIDATOR ] BG: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:35:33.939966] [FATAL] [MAIN ] BG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:35:33.940010] [WARN ] [MAIN ] BG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:35:33.940047] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-06T17:35:33.940108] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-10-06T17:35:33.940143] [INFO ] [LOCAL ] BG: Starting deletion of derivative data. [2025-10-06T17:35:33.940366] [DEBUG] [LOCAL ] BG: Deleted derivative data file. [2025-10-06T17:35:33.940461] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BG took 38.6s. Estimated remaining: 4h 48m 13s. Rate: 7.3 symbols/min [2025-10-06T17:35:34.108470] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:35:34.118003] [DEBUG] [LOCAL ] BGSF: Loaded 7724 existing records from primary storage. [2025-10-06T17:35:34.118230] [INFO ] [MAIN ] BGSF: Loaded 7724 existing records. [2025-10-06T17:35:34.230617] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-06T17:35:34.298853] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:35:34.299241] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-06T17:35:34.299305] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-06T17:35:34.299574] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-06T17:35:34.299632] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-06T17:35:34.681522] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:35:35.031434] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-06T17:35:35.034577] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T17:35:35.405237] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T17:35:35.825496] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-06T17:35:36.078500] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T17:35:36.625541] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-06T17:35:36.649575] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T17:35:36.651259] [INFO ] [REMOTE ] BGB: Full fetch complete (27149 records). [2025-10-06T17:35:36.651337] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-06T17:35:37.059726] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-06T17:35:37.059870] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-06T17:35:37.060691] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-06T17:35:37.060784] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-06T17:35:37.062187] [DEBUG] [LOCAL ] BGB: Trimmed 27149 records to 17794 (keeping 200 days of data) [2025-10-06T17:35:37.172279] [DEBUG] [LOCAL ] BGB: Primary data saved (17794 records). [2025-10-06T17:35:37.172456] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-06T17:35:37.172547] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGB took 36.2s. Estimated remaining: 4h 47m 24s. Rate: 7.3 symbols/min [2025-10-06T17:35:37.349121] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:35:37.367103] [DEBUG] [LOCAL ] BGT: Loaded 16780 existing records from primary storage. [2025-10-06T17:35:37.367337] [INFO ] [MAIN ] BGT: Loaded 16780 existing records. [2025-10-06T17:35:37.431216] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-06T17:35:37.551194] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:35:37.551433] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-06T17:35:37.551482] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-06T17:35:37.551737] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-06T17:35:37.551808] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-06T17:35:37.906363] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:35:38.083969] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T17:35:38.110747] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-06T17:35:38.225524] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-06T17:35:39.025605] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-06T17:35:39.825536] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-06T17:35:39.983444] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T17:35:40.054499] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-06T17:35:40.625520] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-06T17:35:40.803584] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T17:35:41.375226] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T17:35:41.425521] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-06T17:35:42.225542] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-06T17:35:42.319192] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-06T17:35:42.833513] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-06T17:35:43.025538] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-06T17:35:43.825590] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-06T17:35:43.968040] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T17:35:44.625568] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-06T17:35:45.278211] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T17:35:45.393173] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-06T17:35:45.425589] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-06T17:35:45.890173] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-06T17:35:46.225531] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-06T17:35:46.668227] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T17:35:47.025619] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-06T17:35:47.825602] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-06T17:35:48.625510] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-06T17:35:48.864036] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T17:35:48.868331] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T17:35:49.273112] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-06T17:35:49.425568] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-06T17:35:49.902895] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-06T17:35:50.225555] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-06T17:35:51.025512] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-06T17:35:51.320057] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T17:35:51.825523] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-06T17:35:51.900374] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-06T17:35:52.625545] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-06T17:35:53.381406] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T17:35:53.425492] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-06T17:35:53.632416] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-06T17:35:54.225539] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-06T17:35:55.025591] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-06T17:35:55.112792] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-06T17:35:55.189215] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T17:35:55.439046] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-06T17:35:55.825546] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-06T17:35:56.625491] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-06T17:35:56.762862] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T17:35:56.764085] [INFO ] [REMOTE ] BGR: Full fetch complete (20180 records). [2025-10-06T17:35:56.764161] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-06T17:35:57.130747] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-06T17:35:57.130946] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-06T17:35:57.131364] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-06T17:35:57.131407] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-06T17:35:57.132197] [DEBUG] [LOCAL ] BGR: Trimmed 20180 records to 13477 (keeping 200 days of data) [2025-10-06T17:35:57.218208] [DEBUG] [LOCAL ] BGR: Primary data saved (13477 records). [2025-10-06T17:35:57.218392] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-06T17:35:57.218505] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGR took 35.3s. Estimated remaining: 4h 48m 52s. Rate: 7.3 symbols/min [2025-10-06T17:35:57.388742] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:35:57.402477] [DEBUG] [LOCAL ] BGX: Loaded 11262 existing records from primary storage. [2025-10-06T17:35:57.402741] [INFO ] [MAIN ] BGX: Loaded 11262 existing records. [2025-10-06T17:35:57.425575] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-06T17:35:57.584362] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:35:57.595470] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-06T17:35:57.595379] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T17:35:57.595704] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-06T17:35:57.599948] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-06T17:35:57.600017] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-06T17:35:57.984077] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:35:58.225548] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-06T17:35:59.027484] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-06T17:35:59.028509] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T17:35:59.199544] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T17:35:59.825545] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-06T17:36:00.080481] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T17:36:00.625561] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-06T17:36:00.925410] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T17:36:01.304218] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-06T17:36:01.425551] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-06T17:36:02.225591] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-06T17:36:02.697863] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T17:36:02.813893] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T17:36:03.025563] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-06T17:36:03.825538] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-06T17:36:04.296874] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-06T17:36:04.596392] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T17:36:04.625474] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-06T17:36:05.400631] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T17:36:05.425483] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-06T17:36:06.224254] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-06T17:36:06.227105] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-06T17:36:07.025597] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-06T17:36:07.825514] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-06T17:36:07.926488] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T17:36:08.048838] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T17:36:08.625633] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-06T17:36:08.715866] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T17:36:09.425631] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-06T17:36:10.225584] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-06T17:36:10.250522] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T17:36:10.253615] [INFO ] [REMOTE ] BGS: Full fetch complete (72495 records). [2025-10-06T17:36:10.253767] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-06T17:36:10.579415] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T17:36:10.678934] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-06T17:36:10.679041] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-06T17:36:10.679847] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-06T17:36:10.679915] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-06T17:36:10.681529] [DEBUG] [LOCAL ] BGS: Trimmed 72495 records to 50464 (keeping 200 days of data) [2025-10-06T17:36:10.999822] [DEBUG] [LOCAL ] BGS: Primary data saved (50464 records). [2025-10-06T17:36:11.000176] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-06T17:36:11.000335] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGS took 41.0s. Estimated remaining: 4h 49m 28s. Rate: 7.3 symbols/min [2025-10-06T17:36:11.032121] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-06T17:36:11.181257] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:36:11.205592] [DEBUG] [LOCAL ] BGY: Loaded 22654 existing records from primary storage. [2025-10-06T17:36:11.205939] [INFO ] [MAIN ] BGY: Loaded 22654 existing records. [2025-10-06T17:36:11.397346] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:36:11.397621] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-06T17:36:11.397714] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-06T17:36:11.397964] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-06T17:36:11.398022] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-06T17:36:11.699984] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T17:36:11.711985] [INFO ] [REMOTE ] BGSF: Full fetch complete (9131 records). [2025-10-06T17:36:11.731548] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-06T17:36:11.831379] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:36:11.836717] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-06T17:36:12.074446] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-06T17:36:12.179319] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-06T17:36:12.179430] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-06T17:36:12.179708] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-06T17:36:12.179771] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-06T17:36:12.180218] [DEBUG] [LOCAL ] BGSF: Trimmed 9131 records to 7637 (keeping 200 days of data) [2025-10-06T17:36:12.224502] [DEBUG] [LOCAL ] BGSF: Primary data saved (7637 records). [2025-10-06T17:36:12.224636] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-06T17:36:12.224766] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGSF took 38.3s. Estimated remaining: 4h 48m 24s. Rate: 7.3 symbols/min [2025-10-06T17:36:12.395639] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:36:12.413381] [DEBUG] [LOCAL ] BH: Loaded 16097 existing records from primary storage. [2025-10-06T17:36:12.413679] [INFO ] [MAIN ] BH: Loaded 16097 existing records. [2025-10-06T17:36:12.601999] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:36:12.608284] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-06T17:36:12.608625] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-06T17:36:12.608516] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T17:36:12.610361] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-06T17:36:12.610616] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-06T17:36:12.632066] [INFO ] [REMOTE ] BGT: Full fetch complete (24332 records). [2025-10-06T17:36:12.631789] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-06T17:36:12.648809] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-06T17:36:13.327248] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:36:13.384158] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-06T17:36:13.384243] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-06T17:36:13.384674] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-06T17:36:13.384736] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-06T17:36:13.385555] [DEBUG] [LOCAL ] BGT: Trimmed 24332 records to 16588 (keeping 200 days of data) [2025-10-06T17:36:13.429270] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-06T17:36:13.492797] [DEBUG] [LOCAL ] BGT: Primary data saved (16588 records). [2025-10-06T17:36:13.492957] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-06T17:36:13.493047] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGT took 36.3s. Estimated remaining: 4h 47m 20s. Rate: 7.3 symbols/min [2025-10-06T17:36:13.602070] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T17:36:13.673893] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:36:13.717499] [DEBUG] [LOCAL ] BHC: Loaded 47483 existing records from primary storage. [2025-10-06T17:36:13.717947] [INFO ] [MAIN ] BHC: Loaded 47483 existing records. [2025-10-06T17:36:13.904164] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:36:13.904418] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-06T17:36:13.904500] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-06T17:36:13.904786] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-06T17:36:13.904861] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-06T17:36:14.235181] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-06T17:36:14.267489] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:36:14.277160] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T17:36:14.957584] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-06T17:36:15.025530] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-06T17:36:15.773565] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T17:36:15.825476] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-06T17:36:16.420297] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-06T17:36:16.625536] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-06T17:36:17.425601] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-06T17:36:18.230730] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-06T17:36:18.247159] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T17:36:18.301951] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-06T17:36:19.022837] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-06T17:36:19.025628] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-06T17:36:19.825501] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-06T17:36:19.985329] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T17:36:20.442182] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-06T17:36:20.625584] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-06T17:36:21.425516] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-06T17:36:21.457451] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T17:36:21.458980] [INFO ] [REMOTE ] BGX: Full fetch complete (16291 records). [2025-10-06T17:36:21.459081] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-06T17:36:21.833496] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-06T17:36:21.833592] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-06T17:36:21.833931] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-06T17:36:21.834006] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-06T17:36:21.834568] [DEBUG] [LOCAL ] BGX: Trimmed 16291 records to 11087 (keeping 200 days of data) [2025-10-06T17:36:21.905051] [DEBUG] [LOCAL ] BGX: Primary data saved (11087 records). [2025-10-06T17:36:21.905220] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-06T17:36:21.905307] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGX took 24.7s. Estimated remaining: 4h 47m 14s. Rate: 7.3 symbols/min [2025-10-06T17:36:22.077986] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:36:22.102469] [DEBUG] [LOCAL ] BHE: Loaded 24909 existing records from primary storage. [2025-10-06T17:36:22.102780] [INFO ] [MAIN ] BHE: Loaded 24909 existing records. [2025-10-06T17:36:22.230672] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-06T17:36:22.285001] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:36:22.285450] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-06T17:36:22.285554] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-06T17:36:22.292364] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-06T17:36:22.292424] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-06T17:36:22.295720] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-06T17:36:22.683448] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:36:23.025586] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-06T17:36:23.825495] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-06T17:36:23.828894] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T17:36:24.431595] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-06T17:36:24.625478] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-06T17:36:25.022573] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T17:36:25.425525] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-06T17:36:26.124825] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T17:36:26.225485] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-06T17:36:26.384431] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T17:36:27.025574] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-06T17:36:27.574825] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-06T17:36:27.825537] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-06T17:36:27.933380] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-06T17:36:28.625544] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-06T17:36:29.425571] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-06T17:36:29.677467] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T17:36:29.946238] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T17:36:30.225515] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-06T17:36:30.282010] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T17:36:31.025597] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-06T17:36:31.794510] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T17:36:31.825479] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-06T17:36:31.849385] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T17:36:32.625602] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-06T17:36:33.336486] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T17:36:33.425571] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-06T17:36:33.550377] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T17:36:34.225546] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-06T17:36:35.025558] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-06T17:36:35.078542] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T17:36:35.105623] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T17:36:35.825582] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-06T17:36:36.432459] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T17:36:36.553771] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T17:36:36.625539] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-06T17:36:37.425602] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-06T17:36:38.225507] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-06T17:36:38.471453] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T17:36:38.606057] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-06T17:36:39.025504] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-06T17:36:39.707849] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T17:36:39.825529] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-06T17:36:40.533432] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T17:36:40.625483] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-06T17:36:41.007540] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T17:36:41.425511] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-06T17:36:42.137689] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T17:36:42.140389] [INFO ] [REMOTE ] BHC: Full fetch complete (67006 records). [2025-10-06T17:36:42.140486] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-06T17:36:42.230732] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-06T17:36:42.535758] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-06T17:36:42.535926] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-06T17:36:42.536821] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-06T17:36:42.536887] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-06T17:36:42.538234] [DEBUG] [LOCAL ] BHC: Trimmed 67006 records to 46871 (keeping 200 days of data) [2025-10-06T17:36:42.638601] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T17:36:42.827789] [DEBUG] [LOCAL ] BHC: Primary data saved (46871 records). [2025-10-06T17:36:42.828014] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-06T17:36:42.828116] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BHC took 29.3s. Estimated remaining: 4h 48m 46s. Rate: 7.3 symbols/min [2025-10-06T17:36:43.001966] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:36:43.024870] [DEBUG] [LOCAL ] BHK: Loaded 23317 existing records from primary storage. [2025-10-06T17:36:43.025301] [INFO ] [MAIN ] BHK: Loaded 23317 existing records. [2025-10-06T17:36:43.036294] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-06T17:36:43.099049] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-06T17:36:43.228559] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:36:43.228834] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-06T17:36:43.228895] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-06T17:36:43.229183] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-06T17:36:43.229241] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-06T17:36:43.608325] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:36:43.825563] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-06T17:36:44.271579] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-06T17:36:44.625559] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-06T17:36:44.985067] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T17:36:45.425549] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-06T17:36:45.482476] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T17:36:45.484124] [INFO ] [REMOTE ] BGY: Full fetch complete (33112 records). [2025-10-06T17:36:45.484209] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-06T17:36:45.860150] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-06T17:36:45.860276] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-06T17:36:45.860821] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-06T17:36:45.860887] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-06T17:36:45.861996] [DEBUG] [LOCAL ] BGY: Trimmed 33112 records to 22014 (keeping 200 days of data) [2025-10-06T17:36:45.997961] [DEBUG] [LOCAL ] BGY: Primary data saved (22014 records). [2025-10-06T17:36:45.998145] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-06T17:36:45.998284] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BGY took 35.0s. Estimated remaining: 4h 47m 58s. Rate: 7.3 symbols/min [2025-10-06T17:36:46.176415] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:36:46.228437] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-06T17:36:46.231139] [DEBUG] [LOCAL ] BHP: Loaded 54148 existing records from primary storage. [2025-10-06T17:36:46.231691] [INFO ] [MAIN ] BHP: Loaded 54148 existing records. [2025-10-06T17:36:46.420203] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:36:46.420476] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-06T17:36:46.420532] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-06T17:36:46.420946] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-06T17:36:46.421010] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-06T17:36:46.828912] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:36:46.846684] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T17:36:47.025542] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-06T17:36:47.314587] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T17:36:47.825559] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-06T17:36:48.625505] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-06T17:36:48.920914] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T17:36:49.142429] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-06T17:36:49.425550] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-06T17:36:49.498443] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T17:36:50.225588] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-06T17:36:50.311424] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-06T17:36:51.025568] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-06T17:36:51.281496] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T17:36:51.825562] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-06T17:36:51.921039] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T17:36:52.625566] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-06T17:36:52.792942] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T17:36:52.794994] [INFO ] [REMOTE ] BH: Full fetch complete (19775 records). [2025-10-06T17:36:52.795092] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-06T17:36:53.194062] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-06T17:36:53.194177] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-06T17:36:53.194693] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-06T17:36:53.194773] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-06T17:36:53.195547] [DEBUG] [LOCAL ] BH: Trimmed 19775 records to 16097 (keeping 200 days of data) [2025-10-06T17:36:53.297844] [DEBUG] [LOCAL ] BH: Primary data saved (16097 records). [2025-10-06T17:36:53.298018] [INFO ] [MAIN ] BH: Full history saved. [2025-10-06T17:36:53.298135] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BH took 41.1s. Estimated remaining: 4h 47m 43s. Rate: 7.3 symbols/min [2025-10-06T17:36:53.430771] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-06T17:36:53.482840] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:36:53.509161] [DEBUG] [LOCAL ] BHR: Loaded 21779 existing records from primary storage. [2025-10-06T17:36:53.509518] [INFO ] [MAIN ] BHR: Loaded 21779 existing records. [2025-10-06T17:36:53.717681] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:36:53.717961] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-06T17:36:53.718012] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-06T17:36:53.718264] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-06T17:36:53.718321] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-06T17:36:54.113976] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:36:54.225500] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-06T17:36:54.299419] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T17:36:54.724463] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-06T17:36:55.025617] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-06T17:36:55.206442] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T17:36:55.775841] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T17:36:55.825513] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-06T17:36:56.625550] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-06T17:36:56.974518] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T17:36:57.425539] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-06T17:36:58.225501] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-06T17:36:58.327511] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T17:36:58.563166] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-06T17:36:59.025534] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-06T17:36:59.476072] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T17:36:59.478895] [INFO ] [REMOTE ] BHE: Full fetch complete (36523 records). [2025-10-06T17:36:59.479128] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-06T17:36:59.830688] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-06T17:36:59.913704] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-06T17:36:59.913942] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-06T17:36:59.914614] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-06T17:36:59.914840] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-06T17:36:59.927825] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T17:36:59.928037] [DEBUG] [LOCAL ] BHE: Trimmed 36523 records to 24339 (keeping 200 days of data) [2025-10-06T17:37:00.097738] [DEBUG] [LOCAL ] BHE: Primary data saved (24339 records). [2025-10-06T17:37:00.097911] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-06T17:37:00.098056] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHE took 38.2s. Estimated remaining: 4h 47m 24s. Rate: 7.3 symbols/min [2025-10-06T17:37:00.275554] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:37:00.275790] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-06T17:37:00.275837] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-06T17:37:00.275963] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-06T17:37:00.276008] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-06T17:37:00.276050] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-06T17:37:00.276084] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-06T17:37:00.645010] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-06T17:37:00.649733] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:37:01.425592] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-06T17:37:02.095399] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T17:37:02.225566] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-06T17:37:02.282440] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-06T17:37:02.616773] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-06T17:37:02.635351] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-06T17:37:03.025535] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-06T17:37:03.825551] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-06T17:37:04.084618] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T17:37:04.152511] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-06T17:37:04.625529] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-06T17:37:05.425550] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-06T17:37:05.921203] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-06T17:37:06.225506] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-06T17:37:06.244437] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-06T17:37:07.025532] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-06T17:37:07.475580] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T17:37:07.825507] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-06T17:37:08.205373] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-06T17:37:08.625507] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-06T17:37:08.840939] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T17:37:09.425531] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-06T17:37:09.855216] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T17:37:10.225517] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-06T17:37:10.429302] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-06T17:37:11.025535] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-06T17:37:11.244829] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T17:37:11.825490] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-06T17:37:12.071067] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T17:37:12.114716] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-06T17:37:12.625529] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-06T17:37:13.425508] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-06T17:37:13.811744] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T17:37:14.225585] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-06T17:37:14.635338] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T17:37:14.637224] [INFO ] [REMOTE ] BHK: Full fetch complete (30404 records). [2025-10-06T17:37:14.637306] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-06T17:37:15.014844] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-06T17:37:15.014940] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-06T17:37:15.015573] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-06T17:37:15.015616] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-06T17:37:15.016507] [DEBUG] [LOCAL ] BHK: Trimmed 30404 records to 23146 (keeping 200 days of data) [2025-10-06T17:37:15.067760] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-06T17:37:15.162855] [DEBUG] [LOCAL ] BHK: Primary data saved (23146 records). [2025-10-06T17:37:15.163050] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-06T17:37:15.163185] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 32.3s. Estimated remaining: 4h 48m 9s. Rate: 7.3 symbols/min [2025-10-06T17:37:15.301379] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T17:37:15.335151] [INFO ] [REMOTE ] BHR: Full fetch complete (31068 records). [2025-10-06T17:37:15.351463] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-06T17:37:15.353229] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:37:15.751369] [DEBUG] [LOCAL ] BHVN: Loaded 50537 existing records from primary storage. [2025-10-06T17:37:15.774112] [INFO ] [MAIN ] BHVN: Loaded 50537 existing records. [2025-10-06T17:37:15.826317] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-06T17:37:15.879875] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-06T17:37:15.887151] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-06T17:37:15.893717] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-06T17:37:15.915447] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-06T17:37:15.979000] [DEBUG] [LOCAL ] BHR: Trimmed 31068 records to 21645 (keeping 200 days of data) [2025-10-06T17:37:16.001660] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:37:16.002460] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-06T17:37:16.002544] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-06T17:37:16.003266] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-06T17:37:16.003334] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-06T17:37:16.378982] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-06T17:37:16.510436] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:37:16.542715] [DEBUG] [LOCAL ] BHR: Primary data saved (21645 records). [2025-10-06T17:37:16.542940] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-06T17:37:16.543100] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHR took 23.2s. Estimated remaining: 4h 47m 7s. Rate: 7.3 symbols/min [2025-10-06T17:37:16.630733] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-06T17:37:16.733974] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:37:16.790429] [DEBUG] [LOCAL ] BILL: Loaded 53112 existing records from primary storage. [2025-10-06T17:37:16.790975] [INFO ] [MAIN ] BILL: Loaded 53112 existing records. [2025-10-06T17:37:16.988983] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:37:16.989238] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-06T17:37:16.989290] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-06T17:37:16.989940] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-06T17:37:16.990003] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-06T17:37:17.031569] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-06T17:37:17.400085] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:37:17.430898] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-06T17:37:17.438584] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-06T17:37:17.815530] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-06T17:37:18.225547] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-06T17:37:19.025573] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-06T17:37:19.713968] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-06T17:37:19.825508] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-06T17:37:20.625549] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-06T17:37:20.874554] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T17:37:21.425564] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-06T17:37:21.747093] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-06T17:37:21.787515] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-06T17:37:21.990208] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T17:37:22.225559] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-06T17:37:23.025617] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-06T17:37:23.825553] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-06T17:37:24.309683] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-06T17:37:24.532600] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T17:37:24.625497] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-06T17:37:25.425553] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-06T17:37:25.464735] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T17:37:26.063533] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-06T17:37:26.092473] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T17:37:26.225499] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-06T17:37:27.025564] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-06T17:37:27.825502] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-06T17:37:28.141163] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-06T17:37:28.237512] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-06T17:37:28.625575] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-06T17:37:29.425551] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-06T17:37:29.865465] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-06T17:37:29.975733] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T17:37:30.225522] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-06T17:37:30.408439] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T17:37:31.025612] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-06T17:37:31.825546] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-06T17:37:32.166255] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T17:37:32.347778] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-06T17:37:32.625633] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-06T17:37:33.425501] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-06T17:37:33.621528] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T17:37:34.019186] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T17:37:34.225544] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-06T17:37:34.684167] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-06T17:37:35.025504] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-06T17:37:35.164707] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-06T17:37:35.168261] [INFO ] [REMOTE ] BHP: Full fetch complete (77252 records). [2025-10-06T17:37:35.168449] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-06T17:37:35.453451] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-06T17:37:35.471816] [INFO ] [REMOTE ] BHV: Full fetch complete (1363 records). [2025-10-06T17:37:35.480765] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-06T17:37:35.753697] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-06T17:37:35.754191] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-06T17:37:35.756417] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-06T17:37:35.756869] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-06T17:37:35.780452] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-06T17:37:35.781043] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:37:35.781116] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:37:35.781193] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-06T17:37:35.781843] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-06T17:37:35.782149] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-06T17:37:35.782406] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-06T17:37:35.782668] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHV took 35.7s. Estimated remaining: 4h 48m 24s. Rate: 7.3 symbols/min [2025-10-06T17:37:35.816193] [DEBUG] [LOCAL ] BHP: Trimmed 77252 records to 53370 (keeping 200 days of data) [2025-10-06T17:37:35.828204] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-06T17:37:36.082208] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:37:36.085317] [DEBUG] [LOCAL ] BIO: No existing data file found in primary storage. [2025-10-06T17:37:36.086580] [WARN ] [MAIN ] BIO: No existing data found, performing full refresh instead. [2025-10-06T17:37:36.087866] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-06T17:37:36.088315] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-06T17:37:36.089177] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-06T17:37:36.089527] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-06T17:37:36.572009] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:37:36.625780] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-06T17:37:36.728865] [DEBUG] [LOCAL ] BHP: Primary data saved (53370 records). [2025-10-06T17:37:36.729057] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-06T17:37:36.730159] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHP took 50.7s. Estimated remaining: 4h 47m 20s. Rate: 7.3 symbols/min [2025-10-06T17:37:36.903749] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:37:36.946781] [DEBUG] [LOCAL ] BIP: Loaded 40146 existing records from primary storage. [2025-10-06T17:37:36.947237] [INFO ] [MAIN ] BIP: Loaded 40146 existing records. [2025-10-06T17:37:37.135508] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:37:37.135802] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-06T17:37:37.135852] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-06T17:37:37.136131] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-06T17:37:37.136188] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-06T17:37:37.430387] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-06T17:37:37.517171] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:37:37.745487] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-06T17:37:38.225508] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-06T17:37:38.297888] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T17:37:38.607933] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T17:37:39.025541] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-06T17:37:39.757250] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T17:37:39.825484] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-06T17:37:40.209796] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-06T17:37:40.625590] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-06T17:37:41.298443] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T17:37:41.425575] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-06T17:37:42.184246] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T17:37:42.225482] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-06T17:37:42.479280] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T17:37:43.025550] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-06T17:37:43.825492] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-06T17:37:44.176025] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T17:37:44.625576] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-06T17:37:44.813763] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T17:37:45.249779] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T17:37:45.425608] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-06T17:37:45.932900] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T17:37:46.225607] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-06T17:37:47.025568] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-06T17:37:47.192786] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T17:37:47.622366] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T17:37:47.825533] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-06T17:37:48.591936] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T17:37:48.625589] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-06T17:37:48.934176] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T17:37:49.425536] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-06T17:37:50.225573] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-06T17:37:50.534789] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-06T17:37:50.699147] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-06T17:37:51.025589] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-06T17:37:51.755862] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T17:37:51.759311] [INFO ] [REMOTE ] BILL: Full fetch complete (75785 records). [2025-10-06T17:37:51.759459] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-06T17:37:51.835114] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-06T17:37:52.203141] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-06T17:37:52.203240] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-06T17:37:52.204225] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-06T17:37:52.204298] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-06T17:37:52.207721] [DEBUG] [LOCAL ] BILL: Trimmed 75785 records to 52370 (keeping 200 days of data) [2025-10-06T17:37:52.546236] [DEBUG] [LOCAL ] BILL: Primary data saved (52370 records). [2025-10-06T17:37:52.546420] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-06T17:37:52.546592] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BILL took 36.0s. Estimated remaining: 4h 48m 10s. Rate: 7.3 symbols/min [2025-10-06T17:37:52.632196] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-06T17:37:52.738740] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T17:37:52.738322] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:37:52.742797] [INFO ] [REMOTE ] BHVN: Full fetch complete (70043 records). [2025-10-06T17:37:52.742977] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-06T17:37:53.049466] [DEBUG] [LOCAL ] BIPC: Loaded 41980 existing records from primary storage. [2025-10-06T17:37:53.073456] [INFO ] [MAIN ] BIPC: Loaded 41980 existing records. [2025-10-06T17:37:53.411792] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-06T17:37:53.415961] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:37:53.416388] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-06T17:37:53.416718] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-06T17:37:53.438132] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-06T17:37:53.435673] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-06T17:37:53.439090] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-06T17:37:53.440056] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T17:37:53.439055] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-06T17:37:53.440190] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-06T17:37:53.486213] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-06T17:37:53.566341] [DEBUG] [LOCAL ] BHVN: Trimmed 70043 records to 50061 (keeping 200 days of data) [2025-10-06T17:37:54.010782] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:37:54.225519] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-06T17:37:54.304347] [DEBUG] [LOCAL ] BHVN: Primary data saved (50061 records). [2025-10-06T17:37:54.304566] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-06T17:37:54.304747] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BHVN took 39.1s. Estimated remaining: 4h 47m 12s. Rate: 7.3 symbols/min [2025-10-06T17:37:54.650344] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:37:54.656603] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-06T17:37:54.693822] [DEBUG] [LOCAL ] BIPH: Loaded 2595 existing records from primary storage. [2025-10-06T17:37:54.713754] [INFO ] [MAIN ] BIPH: Loaded 2595 existing records. [2025-10-06T17:37:54.771860] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-06T17:37:55.002383] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:37:55.002769] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-06T17:37:55.002845] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-06T17:37:55.003126] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-06T17:37:55.003203] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-06T17:37:55.030840] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-06T17:37:55.446872] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:37:55.738430] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T17:37:55.825558] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-06T17:37:56.228484] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-06T17:37:56.625608] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-06T17:37:57.263069] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T17:37:57.425551] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-06T17:37:57.630035] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T17:37:58.143120] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-06T17:37:58.225523] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-06T17:37:59.025562] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-06T17:37:59.590396] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T17:37:59.709427] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T17:37:59.825497] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-06T17:38:00.625524] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-06T17:38:01.259102] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T17:38:01.425574] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-06T17:38:02.179531] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T17:38:02.225546] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-06T17:38:02.866177] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T17:38:03.025531] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-06T17:38:03.281462] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T17:38:03.283098] [INFO ] [REMOTE ] BIO: Full fetch complete (34168 records). [2025-10-06T17:38:03.283204] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-06T17:38:03.652727] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-06T17:38:03.652816] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-06T17:38:03.653267] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-06T17:38:03.653306] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-06T17:38:03.654171] [DEBUG] [LOCAL ] BIO: Trimmed 34168 records to 24576 (keeping 200 days of data) [2025-10-06T17:38:03.804307] [DEBUG] [LOCAL ] BIO: Primary data saved (24576 records). [2025-10-06T17:38:03.804465] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-06T17:38:03.804539] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIO took 28.0s. Estimated remaining: 4h 47m 13s. Rate: 7.3 symbols/min [2025-10-06T17:38:03.825481] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-06T17:38:04.199558] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-06T17:38:04.625554] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-06T17:38:04.697046] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T17:38:05.425575] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-06T17:38:05.899342] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-06T17:38:06.230591] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-06T17:38:06.243982] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T17:38:07.025529] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-06T17:38:07.768299] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T17:38:07.825533] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-06T17:38:08.625530] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-06T17:38:08.865476] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T17:38:09.314864] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-06T17:38:09.378252] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T17:38:09.425485] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-06T17:38:10.225617] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-06T17:38:10.680833] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-06T17:38:10.795240] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T17:38:10.798414] [INFO ] [REMOTE ] BIP: Full fetch complete (56989 records). [2025-10-06T17:38:10.798616] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-06T17:38:11.030830] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-06T17:38:11.179144] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-06T17:38:11.179254] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-06T17:38:11.179958] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-06T17:38:11.180024] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-06T17:38:11.181384] [DEBUG] [LOCAL ] BIP: Trimmed 56989 records to 39429 (keeping 200 days of data) [2025-10-06T17:38:11.425705] [DEBUG] [LOCAL ] BIP: Primary data saved (39429 records). [2025-10-06T17:38:11.425899] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-06T17:38:11.426691] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIP took 34.7s. Estimated remaining: 4h 47m 1s. Rate: 7.3 symbols/min [2025-10-06T17:38:11.536688] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-06T17:38:11.825544] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-06T17:38:12.319347] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-06T17:38:12.625515] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-06T17:38:13.425551] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-06T17:38:13.863613] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-06T17:38:14.175761] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T17:38:14.225523] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-06T17:38:15.025598] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-06T17:38:15.499219] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-06T17:38:15.522116] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-06T17:38:15.825540] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-06T17:38:16.291203] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T17:38:16.291984] [INFO ] [REMOTE ] BIPH: Full fetch complete (4283 records). [2025-10-06T17:38:16.292055] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-06T17:38:16.636245] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-06T17:38:16.642559] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-06T17:38:16.643803] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-06T17:38:16.643996] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-06T17:38:16.644040] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-06T17:38:16.644403] [DEBUG] [LOCAL ] BIPH: Trimmed 4283 records to 2559 (keeping 200 days of data) [2025-10-06T17:38:16.660592] [DEBUG] [LOCAL ] BIPH: Primary data saved (2559 records). [2025-10-06T17:38:16.660691] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-06T17:38:16.660782] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BIPH took 22.4s. Estimated remaining: 4h 46m 30s. Rate: 7.3 symbols/min [2025-10-06T17:38:17.967955] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-06T17:38:17.977533] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-06T17:38:19.066359] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T17:38:19.079026] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-06T17:38:20.517375] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T17:38:20.526624] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-06T17:38:21.825484] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T17:38:21.829171] [INFO ] [REMOTE ] BIPC: Full fetch complete (59974 records). [2025-10-06T17:38:21.829434] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-06T17:38:22.244162] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-06T17:38:22.244282] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-06T17:38:22.245301] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-06T17:38:22.245368] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-06T17:38:22.246935] [DEBUG] [LOCAL ] BIPC: Trimmed 59974 records to 41260 (keeping 200 days of data) [2025-10-06T17:38:22.500164] [DEBUG] [LOCAL ] BIPC: Primary data saved (41260 records). [2025-10-06T17:38:22.500325] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-06T17:38:22.500410] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPC took 30.0s. Estimated remaining: 4h 46m 4s. Rate: 7.3 symbols/min [2025-10-06T17:38:23.133010] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:38:23.186439] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:38:23.245433] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:38:23.285192] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:38:23.291890] [DEBUG] [LOCAL ] BIPJ: Loaded 3148 existing records from primary storage. [2025-10-06T17:38:23.292232] [INFO ] [MAIN ] BIPJ: Loaded 3148 existing records. [2025-10-06T17:38:23.374825] [DEBUG] [LOCAL ] BIPI: Loaded 3229 existing records from primary storage. [2025-10-06T17:38:23.385885] [INFO ] [MAIN ] BIPI: Loaded 3229 existing records. [2025-10-06T17:38:23.513856] [DEBUG] [LOCAL ] BIT: Loaded 23266 existing records from primary storage. [2025-10-06T17:38:23.596464] [INFO ] [MAIN ] BIT: Loaded 23266 existing records. [2025-10-06T17:38:23.657601] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:38:23.728209] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-06T17:38:23.839915] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-06T17:38:23.835677] [DEBUG] [LOCAL ] BIRK: Loaded 51678 existing records from primary storage. [2025-10-06T17:38:23.879742] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-06T17:38:23.880119] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-06T17:38:23.884744] [INFO ] [MAIN ] BIRK: Loaded 51678 existing records. [2025-10-06T17:38:24.058090] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:38:24.044078] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:38:24.094600] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-06T17:38:24.153748] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-06T17:38:24.163277] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-06T17:38:24.189729] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-06T17:38:24.220896] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-06T17:38:24.227496] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-06T17:38:24.227444] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-06T17:38:24.250103] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-06T17:38:24.623109] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:38:24.655926] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-06T17:38:24.710501] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-06T17:38:24.741620] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-06T17:38:24.799399] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-06T17:38:24.988424] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:38:25.049066] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-06T17:38:25.531897] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:38:25.569890] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-06T17:38:25.807486] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:38:25.844506] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-06T17:38:25.845383] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-06T17:38:25.843850] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:38:25.848896] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-06T17:38:25.848439] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-06T17:38:26.206226] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-06T17:38:26.208398] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-06T17:38:26.406073] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T17:38:26.407463] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-06T17:38:26.768087] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T17:38:26.769533] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-06T17:38:26.851303] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T17:38:26.852639] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-06T17:38:27.056728] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-06T17:38:27.062083] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-06T17:38:27.236271] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T17:38:27.287669] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-06T17:38:27.306376] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-06T17:38:27.825514] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-06T17:38:28.106038] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T17:38:28.625548] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-06T17:38:29.181851] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T17:38:29.243134] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T17:38:29.425547] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-06T17:38:29.772330] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-06T17:38:30.225518] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-06T17:38:30.670355] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-06T17:38:31.025536] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-06T17:38:31.469175] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-06T17:38:31.825539] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-06T17:38:32.625581] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-06T17:38:33.017213] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T17:38:33.184446] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-06T17:38:33.425546] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-06T17:38:33.877879] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-06T17:38:34.225537] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-06T17:38:34.740250] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-06T17:38:35.025544] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-06T17:38:35.585009] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T17:38:35.825539] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-06T17:38:36.436797] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-06T17:38:36.625534] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-06T17:38:37.425588] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-06T17:38:38.199956] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T17:38:38.225569] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-06T17:38:38.483478] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T17:38:39.025557] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-06T17:38:39.825500] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-06T17:38:39.962891] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T17:38:39.990855] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T17:38:40.241237] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-06T17:38:40.625557] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-06T17:38:41.165326] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T17:38:41.166390] [INFO ] [REMOTE ] BIPI: Full fetch complete (5082 records). [2025-10-06T17:38:41.166482] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-06T17:38:41.432080] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-06T17:38:41.552438] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-06T17:38:41.552537] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-06T17:38:41.552737] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-06T17:38:41.552823] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-06T17:38:41.553226] [DEBUG] [LOCAL ] BIPI: Trimmed 5082 records to 3194 (keeping 200 days of data) [2025-10-06T17:38:41.574528] [DEBUG] [LOCAL ] BIPI: Primary data saved (3194 records). [2025-10-06T17:38:41.574610] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-06T17:38:41.574712] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPI took 19.1s. Estimated remaining: 4h 47m 17s. Rate: 7.3 symbols/min [2025-10-06T17:38:41.746932] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:38:41.798458] [DEBUG] [LOCAL ] BJ: Loaded 52136 existing records from primary storage. [2025-10-06T17:38:41.798890] [INFO ] [MAIN ] BJ: Loaded 52136 existing records. [2025-10-06T17:38:41.972186] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:38:41.972434] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-06T17:38:41.972482] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-06T17:38:41.972815] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-06T17:38:41.972874] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-06T17:38:42.228487] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-06T17:38:42.336755] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:38:42.352393] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-06T17:38:43.025547] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-06T17:38:43.825537] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-06T17:38:43.917637] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T17:38:44.625507] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-06T17:38:44.804034] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T17:38:44.846622] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T17:38:45.166540] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-06T17:38:45.425540] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-06T17:38:46.225541] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-06T17:38:47.025620] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-06T17:38:47.128216] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T17:38:47.168006] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T17:38:47.825568] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-06T17:38:48.625546] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-06T17:38:48.805586] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-06T17:38:49.081083] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-06T17:38:49.413948] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T17:38:49.425468] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-06T17:38:50.225522] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-06T17:38:51.025579] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-06T17:38:51.196207] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T17:38:51.502029] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-06T17:38:51.723154] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T17:38:51.825568] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-06T17:38:52.625535] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-06T17:38:53.425565] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-06T17:38:53.491791] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T17:38:54.225547] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-06T17:38:54.482215] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T17:38:54.614995] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T17:38:55.025547] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-06T17:38:55.766864] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T17:38:55.825489] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-06T17:38:56.625559] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-06T17:38:56.905154] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-06T17:38:57.050146] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-06T17:38:57.050978] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4359 records). [2025-10-06T17:38:57.051050] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-06T17:38:57.368946] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T17:38:57.411511] [INFO ] [REMOTE ] BIRK: Full fetch complete (73085 records). [2025-10-06T17:38:57.419692] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-06T17:38:57.437755] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-06T17:38:57.444639] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-06T17:38:57.444770] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-06T17:38:57.444989] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-06T17:38:57.445030] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-06T17:38:57.478946] [DEBUG] [LOCAL ] BIPJ: Trimmed 4359 records to 3135 (keeping 200 days of data) [2025-10-06T17:38:57.598696] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3135 records). [2025-10-06T17:38:57.623089] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-06T17:38:57.640024] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPJ took 35.1s. Estimated remaining: 4h 48m 6s. Rate: 7.3 symbols/min [2025-10-06T17:38:58.093044] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:38:58.142791] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-06T17:38:58.142934] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-06T17:38:58.143907] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-06T17:38:58.143982] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-06T17:38:58.146022] [DEBUG] [LOCAL ] BIRK: Trimmed 73085 records to 50930 (keeping 200 days of data) [2025-10-06T17:38:58.232085] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-06T17:38:58.371677] [DEBUG] [LOCAL ] BK: Loaded 54317 existing records from primary storage. [2025-10-06T17:38:58.399753] [INFO ] [MAIN ] BK: Loaded 54317 existing records. [2025-10-06T17:38:58.604429] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:38:58.623148] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-06T17:38:58.624762] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T17:38:58.624901] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-06T17:38:58.632625] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-06T17:38:58.633792] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-06T17:38:59.030854] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-06T17:38:59.044981] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:38:59.117589] [DEBUG] [LOCAL ] BIRK: Primary data saved (50930 records). [2025-10-06T17:38:59.117782] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-06T17:38:59.117880] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIRK took 36.6s. Estimated remaining: 4h 47m 8s. Rate: 7.3 symbols/min [2025-10-06T17:38:59.283624] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:38:59.336268] [DEBUG] [LOCAL ] BKD: Loaded 50962 existing records from primary storage. [2025-10-06T17:38:59.336752] [INFO ] [MAIN ] BKD: Loaded 50962 existing records. [2025-10-06T17:38:59.520118] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:38:59.520430] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-06T17:38:59.520574] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-06T17:38:59.521039] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-06T17:38:59.521147] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-06T17:38:59.829144] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-06T17:38:59.833634] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T17:38:59.925540] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:39:00.465135] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-06T17:39:00.625513] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-06T17:39:01.425535] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-06T17:39:01.799345] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-06T17:39:02.225577] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-06T17:39:02.592878] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-06T17:39:03.025526] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-06T17:39:03.333747] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-06T17:39:03.825573] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-06T17:39:04.092352] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-06T17:39:04.131962] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T17:39:04.134398] [INFO ] [REMOTE ] BIT: Full fetch complete (31956 records). [2025-10-06T17:39:04.134484] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-06T17:39:04.543228] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-06T17:39:04.543326] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-06T17:39:04.543789] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-06T17:39:04.543854] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-06T17:39:04.544768] [DEBUG] [LOCAL ] BIT: Trimmed 31956 records to 23078 (keeping 200 days of data) [2025-10-06T17:39:04.634260] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-06T17:39:04.717421] [DEBUG] [LOCAL ] BIT: Primary data saved (23078 records). [2025-10-06T17:39:04.717596] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-06T17:39:04.717708] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIT took 42.2s. Estimated remaining: 4h 46m 40s. Rate: 7.3 symbols/min [2025-10-06T17:39:04.890380] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:39:04.923669] [DEBUG] [LOCAL ] BKE: Loaded 34858 existing records from primary storage. [2025-10-06T17:39:04.923995] [INFO ] [MAIN ] BKE: Loaded 34858 existing records. [2025-10-06T17:39:05.100078] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:39:05.100485] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-06T17:39:05.100548] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-06T17:39:05.100822] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-06T17:39:05.100882] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-06T17:39:05.456941] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:39:05.436457] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-06T17:39:05.501245] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T17:39:06.115909] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T17:39:06.225553] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-06T17:39:07.032411] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-06T17:39:07.060620] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T17:39:07.825514] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-06T17:39:07.907446] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T17:39:08.618084] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T17:39:08.627175] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-06T17:39:09.425493] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-06T17:39:09.541414] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T17:39:10.225520] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-06T17:39:10.531313] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T17:39:10.564514] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T17:39:11.025546] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-06T17:39:11.683427] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T17:39:11.686772] [INFO ] [REMOTE ] BJ: Full fetch complete (73967 records). [2025-10-06T17:39:11.686887] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-06T17:39:11.830748] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-06T17:39:12.115587] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-06T17:39:12.115717] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-06T17:39:12.116677] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-06T17:39:12.116742] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-06T17:39:12.118631] [DEBUG] [LOCAL ] BJ: Trimmed 73967 records to 51429 (keeping 200 days of data) [2025-10-06T17:39:12.445189] [DEBUG] [LOCAL ] BJ: Primary data saved (51429 records). [2025-10-06T17:39:12.445357] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-06T17:39:12.445452] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BJ took 30.9s. Estimated remaining: 4h 46m 28s. Rate: 7.3 symbols/min [2025-10-06T17:39:12.627113] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:39:12.627240] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-06T17:39:12.670173] [DEBUG] [LOCAL ] BKH: Loaded 37195 existing records from primary storage. [2025-10-06T17:39:12.670560] [INFO ] [MAIN ] BKH: Loaded 37195 existing records. [2025-10-06T17:39:12.880076] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:39:12.880434] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-06T17:39:12.880490] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-06T17:39:12.880913] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-06T17:39:12.880977] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-06T17:39:13.037912] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-06T17:39:13.309760] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:39:13.425558] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-06T17:39:13.760534] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-06T17:39:13.942145] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T17:39:14.225521] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-06T17:39:15.025513] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-06T17:39:15.121851] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T17:39:15.777034] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T17:39:15.825522] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-06T17:39:16.625528] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-06T17:39:16.681394] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T17:39:17.325243] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T17:39:17.425612] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-06T17:39:18.123851] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T17:39:18.225558] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-06T17:39:19.025551] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-06T17:39:19.069065] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T17:39:19.829126] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-06T17:39:19.833854] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T17:39:20.520047] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T17:39:20.625491] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-06T17:39:21.389452] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-06T17:39:21.425512] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-06T17:39:22.017712] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T17:39:22.225532] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-06T17:39:23.025494] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-06T17:39:23.127546] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T17:39:23.825536] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-06T17:39:23.891570] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T17:39:24.169729] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T17:39:24.625622] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-06T17:39:25.325886] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T17:39:25.425568] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-06T17:39:25.985680] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-06T17:39:26.225578] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-06T17:39:27.025547] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-06T17:39:27.168315] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T17:39:27.510428] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T17:39:27.825529] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-06T17:39:28.495561] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T17:39:28.625547] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-06T17:39:29.114784] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-06T17:39:29.425599] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-06T17:39:30.226729] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-06T17:39:30.230253] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T17:39:30.512846] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T17:39:30.515123] [INFO ] [REMOTE ] BKE: Full fetch complete (50220 records). [2025-10-06T17:39:30.515234] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-06T17:39:30.916284] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-06T17:39:30.916399] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-06T17:39:30.917188] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-06T17:39:30.917254] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-06T17:39:30.918807] [DEBUG] [LOCAL ] BKE: Trimmed 50220 records to 34159 (keeping 200 days of data) [2025-10-06T17:39:31.027714] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-06T17:39:31.141301] [DEBUG] [LOCAL ] BKE: Primary data saved (34159 records). [2025-10-06T17:39:31.141517] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-06T17:39:31.141630] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BKE took 26.4s. Estimated remaining: 4h 47m 36s. Rate: 7.2 symbols/min [2025-10-06T17:39:31.318055] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:39:31.318300] [DEBUG] [LOCAL ] BKKT: No existing data file found in primary storage. [2025-10-06T17:39:31.318346] [WARN ] [MAIN ] BKKT: No existing data found, performing full refresh instead. [2025-10-06T17:39:31.318472] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-06T17:39:31.318513] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-06T17:39:31.318553] [DEBUG] [LOCAL ] BKKT: No primary data file found to delete. [2025-10-06T17:39:31.318583] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-06T17:39:31.695801] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:39:31.825532] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-06T17:39:32.136852] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-06T17:39:32.460377] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T17:39:32.625595] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-06T17:39:33.425562] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-06T17:39:33.842201] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-06T17:39:34.225546] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-06T17:39:34.448721] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T17:39:35.025566] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-06T17:39:35.216064] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T17:39:35.235253] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-06T17:39:35.239813] [INFO ] [REMOTE ] BK: Full fetch complete (77481 records). [2025-10-06T17:39:35.240004] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-06T17:39:35.660754] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-06T17:39:35.660870] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-06T17:39:35.661863] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-06T17:39:35.661931] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-06T17:39:35.663793] [DEBUG] [LOCAL ] BK: Trimmed 77481 records to 53537 (keeping 200 days of data) [2025-10-06T17:39:35.847624] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-06T17:39:36.010068] [DEBUG] [LOCAL ] BK: Primary data saved (53537 records). [2025-10-06T17:39:36.010240] [INFO ] [MAIN ] BK: Full history saved. [2025-10-06T17:39:36.011340] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BK took 38.4s. Estimated remaining: 4h 47m 3s. Rate: 7.3 symbols/min [2025-10-06T17:39:36.183445] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:39:36.196828] [DEBUG] [LOCAL ] BKN: Loaded 7844 existing records from primary storage. [2025-10-06T17:39:36.197153] [INFO ] [MAIN ] BKN: Loaded 7844 existing records. [2025-10-06T17:39:36.386875] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:39:36.387392] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-06T17:39:36.387452] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-06T17:39:36.387811] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-06T17:39:36.387873] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-06T17:39:36.629080] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-06T17:39:36.775119] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:39:36.806629] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T17:39:37.425591] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-06T17:39:37.493273] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-06T17:39:38.186736] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T17:39:38.225547] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-06T17:39:38.237900] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T17:39:39.025566] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-06T17:39:39.508395] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-06T17:39:39.833205] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-06T17:39:39.840307] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T17:39:40.460862] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-06T17:39:40.625542] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-06T17:39:41.425558] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-06T17:39:42.063016] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T17:39:42.225493] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-06T17:39:42.827782] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T17:39:42.830784] [INFO ] [REMOTE ] BKD: Full fetch complete (71784 records). [2025-10-06T17:39:42.830904] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-06T17:39:43.035737] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-06T17:39:43.231425] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-06T17:39:43.231543] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-06T17:39:43.232611] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-06T17:39:43.232708] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-06T17:39:43.234738] [DEBUG] [LOCAL ] BKD: Trimmed 71784 records to 50317 (keeping 200 days of data) [2025-10-06T17:39:43.542003] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T17:39:43.547485] [INFO ] [REMOTE ] BKH: Full fetch complete (52440 records). [2025-10-06T17:39:43.548214] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-06T17:39:43.829250] [DEBUG] [LOCAL ] BKD: Primary data saved (50317 records). [2025-10-06T17:39:43.826105] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-06T17:39:43.872322] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-06T17:39:43.886222] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKD took 44.8s. Estimated remaining: 4h 46m 52s. Rate: 7.3 symbols/min [2025-10-06T17:39:44.182148] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-06T17:39:44.183500] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-06T17:39:44.184784] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-06T17:39:44.199947] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-06T17:39:44.205019] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:39:44.206463] [DEBUG] [LOCAL ] BKH: Trimmed 52440 records to 36789 (keeping 200 days of data) [2025-10-06T17:39:44.358373] [DEBUG] [LOCAL ] BKSY: Loaded 48985 existing records from primary storage. [2025-10-06T17:39:44.359921] [INFO ] [MAIN ] BKSY: Loaded 48985 existing records. [2025-10-06T17:39:44.640142] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:39:44.642077] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-06T17:39:44.642958] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-06T17:39:44.643580] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-06T17:39:44.644136] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-06T17:39:44.719448] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-06T17:39:44.759116] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-06T17:39:44.786111] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T17:39:45.108059] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:39:45.119909] [DEBUG] [LOCAL ] BKH: Primary data saved (36789 records). [2025-10-06T17:39:45.120094] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-06T17:39:45.120225] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKH took 32.7s. Estimated remaining: 4h 45m 53s. Rate: 7.3 symbols/min [2025-10-06T17:39:45.320138] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:39:45.337706] [DEBUG] [LOCAL ] BKT: Loaded 11681 existing records from primary storage. [2025-10-06T17:39:45.338018] [INFO ] [MAIN ] BKT: Loaded 11681 existing records. [2025-10-06T17:39:45.426042] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-06T17:39:45.567198] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:39:45.567763] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-06T17:39:45.571441] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-06T17:39:45.575209] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-06T17:39:45.575488] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T17:39:45.575631] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-06T17:39:45.964043] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:39:46.225578] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-06T17:39:47.025552] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-06T17:39:47.150316] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T17:39:47.164568] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T17:39:47.825566] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-06T17:39:47.961751] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T17:39:48.559040] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T17:39:48.625539] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-06T17:39:49.425515] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-06T17:39:49.449053] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-06T17:39:50.225514] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-06T17:39:50.609543] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T17:39:50.972117] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T17:39:51.025608] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-06T17:39:51.825550] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-06T17:39:52.522181] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T17:39:52.625480] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-06T17:39:53.425546] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-06T17:39:53.577000] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T17:39:53.663500] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T17:39:54.146772] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T17:39:54.225479] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-06T17:39:55.025573] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-06T17:39:55.825491] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-06T17:39:55.941528] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T17:39:55.982886] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T17:39:56.562070] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-06T17:39:56.625544] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-06T17:39:57.302029] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-06T17:39:57.425561] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-06T17:39:58.041360] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-06T17:39:58.225549] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-06T17:39:59.025600] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-06T17:39:59.033436] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-06T17:39:59.825581] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-06T17:40:00.625604] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-06T17:40:01.425589] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-06T17:40:01.521499] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-06T17:40:01.552446] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-06T17:40:01.833165] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-06T17:40:02.094113] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-06T17:40:02.095288] [INFO ] [REMOTE ] BKN: Full fetch complete (11857 records). [2025-10-06T17:40:02.095386] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-06T17:40:02.230696] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-06T17:40:02.473939] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-06T17:40:02.474027] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-06T17:40:02.474308] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-06T17:40:02.474347] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-06T17:40:02.474824] [DEBUG] [LOCAL ] BKN: Trimmed 11857 records to 7717 (keeping 200 days of data) [2025-10-06T17:40:02.520946] [DEBUG] [LOCAL ] BKN: Primary data saved (7717 records). [2025-10-06T17:40:02.521095] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-06T17:40:02.521181] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKN took 26.5s. Estimated remaining: 4h 46m 51s. Rate: 7.3 symbols/min [2025-10-06T17:40:02.686587] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:40:02.739680] [DEBUG] [LOCAL ] BKU: Loaded 42022 existing records from primary storage. [2025-10-06T17:40:02.740132] [INFO ] [MAIN ] BKU: Loaded 42022 existing records. [2025-10-06T17:40:02.932525] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:40:02.932824] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-06T17:40:02.932873] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-06T17:40:02.933283] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-06T17:40:02.933343] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-06T17:40:03.030672] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-06T17:40:03.307344] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:40:03.825548] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-06T17:40:04.243734] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-06T17:40:04.580796] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T17:40:04.625494] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-06T17:40:05.003337] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-06T17:40:05.427361] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-06T17:40:05.429212] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T17:40:06.225588] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-06T17:40:07.025594] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-06T17:40:07.238132] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T17:40:07.677708] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T17:40:07.825539] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-06T17:40:08.132937] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T17:40:08.625588] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-06T17:40:09.302218] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-06T17:40:09.425551] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-06T17:40:10.225564] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-06T17:40:10.358848] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T17:40:10.923963] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T17:40:11.025555] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-06T17:40:11.437972] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T17:40:11.439706] [INFO ] [REMOTE ] BKT: Full fetch complete (15704 records). [2025-10-06T17:40:11.439787] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-06T17:40:11.829153] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-06T17:40:11.829342] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-06T17:40:11.829720] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-06T17:40:11.831379] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-06T17:40:11.831444] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-06T17:40:11.832369] [DEBUG] [LOCAL ] BKT: Trimmed 15704 records to 11729 (keeping 200 days of data) [2025-10-06T17:40:11.905146] [DEBUG] [LOCAL ] BKT: Primary data saved (11729 records). [2025-10-06T17:40:11.905357] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-06T17:40:11.905470] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKT took 26.8s. Estimated remaining: 4h 46m 50s. Rate: 7.3 symbols/min [2025-10-06T17:40:12.071801] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:40:12.071960] [DEBUG] [LOCAL ] BKV: No existing data file found in primary storage. [2025-10-06T17:40:12.071997] [WARN ] [MAIN ] BKV: No existing data found, performing full refresh instead. [2025-10-06T17:40:12.072109] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-06T17:40:12.072151] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-06T17:40:12.072217] [DEBUG] [LOCAL ] BKV: No primary data file found to delete. [2025-10-06T17:40:12.072251] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-06T17:40:12.428831] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:40:12.488690] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T17:40:12.625478] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-06T17:40:13.425569] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-06T17:40:13.861958] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-06T17:40:14.225561] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-06T17:40:14.287622] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T17:40:15.025603] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-06T17:40:15.526006] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-06T17:40:15.825549] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-06T17:40:16.363817] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T17:40:16.625547] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-06T17:40:17.425572] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-06T17:40:17.767543] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (3.54 seconds). [2025-10-06T17:40:17.807339] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-06T17:40:17.811217] [INFO ] [REMOTE ] BKKT: Full fetch complete (50428 records). [2025-10-06T17:40:17.811398] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-06T17:40:18.211880] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-06T17:40:18.212073] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-06T17:40:18.212859] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-06T17:40:18.212942] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-06T17:40:18.228460] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-06T17:40:18.235725] [DEBUG] [LOCAL ] BKKT: Trimmed 50428 records to 35590 (keeping 200 days of data) [2025-10-06T17:40:18.242828] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T17:40:18.465522] [DEBUG] [LOCAL ] BKKT: Primary data saved (35590 records). [2025-10-06T17:40:18.465797] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-06T17:40:18.465895] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKKT took 47.3s. Estimated remaining: 4h 46m 30s. Rate: 7.3 symbols/min [2025-10-06T17:40:18.635414] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:40:18.672927] [DEBUG] [LOCAL ] BLCO: Loaded 35851 existing records from primary storage. [2025-10-06T17:40:18.673260] [INFO ] [MAIN ] BLCO: Loaded 35851 existing records. [2025-10-06T17:40:18.804233] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T17:40:18.881862] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:40:18.882150] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-06T17:40:18.882205] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-06T17:40:18.882606] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-06T17:40:18.882716] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-06T17:40:19.030760] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-06T17:40:19.305516] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:40:19.825504] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-06T17:40:20.224321] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-06T17:40:20.547013] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T17:40:20.625477] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-06T17:40:21.301766] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T17:40:21.425582] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-06T17:40:21.987022] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T17:40:22.225586] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-06T17:40:23.025561] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-06T17:40:23.404704] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-06T17:40:23.591290] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T17:40:23.825545] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-06T17:40:24.064563] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T17:40:24.625599] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-06T17:40:25.195507] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T17:40:25.425595] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-06T17:40:25.937603] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T17:40:26.225576] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-06T17:40:27.025597] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-06T17:40:27.313041] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-06T17:40:27.316559] [INFO ] [REMOTE ] BKSY: Full fetch complete (69798 records). [2025-10-06T17:40:27.316724] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-06T17:40:27.751538] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-06T17:40:27.773764] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-06T17:40:27.774750] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-06T17:40:27.775068] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-06T17:40:27.777263] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T17:40:27.787161] [DEBUG] [LOCAL ] BKSY: Trimmed 69798 records to 48342 (keeping 200 days of data) [2025-10-06T17:40:27.837200] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-06T17:40:27.908397] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T17:40:28.101017] [DEBUG] [LOCAL ] BKSY: Primary data saved (48342 records). [2025-10-06T17:40:28.101196] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-06T17:40:28.101287] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKSY took 44.2s. Estimated remaining: 4h 46m 31s. Rate: 7.3 symbols/min [2025-10-06T17:40:28.268447] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:40:28.296290] [DEBUG] [LOCAL ] BLD: Loaded 27960 existing records from primary storage. [2025-10-06T17:40:28.296588] [INFO ] [MAIN ] BLD: Loaded 27960 existing records. [2025-10-06T17:40:28.475132] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:40:28.475400] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-06T17:40:28.475452] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-06T17:40:28.475958] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-06T17:40:28.476016] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-06T17:40:28.628266] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-06T17:40:28.829706] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:40:29.357192] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T17:40:29.425552] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-06T17:40:30.127497] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T17:40:30.225550] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-06T17:40:30.931597] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T17:40:31.025554] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-06T17:40:31.451441] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T17:40:31.825547] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-06T17:40:32.196756] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-06T17:40:32.625570] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-06T17:40:33.432798] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-06T17:40:33.450228] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T17:40:33.682873] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T17:40:34.225555] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-06T17:40:34.591184] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T17:40:35.025545] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-06T17:40:35.515584] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T17:40:35.825562] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-06T17:40:36.464369] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T17:40:36.625577] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-06T17:40:37.236916] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T17:40:37.425563] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-06T17:40:37.964691] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T17:40:38.225540] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-06T17:40:38.861022] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T17:40:39.025569] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-06T17:40:39.319232] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T17:40:39.322197] [INFO ] [REMOTE ] BKV: Full fetch complete (44799 records). [2025-10-06T17:40:39.322338] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-06T17:40:39.711623] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-06T17:40:39.711778] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-06T17:40:39.712428] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-06T17:40:39.712475] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-06T17:40:39.713939] [DEBUG] [LOCAL ] BKV: Trimmed 44799 records to 29817 (keeping 200 days of data) [2025-10-06T17:40:39.825628] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-06T17:40:39.899112] [DEBUG] [LOCAL ] BKV: Primary data saved (29817 records). [2025-10-06T17:40:39.899306] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-06T17:40:39.899391] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKV took 28.0s. Estimated remaining: 4h 46m 48s. Rate: 7.2 symbols/min [2025-10-06T17:40:40.083796] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:40:40.140685] [DEBUG] [LOCAL ] BLDR: Loaded 52382 existing records from primary storage. [2025-10-06T17:40:40.141259] [INFO ] [MAIN ] BLDR: Loaded 52382 existing records. [2025-10-06T17:40:40.266488] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T17:40:40.351761] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:40:40.352092] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-06T17:40:40.352155] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-06T17:40:40.352602] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-06T17:40:40.352698] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-06T17:40:40.630854] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-06T17:40:40.706481] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:40:41.235698] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T17:40:41.425561] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-06T17:40:41.759360] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T17:40:42.225601] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-06T17:40:42.438163] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T17:40:42.440839] [INFO ] [REMOTE ] BKU: Full fetch complete (59976 records). [2025-10-06T17:40:42.440976] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-06T17:40:42.861219] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-06T17:40:42.861347] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-06T17:40:42.862083] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-06T17:40:42.862146] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-06T17:40:42.863418] [DEBUG] [LOCAL ] BKU: Trimmed 59976 records to 41507 (keeping 200 days of data) [2025-10-06T17:40:43.045246] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-06T17:40:43.134723] [DEBUG] [LOCAL ] BKU: Primary data saved (41507 records). [2025-10-06T17:40:43.134938] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-06T17:40:43.135729] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKU took 40.6s. Estimated remaining: 4h 46m 4s. Rate: 7.3 symbols/min [2025-10-06T17:40:43.338664] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:40:43.358719] [DEBUG] [LOCAL ] BLE: Loaded 14475 existing records from primary storage. [2025-10-06T17:40:43.359045] [INFO ] [MAIN ] BLE: Loaded 14475 existing records. [2025-10-06T17:40:43.553991] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T17:40:43.575874] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:40:43.582098] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-06T17:40:43.582190] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-06T17:40:43.582816] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-06T17:40:43.582885] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-06T17:40:43.830784] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-06T17:40:43.944635] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:40:44.390072] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T17:40:44.625567] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-06T17:40:45.425602] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-06T17:40:45.740419] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T17:40:45.874686] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T17:40:45.876865] [INFO ] [REMOTE ] BLCO: Full fetch complete (52455 records). [2025-10-06T17:40:45.877001] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-06T17:40:46.229723] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-06T17:40:46.268817] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-06T17:40:46.269001] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-06T17:40:46.269817] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-06T17:40:46.269899] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-06T17:40:46.271315] [DEBUG] [LOCAL ] BLCO: Trimmed 52455 records to 35566 (keeping 200 days of data) [2025-10-06T17:40:46.393145] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T17:40:46.507368] [DEBUG] [LOCAL ] BLCO: Primary data saved (35566 records). [2025-10-06T17:40:46.507554] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-06T17:40:46.507667] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLCO took 28.0s. Estimated remaining: 4h 45m 21s. Rate: 7.3 symbols/min [2025-10-06T17:40:46.687152] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:40:46.724044] [DEBUG] [LOCAL ] BLK: Loaded 34890 existing records from primary storage. [2025-10-06T17:40:46.724405] [INFO ] [MAIN ] BLK: Loaded 34890 existing records. [2025-10-06T17:40:46.900394] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:40:46.900674] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-06T17:40:46.900735] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-06T17:40:46.902110] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-06T17:40:46.902170] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-06T17:40:47.025613] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-06T17:40:47.286797] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:40:47.825499] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-06T17:40:48.224307] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-06T17:40:48.570694] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T17:40:48.625505] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-06T17:40:49.425592] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-06T17:40:49.621800] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T17:40:50.041603] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T17:40:50.225549] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-06T17:40:51.004832] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T17:40:51.025488] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-06T17:40:51.458985] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T17:40:51.825541] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-06T17:40:52.625502] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-06T17:40:52.746061] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T17:40:53.415319] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T17:40:53.425554] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-06T17:40:53.664026] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-06T17:40:54.225536] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-06T17:40:54.820858] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-06T17:40:55.025561] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-06T17:40:55.825501] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-06T17:40:56.029076] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T17:40:56.625498] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-06T17:40:56.836352] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T17:40:56.905825] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-06T17:40:57.425541] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-06T17:40:57.537089] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T17:40:58.225718] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-06T17:40:59.025517] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-06T17:40:59.186517] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T17:40:59.254529] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T17:40:59.825559] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-06T17:41:00.095473] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T17:41:00.097250] [INFO ] [REMOTE ] BLD: Full fetch complete (40152 records). [2025-10-06T17:41:00.097393] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-06T17:41:00.488500] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-06T17:41:00.488632] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-06T17:41:00.489314] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-06T17:41:00.489383] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-06T17:41:00.490677] [DEBUG] [LOCAL ] BLD: Trimmed 40152 records to 27586 (keeping 200 days of data) [2025-10-06T17:41:00.633981] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-06T17:41:00.665972] [DEBUG] [LOCAL ] BLD: Primary data saved (27586 records). [2025-10-06T17:41:00.666137] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-06T17:41:00.666244] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLD took 32.6s. Estimated remaining: 4h 45m 54s. Rate: 7.3 symbols/min [2025-10-06T17:41:00.845054] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:41:00.892696] [DEBUG] [LOCAL ] BLND: Loaded 49987 existing records from primary storage. [2025-10-06T17:41:00.893119] [INFO ] [MAIN ] BLND: Loaded 49987 existing records. [2025-10-06T17:41:01.088304] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:41:01.094854] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T17:41:01.094398] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-06T17:41:01.099401] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-06T17:41:01.100428] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-06T17:41:01.100491] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-06T17:41:01.430733] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-06T17:41:01.474867] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:41:02.225601] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-06T17:41:03.035190] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-06T17:41:03.039594] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-06T17:41:03.137932] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T17:41:03.194914] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T17:41:03.825525] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-06T17:41:04.609150] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T17:41:04.625477] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-06T17:41:04.889055] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T17:41:05.425538] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-06T17:41:06.225535] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-06T17:41:06.306954] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T17:41:06.308022] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T17:41:07.025623] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-06T17:41:07.702265] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T17:41:07.825540] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-06T17:41:08.608491] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T17:41:08.625489] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-06T17:41:09.370473] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T17:41:09.425487] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-06T17:41:10.225499] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-06T17:41:10.305530] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T17:41:10.795681] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-06T17:41:11.025582] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-06T17:41:11.109378] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T17:41:11.825580] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-06T17:41:12.625517] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-06T17:41:12.849077] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T17:41:13.307367] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-06T17:41:13.425488] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-06T17:41:13.670337] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T17:41:14.225616] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-06T17:41:15.025564] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-06T17:41:15.400430] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-06T17:41:15.825518] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-06T17:41:16.301083] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-06T17:41:16.343320] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T17:41:16.583228] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T17:41:16.584494] [INFO ] [REMOTE ] BLE: Full fetch complete (20254 records). [2025-10-06T17:41:16.584567] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-06T17:41:16.630765] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-06T17:41:16.942844] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-06T17:41:16.942933] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-06T17:41:16.943276] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-06T17:41:16.943315] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-06T17:41:16.943983] [DEBUG] [LOCAL ] BLE: Trimmed 20254 records to 14135 (keeping 200 days of data) [2025-10-06T17:41:17.033747] [DEBUG] [LOCAL ] BLE: Primary data saved (14135 records). [2025-10-06T17:41:17.033993] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-06T17:41:17.034145] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 33.9s. Estimated remaining: 4h 46m 43s. Rate: 7.2 symbols/min [2025-10-06T17:41:17.217943] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:41:17.218167] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-06T17:41:17.218205] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-06T17:41:17.218323] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-06T17:41:17.218364] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-06T17:41:17.218404] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-06T17:41:17.218435] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-06T17:41:17.435441] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-06T17:41:17.572190] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:41:18.213235] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T17:41:18.225483] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-06T17:41:19.025696] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-06T17:41:19.095636] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T17:41:19.726530] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T17:41:19.825574] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-06T17:41:20.625556] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-06T17:41:20.802785] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T17:41:20.822891] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:41:20.823238] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-06T17:41:20.823348] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:41:20.823395] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-06T17:41:20.823461] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:41:20.823506] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-06T17:41:20.823568] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-06T17:41:20.823601] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-06T17:41:20.823662] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-06T17:41:20.823735] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLSH took 3.8s. Estimated remaining: 4h 46m 3s. Rate: 7.2 symbols/min [2025-10-06T17:41:20.992884] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:41:21.007584] [DEBUG] [LOCAL ] BLW: Loaded 13457 existing records from primary storage. [2025-10-06T17:41:21.007839] [INFO ] [MAIN ] BLW: Loaded 13457 existing records. [2025-10-06T17:41:21.221982] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:41:21.222272] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-06T17:41:21.222357] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-06T17:41:21.222869] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-06T17:41:21.222929] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-06T17:41:21.404694] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T17:41:21.430735] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-06T17:41:21.488965] [INFO ] [REMOTE ] BLK: Full fetch complete (52616 records). [2025-10-06T17:41:21.513070] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-06T17:41:21.713366] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:41:21.991471] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-06T17:41:21.991595] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-06T17:41:21.992347] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-06T17:41:21.992417] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-06T17:41:21.994432] [DEBUG] [LOCAL ] BLK: Trimmed 52616 records to 34166 (keeping 200 days of data) [2025-10-06T17:41:22.217370] [DEBUG] [LOCAL ] BLK: Primary data saved (34166 records). [2025-10-06T17:41:22.217566] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-06T17:41:22.217681] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLK took 35.7s. Estimated remaining: 4h 45m 7s. Rate: 7.3 symbols/min [2025-10-06T17:41:22.230758] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-06T17:41:22.392736] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:41:22.410577] [DEBUG] [LOCAL ] BLX: Loaded 15829 existing records from primary storage. [2025-10-06T17:41:22.410918] [INFO ] [MAIN ] BLX: Loaded 15829 existing records. [2025-10-06T17:41:22.591182] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:41:22.591629] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-06T17:41:22.591719] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-06T17:41:22.592017] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-06T17:41:22.592076] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-06T17:41:22.965096] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:41:23.025510] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-06T17:41:23.147082] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T17:41:23.311062] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-06T17:41:23.825563] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-06T17:41:24.625523] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-06T17:41:24.700988] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T17:41:25.006942] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-06T17:41:25.425534] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-06T17:41:25.536318] [DEBUG] [REMOTE ] BLW: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-06T17:41:25.536881] [WARN ] [REMOTE ] BLW: No data returned for month 2025-02 [2025-10-06T17:41:25.537027] [FATAL] [REMOTE ] BLW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:41:25.537138] [FATAL] [MAIN ] BLW: Failed to fetch primary data. [2025-10-06T17:41:25.537211] [WARN ] [MAIN ] BLW: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:41:25.537300] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-06T17:41:25.537405] [DEBUG] [LOCAL ] BLW: No primary data file found to delete. [2025-10-06T17:41:25.537479] [INFO ] [LOCAL ] BLW: Starting deletion of derivative data. [2025-10-06T17:41:25.537966] [DEBUG] [LOCAL ] BLW: Deleted derivative data file. [2025-10-06T17:41:25.538092] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLW took 4.7s. Estimated remaining: 4h 44m 25s. Rate: 7.3 symbols/min [2025-10-06T17:41:25.719459] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:41:25.760572] [DEBUG] [LOCAL ] BMA: Loaded 35953 existing records from primary storage. [2025-10-06T17:41:25.760980] [INFO ] [MAIN ] BMA: Loaded 35953 existing records. [2025-10-06T17:41:25.941979] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:41:25.942358] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-06T17:41:25.942420] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-06T17:41:25.942794] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-06T17:41:25.942892] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-06T17:41:26.231698] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-06T17:41:26.346268] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:41:26.376433] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T17:41:27.025553] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-06T17:41:27.825553] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-06T17:41:28.004930] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-06T17:41:28.007997] [INFO ] [REMOTE ] BLDR: Full fetch complete (74478 records). [2025-10-06T17:41:28.008116] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-06T17:41:28.457491] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-06T17:41:28.457676] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-06T17:41:28.459007] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-06T17:41:28.459103] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-06T17:41:28.461176] [DEBUG] [LOCAL ] BLDR: Trimmed 74478 records to 51674 (keeping 200 days of data) [2025-10-06T17:41:28.590273] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T17:41:28.625706] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-06T17:41:28.852751] [DEBUG] [LOCAL ] BLDR: Primary data saved (51674 records). [2025-10-06T17:41:28.852953] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-06T17:41:28.853049] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLDR took 49.0s. Estimated remaining: 4h 43m 43s. Rate: 7.3 symbols/min [2025-10-06T17:41:29.042808] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:41:29.044325] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T17:41:29.067005] [DEBUG] [LOCAL ] BME: Loaded 11124 existing records from primary storage. [2025-10-06T17:41:29.067472] [INFO ] [MAIN ] BME: Loaded 11124 existing records. [2025-10-06T17:41:29.242829] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:41:29.243040] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-06T17:41:29.243088] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-06T17:41:29.243312] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-06T17:41:29.243368] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-06T17:41:29.430738] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-06T17:41:29.595308] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:41:30.225570] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-06T17:41:30.471615] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-06T17:41:30.474721] [INFO ] [REMOTE ] BLND: Full fetch complete (72240 records). [2025-10-06T17:41:30.474897] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-06T17:41:30.883115] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-06T17:41:30.883229] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-06T17:41:30.884127] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-06T17:41:30.884194] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-06T17:41:30.885783] [DEBUG] [LOCAL ] BLND: Trimmed 72240 records to 49213 (keeping 200 days of data) [2025-10-06T17:41:31.020324] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T17:41:31.030498] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-06T17:41:31.217747] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T17:41:31.238287] [DEBUG] [LOCAL ] BLND: Primary data saved (49213 records). [2025-10-06T17:41:31.238531] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-06T17:41:31.238672] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLND took 30.6s. Estimated remaining: 4h 42m 55s. Rate: 7.3 symbols/min [2025-10-06T17:41:31.419447] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:41:31.420071] [DEBUG] [LOCAL ] BMEZ: No existing data file found in primary storage. [2025-10-06T17:41:31.420162] [WARN ] [MAIN ] BMEZ: No existing data found, performing full refresh instead. [2025-10-06T17:41:31.420328] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-06T17:41:31.420391] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-06T17:41:31.420477] [DEBUG] [LOCAL ] BMEZ: No primary data file found to delete. [2025-10-06T17:41:31.420523] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-06T17:41:31.782072] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:41:31.825500] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-06T17:41:32.178006] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T17:41:32.625580] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-06T17:41:33.110923] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T17:41:33.425518] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-06T17:41:33.542219] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T17:41:34.225540] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-06T17:41:34.293962] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T17:41:35.025576] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-06T17:41:35.436770] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T17:41:35.825556] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-06T17:41:36.390581] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T17:41:36.625498] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-06T17:41:36.928624] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T17:41:37.425537] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-06T17:41:37.672816] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T17:41:38.225578] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-06T17:41:38.645470] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-06T17:41:39.025575] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-06T17:41:39.376563] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T17:41:39.825555] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-06T17:41:40.421673] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T17:41:40.625512] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-06T17:41:40.804580] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T17:41:41.425548] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-06T17:41:41.442904] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-06T17:41:42.225569] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-06T17:41:42.848395] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-06T17:41:43.025505] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-06T17:41:43.086767] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-06T17:41:43.825540] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-06T17:41:43.988018] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T17:41:44.625530] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-06T17:41:44.688007] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T17:41:45.425543] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-06T17:41:46.046868] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T17:41:46.167974] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T17:41:46.225555] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-06T17:41:47.025531] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-06T17:41:47.707226] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T17:41:47.825483] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-06T17:41:48.051672] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T17:41:48.586107] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-06T17:41:48.625510] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-06T17:41:49.425499] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-06T17:41:49.507087] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T17:41:50.225496] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-06T17:41:50.441897] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T17:41:51.025533] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-06T17:41:51.711990] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T17:41:51.825510] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-06T17:41:51.839484] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-06T17:41:52.625609] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-06T17:41:53.254318] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T17:41:53.425542] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-06T17:41:53.614024] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T17:41:54.225539] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-06T17:41:54.465790] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T17:41:55.025068] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T17:41:55.026701] [INFO ] [REMOTE ] BLX: Full fetch complete (22751 records). [2025-10-06T17:41:55.026839] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-06T17:41:55.026524] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-06T17:41:55.393717] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-06T17:41:55.393820] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-06T17:41:55.394209] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-06T17:41:55.394248] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-06T17:41:55.394916] [DEBUG] [LOCAL ] BLX: Trimmed 22751 records to 15594 (keeping 200 days of data) [2025-10-06T17:41:55.489360] [DEBUG] [LOCAL ] BLX: Primary data saved (15594 records). [2025-10-06T17:41:55.489531] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-06T17:41:55.489631] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BLX took 33.3s. Estimated remaining: 4h 44m 36s. Rate: 7.3 symbols/min [2025-10-06T17:41:55.661629] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:41:55.688546] [DEBUG] [LOCAL ] BMI: Loaded 24515 existing records from primary storage. [2025-10-06T17:41:55.688904] [INFO ] [MAIN ] BMI: Loaded 24515 existing records. [2025-10-06T17:41:55.834197] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-06T17:41:55.874674] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:41:55.874925] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-06T17:41:55.874974] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-06T17:41:55.875251] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-06T17:41:55.875309] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-06T17:41:56.230301] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:41:56.462373] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T17:41:56.571501] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T17:41:56.572802] [INFO ] [REMOTE ] BME: Full fetch complete (16131 records). [2025-10-06T17:41:56.572874] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-06T17:41:56.634452] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-06T17:41:56.939800] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-06T17:41:56.939886] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-06T17:41:56.940216] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-06T17:41:56.940255] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-06T17:41:56.940804] [DEBUG] [LOCAL ] BME: Trimmed 16131 records to 11023 (keeping 200 days of data) [2025-10-06T17:41:57.008159] [DEBUG] [LOCAL ] BME: Primary data saved (11023 records). [2025-10-06T17:41:57.008320] [INFO ] [MAIN ] BME: Full history saved. [2025-10-06T17:41:57.008408] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BME took 28.2s. Estimated remaining: 4h 43m 42s. Rate: 7.3 symbols/min [2025-10-06T17:41:57.176205] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:41:57.180323] [DEBUG] [LOCAL ] BMN: Loaded 2606 existing records from primary storage. [2025-10-06T17:41:57.180470] [INFO ] [MAIN ] BMN: Loaded 2606 existing records. [2025-10-06T17:41:57.381806] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:41:57.382092] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-06T17:41:57.382140] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-06T17:41:57.382423] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-06T17:41:57.382482] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-06T17:41:57.436584] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-06T17:41:57.800617] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:41:58.225541] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-06T17:41:58.385612] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T17:41:58.437275] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T17:41:58.781259] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-06T17:41:59.025579] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-06T17:41:59.568116] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-06T17:41:59.825548] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-06T17:42:00.625592] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-06T17:42:01.312618] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T17:42:01.425496] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-06T17:42:01.533180] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T17:42:02.225561] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-06T17:42:02.592017] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-06T17:42:03.025498] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-06T17:42:03.475722] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T17:42:03.825577] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-06T17:42:04.625544] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-06T17:42:04.840910] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-06T17:42:04.843550] [INFO ] [REMOTE ] BMA: Full fetch complete (51536 records). [2025-10-06T17:42:04.843707] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-06T17:42:05.017405] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T17:42:05.257165] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-06T17:42:05.257307] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-06T17:42:05.258524] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-06T17:42:05.258607] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-06T17:42:05.260509] [DEBUG] [LOCAL ] BMA: Trimmed 51536 records to 35563 (keeping 200 days of data) [2025-10-06T17:42:05.429535] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-06T17:42:05.488245] [DEBUG] [LOCAL ] BMA: Primary data saved (35563 records). [2025-10-06T17:42:05.488486] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-06T17:42:05.489328] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BMA took 40.0s. Estimated remaining: 4h 43m 35s. Rate: 7.3 symbols/min [2025-10-06T17:42:05.666919] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:42:05.715686] [DEBUG] [LOCAL ] BMO: Loaded 41826 existing records from primary storage. [2025-10-06T17:42:05.716140] [INFO ] [MAIN ] BMO: Loaded 41826 existing records. [2025-10-06T17:42:05.912340] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:42:05.907010] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T17:42:05.917230] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-06T17:42:05.917688] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-06T17:42:05.919515] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-06T17:42:05.919595] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-06T17:42:06.230718] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-06T17:42:06.268846] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:42:06.752220] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T17:42:07.025560] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-06T17:42:07.663154] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-06T17:42:07.825550] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-06T17:42:08.625493] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-06T17:42:08.735255] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T17:42:09.052702] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-06T17:42:09.112332] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T17:42:09.114542] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40919 records). [2025-10-06T17:42:09.114638] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-06T17:42:09.430692] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-06T17:42:09.495348] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-06T17:42:09.495450] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-06T17:42:09.496034] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-06T17:42:09.496100] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-06T17:42:09.497262] [DEBUG] [LOCAL ] BMEZ: Trimmed 40919 records to 26581 (keeping 200 days of data) [2025-10-06T17:42:09.667814] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26581 records). [2025-10-06T17:42:09.668027] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-06T17:42:09.668118] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMEZ took 38.4s. Estimated remaining: 4h 42m 60s. Rate: 7.3 symbols/min [2025-10-06T17:42:09.852846] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:42:09.906073] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-10-06T17:42:09.906546] [INFO ] [MAIN ] BMY: Loaded 54537 existing records. [2025-10-06T17:42:09.993273] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-06T17:42:10.101529] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:42:10.101819] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-06T17:42:10.101931] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-06T17:42:10.103916] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-06T17:42:10.104131] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-06T17:42:10.230736] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-06T17:42:10.537185] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:42:11.025587] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-06T17:42:11.825540] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-06T17:42:11.942047] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T17:42:12.248451] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T17:42:12.625571] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-06T17:42:13.195598] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-06T17:42:13.425543] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-06T17:42:13.779244] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-06T17:42:13.832802] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-06T17:42:14.225531] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-06T17:42:14.668267] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-06T17:42:15.025543] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-06T17:42:15.502678] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-06T17:42:15.825559] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-06T17:42:16.578079] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-06T17:42:16.625485] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-06T17:42:17.103024] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-06T17:42:17.425570] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-06T17:42:18.225527] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-06T17:42:19.025614] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-06T17:42:19.067252] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T17:42:19.825511] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-06T17:42:19.919126] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T17:42:20.102412] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T17:42:20.374025] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T17:42:20.375044] [INFO ] [REMOTE ] BMN: Full fetch complete (3733 records). [2025-10-06T17:42:20.375119] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-06T17:42:20.375523] [FATAL] [VALIDATOR ] BMN: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:42:20.375684] [FATAL] [MAIN ] BMN: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:42:20.375740] [WARN ] [MAIN ] BMN: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:42:20.375788] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-06T17:42:20.375886] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-10-06T17:42:20.375938] [INFO ] [LOCAL ] BMN: Starting deletion of derivative data. [2025-10-06T17:42:20.376360] [DEBUG] [LOCAL ] BMN: Deleted derivative data file. [2025-10-06T17:42:20.376469] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMN took 23.4s. Estimated remaining: 4h 43m 8s. Rate: 7.3 symbols/min [2025-10-06T17:42:20.560013] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:42:20.616089] [DEBUG] [LOCAL ] BN: Loaded 53772 existing records from primary storage. [2025-10-06T17:42:20.616459] [INFO ] [MAIN ] BN: Loaded 53772 existing records. [2025-10-06T17:42:20.630617] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-06T17:42:20.803973] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:42:20.804245] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-06T17:42:20.804303] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-06T17:42:20.806088] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-06T17:42:20.806149] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-06T17:42:21.157038] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:42:21.425611] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-06T17:42:21.793396] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T17:42:22.225576] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-06T17:42:22.680964] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T17:42:23.025612] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-06T17:42:23.665819] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T17:42:23.825532] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-06T17:42:24.621047] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T17:42:24.630203] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-06T17:42:25.425569] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-06T17:42:25.555251] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T17:42:25.768050] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T17:42:26.225489] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-06T17:42:27.025713] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-06T17:42:27.302903] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T17:42:27.643951] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T17:42:27.825562] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-06T17:42:28.359089] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T17:42:28.625571] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-06T17:42:29.246038] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T17:42:29.425584] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-06T17:42:30.225555] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-06T17:42:30.529465] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T17:42:30.531422] [INFO ] [REMOTE ] BMI: Full fetch complete (33056 records). [2025-10-06T17:42:30.531521] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-06T17:42:30.924902] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-06T17:42:30.972491] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-06T17:42:30.973089] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-06T17:42:30.973609] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-06T17:42:30.973691] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-06T17:42:30.974774] [DEBUG] [LOCAL ] BMI: Trimmed 33056 records to 24309 (keeping 200 days of data) [2025-10-06T17:42:31.030331] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-06T17:42:31.131872] [DEBUG] [LOCAL ] BMI: Primary data saved (24309 records). [2025-10-06T17:42:31.132031] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-06T17:42:31.132121] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMI took 35.6s. Estimated remaining: 4h 43m 17s. Rate: 7.3 symbols/min [2025-10-06T17:42:31.298670] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:42:31.327584] [DEBUG] [LOCAL ] BNED: Loaded 29850 existing records from primary storage. [2025-10-06T17:42:31.327929] [INFO ] [MAIN ] BNED: Loaded 29850 existing records. [2025-10-06T17:42:31.504669] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:42:31.504957] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-06T17:42:31.505013] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-06T17:42:31.506075] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-06T17:42:31.506137] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-06T17:42:31.830334] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-06T17:42:31.871787] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:42:31.981148] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T17:42:32.588329] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T17:42:32.625490] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-06T17:42:33.425541] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-06T17:42:33.960181] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-06T17:42:34.100883] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T17:42:34.225500] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-06T17:42:35.025532] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-06T17:42:35.104879] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T17:42:35.485041] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T17:42:35.825556] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-06T17:42:36.625506] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-06T17:42:37.081770] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-06T17:42:37.209327] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T17:42:37.211813] [INFO ] [REMOTE ] BMO: Full fetch complete (59747 records). [2025-10-06T17:42:37.211903] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-06T17:42:37.432185] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-06T17:42:37.709096] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-06T17:42:37.709273] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-06T17:42:37.711017] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-06T17:42:37.711140] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-06T17:42:37.713145] [DEBUG] [LOCAL ] BMO: Trimmed 59747 records to 41165 (keeping 200 days of data) [2025-10-06T17:42:38.069535] [DEBUG] [LOCAL ] BMO: Primary data saved (41165 records). [2025-10-06T17:42:38.069743] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-06T17:42:38.070398] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 32.6s. Estimated remaining: 4h 42m 60s. Rate: 7.3 symbols/min [2025-10-06T17:42:38.230993] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-06T17:42:38.341328] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:42:38.353298] [DEBUG] [LOCAL ] BNH: Loaded 5198 existing records from primary storage. [2025-10-06T17:42:38.353694] [INFO ] [MAIN ] BNH: Loaded 5198 existing records. [2025-10-06T17:42:38.636323] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:42:38.636699] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-06T17:42:38.636779] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-06T17:42:38.637120] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-06T17:42:38.637279] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-06T17:42:39.064319] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-06T17:42:39.088384] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:42:39.089525] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-06T17:42:39.522413] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-06T17:42:39.825506] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-06T17:42:39.837814] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-06T17:42:39.916745] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T17:42:40.625600] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-06T17:42:41.425551] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-06T17:42:41.858582] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-06T17:42:41.887778] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T17:42:42.225523] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-06T17:42:42.794495] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-06T17:42:42.834449] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T17:42:43.025524] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-06T17:42:43.645152] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T17:42:43.825539] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-06T17:42:44.470867] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-06T17:42:44.625496] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-06T17:42:45.425551] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-06T17:42:46.225518] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-06T17:42:46.550462] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T17:42:46.713805] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-06T17:42:47.025546] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-06T17:42:47.431927] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-06T17:42:47.825512] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-06T17:42:47.980403] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T17:42:48.625531] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-06T17:42:49.199392] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T17:42:49.425555] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-06T17:42:50.225593] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-06T17:42:50.497744] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-06T17:42:50.777853] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T17:42:51.025611] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-06T17:42:51.825532] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-06T17:42:52.024971] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T17:42:52.103912] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T17:42:52.366502] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-06T17:42:52.625595] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-06T17:42:53.425547] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-06T17:42:53.876262] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-06T17:42:53.884404] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T17:42:53.889974] [INFO ] [REMOTE ] BMY: Full fetch complete (77405 records). [2025-10-06T17:42:53.890379] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-06T17:42:53.892451] [FATAL] [VALIDATOR ] BMY: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:42:53.892725] [FATAL] [MAIN ] BMY: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:42:53.892795] [WARN ] [MAIN ] BMY: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:42:53.892873] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-06T17:42:53.892991] [DEBUG] [LOCAL ] BMY: No primary data file found to delete. [2025-10-06T17:42:53.893053] [INFO ] [LOCAL ] BMY: Starting deletion of derivative data. [2025-10-06T17:42:53.893291] [DEBUG] [LOCAL ] BMY: Deleted derivative data file. [2025-10-06T17:42:53.893403] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMY took 44.2s. Estimated remaining: 4h 43m 42s. Rate: 7.3 symbols/min [2025-10-06T17:42:54.104715] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:42:54.111325] [DEBUG] [LOCAL ] BNJ: Loaded 2666 existing records from primary storage. [2025-10-06T17:42:54.111560] [INFO ] [MAIN ] BNJ: Loaded 2666 existing records. [2025-10-06T17:42:54.230814] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-06T17:42:54.302043] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:42:54.302506] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-06T17:42:54.302567] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-06T17:42:54.302799] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-06T17:42:54.302859] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-06T17:42:54.635261] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-06T17:42:54.724395] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:42:55.025629] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-06T17:42:55.733878] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-06T17:42:55.825508] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-06T17:42:56.301795] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-06T17:42:56.625563] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-06T17:42:57.425551] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-06T17:42:57.891289] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-06T17:42:58.225710] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-06T17:42:58.478152] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-06T17:42:59.025597] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-06T17:42:59.221294] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-06T17:42:59.580112] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-06T17:42:59.825549] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-06T17:43:00.432639] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-06T17:43:00.625545] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-06T17:43:01.282287] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-06T17:43:01.425625] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-06T17:43:01.973279] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-06T17:43:02.225556] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-06T17:43:02.974184] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T17:43:03.025485] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-06T17:43:03.611335] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T17:43:03.825533] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-06T17:43:04.414755] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-06T17:43:04.625530] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-06T17:43:05.231749] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T17:43:05.232776] [INFO ] [REMOTE ] BNH: Full fetch complete (7008 records). [2025-10-06T17:43:05.232923] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-06T17:43:05.434866] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-06T17:43:05.593335] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-06T17:43:05.593427] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-06T17:43:05.593637] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-06T17:43:05.593742] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-06T17:43:05.594165] [DEBUG] [LOCAL ] BNH: Trimmed 7008 records to 5218 (keeping 200 days of data) [2025-10-06T17:43:05.626224] [DEBUG] [LOCAL ] BNH: Primary data saved (5218 records). [2025-10-06T17:43:05.626364] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-06T17:43:05.626451] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BNH took 27.6s. Estimated remaining: 4h 43m 56s. Rate: 7.3 symbols/min [2025-10-06T17:43:05.791895] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:43:05.844899] [DEBUG] [LOCAL ] BNL: Loaded 47668 existing records from primary storage. [2025-10-06T17:43:05.845266] [INFO ] [MAIN ] BNL: Loaded 47668 existing records. [2025-10-06T17:43:06.025546] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:43:06.025885] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-06T17:43:06.025934] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-06T17:43:06.026391] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-06T17:43:06.026448] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-06T17:43:06.230739] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-06T17:43:06.400186] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:43:07.000172] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T17:43:07.025563] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-06T17:43:07.317747] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T17:43:07.715118] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-06T17:43:07.825546] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-06T17:43:08.625553] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-06T17:43:09.176580] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-06T17:43:09.218819] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T17:43:09.425531] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-06T17:43:10.225516] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-06T17:43:11.025496] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-06T17:43:11.337335] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T17:43:11.532807] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T17:43:11.825545] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-06T17:43:12.302523] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T17:43:12.303437] [INFO ] [REMOTE ] BNJ: Full fetch complete (4258 records). [2025-10-06T17:43:12.303513] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-06T17:43:12.630697] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-06T17:43:12.713628] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-06T17:43:12.713786] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-06T17:43:12.713965] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-06T17:43:12.714004] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-06T17:43:12.714389] [DEBUG] [LOCAL ] BNJ: Trimmed 4258 records to 2655 (keeping 200 days of data) [2025-10-06T17:43:12.732013] [DEBUG] [LOCAL ] BNJ: Primary data saved (2655 records). [2025-10-06T17:43:12.732172] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-06T17:43:12.732267] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BNJ took 18.8s. Estimated remaining: 4h 43m 40s. Rate: 7.3 symbols/min [2025-10-06T17:43:12.908589] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:43:12.996923] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-06T17:43:12.997860] [DEBUG] [LOCAL ] BNS: Loaded 52238 existing records from primary storage. [2025-10-06T17:43:13.010548] [INFO ] [MAIN ] BNS: Loaded 52238 existing records. [2025-10-06T17:43:13.198443] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:43:13.198723] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-06T17:43:13.198792] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-06T17:43:13.199293] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-06T17:43:13.199357] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-06T17:43:13.432372] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-06T17:43:13.646386] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:43:13.705548] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T17:43:13.707700] [INFO ] [REMOTE ] BNED: Full fetch complete (43634 records). [2025-10-06T17:43:13.707871] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-06T17:43:14.162358] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-06T17:43:14.162452] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-06T17:43:14.163348] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-06T17:43:14.163425] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-06T17:43:14.165018] [DEBUG] [LOCAL ] BNED: Trimmed 43634 records to 29447 (keeping 200 days of data) [2025-10-06T17:43:14.229417] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-06T17:43:14.362148] [DEBUG] [LOCAL ] BNED: Primary data saved (29447 records). [2025-10-06T17:43:14.362326] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-06T17:43:14.362417] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNED took 43.2s. Estimated remaining: 4h 42m 49s. Rate: 7.3 symbols/min [2025-10-06T17:43:14.570951] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:43:14.577436] [DEBUG] [LOCAL ] BNT: Loaded 3434 existing records from primary storage. [2025-10-06T17:43:14.577632] [INFO ] [MAIN ] BNT: Loaded 3434 existing records. [2025-10-06T17:43:14.764856] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:43:14.765183] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-06T17:43:14.765241] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-06T17:43:14.765407] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-06T17:43:14.765465] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-06T17:43:15.034453] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-06T17:43:15.126224] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:43:15.142681] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T17:43:15.146358] [INFO ] [REMOTE ] BN: Full fetch complete (76712 records). [2025-10-06T17:43:15.146513] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-06T17:43:15.627158] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-06T17:43:15.627328] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-06T17:43:15.628374] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-06T17:43:15.628460] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-06T17:43:15.630310] [DEBUG] [LOCAL ] BN: Trimmed 76712 records to 52993 (keeping 200 days of data) [2025-10-06T17:43:15.758049] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T17:43:15.847203] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-06T17:43:16.004894] [DEBUG] [LOCAL ] BN: Primary data saved (52993 records). [2025-10-06T17:43:16.005106] [INFO ] [MAIN ] BN: Full history saved. [2025-10-06T17:43:16.005201] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BN took 55.6s. Estimated remaining: 4h 41m 57s. Rate: 7.3 symbols/min [2025-10-06T17:43:16.172753] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:43:16.182389] [DEBUG] [LOCAL ] BNY: Loaded 7209 existing records from primary storage. [2025-10-06T17:43:16.182579] [INFO ] [MAIN ] BNY: Loaded 7209 existing records. [2025-10-06T17:43:16.368975] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:43:16.369267] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-06T17:43:16.369326] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-06T17:43:16.369537] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-06T17:43:16.369614] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-06T17:43:16.626361] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-06T17:43:16.679939] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-06T17:43:16.774358] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:43:17.010576] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-06T17:43:17.425615] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-06T17:43:18.112736] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T17:43:18.225491] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-06T17:43:19.025533] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-06T17:43:19.057396] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T17:43:19.517768] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-06T17:43:19.825517] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-06T17:43:19.867394] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T17:43:20.316206] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-06T17:43:20.625556] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-06T17:43:21.231097] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T17:43:21.425551] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-06T17:43:22.225515] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-06T17:43:23.025521] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-06T17:43:23.168389] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T17:43:23.171790] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T17:43:23.825573] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-06T17:43:24.425866] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T17:43:24.631858] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-06T17:43:24.650893] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T17:43:25.342269] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-06T17:43:25.425496] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-06T17:43:25.932682] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-06T17:43:26.225606] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-06T17:43:27.025556] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-06T17:43:27.550007] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-06T17:43:27.825539] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-06T17:43:28.079424] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T17:43:28.170535] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-06T17:43:28.625554] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-06T17:43:29.061990] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-06T17:43:29.425548] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-06T17:43:30.080782] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-06T17:43:30.225546] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-06T17:43:31.025612] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-06T17:43:31.825491] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-06T17:43:31.946196] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T17:43:32.421410] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T17:43:32.614561] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T17:43:32.625477] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-06T17:43:33.425567] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-06T17:43:33.965022] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T17:43:33.965918] [INFO ] [REMOTE ] BNT: Full fetch complete (4531 records). [2025-10-06T17:43:33.965987] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-06T17:43:34.227286] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-06T17:43:34.329189] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-06T17:43:34.329276] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-06T17:43:34.329415] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-06T17:43:34.329490] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-06T17:43:34.329885] [DEBUG] [LOCAL ] BNT: Trimmed 4531 records to 3349 (keeping 200 days of data) [2025-10-06T17:43:34.352196] [DEBUG] [LOCAL ] BNT: Primary data saved (3349 records). [2025-10-06T17:43:34.352413] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-06T17:43:34.352549] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNT took 20.0s. Estimated remaining: 4h 42m 55s. Rate: 7.3 symbols/min [2025-10-06T17:43:34.559511] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:43:34.561410] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-06T17:43:34.589774] [DEBUG] [LOCAL ] BOC: Loaded 18490 existing records from primary storage. [2025-10-06T17:43:34.590050] [INFO ] [MAIN ] BOC: Loaded 18490 existing records. [2025-10-06T17:43:34.768749] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:43:34.769096] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-06T17:43:34.769156] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-06T17:43:34.769439] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-06T17:43:34.769495] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-06T17:43:35.033802] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-06T17:43:35.124724] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:43:35.825550] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-06T17:43:35.972461] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T17:43:36.625488] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-06T17:43:36.687994] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T17:43:36.929239] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T17:43:37.425600] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-06T17:43:38.225513] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-06T17:43:38.327276] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T17:43:38.556874] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-06T17:43:38.991557] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-06T17:43:39.025474] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-06T17:43:39.658801] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-06T17:43:39.825480] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-06T17:43:40.597601] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-06T17:43:40.625478] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-06T17:43:41.248873] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-06T17:43:41.425547] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-06T17:43:42.225507] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-06T17:43:43.025491] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-06T17:43:43.223107] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T17:43:43.223902] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-06T17:43:43.474555] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-06T17:43:43.825540] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-06T17:43:44.610138] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T17:43:44.625473] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-06T17:43:45.052919] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-06T17:43:45.425525] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-06T17:43:46.225598] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-06T17:43:47.025710] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-06T17:43:47.189053] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T17:43:47.518558] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T17:43:47.815993] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T17:43:47.817579] [INFO ] [REMOTE ] BNY: Full fetch complete (10378 records). [2025-10-06T17:43:47.817750] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-06T17:43:47.832745] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-06T17:43:48.218755] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-06T17:43:48.218851] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-06T17:43:48.219126] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-06T17:43:48.219170] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-06T17:43:48.219705] [DEBUG] [LOCAL ] BNY: Trimmed 10378 records to 7004 (keeping 200 days of data) [2025-10-06T17:43:48.263690] [DEBUG] [LOCAL ] BNY: Primary data saved (7004 records). [2025-10-06T17:43:48.263875] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-06T17:43:48.263970] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNY took 32.3s. Estimated remaining: 4h 43m 23s. Rate: 7.2 symbols/min [2025-10-06T17:43:48.625514] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-06T17:43:48.866982] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T17:43:49.425574] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-06T17:43:50.225522] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-06T17:43:50.468277] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T17:43:50.493976] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T17:43:51.025626] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-06T17:43:51.266697] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-06T17:43:51.270187] [INFO ] [REMOTE ] BNL: Full fetch complete (67145 records). [2025-10-06T17:43:51.270326] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-06T17:43:51.665370] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-06T17:43:51.665460] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-06T17:43:51.666236] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-06T17:43:51.666299] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-06T17:43:51.667882] [DEBUG] [LOCAL ] BNL: Trimmed 67145 records to 47097 (keeping 200 days of data) [2025-10-06T17:43:51.846032] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-06T17:43:51.982773] [DEBUG] [LOCAL ] BNL: Primary data saved (47097 records). [2025-10-06T17:43:51.982984] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-06T17:43:51.983791] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNL took 46.4s. Estimated remaining: 4h 42m 45s. Rate: 7.3 symbols/min [2025-10-06T17:43:52.699841] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T17:43:52.712055] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-06T17:43:52.723198] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T17:43:53.425601] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-06T17:43:54.262754] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T17:43:54.266094] [INFO ] [REMOTE ] BNS: Full fetch complete (74323 records). [2025-10-06T17:43:54.266290] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-06T17:43:54.597324] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T17:43:54.622770] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-06T17:43:54.697606] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-06T17:43:54.697753] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-06T17:43:54.698561] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-06T17:43:54.698606] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-06T17:43:54.700137] [DEBUG] [LOCAL ] BNS: Trimmed 74323 records to 51491 (keeping 200 days of data) [2025-10-06T17:43:55.020035] [DEBUG] [LOCAL ] BNS: Primary data saved (51491 records). [2025-10-06T17:43:55.020692] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-06T17:43:55.020918] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNS took 42.3s. Estimated remaining: 4h 42m 4s. Rate: 7.3 symbols/min [2025-10-06T17:43:55.705127] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T17:43:55.710102] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-06T17:43:56.830402] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T17:43:56.835509] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-06T17:43:57.868959] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-06T17:43:57.873400] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-06T17:43:58.651473] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T17:43:58.653861] [INFO ] [REMOTE ] BOC: Full fetch complete (25751 records). [2025-10-06T17:43:58.654226] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-06T17:43:59.059027] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-06T17:43:59.059125] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-06T17:43:59.059525] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-06T17:43:59.059564] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-06T17:43:59.060239] [DEBUG] [LOCAL ] BOC: Trimmed 25751 records to 18309 (keeping 200 days of data) [2025-10-06T17:43:59.170253] [DEBUG] [LOCAL ] BOC: Primary data saved (18309 records). [2025-10-06T17:43:59.170463] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-06T17:43:59.170596] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 24.8s. Estimated remaining: 4h 41m 29s. Rate: 7.3 symbols/min [2025-10-06T17:43:59.878053] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:43:59.886874] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:43:59.922099] [DEBUG] [LOCAL ] BOH: No existing data file found in primary storage. [2025-10-06T17:43:59.945402] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:43:59.955790] [WARN ] [MAIN ] BOH: No existing data found, performing full refresh instead. [2025-10-06T17:43:59.958154] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-06T17:43:59.979328] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-06T17:43:59.979616] [DEBUG] [LOCAL ] BOH: No primary data file found to delete. [2025-10-06T17:43:59.979720] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-06T17:43:59.979219] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:44:00.196541] [DEBUG] [LOCAL ] BOE: Loaded 18104 existing records from primary storage. [2025-10-06T17:44:00.198618] [DEBUG] [LOCAL ] BOOT: Loaded 41070 existing records from primary storage. [2025-10-06T17:44:00.210428] [INFO ] [MAIN ] BOE: Loaded 18104 existing records. [2025-10-06T17:44:00.209481] [INFO ] [MAIN ] BOOT: Loaded 41070 existing records. [2025-10-06T17:44:00.241147] [DEBUG] [LOCAL ] BOND: Loaded 32665 existing records from primary storage. [2025-10-06T17:44:00.316043] [INFO ] [MAIN ] BOND: Loaded 32665 existing records. [2025-10-06T17:44:00.865182] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:44:00.908332] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:44:00.918604] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:44:00.949421] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-06T17:44:00.949550] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-06T17:44:00.949857] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-06T17:44:00.950929] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-06T17:44:00.963258] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-06T17:44:00.996392] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:44:00.988322] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-06T17:44:00.997314] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-06T17:44:00.997620] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-06T17:44:00.997100] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-06T17:44:01.018736] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-06T17:44:01.030727] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-06T17:44:01.037244] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-06T17:44:01.055757] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-06T17:44:02.124607] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:44:02.242729] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:44:02.239230] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-06T17:44:02.255787] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-06T17:44:02.294593] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:44:02.295361] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-06T17:44:02.319085] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T17:44:02.327422] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-06T17:44:03.455458] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T17:44:03.460833] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-06T17:44:03.562233] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T17:44:03.569503] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-06T17:44:03.667889] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T17:44:03.675574] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-06T17:44:03.759902] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T17:44:03.825520] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-06T17:44:04.608571] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-06T17:44:04.625469] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-06T17:44:04.877266] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T17:44:05.003318] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T17:44:05.121230] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T17:44:05.425613] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-06T17:44:05.695104] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T17:44:06.225589] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-06T17:44:06.892443] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T17:44:07.025502] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-06T17:44:07.667149] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T17:44:07.825548] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-06T17:44:08.624595] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T17:44:08.633591] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-06T17:44:09.323805] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T17:44:09.425494] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-06T17:44:09.639757] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-06T17:44:10.225530] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-06T17:44:10.953858] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T17:44:11.025479] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-06T17:44:11.345163] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T17:44:11.825593] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-06T17:44:12.231473] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-06T17:44:12.546249] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T17:44:12.625524] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-06T17:44:13.425559] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-06T17:44:13.948566] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-06T17:44:14.225539] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-06T17:44:15.025555] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-06T17:44:15.144722] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T17:44:15.168620] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T17:44:15.825568] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-06T17:44:16.400416] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T17:44:16.625556] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-06T17:44:16.944928] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-06T17:44:17.425572] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-06T17:44:17.875158] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-06T17:44:18.225591] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-06T17:44:19.025571] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-06T17:44:19.159675] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T17:44:19.241803] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T17:44:19.825559] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-06T17:44:19.981424] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T17:44:20.625592] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-06T17:44:21.135424] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-06T17:44:21.425516] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-06T17:44:21.726922] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T17:44:22.225517] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-06T17:44:23.030747] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-06T17:44:23.054068] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T17:44:23.576516] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-06T17:44:23.825530] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-06T17:44:24.318030] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-06T17:44:24.625541] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-06T17:44:25.438048] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T17:44:25.435464] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-06T17:44:25.694208] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T17:44:25.696275] [INFO ] [REMOTE ] BOH: Full fetch complete (44836 records). [2025-10-06T17:44:25.696585] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-06T17:44:26.091365] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-06T17:44:26.091472] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-06T17:44:26.092118] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-06T17:44:26.092185] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-06T17:44:26.093458] [DEBUG] [LOCAL ] BOH: Trimmed 44836 records to 30588 (keeping 200 days of data) [2025-10-06T17:44:26.249725] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-06T17:44:26.289531] [DEBUG] [LOCAL ] BOH: Primary data saved (30588 records). [2025-10-06T17:44:26.289746] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-06T17:44:26.289845] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOH took 27.1s. Estimated remaining: 4h 43m 21s. Rate: 7.2 symbols/min [2025-10-06T17:44:26.469964] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:44:26.521354] [DEBUG] [LOCAL ] BORR: Loaded 51865 existing records from primary storage. [2025-10-06T17:44:26.521760] [INFO ] [MAIN ] BORR: Loaded 51865 existing records. [2025-10-06T17:44:26.702068] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:44:26.702329] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-06T17:44:26.702397] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-06T17:44:26.704715] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-06T17:44:26.704781] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-06T17:44:27.014070] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T17:44:27.045087] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-06T17:44:27.148885] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:44:27.734546] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T17:44:27.825536] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-06T17:44:28.154771] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T17:44:28.157363] [INFO ] [REMOTE ] BOE: Full fetch complete (26890 records). [2025-10-06T17:44:28.157470] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-06T17:44:28.519744] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-06T17:44:28.519844] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-06T17:44:28.520267] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-06T17:44:28.520308] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-06T17:44:28.521082] [DEBUG] [LOCAL ] BOE: Trimmed 26890 records to 18006 (keeping 200 days of data) [2025-10-06T17:44:28.626011] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-06T17:44:28.632513] [DEBUG] [LOCAL ] BOE: Primary data saved (18006 records). [2025-10-06T17:44:28.632697] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-06T17:44:28.632798] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOE took 29.5s. Estimated remaining: 4h 42m 35s. Rate: 7.3 symbols/min [2025-10-06T17:44:28.813302] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:44:28.847858] [DEBUG] [LOCAL ] BOW: Loaded 24158 existing records from primary storage. [2025-10-06T17:44:28.848239] [INFO ] [MAIN ] BOW: Loaded 24158 existing records. [2025-10-06T17:44:29.028514] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:44:29.028849] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-06T17:44:29.028907] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-06T17:44:29.029760] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-06T17:44:29.029820] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-06T17:44:29.396103] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:44:29.425500] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-06T17:44:29.485899] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T17:44:30.156091] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T17:44:30.225501] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-06T17:44:30.526179] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T17:44:31.025574] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-06T17:44:31.540597] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T17:44:31.543044] [INFO ] [REMOTE ] BOOT: Full fetch complete (60165 records). [2025-10-06T17:44:31.543200] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-06T17:44:31.830700] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-06T17:44:31.942725] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-06T17:44:31.942839] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-06T17:44:31.943551] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-06T17:44:31.943618] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-06T17:44:31.945048] [DEBUG] [LOCAL ] BOOT: Trimmed 60165 records to 40336 (keeping 200 days of data) [2025-10-06T17:44:32.188401] [DEBUG] [LOCAL ] BOOT: Primary data saved (40336 records). [2025-10-06T17:44:32.188558] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-06T17:44:32.188663] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOOT took 33.0s. Estimated remaining: 4h 41m 57s. Rate: 7.3 symbols/min [2025-10-06T17:44:32.357088] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:44:32.405956] [DEBUG] [LOCAL ] BOX: Loaded 50948 existing records from primary storage. [2025-10-06T17:44:32.406302] [INFO ] [MAIN ] BOX: Loaded 50948 existing records. [2025-10-06T17:44:32.592349] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:44:32.592962] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-06T17:44:32.593094] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-06T17:44:32.595118] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-06T17:44:32.595193] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-06T17:44:32.645366] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-06T17:44:32.842066] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T17:44:32.890034] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T17:44:33.014611] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:44:33.425535] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-06T17:44:34.051475] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T17:44:34.225525] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-06T17:44:35.025554] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-06T17:44:35.218038] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-06T17:44:35.309018] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T17:44:35.829186] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-06T17:44:35.834516] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-06T17:44:36.625501] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-06T17:44:37.425540] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-06T17:44:37.639087] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T17:44:37.887586] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T17:44:38.225505] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-06T17:44:39.030761] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-06T17:44:39.046463] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T17:44:39.825513] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-06T17:44:39.936399] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T17:44:40.285953] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T17:44:40.625557] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-06T17:44:41.335604] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T17:44:41.425574] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-06T17:44:42.225500] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-06T17:44:42.422205] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T17:44:42.474685] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T17:44:43.025596] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-06T17:44:43.305886] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-06T17:44:43.825555] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-06T17:44:44.625515] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-06T17:44:44.905015] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-06T17:44:44.917353] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T17:44:45.425589] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-06T17:44:45.819507] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T17:44:45.821731] [INFO ] [REMOTE ] BOND: Full fetch complete (46520 records). [2025-10-06T17:44:45.821820] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-06T17:44:46.190000] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-06T17:44:46.190136] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-06T17:44:46.190803] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-06T17:44:46.190927] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-06T17:44:46.192065] [DEBUG] [LOCAL ] BOND: Trimmed 46520 records to 32214 (keeping 200 days of data) [2025-10-06T17:44:46.249521] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-06T17:44:46.304818] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T17:44:46.412856] [DEBUG] [LOCAL ] BOND: Primary data saved (32214 records). [2025-10-06T17:44:46.413023] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-06T17:44:46.413112] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOND took 47.2s. Estimated remaining: 4h 42m 26s. Rate: 7.2 symbols/min [2025-10-06T17:44:46.578209] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:44:46.628229] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-10-06T17:44:46.628591] [INFO ] [MAIN ] BP: Loaded 54491 existing records. [2025-10-06T17:44:46.801046] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:44:46.801248] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-06T17:44:46.801295] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-06T17:44:46.802868] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-06T17:44:46.802930] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-06T17:44:47.036109] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-06T17:44:47.151822] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:44:47.825524] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-06T17:44:48.259470] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-06T17:44:48.625500] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-06T17:44:48.882138] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T17:44:49.425565] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-06T17:44:49.707340] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T17:44:50.036698] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-06T17:44:50.225518] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-06T17:44:51.025569] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-06T17:44:51.093385] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T17:44:51.825571] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-06T17:44:51.856878] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-06T17:44:52.200358] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-06T17:44:52.625540] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-06T17:44:53.425623] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-06T17:44:53.953686] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-06T17:44:54.236223] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-06T17:44:54.247734] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T17:44:54.292689] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T17:44:54.294835] [INFO ] [REMOTE ] BOW: Full fetch complete (31813 records). [2025-10-06T17:44:54.294916] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-06T17:44:54.666395] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-06T17:44:54.666535] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-06T17:44:54.667084] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-06T17:44:54.667233] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-06T17:44:54.668512] [DEBUG] [LOCAL ] BOW: Trimmed 31813 records to 23794 (keeping 200 days of data) [2025-10-06T17:44:54.807885] [DEBUG] [LOCAL ] BOW: Primary data saved (23794 records). [2025-10-06T17:44:54.808057] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-06T17:44:54.808150] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 26.2s. Estimated remaining: 4h 42m 19s. Rate: 7.2 symbols/min [2025-10-06T17:44:54.993390] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:44:55.027848] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-06T17:44:55.029073] [DEBUG] [LOCAL ] BR: Loaded 35147 existing records from primary storage. [2025-10-06T17:44:55.030288] [INFO ] [MAIN ] BR: Loaded 35147 existing records. [2025-10-06T17:44:55.210495] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:44:55.210807] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-06T17:44:55.210858] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-06T17:44:55.211247] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-06T17:44:55.211304] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-06T17:44:55.569852] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:44:55.825561] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-06T17:44:56.367974] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-06T17:44:56.625554] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-06T17:44:56.772409] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T17:44:57.362313] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T17:44:57.425522] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-06T17:44:58.225569] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-06T17:44:58.409833] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T17:44:59.025536] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-06T17:44:59.158855] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T17:44:59.825554] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-06T17:45:00.361680] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-06T17:45:00.436083] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T17:45:00.625495] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-06T17:45:01.425629] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-06T17:45:01.802614] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T17:45:02.225520] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-06T17:45:02.450468] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-06T17:45:02.453160] [INFO ] [REMOTE ] BORR: Full fetch complete (74247 records). [2025-10-06T17:45:02.453353] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-06T17:45:02.454290] [FATAL] [VALIDATOR ] BORR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:45:02.454405] [FATAL] [MAIN ] BORR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:45:02.454544] [WARN ] [MAIN ] BORR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:45:02.454584] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-06T17:45:02.454676] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-10-06T17:45:02.454733] [INFO ] [LOCAL ] BORR: Starting deletion of derivative data. [2025-10-06T17:45:02.455020] [DEBUG] [LOCAL ] BORR: Deleted derivative data file. [2025-10-06T17:45:02.455765] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BORR took 36.2s. Estimated remaining: 4h 42m 7s. Rate: 7.2 symbols/min [2025-10-06T17:45:02.665731] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:45:02.730329] [DEBUG] [LOCAL ] BRBR: Loaded 52061 existing records from primary storage. [2025-10-06T17:45:02.730763] [INFO ] [MAIN ] BRBR: Loaded 52061 existing records. [2025-10-06T17:45:02.911233] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:45:02.911477] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-06T17:45:02.911525] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-06T17:45:02.911919] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-06T17:45:02.911977] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-06T17:45:03.030798] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-06T17:45:03.335063] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:45:03.783701] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-06T17:45:03.827919] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-06T17:45:03.831115] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T17:45:04.410191] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T17:45:04.625536] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-06T17:45:05.425614] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-06T17:45:05.480567] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T17:45:06.223371] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-06T17:45:06.225927] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-06T17:45:06.228694] [INFO ] [REMOTE ] BOX: Full fetch complete (72101 records). [2025-10-06T17:45:06.228898] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-06T17:45:06.659689] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-06T17:45:06.660035] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-06T17:45:06.660910] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-06T17:45:06.660974] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-06T17:45:06.662529] [DEBUG] [LOCAL ] BOX: Trimmed 72101 records to 50221 (keeping 200 days of data) [2025-10-06T17:45:06.892270] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T17:45:06.998506] [DEBUG] [LOCAL ] BOX: Primary data saved (50221 records). [2025-10-06T17:45:06.998733] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-06T17:45:06.998846] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOX took 34.8s. Estimated remaining: 4h 41m 35s. Rate: 7.3 symbols/min [2025-10-06T17:45:07.033151] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-06T17:45:07.197554] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:45:07.197793] [DEBUG] [LOCAL ] BRC: No existing data file found in primary storage. [2025-10-06T17:45:07.197839] [WARN ] [MAIN ] BRC: No existing data found, performing full refresh instead. [2025-10-06T17:45:07.197957] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-06T17:45:07.197999] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-06T17:45:07.198040] [DEBUG] [LOCAL ] BRC: No primary data file found to delete. [2025-10-06T17:45:07.198078] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-06T17:45:07.567882] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:45:07.825579] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-06T17:45:08.562895] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-06T17:45:08.625551] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-06T17:45:08.721778] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T17:45:09.413905] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T17:45:09.425474] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-06T17:45:10.225535] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-06T17:45:10.758051] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-06T17:45:11.025526] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-06T17:45:11.141812] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T17:45:11.168518] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T17:45:11.825533] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-06T17:45:12.625553] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-06T17:45:13.005702] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T17:45:13.273192] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-06T17:45:13.299499] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-06T17:45:13.425597] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-06T17:45:14.225501] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-06T17:45:14.539789] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T17:45:15.025549] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-06T17:45:15.825494] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-06T17:45:16.217710] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-06T17:45:16.482916] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-06T17:45:16.625532] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-06T17:45:17.189376] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T17:45:17.425548] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-06T17:45:18.225528] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-06T17:45:18.817954] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-06T17:45:19.025568] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-06T17:45:19.147840] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T17:45:19.379469] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T17:45:19.825542] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-06T17:45:20.516827] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T17:45:20.625545] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-06T17:45:21.425557] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-06T17:45:21.894603] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-06T17:45:21.897742] [INFO ] [REMOTE ] BP: Full fetch complete (77373 records). [2025-10-06T17:45:21.897914] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-06T17:45:21.899231] [FATAL] [VALIDATOR ] BP: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:45:21.899548] [FATAL] [MAIN ] BP: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:45:21.899880] [WARN ] [MAIN ] BP: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:45:21.900047] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-06T17:45:21.900142] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-10-06T17:45:21.900186] [INFO ] [LOCAL ] BP: Starting deletion of derivative data. [2025-10-06T17:45:21.900555] [DEBUG] [LOCAL ] BP: Deleted derivative data file. [2025-10-06T17:45:21.900741] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BP took 35.5s. Estimated remaining: 4h 42m 8s. Rate: 7.2 symbols/min [2025-10-06T17:45:22.086853] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:45:22.087202] [DEBUG] [LOCAL ] BRCC: No existing data file found in primary storage. [2025-10-06T17:45:22.087308] [WARN ] [MAIN ] BRCC: No existing data found, performing full refresh instead. [2025-10-06T17:45:22.087540] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-06T17:45:22.087623] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-06T17:45:22.087777] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-06T17:45:22.087865] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-06T17:45:22.236758] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-06T17:45:22.563556] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-06T17:45:22.578779] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:45:22.928483] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T17:45:23.025561] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-06T17:45:23.584173] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-06T17:45:23.825593] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-06T17:45:24.625559] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-06T17:45:24.995957] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-06T17:45:25.050403] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T17:45:25.425533] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-06T17:45:26.225556] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-06T17:45:26.410234] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T17:45:26.532801] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T17:45:27.025555] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-06T17:45:27.663131] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T17:45:27.825545] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-06T17:45:28.533576] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T17:45:28.625540] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-06T17:45:29.204184] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T17:45:29.224612] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T17:45:29.425537] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-06T17:45:30.225530] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-06T17:45:31.025528] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-06T17:45:31.097387] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T17:45:31.641614] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T17:45:31.644266] [INFO ] [REMOTE ] BR: Full fetch complete (49460 records). [2025-10-06T17:45:31.644402] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-06T17:45:31.831260] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-06T17:45:32.089849] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-06T17:45:32.089974] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-06T17:45:32.090705] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-06T17:45:32.090775] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-06T17:45:32.092338] [DEBUG] [LOCAL ] BR: Trimmed 49460 records to 34837 (keeping 200 days of data) [2025-10-06T17:45:32.360163] [DEBUG] [LOCAL ] BR: Primary data saved (34837 records). [2025-10-06T17:45:32.360537] [INFO ] [MAIN ] BR: Full history saved. [2025-10-06T17:45:32.360728] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 37.6s. Estimated remaining: 4h 42m 13s. Rate: 7.2 symbols/min [2025-10-06T17:45:32.630861] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-06T17:45:32.656594] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:45:32.739554] [DEBUG] [LOCAL ] BRO: Loaded 52641 existing records from primary storage. [2025-10-06T17:45:32.740188] [INFO ] [MAIN ] BRO: Loaded 52641 existing records. [2025-10-06T17:45:33.008766] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-06T17:45:33.085760] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:45:33.115967] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-06T17:45:33.129022] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-06T17:45:33.132294] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-06T17:45:33.132188] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-06T17:45:33.132607] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-06T17:45:33.425746] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-06T17:45:33.639573] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:45:33.917389] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-06T17:45:34.225556] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-06T17:45:35.025601] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-06T17:45:35.174705] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T17:45:35.825492] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-06T17:45:36.113125] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-06T17:45:36.572178] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T17:45:36.625487] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-06T17:45:37.425541] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-06T17:45:37.523049] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T17:45:37.665883] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T17:45:38.225541] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-06T17:45:38.498941] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T17:45:38.500894] [INFO ] [REMOTE ] BRC: Full fetch complete (29012 records). [2025-10-06T17:45:38.500984] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-06T17:45:38.867318] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-06T17:45:38.867408] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-06T17:45:38.867887] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-06T17:45:38.867961] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-06T17:45:38.868802] [DEBUG] [LOCAL ] BRC: Trimmed 29012 records to 18933 (keeping 200 days of data) [2025-10-06T17:45:38.985352] [DEBUG] [LOCAL ] BRC: Primary data saved (18933 records). [2025-10-06T17:45:38.985532] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-06T17:45:38.985614] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRC took 32.0s. Estimated remaining: 4h 41m 55s. Rate: 7.2 symbols/min [2025-10-06T17:45:39.030810] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-06T17:45:39.158943] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:45:39.209774] [DEBUG] [LOCAL ] BROS: Loaded 54071 existing records from primary storage. [2025-10-06T17:45:39.210125] [INFO ] [MAIN ] BROS: Loaded 54071 existing records. [2025-10-06T17:45:39.395578] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:45:39.395900] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-06T17:45:39.395964] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-06T17:45:39.397360] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-06T17:45:39.397424] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-06T17:45:39.755710] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:45:39.793469] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T17:45:39.825479] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-06T17:45:40.625491] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-06T17:45:40.999779] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-06T17:45:41.425577] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-06T17:45:41.555684] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T17:45:42.225539] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-06T17:45:42.536078] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T17:45:42.706852] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-06T17:45:43.025560] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-06T17:45:43.704945] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T17:45:43.825581] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-06T17:45:44.625572] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-06T17:45:45.017327] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-06T17:45:45.425570] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-06T17:45:45.600389] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T17:45:46.225580] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-06T17:45:46.334616] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T17:45:46.967617] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T17:45:47.025567] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-06T17:45:47.825481] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-06T17:45:48.249265] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-06T17:45:48.381401] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T17:45:48.384470] [INFO ] [REMOTE ] BRBR: Full fetch complete (72172 records). [2025-10-06T17:45:48.384583] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-06T17:45:48.632196] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-06T17:45:48.810271] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-06T17:45:48.810409] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-06T17:45:48.811332] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-06T17:45:48.811402] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-06T17:45:48.813158] [DEBUG] [LOCAL ] BRBR: Trimmed 72172 records to 51408 (keeping 200 days of data) [2025-10-06T17:45:49.114420] [DEBUG] [LOCAL ] BRBR: Primary data saved (51408 records). [2025-10-06T17:45:49.114589] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-06T17:45:49.115247] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRBR took 46.7s. Estimated remaining: 4h 41m 58s. Rate: 7.2 symbols/min [2025-10-06T17:45:49.240236] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T17:45:49.289519] [INFO ] [REMOTE ] BRCC: Full fetch complete (57601 records). [2025-10-06T17:45:49.298825] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-06T17:45:49.300377] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:45:49.301051] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-06T17:45:49.301108] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-06T17:45:49.301233] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-06T17:45:49.301275] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-06T17:45:49.301317] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-06T17:45:49.301352] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-06T17:45:49.460433] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-06T17:45:50.088946] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-06T17:45:50.105085] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-06T17:45:50.107307] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-06T17:45:50.107400] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-06T17:45:50.111383] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:45:50.112873] [DEBUG] [LOCAL ] BRCC: Trimmed 57601 records to 40170 (keeping 200 days of data) [2025-10-06T17:45:50.225638] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-06T17:45:50.342486] [DEBUG] [LOCAL ] BRCC: Primary data saved (40170 records). [2025-10-06T17:45:50.342683] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-06T17:45:50.342784] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRCC took 28.4s. Estimated remaining: 4h 41m 6s. Rate: 7.3 symbols/min [2025-10-06T17:45:50.524029] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:45:50.527499] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-06T17:45:50.527604] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:45:50.527692] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-06T17:45:50.527747] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:45:50.527814] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-06T17:45:50.527891] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-06T17:45:50.527928] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-06T17:45:50.527967] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-06T17:45:50.528034] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRSL took 1.4s. Estimated remaining: 4h 40m 8s. Rate: 7.3 symbols/min [2025-10-06T17:45:50.526881] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:45:50.731359] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:45:50.748887] [DEBUG] [LOCAL ] BRSP: Loaded 37343 existing records from primary storage. [2025-10-06T17:45:50.752416] [DEBUG] [LOCAL ] BRT: Loaded 5030 existing records from primary storage. [2025-10-06T17:45:50.753154] [INFO ] [MAIN ] BRSP: Loaded 37343 existing records. [2025-10-06T17:45:50.752993] [INFO ] [MAIN ] BRT: Loaded 5030 existing records. [2025-10-06T17:45:51.061418] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-06T17:45:51.150335] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:45:51.155908] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-06T17:45:51.136080] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-06T17:45:51.180686] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-06T17:45:51.218536] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-06T17:45:51.218834] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-06T17:45:51.218375] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:45:51.255503] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-06T17:45:51.282101] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-06T17:45:51.315523] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-06T17:45:51.335503] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-06T17:45:51.934730] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:45:51.958533] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-06T17:45:51.959014] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-06T17:45:52.056618] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:45:52.625549] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-06T17:45:53.269584] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-06T17:45:53.425563] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-06T17:45:53.574637] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-06T17:45:53.602393] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T17:45:54.225528] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-06T17:45:54.923814] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T17:45:55.025517] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-06T17:45:55.512459] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-06T17:45:55.539735] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T17:45:55.825555] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-06T17:45:56.625615] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-06T17:45:57.112911] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-06T17:45:57.425612] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-06T17:45:58.071129] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-06T17:45:58.225521] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-06T17:45:58.502189] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-06T17:45:59.025551] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-06T17:45:59.624910] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T17:45:59.825591] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-06T17:46:00.625588] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-06T17:46:01.209117] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-06T17:46:01.425542] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-06T17:46:01.480686] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T17:46:02.156605] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T17:46:02.225523] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-06T17:46:02.501248] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-06T17:46:03.025587] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-06T17:46:03.825590] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-06T17:46:04.337687] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-06T17:46:04.625522] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-06T17:46:04.656558] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T17:46:04.941612] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T17:46:05.425593] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-06T17:46:06.225530] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-06T17:46:06.434174] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-06T17:46:06.701864] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-06T17:46:06.954555] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T17:46:07.025567] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-06T17:46:07.667005] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-06T17:46:07.825555] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-06T17:46:08.545072] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T17:46:08.625519] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-06T17:46:09.259711] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-06T17:46:09.425522] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-06T17:46:10.225528] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-06T17:46:10.787103] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T17:46:10.788060] [INFO ] [REMOTE ] BRT: Full fetch complete (6835 records). [2025-10-06T17:46:10.788132] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-06T17:46:11.033267] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-06T17:46:11.165607] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-06T17:46:11.165853] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-06T17:46:11.166073] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-06T17:46:11.166158] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-06T17:46:11.166729] [DEBUG] [LOCAL ] BRT: Trimmed 6835 records to 4946 (keeping 200 days of data) [2025-10-06T17:46:11.198316] [DEBUG] [LOCAL ] BRT: Primary data saved (4946 records). [2025-10-06T17:46:11.198442] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-06T17:46:11.198529] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRT took 20.7s. Estimated remaining: 4h 41m 16s. Rate: 7.2 symbols/min [2025-10-06T17:46:11.404080] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:46:11.448252] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-06T17:46:11.474735] [DEBUG] [LOCAL ] BRW: Loaded 20684 existing records from primary storage. [2025-10-06T17:46:11.475043] [INFO ] [MAIN ] BRW: Loaded 20684 existing records. [2025-10-06T17:46:11.650171] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:46:11.650406] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-06T17:46:11.650453] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-06T17:46:11.651080] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-06T17:46:11.651138] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-06T17:46:11.838871] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-06T17:46:12.020824] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:46:12.419290] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-06T17:46:12.625599] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-06T17:46:13.425557] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-06T17:46:13.729722] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T17:46:13.773151] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T17:46:14.225520] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-06T17:46:14.742529] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T17:46:15.025566] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-06T17:46:15.420318] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T17:46:15.825600] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-06T17:46:16.625573] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-06T17:46:17.215754] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-06T17:46:17.430606] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-06T17:46:17.446128] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T17:46:17.582811] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-06T17:46:18.225529] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-06T17:46:19.025502] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-06T17:46:19.237935] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T17:46:19.825509] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-06T17:46:20.017072] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T17:46:20.155821] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-06T17:46:20.158949] [INFO ] [REMOTE ] BROS: Full fetch complete (77063 records). [2025-10-06T17:46:20.159078] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-06T17:46:20.559134] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-06T17:46:20.559234] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-06T17:46:20.560112] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-06T17:46:20.560179] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-06T17:46:20.561847] [DEBUG] [LOCAL ] BROS: Trimmed 77063 records to 53294 (keeping 200 days of data) [2025-10-06T17:46:20.650210] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-06T17:46:20.885464] [DEBUG] [LOCAL ] BROS: Primary data saved (53294 records). [2025-10-06T17:46:20.885676] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-06T17:46:20.885792] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BROS took 41.9s. Estimated remaining: 4h 41m 16s. Rate: 7.2 symbols/min [2025-10-06T17:46:21.061083] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:46:21.061295] [DEBUG] [LOCAL ] BRX: No existing data file found in primary storage. [2025-10-06T17:46:21.061333] [WARN ] [MAIN ] BRX: No existing data found, performing full refresh instead. [2025-10-06T17:46:21.061457] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-06T17:46:21.061499] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-06T17:46:21.061540] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-10-06T17:46:21.061572] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-06T17:46:21.424546] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T17:46:21.429977] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-06T17:46:21.518058] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:46:21.531041] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-06T17:46:22.225528] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-06T17:46:22.933337] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T17:46:22.935915] [INFO ] [REMOTE ] BRO: Full fetch complete (73951 records). [2025-10-06T17:46:22.936068] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-06T17:46:22.936816] [FATAL] [VALIDATOR ] BRO: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:46:22.936909] [FATAL] [MAIN ] BRO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:46:22.936977] [WARN ] [MAIN ] BRO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:46:22.937046] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-06T17:46:22.937166] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-06T17:46:22.937234] [INFO ] [LOCAL ] BRO: Starting deletion of derivative data. [2025-10-06T17:46:22.937547] [DEBUG] [LOCAL ] BRO: Deleted derivative data file. [2025-10-06T17:46:22.937702] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRO took 50.6s. Estimated remaining: 4h 40m 30s. Rate: 7.3 symbols/min [2025-10-06T17:46:23.031870] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-06T17:46:23.134588] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:46:23.170846] [DEBUG] [LOCAL ] BSAC: Loaded 33459 existing records from primary storage. [2025-10-06T17:46:23.171279] [INFO ] [MAIN ] BSAC: Loaded 33459 existing records. [2025-10-06T17:46:23.367818] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:46:23.368189] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-06T17:46:23.368259] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-06T17:46:23.369237] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-06T17:46:23.369305] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-06T17:46:23.779728] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:46:23.825564] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-06T17:46:23.929604] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T17:46:24.416296] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T17:46:24.418767] [INFO ] [REMOTE ] BRSP: Full fetch complete (54248 records). [2025-10-06T17:46:24.418878] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-06T17:46:24.632812] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-06T17:46:24.830442] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-06T17:46:24.831302] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-06T17:46:24.848625] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-06T17:46:24.850003] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-06T17:46:24.851061] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-06T17:46:24.857969] [DEBUG] [LOCAL ] BRSP: Trimmed 54248 records to 36695 (keeping 200 days of data) [2025-10-06T17:46:25.153010] [DEBUG] [LOCAL ] BRSP: Primary data saved (36695 records). [2025-10-06T17:46:25.153232] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-06T17:46:25.153398] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRSP took 34.8s. Estimated remaining: 4h 39m 45s. Rate: 7.3 symbols/min [2025-10-06T17:46:25.414458] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:46:25.425590] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-06T17:46:25.462100] [DEBUG] [LOCAL ] BSBR: Loaded 35923 existing records from primary storage. [2025-10-06T17:46:25.462576] [INFO ] [MAIN ] BSBR: Loaded 35923 existing records. [2025-10-06T17:46:25.703268] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:46:25.703976] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-06T17:46:25.704046] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-06T17:46:25.705286] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-06T17:46:25.705366] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-06T17:46:25.815844] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T17:46:26.084314] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:46:26.225516] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-06T17:46:27.025565] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-06T17:46:27.088287] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T17:46:27.626170] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T17:46:27.825522] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-06T17:46:28.050453] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T17:46:28.625531] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-06T17:46:29.409918] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T17:46:29.425470] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-06T17:46:29.818488] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T17:46:30.225548] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-06T17:46:31.025558] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-06T17:46:31.214825] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T17:46:31.621393] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T17:46:31.825574] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-06T17:46:32.014284] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T17:46:32.625691] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-06T17:46:32.947897] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T17:46:33.425599] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-06T17:46:34.028498] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T17:46:34.225575] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-06T17:46:35.018810] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T17:46:35.028360] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-06T17:46:35.515060] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-06T17:46:35.825563] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-06T17:46:36.625527] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-06T17:46:37.008151] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-06T17:46:37.034752] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T17:46:37.425605] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-06T17:46:38.088306] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T17:46:38.225544] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-06T17:46:38.861208] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T17:46:39.025543] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-06T17:46:39.551513] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-06T17:46:39.825540] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-06T17:46:40.617372] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T17:46:40.627086] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-06T17:46:41.404816] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T17:46:41.425486] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-06T17:46:41.623410] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T17:46:42.225547] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-06T17:46:42.799897] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T17:46:43.025518] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-06T17:46:43.407796] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-06T17:46:43.825574] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-06T17:46:44.574998] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T17:46:44.625488] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-06T17:46:45.024568] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T17:46:45.026775] [INFO ] [REMOTE ] BRW: Full fetch complete (30582 records). [2025-10-06T17:46:45.026848] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-06T17:46:45.386619] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-06T17:46:45.386726] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-06T17:46:45.390465] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-06T17:46:45.390535] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-06T17:46:45.391304] [DEBUG] [LOCAL ] BRW: Trimmed 30582 records to 20615 (keeping 200 days of data) [2025-10-06T17:46:45.438034] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-06T17:46:45.512180] [DEBUG] [LOCAL ] BRW: Primary data saved (20615 records). [2025-10-06T17:46:45.512313] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-06T17:46:45.512407] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRW took 34.3s. Estimated remaining: 4h 40m 50s. Rate: 7.2 symbols/min [2025-10-06T17:46:45.682740] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:46:45.692639] [DEBUG] [LOCAL ] BSL: Loaded 8434 existing records from primary storage. [2025-10-06T17:46:45.692871] [INFO ] [MAIN ] BSL: Loaded 8434 existing records. [2025-10-06T17:46:45.869503] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:46:45.869775] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-06T17:46:45.869848] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-06T17:46:45.870346] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-06T17:46:45.870418] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-06T17:46:45.996823] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-06T17:46:46.227122] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-06T17:46:46.249610] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:46:46.833150] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T17:46:47.025565] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-06T17:46:47.825507] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-06T17:46:47.840460] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T17:46:48.196070] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-06T17:46:48.625538] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-06T17:46:49.234337] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T17:46:49.425524] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-06T17:46:49.508400] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T17:46:50.225553] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-06T17:46:51.018919] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T17:46:51.026880] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-06T17:46:51.052147] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T17:46:51.825548] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-06T17:46:52.222981] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T17:46:52.225045] [INFO ] [REMOTE ] BSAC: Full fetch complete (44001 records). [2025-10-06T17:46:52.225139] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-06T17:46:52.593822] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-06T17:46:52.609214] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-06T17:46:52.612142] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-06T17:46:52.613362] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-06T17:46:52.613818] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-06T17:46:52.614891] [DEBUG] [LOCAL ] BSAC: Trimmed 44001 records to 32912 (keeping 200 days of data) [2025-10-06T17:46:52.671401] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-06T17:46:52.823300] [DEBUG] [LOCAL ] BSAC: Primary data saved (32912 records). [2025-10-06T17:46:52.823483] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-06T17:46:52.823580] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BSAC took 29.9s. Estimated remaining: 4h 40m 36s. Rate: 7.2 symbols/min [2025-10-06T17:46:52.997175] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:46:52.997402] [DEBUG] [LOCAL ] BSM: No existing data file found in primary storage. [2025-10-06T17:46:52.997441] [WARN ] [MAIN ] BSM: No existing data found, performing full refresh instead. [2025-10-06T17:46:52.997559] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-06T17:46:52.997601] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-06T17:46:52.997666] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-06T17:46:52.997724] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-06T17:46:53.364585] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:46:53.425511] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-06T17:46:53.491963] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T17:46:54.225636] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-06T17:46:54.593735] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-06T17:46:55.025592] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-06T17:46:55.825523] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-06T17:46:55.977561] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T17:46:56.149890] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T17:46:56.516294] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-06T17:46:56.625543] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-06T17:46:57.425577] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-06T17:46:57.931594] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T17:46:58.225545] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-06T17:46:59.025520] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-06T17:46:59.231579] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T17:46:59.661827] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T17:46:59.825551] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-06T17:47:00.375448] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T17:47:00.625555] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-06T17:47:01.425566] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-06T17:47:01.463454] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T17:47:01.465785] [INFO ] [REMOTE ] BSBR: Full fetch complete (50706 records). [2025-10-06T17:47:01.465892] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-06T17:47:01.843093] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-06T17:47:01.843183] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-06T17:47:01.843804] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-06T17:47:01.843868] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-06T17:47:01.845038] [DEBUG] [LOCAL ] BSBR: Trimmed 50706 records to 35401 (keeping 200 days of data) [2025-10-06T17:47:02.065099] [DEBUG] [LOCAL ] BSBR: Primary data saved (35401 records). [2025-10-06T17:47:02.065294] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-06T17:47:02.065424] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BSBR took 36.9s. Estimated remaining: 4h 40m 33s. Rate: 7.2 symbols/min [2025-10-06T17:47:02.248293] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-06T17:47:02.252521] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:47:02.273925] [DEBUG] [LOCAL ] BST: Loaded 19287 existing records from primary storage. [2025-10-06T17:47:02.274291] [INFO ] [MAIN ] BST: Loaded 19287 existing records. [2025-10-06T17:47:02.396506] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-06T17:47:02.446235] [INFO ] [REMOTE ] BRX: Full fetch complete (74961 records). [2025-10-06T17:47:02.469510] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-06T17:47:02.527417] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:47:02.567348] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-06T17:47:02.598359] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-06T17:47:02.612292] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-06T17:47:02.628020] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-06T17:47:03.230492] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-06T17:47:03.230311] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T17:47:03.208369] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T17:47:03.260446] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-06T17:47:03.246474] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-06T17:47:03.273827] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-06T17:47:03.285257] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-06T17:47:03.347553] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:47:03.348889] [DEBUG] [LOCAL ] BRX: Trimmed 74961 records to 51731 (keeping 200 days of data) [2025-10-06T17:47:03.723548] [DEBUG] [LOCAL ] BRX: Primary data saved (51731 records). [2025-10-06T17:47:03.723812] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-06T17:47:03.723947] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BRX took 42.8s. Estimated remaining: 4h 39m 45s. Rate: 7.3 symbols/min [2025-10-06T17:47:03.829977] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-06T17:47:03.911937] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:47:03.942191] [DEBUG] [LOCAL ] BSTZ: Loaded 25154 existing records from primary storage. [2025-10-06T17:47:03.942548] [INFO ] [MAIN ] BSTZ: Loaded 25154 existing records. [2025-10-06T17:47:04.141621] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T17:47:04.141052] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:47:04.145166] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-06T17:47:04.145674] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-06T17:47:04.146189] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-06T17:47:04.146248] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-06T17:47:04.535844] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:47:04.625573] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-06T17:47:05.196341] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T17:47:05.425569] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-06T17:47:05.917886] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T17:47:06.225550] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-06T17:47:06.907793] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T17:47:07.025574] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-06T17:47:07.360191] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T17:47:07.632903] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T17:47:07.825541] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-06T17:47:08.595825] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-06T17:47:08.625493] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-06T17:47:09.293886] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-06T17:47:09.294970] [INFO ] [REMOTE ] BSL: Full fetch complete (12716 records). [2025-10-06T17:47:09.295087] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-06T17:47:09.295580] [FATAL] [VALIDATOR ] BSL: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:47:09.295687] [FATAL] [MAIN ] BSL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:47:09.295742] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:47:09.295785] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-06T17:47:09.295852] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-06T17:47:09.295889] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-10-06T17:47:09.296154] [DEBUG] [LOCAL ] BSL: Deleted derivative data file. [2025-10-06T17:47:09.296313] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSL took 23.8s. Estimated remaining: 4h 39m 21s. Rate: 7.3 symbols/min [2025-10-06T17:47:09.430736] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-06T17:47:09.494088] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:47:09.494445] [DEBUG] [LOCAL ] BSX: No existing data file found in primary storage. [2025-10-06T17:47:09.494494] [WARN ] [MAIN ] BSX: No existing data found, performing full refresh instead. [2025-10-06T17:47:09.494619] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-06T17:47:09.494698] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-06T17:47:09.494760] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-06T17:47:09.494797] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-06T17:47:09.876200] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:47:10.225553] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-06T17:47:10.790539] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T17:47:11.025570] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-06T17:47:11.825533] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-06T17:47:12.061065] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T17:47:12.124678] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T17:47:12.625563] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-06T17:47:13.128522] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T17:47:13.425497] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-06T17:47:13.643840] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T17:47:14.225550] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-06T17:47:14.634756] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T17:47:15.025532] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-06T17:47:15.647626] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T17:47:15.825550] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-06T17:47:16.625547] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-06T17:47:17.097568] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-06T17:47:17.171400] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T17:47:17.425490] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-06T17:47:17.723113] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T17:47:18.225531] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-06T17:47:18.500953] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T17:47:18.502703] [INFO ] [REMOTE ] BSM: Full fetch complete (47088 records). [2025-10-06T17:47:18.502795] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-06T17:47:18.503378] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:47:18.503468] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:47:18.503512] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:47:18.503551] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-06T17:47:18.503952] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-06T17:47:18.504234] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-10-06T17:47:18.504298] [DEBUG] [LOCAL ] BSM: No derivative data file found to delete. [2025-10-06T17:47:18.504423] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSM took 25.7s. Estimated remaining: 4h 39m 18s. Rate: 7.3 symbols/min [2025-10-06T17:47:18.691221] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:47:18.699999] [DEBUG] [LOCAL ] BTA: Loaded 5450 existing records from primary storage. [2025-10-06T17:47:18.700219] [INFO ] [MAIN ] BTA: Loaded 5450 existing records. [2025-10-06T17:47:18.893486] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:47:18.893792] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-06T17:47:18.893875] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-06T17:47:18.894530] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-06T17:47:18.894592] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-06T17:47:19.065352] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-06T17:47:19.324813] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:47:19.530240] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-06T17:47:19.825509] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-06T17:47:20.625500] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-06T17:47:20.661880] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-06T17:47:21.102161] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-06T17:47:21.425537] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-06T17:47:21.935140] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T17:47:22.225511] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-06T17:47:22.584537] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T17:47:23.025553] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-06T17:47:23.445954] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-06T17:47:23.825526] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-06T17:47:24.247786] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-06T17:47:24.625547] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-06T17:47:25.425500] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-06T17:47:25.625245] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T17:47:25.815408] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T17:47:26.225568] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-06T17:47:26.592211] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T17:47:27.025546] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-06T17:47:27.257259] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T17:47:27.825554] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-06T17:47:28.625541] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-06T17:47:28.930910] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-06T17:47:29.118580] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-06T17:47:29.425598] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-06T17:47:29.874323] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T17:47:30.225606] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-06T17:47:30.495267] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T17:47:31.025546] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-06T17:47:31.825558] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-06T17:47:32.159422] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-06T17:47:32.308167] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-06T17:47:32.364377] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T17:47:32.625547] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-06T17:47:33.425552] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-06T17:47:33.460403] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T17:47:34.225630] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-06T17:47:35.025546] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-06T17:47:35.217799] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T17:47:35.461161] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T17:47:35.825493] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-06T17:47:36.038985] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T17:47:36.041081] [INFO ] [REMOTE ] BST: Full fetch complete (28808 records). [2025-10-06T17:47:36.041167] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-06T17:47:36.437673] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-06T17:47:36.437790] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-06T17:47:36.438332] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-06T17:47:36.438374] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-06T17:47:36.439396] [DEBUG] [LOCAL ] BST: Trimmed 28808 records to 19005 (keeping 200 days of data) [2025-10-06T17:47:36.566764] [DEBUG] [LOCAL ] BST: Primary data saved (19005 records). [2025-10-06T17:47:36.566987] [INFO ] [MAIN ] BST: Full history saved. [2025-10-06T17:47:36.567107] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BST took 34.5s. Estimated remaining: 4h 40m 8s. Rate: 7.2 symbols/min [2025-10-06T17:47:36.633521] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-06T17:47:36.750979] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:47:36.770248] [DEBUG] [LOCAL ] BTCM: Loaded 15705 existing records from primary storage. [2025-10-06T17:47:36.770540] [INFO ] [MAIN ] BTCM: Loaded 15705 existing records. [2025-10-06T17:47:36.967109] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:47:36.968136] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-06T17:47:36.968205] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-06T17:47:36.968453] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-06T17:47:36.968510] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-06T17:47:37.356290] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:47:37.425595] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-06T17:47:37.790372] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-06T17:47:38.007752] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-06T17:47:38.043803] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T17:47:38.225601] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-06T17:47:39.025571] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-06T17:47:39.771380] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T17:47:39.825518] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-06T17:47:40.124239] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T17:47:40.490351] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-06T17:47:40.625599] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-06T17:47:41.425558] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-06T17:47:41.934595] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T17:47:42.225548] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-06T17:47:42.935201] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T17:47:43.025528] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-06T17:47:43.108804] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T17:47:43.812783] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T17:47:43.825477] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-06T17:47:44.625560] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-06T17:47:44.713348] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-06T17:47:45.269831] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-06T17:47:45.425557] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-06T17:47:46.070534] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T17:47:46.225561] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-06T17:47:46.866900] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T17:47:47.025516] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-06T17:47:47.825551] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-06T17:47:48.254456] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T17:47:48.256749] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36849 records). [2025-10-06T17:47:48.256843] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-06T17:47:48.547147] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-06T17:47:48.569971] [INFO ] [REMOTE ] BTA: Full fetch complete (9412 records). [2025-10-06T17:47:48.580585] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-06T17:47:48.586404] [FATAL] [VALIDATOR ] BTA: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:47:48.610207] [FATAL] [MAIN ] BTA: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:47:48.629701] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-06T17:47:48.661632] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-06T17:47:48.651955] [WARN ] [MAIN ] BTA: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:47:48.663404] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-06T17:47:48.661835] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-06T17:47:48.663565] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-10-06T17:47:48.664316] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-06T17:47:48.664395] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-06T17:47:48.664468] [INFO ] [LOCAL ] BTA: Starting deletion of derivative data. [2025-10-06T17:47:48.665380] [DEBUG] [LOCAL ] BTA: Deleted derivative data file. [2025-10-06T17:47:48.665689] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BTA took 30.2s. Estimated remaining: 4h 40m 22s. Rate: 7.2 symbols/min [2025-10-06T17:47:48.691067] [DEBUG] [LOCAL ] BSTZ: Trimmed 36849 records to 24876 (keeping 200 days of data) [2025-10-06T17:47:48.974152] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:47:48.975571] [DEBUG] [LOCAL ] BTE: No existing data file found in primary storage. [2025-10-06T17:47:48.975981] [WARN ] [MAIN ] BTE: No existing data found, performing full refresh instead. [2025-10-06T17:47:48.976432] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-06T17:47:48.976503] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-06T17:47:48.979102] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-06T17:47:48.979771] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-06T17:47:49.415873] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:47:49.422538] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24876 records). [2025-10-06T17:47:49.422765] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-06T17:47:49.422882] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BSTZ took 45.7s. Estimated remaining: 4h 39m 29s. Rate: 7.2 symbols/min [2025-10-06T17:47:49.428299] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-06T17:47:49.611871] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:47:49.670428] [DEBUG] [LOCAL ] BTI: Loaded 54336 existing records from primary storage. [2025-10-06T17:47:49.670971] [INFO ] [MAIN ] BTI: Loaded 54336 existing records. [2025-10-06T17:47:49.865499] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:47:49.865965] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-06T17:47:49.866053] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-06T17:47:49.866680] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-06T17:47:49.866782] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-06T17:47:50.159105] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T17:47:50.227682] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-06T17:47:50.258757] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:47:50.662489] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-06T17:47:50.666111] [INFO ] [REMOTE ] BSX: Full fetch complete (77699 records). [2025-10-06T17:47:50.666305] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-06T17:47:51.023769] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-06T17:47:51.039221] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-06T17:47:51.116234] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-06T17:47:51.116368] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-06T17:47:51.117760] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-06T17:47:51.117851] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-06T17:47:51.120459] [DEBUG] [LOCAL ] BSX: Trimmed 77699 records to 53688 (keeping 200 days of data) [2025-10-06T17:47:51.477866] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-06T17:47:51.478077] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-06T17:47:51.478184] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BSX took 42.2s. Estimated remaining: 4h 38m 45s. Rate: 7.3 symbols/min [2025-10-06T17:47:51.664712] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:47:51.677771] [DEBUG] [LOCAL ] BTO: Loaded 8859 existing records from primary storage. [2025-10-06T17:47:51.678060] [INFO ] [MAIN ] BTO: Loaded 8859 existing records. [2025-10-06T17:47:51.830751] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-06T17:47:51.878170] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:47:51.878736] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-06T17:47:51.878881] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-06T17:47:51.879198] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-06T17:47:51.879281] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-06T17:47:52.250981] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:47:52.625504] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-06T17:47:52.832329] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T17:47:53.180046] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-06T17:47:53.207230] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-06T17:47:53.425553] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-06T17:47:54.073144] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-06T17:47:54.225587] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-06T17:47:55.025538] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-06T17:47:55.825511] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-06T17:47:56.312765] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-06T17:47:56.592080] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T17:47:56.625511] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-06T17:47:56.779513] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T17:47:57.425544] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-06T17:47:58.225526] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-06T17:47:58.545411] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-06T17:47:58.958559] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T17:47:59.025552] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-06T17:47:59.115223] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T17:47:59.825549] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-06T17:48:00.010020] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T17:48:00.625575] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-06T17:48:01.425494] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-06T17:48:01.543502] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T17:48:02.225593] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-06T17:48:02.469244] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-06T17:48:02.786502] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T17:48:03.025559] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-06T17:48:03.825505] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-06T17:48:04.367529] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-06T17:48:04.403975] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T17:48:04.625532] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-06T17:48:04.711308] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T17:48:05.425548] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-06T17:48:06.225547] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-06T17:48:06.935356] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T17:48:06.940696] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-06T17:48:06.952753] [INFO ] [REMOTE ] BTCM: Full fetch complete (19578 records). [2025-10-06T17:48:06.953594] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-06T17:48:07.025910] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-06T17:48:07.097287] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T17:48:07.365953] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-06T17:48:07.366072] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-06T17:48:07.366790] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-06T17:48:07.366857] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-06T17:48:07.367704] [DEBUG] [LOCAL ] BTCM: Trimmed 19578 records to 15847 (keeping 200 days of data) [2025-10-06T17:48:07.463598] [DEBUG] [LOCAL ] BTCM: Primary data saved (15847 records). [2025-10-06T17:48:07.463804] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-06T17:48:07.463908] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 30.9s. Estimated remaining: 4h 39m 22s. Rate: 7.2 symbols/min [2025-10-06T17:48:07.637774] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:48:07.656798] [DEBUG] [LOCAL ] BTT: Loaded 16174 existing records from primary storage. [2025-10-06T17:48:07.657147] [INFO ] [MAIN ] BTT: Loaded 16174 existing records. [2025-10-06T17:48:07.843248] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-06T17:48:07.849631] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:48:07.850006] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-06T17:48:07.851284] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-06T17:48:07.851590] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-06T17:48:07.851695] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-06T17:48:08.238575] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:48:08.625553] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-06T17:48:08.796111] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T17:48:09.425501] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-06T17:48:09.436239] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-06T17:48:10.029270] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-06T17:48:10.225536] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-06T17:48:10.668682] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T17:48:11.025579] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-06T17:48:11.825554] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-06T17:48:12.248738] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-06T17:48:12.590521] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T17:48:12.625531] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-06T17:48:12.843814] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T17:48:13.425528] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-06T17:48:14.225501] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-06T17:48:14.408791] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T17:48:15.025551] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-06T17:48:15.288171] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T17:48:15.591391] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-06T17:48:15.825537] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-06T17:48:16.625592] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-06T17:48:16.846790] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T17:48:17.350402] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-06T17:48:17.425542] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-06T17:48:18.032941] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-06T17:48:18.162169] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T17:48:18.163496] [INFO ] [REMOTE ] BTO: Full fetch complete (13221 records). [2025-10-06T17:48:18.163574] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-06T17:48:18.230575] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-06T17:48:18.553762] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-06T17:48:18.553875] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-06T17:48:18.554623] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-06T17:48:18.554711] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-06T17:48:18.555296] [DEBUG] [LOCAL ] BTO: Trimmed 13221 records to 8690 (keeping 200 days of data) [2025-10-06T17:48:18.613729] [DEBUG] [LOCAL ] BTO: Primary data saved (8690 records). [2025-10-06T17:48:18.613901] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-06T17:48:18.614012] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTO took 27.1s. Estimated remaining: 4h 39m 30s. Rate: 7.2 symbols/min [2025-10-06T17:48:18.796811] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:48:18.854130] [DEBUG] [LOCAL ] BTU: Loaded 54088 existing records from primary storage. [2025-10-06T17:48:18.854502] [INFO ] [MAIN ] BTU: Loaded 54088 existing records. [2025-10-06T17:48:19.026205] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-06T17:48:19.054007] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:48:19.054400] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-06T17:48:19.055584] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-06T17:48:19.056557] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-06T17:48:19.056621] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-06T17:48:19.229700] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-06T17:48:19.471615] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:48:19.825536] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-06T17:48:20.625487] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-06T17:48:20.966024] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-06T17:48:21.158985] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-06T17:48:21.425564] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-06T17:48:22.206038] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T17:48:22.225476] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-06T17:48:23.025595] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-06T17:48:23.233417] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-06T17:48:23.236375] [INFO ] [REMOTE ] BTI: Full fetch complete (77070 records). [2025-10-06T17:48:23.236517] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-06T17:48:23.241191] [FATAL] [VALIDATOR ] BTI: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:48:23.241342] [FATAL] [MAIN ] BTI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:48:23.241421] [WARN ] [MAIN ] BTI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:48:23.241529] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-06T17:48:23.241638] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-10-06T17:48:23.241738] [INFO ] [LOCAL ] BTI: Starting deletion of derivative data. [2025-10-06T17:48:23.241988] [DEBUG] [LOCAL ] BTI: Deleted derivative data file. [2025-10-06T17:48:23.242139] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTI took 33.8s. Estimated remaining: 4h 39m 0s. Rate: 7.2 symbols/min [2025-10-06T17:48:23.438141] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:48:23.438348] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-06T17:48:23.438387] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-06T17:48:23.438561] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-06T17:48:23.438621] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-06T17:48:23.438711] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-06T17:48:23.438763] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-06T17:48:23.828899] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-06T17:48:23.828827] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:48:23.913682] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T17:48:24.625527] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-06T17:48:24.662293] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-06T17:48:25.101374] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:48:25.102011] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-06T17:48:25.104883] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-06T17:48:25.104965] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:48:25.115677] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-06T17:48:25.116418] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:48:25.116496] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-06T17:48:25.116570] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-06T17:48:25.116609] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-06T17:48:25.116686] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-06T17:48:25.116756] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTX took 1.9s. Estimated remaining: 4h 38m 15s. Rate: 7.3 symbols/min [2025-10-06T17:48:25.309784] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:48:25.336541] [DEBUG] [LOCAL ] BTZ: Loaded 23173 existing records from primary storage. [2025-10-06T17:48:25.336901] [INFO ] [MAIN ] BTZ: Loaded 23173 existing records. [2025-10-06T17:48:25.430679] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-06T17:48:25.539672] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:48:25.539924] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-06T17:48:25.539975] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-06T17:48:25.540297] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-06T17:48:25.540356] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-06T17:48:25.928242] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:48:26.225530] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-06T17:48:27.025698] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-06T17:48:27.276169] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-06T17:48:27.402574] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T17:48:27.825559] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-06T17:48:28.625552] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-06T17:48:28.845082] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T17:48:29.425560] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-06T17:48:29.499828] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T17:48:29.549722] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T17:48:30.225577] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-06T17:48:30.476763] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-06T17:48:31.025543] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-06T17:48:31.335542] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T17:48:31.825554] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-06T17:48:32.004926] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T17:48:32.625490] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-06T17:48:32.673856] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T17:48:33.425562] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-06T17:48:33.615963] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T17:48:34.225571] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-06T17:48:35.025521] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-06T17:48:35.404957] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-06T17:48:35.695110] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T17:48:35.698811] [INFO ] [REMOTE ] BTE: Full fetch complete (76102 records). [2025-10-06T17:48:35.698991] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-06T17:48:35.830682] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-06T17:48:36.147451] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-06T17:48:36.147588] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-06T17:48:36.148805] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-06T17:48:36.148896] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-06T17:48:36.150853] [DEBUG] [LOCAL ] BTE: Trimmed 76102 records to 52711 (keeping 200 days of data) [2025-10-06T17:48:36.276246] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-06T17:48:36.539962] [DEBUG] [LOCAL ] BTE: Primary data saved (52711 records). [2025-10-06T17:48:36.540176] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-06T17:48:36.540304] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTE took 47.9s. Estimated remaining: 4h 38m 25s. Rate: 7.3 symbols/min [2025-10-06T17:48:36.630718] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-06T17:48:36.759425] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:48:36.814742] [DEBUG] [LOCAL ] BUD: Loaded 53478 existing records from primary storage. [2025-10-06T17:48:36.815211] [INFO ] [MAIN ] BUD: Loaded 53478 existing records. [2025-10-06T17:48:37.005239] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:48:37.005575] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-06T17:48:37.005686] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-06T17:48:37.007465] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-06T17:48:37.007529] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-06T17:48:37.394769] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:48:37.425494] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-06T17:48:37.648682] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T17:48:37.819856] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-06T17:48:38.225542] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-06T17:48:39.025575] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-06T17:48:39.453105] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-06T17:48:39.825477] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-06T17:48:39.951463] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-06T17:48:40.012391] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T17:48:40.625571] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-06T17:48:41.425494] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-06T17:48:41.657218] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-06T17:48:42.231313] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-06T17:48:42.244520] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T17:48:42.420520] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T17:48:43.025547] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-06T17:48:43.825509] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-06T17:48:43.998275] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T17:48:44.563784] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T17:48:44.602662] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T17:48:44.625488] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-06T17:48:45.425549] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-06T17:48:46.225527] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-06T17:48:46.400214] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T17:48:46.700882] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-06T17:48:47.025584] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-06T17:48:47.705903] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-06T17:48:47.707442] [INFO ] [REMOTE ] BTT: Full fetch complete (23881 records). [2025-10-06T17:48:47.707525] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-06T17:48:47.829745] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-06T17:48:48.123447] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-06T17:48:48.123878] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-06T17:48:48.124605] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-06T17:48:48.124804] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-06T17:48:48.144359] [DEBUG] [LOCAL ] BTT: Trimmed 23881 records to 15829 (keeping 200 days of data) [2025-10-06T17:48:48.182991] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-06T17:48:48.302557] [DEBUG] [LOCAL ] BTT: Primary data saved (15829 records). [2025-10-06T17:48:48.302820] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-06T17:48:48.302990] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTT took 40.8s. Estimated remaining: 4h 38m 37s. Rate: 7.2 symbols/min [2025-10-06T17:48:48.481618] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:48:48.495007] [DEBUG] [LOCAL ] BUI: Loaded 11813 existing records from primary storage. [2025-10-06T17:48:48.495332] [INFO ] [MAIN ] BUI: Loaded 11813 existing records. [2025-10-06T17:48:48.630734] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-06T17:48:48.704394] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:48:48.705021] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-06T17:48:48.705117] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-06T17:48:48.705624] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-06T17:48:48.705721] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-06T17:48:49.119043] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:48:49.425606] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-06T17:48:49.714367] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T17:48:49.811924] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-06T17:48:50.225565] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-06T17:48:50.263086] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-06T17:48:51.025620] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-06T17:48:51.736724] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T17:48:51.740833] [INFO ] [REMOTE ] BTU: Full fetch complete (77008 records). [2025-10-06T17:48:51.740977] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-06T17:48:51.830788] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-06T17:48:51.887104] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T17:48:52.181401] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-06T17:48:52.181518] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-06T17:48:52.182531] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-06T17:48:52.182601] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-06T17:48:52.184801] [DEBUG] [LOCAL ] BTU: Trimmed 77008 records to 53310 (keeping 200 days of data) [2025-10-06T17:48:52.548435] [DEBUG] [LOCAL ] BTU: Primary data saved (53310 records). [2025-10-06T17:48:52.548631] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-06T17:48:52.549721] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTU took 33.9s. Estimated remaining: 4h 38m 5s. Rate: 7.3 symbols/min [2025-10-06T17:48:52.630724] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-06T17:48:52.745520] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:48:52.763332] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T17:48:52.812374] [DEBUG] [LOCAL ] BUR: Loaded 45747 existing records from primary storage. [2025-10-06T17:48:52.812876] [INFO ] [MAIN ] BUR: Loaded 45747 existing records. [2025-10-06T17:48:52.994886] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:48:52.995176] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-06T17:48:52.995228] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-06T17:48:52.996810] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-06T17:48:52.996874] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-06T17:48:53.369787] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:48:53.425477] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-06T17:48:53.491478] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T17:48:54.225544] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-06T17:48:54.843880] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T17:48:55.025569] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-06T17:48:55.277824] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T17:48:55.600063] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T17:48:55.825548] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-06T17:48:56.625546] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-06T17:48:57.425698] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-06T17:48:57.428245] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T17:48:57.431605] [INFO ] [REMOTE ] BTZ: Full fetch complete (33803 records). [2025-10-06T17:48:57.440558] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-06T17:48:57.467305] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T17:48:57.868887] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-06T17:48:57.868998] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-06T17:48:57.869730] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-06T17:48:57.869797] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-06T17:48:57.870956] [DEBUG] [LOCAL ] BTZ: Trimmed 33803 records to 22737 (keeping 200 days of data) [2025-10-06T17:48:58.026069] [DEBUG] [LOCAL ] BTZ: Primary data saved (22737 records). [2025-10-06T17:48:58.026253] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-06T17:48:58.026375] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BTZ took 32.9s. Estimated remaining: 4h 37m 41s. Rate: 7.3 symbols/min [2025-10-06T17:48:58.200945] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:48:58.227601] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-06T17:48:58.253751] [DEBUG] [LOCAL ] BURL: Loaded 46622 existing records from primary storage. [2025-10-06T17:48:58.254199] [INFO ] [MAIN ] BURL: Loaded 46622 existing records. [2025-10-06T17:48:58.448331] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:48:58.448567] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-06T17:48:58.448619] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-06T17:48:58.450200] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-06T17:48:58.450272] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-06T17:48:58.878729] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:48:59.025566] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-06T17:48:59.068769] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-06T17:48:59.495892] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-06T17:48:59.825540] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-06T17:49:00.632618] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-06T17:49:00.638292] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T17:49:00.742148] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T17:49:01.425538] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-06T17:49:02.157787] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T17:49:02.225577] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-06T17:49:03.025530] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-06T17:49:03.041807] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-06T17:49:03.176705] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T17:49:03.825570] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-06T17:49:04.625564] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-06T17:49:04.680580] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T17:49:05.425609] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-06T17:49:05.537453] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T17:49:05.592052] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T17:49:06.225539] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-06T17:49:07.025570] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-06T17:49:07.026767] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T17:49:07.249326] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T17:49:07.825536] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-06T17:49:08.362402] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-06T17:49:08.625558] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-06T17:49:09.425637] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-06T17:49:09.548530] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T17:49:10.225490] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-06T17:49:10.698276] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-06T17:49:11.025555] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-06T17:49:11.132947] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T17:49:11.825521] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-06T17:49:12.093912] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-06T17:49:12.625547] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-06T17:49:12.698222] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T17:49:13.238779] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T17:49:13.425529] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-06T17:49:14.225558] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-06T17:49:14.455388] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T17:49:15.025530] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-06T17:49:15.182127] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T17:49:15.825595] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-06T17:49:16.019078] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T17:49:16.403278] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T17:49:16.625541] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-06T17:49:17.425495] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-06T17:49:17.776432] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-06T17:49:18.194791] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T17:49:18.196012] [INFO ] [REMOTE ] BUI: Full fetch complete (16364 records). [2025-10-06T17:49:18.196084] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-06T17:49:18.196485] [FATAL] [VALIDATOR ] BUI: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:49:18.196570] [FATAL] [MAIN ] BUI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:49:18.196612] [WARN ] [MAIN ] BUI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:49:18.196677] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-06T17:49:18.196783] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-10-06T17:49:18.196827] [INFO ] [LOCAL ] BUI: Starting deletion of derivative data. [2025-10-06T17:49:18.197098] [DEBUG] [LOCAL ] BUI: Deleted derivative data file. [2025-10-06T17:49:18.197192] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BUI took 29.9s. Estimated remaining: 4h 38m 40s. Rate: 7.2 symbols/min [2025-10-06T17:49:18.230159] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-06T17:49:18.401981] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:49:18.404992] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T17:49:18.429153] [DEBUG] [LOCAL ] BUXX: Loaded 15366 existing records from primary storage. [2025-10-06T17:49:18.429432] [INFO ] [MAIN ] BUXX: Loaded 15366 existing records. [2025-10-06T17:49:18.604693] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:49:18.604983] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-06T17:49:18.605038] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-06T17:49:18.605703] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-06T17:49:18.605763] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-06T17:49:18.949342] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:49:19.025478] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-06T17:49:19.712228] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T17:49:19.825522] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-06T17:49:19.916188] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T17:49:20.625633] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-06T17:49:21.425509] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-06T17:49:21.578707] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T17:49:22.188872] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T17:49:22.229364] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-06T17:49:22.231076] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T17:49:23.025615] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-06T17:49:23.588410] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T17:49:23.591825] [INFO ] [REMOTE ] BUR: Full fetch complete (63215 records). [2025-10-06T17:49:23.591974] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-06T17:49:23.593098] [FATAL] [VALIDATOR ] BUR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:49:23.593234] [FATAL] [MAIN ] BUR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:49:23.593315] [WARN ] [MAIN ] BUR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:49:23.593406] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-06T17:49:23.593504] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-10-06T17:49:23.593571] [INFO ] [LOCAL ] BUR: Starting deletion of derivative data. [2025-10-06T17:49:23.593952] [DEBUG] [LOCAL ] BUR: Deleted derivative data file. [2025-10-06T17:49:23.594083] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUR took 31.0s. Estimated remaining: 4h 38m 16s. Rate: 7.2 symbols/min [2025-10-06T17:49:23.825530] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-06T17:49:24.633689] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-06T17:49:24.641889] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T17:49:24.663155] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T17:49:25.425597] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-06T17:49:26.225506] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-06T17:49:26.406712] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-06T17:49:26.410229] [INFO ] [REMOTE ] BUD: Full fetch complete (76473 records). [2025-10-06T17:49:26.410359] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-06T17:49:26.828602] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-06T17:49:26.828925] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-06T17:49:26.829882] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-06T17:49:26.830028] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-06T17:49:26.831788] [DEBUG] [LOCAL ] BUD: Trimmed 76473 records to 52705 (keeping 200 days of data) [2025-10-06T17:49:27.031791] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T17:49:27.083590] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-06T17:49:27.109236] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T17:49:27.222237] [DEBUG] [LOCAL ] BUD: Primary data saved (52705 records). [2025-10-06T17:49:27.222428] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-06T17:49:27.222562] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUD took 50.7s. Estimated remaining: 4h 37m 41s. Rate: 7.2 symbols/min [2025-10-06T17:49:27.825527] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-06T17:49:27.881306] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-06T17:49:28.625537] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-06T17:49:29.230082] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T17:49:29.232727] [INFO ] [REMOTE ] BURL: Full fetch complete (65683 records). [2025-10-06T17:49:29.232828] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-06T17:49:29.635222] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-06T17:49:29.635349] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-06T17:49:29.636147] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-06T17:49:29.636265] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-06T17:49:29.648355] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T17:49:29.653301] [DEBUG] [LOCAL ] BURL: Trimmed 65683 records to 45861 (keeping 200 days of data) [2025-10-06T17:49:29.653204] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-06T17:49:29.967438] [DEBUG] [LOCAL ] BURL: Primary data saved (45861 records). [2025-10-06T17:49:29.967718] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-06T17:49:29.967869] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BURL took 31.9s. Estimated remaining: 4h 37m 2s. Rate: 7.3 symbols/min [2025-10-06T17:49:30.719020] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T17:49:30.722941] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-06T17:49:31.717989] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-06T17:49:31.722100] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-06T17:49:32.321005] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T17:49:32.325147] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-06T17:49:33.281127] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T17:49:33.285621] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-06T17:49:34.069564] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T17:49:34.071004] [INFO ] [REMOTE ] BUXX: Full fetch complete (20373 records). [2025-10-06T17:49:34.071083] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-06T17:49:34.454964] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-06T17:49:34.455869] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-06T17:49:34.456620] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-06T17:49:34.456714] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-06T17:49:34.457685] [DEBUG] [LOCAL ] BUXX: Trimmed 20373 records to 15257 (keeping 200 days of data) [2025-10-06T17:49:34.561809] [DEBUG] [LOCAL ] BUXX: Primary data saved (15257 records). [2025-10-06T17:49:34.561987] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-06T17:49:34.562085] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BUXX took 16.4s. Estimated remaining: 4h 36m 33s. Rate: 7.3 symbols/min [2025-10-06T17:49:35.228540] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:49:35.223853] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:49:35.333219] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:49:35.338230] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:49:35.419438] [DEBUG] [LOCAL ] BW: Loaded 40559 existing records from primary storage. [2025-10-06T17:49:35.420165] [INFO ] [MAIN ] BW: Loaded 40559 existing records. [2025-10-06T17:49:35.532494] [DEBUG] [LOCAL ] BWA: Loaded 52955 existing records from primary storage. [2025-10-06T17:49:35.579390] [INFO ] [MAIN ] BWA: Loaded 52955 existing records. [2025-10-06T17:49:35.636474] [DEBUG] [LOCAL ] BVN: Loaded 44704 existing records from primary storage. [2025-10-06T17:49:35.651575] [DEBUG] [LOCAL ] BV: Loaded 38880 existing records from primary storage. [2025-10-06T17:49:35.677242] [INFO ] [MAIN ] BV: Loaded 38880 existing records. [2025-10-06T17:49:35.677117] [INFO ] [MAIN ] BVN: Loaded 44704 existing records. [2025-10-06T17:49:35.939458] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:49:35.992605] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-06T17:49:36.043412] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-06T17:49:36.132975] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-06T17:49:36.137721] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-06T17:49:36.137553] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:49:36.167807] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-06T17:49:36.167922] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-06T17:49:36.224342] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-06T17:49:36.253804] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-06T17:49:36.474849] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:49:36.527398] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:49:36.549340] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-06T17:49:36.589935] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-06T17:49:36.624085] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-06T17:49:36.625140] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-06T17:49:36.684699] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-06T17:49:36.690208] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-06T17:49:36.690009] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-06T17:49:36.729524] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-06T17:49:37.245631] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:49:37.282926] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-06T17:49:37.600982] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:49:37.674213] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-06T17:49:37.887559] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:49:37.894974] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:49:37.895551] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-06T17:49:37.896295] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-06T17:49:38.692424] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-06T17:49:38.702406] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-06T17:49:39.000215] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T17:49:39.007438] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-06T17:49:39.657183] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T17:49:39.666860] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-06T17:49:39.698894] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-06T17:49:39.709314] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-06T17:49:39.954496] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T17:49:39.963617] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-06T17:49:40.308749] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T17:49:40.625573] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-06T17:49:41.204590] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T17:49:41.297154] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T17:49:41.425568] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-06T17:49:41.462361] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T17:49:41.628311] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-06T17:49:42.225559] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-06T17:49:42.935637] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T17:49:43.025487] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-06T17:49:43.296829] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T17:49:43.825544] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-06T17:49:44.625509] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-06T17:49:44.706574] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T17:49:45.196069] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T17:49:45.425601] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-06T17:49:46.017695] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T17:49:46.225546] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-06T17:49:46.937714] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T17:49:47.025514] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-06T17:49:47.825547] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-06T17:49:47.992497] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T17:49:48.519443] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T17:49:48.625518] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-06T17:49:49.298576] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T17:49:49.425556] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-06T17:49:50.225529] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-06T17:49:50.465882] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T17:49:51.004698] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T17:49:51.025514] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-06T17:49:51.825596] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-06T17:49:51.958573] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T17:49:52.625543] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-06T17:49:52.783912] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T17:49:53.431945] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-06T17:49:53.438137] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T17:49:54.150764] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T17:49:54.225561] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-06T17:49:55.025583] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-06T17:49:55.126313] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T17:49:55.710682] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-06T17:49:55.825566] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-06T17:49:56.155324] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T17:49:56.625550] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-06T17:49:57.310531] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T17:49:57.425497] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-06T17:49:58.157402] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T17:49:58.225474] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-06T17:49:59.025579] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-06T17:49:59.175148] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T17:49:59.825569] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-06T17:49:59.915228] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T17:50:00.478196] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T17:50:00.625576] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-06T17:50:01.425599] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-06T17:50:01.966096] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-06T17:50:02.225548] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-06T17:50:02.341032] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T17:50:02.995069] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T17:50:03.025491] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-06T17:50:03.825560] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-06T17:50:04.035900] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-06T17:50:04.038249] [INFO ] [REMOTE ] BW: Full fetch complete (58493 records). [2025-10-06T17:50:04.038337] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-06T17:50:04.039072] [FATAL] [VALIDATOR ] BW: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:50:04.039169] [FATAL] [MAIN ] BW: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:50:04.039211] [WARN ] [MAIN ] BW: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:50:04.039280] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-06T17:50:04.039386] [DEBUG] [LOCAL ] BW: No primary data file found to delete. [2025-10-06T17:50:04.039441] [INFO ] [LOCAL ] BW: Starting deletion of derivative data. [2025-10-06T17:50:04.039720] [DEBUG] [LOCAL ] BW: Deleted derivative data file. [2025-10-06T17:50:04.039829] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BW took 29.4s. Estimated remaining: 4h 38m 23s. Rate: 7.2 symbols/min [2025-10-06T17:50:04.209268] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:50:04.224254] [DEBUG] [LOCAL ] BWG: Loaded 12694 existing records from primary storage. [2025-10-06T17:50:04.224550] [INFO ] [MAIN ] BWG: Loaded 12694 existing records. [2025-10-06T17:50:04.400246] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:50:04.400505] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-06T17:50:04.400553] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-06T17:50:04.400821] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-06T17:50:04.400879] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-06T17:50:04.635189] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-06T17:50:04.767500] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:50:04.793001] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T17:50:05.425553] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-06T17:50:05.551394] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T17:50:06.225545] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-06T17:50:06.298258] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T17:50:06.301500] [INFO ] [REMOTE ] BWA: Full fetch complete (75715 records). [2025-10-06T17:50:06.301681] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-06T17:50:06.688536] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-06T17:50:06.688637] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-06T17:50:06.689497] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-06T17:50:06.689544] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-06T17:50:06.691164] [DEBUG] [LOCAL ] BWA: Trimmed 75715 records to 52170 (keeping 200 days of data) [2025-10-06T17:50:07.017047] [DEBUG] [LOCAL ] BWA: Primary data saved (52170 records). [2025-10-06T17:50:07.017291] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-06T17:50:07.017452] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BWA took 32.4s. Estimated remaining: 4h 37m 45s. Rate: 7.2 symbols/min [2025-10-06T17:50:07.033547] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-06T17:50:07.170351] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T17:50:07.232845] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:50:07.265991] [DEBUG] [LOCAL ] BWLP: Loaded 32876 existing records from primary storage. [2025-10-06T17:50:07.266316] [INFO ] [MAIN ] BWLP: Loaded 32876 existing records. [2025-10-06T17:50:07.454101] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:50:07.454470] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-06T17:50:07.454676] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-06T17:50:07.455070] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-06T17:50:07.455157] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-06T17:50:07.831439] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-06T17:50:07.866496] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:50:07.860081] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T17:50:08.101610] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T17:50:08.625562] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-06T17:50:09.293895] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T17:50:09.296468] [INFO ] [REMOTE ] BV: Full fetch complete (54370 records). [2025-10-06T17:50:09.296566] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-06T17:50:09.427911] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-06T17:50:09.634290] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T17:50:09.726387] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-06T17:50:09.726476] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-06T17:50:09.727246] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-06T17:50:09.727311] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-06T17:50:09.728599] [DEBUG] [LOCAL ] BV: Trimmed 54370 records to 38381 (keeping 200 days of data) [2025-10-06T17:50:09.951574] [DEBUG] [LOCAL ] BV: Primary data saved (38381 records). [2025-10-06T17:50:09.951768] [INFO ] [MAIN ] BV: Full history saved. [2025-10-06T17:50:09.951886] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BV took 35.4s. Estimated remaining: 4h 37m 7s. Rate: 7.2 symbols/min [2025-10-06T17:50:10.117797] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:50:10.127337] [DEBUG] [LOCAL ] BWMX: Loaded 7749 existing records from primary storage. [2025-10-06T17:50:10.127538] [INFO ] [MAIN ] BWMX: Loaded 7749 existing records. [2025-10-06T17:50:10.225500] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-06T17:50:10.306899] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:50:10.307138] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-06T17:50:10.307186] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-06T17:50:10.307380] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-06T17:50:10.307436] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-06T17:50:10.658244] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:50:11.018303] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-06T17:50:11.025471] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-06T17:50:11.156494] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T17:50:11.754633] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T17:50:11.825468] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-06T17:50:12.625623] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-06T17:50:12.694003] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-06T17:50:13.360312] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-06T17:50:13.425548] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-06T17:50:14.225558] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-06T17:50:14.272675] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T17:50:15.025558] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-06T17:50:15.820977] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-06T17:50:15.823898] [INFO ] [REMOTE ] BVN: Full fetch complete (62827 records). [2025-10-06T17:50:15.824083] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-06T17:50:15.836566] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-06T17:50:16.109296] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T17:50:16.230111] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-06T17:50:16.230221] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-06T17:50:16.230955] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-06T17:50:16.231018] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-06T17:50:16.232545] [DEBUG] [LOCAL ] BVN: Trimmed 62827 records to 43948 (keeping 200 days of data) [2025-10-06T17:50:16.502493] [DEBUG] [LOCAL ] BVN: Primary data saved (43948 records). [2025-10-06T17:50:16.502701] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-06T17:50:16.502840] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BVN took 41.9s. Estimated remaining: 4h 36m 49s. Rate: 7.3 symbols/min [2025-10-06T17:50:16.630688] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-06T17:50:16.677034] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:50:16.684114] [DEBUG] [LOCAL ] BWNB: Loaded 4475 existing records from primary storage. [2025-10-06T17:50:16.684357] [INFO ] [MAIN ] BWNB: Loaded 4475 existing records. [2025-10-06T17:50:16.861674] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:50:16.861935] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-06T17:50:16.861985] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-06T17:50:16.862163] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-06T17:50:16.862221] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-06T17:50:17.222600] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:50:17.425502] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-06T17:50:17.509826] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T17:50:17.973454] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-06T17:50:18.000951] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-06T17:50:18.225573] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-06T17:50:18.790394] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-06T17:50:19.025549] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-06T17:50:19.825511] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-06T17:50:19.831108] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T17:50:20.478466] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-06T17:50:20.625563] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-06T17:50:21.334615] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-06T17:50:21.425568] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-06T17:50:22.225547] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-06T17:50:22.513259] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T17:50:23.025597] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-06T17:50:23.553087] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T17:50:23.814346] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T17:50:23.825505] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-06T17:50:24.625552] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-06T17:50:24.716037] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-06T17:50:25.425554] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-06T17:50:26.053291] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T17:50:26.076710] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T17:50:26.225553] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-06T17:50:27.025514] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-06T17:50:27.045870] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-06T17:50:27.825528] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-06T17:50:27.944970] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T17:50:28.365754] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-06T17:50:28.625552] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-06T17:50:29.425549] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-06T17:50:29.582731] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T17:50:29.584014] [INFO ] [REMOTE ] BWG: Full fetch complete (17891 records). [2025-10-06T17:50:29.584097] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-06T17:50:29.960224] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-06T17:50:29.960317] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-06T17:50:29.960865] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-06T17:50:29.960931] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-06T17:50:29.961495] [DEBUG] [LOCAL ] BWG: Trimmed 17891 records to 12605 (keeping 200 days of data) [2025-10-06T17:50:30.018335] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-06T17:50:30.044872] [DEBUG] [LOCAL ] BWG: Primary data saved (12605 records). [2025-10-06T17:50:30.045051] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-06T17:50:30.045137] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWG took 26.0s. Estimated remaining: 4h 37m 10s. Rate: 7.2 symbols/min [2025-10-06T17:50:30.223753] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:50:30.225499] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-06T17:50:30.235302] [DEBUG] [LOCAL ] BWSN: Loaded 5290 existing records from primary storage. [2025-10-06T17:50:30.235705] [INFO ] [MAIN ] BWSN: Loaded 5290 existing records. [2025-10-06T17:50:30.442019] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:50:30.442361] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-06T17:50:30.442418] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-06T17:50:30.442605] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-06T17:50:30.442699] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-06T17:50:30.812352] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:50:31.004336] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T17:50:31.025472] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-06T17:50:31.667579] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T17:50:31.825536] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-06T17:50:32.586375] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T17:50:32.625532] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-06T17:50:33.345393] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T17:50:33.425492] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-06T17:50:34.225589] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-06T17:50:34.821552] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T17:50:34.985690] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T17:50:35.025485] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-06T17:50:35.825567] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-06T17:50:36.474479] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-06T17:50:36.626082] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-06T17:50:36.628699] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T17:50:37.094815] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-06T17:50:37.425528] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-06T17:50:38.004065] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-06T17:50:38.225553] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-06T17:50:39.025576] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-06T17:50:39.635851] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T17:50:39.715454] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T17:50:39.716842] [INFO ] [REMOTE ] BWMX: Full fetch complete (10066 records). [2025-10-06T17:50:39.716937] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-06T17:50:39.830638] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-06T17:50:40.160716] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-06T17:50:40.160817] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-06T17:50:40.161080] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-06T17:50:40.161140] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-06T17:50:40.161571] [DEBUG] [LOCAL ] BWMX: Trimmed 10066 records to 7693 (keeping 200 days of data) [2025-10-06T17:50:40.209354] [DEBUG] [LOCAL ] BWMX: Primary data saved (7693 records). [2025-10-06T17:50:40.209531] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-06T17:50:40.209667] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWMX took 30.3s. Estimated remaining: 4h 37m 12s. Rate: 7.2 symbols/min [2025-10-06T17:50:40.313484] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-06T17:50:40.383278] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:50:40.427408] [DEBUG] [LOCAL ] BWXT: Loaded 47600 existing records from primary storage. [2025-10-06T17:50:40.427780] [INFO ] [MAIN ] BWXT: Loaded 47600 existing records. [2025-10-06T17:50:40.601674] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:50:40.601871] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-06T17:50:40.601917] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-06T17:50:40.602155] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-06T17:50:40.602212] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-06T17:50:40.630843] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-06T17:50:40.947477] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:50:41.145078] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-06T17:50:41.425500] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-06T17:50:42.225603] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-06T17:50:42.830067] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T17:50:42.967136] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T17:50:43.025598] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-06T17:50:43.662386] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-06T17:50:43.825560] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-06T17:50:44.432563] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-06T17:50:44.625576] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-06T17:50:45.425527] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-06T17:50:46.166072] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T17:50:46.225481] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-06T17:50:46.318672] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T17:50:47.025578] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-06T17:50:47.041206] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T17:50:47.042361] [INFO ] [REMOTE ] BWNB: Full fetch complete (5719 records). [2025-10-06T17:50:47.042448] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-06T17:50:47.399239] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-06T17:50:47.399327] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-06T17:50:47.399477] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-06T17:50:47.399518] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-06T17:50:47.399928] [DEBUG] [LOCAL ] BWNB: Trimmed 5719 records to 4392 (keeping 200 days of data) [2025-10-06T17:50:47.426598] [DEBUG] [LOCAL ] BWNB: Primary data saved (4392 records). [2025-10-06T17:50:47.426699] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-06T17:50:47.426781] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWNB took 30.9s. Estimated remaining: 4h 36m 58s. Rate: 7.2 symbols/min [2025-10-06T17:50:47.600926] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:50:47.606218] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T17:50:47.667315] [DEBUG] [LOCAL ] BX: Loaded 54266 existing records from primary storage. [2025-10-06T17:50:47.667775] [INFO ] [MAIN ] BX: Loaded 54266 existing records. [2025-10-06T17:50:47.837794] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-06T17:50:47.843131] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:50:47.844261] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-06T17:50:47.844310] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-06T17:50:47.844676] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-06T17:50:47.844736] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-06T17:50:48.197116] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:50:48.625534] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-06T17:50:49.425527] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-06T17:50:49.607954] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T17:50:50.225487] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-06T17:50:50.556733] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-06T17:50:51.025519] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-06T17:50:51.304696] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-06T17:50:51.495934] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-06T17:50:51.651386] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T17:50:51.825558] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-06T17:50:52.625529] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-06T17:50:53.203546] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T17:50:53.425609] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-06T17:50:53.994063] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-06T17:50:54.057969] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-06T17:50:54.225606] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-06T17:50:54.628775] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-06T17:50:55.025531] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-06T17:50:55.825548] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-06T17:50:56.158533] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T17:50:56.160765] [INFO ] [REMOTE ] BWLP: Full fetch complete (48039 records). [2025-10-06T17:50:56.160861] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-06T17:50:56.446999] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-06T17:50:56.470514] [INFO ] [REMOTE ] BWSN: Full fetch complete (6301 records). [2025-10-06T17:50:56.481411] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-06T17:50:56.648712] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-06T17:50:56.687197] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-06T17:50:56.687615] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-06T17:50:56.714618] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-06T17:50:56.777091] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-06T17:50:56.895698] [DEBUG] [LOCAL ] BWLP: Trimmed 48039 records to 32271 (keeping 200 days of data) [2025-10-06T17:50:57.041860] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-06T17:50:57.042422] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-06T17:50:57.042686] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-06T17:50:57.070926] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-06T17:50:57.072368] [DEBUG] [LOCAL ] BWSN: Trimmed 6301 records to 5204 (keeping 200 days of data) [2025-10-06T17:50:57.105676] [DEBUG] [LOCAL ] BWSN: Primary data saved (5204 records). [2025-10-06T17:50:57.106299] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-06T17:50:57.106730] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWSN took 27.1s. Estimated remaining: 4h 36m 57s. Rate: 7.2 symbols/min [2025-10-06T17:50:57.297230] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:50:57.316148] [DEBUG] [LOCAL ] BXC: Loaded 13793 existing records from primary storage. [2025-10-06T17:50:57.317039] [INFO ] [MAIN ] BXC: Loaded 13793 existing records. [2025-10-06T17:50:57.434267] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-06T17:50:57.589691] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:50:57.591016] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-06T17:50:57.593036] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-06T17:50:57.594230] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-06T17:50:57.594850] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-06T17:50:57.888137] [DEBUG] [LOCAL ] BWLP: Primary data saved (32271 records). [2025-10-06T17:50:57.888484] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-06T17:50:57.889189] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWLP took 50.9s. Estimated remaining: 4h 36m 8s. Rate: 7.3 symbols/min [2025-10-06T17:50:58.078397] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:50:58.149542] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:50:58.194727] [DEBUG] [LOCAL ] BXMT: Loaded 47953 existing records from primary storage. [2025-10-06T17:50:58.195198] [INFO ] [MAIN ] BXMT: Loaded 47953 existing records. [2025-10-06T17:50:58.231984] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-06T17:50:58.387985] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:50:58.388536] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-06T17:50:58.388613] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-06T17:50:58.389134] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-06T17:50:58.389205] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-06T17:50:58.591870] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T17:50:58.821982] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:50:59.025513] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-06T17:50:59.197475] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T17:50:59.240916] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-06T17:50:59.825549] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-06T17:51:00.625519] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-06T17:51:01.134983] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-06T17:51:01.269895] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-06T17:51:01.425547] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-06T17:51:01.822932] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-06T17:51:02.225536] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-06T17:51:02.298414] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-06T17:51:03.025526] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-06T17:51:03.825517] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-06T17:51:03.868232] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T17:51:04.060016] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T17:51:04.625557] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-06T17:51:05.425544] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-06T17:51:05.779799] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-06T17:51:06.225571] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-06T17:51:06.605843] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T17:51:06.807430] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-06T17:51:07.025541] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-06T17:51:07.825501] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-06T17:51:07.933303] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-06T17:51:08.125438] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-06T17:51:08.625602] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-06T17:51:09.425525] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-06T17:51:09.723357] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T17:51:09.856311] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T17:51:10.225580] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-06T17:51:11.025489] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-06T17:51:11.064604] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T17:51:11.205698] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T17:51:11.825544] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-06T17:51:12.625577] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-06T17:51:13.113918] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-06T17:51:13.425498] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-06T17:51:13.638814] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-06T17:51:13.750045] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-06T17:51:14.225591] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-06T17:51:15.025569] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-06T17:51:15.154371] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T17:51:15.194819] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T17:51:15.825554] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-06T17:51:16.625576] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-06T17:51:16.766048] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T17:51:16.863514] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-06T17:51:17.425549] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-06T17:51:18.225530] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-06T17:51:18.529528] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T17:51:19.025498] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-06T17:51:19.153958] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T17:51:19.779259] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T17:51:19.825516] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-06T17:51:20.625524] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-06T17:51:20.750256] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-06T17:51:20.753195] [INFO ] [REMOTE ] BWXT: Full fetch complete (67595 records). [2025-10-06T17:51:20.753328] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-06T17:51:21.131767] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-06T17:51:21.131882] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-06T17:51:21.132680] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-06T17:51:21.132744] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-06T17:51:21.134193] [DEBUG] [LOCAL ] BWXT: Trimmed 67595 records to 46898 (keeping 200 days of data) [2025-10-06T17:51:21.433043] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-06T17:51:21.467931] [DEBUG] [LOCAL ] BWXT: Primary data saved (46898 records). [2025-10-06T17:51:21.468121] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-06T17:51:21.468232] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BWXT took 41.3s. Estimated remaining: 4h 37m 23s. Rate: 7.2 symbols/min [2025-10-06T17:51:21.717470] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:51:21.752197] [DEBUG] [LOCAL ] BXMX: Loaded 19909 existing records from primary storage. [2025-10-06T17:51:21.753027] [INFO ] [MAIN ] BXMX: Loaded 19909 existing records. [2025-10-06T17:51:21.982068] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-06T17:51:22.121590] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:51:22.121970] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-06T17:51:22.122048] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-06T17:51:22.122532] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-06T17:51:22.122611] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-06T17:51:22.231251] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-06T17:51:22.402110] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T17:51:22.468283] [INFO ] [REMOTE ] BXC: Full fetch complete (17993 records). [2025-10-06T17:51:22.507326] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-06T17:51:22.693293] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:51:22.755395] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-06T17:51:23.011750] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-06T17:51:23.011849] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-06T17:51:23.012185] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-06T17:51:23.012224] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-06T17:51:23.012787] [DEBUG] [LOCAL ] BXC: Trimmed 17993 records to 13641 (keeping 200 days of data) [2025-10-06T17:51:23.045888] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-06T17:51:23.097953] [DEBUG] [LOCAL ] BXC: Primary data saved (13641 records). [2025-10-06T17:51:23.098093] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-06T17:51:23.098203] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BXC took 26.0s. Estimated remaining: 4h 36m 38s. Rate: 7.2 symbols/min [2025-10-06T17:51:23.265461] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:51:23.316481] [DEBUG] [LOCAL ] BXP: Loaded 50590 existing records from primary storage. [2025-10-06T17:51:23.316893] [INFO ] [MAIN ] BXP: Loaded 50590 existing records. [2025-10-06T17:51:23.490521] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:51:23.490755] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-06T17:51:23.490825] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-06T17:51:23.491259] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-06T17:51:23.491334] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-06T17:51:23.829798] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-06T17:51:23.859249] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:51:24.215495] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T17:51:24.278471] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-06T17:51:24.282014] [INFO ] [REMOTE ] BX: Full fetch complete (77403 records). [2025-10-06T17:51:24.282247] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-06T17:51:24.633272] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-06T17:51:24.698892] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-06T17:51:24.699005] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-06T17:51:24.699986] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-06T17:51:24.700060] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-06T17:51:24.701915] [DEBUG] [LOCAL ] BX: Trimmed 77403 records to 53479 (keeping 200 days of data) [2025-10-06T17:51:25.066963] [DEBUG] [LOCAL ] BX: Primary data saved (53479 records). [2025-10-06T17:51:25.067189] [INFO ] [MAIN ] BX: Full history saved. [2025-10-06T17:51:25.067304] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BX took 37.6s. Estimated remaining: 4h 35m 56s. Rate: 7.2 symbols/min [2025-10-06T17:51:25.252147] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:51:25.308505] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T17:51:25.335310] [DEBUG] [LOCAL ] BXSL: Loaded 48413 existing records from primary storage. [2025-10-06T17:51:25.335744] [INFO ] [MAIN ] BXSL: Loaded 48413 existing records. [2025-10-06T17:51:25.430639] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-06T17:51:25.520270] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:51:25.520523] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-06T17:51:25.520570] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-06T17:51:25.520929] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-06T17:51:25.520986] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-06T17:51:25.835247] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-06T17:51:25.902850] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:51:26.225547] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-06T17:51:27.025500] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-06T17:51:27.232479] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T17:51:27.324225] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T17:51:27.825513] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-06T17:51:28.625551] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-06T17:51:28.755472] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T17:51:29.060883] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-06T17:51:29.425544] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-06T17:51:30.091894] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T17:51:30.225570] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-06T17:51:30.654093] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T17:51:31.025595] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-06T17:51:31.812375] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T17:51:31.825473] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-06T17:51:32.066348] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-06T17:51:32.625594] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-06T17:51:33.425534] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-06T17:51:33.644616] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T17:51:34.100068] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T17:51:34.225534] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-06T17:51:35.025518] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-06T17:51:35.195544] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T17:51:35.442110] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T17:51:35.825551] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-06T17:51:36.625556] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-06T17:51:36.916711] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T17:51:37.425509] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-06T17:51:37.463331] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T17:51:37.916682] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-06T17:51:38.225570] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-06T17:51:39.025587] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-06T17:51:39.352065] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-06T17:51:39.396785] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T17:51:39.825556] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-06T17:51:40.625489] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-06T17:51:40.795452] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T17:51:41.237724] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T17:51:41.289826] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-06T17:51:41.425530] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-06T17:51:42.225518] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-06T17:51:42.458520] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-06T17:51:43.025576] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-06T17:51:43.636062] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T17:51:43.639014] [INFO ] [REMOTE ] BXMT: Full fetch complete (69678 records). [2025-10-06T17:51:43.639163] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-06T17:51:43.833201] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-06T17:51:44.071876] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-06T17:51:44.076570] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-06T17:51:44.078519] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-06T17:51:44.078985] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-06T17:51:44.078825] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T17:51:44.081440] [INFO ] [REMOTE ] BXMX: Full fetch complete (28951 records). [2025-10-06T17:51:44.081564] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-06T17:51:44.183459] [DEBUG] [LOCAL ] BXMT: Trimmed 69678 records to 47183 (keeping 200 days of data) [2025-10-06T17:51:44.590009] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-06T17:51:44.590401] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-06T17:51:44.591243] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-06T17:51:44.591772] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-06T17:51:44.595904] [DEBUG] [LOCAL ] BXMX: Trimmed 28951 records to 19522 (keeping 200 days of data) [2025-10-06T17:51:44.657426] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-06T17:51:44.905339] [DEBUG] [LOCAL ] BXMT: Primary data saved (47183 records). [2025-10-06T17:51:44.906536] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-06T17:51:44.906684] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXMT took 47.0s. Estimated remaining: 4h 36m 50s. Rate: 7.2 symbols/min [2025-10-06T17:51:44.974144] [DEBUG] [LOCAL ] BXMX: Primary data saved (19522 records). [2025-10-06T17:51:44.985681] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-06T17:51:44.990907] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 23.5s. Estimated remaining: 4h 35m 57s. Rate: 7.2 symbols/min [2025-10-06T17:51:45.249210] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:51:45.268089] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:51:45.292295] [DEBUG] [LOCAL ] BY: Loaded 21972 existing records from primary storage. [2025-10-06T17:51:45.292626] [INFO ] [MAIN ] BY: Loaded 21972 existing records. [2025-10-06T17:51:45.491271] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:51:45.492955] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-06T17:51:45.493286] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-06T17:51:45.509009] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-06T17:51:45.509362] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-06T17:51:45.516366] [DEBUG] [LOCAL ] BYD: Loaded 45568 existing records from primary storage. [2025-10-06T17:51:45.550977] [INFO ] [MAIN ] BYD: Loaded 45568 existing records. [2025-10-06T17:51:45.922276] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:51:45.951956] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-06T17:51:45.929696] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-06T17:51:45.969792] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-06T17:51:45.980205] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-06T17:51:46.035489] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-06T17:51:46.035747] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-06T17:51:46.326915] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:51:46.343291] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-06T17:51:46.622179] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:51:46.652158] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-06T17:51:47.025549] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-06T17:51:47.616940] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T17:51:47.825532] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-06T17:51:47.878305] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T17:51:48.308608] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T17:51:48.625615] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-06T17:51:48.790191] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T17:51:49.425546] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-06T17:51:49.901632] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-06T17:51:50.003716] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T17:51:50.225546] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-06T17:51:51.025556] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-06T17:51:51.713287] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T17:51:51.760009] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T17:51:51.825558] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-06T17:51:52.625542] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-06T17:51:53.426107] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-06T17:51:53.425997] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T17:51:54.225563] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-06T17:51:54.555280] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-06T17:51:55.021304] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T17:51:55.030504] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-06T17:51:55.825570] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-06T17:51:56.064273] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T17:51:56.625487] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-06T17:51:57.015882] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-06T17:51:57.425513] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-06T17:51:58.225571] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-06T17:51:58.517744] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T17:51:58.533453] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (3.50 seconds). [2025-10-06T17:51:59.025514] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-06T17:51:59.100803] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T17:51:59.123160] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T17:51:59.825541] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-06T17:52:00.625575] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-06T17:52:00.819576] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-06T17:52:00.822972] [INFO ] [REMOTE ] BXSL: Full fetch complete (69503 records). [2025-10-06T17:52:00.823201] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-06T17:52:01.189442] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T17:52:01.254687] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-06T17:52:01.254793] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-06T17:52:01.255617] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-06T17:52:01.255691] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-06T17:52:01.257187] [DEBUG] [LOCAL ] BXSL: Trimmed 69503 records to 47707 (keeping 200 days of data) [2025-10-06T17:52:01.434591] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-06T17:52:01.558294] [DEBUG] [LOCAL ] BXSL: Primary data saved (47707 records). [2025-10-06T17:52:01.558484] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-06T17:52:01.559065] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXSL took 36.5s. Estimated remaining: 4h 36m 33s. Rate: 7.2 symbols/min [2025-10-06T17:52:01.736223] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:52:01.752710] [DEBUG] [LOCAL ] BYM: Loaded 12190 existing records from primary storage. [2025-10-06T17:52:01.752998] [INFO ] [MAIN ] BYM: Loaded 12190 existing records. [2025-10-06T17:52:01.934963] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:52:01.935327] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-06T17:52:01.935390] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-06T17:52:01.935808] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-06T17:52:01.935871] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-06T17:52:02.228304] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-06T17:52:02.309756] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:52:02.392229] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T17:52:03.025515] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-06T17:52:03.436835] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T17:52:03.504412] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-06T17:52:03.825551] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-06T17:52:04.625574] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-06T17:52:04.692479] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T17:52:04.726922] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-06T17:52:04.729535] [INFO ] [REMOTE ] BXP: Full fetch complete (71290 records). [2025-10-06T17:52:04.729671] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-06T17:52:04.730337] [FATAL] [VALIDATOR ] BXP: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:52:04.730426] [FATAL] [MAIN ] BXP: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:52:04.730471] [WARN ] [MAIN ] BXP: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:52:04.730543] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-06T17:52:04.730614] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-06T17:52:04.730709] [INFO ] [LOCAL ] BXP: Starting deletion of derivative data. [2025-10-06T17:52:04.731022] [DEBUG] [LOCAL ] BXP: Deleted derivative data file. [2025-10-06T17:52:04.731120] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXP took 41.6s. Estimated remaining: 4h 35m 57s. Rate: 7.2 symbols/min [2025-10-06T17:52:04.903349] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:52:04.936165] [DEBUG] [LOCAL ] BZH: Loaded 32801 existing records from primary storage. [2025-10-06T17:52:04.936524] [INFO ] [MAIN ] BZH: Loaded 32801 existing records. [2025-10-06T17:52:05.119869] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:52:05.120153] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-06T17:52:05.120201] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-06T17:52:05.120504] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-06T17:52:05.120562] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-06T17:52:05.430785] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-06T17:52:05.496852] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:52:05.681999] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-06T17:52:06.225571] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-06T17:52:07.026487] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-06T17:52:07.033743] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T17:52:07.070054] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T17:52:07.688281] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-06T17:52:07.825547] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-06T17:52:08.625625] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-06T17:52:08.875771] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T17:52:08.878190] [INFO ] [REMOTE ] BY: Full fetch complete (29664 records). [2025-10-06T17:52:08.878320] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-06T17:52:09.346736] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-06T17:52:09.347093] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-06T17:52:09.347564] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-06T17:52:09.347607] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-06T17:52:09.348669] [DEBUG] [LOCAL ] BY: Trimmed 29664 records to 21672 (keeping 200 days of data) [2025-10-06T17:52:09.435742] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-06T17:52:09.448960] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-06T17:52:09.497816] [DEBUG] [LOCAL ] BY: Primary data saved (21672 records). [2025-10-06T17:52:09.497983] [INFO ] [MAIN ] BY: Full history saved. [2025-10-06T17:52:09.498073] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BY took 24.6s. Estimated remaining: 4h 35m 31s. Rate: 7.2 symbols/min [2025-10-06T17:52:09.662445] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:52:09.713220] [DEBUG] [LOCAL ] C: Loaded 54520 existing records from primary storage. [2025-10-06T17:52:09.713712] [INFO ] [MAIN ] C: Loaded 54520 existing records. [2025-10-06T17:52:09.894194] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:52:09.894467] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-06T17:52:09.894604] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-06T17:52:09.895405] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-06T17:52:09.895466] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-06T17:52:10.245924] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-06T17:52:10.252633] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:52:11.025587] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-06T17:52:11.241516] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T17:52:11.611467] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T17:52:11.699212] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-06T17:52:11.825510] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-06T17:52:12.625549] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-06T17:52:13.425494] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-06T17:52:14.148426] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T17:52:14.225602] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-06T17:52:14.578992] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-06T17:52:15.025755] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-06T17:52:15.514063] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-06T17:52:15.825541] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-06T17:52:16.017015] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T17:52:16.521147] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T17:52:16.625512] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-06T17:52:16.866457] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T17:52:17.425550] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-06T17:52:18.226399] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-06T17:52:18.231210] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T17:52:18.254159] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T17:52:19.025599] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-06T17:52:19.825570] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-06T17:52:20.389934] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-06T17:52:20.625559] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-06T17:52:20.743054] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T17:52:21.201584] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T17:52:21.425575] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-06T17:52:22.225553] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-06T17:52:22.605830] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-06T17:52:23.025529] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-06T17:52:23.713206] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T17:52:23.717278] [INFO ] [REMOTE ] BYD: Full fetch complete (65116 records). [2025-10-06T17:52:23.717506] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-06T17:52:23.829738] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-06T17:52:24.154529] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-06T17:52:24.155301] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-06T17:52:24.156198] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-06T17:52:24.157236] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-06T17:52:24.166134] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-06T17:52:24.168009] [DEBUG] [LOCAL ] BYD: Trimmed 65116 records to 44852 (keeping 200 days of data) [2025-10-06T17:52:24.452275] [DEBUG] [LOCAL ] BYD: Primary data saved (44852 records). [2025-10-06T17:52:24.452458] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-06T17:52:24.453479] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BYD took 39.5s. Estimated remaining: 4h 35m 57s. Rate: 7.2 symbols/min [2025-10-06T17:52:24.625942] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:52:24.626364] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-06T17:52:24.639345] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-06T17:52:24.662178] [DEBUG] [LOCAL ] CAAP: Loaded 20340 existing records from primary storage. [2025-10-06T17:52:24.662535] [INFO ] [MAIN ] CAAP: Loaded 20340 existing records. [2025-10-06T17:52:24.840906] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:52:24.841159] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-06T17:52:24.841205] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-06T17:52:24.841479] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-06T17:52:24.841536] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-06T17:52:25.223786] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:52:25.425598] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-06T17:52:26.041476] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T17:52:26.225539] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-06T17:52:26.503286] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-06T17:52:26.570084] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (3.54 seconds). [2025-10-06T17:52:27.025608] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-06T17:52:27.825505] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-06T17:52:27.921238] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T17:52:28.014592] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T17:52:28.423699] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T17:52:28.625517] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-06T17:52:29.425604] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-06T17:52:29.942614] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T17:52:30.202074] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T17:52:30.225575] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-06T17:52:31.025566] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-06T17:52:31.134754] [DEBUG] [REMOTE ] BYM: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-06T17:52:31.135073] [WARN ] [REMOTE ] BYM: No data returned for month 2025-09 [2025-10-06T17:52:31.135187] [FATAL] [REMOTE ] BYM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:52:31.135282] [FATAL] [MAIN ] BYM: Failed to fetch primary data. [2025-10-06T17:52:31.135348] [WARN ] [MAIN ] BYM: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:52:31.135446] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-06T17:52:31.135519] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-10-06T17:52:31.135557] [INFO ] [LOCAL ] BYM: Starting deletion of derivative data. [2025-10-06T17:52:31.135791] [DEBUG] [LOCAL ] BYM: Deleted derivative data file. [2025-10-06T17:52:31.135921] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 29.6s. Estimated remaining: 4h 35m 41s. Rate: 7.2 symbols/min [2025-10-06T17:52:31.353260] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:52:31.375958] [DEBUG] [LOCAL ] CABO: Loaded 17184 existing records from primary storage. [2025-10-06T17:52:31.376284] [INFO ] [MAIN ] CABO: Loaded 17184 existing records. [2025-10-06T17:52:31.590703] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:52:31.591307] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-06T17:52:31.591382] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-06T17:52:31.591625] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-06T17:52:31.591716] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-06T17:52:31.834356] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-06T17:52:31.941181] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:52:32.545762] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-06T17:52:32.625475] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-06T17:52:32.817914] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T17:52:33.425571] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-06T17:52:34.225561] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-06T17:52:34.431429] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-06T17:52:34.797627] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-06T17:52:34.981013] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T17:52:35.025481] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-06T17:52:35.825526] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-06T17:52:36.090732] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T17:52:36.625565] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-06T17:52:37.131425] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-06T17:52:37.425580] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-06T17:52:38.225494] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-06T17:52:38.250078] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T17:52:38.672829] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-06T17:52:38.948946] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T17:52:39.025485] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-06T17:52:39.825506] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-06T17:52:40.061130] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T17:52:40.625504] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-06T17:52:40.798160] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T17:52:41.425528] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-06T17:52:42.225562] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-06T17:52:42.452720] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T17:52:42.675767] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-06T17:52:43.025552] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-06T17:52:43.683216] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T17:52:43.825498] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-06T17:52:43.970765] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-06T17:52:44.625513] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-06T17:52:44.900796] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T17:52:45.425586] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-06T17:52:46.225610] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-06T17:52:46.678175] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T17:52:46.680098] [INFO ] [REMOTE ] BZH: Full fetch complete (46936 records). [2025-10-06T17:52:46.680187] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-06T17:52:47.029713] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-06T17:52:47.064379] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-06T17:52:47.064600] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-06T17:52:47.070703] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-06T17:52:47.075607] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-06T17:52:47.076709] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T17:52:47.082026] [DEBUG] [LOCAL ] BZH: Trimmed 46936 records to 32355 (keeping 200 days of data) [2025-10-06T17:52:47.276889] [DEBUG] [LOCAL ] BZH: Primary data saved (32355 records). [2025-10-06T17:52:47.277169] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-06T17:52:47.277280] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 42.5s. Estimated remaining: 4h 36m 13s. Rate: 7.2 symbols/min [2025-10-06T17:52:47.447205] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:52:47.475607] [DEBUG] [LOCAL ] CACI: Loaded 24817 existing records from primary storage. [2025-10-06T17:52:47.475937] [INFO ] [MAIN ] CACI: Loaded 24817 existing records. [2025-10-06T17:52:47.686909] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:52:47.681737] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (3.06 seconds). [2025-10-06T17:52:47.697705] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-06T17:52:47.697778] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-06T17:52:47.698210] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-06T17:52:47.698543] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-06T17:52:47.830628] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-06T17:52:48.091095] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:52:48.456908] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T17:52:48.625599] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-06T17:52:49.425578] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-06T17:52:49.935169] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T17:52:50.142330] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-06T17:52:50.167196] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T17:52:50.225486] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-06T17:52:51.025567] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-06T17:52:51.519732] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-06T17:52:51.825558] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-06T17:52:52.259060] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-06T17:52:52.625549] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-06T17:52:53.425488] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-06T17:52:53.435362] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-06T17:52:53.439244] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-06T17:52:53.439420] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-06T17:52:53.835033] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-06T17:52:53.835194] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-06T17:52:53.836147] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-06T17:52:53.836240] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-06T17:52:53.837987] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 53740 (keeping 200 days of data) [2025-10-06T17:52:54.077908] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T17:52:54.200225] [DEBUG] [LOCAL ] C: Primary data saved (53740 records). [2025-10-06T17:52:54.200411] [INFO ] [MAIN ] C: Full history saved. [2025-10-06T17:52:54.200507] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. C took 44.7s. Estimated remaining: 4h 35m 58s. Rate: 7.2 symbols/min [2025-10-06T17:52:54.235540] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-06T17:52:54.380850] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:52:54.386728] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T17:52:54.388954] [INFO ] [REMOTE ] CAAP: Full fetch complete (27792 records). [2025-10-06T17:52:54.389049] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-06T17:52:54.764337] [DEBUG] [LOCAL ] CADE: Loaded 49604 existing records from primary storage. [2025-10-06T17:52:54.793883] [INFO ] [MAIN ] CADE: Loaded 49604 existing records. [2025-10-06T17:52:54.793746] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-06T17:52:54.793983] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-06T17:52:54.858990] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-06T17:52:54.871536] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-06T17:52:54.914142] [DEBUG] [LOCAL ] CAAP: Trimmed 27792 records to 19865 (keeping 200 days of data) [2025-10-06T17:52:55.033057] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-06T17:52:55.038495] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:52:55.070318] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-06T17:52:55.070409] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-06T17:52:55.075682] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-06T17:52:55.077209] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-06T17:52:55.477232] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:52:55.481028] [DEBUG] [LOCAL ] CAAP: Primary data saved (19865 records). [2025-10-06T17:52:55.481165] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-06T17:52:55.481298] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CAAP took 31.0s. Estimated remaining: 4h 35m 13s. Rate: 7.2 symbols/min [2025-10-06T17:52:55.651130] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:52:55.693942] [DEBUG] [LOCAL ] CAE: Loaded 39676 existing records from primary storage. [2025-10-06T17:52:55.694281] [INFO ] [MAIN ] CAE: Loaded 39676 existing records. [2025-10-06T17:52:55.836108] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-06T17:52:55.883979] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T17:52:55.926463] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:52:55.926732] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-06T17:52:55.926788] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-06T17:52:55.927299] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-06T17:52:55.927567] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-06T17:52:56.191351] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-06T17:52:56.348050] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:52:56.625604] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-06T17:52:57.425504] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-06T17:52:57.623497] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T17:52:57.668700] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T17:52:58.225541] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-06T17:52:59.025513] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-06T17:52:59.053260] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T17:52:59.054749] [INFO ] [REMOTE ] CABO: Full fetch complete (23093 records). [2025-10-06T17:52:59.054834] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-06T17:52:59.226804] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T17:52:59.487131] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-06T17:52:59.487256] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-06T17:52:59.487961] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-06T17:52:59.488030] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-06T17:52:59.488921] [DEBUG] [LOCAL ] CABO: Trimmed 23093 records to 16885 (keeping 200 days of data) [2025-10-06T17:52:59.606064] [DEBUG] [LOCAL ] CABO: Primary data saved (16885 records). [2025-10-06T17:52:59.606249] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-06T17:52:59.606363] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. CABO took 28.5s. Estimated remaining: 4h 34m 43s. Rate: 7.2 symbols/min [2025-10-06T17:52:59.789163] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:52:59.796113] [DEBUG] [LOCAL ] CAF: Loaded 3474 existing records from primary storage. [2025-10-06T17:52:59.796351] [INFO ] [MAIN ] CAF: Loaded 3474 existing records. [2025-10-06T17:52:59.830723] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-06T17:53:00.022804] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:53:00.023058] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-06T17:53:00.023109] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-06T17:53:00.023383] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-06T17:53:00.023443] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-06T17:53:00.423204] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:53:00.617436] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T17:53:00.627399] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-06T17:53:01.425489] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-06T17:53:01.657701] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-06T17:53:01.681722] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T17:53:02.225592] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-06T17:53:03.027871] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-06T17:53:03.031456] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T17:53:03.768086] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-06T17:53:03.789601] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T17:53:03.825473] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-06T17:53:04.625542] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-06T17:53:05.418580] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-06T17:53:05.425458] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-06T17:53:05.537468] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T17:53:06.044718] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T17:53:06.225766] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-06T17:53:06.854035] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-06T17:53:07.025607] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-06T17:53:07.825550] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-06T17:53:08.339448] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T17:53:08.625595] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-06T17:53:09.267732] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T17:53:09.425512] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-06T17:53:09.724765] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T17:53:09.889035] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-06T17:53:10.225548] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-06T17:53:11.025584] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-06T17:53:11.744523] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T17:53:11.825589] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-06T17:53:12.625589] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-06T17:53:12.698697] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T17:53:13.231372] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-06T17:53:13.359324] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T17:53:13.425514] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-06T17:53:14.225558] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-06T17:53:14.741389] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-06T17:53:15.025538] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-06T17:53:15.077340] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T17:53:15.573860] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T17:53:15.825577] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-06T17:53:16.625530] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-06T17:53:16.902309] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T17:53:17.425562] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-06T17:53:17.820945] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T17:53:18.225601] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-06T17:53:18.728861] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T17:53:19.025562] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-06T17:53:19.605906] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-06T17:53:19.825506] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-06T17:53:20.509259] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-06T17:53:20.625540] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-06T17:53:20.899617] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T17:53:21.425532] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-06T17:53:22.066456] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T17:53:22.225566] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-06T17:53:23.025482] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-06T17:53:23.229940] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T17:53:23.233628] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T17:53:23.245834] [INFO ] [REMOTE ] CACI: Full fetch complete (38781 records). [2025-10-06T17:53:23.246347] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-06T17:53:23.663230] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-06T17:53:23.663365] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-06T17:53:23.664034] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-06T17:53:23.664116] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-06T17:53:23.665634] [DEBUG] [LOCAL ] CACI: Trimmed 38781 records to 24209 (keeping 200 days of data) [2025-10-06T17:53:23.822045] [DEBUG] [LOCAL ] CACI: Primary data saved (24209 records). [2025-10-06T17:53:23.822217] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-06T17:53:23.822318] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CACI took 36.5s. Estimated remaining: 4h 35m 57s. Rate: 7.2 symbols/min [2025-10-06T17:53:23.833684] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-06T17:53:24.014386] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:53:24.077953] [DEBUG] [LOCAL ] CAG: Loaded 54443 existing records from primary storage. [2025-10-06T17:53:24.078386] [INFO ] [MAIN ] CAG: Loaded 54443 existing records. [2025-10-06T17:53:24.279626] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:53:24.280044] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-06T17:53:24.280127] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-06T17:53:24.280583] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-06T17:53:24.280682] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-06T17:53:24.627492] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-06T17:53:24.687628] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T17:53:24.708334] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:53:25.315791] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T17:53:25.316874] [INFO ] [REMOTE ] CAF: Full fetch complete (5607 records). [2025-10-06T17:53:25.316962] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-06T17:53:25.429423] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-06T17:53:25.779817] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-06T17:53:25.780043] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-06T17:53:25.780482] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-06T17:53:25.791702] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-06T17:53:25.810072] [DEBUG] [LOCAL ] CAF: Trimmed 5607 records to 3419 (keeping 200 days of data) [2025-10-06T17:53:25.812774] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-06T17:53:25.845817] [DEBUG] [LOCAL ] CAF: Primary data saved (3419 records). [2025-10-06T17:53:25.846014] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-06T17:53:25.846123] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAF took 26.2s. Estimated remaining: 4h 35m 16s. Rate: 7.2 symbols/min [2025-10-06T17:53:26.018971] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:53:26.084456] [DEBUG] [LOCAL ] CAH: Loaded 52181 existing records from primary storage. [2025-10-06T17:53:26.084867] [INFO ] [MAIN ] CAH: Loaded 52181 existing records. [2025-10-06T17:53:26.230796] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-06T17:53:26.277475] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:53:26.277913] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-06T17:53:26.277974] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-06T17:53:26.278505] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-06T17:53:26.278565] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-06T17:53:26.648545] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:53:26.938003] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T17:53:26.941093] [INFO ] [REMOTE ] CAE: Full fetch complete (56246 records). [2025-10-06T17:53:26.941210] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-06T17:53:27.030729] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-06T17:53:27.355838] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-06T17:53:27.356049] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-06T17:53:27.356951] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-06T17:53:27.357045] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-06T17:53:27.358740] [DEBUG] [LOCAL ] CAE: Trimmed 56246 records to 39221 (keeping 200 days of data) [2025-10-06T17:53:27.599821] [DEBUG] [LOCAL ] CAE: Primary data saved (39221 records). [2025-10-06T17:53:27.600043] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-06T17:53:27.600796] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CAE took 32.1s. Estimated remaining: 4h 34m 34s. Rate: 7.2 symbols/min [2025-10-06T17:53:27.800454] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:53:27.833259] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-06T17:53:27.857704] [DEBUG] [LOCAL ] CAL: Loaded 43747 existing records from primary storage. [2025-10-06T17:53:27.858095] [INFO ] [MAIN ] CAL: Loaded 43747 existing records. [2025-10-06T17:53:28.056324] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:53:28.056709] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-06T17:53:28.056850] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-06T17:53:28.057777] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-06T17:53:28.057842] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-06T17:53:28.489691] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:53:28.494639] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-06T17:53:28.625496] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-06T17:53:28.736934] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T17:53:29.425507] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-06T17:53:29.591167] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T17:53:30.215960] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T17:53:30.226284] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-06T17:53:31.025575] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-06T17:53:31.225180] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T17:53:31.825568] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-06T17:53:31.974515] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T17:53:32.625601] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-06T17:53:32.678054] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T17:53:33.425528] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-06T17:53:33.708224] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T17:53:34.072767] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T17:53:34.225588] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-06T17:53:35.025578] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-06T17:53:35.350067] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-06T17:53:35.668328] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T17:53:35.825557] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-06T17:53:36.625513] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-06T17:53:36.752489] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T17:53:37.425543] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-06T17:53:37.714033] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T17:53:37.954668] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T17:53:38.225556] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-06T17:53:38.856519] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T17:53:38.860041] [INFO ] [REMOTE ] CADE: Full fetch complete (70070 records). [2025-10-06T17:53:38.860248] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-06T17:53:39.046487] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-06T17:53:39.278264] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-06T17:53:39.278434] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-06T17:53:39.279446] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-06T17:53:39.279513] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-06T17:53:39.281462] [DEBUG] [LOCAL ] CADE: Trimmed 70070 records to 49070 (keeping 200 days of data) [2025-10-06T17:53:39.603235] [DEBUG] [LOCAL ] CADE: Primary data saved (49070 records). [2025-10-06T17:53:39.603396] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-06T17:53:39.603493] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CADE took 45.4s. Estimated remaining: 4h 34m 45s. Rate: 7.2 symbols/min [2025-10-06T17:53:39.790816] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:53:39.822381] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T17:53:39.831384] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-06T17:53:39.868334] [DEBUG] [LOCAL ] CALX: Loaded 38363 existing records from primary storage. [2025-10-06T17:53:39.868712] [INFO ] [MAIN ] CALX: Loaded 38363 existing records. [2025-10-06T17:53:40.056329] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:53:40.056587] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-06T17:53:40.056634] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-06T17:53:40.057077] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-06T17:53:40.057136] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-06T17:53:40.440215] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:53:40.625536] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-06T17:53:41.163523] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-06T17:53:41.425532] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-06T17:53:41.635750] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T17:53:41.761897] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T17:53:42.225568] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-06T17:53:43.025541] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-06T17:53:43.303921] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-06T17:53:43.518991] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-06T17:53:43.825549] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-06T17:53:44.625556] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-06T17:53:44.836624] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T17:53:45.077074] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T17:53:45.425534] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-06T17:53:45.537762] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T17:53:46.225536] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-06T17:53:47.026034] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-06T17:53:47.033716] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T17:53:47.825540] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-06T17:53:48.079853] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T17:53:48.625507] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-06T17:53:49.035975] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T17:53:49.162031] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-06T17:53:49.425543] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-06T17:53:50.225509] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-06T17:53:50.439520] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T17:53:50.951248] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T17:53:51.025477] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-06T17:53:51.271232] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T17:53:51.825526] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-06T17:53:52.531699] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T17:53:52.625509] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-06T17:53:53.391131] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T17:53:53.425514] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-06T17:53:54.220328] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T17:53:54.222957] [INFO ] [REMOTE ] CAL: Full fetch complete (61832 records). [2025-10-06T17:53:54.223069] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-06T17:53:54.235456] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-06T17:53:54.640205] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-06T17:53:54.640375] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-06T17:53:54.641280] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-06T17:53:54.641426] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-06T17:53:54.643297] [DEBUG] [LOCAL ] CAL: Trimmed 61832 records to 43096 (keeping 200 days of data) [2025-10-06T17:53:54.795084] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T17:53:54.953801] [DEBUG] [LOCAL ] CAL: Primary data saved (43096 records). [2025-10-06T17:53:54.953953] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-06T17:53:54.954820] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAL took 27.4s. Estimated remaining: 4h 35m 12s. Rate: 7.2 symbols/min [2025-10-06T17:53:55.030626] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-06T17:53:55.130223] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:53:55.158263] [DEBUG] [LOCAL ] CANG: Loaded 27426 existing records from primary storage. [2025-10-06T17:53:55.158586] [INFO ] [MAIN ] CANG: Loaded 27426 existing records. [2025-10-06T17:53:55.340426] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:53:55.340749] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-06T17:53:55.340813] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-06T17:53:55.341115] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-06T17:53:55.341194] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-06T17:53:55.716113] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:53:55.825538] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-06T17:53:56.218744] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T17:53:56.625511] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-06T17:53:56.734694] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T17:53:57.425555] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-06T17:53:57.618477] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T17:53:58.225508] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-06T17:53:58.956050] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T17:53:59.025568] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-06T17:53:59.726056] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (3.10 seconds). [2025-10-06T17:53:59.825516] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-06T17:54:00.525076] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T17:54:00.625550] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-06T17:54:01.144360] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (2.92 seconds). [2025-10-06T17:54:01.302676] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T17:54:01.425551] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-06T17:54:02.225550] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-06T17:54:02.555395] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-06T17:54:02.807951] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T17:54:03.025592] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-06T17:54:03.825545] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-06T17:54:04.009394] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-06T17:54:04.012998] [INFO ] [REMOTE ] CAH: Full fetch complete (74632 records). [2025-10-06T17:54:04.013140] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-06T17:54:04.412096] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-06T17:54:04.412191] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-06T17:54:04.413171] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-06T17:54:04.413235] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-06T17:54:04.414805] [DEBUG] [LOCAL ] CAH: Trimmed 74632 records to 51470 (keeping 200 days of data) [2025-10-06T17:54:04.637671] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-06T17:54:04.752950] [DEBUG] [LOCAL ] CAH: Primary data saved (51470 records). [2025-10-06T17:54:04.753144] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-06T17:54:04.754109] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAH took 38.9s. Estimated remaining: 4h 35m 11s. Rate: 7.2 symbols/min [2025-10-06T17:54:04.933404] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:54:04.964303] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-06T17:54:04.961450] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-06T17:54:04.981535] [DEBUG] [LOCAL ] CAPL: Loaded 5854 existing records from primary storage. [2025-10-06T17:54:04.981718] [INFO ] [REMOTE ] CAG: Full fetch complete (77655 records). [2025-10-06T17:54:04.982122] [INFO ] [MAIN ] CAPL: Loaded 5854 existing records. [2025-10-06T17:54:04.982258] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-06T17:54:05.328573] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:54:05.367043] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-06T17:54:05.390492] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-06T17:54:05.425836] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-06T17:54:05.431320] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-06T17:54:05.463036] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-06T17:54:05.857038] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-06T17:54:05.880909] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-06T17:54:05.917698] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-06T17:54:05.928768] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-06T17:54:06.010888] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:54:06.012278] [DEBUG] [LOCAL ] CAG: Trimmed 77655 records to 53664 (keeping 200 days of data) [2025-10-06T17:54:06.158286] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-06T17:54:06.234702] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-06T17:54:06.394890] [DEBUG] [LOCAL ] CAG: Primary data saved (53664 records). [2025-10-06T17:54:06.395088] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-06T17:54:06.395178] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAG took 42.6s. Estimated remaining: 4h 34m 29s. Rate: 7.2 symbols/min [2025-10-06T17:54:06.580129] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:54:06.651409] [DEBUG] [LOCAL ] CARR: Loaded 54374 existing records from primary storage. [2025-10-06T17:54:06.651876] [INFO ] [MAIN ] CARR: Loaded 54374 existing records. [2025-10-06T17:54:06.832052] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:54:06.832387] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-06T17:54:06.832602] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-06T17:54:06.848941] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-06T17:54:06.849034] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-06T17:54:06.849914] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T17:54:07.030384] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-06T17:54:07.173320] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T17:54:07.229170] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:54:07.825609] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-06T17:54:08.625541] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-06T17:54:08.740053] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T17:54:09.282474] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-06T17:54:09.425583] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-06T17:54:09.587687] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T17:54:09.858947] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-06T17:54:10.225542] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-06T17:54:11.025706] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-06T17:54:11.607606] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T17:54:11.825552] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-06T17:54:11.928239] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-06T17:54:12.625570] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-06T17:54:13.143345] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T17:54:13.146617] [INFO ] [REMOTE ] CALX: Full fetch complete (54027 records). [2025-10-06T17:54:13.146833] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-06T17:54:13.433393] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-06T17:54:13.619060] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-06T17:54:13.619162] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-06T17:54:13.620151] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-06T17:54:13.620240] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-06T17:54:13.621621] [DEBUG] [LOCAL ] CALX: Trimmed 54027 records to 37817 (keeping 200 days of data) [2025-10-06T17:54:13.856816] [DEBUG] [LOCAL ] CALX: Primary data saved (37817 records). [2025-10-06T17:54:13.857244] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-06T17:54:13.857355] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 34.3s. Estimated remaining: 4h 34m 16s. Rate: 7.2 symbols/min [2025-10-06T17:54:14.028768] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:54:14.069972] [DEBUG] [LOCAL ] CARS: Loaded 40377 existing records from primary storage. [2025-10-06T17:54:14.070356] [INFO ] [MAIN ] CARS: Loaded 40377 existing records. [2025-10-06T17:54:14.254253] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-06T17:54:14.254169] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:54:14.255985] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-06T17:54:14.256238] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-06T17:54:14.257040] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-06T17:54:14.257124] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-06T17:54:14.364677] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T17:54:14.675591] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-06T17:54:14.680332] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:54:15.025638] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-06T17:54:15.510073] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T17:54:15.825542] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-06T17:54:16.516946] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-06T17:54:16.561847] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T17:54:16.625482] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-06T17:54:17.425526] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-06T17:54:17.837894] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T17:54:18.059238] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-06T17:54:18.225546] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-06T17:54:18.834373] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-06T17:54:19.025560] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-06T17:54:19.825501] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-06T17:54:20.135172] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T17:54:20.316666] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-06T17:54:20.625558] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-06T17:54:21.218184] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-06T17:54:21.425576] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-06T17:54:22.013841] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T17:54:22.015160] [INFO ] [REMOTE ] CAPL: Full fetch complete (8743 records). [2025-10-06T17:54:22.015249] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-06T17:54:22.230618] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-06T17:54:22.384493] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-06T17:54:22.384583] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-06T17:54:22.384825] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-06T17:54:22.384885] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-06T17:54:22.385304] [DEBUG] [LOCAL ] CAPL: Trimmed 8743 records to 5725 (keeping 200 days of data) [2025-10-06T17:54:22.419963] [DEBUG] [LOCAL ] CAPL: Primary data saved (5725 records). [2025-10-06T17:54:22.420087] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-06T17:54:22.420172] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CAPL took 17.7s. Estimated remaining: 4h 34m 9s. Rate: 7.2 symbols/min [2025-10-06T17:54:22.594432] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:54:22.654217] [DEBUG] [LOCAL ] CAT: Loaded 53696 existing records from primary storage. [2025-10-06T17:54:22.654700] [INFO ] [MAIN ] CAT: Loaded 53696 existing records. [2025-10-06T17:54:22.829072] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:54:22.829349] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-06T17:54:22.829427] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-06T17:54:22.829933] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-06T17:54:22.830015] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-06T17:54:23.033638] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-06T17:54:23.189754] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:54:23.825540] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-06T17:54:24.034331] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T17:54:24.382349] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T17:54:24.625547] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-06T17:54:25.061906] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-06T17:54:25.425529] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-06T17:54:26.225613] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-06T17:54:26.346970] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T17:54:27.030581] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-06T17:54:27.042829] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T17:54:27.518155] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-06T17:54:27.825553] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-06T17:54:28.625518] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-06T17:54:28.885502] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T17:54:29.089895] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T17:54:29.425541] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-06T17:54:30.148265] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T17:54:30.225510] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-06T17:54:30.353237] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T17:54:31.025609] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-06T17:54:31.480118] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T17:54:31.825557] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-06T17:54:32.222028] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T17:54:32.224483] [INFO ] [REMOTE ] CANG: Full fetch complete (40439 records). [2025-10-06T17:54:32.224881] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-06T17:54:32.608141] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-06T17:54:32.608245] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-06T17:54:32.609004] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-06T17:54:32.609071] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-06T17:54:32.610372] [DEBUG] [LOCAL ] CANG: Trimmed 40439 records to 26918 (keeping 200 days of data) [2025-10-06T17:54:32.656498] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-06T17:54:32.770391] [DEBUG] [LOCAL ] CANG: Primary data saved (26918 records). [2025-10-06T17:54:32.770579] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-06T17:54:32.770700] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CANG took 37.8s. Estimated remaining: 4h 34m 11s. Rate: 7.2 symbols/min [2025-10-06T17:54:32.944020] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:54:32.955442] [DEBUG] [LOCAL ] CATO: Loaded 7167 existing records from primary storage. [2025-10-06T17:54:32.955785] [INFO ] [MAIN ] CATO: Loaded 7167 existing records. [2025-10-06T17:54:33.143024] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:54:33.143331] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-06T17:54:33.143393] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-06T17:54:33.143606] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-06T17:54:33.143707] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-06T17:54:33.431078] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-06T17:54:33.520796] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:54:34.103833] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-06T17:54:34.225553] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-06T17:54:34.545638] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T17:54:34.764853] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-06T17:54:35.025587] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-06T17:54:35.390947] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T17:54:35.825542] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-06T17:54:36.625543] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-06T17:54:36.933443] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-06T17:54:37.203069] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-06T17:54:37.364434] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-06T17:54:37.425501] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-06T17:54:38.158838] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T17:54:38.225536] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-06T17:54:39.025573] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-06T17:54:39.809292] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T17:54:39.825493] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-06T17:54:40.317033] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-06T17:54:40.610975] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-06T17:54:40.625475] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-06T17:54:41.425523] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-06T17:54:42.225536] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-06T17:54:42.358192] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T17:54:42.838746] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-06T17:54:42.895498] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T17:54:43.025548] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-06T17:54:43.825532] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-06T17:54:44.625540] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-06T17:54:45.071951] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-06T17:54:45.147844] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-06T17:54:45.425531] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-06T17:54:46.022481] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-06T17:54:46.225535] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-06T17:54:47.025521] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-06T17:54:47.314366] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T17:54:47.667315] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-06T17:54:47.825507] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-06T17:54:48.367815] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-06T17:54:48.625532] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-06T17:54:49.425523] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-06T17:54:49.662677] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T17:54:49.983100] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T17:54:50.225516] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-06T17:54:50.632826] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-06T17:54:50.965749] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-06T17:54:51.025558] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-06T17:54:51.618992] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T17:54:51.620128] [INFO ] [REMOTE ] CATO: Full fetch complete (11398 records). [2025-10-06T17:54:51.620211] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-06T17:54:51.830716] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-06T17:54:52.070390] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-06T17:54:52.070483] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-06T17:54:52.070905] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-06T17:54:52.070998] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-06T17:54:52.071576] [DEBUG] [LOCAL ] CATO: Trimmed 11398 records to 7011 (keeping 200 days of data) [2025-10-06T17:54:52.115015] [DEBUG] [LOCAL ] CATO: Primary data saved (7011 records). [2025-10-06T17:54:52.115211] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-06T17:54:52.115324] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CATO took 19.3s. Estimated remaining: 4h 34m 58s. Rate: 7.2 symbols/min [2025-10-06T17:54:52.289676] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:54:52.348569] [DEBUG] [LOCAL ] CAVA: Loaded 54332 existing records from primary storage. [2025-10-06T17:54:52.349030] [INFO ] [MAIN ] CAVA: Loaded 54332 existing records. [2025-10-06T17:54:52.540205] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:54:52.540487] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-06T17:54:52.540558] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-06T17:54:52.541021] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-06T17:54:52.541087] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-06T17:54:52.633919] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-06T17:54:52.910168] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:54:53.425542] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-06T17:54:53.887600] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-06T17:54:53.958967] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T17:54:54.225540] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-06T17:54:55.025588] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-06T17:54:55.205033] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-06T17:54:55.209005] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-06T17:54:55.209235] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-06T17:54:55.542302] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T17:54:55.584385] [INFO ] [REMOTE ] CARS: Full fetch complete (55606 records). [2025-10-06T17:54:55.591307] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-06T17:54:55.736236] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-06T17:54:55.747834] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-06T17:54:55.749389] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-06T17:54:55.749514] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-06T17:54:55.822498] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 53595 (keeping 200 days of data) [2025-10-06T17:54:55.825907] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-06T17:54:56.262542] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-06T17:54:56.262745] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-06T17:54:56.264137] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-06T17:54:56.264229] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-06T17:54:56.308735] [DEBUG] [LOCAL ] CARS: Trimmed 55606 records to 39750 (keeping 200 days of data) [2025-10-06T17:54:56.625851] [DEBUG] [LOCAL ] CARR: Primary data saved (53595 records). [2025-10-06T17:54:56.630244] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-06T17:54:56.632483] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CARR took 50.2s. Estimated remaining: 4h 34m 31s. Rate: 7.2 symbols/min [2025-10-06T17:54:56.839871] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:54:56.844817] [DEBUG] [LOCAL ] CARS: Primary data saved (39750 records). [2025-10-06T17:54:56.845154] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-06T17:54:56.845287] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CARS took 43.0s. Estimated remaining: 4h 33m 42s. Rate: 7.2 symbols/min [2025-10-06T17:54:57.037078] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:54:57.065941] [DEBUG] [LOCAL ] CBAN: Loaded 10995 existing records from primary storage. [2025-10-06T17:54:57.066282] [INFO ] [MAIN ] CBAN: Loaded 10995 existing records. [2025-10-06T17:54:57.194037] [DEBUG] [LOCAL ] CB: Loaded 50658 existing records from primary storage. [2025-10-06T17:54:57.221002] [INFO ] [MAIN ] CB: Loaded 50658 existing records. [2025-10-06T17:54:57.338411] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:54:57.347448] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-06T17:54:57.361549] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-06T17:54:57.372704] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-06T17:54:57.383599] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-06T17:54:57.682560] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:54:57.696878] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-06T17:54:57.697094] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-06T17:54:57.686320] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-06T17:54:57.785261] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-06T17:54:57.785883] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-06T17:54:57.826590] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-06T17:54:58.126438] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:54:58.166421] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-06T17:54:58.369303] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:54:58.369812] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-06T17:54:58.476489] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-06T17:54:59.025579] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-06T17:54:59.044199] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-06T17:54:59.825538] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-06T17:55:00.264193] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-06T17:55:00.504956] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-06T17:55:00.625500] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-06T17:55:01.115958] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (3.29 seconds). [2025-10-06T17:55:01.254770] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-06T17:55:01.425627] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-06T17:55:02.225616] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-06T17:55:03.025612] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-06T17:55:04.595158] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-06T17:55:04.608618] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-06T17:55:04.910520] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (4.29 seconds). [2025-10-06T17:55:04.914256] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-06T17:55:05.045834] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-06T17:55:05.425605] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-06T17:55:06.005974] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-06T17:55:06.225633] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-06T17:55:06.941463] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-06T17:55:06.950140] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (5.52 seconds). [2025-10-06T17:55:06.950412] [INFO ] [REMOTE ] CAT: Full fetch complete (76694 records). [2025-10-06T17:55:06.961535] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-06T17:55:07.032209] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-06T17:55:07.153688] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T17:55:07.395610] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-06T17:55:07.460589] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-06T17:55:07.460756] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-06T17:55:07.462342] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-06T17:55:07.462424] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-06T17:55:07.464766] [DEBUG] [LOCAL ] CAT: Trimmed 76694 records to 52917 (keeping 200 days of data) [2025-10-06T17:55:07.819565] [DEBUG] [LOCAL ] CAT: Primary data saved (52917 records). [2025-10-06T17:55:07.819797] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-06T17:55:07.820804] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CAT took 45.4s. Estimated remaining: 4h 33m 47s. Rate: 7.2 symbols/min [2025-10-06T17:55:07.825543] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-06T17:55:08.625636] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-06T17:55:08.683565] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T17:55:09.317104] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-06T17:55:09.425569] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-06T17:55:10.225550] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-06T17:55:10.705422] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-06T17:55:11.025580] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-06T17:55:11.143827] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T17:55:11.499338] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-06T17:55:11.825560] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-06T17:55:12.625541] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-06T17:55:12.669261] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T17:55:12.942914] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T17:55:13.425555] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-06T17:55:14.225617] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-06T17:55:14.757997] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-06T17:55:14.776780] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T17:55:15.025502] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-06T17:55:15.186821] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T17:55:15.825565] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-06T17:55:16.625626] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-06T17:55:17.139569] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-06T17:55:17.425559] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-06T17:55:17.586030] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T17:55:17.618672] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T17:55:18.225576] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-06T17:55:19.025630] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-06T17:55:19.747124] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-06T17:55:19.748285] [INFO ] [REMOTE ] CBAN: Full fetch complete (16121 records). [2025-10-06T17:55:19.748360] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-06T17:55:20.176699] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-06T17:55:20.177719] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-06T17:55:20.180247] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-06T17:55:20.180974] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-06T17:55:20.191802] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-06T17:55:20.194503] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-06T17:55:20.194123] [DEBUG] [LOCAL ] CBAN: Trimmed 16121 records to 10712 (keeping 200 days of data) [2025-10-06T17:55:20.265183] [DEBUG] [LOCAL ] CBAN: Primary data saved (10712 records). [2025-10-06T17:55:20.265400] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-06T17:55:20.265561] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CBAN took 23.4s. Estimated remaining: 4h 33m 59s. Rate: 7.2 symbols/min [2025-10-06T17:55:20.295366] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-06T17:55:20.625551] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-06T17:55:22.357168] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-06T17:55:22.370205] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-06T17:55:22.428798] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T17:55:22.439325] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-06T17:55:24.383245] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T17:55:24.401529] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-06T17:55:24.486386] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-06T17:55:24.499283] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-06T17:55:25.981977] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T17:55:25.985282] [INFO ] [REMOTE ] CB: Full fetch complete (72643 records). [2025-10-06T17:55:25.985438] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-06T17:55:26.402958] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-06T17:55:26.403083] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-06T17:55:26.404038] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-06T17:55:26.404120] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-06T17:55:26.412072] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-06T17:55:26.415575] [INFO ] [REMOTE ] CAVA: Full fetch complete (77304 records). [2025-10-06T17:55:26.415466] [DEBUG] [LOCAL ] CB: Trimmed 72643 records to 49941 (keeping 200 days of data) [2025-10-06T17:55:26.416114] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-06T17:55:26.941135] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-06T17:55:26.942295] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-06T17:55:26.945907] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-06T17:55:26.947682] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-06T17:55:26.953057] [DEBUG] [LOCAL ] CAVA: Trimmed 77304 records to 53556 (keeping 200 days of data) [2025-10-06T17:55:27.472036] [DEBUG] [LOCAL ] CAVA: Primary data saved (53556 records). [2025-10-06T17:55:27.477091] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-06T17:55:27.482338] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAVA took 35.4s. Estimated remaining: 4h 33m 45s. Rate: 7.2 symbols/min [2025-10-06T17:55:27.492933] [DEBUG] [LOCAL ] CB: Primary data saved (49941 records). [2025-10-06T17:55:27.493130] [INFO ] [MAIN ] CB: Full history saved. [2025-10-06T17:55:27.493237] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 30.9s. Estimated remaining: 4h 32m 56s. Rate: 7.2 symbols/min [2025-10-06T17:55:28.155483] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:55:28.126518] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:55:28.214568] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-06T17:55:28.235070] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:55:28.235349] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-06T17:55:28.202397] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:55:28.235552] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-06T17:55:28.237097] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-06T17:55:28.237219] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-06T17:55:28.237546] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-06T17:55:28.253859] [DEBUG] [LOCAL ] CBNA: Loaded 2938 existing records from primary storage. [2025-10-06T17:55:28.272482] [INFO ] [MAIN ] CBNA: Loaded 2938 existing records. [2025-10-06T17:55:28.441818] [DEBUG] [LOCAL ] CBL: Loaded 16471 existing records from primary storage. [2025-10-06T17:55:28.500153] [INFO ] [MAIN ] CBL: Loaded 16471 existing records. [2025-10-06T17:55:28.776210] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:55:28.832391] [DEBUG] [LOCAL ] CBRE: Loaded 51279 existing records from primary storage. [2025-10-06T17:55:28.826153] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-06T17:55:28.909168] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-06T17:55:28.909029] [INFO ] [MAIN ] CBRE: Loaded 51279 existing records. [2025-10-06T17:55:28.972807] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:55:29.046029] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-06T17:55:29.051278] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-06T17:55:29.040722] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-06T17:55:29.096663] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:55:29.107216] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-06T17:55:29.115741] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-06T17:55:29.112456] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-06T17:55:29.093609] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-06T17:55:29.352351] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:55:29.373706] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:55:29.385109] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-06T17:55:29.398598] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-06T17:55:29.412874] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:55:29.412935] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-06T17:55:29.423526] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-06T17:55:29.463291] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-06T17:55:29.429049] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:55:29.463479] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-06T17:55:29.520981] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-06T17:55:29.617212] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-06T17:55:29.669320] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-06T17:55:29.759283] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-06T17:55:29.776537] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 2.3s. Estimated remaining: 4h 32m 18s. Rate: 7.2 symbols/min [2025-10-06T17:55:30.224555] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:55:30.248839] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-06T17:55:30.351313] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:55:30.391415] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-06T17:55:30.430020] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:55:30.499252] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:55:30.499788] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-06T17:55:30.527389] [DEBUG] [LOCAL ] CBT: Loaded 31248 existing records from primary storage. [2025-10-06T17:55:30.527716] [INFO ] [MAIN ] CBT: Loaded 31248 existing records. [2025-10-06T17:55:30.701859] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:55:30.702140] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-06T17:55:30.702187] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-06T17:55:30.702459] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-06T17:55:30.702515] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-06T17:55:31.049225] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:55:31.049550] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-06T17:55:31.223880] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-06T17:55:31.225602] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-06T17:55:31.642104] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-06T17:55:31.644024] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-06T17:55:31.657140] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-06T17:55:31.661923] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-06T17:55:32.032085] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T17:55:32.042681] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-06T17:55:32.126635] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-06T17:55:32.128217] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-06T17:55:32.303605] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-06T17:55:32.554463] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T17:55:32.564963] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-06T17:55:32.625474] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-06T17:55:33.425538] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-06T17:55:33.513965] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T17:55:33.675431] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T17:55:33.839450] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-06T17:55:34.225538] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-06T17:55:35.025553] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-06T17:55:35.590377] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T17:55:35.591717] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T17:55:35.825554] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-06T17:55:36.625553] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-06T17:55:37.425495] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-06T17:55:37.539017] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T17:55:37.638153] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T17:55:38.225534] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-06T17:55:38.495556] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T17:55:39.025543] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-06T17:55:39.581635] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-06T17:55:39.825503] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-06T17:55:39.991694] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T17:55:40.626052] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-06T17:55:41.288057] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T17:55:41.425540] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-06T17:55:42.225510] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-06T17:55:42.579013] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T17:55:42.745997] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-06T17:55:42.890962] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T17:55:43.025560] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-06T17:55:43.825564] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-06T17:55:44.415570] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T17:55:44.625551] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-06T17:55:45.425509] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-06T17:55:45.620398] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T17:55:45.931351] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T17:55:45.989410] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T17:55:46.225559] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-06T17:55:47.025550] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-06T17:55:47.487032] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T17:55:47.496180] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-06T17:55:47.825572] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-06T17:55:48.285581] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T17:55:48.286388] [INFO ] [REMOTE ] CBNA: Full fetch complete (4551 records). [2025-10-06T17:55:48.286456] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-06T17:55:48.652232] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-06T17:55:48.740006] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-06T17:55:48.740114] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-06T17:55:48.740346] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-06T17:55:48.740389] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-06T17:55:48.740828] [DEBUG] [LOCAL ] CBNA: Trimmed 4551 records to 2906 (keeping 200 days of data) [2025-10-06T17:55:48.759262] [DEBUG] [LOCAL ] CBNA: Primary data saved (2906 records). [2025-10-06T17:55:48.759370] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-06T17:55:48.759490] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBNA took 21.3s. Estimated remaining: 4h 33m 2s. Rate: 7.2 symbols/min [2025-10-06T17:55:48.945124] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:55:48.974638] [DEBUG] [LOCAL ] CBU: Loaded 23000 existing records from primary storage. [2025-10-06T17:55:48.974980] [INFO ] [MAIN ] CBU: Loaded 23000 existing records. [2025-10-06T17:55:49.163466] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:55:49.163793] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-06T17:55:49.163849] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-06T17:55:49.164863] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-06T17:55:49.164928] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-06T17:55:49.430727] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-06T17:55:49.545348] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:55:50.225497] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-06T17:55:50.425813] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-06T17:55:50.569234] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T17:55:51.025611] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-06T17:55:51.402382] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T17:55:51.825501] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-06T17:55:52.000558] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T17:55:52.625605] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-06T17:55:52.920410] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T17:55:53.425626] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-06T17:55:54.225596] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-06T17:55:54.722718] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T17:55:54.819218] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-06T17:55:55.025580] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-06T17:55:55.082956] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T17:55:55.825566] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-06T17:55:56.625533] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-06T17:55:56.793769] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T17:55:57.083029] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T17:55:57.425612] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-06T17:55:57.452276] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-06T17:55:58.225575] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-06T17:55:58.668604] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T17:55:58.670627] [INFO ] [REMOTE ] CBT: Full fetch complete (45674 records). [2025-10-06T17:55:58.670752] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-06T17:55:59.030777] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-06T17:55:59.076159] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-06T17:55:59.076278] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-06T17:55:59.077689] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-06T17:55:59.077818] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-06T17:55:59.079429] [DEBUG] [LOCAL ] CBT: Trimmed 45674 records to 30746 (keeping 200 days of data) [2025-10-06T17:55:59.300601] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T17:55:59.311735] [DEBUG] [LOCAL ] CBT: Primary data saved (30746 records). [2025-10-06T17:55:59.311889] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-06T17:55:59.311985] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBT took 29.5s. Estimated remaining: 4h 33m 5s. Rate: 7.2 symbols/min [2025-10-06T17:55:59.484451] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:55:59.484739] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-06T17:55:59.484795] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-06T17:55:59.484943] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-06T17:55:59.484985] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-06T17:55:59.485027] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-06T17:55:59.485059] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-06T17:55:59.829681] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-06T17:55:59.858228] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:56:00.136870] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-06T17:56:00.625815] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-06T17:56:01.221114] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:56:01.221624] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-06T17:56:01.221790] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:56:01.222347] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-06T17:56:01.222730] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:56:01.222837] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-06T17:56:01.222977] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-06T17:56:01.223053] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-06T17:56:01.223126] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-06T17:56:01.223218] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBX took 1.9s. Estimated remaining: 4h 32m 25s. Rate: 7.2 symbols/min [2025-10-06T17:56:01.392796] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T17:56:01.425668] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-06T17:56:01.492094] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:56:01.535618] [DEBUG] [LOCAL ] CBZ: Loaded 34222 existing records from primary storage. [2025-10-06T17:56:01.536032] [INFO ] [MAIN ] CBZ: Loaded 34222 existing records. [2025-10-06T17:56:01.759033] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:56:01.759339] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-06T17:56:01.759390] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-06T17:56:01.760378] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-06T17:56:01.760456] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-06T17:56:02.150189] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:56:02.225552] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-06T17:56:02.445337] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T17:56:03.025552] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-06T17:56:03.825512] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-06T17:56:03.935189] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T17:56:04.262910] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T17:56:04.625717] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-06T17:56:05.201186] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T17:56:05.425584] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-06T17:56:06.212154] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T17:56:06.218759] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T17:56:06.218597] [INFO ] [REMOTE ] CBRE: Full fetch complete (73871 records). [2025-10-06T17:56:06.220077] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-06T17:56:06.220347] [INFO ] [REMOTE ] CBL: Full fetch complete (25454 records). [2025-10-06T17:56:06.220452] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-06T17:56:06.231977] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-06T17:56:06.945219] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-06T17:56:06.967689] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-06T17:56:06.977970] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-06T17:56:06.978061] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-06T17:56:07.016804] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-06T17:56:07.016966] [DEBUG] [LOCAL ] CBL: Trimmed 25454 records to 16311 (keeping 200 days of data) [2025-10-06T17:56:07.017079] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-06T17:56:07.018093] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-06T17:56:07.018174] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-06T17:56:07.061103] [DEBUG] [LOCAL ] CBRE: Trimmed 73871 records to 50483 (keeping 200 days of data) [2025-10-06T17:56:07.060876] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-06T17:56:07.221020] [DEBUG] [LOCAL ] CBL: Primary data saved (16311 records). [2025-10-06T17:56:07.221847] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-06T17:56:07.222303] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBL took 39.7s. Estimated remaining: 4h 32m 6s. Rate: 7.2 symbols/min [2025-10-06T17:56:07.418934] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:56:07.440607] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T17:56:07.610704] [DEBUG] [LOCAL ] CC: Loaded 53769 existing records from primary storage. [2025-10-06T17:56:07.614297] [INFO ] [MAIN ] CC: Loaded 53769 existing records. [2025-10-06T17:56:07.825884] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-06T17:56:07.860409] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:56:07.865001] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-06T17:56:07.866584] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-06T17:56:07.870000] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-06T17:56:07.870326] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-06T17:56:07.966113] [DEBUG] [LOCAL ] CBRE: Primary data saved (50483 records). [2025-10-06T17:56:07.980132] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-06T17:56:07.980511] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBRE took 40.5s. Estimated remaining: 4h 31m 21s. Rate: 7.2 symbols/min [2025-10-06T17:56:08.348385] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:56:08.440596] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:56:08.411078] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-06T17:56:08.496615] [DEBUG] [LOCAL ] CCI: Loaded 53918 existing records from primary storage. [2025-10-06T17:56:08.497110] [INFO ] [MAIN ] CCI: Loaded 53918 existing records. [2025-10-06T17:56:08.635419] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-06T17:56:08.678812] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:56:08.679198] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-06T17:56:08.679259] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-06T17:56:08.680887] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-06T17:56:08.680950] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-06T17:56:09.058095] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:56:09.073477] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T17:56:09.425512] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-06T17:56:10.225482] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-06T17:56:10.418719] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T17:56:11.025792] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-06T17:56:11.247778] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T17:56:11.533384] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-06T17:56:11.825546] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-06T17:56:12.391303] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T17:56:12.625576] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-06T17:56:13.083015] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T17:56:13.425577] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-06T17:56:14.225494] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-06T17:56:14.359166] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T17:56:14.619842] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T17:56:15.025584] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-06T17:56:15.825563] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-06T17:56:15.874461] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T17:56:15.940754] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T17:56:16.625541] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-06T17:56:17.425569] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-06T17:56:17.573533] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T17:56:17.575335] [INFO ] [REMOTE ] CBU: Full fetch complete (32395 records). [2025-10-06T17:56:17.575419] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-06T17:56:17.977159] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-06T17:56:17.977265] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-06T17:56:17.977812] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-06T17:56:17.977878] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-06T17:56:17.978848] [DEBUG] [LOCAL ] CBU: Trimmed 32395 records to 22556 (keeping 200 days of data) [2025-10-06T17:56:18.123439] [DEBUG] [LOCAL ] CBU: Primary data saved (22556 records). [2025-10-06T17:56:18.123673] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-06T17:56:18.123831] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBU took 29.4s. Estimated remaining: 4h 31m 21s. Rate: 7.2 symbols/min [2025-10-06T17:56:18.230209] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-06T17:56:18.334784] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:56:18.331477] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-06T17:56:18.335016] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-06T17:56:18.344398] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-06T17:56:18.344993] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-06T17:56:18.345102] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-06T17:56:18.345189] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-06T17:56:18.345251] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-06T17:56:18.699852] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:56:19.025528] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-06T17:56:19.313024] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T17:56:19.455212] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-06T17:56:19.527206] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T17:56:19.825554] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-06T17:56:20.625888] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-06T17:56:20.978026] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-06T17:56:21.425509] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-06T17:56:22.037992] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-06T17:56:22.225585] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-06T17:56:22.555865] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-06T17:56:23.025547] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-06T17:56:23.311581] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T17:56:23.825546] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-06T17:56:24.405804] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T17:56:24.625554] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-06T17:56:25.425557] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-06T17:56:25.766769] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-06T17:56:26.225538] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-06T17:56:26.391421] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T17:56:26.725085] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-06T17:56:27.025564] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-06T17:56:27.825507] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-06T17:56:28.147152] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T17:56:28.625543] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-06T17:56:28.762723] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T17:56:29.258846] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-06T17:56:29.281263] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T17:56:29.425539] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-06T17:56:30.225544] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-06T17:56:30.836421] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-06T17:56:30.868756] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T17:56:31.025538] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-06T17:56:31.825542] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-06T17:56:32.287283] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-06T17:56:32.625537] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-06T17:56:32.964826] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-06T17:56:33.055377] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-06T17:56:33.425562] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-06T17:56:33.775576] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-06T17:56:34.225540] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-06T17:56:35.025553] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-06T17:56:35.481480] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-06T17:56:35.825497] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-06T17:56:36.254465] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-06T17:56:36.290102] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-06T17:56:36.625532] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-06T17:56:37.425522] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-06T17:56:38.225525] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-06T17:56:38.674627] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-06T17:56:39.025554] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-06T17:56:39.095161] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T17:56:39.095995] [INFO ] [REMOTE ] CCIA: Full fetch complete (2092 records). [2025-10-06T17:56:39.096088] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-06T17:56:39.290785] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T17:56:39.291178] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:56:39.291259] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:56:39.291345] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-06T17:56:39.291542] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-06T17:56:39.291591] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-06T17:56:39.291686] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-06T17:56:39.291786] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CCIA took 21.2s. Estimated remaining: 4h 32m 15s. Rate: 7.2 symbols/min [2025-10-06T17:56:39.478253] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:56:39.516964] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-06T17:56:39.545147] [DEBUG] [LOCAL ] CCIF: Loaded 15916 existing records from primary storage. [2025-10-06T17:56:39.545520] [INFO ] [MAIN ] CCIF: Loaded 15916 existing records. [2025-10-06T17:56:39.737253] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:56:39.737545] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-06T17:56:39.737599] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-06T17:56:39.737949] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-06T17:56:39.738014] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-06T17:56:39.835535] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-06T17:56:40.129402] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:56:40.625526] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-06T17:56:40.832227] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-06T17:56:41.425537] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-06T17:56:41.596379] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T17:56:41.828019] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T17:56:42.225620] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-06T17:56:43.025606] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-06T17:56:43.044731] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-06T17:56:43.047458] [INFO ] [REMOTE ] CBZ: Full fetch complete (45712 records). [2025-10-06T17:56:43.047598] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-06T17:56:43.446312] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-06T17:56:43.446478] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-06T17:56:43.450421] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-06T17:56:43.450509] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-06T17:56:43.451996] [DEBUG] [LOCAL ] CBZ: Trimmed 45712 records to 33903 (keeping 200 days of data) [2025-10-06T17:56:43.676117] [DEBUG] [LOCAL ] CBZ: Primary data saved (33903 records). [2025-10-06T17:56:43.676324] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-06T17:56:43.676454] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CBZ took 42.5s. Estimated remaining: 4h 31m 48s. Rate: 7.2 symbols/min [2025-10-06T17:56:43.843496] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-06T17:56:43.870362] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:56:43.922742] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T17:56:43.948137] [DEBUG] [LOCAL ] CCJ: Loaded 54453 existing records from primary storage. [2025-10-06T17:56:43.948808] [INFO ] [MAIN ] CCJ: Loaded 54453 existing records. [2025-10-06T17:56:44.146026] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:56:44.146487] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-06T17:56:44.146563] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-06T17:56:44.159795] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-06T17:56:44.165052] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-06T17:56:44.303473] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-06T17:56:44.599721] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:56:44.625492] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-06T17:56:45.425540] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-06T17:56:45.964896] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-06T17:56:46.225570] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-06T17:56:46.504275] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-06T17:56:46.887594] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-06T17:56:47.025515] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-06T17:56:47.078215] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T17:56:47.825557] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-06T17:56:48.625511] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-06T17:56:49.226412] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-06T17:56:49.425534] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-06T17:56:49.595218] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-06T17:56:50.225505] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-06T17:56:50.667177] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (2.84 seconds). [2025-10-06T17:56:50.670777] [INFO ] [REMOTE ] CC: Full fetch complete (75670 records). [2025-10-06T17:56:50.670924] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-06T17:56:51.038405] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-06T17:56:51.118980] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-06T17:56:51.119149] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-06T17:56:51.120548] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-06T17:56:51.120691] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-06T17:56:51.122994] [DEBUG] [LOCAL ] CC: Trimmed 75670 records to 52991 (keeping 200 days of data) [2025-10-06T17:56:51.240591] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-06T17:56:51.246160] [INFO ] [REMOTE ] CCI: Full fetch complete (76994 records). [2025-10-06T17:56:51.246892] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-06T17:56:51.351557] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-06T17:56:51.799186] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-06T17:56:51.809436] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-06T17:56:51.837163] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-06T17:56:51.810797] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-06T17:56:51.839701] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-06T17:56:51.846146] [DEBUG] [LOCAL ] CCI: Trimmed 76994 records to 53139 (keeping 200 days of data) [2025-10-06T17:56:52.098273] [DEBUG] [LOCAL ] CC: Primary data saved (52991 records). [2025-10-06T17:56:52.099444] [INFO ] [MAIN ] CC: Full history saved. [2025-10-06T17:56:52.100509] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CC took 44.9s. Estimated remaining: 4h 31m 40s. Rate: 7.2 symbols/min [2025-10-06T17:56:52.384369] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:56:52.447864] [DEBUG] [LOCAL ] CCK: Loaded 46844 existing records from primary storage. [2025-10-06T17:56:52.453445] [INFO ] [MAIN ] CCK: Loaded 46844 existing records. [2025-10-06T17:56:52.719205] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:56:52.719733] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-06T17:56:52.719825] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-06T17:56:52.720275] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-06T17:56:52.720850] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-06T17:56:53.005235] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T17:56:53.039985] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-06T17:56:53.163752] [DEBUG] [LOCAL ] CCI: Primary data saved (53139 records). [2025-10-06T17:56:53.169404] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-06T17:56:53.180184] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCI took 45.2s. Estimated remaining: 4h 30m 57s. Rate: 7.2 symbols/min [2025-10-06T17:56:53.546398] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:56:53.547321] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-06T17:56:53.718523] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-06T17:56:53.720911] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:56:53.789882] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-10-06T17:56:53.790283] [INFO ] [MAIN ] CCL: Loaded 54580 existing records. [2025-10-06T17:56:54.013203] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:56:54.013784] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-06T17:56:54.014044] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-06T17:56:54.015957] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-06T17:56:54.016093] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-06T17:56:54.133712] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T17:56:54.231755] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-06T17:56:54.398381] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:56:55.025556] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-06T17:56:55.276869] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T17:56:55.825554] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-06T17:56:56.394433] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-06T17:56:56.625550] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-06T17:56:57.430675] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-06T17:56:57.459871] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-06T17:56:58.225500] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-06T17:56:58.453223] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T17:56:59.025503] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-06T17:56:59.209164] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (3.38 seconds). [2025-10-06T17:56:59.825543] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-06T17:56:59.903779] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-06T17:56:59.905673] [INFO ] [REMOTE ] CCIF: Full fetch complete (21900 records). [2025-10-06T17:56:59.905821] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-06T17:57:00.333876] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-06T17:57:00.334085] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-06T17:57:00.334923] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-06T17:57:00.335020] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-06T17:57:00.336470] [DEBUG] [LOCAL ] CCIF: Trimmed 21900 records to 15589 (keeping 200 days of data) [2025-10-06T17:57:00.433612] [DEBUG] [LOCAL ] CCIF: Primary data saved (15589 records). [2025-10-06T17:57:00.433893] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-06T17:57:00.434003] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCIF took 21.1s. Estimated remaining: 4h 30m 44s. Rate: 7.2 symbols/min [2025-10-06T17:57:00.618541] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:57:00.655030] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-06T17:57:00.667145] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-06T17:57:00.709976] [DEBUG] [LOCAL ] CCO: Loaded 48625 existing records from primary storage. [2025-10-06T17:57:00.710419] [INFO ] [MAIN ] CCO: Loaded 48625 existing records. [2025-10-06T17:57:00.908072] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:57:00.908934] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-06T17:57:00.920008] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-06T17:57:00.937838] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-06T17:57:00.937988] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-06T17:57:01.009466] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (4.38 seconds). [2025-10-06T17:57:01.336598] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:57:01.425512] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-06T17:57:01.612574] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T17:57:02.225570] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-06T17:57:02.966215] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-06T17:57:03.025594] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-06T17:57:03.542865] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-06T17:57:03.833685] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-06T17:57:03.840668] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T17:57:04.553194] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T17:57:04.625545] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-06T17:57:05.425590] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-06T17:57:05.914055] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-06T17:57:06.225576] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-06T17:57:06.406228] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-06T17:57:07.025534] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-06T17:57:07.205227] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-06T17:57:07.825493] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-06T17:57:07.989047] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T17:57:08.625561] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-06T17:57:09.133782] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T17:57:09.425553] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-06T17:57:09.466984] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-06T17:57:09.751358] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T17:57:10.225558] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-06T17:57:10.612940] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T17:57:11.025567] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-06T17:57:11.825542] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-06T17:57:12.630701] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-06T17:57:12.654595] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-06T17:57:12.774994] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T17:57:12.947222] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T17:57:13.425535] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-06T17:57:14.225543] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-06T17:57:14.695971] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-06T17:57:14.769117] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-06T17:57:15.025551] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-06T17:57:15.825506] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-06T17:57:16.637588] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-06T17:57:16.645505] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-06T17:57:16.726762] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T17:57:17.389060] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T17:57:17.425505] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-06T17:57:18.225546] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-06T17:57:18.932354] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-06T17:57:19.036176] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-06T17:57:19.044852] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T17:57:19.825539] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-06T17:57:20.351896] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-06T17:57:20.625503] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-06T17:57:20.714340] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T17:57:21.233378] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T17:57:21.425496] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-06T17:57:22.225570] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-06T17:57:22.959585] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T17:57:22.977051] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-06T17:57:23.025559] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-06T17:57:23.724456] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T17:57:23.727660] [INFO ] [REMOTE ] CCK: Full fetch complete (67602 records). [2025-10-06T17:57:23.727844] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-06T17:57:23.830669] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-06T17:57:24.155749] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-06T17:57:24.155869] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-06T17:57:24.156856] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-06T17:57:24.156927] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-06T17:57:24.158934] [DEBUG] [LOCAL ] CCK: Trimmed 67602 records to 46259 (keeping 200 days of data) [2025-10-06T17:57:24.465794] [DEBUG] [LOCAL ] CCK: Primary data saved (46259 records). [2025-10-06T17:57:24.466008] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-06T17:57:24.466953] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCK took 32.4s. Estimated remaining: 4h 31m 50s. Rate: 7.2 symbols/min [2025-10-06T17:57:24.629889] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-06T17:57:24.651906] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:57:24.665667] [DEBUG] [LOCAL ] CCRD: Loaded 9165 existing records from primary storage. [2025-10-06T17:57:24.665945] [INFO ] [MAIN ] CCRD: Loaded 9165 existing records. [2025-10-06T17:57:24.867883] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:57:24.868178] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-06T17:57:24.868230] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-06T17:57:24.868777] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-06T17:57:24.868837] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-06T17:57:25.268525] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:57:25.346899] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-06T17:57:25.425525] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-06T17:57:25.574810] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T17:57:26.225556] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-06T17:57:26.365578] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T17:57:27.030676] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-06T17:57:27.054912] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-06T17:57:27.705873] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T17:57:27.709208] [INFO ] [REMOTE ] CCO: Full fetch complete (66814 records). [2025-10-06T17:57:27.709388] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-06T17:57:27.827584] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-06T17:57:28.147052] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-06T17:57:28.147165] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-06T17:57:28.148126] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-06T17:57:28.148191] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-06T17:57:28.149953] [DEBUG] [LOCAL ] CCO: Trimmed 66814 records to 47991 (keeping 200 days of data) [2025-10-06T17:57:28.433128] [DEBUG] [LOCAL ] CCO: Primary data saved (47991 records). [2025-10-06T17:57:28.433297] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-06T17:57:28.433398] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCO took 28.0s. Estimated remaining: 4h 31m 21s. Rate: 7.2 symbols/min [2025-10-06T17:57:28.618468] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:57:28.625549] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-06T17:57:28.655850] [DEBUG] [LOCAL ] CCS: Loaded 30853 existing records from primary storage. [2025-10-06T17:57:28.656211] [INFO ] [MAIN ] CCS: Loaded 30853 existing records. [2025-10-06T17:57:28.843119] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:57:28.843404] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-06T17:57:28.843461] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-06T17:57:28.843885] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-06T17:57:28.843945] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-06T17:57:29.229554] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:57:29.316327] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-06T17:57:29.319828] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-06T17:57:29.319962] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-06T17:57:29.427092] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-06T17:57:29.539567] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T17:57:29.757412] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-06T17:57:29.757592] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-06T17:57:29.758751] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-06T17:57:29.758823] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-06T17:57:29.761114] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-10-06T17:57:30.109555] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-06T17:57:30.109782] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-06T17:57:30.109908] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCL took 36.9s. Estimated remaining: 4h 30m 42s. Rate: 7.2 symbols/min [2025-10-06T17:57:30.229739] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-06T17:57:30.250855] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-06T17:57:30.354794] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:57:30.382213] [DEBUG] [LOCAL ] CCU: Loaded 23444 existing records from primary storage. [2025-10-06T17:57:30.382569] [INFO ] [MAIN ] CCU: Loaded 23444 existing records. [2025-10-06T17:57:30.579403] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:57:30.579773] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-06T17:57:30.579828] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-06T17:57:30.580109] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-06T17:57:30.580169] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-06T17:57:30.866839] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-06T17:57:30.973381] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T17:57:31.001879] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:57:31.025477] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-06T17:57:31.825541] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-06T17:57:32.253468] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T17:57:32.387740] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-06T17:57:32.625534] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-06T17:57:33.425552] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-06T17:57:34.225531] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-06T17:57:34.786958] [DEBUG] [REMOTE ] CCU: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-06T17:57:34.787409] [WARN ] [REMOTE ] CCU: No data returned for month 2025-01 [2025-10-06T17:57:34.787504] [FATAL] [REMOTE ] CCU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:57:34.787597] [FATAL] [MAIN ] CCU: Failed to fetch primary data. [2025-10-06T17:57:34.787689] [WARN ] [MAIN ] CCU: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:57:34.787767] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-06T17:57:34.787842] [DEBUG] [LOCAL ] CCU: No primary data file found to delete. [2025-10-06T17:57:34.787879] [INFO ] [LOCAL ] CCU: Starting deletion of derivative data. [2025-10-06T17:57:34.788201] [DEBUG] [LOCAL ] CCU: Deleted derivative data file. [2025-10-06T17:57:34.788319] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCU took 4.7s. Estimated remaining: 4h 30m 16s. Rate: 7.2 symbols/min [2025-10-06T17:57:34.970331] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T17:57:35.007121] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:57:35.007616] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-06T17:57:35.007703] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-06T17:57:35.007836] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-06T17:57:35.007879] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-06T17:57:35.007920] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-06T17:57:35.007952] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-06T17:57:35.030638] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-06T17:57:35.147077] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-06T17:57:35.415523] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:57:35.741181] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-06T17:57:35.825544] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-06T17:57:36.625538] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-06T17:57:37.270605] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-06T17:57:37.290353] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T17:57:37.425489] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-06T17:57:38.225590] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-06T17:57:39.001340] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T17:57:39.025478] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-06T17:57:39.050426] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-06T17:57:39.825530] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-06T17:57:40.599806] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T17:57:40.625474] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-06T17:57:40.663878] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-06T17:57:41.425579] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-06T17:57:42.225564] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-06T17:57:42.245289] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T17:57:42.271844] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T17:57:43.025541] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-06T17:57:43.825534] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-06T17:57:43.938804] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-06T17:57:44.380428] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-06T17:57:44.384736] [INFO ] [REMOTE ] CCJ: Full fetch complete (77685 records). [2025-10-06T17:57:44.384987] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-06T17:57:44.627471] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-06T17:57:44.813360] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-06T17:57:44.813525] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-06T17:57:44.814926] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-06T17:57:44.815003] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-06T17:57:44.816947] [DEBUG] [LOCAL ] CCJ: Trimmed 77685 records to 53677 (keeping 200 days of data) [2025-10-06T17:57:45.045273] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T17:57:45.190452] [DEBUG] [LOCAL ] CCJ: Primary data saved (53677 records). [2025-10-06T17:57:45.190672] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-06T17:57:45.191733] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCJ took 1m 2s. Estimated remaining: 4h 30m 18s. Rate: 7.2 symbols/min [2025-10-06T17:57:45.405260] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:57:45.425700] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-06T17:57:45.493609] [DEBUG] [LOCAL ] CDE: Loaded 54422 existing records from primary storage. [2025-10-06T17:57:45.494277] [INFO ] [MAIN ] CDE: Loaded 54422 existing records. [2025-10-06T17:57:45.692695] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-06T17:57:45.692801] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T17:57:45.837712] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:57:45.838223] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-06T17:57:45.838312] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-06T17:57:45.840219] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-06T17:57:45.840312] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-06T17:57:46.230748] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-06T17:57:46.311102] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:57:46.788180] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-06T17:57:47.025537] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-06T17:57:47.629211] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T17:57:47.630563] [INFO ] [REMOTE ] CCRD: Full fetch complete (11837 records). [2025-10-06T17:57:47.630668] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-06T17:57:47.854109] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-06T17:57:48.052223] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-06T17:57:48.052321] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-06T17:57:48.052676] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-06T17:57:48.052738] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-06T17:57:48.053225] [DEBUG] [LOCAL ] CCRD: Trimmed 11837 records to 9159 (keeping 200 days of data) [2025-10-06T17:57:48.107327] [DEBUG] [LOCAL ] CCRD: Primary data saved (9159 records). [2025-10-06T17:57:48.107492] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-06T17:57:48.107581] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCRD took 23.6s. Estimated remaining: 4h 29m 45s. Rate: 7.2 symbols/min [2025-10-06T17:57:48.274626] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:57:48.288157] [DEBUG] [LOCAL ] CDLR: Loaded 10028 existing records from primary storage. [2025-10-06T17:57:48.288414] [INFO ] [MAIN ] CDLR: Loaded 10028 existing records. [2025-10-06T17:57:48.358751] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-06T17:57:48.468018] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:57:48.468259] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-06T17:57:48.468307] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-06T17:57:48.468543] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-06T17:57:48.468601] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-06T17:57:48.638816] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-06T17:57:48.821270] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:57:49.425549] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-06T17:57:50.225579] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-06T17:57:50.265526] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-06T17:57:50.461224] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-06T17:57:50.693314] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-06T17:57:51.025550] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-06T17:57:51.615997] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-06T17:57:51.825548] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-06T17:57:52.625580] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-06T17:57:53.425501] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-06T17:57:53.652661] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-06T17:57:53.714165] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T17:57:54.132676] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T17:57:54.225481] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-06T17:57:55.025490] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-06T17:57:55.257510] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:57:55.257925] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-06T17:57:55.258018] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:57:55.258104] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-06T17:57:55.258140] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:57:55.258187] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-06T17:57:55.258263] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-06T17:57:55.258343] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-06T17:57:55.258425] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-06T17:57:55.258498] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCZ took 20.5s. Estimated remaining: 4h 29m 31s. Rate: 7.2 symbols/min [2025-10-06T17:57:55.435450] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:57:55.463832] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T17:57:55.500843] [DEBUG] [LOCAL ] CDP: Loaded 43241 existing records from primary storage. [2025-10-06T17:57:55.501223] [INFO ] [MAIN ] CDP: Loaded 43241 existing records. [2025-10-06T17:57:55.676515] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:57:55.676782] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-06T17:57:55.676832] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-06T17:57:55.678169] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-06T17:57:55.678229] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-06T17:57:55.830402] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-06T17:57:56.040416] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:57:56.572209] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-06T17:57:56.625476] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-06T17:57:57.425521] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-06T17:57:58.225514] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-06T17:57:58.413551] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T17:57:58.621873] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-06T17:57:59.025632] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-06T17:57:59.571927] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T17:57:59.617069] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-06T17:57:59.825546] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-06T17:58:00.625567] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-06T17:58:00.809121] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T17:58:01.425544] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-06T17:58:01.879778] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T17:58:01.881783] [INFO ] [REMOTE ] CCS: Full fetch complete (44814 records). [2025-10-06T17:58:01.881913] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-06T17:58:01.882715] [FATAL] [VALIDATOR ] CCS: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:58:01.882818] [FATAL] [MAIN ] CCS: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:58:01.882860] [WARN ] [MAIN ] CCS: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:58:01.882903] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-06T17:58:01.882989] [DEBUG] [LOCAL ] CCS: No primary data file found to delete. [2025-10-06T17:58:01.883045] [INFO ] [LOCAL ] CCS: Starting deletion of derivative data. [2025-10-06T17:58:01.883267] [DEBUG] [LOCAL ] CCS: Deleted derivative data file. [2025-10-06T17:58:01.883391] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CCS took 33.4s. Estimated remaining: 4h 29m 15s. Rate: 7.2 symbols/min [2025-10-06T17:58:02.057109] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:58:02.082337] [DEBUG] [LOCAL ] CDRE: Loaded 25295 existing records from primary storage. [2025-10-06T17:58:02.082628] [INFO ] [MAIN ] CDRE: Loaded 25295 existing records. [2025-10-06T17:58:02.225842] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-06T17:58:02.261897] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:58:02.262218] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-06T17:58:02.262274] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-06T17:58:02.262998] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-06T17:58:02.263057] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-06T17:58:02.619977] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:58:03.025572] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-06T17:58:03.625377] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-06T17:58:03.825561] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-06T17:58:03.895500] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T17:58:04.344053] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-06T17:58:04.458006] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T17:58:04.625606] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-06T17:58:05.425517] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-06T17:58:05.476597] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-06T17:58:06.225712] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-06T17:58:07.025509] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-06T17:58:07.337165] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T17:58:07.357301] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-06T17:58:07.825556] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-06T17:58:08.625515] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-06T17:58:08.661483] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T17:58:08.835514] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T17:58:09.225517] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T17:58:09.425613] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-06T17:58:10.225493] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-06T17:58:10.599465] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-06T17:58:11.025549] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-06T17:58:11.116769] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-06T17:58:11.825528] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-06T17:58:12.527147] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T17:58:12.557992] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T17:58:12.559339] [INFO ] [REMOTE ] CDLR: Full fetch complete (13487 records). [2025-10-06T17:58:12.559409] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-06T17:58:12.630746] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-06T17:58:12.932507] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-06T17:58:12.932629] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-06T17:58:12.933049] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-06T17:58:12.933113] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-06T17:58:12.933683] [DEBUG] [LOCAL ] CDLR: Trimmed 13487 records to 9885 (keeping 200 days of data) [2025-10-06T17:58:12.995400] [DEBUG] [LOCAL ] CDLR: Primary data saved (9885 records). [2025-10-06T17:58:12.995584] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-06T17:58:12.995714] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDLR took 24.9s. Estimated remaining: 4h 29m 20s. Rate: 7.2 symbols/min [2025-10-06T17:58:13.166296] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:58:13.224914] [DEBUG] [LOCAL ] CE: Loaded 52243 existing records from primary storage. [2025-10-06T17:58:13.225356] [INFO ] [MAIN ] CE: Loaded 52243 existing records. [2025-10-06T17:58:13.415858] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:58:13.416133] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-06T17:58:13.416183] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-06T17:58:13.417749] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-06T17:58:13.417813] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-06T17:58:13.431116] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-06T17:58:13.801223] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:58:14.225521] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-06T17:58:14.507222] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T17:58:15.025637] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-06T17:58:15.689967] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-06T17:58:15.825554] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-06T17:58:16.197415] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-06T17:58:16.605177] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T17:58:16.625484] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-06T17:58:17.425595] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-06T17:58:17.467468] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T17:58:18.130603] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T17:58:18.225618] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-06T17:58:18.816356] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T17:58:19.025568] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-06T17:58:19.719618] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T17:58:19.825531] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-06T17:58:20.625562] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-06T17:58:20.730296] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T17:58:21.401113] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T17:58:21.425519] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-06T17:58:21.455880] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T17:58:22.225550] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-06T17:58:23.025565] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-06T17:58:23.253082] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T17:58:23.826215] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-06T17:58:23.988812] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T17:58:24.233208] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T17:58:24.625551] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-06T17:58:25.425517] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-06T17:58:25.658915] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T17:58:25.927300] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-06T17:58:26.225551] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-06T17:58:27.025543] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-06T17:58:27.229373] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T17:58:27.825561] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-06T17:58:28.347207] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-06T17:58:28.514799] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T17:58:28.625536] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-06T17:58:29.053402] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T17:58:29.425531] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-06T17:58:30.225554] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-06T17:58:31.025585] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-06T17:58:31.245081] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-06T17:58:31.382625] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-06T17:58:31.689761] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T17:58:31.692634] [INFO ] [REMOTE ] CDP: Full fetch complete (61927 records). [2025-10-06T17:58:31.692797] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-06T17:58:31.830634] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-06T17:58:32.103862] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-06T17:58:32.104098] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-06T17:58:32.105219] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-06T17:58:32.105303] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-06T17:58:32.120936] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T17:58:32.125879] [DEBUG] [LOCAL ] CDP: Trimmed 61927 records to 42655 (keeping 200 days of data) [2025-10-06T17:58:32.389976] [DEBUG] [LOCAL ] CDP: Primary data saved (42655 records). [2025-10-06T17:58:32.390150] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-06T17:58:32.390244] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDP took 37.1s. Estimated remaining: 4h 30m 3s. Rate: 7.2 symbols/min [2025-10-06T17:58:32.559502] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:58:32.567765] [DEBUG] [LOCAL ] CEE: Loaded 5980 existing records from primary storage. [2025-10-06T17:58:32.568039] [INFO ] [MAIN ] CEE: Loaded 5980 existing records. [2025-10-06T17:58:32.635443] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-06T17:58:32.753117] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:58:32.753411] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-06T17:58:32.753458] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-06T17:58:32.753864] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-06T17:58:32.753922] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-06T17:58:33.101157] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:58:33.425510] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-06T17:58:33.792134] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-06T17:58:34.225568] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-06T17:58:34.344833] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T17:58:34.346564] [INFO ] [REMOTE ] CDRE: Full fetch complete (35095 records). [2025-10-06T17:58:34.346661] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-06T17:58:34.721547] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-06T17:58:34.759237] [INFO ] [REMOTE ] CDE: Full fetch complete (77587 records). [2025-10-06T17:58:34.772920] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-06T17:58:34.773034] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-06T17:58:34.773671] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-06T17:58:34.773755] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-06T17:58:34.772763] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-06T17:58:34.774886] [DEBUG] [LOCAL ] CDRE: Trimmed 35095 records to 24654 (keeping 200 days of data) [2025-10-06T17:58:35.051197] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-06T17:58:35.310895] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-06T17:58:35.311335] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-06T17:58:35.312866] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-06T17:58:35.312974] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-06T17:58:35.318628] [DEBUG] [LOCAL ] CDE: Trimmed 77587 records to 53642 (keeping 200 days of data) [2025-10-06T17:58:35.477004] [DEBUG] [LOCAL ] CDRE: Primary data saved (24654 records). [2025-10-06T17:58:35.477843] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-06T17:58:35.478527] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CDRE took 33.6s. Estimated remaining: 4h 29m 31s. Rate: 7.2 symbols/min [2025-10-06T17:58:35.665008] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:58:35.788470] [DEBUG] [LOCAL ] CEPU: Loaded 26369 existing records from primary storage. [2025-10-06T17:58:35.790001] [INFO ] [MAIN ] CEPU: Loaded 26369 existing records. [2025-10-06T17:58:35.850142] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-06T17:58:35.879373] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-06T17:58:36.011304] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:58:36.017740] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-06T17:58:36.018160] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-06T17:58:36.020837] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-06T17:58:36.025575] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-06T17:58:36.316761] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-06T17:58:36.520365] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:58:36.533318] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-06T17:58:36.544497] [DEBUG] [LOCAL ] CDE: Primary data saved (53642 records). [2025-10-06T17:58:36.544829] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-06T17:58:36.545891] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDE took 51.4s. Estimated remaining: 4h 28m 49s. Rate: 7.2 symbols/min [2025-10-06T17:58:36.630675] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-06T17:58:36.725904] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:58:36.789105] [DEBUG] [LOCAL ] CF: Loaded 52917 existing records from primary storage. [2025-10-06T17:58:36.789554] [INFO ] [MAIN ] CF: Loaded 52917 existing records. [2025-10-06T17:58:36.990045] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:58:36.990303] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-06T17:58:36.990353] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-06T17:58:36.991012] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-06T17:58:36.991077] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-06T17:58:37.383096] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:58:37.425561] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-06T17:58:38.092043] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T17:58:38.225497] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-06T17:58:39.025557] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-06T17:58:39.273624] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T17:58:39.339788] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T17:58:39.825555] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-06T17:58:40.625493] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-06T17:58:40.806577] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T17:58:40.943046] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T17:58:41.425533] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-06T17:58:41.836332] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-06T17:58:42.225520] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-06T17:58:42.411979] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T17:58:43.025543] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-06T17:58:43.731453] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-06T17:58:43.825494] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-06T17:58:43.934021] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T17:58:44.466473] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-06T17:58:44.625546] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-06T17:58:45.425624] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-06T17:58:46.225598] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-06T17:58:46.458897] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T17:58:46.535572] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T17:58:47.025557] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-06T17:58:47.641010] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-06T17:58:47.825490] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-06T17:58:47.885316] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T17:58:48.625554] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-06T17:58:49.065330] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T17:58:49.078849] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-06T17:58:49.425542] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-06T17:58:50.129225] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-06T17:58:50.225587] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-06T17:58:50.794247] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-06T17:58:51.025566] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-06T17:58:51.825554] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-06T17:58:52.625505] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-06T17:58:52.909171] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T17:58:53.425530] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-06T17:58:53.738891] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T17:58:53.797916] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-06T17:58:53.918889] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-06T17:58:53.919778] [INFO ] [REMOTE ] CEE: Full fetch complete (10174 records). [2025-10-06T17:58:53.919857] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-06T17:58:54.230617] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-06T17:58:54.292460] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-06T17:58:54.292551] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-06T17:58:54.292828] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-06T17:58:54.292889] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-06T17:58:54.293309] [DEBUG] [LOCAL ] CEE: Trimmed 10174 records to 5673 (keeping 200 days of data) [2025-10-06T17:58:54.327401] [DEBUG] [LOCAL ] CEE: Primary data saved (5673 records). [2025-10-06T17:58:54.327531] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-06T17:58:54.327626] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CEE took 21.9s. Estimated remaining: 4h 29m 24s. Rate: 7.2 symbols/min [2025-10-06T17:58:54.493169] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:58:54.546135] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-10-06T17:58:54.546508] [INFO ] [MAIN ] CFG: Loaded 54404 existing records. [2025-10-06T17:58:54.726610] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:58:54.727164] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-06T17:58:54.727223] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-06T17:58:54.727742] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-06T17:58:54.727806] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-06T17:58:55.034470] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-06T17:58:55.123564] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:58:55.825567] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-06T17:58:56.093033] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T17:58:56.569076] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T17:58:56.572954] [INFO ] [REMOTE ] CE: Full fetch complete (74816 records). [2025-10-06T17:58:56.573255] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-06T17:58:56.631045] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-06T17:58:56.998112] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-06T17:58:56.998301] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-06T17:58:56.999347] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-06T17:58:56.999421] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-06T17:58:57.001141] [DEBUG] [LOCAL ] CE: Trimmed 74816 records to 51474 (keeping 200 days of data) [2025-10-06T17:58:57.330927] [DEBUG] [LOCAL ] CE: Primary data saved (51474 records). [2025-10-06T17:58:57.331107] [INFO ] [MAIN ] CE: Full history saved. [2025-10-06T17:58:57.332303] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CE took 44.3s. Estimated remaining: 4h 28m 52s. Rate: 7.2 symbols/min [2025-10-06T17:58:57.431406] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-06T17:58:57.508160] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:58:57.508503] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-06T17:58:57.508574] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-06T17:58:57.508858] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-06T17:58:57.508965] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-06T17:58:57.509072] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-06T17:58:57.509201] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-06T17:58:57.841238] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-06T17:58:57.931809] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:58:58.145290] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T17:58:58.225614] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-06T17:58:58.452367] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T17:58:58.452738] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-06T17:58:58.452836] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T17:58:58.452890] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-06T17:58:58.452962] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T17:58:58.453036] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-06T17:58:58.453108] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-06T17:58:58.453145] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-06T17:58:58.453202] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-06T17:58:58.453276] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CFND took 1.1s. Estimated remaining: 4h 28m 11s. Rate: 7.2 symbols/min [2025-10-06T17:58:58.647351] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T17:58:58.653551] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:58:58.708740] [DEBUG] [LOCAL ] CFR: Loaded 33593 existing records from primary storage. [2025-10-06T17:58:58.709153] [INFO ] [MAIN ] CFR: Loaded 33593 existing records. [2025-10-06T17:58:58.898222] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:58:58.898494] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-06T17:58:58.898547] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-06T17:58:58.898927] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-06T17:58:58.898989] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-06T17:58:59.030793] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-06T17:58:59.297239] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:58:59.825542] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-06T17:59:00.625598] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-06T17:59:01.228198] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-06T17:59:01.425502] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-06T17:59:01.493033] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T17:59:02.122163] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T17:59:02.225607] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-06T17:59:03.025585] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-06T17:59:03.167615] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-06T17:59:03.551903] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-06T17:59:03.825503] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-06T17:59:04.625514] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-06T17:59:04.776371] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T17:59:04.837381] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T17:59:05.425518] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-06T17:59:05.696757] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T17:59:06.225531] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-06T17:59:07.025489] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-06T17:59:07.167220] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T17:59:07.628992] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T17:59:07.825551] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-06T17:59:08.108665] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T17:59:08.110675] [INFO ] [REMOTE ] CEPU: Full fetch complete (39508 records). [2025-10-06T17:59:08.110782] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-06T17:59:08.478444] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-06T17:59:08.478562] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-06T17:59:08.479088] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-06T17:59:08.479163] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-06T17:59:08.480043] [DEBUG] [LOCAL ] CEPU: Trimmed 39508 records to 26006 (keeping 200 days of data) [2025-10-06T17:59:08.627093] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-06T17:59:08.627270] [DEBUG] [LOCAL ] CEPU: Primary data saved (26006 records). [2025-10-06T17:59:08.627680] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-06T17:59:08.628525] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CEPU took 33.1s. Estimated remaining: 4h 28m 11s. Rate: 7.2 symbols/min [2025-10-06T17:59:08.797722] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:59:08.836302] [DEBUG] [LOCAL ] CGAU: Loaded 43455 existing records from primary storage. [2025-10-06T17:59:08.836703] [INFO ] [MAIN ] CGAU: Loaded 43455 existing records. [2025-10-06T17:59:09.009286] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:59:09.009498] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-06T17:59:09.009547] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-06T17:59:09.010981] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-06T17:59:09.011041] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-06T17:59:09.358701] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:59:09.425485] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-06T17:59:09.679931] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T17:59:10.225608] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-06T17:59:10.630111] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-06T17:59:11.025568] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-06T17:59:11.102465] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T17:59:11.825526] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-06T17:59:12.010160] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T17:59:12.626018] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-06T17:59:12.628758] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T17:59:13.167313] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T17:59:13.425530] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-06T17:59:14.225594] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-06T17:59:14.410840] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T17:59:15.025540] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-06T17:59:15.153683] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T17:59:15.273045] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T17:59:15.825548] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-06T17:59:16.625501] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-06T17:59:16.906675] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T17:59:17.350675] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T17:59:17.425481] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-06T17:59:18.130932] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T17:59:18.225492] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-06T17:59:18.970068] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-06T17:59:19.025480] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-06T17:59:19.620070] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T17:59:19.825506] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-06T17:59:20.488298] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-06T17:59:20.625505] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-06T17:59:21.125545] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-06T17:59:21.425605] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-06T17:59:22.225534] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-06T17:59:22.597524] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-06T17:59:23.025551] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-06T17:59:23.068969] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T17:59:23.072079] [INFO ] [REMOTE ] CF: Full fetch complete (75287 records). [2025-10-06T17:59:23.072235] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-06T17:59:23.474188] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-06T17:59:23.474313] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-06T17:59:23.475223] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-06T17:59:23.475293] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-06T17:59:23.477113] [DEBUG] [LOCAL ] CF: Trimmed 75287 records to 52167 (keeping 200 days of data) [2025-10-06T17:59:23.722791] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T17:59:23.828131] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-06T17:59:23.835271] [DEBUG] [LOCAL ] CF: Primary data saved (52167 records). [2025-10-06T17:59:23.835546] [INFO ] [MAIN ] CF: Full history saved. [2025-10-06T17:59:23.836173] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CF took 47.3s. Estimated remaining: 4h 28m 34s. Rate: 7.2 symbols/min [2025-10-06T17:59:24.006783] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:59:24.011052] [DEBUG] [LOCAL ] CGV: Loaded 1411 existing records from primary storage. [2025-10-06T17:59:24.011208] [INFO ] [MAIN ] CGV: Loaded 1411 existing records. [2025-10-06T17:59:24.186242] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:59:24.186536] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-06T17:59:24.186586] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-06T17:59:24.186780] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-06T17:59:24.186838] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-06T17:59:24.538751] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:59:24.625496] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-06T17:59:24.802004] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T17:59:25.425545] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-06T17:59:25.670899] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T17:59:26.108915] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T17:59:26.225532] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-06T17:59:26.756073] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T17:59:27.025590] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-06T17:59:27.219263] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T17:59:27.825541] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-06T17:59:28.332932] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-06T17:59:28.625588] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-06T17:59:28.675190] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-06T17:59:28.678858] [INFO ] [REMOTE ] CFG: Full fetch complete (77576 records). [2025-10-06T17:59:28.679041] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-06T17:59:29.079439] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-06T17:59:29.108196] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-06T17:59:29.108312] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-06T17:59:29.109713] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-06T17:59:29.109873] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-06T17:59:29.112736] [DEBUG] [LOCAL ] CFG: Trimmed 77576 records to 53624 (keeping 200 days of data) [2025-10-06T17:59:29.427587] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-06T17:59:29.476775] [DEBUG] [LOCAL ] CFG: Primary data saved (53624 records). [2025-10-06T17:59:29.477010] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-06T17:59:29.477157] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CFG took 35.1s. Estimated remaining: 4h 28m 14s. Rate: 7.2 symbols/min [2025-10-06T17:59:29.663221] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:59:29.691142] [DEBUG] [LOCAL ] CHCT: Loaded 24161 existing records from primary storage. [2025-10-06T17:59:29.691486] [INFO ] [MAIN ] CHCT: Loaded 24161 existing records. [2025-10-06T17:59:29.871266] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:59:29.871597] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-06T17:59:29.871680] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-06T17:59:29.872813] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-06T17:59:29.872879] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-06T17:59:30.237333] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-06T17:59:30.258199] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:59:30.639846] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T17:59:31.025592] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-06T17:59:31.476114] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T17:59:31.478214] [INFO ] [REMOTE ] CFR: Full fetch complete (48306 records). [2025-10-06T17:59:31.478408] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-06T17:59:31.479260] [FATAL] [VALIDATOR ] CFR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T17:59:31.479349] [FATAL] [MAIN ] CFR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T17:59:31.479393] [WARN ] [MAIN ] CFR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T17:59:31.479433] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-06T17:59:31.479495] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-06T17:59:31.479530] [INFO ] [LOCAL ] CFR: Starting deletion of derivative data. [2025-10-06T17:59:31.479805] [DEBUG] [LOCAL ] CFR: Deleted derivative data file. [2025-10-06T17:59:31.480836] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CFR took 33.0s. Estimated remaining: 4h 27m 37s. Rate: 7.2 symbols/min [2025-10-06T17:59:31.670594] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:59:31.736857] [DEBUG] [LOCAL ] CHD: Loaded 52856 existing records from primary storage. [2025-10-06T17:59:31.737292] [INFO ] [MAIN ] CHD: Loaded 52856 existing records. [2025-10-06T17:59:31.830828] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-06T17:59:31.991192] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:59:31.991445] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-06T17:59:31.991496] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-06T17:59:31.992035] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-06T17:59:31.992095] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-06T17:59:32.387075] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:59:32.409369] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T17:59:32.625545] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-06T17:59:33.381384] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T17:59:33.425485] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-06T17:59:33.727241] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T17:59:34.225591] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-06T17:59:35.036030] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-06T17:59:35.042756] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T17:59:35.474557] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T17:59:35.825499] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-06T17:59:36.010392] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T17:59:36.625570] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-06T17:59:37.288546] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T17:59:37.291615] [INFO ] [REMOTE ] CGAU: Full fetch complete (61032 records). [2025-10-06T17:59:37.291740] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-06T17:59:37.431072] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-06T17:59:37.677109] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-06T17:59:37.677224] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-06T17:59:37.678009] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-06T17:59:37.678072] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-06T17:59:37.679434] [DEBUG] [LOCAL ] CGAU: Trimmed 61032 records to 42926 (keeping 200 days of data) [2025-10-06T17:59:37.910973] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-06T17:59:37.941795] [DEBUG] [LOCAL ] CGAU: Primary data saved (42926 records). [2025-10-06T17:59:37.941980] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-06T17:59:37.942076] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CGAU took 29.3s. Estimated remaining: 4h 27m 21s. Rate: 7.3 symbols/min [2025-10-06T17:59:38.116765] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:59:38.136348] [DEBUG] [LOCAL ] CHE: Loaded 15300 existing records from primary storage. [2025-10-06T17:59:38.136906] [INFO ] [MAIN ] CHE: Loaded 15300 existing records. [2025-10-06T17:59:38.234225] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-06T17:59:38.326821] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:59:38.327249] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-06T17:59:38.327351] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-06T17:59:38.328213] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-06T17:59:38.328297] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-06T17:59:38.467858] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-06T17:59:38.765587] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:59:39.025616] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-06T17:59:39.316401] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-06T17:59:39.825580] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-06T17:59:40.152432] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T17:59:40.182440] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-06T17:59:40.625545] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-06T17:59:41.425564] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-06T17:59:41.724411] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T17:59:41.724993] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-06T17:59:42.225558] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-06T17:59:43.025570] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-06T17:59:43.693421] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T17:59:43.825544] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-06T17:59:44.255180] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-06T17:59:44.594636] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T17:59:44.625479] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-06T17:59:45.060003] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T17:59:45.425529] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-06T17:59:45.882491] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-06T17:59:46.225562] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-06T17:59:47.025578] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-06T17:59:47.417414] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-06T17:59:47.418161] [INFO ] [REMOTE ] CGV: Full fetch complete (2277 records). [2025-10-06T17:59:47.418229] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-06T17:59:47.610106] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T17:59:47.820474] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-06T17:59:47.820583] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-06T17:59:47.820740] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-06T17:59:47.820806] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-06T17:59:47.821175] [DEBUG] [LOCAL ] CGV: Trimmed 2277 records to 1391 (keeping 200 days of data) [2025-10-06T17:59:47.829455] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-06T17:59:47.833506] [DEBUG] [LOCAL ] CGV: Primary data saved (1391 records). [2025-10-06T17:59:47.833611] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-06T17:59:47.833740] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGV took 24.0s. Estimated remaining: 4h 27m 20s. Rate: 7.2 symbols/min [2025-10-06T17:59:48.032723] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T17:59:48.083905] [DEBUG] [LOCAL ] CHGG: Loaded 48372 existing records from primary storage. [2025-10-06T17:59:48.084391] [INFO ] [MAIN ] CHGG: Loaded 48372 existing records. [2025-10-06T17:59:48.287421] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T17:59:48.288060] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-06T17:59:48.288127] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-06T17:59:48.289594] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-06T17:59:48.289694] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-06T17:59:48.633497] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-06T17:59:48.836825] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T17:59:49.425498] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-06T17:59:49.557988] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T17:59:49.861793] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-06T17:59:50.225544] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-06T17:59:51.025522] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-06T17:59:51.146348] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T17:59:51.825569] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-06T17:59:51.999096] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T17:59:52.061826] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T17:59:52.625555] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-06T17:59:52.862373] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T17:59:53.425542] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-06T17:59:53.477944] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T17:59:54.225589] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-06T17:59:55.025539] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-06T17:59:55.118663] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T17:59:55.170289] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T17:59:55.825561] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-06T17:59:56.625508] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-06T17:59:56.774853] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T17:59:57.187839] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-06T17:59:57.425536] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-06T17:59:58.225582] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-06T17:59:58.296127] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T17:59:58.755544] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T17:59:59.025555] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-06T17:59:59.317082] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T17:59:59.825548] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-06T18:00:00.625508] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-06T18:00:00.792186] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T18:00:00.838199] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T18:00:01.425544] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-06T18:00:02.225547] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-06T18:00:02.636904] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T18:00:03.026956] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-06T18:00:03.027188] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-06T18:00:03.825614] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-06T18:00:04.120974] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-06T18:00:04.509970] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T18:00:04.625543] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-06T18:00:05.425491] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-06T18:00:05.741524] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T18:00:05.891935] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-06T18:00:06.225576] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-06T18:00:06.552902] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T18:00:07.025582] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-06T18:00:07.825524] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-06T18:00:07.940839] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-06T18:00:07.980617] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T18:00:08.625538] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-06T18:00:09.425555] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-06T18:00:09.523568] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T18:00:09.706708] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-06T18:00:10.225566] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-06T18:00:10.869372] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T18:00:10.871203] [INFO ] [REMOTE ] CHCT: Full fetch complete (34880 records). [2025-10-06T18:00:10.871283] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-06T18:00:11.030639] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-06T18:00:11.268187] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-06T18:00:11.268263] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-06T18:00:11.269124] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-06T18:00:11.269212] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-06T18:00:11.270287] [DEBUG] [LOCAL ] CHCT: Trimmed 34880 records to 23818 (keeping 200 days of data) [2025-10-06T18:00:11.428241] [DEBUG] [LOCAL ] CHCT: Primary data saved (23818 records). [2025-10-06T18:00:11.428410] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-06T18:00:11.428513] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CHCT took 42.0s. Estimated remaining: 4h 28m 20s. Rate: 7.2 symbols/min [2025-10-06T18:00:11.615443] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:00:11.656417] [DEBUG] [LOCAL ] CHH: Loaded 32481 existing records from primary storage. [2025-10-06T18:00:11.656775] [INFO ] [MAIN ] CHH: Loaded 32481 existing records. [2025-10-06T18:00:11.837895] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-06T18:00:11.844343] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:00:11.845773] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-06T18:00:11.845836] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-06T18:00:11.846170] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-06T18:00:11.846238] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-06T18:00:12.241626] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:00:12.283272] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-06T18:00:12.625543] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-06T18:00:12.686131] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T18:00:12.689617] [INFO ] [REMOTE ] CHD: Full fetch complete (74433 records). [2025-10-06T18:00:12.689833] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-06T18:00:13.052041] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T18:00:13.093531] [INFO ] [REMOTE ] CHE: Full fetch complete (20168 records). [2025-10-06T18:00:13.114100] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-06T18:00:13.250243] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-06T18:00:13.255530] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-06T18:00:13.264335] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-06T18:00:13.270320] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-06T18:00:13.349288] [DEBUG] [LOCAL ] CHD: Trimmed 74433 records to 52192 (keeping 200 days of data) [2025-10-06T18:00:13.477083] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-06T18:00:13.701860] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-06T18:00:13.702524] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-06T18:00:13.703449] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-06T18:00:13.703835] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-06T18:00:13.706495] [DEBUG] [LOCAL ] CHE: Trimmed 20168 records to 15216 (keeping 200 days of data) [2025-10-06T18:00:13.942674] [DEBUG] [LOCAL ] CHE: Primary data saved (15216 records). [2025-10-06T18:00:13.943824] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-06T18:00:13.944254] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHE took 36.0s. Estimated remaining: 4h 27m 46s. Rate: 7.2 symbols/min [2025-10-06T18:00:14.146917] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:00:14.179314] [DEBUG] [LOCAL ] CHMI: Loaded 22168 existing records from primary storage. [2025-10-06T18:00:14.180142] [INFO ] [MAIN ] CHMI: Loaded 22168 existing records. [2025-10-06T18:00:14.440565] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:00:14.449606] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-06T18:00:14.450468] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-06T18:00:14.451170] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-06T18:00:14.451599] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-06T18:00:14.813962] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-06T18:00:14.823469] [DEBUG] [LOCAL ] CHD: Primary data saved (52192 records). [2025-10-06T18:00:14.837986] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-06T18:00:14.839567] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHD took 43.4s. Estimated remaining: 4h 27m 5s. Rate: 7.2 symbols/min [2025-10-06T18:00:14.862044] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-06T18:00:15.043998] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:00:15.044518] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-06T18:00:15.125261] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:00:15.146457] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T18:00:15.156039] [DEBUG] [LOCAL ] CHN: Loaded 4866 existing records from primary storage. [2025-10-06T18:00:15.156256] [INFO ] [MAIN ] CHN: Loaded 4866 existing records. [2025-10-06T18:00:15.348694] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:00:15.348955] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-06T18:00:15.349004] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-06T18:00:15.349194] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-06T18:00:15.349251] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-06T18:00:15.726344] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:00:15.825539] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-06T18:00:16.625584] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-06T18:00:16.645843] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T18:00:16.662360] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T18:00:16.704796] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T18:00:17.425515] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-06T18:00:17.692273] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T18:00:18.225531] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-06T18:00:19.025540] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-06T18:00:19.360167] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-06T18:00:19.705071] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T18:00:19.728403] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-06T18:00:19.825533] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-06T18:00:20.625541] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-06T18:00:21.099621] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T18:00:21.425538] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-06T18:00:21.754835] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T18:00:22.225530] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-06T18:00:22.622070] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T18:00:23.025533] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-06T18:00:23.825509] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-06T18:00:24.095774] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-06T18:00:24.099161] [INFO ] [REMOTE ] CHGG: Full fetch complete (70452 records). [2025-10-06T18:00:24.099334] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-06T18:00:24.400354] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-06T18:00:24.577462] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T18:00:24.577962] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-06T18:00:24.585954] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-06T18:00:24.587499] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-06T18:00:24.587603] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-06T18:00:24.589966] [DEBUG] [LOCAL ] CHGG: Trimmed 70452 records to 47811 (keeping 200 days of data) [2025-10-06T18:00:24.642883] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-06T18:00:24.906277] [DEBUG] [LOCAL ] CHGG: Primary data saved (47811 records). [2025-10-06T18:00:24.906514] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-06T18:00:24.907463] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHGG took 37.1s. Estimated remaining: 4h 27m 4s. Rate: 7.2 symbols/min [2025-10-06T18:00:25.116598] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-06T18:00:25.425561] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-06T18:00:26.225504] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-06T18:00:26.485612] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T18:00:27.025590] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-06T18:00:27.545554] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T18:00:27.739134] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-06T18:00:27.825533] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-06T18:00:28.625584] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-06T18:00:29.093792] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-06T18:00:29.108171] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-06T18:00:29.425498] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-06T18:00:29.935709] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-06T18:00:30.225585] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-06T18:00:30.578509] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-06T18:00:31.025612] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-06T18:00:31.825589] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-06T18:00:32.386159] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T18:00:32.584365] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-06T18:00:32.625495] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-06T18:00:33.249300] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-06T18:00:33.425526] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-06T18:00:33.907207] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T18:00:33.908208] [INFO ] [REMOTE ] CHN: Full fetch complete (7434 records). [2025-10-06T18:00:33.908283] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-06T18:00:34.238298] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-06T18:00:34.290174] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-06T18:00:34.290292] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-06T18:00:34.291043] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-06T18:00:34.291128] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-06T18:00:34.291945] [DEBUG] [LOCAL ] CHN: Trimmed 7434 records to 4779 (keeping 200 days of data) [2025-10-06T18:00:34.331003] [DEBUG] [LOCAL ] CHN: Primary data saved (4779 records). [2025-10-06T18:00:34.331207] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-06T18:00:34.331332] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHN took 19.5s. Estimated remaining: 4h 27m 1s. Rate: 7.2 symbols/min [2025-10-06T18:00:35.025624] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-06T18:00:35.637319] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T18:00:35.825565] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-06T18:00:36.302569] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T18:00:36.625595] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-06T18:00:36.732489] [DEBUG] [REMOTE ] CHH: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-06T18:00:36.732968] [WARN ] [REMOTE ] CHH: No data returned for month 2025-10 [2025-10-06T18:00:36.733057] [FATAL] [REMOTE ] CHH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:00:36.733147] [FATAL] [MAIN ] CHH: Failed to fetch primary data. [2025-10-06T18:00:36.733210] [WARN ] [MAIN ] CHH: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:00:36.733281] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-06T18:00:36.733352] [DEBUG] [LOCAL ] CHH: No primary data file found to delete. [2025-10-06T18:00:36.733390] [INFO ] [LOCAL ] CHH: Starting deletion of derivative data. [2025-10-06T18:00:36.733748] [DEBUG] [LOCAL ] CHH: Deleted derivative data file. [2025-10-06T18:00:36.733852] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHH took 25.3s. Estimated remaining: 4h 26m 27s. Rate: 7.3 symbols/min [2025-10-06T18:00:36.754631] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T18:00:37.425522] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-06T18:00:38.522914] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T18:00:38.527634] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-06T18:00:39.578402] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T18:00:39.583408] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-06T18:00:40.821337] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-06T18:00:40.829441] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-06T18:00:42.040013] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T18:00:42.044710] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-06T18:00:42.921234] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T18:00:42.926461] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-06T18:00:44.007925] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T18:00:44.009499] [INFO ] [REMOTE ] CHMI: Full fetch complete (31850 records). [2025-10-06T18:00:44.009624] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-06T18:00:44.398838] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-06T18:00:44.398934] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-06T18:00:44.399669] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-06T18:00:44.399733] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-06T18:00:44.400534] [DEBUG] [LOCAL ] CHMI: Trimmed 31850 records to 21649 (keeping 200 days of data) [2025-10-06T18:00:44.527339] [DEBUG] [LOCAL ] CHMI: Primary data saved (21649 records). [2025-10-06T18:00:44.527502] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-06T18:00:44.527589] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 30.6s. Estimated remaining: 4h 26m 16s. Rate: 7.3 symbols/min [2025-10-06T18:00:45.195106] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:00:45.211742] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:00:45.233284] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:00:45.268252] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:00:45.291567] [DEBUG] [LOCAL ] CHT: Loaded 19918 existing records from primary storage. [2025-10-06T18:00:45.291952] [INFO ] [MAIN ] CHT: Loaded 19918 existing records. [2025-10-06T18:00:45.553722] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:00:45.557437] [DEBUG] [LOCAL ] CHPT: Loaded 49254 existing records from primary storage. [2025-10-06T18:00:45.555621] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-10-06T18:00:45.557757] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-06T18:00:45.558009] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-06T18:00:45.558208] [INFO ] [MAIN ] CHPT: Loaded 49254 existing records. [2025-10-06T18:00:45.570414] [INFO ] [MAIN ] CHWY: Loaded 54434 existing records. [2025-10-06T18:00:45.601663] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-06T18:00:45.640897] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-06T18:00:45.813137] [DEBUG] [LOCAL ] CI: Loaded 50475 existing records from primary storage. [2025-10-06T18:00:45.878720] [INFO ] [MAIN ] CI: Loaded 50475 existing records. [2025-10-06T18:00:46.127440] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:00:46.167822] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-06T18:00:46.198695] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-06T18:00:46.192918] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:00:46.225028] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-06T18:00:46.262193] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-06T18:00:46.256896] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-06T18:00:46.292242] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-06T18:00:46.360062] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-06T18:00:46.387466] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-06T18:00:46.575767] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:00:46.641970] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-06T18:00:46.647231] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-06T18:00:46.746630] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-06T18:00:46.760697] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-06T18:00:47.048729] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:00:47.114960] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-06T18:00:47.285499] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:00:47.296293] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-06T18:00:47.589759] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:00:47.600132] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-06T18:00:47.678565] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:00:47.678896] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-06T18:00:48.475547] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T18:00:48.479597] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-06T18:00:49.484594] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-06T18:00:49.488414] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-06T18:00:49.586740] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T18:00:49.597531] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-06T18:00:49.807522] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-06T18:00:49.818600] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-06T18:00:49.918627] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-06T18:00:49.929619] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-06T18:00:50.439883] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T18:00:50.443973] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-06T18:00:51.412766] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T18:00:51.423078] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-06T18:00:51.456414] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-06T18:00:51.461500] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-06T18:00:51.923966] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-06T18:00:51.935262] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-06T18:00:52.033969] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-06T18:00:52.625504] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-06T18:00:52.692331] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T18:00:53.045512] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T18:00:53.425595] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-06T18:00:53.538699] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T18:00:54.225639] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-06T18:00:54.820960] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-06T18:00:55.025558] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-06T18:00:55.256603] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T18:00:55.820030] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T18:00:55.830827] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-06T18:00:55.851857] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T18:00:56.625544] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-06T18:00:57.425492] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-06T18:00:57.895426] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-06T18:00:58.225535] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-06T18:00:58.431027] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T18:00:58.691452] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-06T18:00:59.025707] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-06T18:00:59.825507] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-06T18:00:59.947406] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T18:01:00.169049] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T18:01:00.625532] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-06T18:01:01.425598] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-06T18:01:01.944072] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T18:01:02.130547] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-06T18:01:02.225531] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-06T18:01:03.025531] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-06T18:01:03.249428] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T18:01:03.731589] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-06T18:01:03.825548] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-06T18:01:04.447033] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-06T18:01:04.625479] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-06T18:01:05.425527] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-06T18:01:06.008558] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-06T18:01:06.225556] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-06T18:01:06.929450] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-06T18:01:07.031890] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-06T18:01:07.040801] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T18:01:07.825553] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-06T18:01:08.202191] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-06T18:01:08.625545] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-06T18:01:08.810485] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-06T18:01:08.812201] [INFO ] [REMOTE ] CHT: Full fetch complete (27533 records). [2025-10-06T18:01:08.812280] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-06T18:01:09.198887] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-06T18:01:09.199078] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-06T18:01:09.199783] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-06T18:01:09.199906] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-06T18:01:09.201009] [DEBUG] [LOCAL ] CHT: Trimmed 27533 records to 19553 (keeping 200 days of data) [2025-10-06T18:01:09.322785] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-06T18:01:09.369340] [DEBUG] [LOCAL ] CHT: Primary data saved (19553 records). [2025-10-06T18:01:09.369567] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-06T18:01:09.369700] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHT took 24.8s. Estimated remaining: 4h 27m 21s. Rate: 7.2 symbols/min [2025-10-06T18:01:09.432285] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-06T18:01:09.542031] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:01:09.542268] [DEBUG] [LOCAL ] CIA: No existing data file found in primary storage. [2025-10-06T18:01:09.542307] [WARN ] [MAIN ] CIA: No existing data found, performing full refresh instead. [2025-10-06T18:01:09.542427] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-06T18:01:09.542470] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-06T18:01:09.542512] [DEBUG] [LOCAL ] CIA: No primary data file found to delete. [2025-10-06T18:01:09.542543] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-06T18:01:09.896070] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:01:10.225594] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-06T18:01:10.336372] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T18:01:11.025592] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-06T18:01:11.770568] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-06T18:01:11.825476] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-06T18:01:12.019586] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T18:01:12.595543] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T18:01:12.625471] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-06T18:01:13.289069] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T18:01:13.425522] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-06T18:01:14.225524] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-06T18:01:14.745411] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-06T18:01:15.025498] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-06T18:01:15.049082] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T18:01:15.825500] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-06T18:01:16.035434] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T18:01:16.065704] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T18:01:16.625583] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-06T18:01:17.280426] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T18:01:17.283451] [INFO ] [REMOTE ] CI: Full fetch complete (72346 records). [2025-10-06T18:01:17.283569] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-06T18:01:17.437741] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-06T18:01:17.748465] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-06T18:01:17.748581] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-06T18:01:17.749675] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-06T18:01:17.749753] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-06T18:01:17.751529] [DEBUG] [LOCAL ] CI: Trimmed 72346 records to 49801 (keeping 200 days of data) [2025-10-06T18:01:17.863624] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-06T18:01:17.869232] [INFO ] [REMOTE ] CHWY: Full fetch complete (77632 records). [2025-10-06T18:01:17.869870] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-06T18:01:18.225844] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-06T18:01:18.308482] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-06T18:01:18.311482] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-06T18:01:18.315969] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-06T18:01:18.317251] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-06T18:01:18.324300] [DEBUG] [LOCAL ] CHWY: Trimmed 77632 records to 53654 (keeping 200 days of data) [2025-10-06T18:01:18.734237] [DEBUG] [LOCAL ] CI: Primary data saved (49801 records). [2025-10-06T18:01:18.734909] [INFO ] [MAIN ] CI: Full history saved. [2025-10-06T18:01:18.736167] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CI took 34.2s. Estimated remaining: 4h 27m 17s. Rate: 7.2 symbols/min [2025-10-06T18:01:18.976061] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:01:19.016948] [DEBUG] [LOCAL ] CIB: Loaded 31243 existing records from primary storage. [2025-10-06T18:01:19.019445] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-10-06T18:01:19.019550] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-06T18:01:19.019694] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CHWY took 34.5s. Estimated remaining: 4h 26m 34s. Rate: 7.2 symbols/min [2025-10-06T18:01:19.019366] [INFO ] [MAIN ] CIB: Loaded 31243 existing records. [2025-10-06T18:01:19.193049] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-06T18:01:19.269532] [INFO ] [REMOTE ] CHPT: Full fetch complete (72472 records). [2025-10-06T18:01:19.295206] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-06T18:01:19.372733] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:01:19.424840] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-06T18:01:19.412977] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:01:19.407181] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T18:01:19.435184] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-06T18:01:19.445513] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-06T18:01:19.455977] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-06T18:01:19.470496] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-06T18:01:19.487731] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-06T18:01:19.487341] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-06T18:01:19.493053] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-06T18:01:19.500139] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-06T18:01:19.505430] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-06T18:01:19.521452] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-06T18:01:20.454815] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:01:20.456839] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-06T18:01:20.507235] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T18:01:20.512973] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-06T18:01:20.551476] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-06T18:01:20.562786] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-06T18:01:20.572156] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-06T18:01:20.594254] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:01:20.595005] [DEBUG] [LOCAL ] CHPT: Trimmed 72472 records to 48378 (keeping 200 days of data) [2025-10-06T18:01:20.650701] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-06T18:01:20.891596] [DEBUG] [LOCAL ] CHPT: Primary data saved (48378 records). [2025-10-06T18:01:20.891871] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-06T18:01:20.892635] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHPT took 36.4s. Estimated remaining: 4h 25m 58s. Rate: 7.2 symbols/min [2025-10-06T18:01:21.060709] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:01:21.115475] [DEBUG] [LOCAL ] CIEN: Loaded 52838 existing records from primary storage. [2025-10-06T18:01:21.115901] [INFO ] [MAIN ] CIEN: Loaded 52838 existing records. [2025-10-06T18:01:21.291595] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:01:21.291837] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-06T18:01:21.291887] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-06T18:01:21.292140] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-06T18:01:21.292198] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-06T18:01:21.430825] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-06T18:01:21.671262] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:01:21.672473] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T18:01:21.689686] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T18:01:22.097728] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-06T18:01:22.225607] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-06T18:01:23.025549] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-06T18:01:23.642731] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T18:01:23.825518] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-06T18:01:24.288045] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-06T18:01:24.625559] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-06T18:01:24.849723] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T18:01:25.425528] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-06T18:01:25.738977] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T18:01:26.225621] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-06T18:01:27.025539] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-06T18:01:27.189507] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T18:01:27.626841] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T18:01:27.646737] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T18:01:27.825550] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-06T18:01:28.249702] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-06T18:01:28.625552] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-06T18:01:29.425486] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-06T18:01:29.758316] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-06T18:01:30.225695] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-06T18:01:30.930237] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T18:01:31.025541] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-06T18:01:31.178076] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T18:01:31.368210] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-06T18:01:31.825533] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-06T18:01:32.346058] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-06T18:01:32.625535] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-06T18:01:33.425640] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-06T18:01:33.766789] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T18:01:34.225552] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-06T18:01:34.648839] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-06T18:01:35.025501] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-06T18:01:35.064985] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T18:01:35.825500] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-06T18:01:36.625568] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-06T18:01:36.948456] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-06T18:01:37.299481] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T18:01:37.425557] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-06T18:01:37.693241] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-06T18:01:38.225535] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-06T18:01:38.571013] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-06T18:01:38.703194] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-06T18:01:39.025552] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-06T18:01:39.375923] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-06T18:01:39.825550] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-06T18:01:40.625566] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-06T18:01:41.425542] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-06T18:01:41.523014] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T18:01:41.940053] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T18:01:42.225539] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-06T18:01:42.434834] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-06T18:01:43.025555] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-06T18:01:43.825552] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-06T18:01:43.937630] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T18:01:44.014281] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T18:01:44.308010] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T18:01:44.308751] [INFO ] [REMOTE ] CICB: Full fetch complete (2034 records). [2025-10-06T18:01:44.308856] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-06T18:01:44.489589] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-06T18:01:44.489961] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:01:44.490734] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:01:44.490828] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-06T18:01:44.490923] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-06T18:01:44.490962] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-06T18:01:44.491003] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-06T18:01:44.491071] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CICB took 25.5s. Estimated remaining: 4h 26m 56s. Rate: 7.2 symbols/min [2025-10-06T18:01:44.630762] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-06T18:01:44.682510] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:01:44.692164] [DEBUG] [LOCAL ] CIF: Loaded 4246 existing records from primary storage. [2025-10-06T18:01:44.693140] [INFO ] [MAIN ] CIF: Loaded 4246 existing records. [2025-10-06T18:01:44.875989] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:01:44.876256] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-06T18:01:44.876306] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-06T18:01:44.876518] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-06T18:01:44.876576] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-06T18:01:45.232047] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:01:45.425628] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-06T18:01:46.225496] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-06T18:01:46.374796] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T18:01:46.376288] [INFO ] [REMOTE ] CIA: Full fetch complete (23524 records). [2025-10-06T18:01:46.376367] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-06T18:01:46.769672] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-06T18:01:46.778777] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-06T18:01:46.789523] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-06T18:01:46.789703] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-06T18:01:46.792114] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-06T18:01:46.802776] [DEBUG] [LOCAL ] CIA: Trimmed 23524 records to 16872 (keeping 200 days of data) [2025-10-06T18:01:46.883041] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-06T18:01:46.903286] [DEBUG] [LOCAL ] CIA: Primary data saved (16872 records). [2025-10-06T18:01:46.903411] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-06T18:01:46.903495] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CIA took 37.5s. Estimated remaining: 4h 26m 22s. Rate: 7.2 symbols/min [2025-10-06T18:01:47.040497] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-06T18:01:47.075105] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:01:47.120946] [DEBUG] [LOCAL ] CIG: Loaded 44526 existing records from primary storage. [2025-10-06T18:01:47.121325] [INFO ] [MAIN ] CIG: Loaded 44526 existing records. [2025-10-06T18:01:47.341939] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:01:47.342223] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-06T18:01:47.342315] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-06T18:01:47.342707] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-06T18:01:47.342777] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-06T18:01:47.706699] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:01:47.707033] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-06T18:01:47.825560] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-06T18:01:48.625608] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-06T18:01:49.425513] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-06T18:01:49.680896] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T18:01:50.062254] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-06T18:01:50.158715] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T18:01:50.225491] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-06T18:01:51.025546] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-06T18:01:51.583126] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T18:01:51.825546] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-06T18:01:52.410723] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T18:01:52.625554] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-06T18:01:53.347418] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T18:01:53.425568] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-06T18:01:53.953213] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T18:01:54.225567] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-06T18:01:54.926099] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-06T18:01:55.006143] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T18:01:55.025483] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-06T18:01:55.825550] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-06T18:01:56.625513] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-06T18:01:56.744630] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T18:01:57.070875] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-06T18:01:57.425577] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-06T18:01:58.095879] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-06T18:01:58.225527] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-06T18:01:59.025558] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-06T18:01:59.402802] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T18:01:59.404850] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-06T18:01:59.419388] [INFO ] [REMOTE ] CIB: Full fetch complete (44590 records). [2025-10-06T18:01:59.419614] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-06T18:01:59.822472] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-06T18:01:59.822588] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-06T18:01:59.823264] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-06T18:01:59.823334] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-06T18:01:59.824534] [DEBUG] [LOCAL ] CIB: Trimmed 44590 records to 30791 (keeping 200 days of data) [2025-10-06T18:01:59.825603] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-06T18:02:00.028465] [DEBUG] [LOCAL ] CIB: Primary data saved (30791 records). [2025-10-06T18:02:00.028621] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-06T18:02:00.028749] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIB took 41.3s. Estimated remaining: 4h 26m 34s. Rate: 7.2 symbols/min [2025-10-06T18:02:00.201985] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:02:00.220034] [DEBUG] [LOCAL ] CII: Loaded 15458 existing records from primary storage. [2025-10-06T18:02:00.220369] [INFO ] [MAIN ] CII: Loaded 15458 existing records. [2025-10-06T18:02:00.401816] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:02:00.402073] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-06T18:02:00.402125] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-06T18:02:00.402354] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-06T18:02:00.402394] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-06T18:02:00.626763] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-06T18:02:00.783092] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T18:02:00.825263] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:02:01.425606] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-06T18:02:01.692515] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-06T18:02:01.695307] [INFO ] [REMOTE ] CIEN: Full fetch complete (75178 records). [2025-10-06T18:02:01.695564] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-06T18:02:01.696692] [FATAL] [VALIDATOR ] CIEN: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:02:01.696825] [FATAL] [MAIN ] CIEN: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:02:01.696869] [WARN ] [MAIN ] CIEN: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:02:01.696910] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-06T18:02:01.696991] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-06T18:02:01.697070] [INFO ] [LOCAL ] CIEN: Starting deletion of derivative data. [2025-10-06T18:02:01.697446] [DEBUG] [LOCAL ] CIEN: Deleted derivative data file. [2025-10-06T18:02:01.698018] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIEN took 40.8s. Estimated remaining: 4h 25m 57s. Rate: 7.2 symbols/min [2025-10-06T18:02:01.880893] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:02:01.924898] [DEBUG] [LOCAL ] CIM: Loaded 38123 existing records from primary storage. [2025-10-06T18:02:01.925245] [INFO ] [MAIN ] CIM: Loaded 38123 existing records. [2025-10-06T18:02:02.112313] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:02:02.112548] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-06T18:02:02.112595] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-06T18:02:02.113183] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-06T18:02:02.113244] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-06T18:02:02.231124] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-06T18:02:02.490612] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:02:02.623404] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-06T18:02:03.025506] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-06T18:02:03.825506] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-06T18:02:03.940948] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T18:02:03.982459] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T18:02:04.625606] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-06T18:02:05.313821] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T18:02:05.386628] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (4.76 seconds). [2025-10-06T18:02:05.425492] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-06T18:02:05.544490] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T18:02:05.972385] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-06T18:02:06.225496] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-06T18:02:07.025603] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-06T18:02:07.445576] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-06T18:02:07.825510] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-06T18:02:07.904053] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T18:02:08.497720] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-06T18:02:08.625611] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-06T18:02:09.235418] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T18:02:09.425524] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-06T18:02:10.090567] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T18:02:10.225560] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-06T18:02:11.025548] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-06T18:02:11.665234] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T18:02:11.825531] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-06T18:02:12.631534] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-06T18:02:12.638679] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T18:02:13.194617] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T18:02:13.425543] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-06T18:02:13.463931] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-06T18:02:14.225535] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-06T18:02:15.028329] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-06T18:02:15.041631] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T18:02:15.426176] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T18:02:15.825549] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-06T18:02:16.311470] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T18:02:16.625503] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-06T18:02:16.713454] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T18:02:17.425555] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-06T18:02:18.040008] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T18:02:18.042980] [INFO ] [REMOTE ] CIG: Full fetch complete (61261 records). [2025-10-06T18:02:18.043118] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-06T18:02:18.227006] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-06T18:02:18.434990] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-06T18:02:18.435102] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-06T18:02:18.435878] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-06T18:02:18.435941] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-06T18:02:18.437297] [DEBUG] [LOCAL ] CIG: Trimmed 61261 records to 43776 (keeping 200 days of data) [2025-10-06T18:02:18.683172] [DEBUG] [LOCAL ] CIG: Primary data saved (43776 records). [2025-10-06T18:02:18.683341] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-06T18:02:18.684598] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIG took 31.8s. Estimated remaining: 4h 26m 26s. Rate: 7.2 symbols/min [2025-10-06T18:02:18.857973] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:02:18.863886] [DEBUG] [LOCAL ] CIMN: Loaded 2714 existing records from primary storage. [2025-10-06T18:02:18.864102] [INFO ] [MAIN ] CIMN: Loaded 2714 existing records. [2025-10-06T18:02:19.047583] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-06T18:02:19.053703] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:02:19.054852] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-06T18:02:19.054942] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-06T18:02:19.055388] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-06T18:02:19.055558] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-06T18:02:19.173168] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T18:02:19.251381] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T18:02:19.466339] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:02:19.730076] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-06T18:02:19.730917] [INFO ] [REMOTE ] CIF: Full fetch complete (6604 records). [2025-10-06T18:02:19.730988] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-06T18:02:19.829760] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-06T18:02:20.095463] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-06T18:02:20.095551] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-06T18:02:20.095769] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-06T18:02:20.095831] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-06T18:02:20.096217] [DEBUG] [LOCAL ] CIF: Trimmed 6604 records to 4156 (keeping 200 days of data) [2025-10-06T18:02:20.120457] [DEBUG] [LOCAL ] CIF: Primary data saved (4156 records). [2025-10-06T18:02:20.120533] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-06T18:02:20.120609] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CIF took 35.6s. Estimated remaining: 4h 25m 49s. Rate: 7.2 symbols/min [2025-10-06T18:02:20.290431] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:02:20.290683] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-06T18:02:20.290740] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-06T18:02:20.290854] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-06T18:02:20.290897] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-06T18:02:20.290939] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-06T18:02:20.291002] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-06T18:02:20.576847] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-06T18:02:20.636198] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-06T18:02:20.658860] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:02:21.425516] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-06T18:02:22.116371] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-06T18:02:22.139223] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T18:02:22.225568] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-06T18:02:22.747758] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-06T18:02:23.025571] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-06T18:02:23.825545] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-06T18:02:24.436931] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T18:02:24.625531] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-06T18:02:24.667352] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-06T18:02:25.425596] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-06T18:02:25.896364] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-06T18:02:26.093471] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T18:02:26.225517] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-06T18:02:27.025515] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-06T18:02:27.321310] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T18:02:27.491627] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-06T18:02:27.825555] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-06T18:02:28.625589] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-06T18:02:29.119396] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-06T18:02:29.332526] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T18:02:29.425615] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-06T18:02:30.225483] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-06T18:02:30.306391] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T18:02:30.948211] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-06T18:02:31.025577] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-06T18:02:31.450911] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-06T18:02:31.825554] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-06T18:02:32.352883] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-06T18:02:32.625560] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-06T18:02:33.425552] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-06T18:02:33.612923] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T18:02:33.796062] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-06T18:02:34.225535] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-06T18:02:34.680496] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-06T18:02:35.025560] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-06T18:02:35.458430] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-06T18:02:35.825574] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-06T18:02:36.625538] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-06T18:02:37.335636] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T18:02:37.425563] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-06T18:02:37.631267] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T18:02:37.633169] [INFO ] [REMOTE ] CII: Full fetch complete (22984 records). [2025-10-06T18:02:37.633266] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-06T18:02:38.005978] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-06T18:02:38.006066] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-06T18:02:38.006445] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-06T18:02:38.006484] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-06T18:02:38.007151] [DEBUG] [LOCAL ] CII: Trimmed 22984 records to 15166 (keeping 200 days of data) [2025-10-06T18:02:38.078367] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-06T18:02:38.106169] [DEBUG] [LOCAL ] CII: Primary data saved (15166 records). [2025-10-06T18:02:38.106279] [INFO ] [MAIN ] CII: Full history saved. [2025-10-06T18:02:38.106356] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CII took 38.1s. Estimated remaining: 4h 26m 21s. Rate: 7.2 symbols/min [2025-10-06T18:02:38.230729] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-06T18:02:38.279615] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:02:38.279799] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-06T18:02:38.279854] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-06T18:02:38.279964] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-06T18:02:38.280005] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-06T18:02:38.280045] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-06T18:02:38.280076] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-06T18:02:38.658620] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:02:38.693462] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T18:02:38.694278] [INFO ] [REMOTE ] CIMN: Full fetch complete (3941 records). [2025-10-06T18:02:38.694349] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-06T18:02:39.029797] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-06T18:02:39.059929] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-06T18:02:39.060028] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-06T18:02:39.060163] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-06T18:02:39.060203] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-06T18:02:39.060618] [DEBUG] [LOCAL ] CIMN: Trimmed 3941 records to 2736 (keeping 200 days of data) [2025-10-06T18:02:39.079608] [DEBUG] [LOCAL ] CIMN: Primary data saved (2736 records). [2025-10-06T18:02:39.079816] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-06T18:02:39.079945] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMN took 20.4s. Estimated remaining: 4h 25m 42s. Rate: 7.2 symbols/min [2025-10-06T18:02:39.294348] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:02:39.319299] [DEBUG] [LOCAL ] CINT: Loaded 19081 existing records from primary storage. [2025-10-06T18:02:39.319712] [INFO ] [MAIN ] CINT: Loaded 19081 existing records. [2025-10-06T18:02:39.518622] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:02:39.519129] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-06T18:02:39.519185] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-06T18:02:39.519431] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-06T18:02:39.519488] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-06T18:02:39.755880] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T18:02:39.830699] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-06T18:02:39.923008] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:02:40.625592] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-06T18:02:41.333250] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T18:02:41.335960] [INFO ] [REMOTE ] CIM: Full fetch complete (55025 records). [2025-10-06T18:02:41.336056] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-06T18:02:41.430908] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-06T18:02:41.692377] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T18:02:41.766104] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-06T18:02:41.766206] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-06T18:02:41.767049] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-06T18:02:41.767142] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-06T18:02:41.768472] [DEBUG] [LOCAL ] CIM: Trimmed 55025 records to 37664 (keeping 200 days of data) [2025-10-06T18:02:41.998996] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:02:42.004376] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-06T18:02:42.006430] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:02:42.009334] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-06T18:02:42.012995] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:02:42.024964] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-06T18:02:42.027476] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-06T18:02:42.042372] [DEBUG] [LOCAL ] CIM: Primary data saved (37664 records). [2025-10-06T18:02:42.042542] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-06T18:02:42.042994] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-06T18:02:42.043954] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIM took 40.3s. Estimated remaining: 4h 25m 11s. Rate: 7.2 symbols/min [2025-10-06T18:02:42.043140] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-06T18:02:42.084876] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIMP took 4.0s. Estimated remaining: 4h 24m 28s. Rate: 7.2 symbols/min [2025-10-06T18:02:42.230634] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-06T18:02:42.468200] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:02:42.586149] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:02:42.601583] [DEBUG] [LOCAL ] CIO: Loaded 20752 existing records from primary storage. [2025-10-06T18:02:42.602113] [INFO ] [MAIN ] CIO: Loaded 20752 existing records. [2025-10-06T18:02:42.806861] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-06T18:02:42.806404] [DEBUG] [LOCAL ] CION: Loaded 29192 existing records from primary storage. [2025-10-06T18:02:42.880918] [INFO ] [MAIN ] CION: Loaded 29192 existing records. [2025-10-06T18:02:42.922406] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:02:42.958536] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-06T18:02:42.991794] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-06T18:02:43.025824] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-06T18:02:43.074058] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-06T18:02:43.079971] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-06T18:02:43.275874] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:02:43.305112] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-06T18:02:43.305267] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-06T18:02:43.311072] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-06T18:02:43.316286] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-06T18:02:43.848000] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-06T18:02:43.891284] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:02:44.013985] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T18:02:44.076854] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:02:44.186986] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-06T18:02:44.625544] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-06T18:02:45.425590] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-06T18:02:45.895398] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T18:02:46.069189] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-06T18:02:46.225576] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-06T18:02:47.025519] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-06T18:02:47.342149] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T18:02:47.825498] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-06T18:02:48.052186] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T18:02:48.625483] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-06T18:02:48.933057] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T18:02:49.131447] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-06T18:02:49.425554] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-06T18:02:50.225555] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-06T18:02:50.665854] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T18:02:51.025599] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-06T18:02:51.571350] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T18:02:51.614987] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T18:02:51.825586] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-06T18:02:52.625583] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-06T18:02:53.000876] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T18:02:53.425603] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-06T18:02:53.750823] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T18:02:54.019907] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-06T18:02:54.225506] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-06T18:02:54.746514] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T18:02:54.747447] [INFO ] [REMOTE ] CIMO: Full fetch complete (5259 records). [2025-10-06T18:02:54.747518] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-06T18:02:54.931955] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T18:02:54.932303] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:02:54.932375] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:02:54.932446] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-06T18:02:54.932517] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-06T18:02:54.932554] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-06T18:02:54.932609] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-06T18:02:54.932719] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIMO took 34.8s. Estimated remaining: 4h 24m 39s. Rate: 7.2 symbols/min [2025-10-06T18:02:55.030790] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-06T18:02:55.115233] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:02:55.176803] [DEBUG] [LOCAL ] CIVI: Loaded 53365 existing records from primary storage. [2025-10-06T18:02:55.177306] [INFO ] [MAIN ] CIVI: Loaded 53365 existing records. [2025-10-06T18:02:55.357234] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:02:55.357537] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-06T18:02:55.357588] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-06T18:02:55.357945] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-06T18:02:55.358003] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-06T18:02:55.717676] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:02:55.825544] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-06T18:02:56.304340] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-06T18:02:56.625545] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-06T18:02:57.425484] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-06T18:02:57.635797] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T18:02:57.659373] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T18:02:58.225595] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-06T18:02:58.357919] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T18:02:59.025565] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-06T18:02:59.245409] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T18:02:59.825569] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-06T18:03:00.523016] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T18:03:00.625516] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-06T18:03:01.170098] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-06T18:03:01.425582] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-06T18:03:02.115799] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T18:03:02.225622] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-06T18:03:02.575286] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T18:03:03.025513] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-06T18:03:03.825481] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-06T18:03:03.946955] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T18:03:04.209211] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T18:03:04.625541] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-06T18:03:04.892069] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T18:03:05.425496] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-06T18:03:05.736779] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T18:03:06.225495] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-06T18:03:06.468513] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T18:03:07.025540] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-06T18:03:07.825495] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-06T18:03:07.945893] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T18:03:08.101141] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T18:03:08.625549] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-06T18:03:09.425512] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-06T18:03:09.580630] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T18:03:09.711582] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T18:03:10.225625] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-06T18:03:10.354287] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T18:03:11.025530] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-06T18:03:11.563693] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T18:03:11.825538] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-06T18:03:12.267469] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-06T18:03:12.625491] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-06T18:03:12.941378] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T18:03:13.425516] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-06T18:03:13.769862] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T18:03:13.771565] [INFO ] [REMOTE ] CION: Full fetch complete (40785 records). [2025-10-06T18:03:13.771663] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-06T18:03:14.139533] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-06T18:03:14.139624] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-06T18:03:14.140232] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-06T18:03:14.140288] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-06T18:03:14.141309] [DEBUG] [LOCAL ] CION: Trimmed 40785 records to 28474 (keeping 200 days of data) [2025-10-06T18:03:14.228045] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-06T18:03:14.323905] [DEBUG] [LOCAL ] CION: Primary data saved (28474 records). [2025-10-06T18:03:14.324337] [INFO ] [MAIN ] CION: Full history saved. [2025-10-06T18:03:14.324475] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CION took 32.2s. Estimated remaining: 4h 25m 17s. Rate: 7.2 symbols/min [2025-10-06T18:03:14.500949] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:03:14.505346] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T18:03:14.506866] [INFO ] [REMOTE ] CINT: Full fetch complete (26722 records). [2025-10-06T18:03:14.506941] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-06T18:03:14.507680] [FATAL] [VALIDATOR ] CINT: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:03:14.507834] [FATAL] [MAIN ] CINT: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:03:14.507918] [WARN ] [MAIN ] CINT: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:03:14.507998] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-06T18:03:14.508613] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-06T18:03:14.508700] [INFO ] [LOCAL ] CINT: Starting deletion of derivative data. [2025-10-06T18:03:14.509348] [DEBUG] [LOCAL ] CINT: Deleted derivative data file. [2025-10-06T18:03:14.509458] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CINT took 35.4s. Estimated remaining: 4h 24m 35s. Rate: 7.2 symbols/min [2025-10-06T18:03:14.709583] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:03:14.731857] [DEBUG] [LOCAL ] CL: Loaded 54425 existing records from primary storage. [2025-10-06T18:03:14.732337] [INFO ] [MAIN ] CL: Loaded 54425 existing records. [2025-10-06T18:03:14.945913] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:03:14.947052] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-06T18:03:14.946852] [DEBUG] [LOCAL ] CLB: Loaded 33416 existing records from primary storage. [2025-10-06T18:03:14.947272] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-06T18:03:14.947679] [INFO ] [MAIN ] CLB: Loaded 33416 existing records. [2025-10-06T18:03:14.979692] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-06T18:03:15.023849] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-06T18:03:15.034449] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-06T18:03:15.309587] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:03:15.340781] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-06T18:03:15.340886] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-06T18:03:15.385808] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-06T18:03:15.410159] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-06T18:03:15.673496] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:03:15.836745] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-06T18:03:15.960573] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:03:15.992341] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T18:03:16.486144] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T18:03:16.625517] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-06T18:03:17.425563] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-06T18:03:17.803474] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-06T18:03:18.225537] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-06T18:03:18.400545] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-06T18:03:18.445033] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-06T18:03:19.025596] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-06T18:03:19.833589] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-06T18:03:19.840176] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T18:03:20.151933] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T18:03:20.625553] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-06T18:03:21.425524] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-06T18:03:21.863838] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-06T18:03:22.225511] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-06T18:03:22.406737] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T18:03:22.583242] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-06T18:03:23.025538] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-06T18:03:23.825545] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-06T18:03:23.949674] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T18:03:24.625506] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-06T18:03:24.803031] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-06T18:03:24.804956] [INFO ] [REMOTE ] CIO: Full fetch complete (29191 records). [2025-10-06T18:03:24.805029] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-06T18:03:25.211552] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-06T18:03:25.232150] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-06T18:03:25.232755] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-06T18:03:25.233690] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-06T18:03:25.233760] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-06T18:03:25.235134] [DEBUG] [LOCAL ] CIO: Trimmed 29191 records to 20433 (keeping 200 days of data) [2025-10-06T18:03:25.362110] [DEBUG] [LOCAL ] CIO: Primary data saved (20433 records). [2025-10-06T18:03:25.362288] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-06T18:03:25.362390] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CIO took 43.3s. Estimated remaining: 4h 24m 37s. Rate: 7.2 symbols/min [2025-10-06T18:03:25.430811] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-06T18:03:25.542984] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:03:25.559769] [DEBUG] [LOCAL ] CLCO: Loaded 13025 existing records from primary storage. [2025-10-06T18:03:25.560036] [INFO ] [MAIN ] CLCO: Loaded 13025 existing records. [2025-10-06T18:03:25.748702] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:03:25.749040] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-06T18:03:25.749092] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-06T18:03:25.749376] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-06T18:03:25.749438] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-06T18:03:26.144072] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:03:26.225563] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-06T18:03:26.300160] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T18:03:27.025526] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-06T18:03:27.345727] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T18:03:27.476753] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T18:03:27.825503] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-06T18:03:28.624524] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-06T18:03:28.628296] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-06T18:03:28.630067] [INFO ] [REMOTE ] CIVI: Full fetch complete (75715 records). [2025-10-06T18:03:28.630210] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-06T18:03:29.017629] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T18:03:29.102586] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-06T18:03:29.102743] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-06T18:03:29.103623] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-06T18:03:29.103706] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-06T18:03:29.105683] [DEBUG] [LOCAL ] CIVI: Trimmed 75715 records to 52609 (keeping 200 days of data) [2025-10-06T18:03:29.425862] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-06T18:03:29.441541] [DEBUG] [LOCAL ] CIVI: Primary data saved (52609 records). [2025-10-06T18:03:29.441758] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-06T18:03:29.441878] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CIVI took 34.5s. Estimated remaining: 4h 24m 11s. Rate: 7.2 symbols/min [2025-10-06T18:03:29.624284] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:03:29.649119] [DEBUG] [LOCAL ] CLDT: Loaded 25759 existing records from primary storage. [2025-10-06T18:03:29.649454] [INFO ] [MAIN ] CLDT: Loaded 25759 existing records. [2025-10-06T18:03:29.855045] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:03:29.855740] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-06T18:03:29.855919] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-06T18:03:29.856187] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-06T18:03:29.856247] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-06T18:03:30.154493] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T18:03:30.234540] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-06T18:03:30.240622] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:03:31.025594] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-06T18:03:31.500187] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-06T18:03:31.542771] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T18:03:31.693917] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-06T18:03:31.825515] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-06T18:03:32.625728] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-06T18:03:32.972706] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-06T18:03:33.425548] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-06T18:03:33.875807] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T18:03:34.225559] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-06T18:03:35.025610] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-06T18:03:35.259767] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T18:03:35.285748] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-06T18:03:35.829451] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-06T18:03:35.836476] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T18:03:36.625496] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-06T18:03:36.710002] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T18:03:37.425592] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-06T18:03:38.225576] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-06T18:03:38.416841] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T18:03:38.765092] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-06T18:03:39.025548] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-06T18:03:39.371618] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T18:03:39.808258] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T18:03:39.825485] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-06T18:03:40.602693] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T18:03:40.625485] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-06T18:03:41.425495] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-06T18:03:41.552182] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T18:03:42.225559] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-06T18:03:42.507219] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-06T18:03:43.025571] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-06T18:03:43.290106] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T18:03:43.291788] [INFO ] [REMOTE ] CLCO: Full fetch complete (22679 records). [2025-10-06T18:03:43.291882] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-06T18:03:43.653320] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-06T18:03:43.653413] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-06T18:03:43.653865] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-06T18:03:43.653937] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-06T18:03:43.654582] [DEBUG] [LOCAL ] CLCO: Trimmed 22679 records to 12635 (keeping 200 days of data) [2025-10-06T18:03:43.730683] [DEBUG] [LOCAL ] CLCO: Primary data saved (12635 records). [2025-10-06T18:03:43.730880] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-06T18:03:43.730987] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLCO took 18.4s. Estimated remaining: 4h 24m 28s. Rate: 7.2 symbols/min [2025-10-06T18:03:43.830772] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-06T18:03:43.917871] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:03:43.918145] [DEBUG] [LOCAL ] CLF: No existing data file found in primary storage. [2025-10-06T18:03:43.918204] [WARN ] [MAIN ] CLF: No existing data found, performing full refresh instead. [2025-10-06T18:03:43.918342] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-06T18:03:43.918446] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-06T18:03:43.918513] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-10-06T18:03:43.918548] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-06T18:03:44.304193] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:03:44.544830] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T18:03:44.625581] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-06T18:03:45.425556] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-06T18:03:45.656595] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T18:03:45.987053] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-06T18:03:46.225592] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-06T18:03:47.025518] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-06T18:03:47.473702] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-06T18:03:47.535529] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-06T18:03:47.825553] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-06T18:03:48.630200] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-06T18:03:48.634053] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-06T18:03:49.019291] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T18:03:49.425582] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-06T18:03:50.225591] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-06T18:03:50.773592] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-06T18:03:50.876459] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T18:03:51.025564] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-06T18:03:51.546472] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T18:03:51.825503] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-06T18:03:52.625569] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-06T18:03:53.234548] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-06T18:03:53.381574] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T18:03:53.384849] [INFO ] [REMOTE ] CL: Full fetch complete (77619 records). [2025-10-06T18:03:53.384989] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-06T18:03:53.430617] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-06T18:03:53.789248] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-06T18:03:53.789370] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-06T18:03:53.790287] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-06T18:03:53.790358] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-06T18:03:53.792290] [DEBUG] [LOCAL ] CL: Trimmed 77619 records to 53648 (keeping 200 days of data) [2025-10-06T18:03:54.126562] [DEBUG] [LOCAL ] CL: Primary data saved (53648 records). [2025-10-06T18:03:54.126775] [INFO ] [MAIN ] CL: Full history saved. [2025-10-06T18:03:54.126880] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CL took 39.8s. Estimated remaining: 4h 24m 28s. Rate: 7.2 symbols/min [2025-10-06T18:03:54.233007] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-06T18:03:54.293112] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T18:03:54.334928] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:03:54.365408] [DEBUG] [LOCAL ] CLH: Loaded 28188 existing records from primary storage. [2025-10-06T18:03:54.365770] [INFO ] [MAIN ] CLH: Loaded 28188 existing records. [2025-10-06T18:03:54.540998] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:03:54.541295] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-06T18:03:54.541348] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-06T18:03:54.541726] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-06T18:03:54.541785] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-06T18:03:54.892595] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:03:55.025533] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-06T18:03:55.542691] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T18:03:55.759303] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-06T18:03:55.825560] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-06T18:03:56.408956] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T18:03:56.625606] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-06T18:03:57.425575] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-06T18:03:57.962610] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T18:03:58.132115] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-06T18:03:58.225505] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-06T18:03:58.870274] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T18:03:59.025680] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-06T18:03:59.137320] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T18:03:59.825477] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-06T18:04:00.139253] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-06T18:04:00.625525] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-06T18:04:01.425617] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-06T18:04:02.114858] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-06T18:04:02.225540] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-06T18:04:03.025545] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-06T18:04:04.182128] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-06T18:04:04.193233] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-06T18:04:04.324460] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T18:04:04.326534] [INFO ] [REMOTE ] CLB: Full fetch complete (46703 records). [2025-10-06T18:04:04.326674] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-06T18:04:04.714185] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-06T18:04:04.714293] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-06T18:04:04.715092] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-06T18:04:04.715173] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-06T18:04:04.716356] [DEBUG] [LOCAL ] CLB: Trimmed 46703 records to 33026 (keeping 200 days of data) [2025-10-06T18:04:04.911866] [DEBUG] [LOCAL ] CLB: Primary data saved (33026 records). [2025-10-06T18:04:04.912032] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-06T18:04:04.912804] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLB took 50.4s. Estimated remaining: 4h 24m 30s. Rate: 7.2 symbols/min [2025-10-06T18:04:05.085596] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:04:05.098042] [DEBUG] [LOCAL ] CLPR: Loaded 11502 existing records from primary storage. [2025-10-06T18:04:05.098316] [INFO ] [MAIN ] CLPR: Loaded 11502 existing records. [2025-10-06T18:04:05.273411] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:04:05.273795] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-06T18:04:05.273862] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-06T18:04:05.274142] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-06T18:04:05.274219] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-06T18:04:05.673015] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:04:05.673782] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-06T18:04:05.779004] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (5.15 seconds). [2025-10-06T18:04:05.784883] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-06T18:04:06.090856] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T18:04:06.225537] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-06T18:04:06.646356] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (5.22 seconds). [2025-10-06T18:04:06.721258] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T18:04:06.723740] [INFO ] [REMOTE ] CLDT: Full fetch complete (37165 records). [2025-10-06T18:04:06.723937] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-06T18:04:06.744386] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T18:04:07.030721] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-06T18:04:07.142743] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-06T18:04:07.142867] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-06T18:04:07.143473] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-06T18:04:07.143518] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-06T18:04:07.144532] [DEBUG] [LOCAL ] CLDT: Trimmed 37165 records to 25327 (keeping 200 days of data) [2025-10-06T18:04:07.301700] [DEBUG] [LOCAL ] CLDT: Primary data saved (25327 records). [2025-10-06T18:04:07.302053] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-06T18:04:07.302165] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLDT took 37.9s. Estimated remaining: 4h 23m 58s. Rate: 7.2 symbols/min [2025-10-06T18:04:07.471682] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:04:07.536403] [DEBUG] [LOCAL ] CLS: Loaded 54389 existing records from primary storage. [2025-10-06T18:04:07.537021] [INFO ] [MAIN ] CLS: Loaded 54389 existing records. [2025-10-06T18:04:07.736602] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:04:07.736932] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-06T18:04:07.736983] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-06T18:04:07.737469] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-06T18:04:07.737564] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-06T18:04:07.834478] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-06T18:04:08.126483] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:04:08.383425] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-06T18:04:08.434605] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T18:04:08.625487] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-06T18:04:08.784317] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T18:04:09.425520] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-06T18:04:10.225505] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-06T18:04:10.302075] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T18:04:11.025723] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-06T18:04:11.685999] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-06T18:04:11.825503] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-06T18:04:12.160477] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-06T18:04:12.260623] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T18:04:12.625555] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-06T18:04:13.419158] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T18:04:13.422366] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-10-06T18:04:13.422504] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-06T18:04:13.434871] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-06T18:04:13.876001] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-06T18:04:13.876151] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-06T18:04:13.877227] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-06T18:04:13.877335] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-06T18:04:13.894876] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-06T18:04:13.900575] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 53741 (keeping 200 days of data) [2025-10-06T18:04:14.225524] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-06T18:04:14.236580] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-06T18:04:14.236796] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-06T18:04:14.236889] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLF took 30.5s. Estimated remaining: 4h 23m 44s. Rate: 7.2 symbols/min [2025-10-06T18:04:14.368372] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T18:04:14.423771] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:04:14.475053] [DEBUG] [LOCAL ] CLVT: Loaded 52720 existing records from primary storage. [2025-10-06T18:04:14.475457] [INFO ] [MAIN ] CLVT: Loaded 52720 existing records. [2025-10-06T18:04:14.658550] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:04:14.658883] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-06T18:04:14.658939] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-06T18:04:14.659234] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-06T18:04:14.659292] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-06T18:04:15.028170] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-06T18:04:15.031923] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:04:15.825602] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-06T18:04:16.388812] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-06T18:04:16.625522] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-06T18:04:16.755910] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-06T18:04:17.301596] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T18:04:17.425487] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-06T18:04:17.824939] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-06T18:04:18.225564] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-06T18:04:19.025557] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-06T18:04:19.084910] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T18:04:19.385845] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-06T18:04:19.825566] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-06T18:04:20.625500] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-06T18:04:20.850404] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T18:04:21.425553] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-06T18:04:21.552837] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-06T18:04:22.172360] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T18:04:22.225512] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-06T18:04:22.888146] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T18:04:23.025540] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-06T18:04:23.804975] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T18:04:23.825494] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-06T18:04:23.955486] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T18:04:24.625560] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-06T18:04:24.879423] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T18:04:24.881385] [INFO ] [REMOTE ] CLH: Full fetch complete (41884 records). [2025-10-06T18:04:24.881492] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-06T18:04:25.265601] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-06T18:04:25.265747] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-06T18:04:25.266368] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-06T18:04:25.266411] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-06T18:04:25.267359] [DEBUG] [LOCAL ] CLH: Trimmed 41884 records to 27690 (keeping 200 days of data) [2025-10-06T18:04:25.425749] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-06T18:04:25.443943] [DEBUG] [LOCAL ] CLH: Primary data saved (27690 records). [2025-10-06T18:04:25.444136] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-06T18:04:25.444286] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLH took 31.3s. Estimated remaining: 4h 23m 47s. Rate: 7.2 symbols/min [2025-10-06T18:04:25.631622] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:04:25.631993] [DEBUG] [LOCAL ] CLW: No existing data file found in primary storage. [2025-10-06T18:04:25.632040] [WARN ] [MAIN ] CLW: No existing data found, performing full refresh instead. [2025-10-06T18:04:25.632169] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-06T18:04:25.632212] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-06T18:04:25.632252] [DEBUG] [LOCAL ] CLW: No primary data file found to delete. [2025-10-06T18:04:25.632285] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-06T18:04:25.994704] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:04:26.192907] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T18:04:26.225480] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-06T18:04:26.974776] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-06T18:04:27.025514] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-06T18:04:27.092411] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-06T18:04:27.825573] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-06T18:04:28.625559] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-06T18:04:29.186060] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-06T18:04:29.425591] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-06T18:04:29.798269] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T18:04:30.014630] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T18:04:30.225558] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-06T18:04:31.025599] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-06T18:04:31.586875] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T18:04:31.830694] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-06T18:04:31.846919] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-06T18:04:32.625570] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-06T18:04:32.713860] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T18:04:32.740446] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-06T18:04:33.425491] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-06T18:04:33.455545] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-06T18:04:34.225530] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-06T18:04:34.580905] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-06T18:04:35.025571] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-06T18:04:35.825489] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-06T18:04:36.199285] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T18:04:36.489225] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-06T18:04:36.625545] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-06T18:04:37.297927] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T18:04:37.425537] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-06T18:04:37.475321] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T18:04:38.029337] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T18:04:38.030391] [INFO ] [REMOTE ] CLPR: Full fetch complete (17241 records). [2025-10-06T18:04:38.030467] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-06T18:04:38.234446] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-06T18:04:38.396204] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-06T18:04:38.396291] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-06T18:04:38.396705] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-06T18:04:38.396767] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-06T18:04:38.397303] [DEBUG] [LOCAL ] CLPR: Trimmed 17241 records to 10866 (keeping 200 days of data) [2025-10-06T18:04:38.458743] [DEBUG] [LOCAL ] CLPR: Primary data saved (10866 records). [2025-10-06T18:04:38.458899] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-06T18:04:38.458986] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLPR took 33.5s. Estimated remaining: 4h 23m 58s. Rate: 7.2 symbols/min [2025-10-06T18:04:38.693192] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:04:38.762378] [DEBUG] [LOCAL ] CLX: Loaded 52222 existing records from primary storage. [2025-10-06T18:04:38.762800] [INFO ] [MAIN ] CLX: Loaded 52222 existing records. [2025-10-06T18:04:38.939861] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:04:38.940197] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-06T18:04:38.940271] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-06T18:04:38.940869] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-06T18:04:38.940944] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-06T18:04:39.030591] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-06T18:04:39.296071] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:04:39.825557] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-06T18:04:40.435779] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-06T18:04:40.625563] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-06T18:04:41.425558] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-06T18:04:41.464779] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-06T18:04:41.511628] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T18:04:41.882510] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T18:04:42.225532] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-06T18:04:43.025490] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-06T18:04:43.092926] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T18:04:43.825566] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-06T18:04:44.008267] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T18:04:44.513279] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-06T18:04:44.625527] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-06T18:04:45.167749] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T18:04:45.425507] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-06T18:04:45.727161] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T18:04:46.225528] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-06T18:04:46.714569] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-06T18:04:47.025540] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-06T18:04:47.386829] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-06T18:04:47.825534] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-06T18:04:48.325707] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T18:04:48.328727] [INFO ] [REMOTE ] CLVT: Full fetch complete (75235 records). [2025-10-06T18:04:48.328846] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-06T18:04:48.625815] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-06T18:04:48.728962] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-06T18:04:48.729074] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-06T18:04:48.730439] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-06T18:04:48.730511] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-06T18:04:48.732570] [DEBUG] [LOCAL ] CLVT: Trimmed 75235 records to 51951 (keeping 200 days of data) [2025-10-06T18:04:49.047419] [DEBUG] [LOCAL ] CLVT: Primary data saved (51951 records). [2025-10-06T18:04:49.047602] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-06T18:04:49.047722] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLVT took 34.8s. Estimated remaining: 4h 23m 59s. Rate: 7.2 symbols/min [2025-10-06T18:04:49.229077] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:04:49.277951] [DEBUG] [LOCAL ] CM: Loaded 49298 existing records from primary storage. [2025-10-06T18:04:49.278355] [INFO ] [MAIN ] CM: Loaded 49298 existing records. [2025-10-06T18:04:49.433276] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-06T18:04:49.479992] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:04:49.480593] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-06T18:04:49.480712] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-06T18:04:49.481164] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-06T18:04:49.481225] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-06T18:04:49.862620] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:04:49.883038] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T18:04:50.225553] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-06T18:04:50.270573] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-06T18:04:51.025535] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-06T18:04:51.195144] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T18:04:51.196745] [INFO ] [REMOTE ] CLW: Full fetch complete (34736 records). [2025-10-06T18:04:51.196859] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-06T18:04:51.526633] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-06T18:04:51.627187] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-06T18:04:51.627302] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-06T18:04:51.627897] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-06T18:04:51.627966] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-06T18:04:51.629059] [DEBUG] [LOCAL ] CLW: Trimmed 34736 records to 21690 (keeping 200 days of data) [2025-10-06T18:04:51.757015] [DEBUG] [LOCAL ] CLW: Primary data saved (21690 records). [2025-10-06T18:04:51.757228] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-06T18:04:51.757322] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLW took 26.3s. Estimated remaining: 4h 23m 28s. Rate: 7.2 symbols/min [2025-10-06T18:04:51.831317] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-06T18:04:51.930526] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:04:51.978635] [DEBUG] [LOCAL ] CMA: Loaded 50603 existing records from primary storage. [2025-10-06T18:04:51.979060] [INFO ] [MAIN ] CMA: Loaded 50603 existing records. [2025-10-06T18:04:52.155634] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:04:52.155995] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-06T18:04:52.156049] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-06T18:04:52.156407] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-06T18:04:52.156464] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-06T18:04:52.515095] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:04:52.625530] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-06T18:04:52.661022] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T18:04:53.425580] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-06T18:04:53.944280] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-06T18:04:53.947806] [INFO ] [REMOTE ] CLS: Full fetch complete (77459 records). [2025-10-06T18:04:53.947996] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-06T18:04:54.228759] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-06T18:04:54.378924] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-06T18:04:54.379091] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-06T18:04:54.380402] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-06T18:04:54.380531] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-06T18:04:54.382967] [DEBUG] [LOCAL ] CLS: Trimmed 77459 records to 53612 (keeping 200 days of data) [2025-10-06T18:04:54.511091] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-06T18:04:54.757670] [DEBUG] [LOCAL ] CLS: Primary data saved (53612 records). [2025-10-06T18:04:54.757831] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-06T18:04:54.757917] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLS took 47.5s. Estimated remaining: 4h 22m 58s. Rate: 7.2 symbols/min [2025-10-06T18:04:54.933088] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:04:54.966120] [DEBUG] [LOCAL ] CMBT: Loaded 24208 existing records from primary storage. [2025-10-06T18:04:54.966606] [INFO ] [MAIN ] CMBT: Loaded 24208 existing records. [2025-10-06T18:04:55.029588] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-06T18:04:55.184842] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:04:55.185249] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-06T18:04:55.185425] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-06T18:04:55.185804] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-06T18:04:55.185874] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-06T18:04:55.306338] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T18:04:55.659889] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:04:55.825570] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-06T18:04:56.287393] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-06T18:04:56.399305] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T18:04:56.625551] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-06T18:04:57.211235] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T18:04:57.425587] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-06T18:04:58.225541] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-06T18:04:58.448978] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T18:04:58.987682] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T18:04:59.025479] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-06T18:04:59.373707] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T18:04:59.825542] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-06T18:05:00.625551] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-06T18:05:00.842335] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T18:05:01.155260] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T18:05:01.425538] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-06T18:05:02.225548] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-06T18:05:02.761401] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-06T18:05:03.025537] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-06T18:05:03.142050] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T18:05:03.257217] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T18:05:03.825539] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-06T18:05:04.625528] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-06T18:05:04.902715] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-06T18:05:05.425539] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-06T18:05:05.659583] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T18:05:06.189760] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-06T18:05:06.225479] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-06T18:05:06.466595] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T18:05:07.025533] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-06T18:05:07.825543] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-06T18:05:08.121442] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-06T18:05:08.625523] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-06T18:05:08.964424] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T18:05:09.147045] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-06T18:05:09.425566] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-06T18:05:10.225548] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-06T18:05:10.309830] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T18:05:10.829605] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T18:05:11.025604] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-06T18:05:11.578764] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-06T18:05:11.825603] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-06T18:05:12.524087] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-06T18:05:12.625515] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-06T18:05:13.425511] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-06T18:05:13.504900] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T18:05:14.225503] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-06T18:05:14.393897] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T18:05:14.473581] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T18:05:15.025612] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-06T18:05:15.825504] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-06T18:05:15.884474] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T18:05:15.925725] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-06T18:05:16.625566] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-06T18:05:17.296745] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T18:05:17.425482] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-06T18:05:18.178905] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T18:05:18.225589] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-06T18:05:19.030744] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-06T18:05:19.050681] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T18:05:19.825566] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-06T18:05:20.169904] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T18:05:20.625523] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-06T18:05:21.111474] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-06T18:05:21.296739] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T18:05:21.299842] [INFO ] [REMOTE ] CM: Full fetch complete (69512 records). [2025-10-06T18:05:21.300007] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-06T18:05:21.430737] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-06T18:05:21.709272] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-06T18:05:21.709363] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-06T18:05:21.710166] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-06T18:05:21.710231] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-06T18:05:21.711678] [DEBUG] [LOCAL ] CM: Trimmed 69512 records to 48664 (keeping 200 days of data) [2025-10-06T18:05:22.025406] [DEBUG] [LOCAL ] CM: Primary data saved (48664 records). [2025-10-06T18:05:22.025727] [INFO ] [MAIN ] CM: Full history saved. [2025-10-06T18:05:22.025853] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CM took 33.0s. Estimated remaining: 4h 24m 7s. Rate: 7.2 symbols/min [2025-10-06T18:05:22.201213] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:05:22.225572] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-06T18:05:22.243542] [DEBUG] [LOCAL ] CMC: Loaded 46192 existing records from primary storage. [2025-10-06T18:05:22.243989] [INFO ] [MAIN ] CMC: Loaded 46192 existing records. [2025-10-06T18:05:22.355200] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-06T18:05:22.384768] [INFO ] [REMOTE ] CMA: Full fetch complete (73095 records). [2025-10-06T18:05:22.408705] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-06T18:05:22.504070] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:05:22.549016] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-06T18:05:22.553126] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-06T18:05:22.559093] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-06T18:05:22.559230] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-06T18:05:23.275359] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-06T18:05:23.280794] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-06T18:05:23.287577] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-06T18:05:23.302020] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-06T18:05:23.324862] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-06T18:05:23.324738] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:05:23.325100] [INFO ] [REMOTE ] CMBT: Full fetch complete (30949 records). [2025-10-06T18:05:23.325624] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-06T18:05:23.325962] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-06T18:05:23.399765] [DEBUG] [LOCAL ] CMA: Trimmed 73095 records to 49881 (keeping 200 days of data) [2025-10-06T18:05:23.829692] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-06T18:05:23.831731] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-06T18:05:23.835587] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-06T18:05:23.836244] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-06T18:05:23.840849] [DEBUG] [LOCAL ] CMBT: Trimmed 30949 records to 24195 (keeping 200 days of data) [2025-10-06T18:05:24.123478] [DEBUG] [LOCAL ] CMBT: Primary data saved (24195 records). [2025-10-06T18:05:24.124037] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-06T18:05:24.125147] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CMBT took 29.4s. Estimated remaining: 4h 23m 33s. Rate: 7.2 symbols/min [2025-10-06T18:05:24.127230] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T18:05:24.206684] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-06T18:05:24.402683] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:05:24.405380] [DEBUG] [LOCAL ] CMA: Primary data saved (49881 records). [2025-10-06T18:05:24.406046] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-06T18:05:24.406185] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMA took 32.6s. Estimated remaining: 4h 22m 53s. Rate: 7.2 symbols/min [2025-10-06T18:05:24.496225] [DEBUG] [LOCAL ] CMCM: Loaded 4794 existing records from primary storage. [2025-10-06T18:05:24.514787] [INFO ] [MAIN ] CMCM: Loaded 4794 existing records. [2025-10-06T18:05:24.733259] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:05:24.769284] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-06T18:05:24.812230] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:05:24.812358] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-06T18:05:24.812568] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-06T18:05:24.812715] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-06T18:05:24.812796] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-06T18:05:24.812850] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-06T18:05:24.812965] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-06T18:05:24.813108] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-06T18:05:24.845150] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-06T18:05:24.879379] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-06T18:05:25.513440] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:05:25.549107] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-06T18:05:25.603085] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-06T18:05:25.651062] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:05:25.651467] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-06T18:05:25.848798] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:05:25.849202] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-06T18:05:25.849297] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:05:25.849345] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-06T18:05:25.849400] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:05:25.849474] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-06T18:05:25.849545] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-06T18:05:25.849580] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-06T18:05:25.849617] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-06T18:05:25.849697] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CMDB took 1.4s. Estimated remaining: 4h 22m 17s. Rate: 7.2 symbols/min [2025-10-06T18:05:26.021233] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:05:26.074093] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-10-06T18:05:26.074484] [INFO ] [MAIN ] CMG: Loaded 54501 existing records. [2025-10-06T18:05:26.231162] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-06T18:05:26.255987] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:05:26.257315] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-06T18:05:26.257380] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-06T18:05:26.257974] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-06T18:05:26.258033] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-06T18:05:26.458950] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-06T18:05:26.592907] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T18:05:26.710412] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:05:27.025609] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-06T18:05:27.825567] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-06T18:05:27.983449] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T18:05:28.625591] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-06T18:05:29.170501] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-06T18:05:29.195398] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-06T18:05:29.283414] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T18:05:29.288304] [INFO ] [REMOTE ] CLX: Full fetch complete (73150 records). [2025-10-06T18:05:29.288564] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-06T18:05:29.430763] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-06T18:05:29.740534] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-06T18:05:29.740705] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-06T18:05:29.741783] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-06T18:05:29.741877] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-06T18:05:29.743923] [DEBUG] [LOCAL ] CLX: Trimmed 73150 records to 51548 (keeping 200 days of data) [2025-10-06T18:05:30.108462] [DEBUG] [LOCAL ] CLX: Primary data saved (51548 records). [2025-10-06T18:05:30.108836] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-06T18:05:30.109845] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CLX took 51.7s. Estimated remaining: 4h 21m 52s. Rate: 7.2 symbols/min [2025-10-06T18:05:30.226508] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-06T18:05:30.308855] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:05:30.362908] [DEBUG] [LOCAL ] CMI: Loaded 42360 existing records from primary storage. [2025-10-06T18:05:30.363350] [INFO ] [MAIN ] CMI: Loaded 42360 existing records. [2025-10-06T18:05:30.568568] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:05:30.569097] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-06T18:05:30.569175] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-06T18:05:30.569431] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-06T18:05:30.569491] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-06T18:05:30.974292] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:05:30.994265] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-06T18:05:31.025547] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-06T18:05:31.644096] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-06T18:05:31.825547] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-06T18:05:32.625585] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T18:05:32.625679] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-06T18:05:33.250353] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T18:05:33.425586] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-06T18:05:33.886061] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-06T18:05:34.225562] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-06T18:05:34.750827] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-06T18:05:34.929144] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T18:05:35.025554] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-06T18:05:35.825565] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-06T18:05:36.625486] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-06T18:05:36.911920] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T18:05:37.219589] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-06T18:05:37.425508] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-06T18:05:38.015701] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-06T18:05:38.037167] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-06T18:05:38.225527] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-06T18:05:39.025564] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-06T18:05:39.825541] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-06T18:05:40.434204] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-06T18:05:40.465392] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-06T18:05:40.625493] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-06T18:05:40.836755] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-06T18:05:41.295558] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-06T18:05:41.425531] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-06T18:05:42.225533] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-06T18:05:43.030732] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-06T18:05:43.045742] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T18:05:43.825593] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-06T18:05:44.362996] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-06T18:05:44.604072] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-06T18:05:44.632117] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-06T18:05:44.637991] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T18:05:45.425540] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-06T18:05:46.216354] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T18:05:46.217302] [INFO ] [REMOTE ] CMCM: Full fetch complete (6933 records). [2025-10-06T18:05:46.217378] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-06T18:05:46.230629] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-06T18:05:46.595900] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-06T18:05:46.596137] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-06T18:05:46.596413] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-06T18:05:46.596477] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-06T18:05:46.597131] [DEBUG] [LOCAL ] CMCM: Trimmed 6933 records to 4714 (keeping 200 days of data) [2025-10-06T18:05:46.654190] [DEBUG] [LOCAL ] CMCM: Primary data saved (4714 records). [2025-10-06T18:05:46.656126] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-06T18:05:46.656197] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-06T18:05:46.666633] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMCM took 22.5s. Estimated remaining: 4h 22m 17s. Rate: 7.2 symbols/min [2025-10-06T18:05:46.832139] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:05:46.872629] [DEBUG] [LOCAL ] CMP: Loaded 36601 existing records from primary storage. [2025-10-06T18:05:46.873012] [INFO ] [MAIN ] CMP: Loaded 36601 existing records. [2025-10-06T18:05:47.027875] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-06T18:05:47.048307] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:05:47.049435] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-06T18:05:47.049484] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-06T18:05:47.049760] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-06T18:05:47.049820] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-06T18:05:47.404947] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:05:47.825532] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-06T18:05:47.953471] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T18:05:48.625577] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-06T18:05:49.338026] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-06T18:05:49.372899] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T18:05:49.425560] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-06T18:05:50.225557] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-06T18:05:50.374458] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T18:05:50.885135] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T18:05:51.025535] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-06T18:05:51.818470] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T18:05:51.827356] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-06T18:05:52.517748] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T18:05:52.625496] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-06T18:05:53.425517] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-06T18:05:53.638999] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T18:05:54.236463] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-06T18:05:54.263609] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T18:05:55.025587] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-06T18:05:55.749794] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-06T18:05:55.801917] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T18:05:55.825483] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-06T18:05:56.563223] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T18:05:56.625483] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-06T18:05:57.425525] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-06T18:05:58.202735] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T18:05:58.225498] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-06T18:05:58.315403] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-06T18:05:58.921571] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T18:05:59.025543] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-06T18:05:59.825525] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-06T18:05:59.911200] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T18:06:00.562506] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-06T18:06:00.625515] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-06T18:06:01.425554] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-06T18:06:02.107681] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-06T18:06:02.112076] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-06T18:06:02.112252] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-06T18:06:02.225754] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-06T18:06:02.534768] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-06T18:06:02.535050] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-06T18:06:02.535993] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-06T18:06:02.536078] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-06T18:06:02.561726] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-06T18:06:02.561891] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53721 (keeping 200 days of data) [2025-10-06T18:06:02.892970] [DEBUG] [LOCAL ] CMG: Primary data saved (53721 records). [2025-10-06T18:06:02.893180] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-06T18:06:02.893288] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMG took 37.0s. Estimated remaining: 4h 22m 40s. Rate: 7.2 symbols/min [2025-10-06T18:06:03.034526] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-06T18:06:03.069773] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:06:03.114878] [DEBUG] [LOCAL ] CMPO: Loaded 39703 existing records from primary storage. [2025-10-06T18:06:03.115344] [INFO ] [MAIN ] CMPO: Loaded 39703 existing records. [2025-10-06T18:06:03.351093] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:06:03.355007] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-06T18:06:03.354775] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-06T18:06:03.355276] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-06T18:06:03.366227] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-06T18:06:03.366306] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-06T18:06:03.757414] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:06:03.825552] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-06T18:06:03.938704] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T18:06:04.104052] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T18:06:04.625524] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-06T18:06:05.425512] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-06T18:06:05.493125] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T18:06:06.103065] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T18:06:06.106449] [INFO ] [REMOTE ] CMC: Full fetch complete (66951 records). [2025-10-06T18:06:06.106597] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-06T18:06:06.230712] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-06T18:06:06.513395] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-06T18:06:06.513516] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-06T18:06:06.514316] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-06T18:06:06.514391] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-06T18:06:06.516032] [DEBUG] [LOCAL ] CMC: Trimmed 66951 records to 45453 (keeping 200 days of data) [2025-10-06T18:06:06.786746] [DEBUG] [LOCAL ] CMC: Primary data saved (45453 records). [2025-10-06T18:06:06.786915] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-06T18:06:06.787025] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMC took 44.8s. Estimated remaining: 4h 22m 14s. Rate: 7.2 symbols/min [2025-10-06T18:06:07.025545] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-06T18:06:07.152155] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T18:06:07.834186] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-06T18:06:07.836439] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T18:06:08.494444] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T18:06:08.625564] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-06T18:06:08.967255] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T18:06:08.971033] [INFO ] [REMOTE ] CMI: Full fetch complete (60118 records). [2025-10-06T18:06:08.971190] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-06T18:06:09.409117] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-06T18:06:09.409219] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-06T18:06:09.410166] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-06T18:06:09.410234] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-06T18:06:09.412142] [DEBUG] [LOCAL ] CMI: Trimmed 60118 records to 41714 (keeping 200 days of data) [2025-10-06T18:06:09.469004] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-06T18:06:09.715798] [DEBUG] [LOCAL ] CMI: Primary data saved (41714 records). [2025-10-06T18:06:09.715984] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-06T18:06:09.716849] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMI took 39.6s. Estimated remaining: 4h 21m 45s. Rate: 7.2 symbols/min [2025-10-06T18:06:10.189635] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T18:06:10.225590] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-06T18:06:10.469302] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T18:06:11.025587] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-06T18:06:11.844120] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T18:06:11.853977] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-06T18:06:11.905088] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T18:06:12.625543] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-06T18:06:13.378696] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T18:06:13.425477] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-06T18:06:13.677981] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T18:06:13.679908] [INFO ] [REMOTE ] CMP: Full fetch complete (52269 records). [2025-10-06T18:06:13.680007] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-06T18:06:14.056234] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-06T18:06:14.056346] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-06T18:06:14.057124] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-06T18:06:14.057250] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-06T18:06:14.058611] [DEBUG] [LOCAL ] CMP: Trimmed 52269 records to 36092 (keeping 200 days of data) [2025-10-06T18:06:14.266759] [DEBUG] [LOCAL ] CMP: Primary data saved (36092 records). [2025-10-06T18:06:14.266945] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-06T18:06:14.267037] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMP took 27.6s. Estimated remaining: 4h 21m 22s. Rate: 7.2 symbols/min [2025-10-06T18:06:15.027970] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T18:06:15.037781] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-06T18:06:16.699105] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T18:06:16.708476] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-06T18:06:18.209304] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T18:06:18.217749] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-06T18:06:19.749775] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T18:06:19.759387] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-06T18:06:21.219584] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T18:06:21.228098] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-06T18:06:22.649523] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T18:06:22.652893] [INFO ] [REMOTE ] CMPO: Full fetch complete (58841 records). [2025-10-06T18:06:22.653007] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-06T18:06:23.130050] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-06T18:06:23.130203] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-06T18:06:23.131324] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-06T18:06:23.131407] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-06T18:06:23.133111] [DEBUG] [LOCAL ] CMPO: Trimmed 58841 records to 39064 (keeping 200 days of data) [2025-10-06T18:06:23.357765] [DEBUG] [LOCAL ] CMPO: Primary data saved (39064 records). [2025-10-06T18:06:23.357946] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-06T18:06:23.358038] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMPO took 20.5s. Estimated remaining: 4h 21m 17s. Rate: 7.2 symbols/min [2025-10-06T18:06:23.868756] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:06:23.969043] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:06:24.040734] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:06:24.041791] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:06:24.049536] [DEBUG] [LOCAL ] CMSA: Loaded 3544 existing records from primary storage. [2025-10-06T18:06:24.051113] [INFO ] [MAIN ] CMSA: Loaded 3544 existing records. [2025-10-06T18:06:24.070946] [DEBUG] [LOCAL ] CMSC: Loaded 5138 existing records from primary storage. [2025-10-06T18:06:24.110259] [INFO ] [MAIN ] CMSC: Loaded 5138 existing records. [2025-10-06T18:06:24.404518] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:06:24.411424] [DEBUG] [LOCAL ] CMS: Loaded 53374 existing records from primary storage. [2025-10-06T18:06:24.411613] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-06T18:06:24.410744] [DEBUG] [LOCAL ] CMRE: Loaded 35928 existing records from primary storage. [2025-10-06T18:06:24.422183] [INFO ] [MAIN ] CMS: Loaded 53374 existing records. [2025-10-06T18:06:24.445815] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-06T18:06:24.466150] [INFO ] [MAIN ] CMRE: Loaded 35928 existing records. [2025-10-06T18:06:24.514951] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:06:24.483222] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-06T18:06:24.539695] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-06T18:06:24.647956] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-06T18:06:24.746899] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-06T18:06:24.831483] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:06:24.937281] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-06T18:06:24.931813] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-06T18:06:24.951503] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-06T18:06:24.993925] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-06T18:06:24.996726] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-06T18:06:25.002003] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-06T18:06:25.005052] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:06:25.077171] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-06T18:06:25.128898] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-06T18:06:25.203451] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-06T18:06:25.259955] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-06T18:06:25.946741] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:06:26.029596] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-06T18:06:26.298918] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:06:26.326033] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-06T18:06:26.456305] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:06:26.480355] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-06T18:06:26.479888] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:06:26.481909] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-06T18:06:26.895601] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T18:06:26.897498] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-06T18:06:27.214143] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-06T18:06:27.216004] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-06T18:06:27.449856] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-06T18:06:27.451427] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-06T18:06:27.572370] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-06T18:06:27.578048] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-06T18:06:27.633257] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-06T18:06:27.635043] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-06T18:06:27.772815] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-06T18:06:27.774301] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-06T18:06:28.009905] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T18:06:28.020826] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-06T18:06:28.112494] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-06T18:06:28.113983] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-06T18:06:28.192913] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-06T18:06:28.194344] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-06T18:06:28.489960] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-06T18:06:28.625538] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-06T18:06:28.710353] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T18:06:28.837463] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-06T18:06:29.319762] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-06T18:06:29.425595] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-06T18:06:29.655346] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T18:06:30.225637] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-06T18:06:30.834239] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-06T18:06:30.839683] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T18:06:31.025608] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-06T18:06:31.825587] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-06T18:06:32.432319] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-06T18:06:32.625503] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-06T18:06:32.660879] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T18:06:33.200635] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-06T18:06:33.425543] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-06T18:06:33.993628] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-06T18:06:34.225557] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-06T18:06:34.822634] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T18:06:35.025541] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-06T18:06:35.646374] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-06T18:06:35.825551] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-06T18:06:36.625533] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-06T18:06:37.283242] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-06T18:06:37.349694] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T18:06:37.425512] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-06T18:06:38.225550] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-06T18:06:39.025547] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-06T18:06:39.258933] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T18:06:39.585841] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-06T18:06:39.825491] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-06T18:06:39.938805] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T18:06:40.625564] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-06T18:06:41.135197] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T18:06:41.136081] [INFO ] [REMOTE ] CMSA: Full fetch complete (5103 records). [2025-10-06T18:06:41.136152] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-06T18:06:41.435913] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-06T18:06:41.518309] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-06T18:06:41.518837] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-06T18:06:41.519133] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-06T18:06:41.519205] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-06T18:06:41.520071] [DEBUG] [LOCAL ] CMSA: Trimmed 5103 records to 3513 (keeping 200 days of data) [2025-10-06T18:06:41.580141] [DEBUG] [LOCAL ] CMSA: Primary data saved (3513 records). [2025-10-06T18:06:41.580357] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-06T18:06:41.580511] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSA took 18.2s. Estimated remaining: 4h 21m 47s. Rate: 7.2 symbols/min [2025-10-06T18:06:41.649467] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T18:06:41.775999] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:06:41.788697] [DEBUG] [LOCAL ] CMSD: Loaded 8171 existing records from primary storage. [2025-10-06T18:06:41.789081] [INFO ] [MAIN ] CMSD: Loaded 8171 existing records. [2025-10-06T18:06:41.973449] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:06:41.973757] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-06T18:06:41.973810] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-06T18:06:41.974093] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-06T18:06:41.974149] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-06T18:06:42.230726] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-06T18:06:42.340109] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:06:42.950760] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T18:06:43.025530] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-06T18:06:43.758584] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T18:06:43.825471] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-06T18:06:44.477099] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T18:06:44.625519] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-06T18:06:45.283695] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-06T18:06:45.367055] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T18:06:45.425521] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-06T18:06:46.225568] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-06T18:06:47.025517] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-06T18:06:47.269058] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T18:06:47.294557] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T18:06:47.446264] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-06T18:06:47.825545] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-06T18:06:48.624350] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-06T18:06:48.626624] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-06T18:06:49.425532] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-06T18:06:50.042500] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T18:06:50.232262] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-06T18:06:50.253910] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T18:06:50.984178] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T18:06:51.025518] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-06T18:06:51.830287] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-06T18:06:51.833295] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T18:06:52.625601] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-06T18:06:53.360759] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T18:06:53.425493] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-06T18:06:53.590227] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T18:06:54.005843] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-06T18:06:54.006739] [INFO ] [REMOTE ] CMSC: Full fetch complete (7179 records). [2025-10-06T18:06:54.006808] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-06T18:06:54.235117] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-06T18:06:54.364528] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-06T18:06:54.364621] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-06T18:06:54.364857] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-06T18:06:54.364912] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-06T18:06:54.365291] [DEBUG] [LOCAL ] CMSC: Trimmed 7179 records to 5062 (keeping 200 days of data) [2025-10-06T18:06:54.395569] [DEBUG] [LOCAL ] CMSC: Primary data saved (5062 records). [2025-10-06T18:06:54.395770] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-06T18:06:54.395872] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSC took 31.0s. Estimated remaining: 4h 21m 57s. Rate: 7.2 symbols/min [2025-10-06T18:06:54.560900] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:06:54.600849] [DEBUG] [LOCAL ] CMTG: Loaded 37256 existing records from primary storage. [2025-10-06T18:06:54.601193] [INFO ] [MAIN ] CMTG: Loaded 37256 existing records. [2025-10-06T18:06:54.775095] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:06:54.775318] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-06T18:06:54.775365] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-06T18:06:54.775718] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-06T18:06:54.775775] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-06T18:06:55.030789] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-06T18:06:55.125663] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:06:55.666473] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T18:06:55.825556] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-06T18:06:56.625601] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-06T18:06:56.801138] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T18:06:57.319183] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T18:06:57.425501] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-06T18:06:57.464405] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-06T18:06:58.225528] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-06T18:06:58.985365] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T18:06:58.989122] [INFO ] [REMOTE ] CMS: Full fetch complete (76008 records). [2025-10-06T18:06:58.989353] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-06T18:06:59.030868] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-06T18:06:59.206353] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T18:06:59.435206] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-06T18:06:59.435313] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-06T18:06:59.436664] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-06T18:06:59.436737] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-06T18:06:59.439036] [DEBUG] [LOCAL ] CMS: Trimmed 76008 records to 52610 (keeping 200 days of data) [2025-10-06T18:06:59.789261] [DEBUG] [LOCAL ] CMS: Primary data saved (52610 records). [2025-10-06T18:06:59.789451] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-06T18:06:59.790632] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMS took 36.4s. Estimated remaining: 4h 21m 37s. Rate: 7.2 symbols/min [2025-10-06T18:06:59.830864] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-06T18:06:59.977189] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:06:59.989431] [DEBUG] [LOCAL ] CMU: Loaded 6911 existing records from primary storage. [2025-10-06T18:06:59.989745] [INFO ] [MAIN ] CMU: Loaded 6911 existing records. [2025-10-06T18:07:00.222755] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:07:00.223060] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-06T18:07:00.223111] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-06T18:07:00.223331] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-06T18:07:00.223391] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-06T18:07:00.640912] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-06T18:07:00.640697] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T18:07:00.705926] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:07:01.425506] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-06T18:07:01.574350] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T18:07:01.650310] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-06T18:07:02.225544] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-06T18:07:02.794790] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T18:07:02.897412] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T18:07:03.025590] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-06T18:07:03.586582] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T18:07:03.587611] [INFO ] [REMOTE ] CMSD: Full fetch complete (12276 records). [2025-10-06T18:07:03.587731] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-06T18:07:03.832087] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-06T18:07:03.964191] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-06T18:07:03.964296] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-06T18:07:03.964661] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-06T18:07:03.964722] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-06T18:07:03.965180] [DEBUG] [LOCAL ] CMSD: Trimmed 12276 records to 8028 (keeping 200 days of data) [2025-10-06T18:07:04.013252] [DEBUG] [LOCAL ] CMSD: Primary data saved (8028 records). [2025-10-06T18:07:04.013392] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-06T18:07:04.013475] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMSD took 22.4s. Estimated remaining: 4h 21m 13s. Rate: 7.2 symbols/min [2025-10-06T18:07:04.182045] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:07:04.226530] [DEBUG] [LOCAL ] CNA: Loaded 33259 existing records from primary storage. [2025-10-06T18:07:04.226931] [INFO ] [MAIN ] CNA: Loaded 33259 existing records. [2025-10-06T18:07:04.404603] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:07:04.404861] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-06T18:07:04.404915] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-06T18:07:04.405478] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-06T18:07:04.405536] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-06T18:07:04.630719] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-06T18:07:04.685463] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T18:07:04.765566] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:07:05.425626] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-06T18:07:06.225551] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-06T18:07:06.227424] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T18:07:06.740064] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T18:07:07.025536] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-06T18:07:07.455115] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T18:07:07.457374] [INFO ] [REMOTE ] CMRE: Full fetch complete (50174 records). [2025-10-06T18:07:07.457510] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-06T18:07:07.830728] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-06T18:07:07.831230] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-06T18:07:07.832224] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-06T18:07:07.833073] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-06T18:07:07.833211] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-06T18:07:07.834500] [DEBUG] [LOCAL ] CMRE: Trimmed 50174 records to 35445 (keeping 200 days of data) [2025-10-06T18:07:08.081816] [DEBUG] [LOCAL ] CMRE: Primary data saved (35445 records). [2025-10-06T18:07:08.082034] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-06T18:07:08.082164] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMRE took 44.7s. Estimated remaining: 4h 20m 48s. Rate: 7.2 symbols/min [2025-10-06T18:07:08.298145] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-06T18:07:08.303516] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:07:08.333192] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-06T18:07:08.374767] [DEBUG] [LOCAL ] CNC: Loaded 54518 existing records from primary storage. [2025-10-06T18:07:08.375270] [INFO ] [MAIN ] CNC: Loaded 54518 existing records. [2025-10-06T18:07:08.557689] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:07:08.557996] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-06T18:07:08.558049] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-06T18:07:08.558550] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-06T18:07:08.558612] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-06T18:07:08.630805] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-06T18:07:08.925761] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:07:09.425552] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-06T18:07:09.937902] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T18:07:10.225576] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-06T18:07:11.025535] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-06T18:07:11.361921] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-06T18:07:11.825497] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-06T18:07:11.858544] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T18:07:12.448500] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T18:07:12.625591] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-06T18:07:13.425571] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-06T18:07:13.592572] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T18:07:13.788025] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-06T18:07:14.131530] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T18:07:14.225545] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-06T18:07:15.025558] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-06T18:07:15.060158] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-06T18:07:15.825555] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-06T18:07:16.538102] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T18:07:16.625516] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-06T18:07:17.198519] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T18:07:17.425551] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-06T18:07:17.882873] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T18:07:18.225725] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-06T18:07:19.025590] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-06T18:07:19.158843] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T18:07:19.657811] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T18:07:19.825560] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-06T18:07:20.502972] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T18:07:20.625588] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-06T18:07:21.425576] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-06T18:07:21.826309] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-06T18:07:22.084094] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T18:07:22.225689] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-06T18:07:22.905392] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T18:07:23.025522] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-06T18:07:23.825571] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-06T18:07:24.139942] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-06T18:07:24.361288] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T18:07:24.612925] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-06T18:07:24.625462] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-06T18:07:25.358377] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-06T18:07:25.425596] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-06T18:07:26.225629] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-06T18:07:27.025543] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-06T18:07:27.279921] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T18:07:27.580403] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T18:07:27.825495] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-06T18:07:28.285677] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T18:07:28.625611] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-06T18:07:29.425492] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-06T18:07:29.887162] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T18:07:30.022162] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T18:07:30.027001] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-06T18:07:30.225527] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-06T18:07:31.025544] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-06T18:07:31.825556] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-06T18:07:31.866007] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T18:07:32.412314] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-06T18:07:32.625530] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-06T18:07:32.812282] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-06T18:07:32.815629] [INFO ] [REMOTE ] CMTG: Full fetch complete (53651 records). [2025-10-06T18:07:32.815885] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-06T18:07:33.248336] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-06T18:07:33.248462] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-06T18:07:33.249293] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-06T18:07:33.249375] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-06T18:07:33.250992] [DEBUG] [LOCAL ] CMTG: Trimmed 53651 records to 36405 (keeping 200 days of data) [2025-10-06T18:07:33.436615] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-06T18:07:33.469095] [DEBUG] [LOCAL ] CMTG: Primary data saved (36405 records). [2025-10-06T18:07:33.469290] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-06T18:07:33.469397] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMTG took 39.1s. Estimated remaining: 4h 21m 46s. Rate: 7.2 symbols/min [2025-10-06T18:07:33.650038] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:07:33.650278] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-10-06T18:07:33.650318] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-10-06T18:07:33.650439] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-06T18:07:33.650482] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-06T18:07:33.650525] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-06T18:07:33.650558] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-06T18:07:34.041579] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:07:34.225584] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-06T18:07:34.574757] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T18:07:34.578295] [INFO ] [REMOTE ] CNA: Full fetch complete (45639 records). [2025-10-06T18:07:34.578511] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-06T18:07:34.912263] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-06T18:07:35.013597] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-06T18:07:35.013801] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-06T18:07:35.014593] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-06T18:07:35.014697] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-06T18:07:35.026882] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-06T18:07:35.049098] [DEBUG] [LOCAL ] CNA: Trimmed 45639 records to 32857 (keeping 200 days of data) [2025-10-06T18:07:35.052538] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-06T18:07:35.277150] [DEBUG] [LOCAL ] CNA: Primary data saved (32857 records). [2025-10-06T18:07:35.277376] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-06T18:07:35.277486] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CNA took 31.3s. Estimated remaining: 4h 21m 12s. Rate: 7.2 symbols/min [2025-10-06T18:07:35.458411] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:07:35.521891] [DEBUG] [LOCAL ] CNH: Loaded 54333 existing records from primary storage. [2025-10-06T18:07:35.522324] [INFO ] [MAIN ] CNH: Loaded 54333 existing records. [2025-10-06T18:07:35.709604] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:07:35.709897] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-06T18:07:35.709950] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-06T18:07:35.710978] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-06T18:07:35.711043] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-06T18:07:35.830614] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-06T18:07:36.016411] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T18:07:36.127158] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:07:36.589808] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-06T18:07:36.625561] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-06T18:07:37.251130] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T18:07:37.425582] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-06T18:07:37.881632] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-06T18:07:38.225534] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-06T18:07:38.980775] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T18:07:39.025601] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-06T18:07:39.581073] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T18:07:39.582006] [INFO ] [REMOTE ] CMU: Full fetch complete (9678 records). [2025-10-06T18:07:39.582080] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-06T18:07:39.830776] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-06T18:07:39.993582] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-06T18:07:39.993695] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-06T18:07:39.994063] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-06T18:07:39.994129] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-06T18:07:39.994619] [DEBUG] [LOCAL ] CMU: Trimmed 9678 records to 6438 (keeping 200 days of data) [2025-10-06T18:07:40.033875] [DEBUG] [LOCAL ] CMU: Primary data saved (6438 records). [2025-10-06T18:07:40.034050] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-06T18:07:40.034174] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CMU took 40.2s. Estimated remaining: 4h 20m 50s. Rate: 7.2 symbols/min [2025-10-06T18:07:40.215430] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:07:40.276007] [DEBUG] [LOCAL ] CNI: Loaded 52388 existing records from primary storage. [2025-10-06T18:07:40.276459] [INFO ] [MAIN ] CNI: Loaded 52388 existing records. [2025-10-06T18:07:40.473335] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:07:40.473918] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-06T18:07:40.473982] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-06T18:07:40.474518] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-06T18:07:40.474583] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-06T18:07:40.630772] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-06T18:07:40.863430] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:07:41.326535] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T18:07:41.425554] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-06T18:07:41.993378] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-06T18:07:42.211997] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T18:07:42.225483] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-06T18:07:43.025568] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-06T18:07:43.315425] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T18:07:43.825561] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-06T18:07:44.626230] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-06T18:07:44.630524] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T18:07:45.382453] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T18:07:45.425474] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-06T18:07:45.942870] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-06T18:07:45.946437] [INFO ] [REMOTE ] CNC: Full fetch complete (77673 records). [2025-10-06T18:07:45.946614] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-06T18:07:46.225962] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-06T18:07:46.376763] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-06T18:07:46.377002] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-06T18:07:46.378122] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-06T18:07:46.378197] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-06T18:07:46.380355] [DEBUG] [LOCAL ] CNC: Trimmed 77673 records to 53745 (keeping 200 days of data) [2025-10-06T18:07:46.482689] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T18:07:46.747637] [DEBUG] [LOCAL ] CNC: Primary data saved (53745 records). [2025-10-06T18:07:46.747883] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-06T18:07:46.748006] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNC took 38.7s. Estimated remaining: 4h 20m 36s. Rate: 7.2 symbols/min [2025-10-06T18:07:46.938049] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:07:46.997389] [DEBUG] [LOCAL ] CNK: Loaded 53649 existing records from primary storage. [2025-10-06T18:07:46.997865] [INFO ] [MAIN ] CNK: Loaded 53649 existing records. [2025-10-06T18:07:47.031364] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-06T18:07:47.193491] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:07:47.193809] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-06T18:07:47.193864] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-06T18:07:47.194218] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-06T18:07:47.194278] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-06T18:07:47.581028] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:07:47.825535] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-06T18:07:48.019814] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T18:07:48.181334] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T18:07:48.625541] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-06T18:07:49.425498] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-06T18:07:49.541517] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T18:07:50.225577] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-06T18:07:50.291583] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T18:07:51.025506] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-06T18:07:51.225418] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T18:07:51.723308] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T18:07:51.724902] [INFO ] [REMOTE ] CNF: Full fetch complete (13010 records). [2025-10-06T18:07:51.725058] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-06T18:07:51.825550] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-06T18:07:52.174248] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-06T18:07:52.174849] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-06T18:07:52.179037] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-06T18:07:52.179157] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-06T18:07:52.178301] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-06T18:07:52.191184] [DEBUG] [LOCAL ] CNF: Trimmed 13010 records to 10495 (keeping 200 days of data) [2025-10-06T18:07:52.254420] [DEBUG] [LOCAL ] CNF: Primary data saved (10495 records). [2025-10-06T18:07:52.254620] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-06T18:07:52.254757] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNF took 18.8s. Estimated remaining: 4h 20m 17s. Rate: 7.2 symbols/min [2025-10-06T18:07:52.438091] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:07:52.497558] [DEBUG] [LOCAL ] CNM: Loaded 51723 existing records from primary storage. [2025-10-06T18:07:52.498016] [INFO ] [MAIN ] CNM: Loaded 51723 existing records. [2025-10-06T18:07:52.630759] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-06T18:07:52.706405] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:07:52.706783] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-06T18:07:52.706841] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-06T18:07:52.707409] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-06T18:07:52.707472] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-06T18:07:53.108231] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:07:53.425540] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-06T18:07:53.560896] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T18:07:54.225515] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-06T18:07:54.377030] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T18:07:54.872901] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T18:07:55.025548] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-06T18:07:55.825547] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-06T18:07:56.255166] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-06T18:07:56.436583] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T18:07:56.625522] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-06T18:07:57.425556] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-06T18:07:57.469577] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T18:07:58.225608] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-06T18:07:58.513729] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T18:07:59.025525] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-06T18:07:59.085187] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T18:07:59.677383] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T18:07:59.825534] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-06T18:08:00.625610] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-06T18:08:00.759751] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T18:08:01.425609] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-06T18:08:01.704709] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-06T18:08:02.225540] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-06T18:08:02.389036] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T18:08:03.025589] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-06T18:08:03.254591] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-06T18:08:03.825507] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-06T18:08:03.939245] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T18:08:04.625521] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-06T18:08:04.750145] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T18:08:05.425508] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-06T18:08:05.726877] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T18:08:06.099990] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T18:08:06.225529] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-06T18:08:07.031604] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-06T18:08:07.065372] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T18:08:07.825527] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-06T18:08:07.994090] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T18:08:08.630673] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-06T18:08:08.655126] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T18:08:09.425603] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-06T18:08:09.736779] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-06T18:08:10.225546] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-06T18:08:10.362216] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T18:08:10.905508] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T18:08:11.025580] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-06T18:08:11.825546] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-06T18:08:12.081273] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-06T18:08:12.625503] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-06T18:08:12.824523] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T18:08:13.425500] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-06T18:08:13.751499] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-06T18:08:14.225612] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-06T18:08:14.248322] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-06T18:08:14.252196] [INFO ] [REMOTE ] CNI: Full fetch complete (74571 records). [2025-10-06T18:08:14.252507] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-06T18:08:14.829536] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-06T18:08:14.829773] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-06T18:08:14.831503] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-06T18:08:14.831667] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-06T18:08:14.834390] [DEBUG] [LOCAL ] CNI: Trimmed 74571 records to 51661 (keeping 200 days of data) [2025-10-06T18:08:15.025903] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-06T18:08:15.032252] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T18:08:15.365952] [DEBUG] [LOCAL ] CNI: Primary data saved (51661 records). [2025-10-06T18:08:15.366216] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-06T18:08:15.367129] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNI took 35.3s. Estimated remaining: 4h 21m 5s. Rate: 7.2 symbols/min [2025-10-06T18:08:15.574098] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:08:15.614789] [DEBUG] [LOCAL ] CNMD: Loaded 32705 existing records from primary storage. [2025-10-06T18:08:15.615100] [INFO ] [MAIN ] CNMD: Loaded 32705 existing records. [2025-10-06T18:08:15.809831] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T18:08:15.820825] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:08:15.821979] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-06T18:08:15.822043] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-06T18:08:15.822336] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-06T18:08:15.822397] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-06T18:08:15.834018] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-06T18:08:15.844156] [INFO ] [REMOTE ] CNH: Full fetch complete (77148 records). [2025-10-06T18:08:15.882730] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-06T18:08:15.934890] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:08:15.935559] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:08:15.946364] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:08:15.982169] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-06T18:08:16.000727] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-06T18:08:16.016736] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-10-06T18:08:16.092893] [DEBUG] [LOCAL ] CNH: Deleted derivative data file. [2025-10-06T18:08:16.103959] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNH took 40.8s. Estimated remaining: 4h 20m 28s. Rate: 7.2 symbols/min [2025-10-06T18:08:16.366754] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:08:16.397318] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:08:16.447750] [DEBUG] [LOCAL ] CNNE: Loaded 36931 existing records from primary storage. [2025-10-06T18:08:16.448217] [INFO ] [MAIN ] CNNE: Loaded 36931 existing records. [2025-10-06T18:08:16.644805] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-06T18:08:16.652905] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:08:16.653599] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-06T18:08:16.654865] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-06T18:08:16.655109] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-06T18:08:16.655171] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-06T18:08:17.049558] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:08:17.087501] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-06T18:08:17.425565] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-06T18:08:17.648902] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-06T18:08:18.128836] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T18:08:18.225552] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-06T18:08:19.025566] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-06T18:08:19.180771] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T18:08:19.825508] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-06T18:08:19.980001] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T18:08:20.289227] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T18:08:20.625545] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-06T18:08:21.337025] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T18:08:21.340495] [INFO ] [REMOTE ] CNK: Full fetch complete (75821 records). [2025-10-06T18:08:21.340625] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-06T18:08:21.430381] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-06T18:08:21.748272] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-06T18:08:21.748426] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-06T18:08:21.749398] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-06T18:08:21.749483] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-06T18:08:21.765261] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T18:08:21.771570] [DEBUG] [LOCAL ] CNK: Trimmed 75821 records to 52882 (keeping 200 days of data) [2025-10-06T18:08:22.112861] [DEBUG] [LOCAL ] CNK: Primary data saved (52882 records). [2025-10-06T18:08:22.113054] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-06T18:08:22.113162] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNK took 35.4s. Estimated remaining: 4h 20m 11s. Rate: 7.2 symbols/min [2025-10-06T18:08:22.230713] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-06T18:08:22.292242] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:08:22.336725] [DEBUG] [LOCAL ] CNO: Loaded 41722 existing records from primary storage. [2025-10-06T18:08:22.337239] [INFO ] [MAIN ] CNO: Loaded 41722 existing records. [2025-10-06T18:08:22.533029] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:08:22.533373] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-06T18:08:22.533439] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-06T18:08:22.533948] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-06T18:08:22.534021] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-06T18:08:22.941790] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:08:23.011523] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T18:08:23.025489] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-06T18:08:23.693880] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T18:08:23.825551] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-06T18:08:24.625501] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-06T18:08:24.818517] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T18:08:25.425487] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-06T18:08:25.468958] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T18:08:25.817904] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T18:08:26.225542] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-06T18:08:26.988179] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T18:08:26.993037] [INFO ] [REMOTE ] CNM: Full fetch complete (73653 records). [2025-10-06T18:08:26.993256] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-06T18:08:27.037890] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-06T18:08:27.408628] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-06T18:08:27.408824] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-06T18:08:27.409712] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-06T18:08:27.409778] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-06T18:08:27.411396] [DEBUG] [LOCAL ] CNM: Trimmed 73653 records to 51030 (keeping 200 days of data) [2025-10-06T18:08:27.726712] [DEBUG] [LOCAL ] CNM: Primary data saved (51030 records). [2025-10-06T18:08:27.727191] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-06T18:08:27.727471] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNM took 35.5s. Estimated remaining: 4h 19m 52s. Rate: 7.2 symbols/min [2025-10-06T18:08:27.830844] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-06T18:08:27.913199] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T18:08:27.945767] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:08:27.998760] [DEBUG] [LOCAL ] CNP: Loaded 54248 existing records from primary storage. [2025-10-06T18:08:27.999161] [INFO ] [MAIN ] CNP: Loaded 54248 existing records. [2025-10-06T18:08:28.180809] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:08:28.181102] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-06T18:08:28.181150] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-06T18:08:28.181721] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-06T18:08:28.181780] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-06T18:08:28.544565] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:08:28.625588] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-06T18:08:28.859367] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T18:08:29.270914] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T18:08:29.425520] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-06T18:08:30.066500] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T18:08:30.225571] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-06T18:08:30.851841] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T18:08:31.025588] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-06T18:08:31.775546] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T18:08:31.825545] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-06T18:08:32.289703] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T18:08:32.625552] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-06T18:08:33.165620] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T18:08:33.425562] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-06T18:08:34.225531] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-06T18:08:34.432072] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-06T18:08:34.770235] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T18:08:35.025542] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-06T18:08:35.354222] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T18:08:35.825571] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-06T18:08:36.625562] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-06T18:08:36.852737] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T18:08:37.305720] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T18:08:37.425550] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-06T18:08:37.909456] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T18:08:38.225565] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-06T18:08:38.879167] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T18:08:39.025552] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-06T18:08:39.825553] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-06T18:08:39.915597] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T18:08:40.630932] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-06T18:08:40.635841] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T18:08:41.246266] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T18:08:41.425484] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-06T18:08:41.940098] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T18:08:42.225495] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-06T18:08:42.731248] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T18:08:43.025615] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-06T18:08:43.772914] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T18:08:43.825478] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-06T18:08:44.525712] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T18:08:44.625533] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-06T18:08:45.425503] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-06T18:08:45.610160] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T18:08:46.007339] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T18:08:46.225590] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-06T18:08:46.609594] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T18:08:46.611703] [INFO ] [REMOTE ] CNMD: Full fetch complete (47336 records). [2025-10-06T18:08:46.611787] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-06T18:08:47.003627] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-06T18:08:47.003785] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-06T18:08:47.005149] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-06T18:08:47.005218] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-06T18:08:47.006976] [DEBUG] [LOCAL ] CNMD: Trimmed 47336 records to 32267 (keeping 200 days of data) [2025-10-06T18:08:47.060665] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-06T18:08:47.217501] [DEBUG] [LOCAL ] CNMD: Primary data saved (32267 records). [2025-10-06T18:08:47.217733] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-06T18:08:47.218441] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNMD took 31.9s. Estimated remaining: 4h 20m 26s. Rate: 7.2 symbols/min [2025-10-06T18:08:47.396059] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:08:47.457939] [DEBUG] [LOCAL ] CNQ: Loaded 54359 existing records from primary storage. [2025-10-06T18:08:47.458382] [INFO ] [MAIN ] CNQ: Loaded 54359 existing records. [2025-10-06T18:08:47.654794] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:08:47.655174] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-06T18:08:47.655234] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-06T18:08:47.655711] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-06T18:08:47.655772] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-06T18:08:47.838603] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-06T18:08:48.043013] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:08:48.075871] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T18:08:48.621566] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T18:08:48.629213] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-06T18:08:49.425539] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-06T18:08:49.646844] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T18:08:50.225538] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-06T18:08:50.527826] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T18:08:51.025507] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-06T18:08:51.073353] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T18:08:51.825819] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-06T18:08:52.174945] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T18:08:52.625591] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-06T18:08:52.986540] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T18:08:53.019520] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T18:08:53.425573] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-06T18:08:54.230710] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-06T18:08:54.244085] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T18:08:55.025505] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-06T18:08:55.388752] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T18:08:55.598402] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T18:08:55.601736] [INFO ] [REMOTE ] CNNE: Full fetch complete (50176 records). [2025-10-06T18:08:55.601850] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-06T18:08:55.835827] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-06T18:08:55.985268] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-06T18:08:55.985358] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-06T18:08:55.986018] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-06T18:08:55.986081] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-06T18:08:55.987258] [DEBUG] [LOCAL ] CNNE: Trimmed 50176 records to 36348 (keeping 200 days of data) [2025-10-06T18:08:56.210865] [DEBUG] [LOCAL ] CNNE: Primary data saved (36348 records). [2025-10-06T18:08:56.211058] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-06T18:08:56.211169] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNNE took 40.1s. Estimated remaining: 4h 20m 20s. Rate: 7.2 symbols/min [2025-10-06T18:08:56.379808] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:08:56.380031] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-06T18:08:56.380086] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-06T18:08:56.380203] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-06T18:08:56.380243] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-06T18:08:56.380311] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-06T18:08:56.380355] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-06T18:08:56.628566] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-06T18:08:56.749125] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:08:56.855768] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T18:08:57.203460] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T18:08:57.206083] [INFO ] [REMOTE ] CNO: Full fetch complete (60665 records). [2025-10-06T18:08:57.206246] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-06T18:08:57.430785] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-06T18:08:57.589770] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-06T18:08:57.589874] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-06T18:08:57.590614] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-06T18:08:57.590697] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-06T18:08:57.591899] [DEBUG] [LOCAL ] CNO: Trimmed 60665 records to 40924 (keeping 200 days of data) [2025-10-06T18:08:57.834672] [DEBUG] [LOCAL ] CNO: Primary data saved (40924 records). [2025-10-06T18:08:57.834834] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-06T18:08:57.834926] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNO took 35.7s. Estimated remaining: 4h 19m 47s. Rate: 7.2 symbols/min [2025-10-06T18:08:58.038589] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:08:58.038873] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-06T18:08:58.038916] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-06T18:08:58.039036] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-06T18:08:58.039077] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-06T18:08:58.039119] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-06T18:08:58.039150] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-06T18:08:58.193335] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T18:08:58.227158] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-06T18:08:58.243130] [INFO ] [REMOTE ] CNP: Full fetch complete (77368 records). [2025-10-06T18:08:58.267376] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-06T18:08:58.599106] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:08:58.606696] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:08:58.637116] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-06T18:08:58.666572] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:08:58.673736] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-06T18:08:58.696334] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:08:58.718573] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-06T18:08:58.742207] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-06T18:08:58.748133] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-06T18:08:58.758879] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-06T18:08:58.764122] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNR took 2.6s. Estimated remaining: 4h 19m 11s. Rate: 7.2 symbols/min [2025-10-06T18:08:59.031241] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-06T18:08:59.057304] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-06T18:08:59.065205] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-06T18:08:59.086109] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:08:59.066235] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-06T18:08:59.092710] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-06T18:08:59.097689] [DEBUG] [LOCAL ] CNP: Trimmed 77368 records to 53471 (keeping 200 days of data) [2025-10-06T18:08:59.287861] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T18:08:59.311097] [DEBUG] [LOCAL ] CNX: Loaded 52109 existing records from primary storage. [2025-10-06T18:08:59.314505] [INFO ] [MAIN ] CNX: Loaded 52109 existing records. [2025-10-06T18:08:59.521802] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:08:59.523707] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-06T18:08:59.523792] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-06T18:08:59.524967] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-06T18:08:59.525308] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-06T18:08:59.835402] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-06T18:09:00.022990] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:09:00.138569] [DEBUG] [LOCAL ] CNP: Primary data saved (53471 records). [2025-10-06T18:09:00.138778] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-06T18:09:00.138888] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNP took 32.4s. Estimated remaining: 4h 18m 36s. Rate: 7.2 symbols/min [2025-10-06T18:09:00.270930] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T18:09:00.321131] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:09:00.360045] [DEBUG] [LOCAL ] CODI: Loaded 40570 existing records from primary storage. [2025-10-06T18:09:00.360374] [INFO ] [MAIN ] CODI: Loaded 40570 existing records. [2025-10-06T18:09:00.534599] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:09:00.534814] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-06T18:09:00.534859] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-06T18:09:00.535141] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-06T18:09:00.535198] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-06T18:09:00.630743] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-06T18:09:00.882516] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:09:01.425602] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-06T18:09:02.041699] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-06T18:09:02.225614] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-06T18:09:02.770853] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T18:09:03.025515] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-06T18:09:03.215693] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-06T18:09:03.297218] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T18:09:03.825531] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-06T18:09:04.625571] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-06T18:09:05.161671] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-06T18:09:05.425634] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-06T18:09:05.676851] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-06T18:09:05.723173] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T18:09:06.225558] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-06T18:09:07.025566] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-06T18:09:07.377388] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T18:09:07.410280] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T18:09:07.825609] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-06T18:09:08.626572] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-06T18:09:08.630247] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T18:09:08.876539] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T18:09:09.425544] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-06T18:09:10.225559] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-06T18:09:10.593722] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-06T18:09:11.025509] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-06T18:09:11.136576] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T18:09:11.504795] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T18:09:11.825569] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-06T18:09:12.625584] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-06T18:09:12.912183] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T18:09:13.030475] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-06T18:09:13.425614] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-06T18:09:13.764939] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T18:09:14.225549] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-06T18:09:14.445982] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T18:09:15.025540] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-06T18:09:15.760195] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T18:09:15.778164] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T18:09:15.825476] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-06T18:09:16.625555] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-06T18:09:17.110633] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-06T18:09:17.425630] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-06T18:09:18.218375] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T18:09:18.226969] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-06T18:09:18.670077] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T18:09:19.025593] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-06T18:09:19.825498] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-06T18:09:20.225041] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-06T18:09:20.625511] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-06T18:09:20.682212] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T18:09:20.908403] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-06T18:09:21.425549] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-06T18:09:22.225504] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-06T18:09:22.561610] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-06T18:09:23.034065] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-06T18:09:23.052674] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T18:09:23.374911] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-06T18:09:23.376741] [INFO ] [REMOTE ] CNS: Full fetch complete (30409 records). [2025-10-06T18:09:23.376820] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-06T18:09:23.776859] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-06T18:09:23.777517] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-06T18:09:23.778374] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-06T18:09:23.778477] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-06T18:09:23.779992] [DEBUG] [LOCAL ] CNS: Trimmed 30409 records to 20806 (keeping 200 days of data) [2025-10-06T18:09:23.833418] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-06T18:09:23.915505] [DEBUG] [LOCAL ] CNS: Primary data saved (20806 records). [2025-10-06T18:09:23.915723] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-06T18:09:23.915818] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNS took 26.1s. Estimated remaining: 4h 19m 26s. Rate: 7.2 symbols/min [2025-10-06T18:09:24.091165] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:09:24.153174] [DEBUG] [LOCAL ] COF: Loaded 54389 existing records from primary storage. [2025-10-06T18:09:24.153590] [INFO ] [MAIN ] COF: Loaded 54389 existing records. [2025-10-06T18:09:24.340492] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:09:24.340818] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-06T18:09:24.340872] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-06T18:09:24.341464] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-06T18:09:24.341524] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-06T18:09:24.629263] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-06T18:09:24.703199] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:09:24.733780] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T18:09:25.425579] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-06T18:09:26.009110] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-06T18:09:26.225551] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-06T18:09:26.336974] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T18:09:27.025497] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-06T18:09:27.070463] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T18:09:27.826015] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-06T18:09:27.832873] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T18:09:28.453750] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-06T18:09:28.625535] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-06T18:09:29.425495] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-06T18:09:29.618753] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T18:09:29.875097] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T18:09:29.881309] [INFO ] [REMOTE ] CODI: Full fetch complete (51309 records). [2025-10-06T18:09:29.881539] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-06T18:09:30.231074] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-06T18:09:30.268489] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-06T18:09:30.268599] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-06T18:09:30.269409] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-06T18:09:30.269482] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-06T18:09:30.270916] [DEBUG] [LOCAL ] CODI: Trimmed 51309 records to 40433 (keeping 200 days of data) [2025-10-06T18:09:30.534969] [DEBUG] [LOCAL ] CODI: Primary data saved (40433 records). [2025-10-06T18:09:30.535152] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-06T18:09:30.535241] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CODI took 30.4s. Estimated remaining: 4h 19m 11s. Rate: 7.2 symbols/min [2025-10-06T18:09:30.722472] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:09:30.791335] [DEBUG] [LOCAL ] COHR: Loaded 54136 existing records from primary storage. [2025-10-06T18:09:30.792169] [INFO ] [MAIN ] COHR: Loaded 54136 existing records. [2025-10-06T18:09:30.979407] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:09:30.979758] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-06T18:09:30.979909] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-06T18:09:30.980278] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-06T18:09:30.980353] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-06T18:09:31.064249] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-06T18:09:31.126580] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T18:09:31.397011] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:09:31.825547] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-06T18:09:32.139356] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T18:09:32.625626] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-06T18:09:32.729551] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-06T18:09:32.732605] [INFO ] [REMOTE ] CNQ: Full fetch complete (77550 records). [2025-10-06T18:09:32.732785] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-06T18:09:33.182306] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-06T18:09:33.182526] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-06T18:09:33.183564] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-06T18:09:33.183635] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-06T18:09:33.185400] [DEBUG] [LOCAL ] CNQ: Trimmed 77550 records to 53577 (keeping 200 days of data) [2025-10-06T18:09:33.427483] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-06T18:09:33.540569] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T18:09:33.577742] [DEBUG] [LOCAL ] CNQ: Primary data saved (53577 records). [2025-10-06T18:09:33.577953] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-06T18:09:33.578692] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CNQ took 46.4s. Estimated remaining: 4h 18m 43s. Rate: 7.2 symbols/min [2025-10-06T18:09:33.752614] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:09:33.809983] [DEBUG] [LOCAL ] COLD: Loaded 52854 existing records from primary storage. [2025-10-06T18:09:33.810413] [INFO ] [MAIN ] COLD: Loaded 52854 existing records. [2025-10-06T18:09:34.015317] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:09:34.015751] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-06T18:09:34.015823] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-06T18:09:34.016195] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-06T18:09:34.016278] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-06T18:09:34.231020] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-06T18:09:34.436151] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:09:34.788934] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-06T18:09:35.025590] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-06T18:09:35.145733] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T18:09:35.825532] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-06T18:09:36.630841] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-06T18:09:36.646980] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T18:09:37.414181] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T18:09:37.425472] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-06T18:09:38.225566] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-06T18:09:38.382839] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (4.15 seconds). [2025-10-06T18:09:38.782314] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-06T18:09:39.025547] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-06T18:09:39.102053] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T18:09:39.295955] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T18:09:39.825551] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-06T18:09:40.625565] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-06T18:09:41.020919] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-06T18:09:41.425495] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-06T18:09:41.544860] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T18:09:42.225538] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-06T18:09:42.406940] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T18:09:42.945792] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T18:09:43.025581] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-06T18:09:43.825564] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-06T18:09:43.899549] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T18:09:44.625569] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-06T18:09:45.287058] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-06T18:09:45.319090] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T18:09:45.322116] [INFO ] [REMOTE ] CNX: Full fetch complete (74731 records). [2025-10-06T18:09:45.322276] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-06T18:09:45.426890] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-06T18:09:45.717028] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-06T18:09:45.717163] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-06T18:09:45.718132] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-06T18:09:45.718220] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-06T18:09:45.719815] [DEBUG] [LOCAL ] CNX: Trimmed 74731 records to 51353 (keeping 200 days of data) [2025-10-06T18:09:46.030017] [DEBUG] [LOCAL ] CNX: Primary data saved (51353 records). [2025-10-06T18:09:46.030194] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-06T18:09:46.030282] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CNX took 47.3s. Estimated remaining: 4h 18m 50s. Rate: 7.2 symbols/min [2025-10-06T18:09:46.205152] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:09:46.225544] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-06T18:09:46.266845] [DEBUG] [LOCAL ] COMP: Loaded 54169 existing records from primary storage. [2025-10-06T18:09:46.267250] [INFO ] [MAIN ] COMP: Loaded 54169 existing records. [2025-10-06T18:09:46.492010] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:09:46.493497] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-06T18:09:46.496706] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-06T18:09:46.496569] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T18:09:46.507669] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-06T18:09:46.508052] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-06T18:09:46.865997] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:09:47.025547] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-06T18:09:47.288667] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T18:09:47.825550] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-06T18:09:48.287274] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-06T18:09:48.601892] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T18:09:48.625481] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-06T18:09:49.425566] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-06T18:09:49.820322] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-06T18:09:50.225539] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-06T18:09:50.289550] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T18:09:50.780082] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T18:09:51.025583] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-06T18:09:51.825497] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-06T18:09:51.955504] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T18:09:52.625554] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-06T18:09:53.371872] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-06T18:09:53.425492] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-06T18:09:53.483949] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T18:09:54.225615] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-06T18:09:54.629634] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-06T18:09:54.632735] [INFO ] [REMOTE ] COF: Full fetch complete (77437 records). [2025-10-06T18:09:54.632834] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-06T18:09:55.032303] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-06T18:09:55.053634] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-06T18:09:55.053884] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-06T18:09:55.055605] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-06T18:09:55.055935] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-06T18:09:55.059358] [DEBUG] [LOCAL ] COF: Trimmed 77437 records to 53609 (keeping 200 days of data) [2025-10-06T18:09:55.200758] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T18:09:55.491177] [DEBUG] [LOCAL ] COF: Primary data saved (53609 records). [2025-10-06T18:09:55.491401] [INFO ] [MAIN ] COF: Full history saved. [2025-10-06T18:09:55.492796] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COF took 31.6s. Estimated remaining: 4h 18m 46s. Rate: 7.2 symbols/min [2025-10-06T18:09:55.680944] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:09:55.732032] [DEBUG] [LOCAL ] CON: Loaded 39417 existing records from primary storage. [2025-10-06T18:09:55.732608] [INFO ] [MAIN ] CON: Loaded 39417 existing records. [2025-10-06T18:09:55.835158] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-06T18:09:55.970128] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:09:55.970556] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-06T18:09:55.970776] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-06T18:09:55.971327] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-06T18:09:55.971397] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-06T18:09:56.083235] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-06T18:09:56.389838] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:09:56.625596] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-06T18:09:56.931058] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T18:09:57.425556] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-06T18:09:57.825755] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-06T18:09:58.225481] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-06T18:09:58.524133] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T18:09:59.025595] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-06T18:09:59.362849] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-06T18:09:59.709852] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T18:09:59.712979] [INFO ] [REMOTE ] COLD: Full fetch complete (74360 records). [2025-10-06T18:09:59.713097] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-06T18:09:59.830820] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-06T18:10:00.112830] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-06T18:10:00.112961] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-06T18:10:00.114024] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-06T18:10:00.114091] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-06T18:10:00.116189] [DEBUG] [LOCAL ] COLD: Trimmed 74360 records to 52161 (keeping 200 days of data) [2025-10-06T18:10:00.455609] [DEBUG] [LOCAL ] COLD: Primary data saved (52161 records). [2025-10-06T18:10:00.455881] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-06T18:10:00.456738] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COLD took 26.9s. Estimated remaining: 4h 18m 26s. Rate: 7.2 symbols/min [2025-10-06T18:10:00.629873] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-06T18:10:00.656426] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:10:00.687020] [DEBUG] [LOCAL ] COOK: Loaded 24640 existing records from primary storage. [2025-10-06T18:10:00.687422] [INFO ] [MAIN ] COOK: Loaded 24640 existing records. [2025-10-06T18:10:00.879179] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:10:00.879422] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-06T18:10:00.879470] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-06T18:10:00.879767] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-06T18:10:00.879827] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-06T18:10:01.313665] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:10:01.355924] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-06T18:10:01.425559] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-06T18:10:02.142715] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-06T18:10:02.225513] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-06T18:10:02.832927] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-06T18:10:03.025491] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-06T18:10:03.509403] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-06T18:10:03.825548] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-06T18:10:04.469392] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T18:10:04.625524] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-06T18:10:04.736585] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-06T18:10:05.425745] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-06T18:10:05.506779] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T18:10:05.605820] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T18:10:06.225570] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-06T18:10:06.733737] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T18:10:07.025595] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-06T18:10:07.825586] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-06T18:10:08.625599] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-06T18:10:08.708159] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-06T18:10:08.906147] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-06T18:10:08.932145] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T18:10:09.425585] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-06T18:10:09.767678] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T18:10:09.944360] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-06T18:10:10.225596] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-06T18:10:11.025600] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-06T18:10:11.370339] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T18:10:11.825532] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-06T18:10:12.625501] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-06T18:10:12.926212] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T18:10:13.425541] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-06T18:10:14.070173] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T18:10:14.217742] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-06T18:10:14.221428] [INFO ] [REMOTE ] COHR: Full fetch complete (76754 records). [2025-10-06T18:10:14.221627] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-06T18:10:14.222978] [FATAL] [VALIDATOR ] COHR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:10:14.223115] [FATAL] [MAIN ] COHR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:10:14.223213] [WARN ] [MAIN ] COHR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:10:14.223304] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-06T18:10:14.223425] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-06T18:10:14.223477] [INFO ] [LOCAL ] COHR: Starting deletion of derivative data. [2025-10-06T18:10:14.223842] [DEBUG] [LOCAL ] COHR: Deleted derivative data file. [2025-10-06T18:10:14.223964] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COHR took 43.7s. Estimated remaining: 4h 18m 37s. Rate: 7.2 symbols/min [2025-10-06T18:10:14.230585] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-06T18:10:14.417608] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:10:14.472805] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-10-06T18:10:14.473233] [INFO ] [MAIN ] COP: Loaded 54507 existing records. [2025-10-06T18:10:14.654422] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:10:14.654726] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-06T18:10:14.654782] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-06T18:10:14.655249] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-06T18:10:14.655308] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-06T18:10:15.028793] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-06T18:10:15.035065] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:10:15.186944] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T18:10:15.825563] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-06T18:10:16.152674] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-06T18:10:16.205061] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T18:10:16.625620] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-06T18:10:17.425555] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-06T18:10:17.913366] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-06T18:10:18.225589] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-06T18:10:18.574910] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-06T18:10:18.646941] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-06T18:10:19.025613] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-06T18:10:19.825526] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-06T18:10:20.135292] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-06T18:10:20.625579] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-06T18:10:20.727694] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-06T18:10:20.730298] [INFO ] [REMOTE ] COMP: Full fetch complete (76802 records). [2025-10-06T18:10:20.730445] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-06T18:10:20.731492] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:10:20.731592] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:10:20.731636] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:10:20.731926] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-06T18:10:20.732032] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-06T18:10:20.732102] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-10-06T18:10:20.732386] [DEBUG] [LOCAL ] COMP: Deleted derivative data file. [2025-10-06T18:10:20.732506] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COMP took 34.7s. Estimated remaining: 4h 18m 22s. Rate: 7.2 symbols/min [2025-10-06T18:10:20.903410] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:10:20.965619] [DEBUG] [LOCAL ] COR: Loaded 47718 existing records from primary storage. [2025-10-06T18:10:20.966054] [INFO ] [MAIN ] COR: Loaded 47718 existing records. [2025-10-06T18:10:21.175460] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:10:21.175768] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-06T18:10:21.175839] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-06T18:10:21.176545] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-06T18:10:21.176608] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-06T18:10:21.434889] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-06T18:10:21.534170] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T18:10:21.585310] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:10:22.230602] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-06T18:10:22.243592] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T18:10:22.831375] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T18:10:23.025488] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-06T18:10:23.735552] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T18:10:23.825496] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-06T18:10:24.107055] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T18:10:24.625542] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-06T18:10:25.354593] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T18:10:25.425553] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-06T18:10:26.225625] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-06T18:10:26.545113] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-06T18:10:27.025569] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-06T18:10:27.057402] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T18:10:27.060215] [INFO ] [REMOTE ] CON: Full fetch complete (56905 records). [2025-10-06T18:10:27.060345] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-06T18:10:27.524785] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-06T18:10:27.525042] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-06T18:10:27.526094] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-06T18:10:27.526163] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-06T18:10:27.527993] [DEBUG] [LOCAL ] CON: Trimmed 56905 records to 38814 (keeping 200 days of data) [2025-10-06T18:10:27.781738] [DEBUG] [LOCAL ] CON: Primary data saved (38814 records). [2025-10-06T18:10:27.781929] [INFO ] [MAIN ] CON: Full history saved. [2025-10-06T18:10:27.782073] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. CON took 32.3s. Estimated remaining: 4h 18m 10s. Rate: 7.2 symbols/min [2025-10-06T18:10:27.850143] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-06T18:10:27.969331] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:10:28.025454] [DEBUG] [LOCAL ] COTY: Loaded 54004 existing records from primary storage. [2025-10-06T18:10:28.025917] [INFO ] [MAIN ] COTY: Loaded 54004 existing records. [2025-10-06T18:10:28.219613] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:10:28.220025] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-06T18:10:28.220084] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-06T18:10:28.220403] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-06T18:10:28.220494] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-06T18:10:28.622424] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:10:28.642323] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-06T18:10:28.663557] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-06T18:10:28.716101] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T18:10:29.123287] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-06T18:10:29.425608] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-06T18:10:30.225501] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-06T18:10:30.339538] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T18:10:31.025510] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-06T18:10:31.340382] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T18:10:31.375756] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T18:10:31.825593] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-06T18:10:32.625521] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-06T18:10:32.767292] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T18:10:33.425480] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-06T18:10:33.901525] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-06T18:10:33.942529] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T18:10:34.225608] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-06T18:10:34.706623] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-06T18:10:35.025566] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-06T18:10:35.269912] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-06T18:10:35.271639] [INFO ] [REMOTE ] COOK: Full fetch complete (32523 records). [2025-10-06T18:10:35.271757] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-06T18:10:35.645520] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-06T18:10:35.645610] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-06T18:10:35.646197] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-06T18:10:35.646260] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-06T18:10:35.647135] [DEBUG] [LOCAL ] COOK: Trimmed 32523 records to 24317 (keeping 200 days of data) [2025-10-06T18:10:35.780752] [DEBUG] [LOCAL ] COOK: Primary data saved (24317 records). [2025-10-06T18:10:35.780913] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-06T18:10:35.781000] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COOK took 35.3s. Estimated remaining: 4h 18m 0s. Rate: 7.2 symbols/min [2025-10-06T18:10:35.837711] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-06T18:10:35.959422] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:10:36.009016] [DEBUG] [LOCAL ] COUR: Loaded 49645 existing records from primary storage. [2025-10-06T18:10:36.009438] [INFO ] [MAIN ] COUR: Loaded 49645 existing records. [2025-10-06T18:10:36.183639] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:10:36.183977] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-06T18:10:36.184028] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-06T18:10:36.184321] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-06T18:10:36.184379] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-06T18:10:36.535683] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:10:36.625546] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-06T18:10:37.103012] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-06T18:10:37.425490] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-06T18:10:37.463550] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T18:10:38.225570] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-06T18:10:38.328529] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T18:10:39.025502] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-06T18:10:39.354935] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-06T18:10:39.480723] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T18:10:39.825558] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-06T18:10:40.617618] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T18:10:40.627025] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-06T18:10:41.425506] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-06T18:10:41.530304] [DEBUG] [REMOTE ] COP: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-06T18:10:41.530703] [WARN ] [REMOTE ] COP: No data returned for month 2025-08 [2025-10-06T18:10:41.530793] [FATAL] [REMOTE ] COP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:10:41.530877] [FATAL] [MAIN ] COP: Failed to fetch primary data. [2025-10-06T18:10:41.530938] [WARN ] [MAIN ] COP: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:10:41.531032] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-06T18:10:41.531144] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-06T18:10:41.531199] [INFO ] [LOCAL ] COP: Starting deletion of derivative data. [2025-10-06T18:10:41.531446] [DEBUG] [LOCAL ] COP: Deleted derivative data file. [2025-10-06T18:10:41.531549] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COP took 27.3s. Estimated remaining: 4h 17m 42s. Rate: 7.2 symbols/min [2025-10-06T18:10:41.715822] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:10:41.775274] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T18:10:41.806209] [DEBUG] [LOCAL ] CP: Loaded 54043 existing records from primary storage. [2025-10-06T18:10:41.806635] [INFO ] [MAIN ] CP: Loaded 54043 existing records. [2025-10-06T18:10:41.988874] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:10:41.989132] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-06T18:10:41.989181] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-06T18:10:41.989626] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-06T18:10:41.989720] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-06T18:10:42.229379] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-06T18:10:42.346713] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:10:42.493216] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T18:10:43.025528] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-06T18:10:43.776503] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T18:10:43.825488] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-06T18:10:44.625559] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-06T18:10:44.770053] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T18:10:45.398558] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T18:10:45.425474] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-06T18:10:46.225519] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-06T18:10:46.450232] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T18:10:47.025555] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-06T18:10:47.090519] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T18:10:47.656734] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T18:10:47.825503] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-06T18:10:48.625498] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-06T18:10:49.001250] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-06T18:10:49.425560] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-06T18:10:49.891604] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-06T18:10:50.225515] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-06T18:10:50.432674] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T18:10:51.025513] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-06T18:10:51.297948] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-06T18:10:51.825497] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-06T18:10:52.018030] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T18:10:52.625501] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-06T18:10:52.700333] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T18:10:53.425527] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-06T18:10:53.500299] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T18:10:54.225492] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-06T18:10:54.709934] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-06T18:10:55.025535] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-06T18:10:55.114025] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T18:10:55.452518] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T18:10:55.825540] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-06T18:10:56.591592] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T18:10:56.625492] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-06T18:10:57.425497] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-06T18:10:57.547490] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T18:10:58.225513] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-06T18:10:58.491445] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T18:10:59.025520] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-06T18:10:59.220912] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T18:10:59.629408] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T18:10:59.632098] [INFO ] [REMOTE ] COR: Full fetch complete (68756 records). [2025-10-06T18:10:59.632207] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-06T18:10:59.830870] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-06T18:11:00.028764] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-06T18:11:00.028865] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-06T18:11:00.029692] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-06T18:11:00.029757] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-06T18:11:00.031422] [DEBUG] [LOCAL ] COR: Trimmed 68756 records to 46949 (keeping 200 days of data) [2025-10-06T18:11:00.337889] [DEBUG] [LOCAL ] COR: Primary data saved (46949 records). [2025-10-06T18:11:00.338056] [INFO ] [MAIN ] COR: Full history saved. [2025-10-06T18:11:00.338143] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COR took 39.6s. Estimated remaining: 4h 18m 12s. Rate: 7.2 symbols/min [2025-10-06T18:11:00.511510] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:11:00.541148] [DEBUG] [LOCAL ] CPA: Loaded 28805 existing records from primary storage. [2025-10-06T18:11:00.541451] [INFO ] [MAIN ] CPA: Loaded 28805 existing records. [2025-10-06T18:11:00.637740] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-06T18:11:00.698161] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-06T18:11:00.757325] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:11:00.758218] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-06T18:11:00.758309] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-06T18:11:00.758433] [INFO ] [REMOTE ] COTY: Full fetch complete (77102 records). [2025-10-06T18:11:00.758768] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-06T18:11:00.758873] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-06T18:11:00.758721] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-06T18:11:01.548915] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-06T18:11:01.548752] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:11:01.549217] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-06T18:11:01.549286] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-06T18:11:01.550190] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-06T18:11:01.551027] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-06T18:11:01.552597] [DEBUG] [LOCAL ] COTY: Trimmed 77102 records to 53238 (keeping 200 days of data) [2025-10-06T18:11:01.845944] [DEBUG] [LOCAL ] COTY: Primary data saved (53238 records). [2025-10-06T18:11:01.846104] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-06T18:11:01.846187] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COTY took 34.1s. Estimated remaining: 4h 17m 39s. Rate: 7.2 symbols/min [2025-10-06T18:11:02.039833] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:11:02.040183] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-06T18:11:02.040240] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-06T18:11:02.040373] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-06T18:11:02.040416] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-06T18:11:02.040458] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-06T18:11:02.040491] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-06T18:11:02.442667] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:11:02.443479] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-06T18:11:02.477518] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-06T18:11:02.733968] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-06T18:11:02.911317] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-06T18:11:03.025495] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-06T18:11:03.216808] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T18:11:03.825567] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-06T18:11:04.625517] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-06T18:11:04.805877] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T18:11:05.166922] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T18:11:05.425592] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-06T18:11:05.875924] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-06T18:11:06.225507] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-06T18:11:06.366929] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T18:11:07.025599] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-06T18:11:07.472831] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-06T18:11:07.752390] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T18:11:07.754962] [INFO ] [REMOTE ] COUR: Full fetch complete (70498 records). [2025-10-06T18:11:07.755371] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-06T18:11:07.756387] [FATAL] [VALIDATOR ] COUR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:11:07.756545] [FATAL] [MAIN ] COUR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:11:07.756600] [WARN ] [MAIN ] COUR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:11:07.756675] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-06T18:11:07.756777] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-06T18:11:07.756814] [INFO ] [LOCAL ] COUR: Starting deletion of derivative data. [2025-10-06T18:11:07.757162] [DEBUG] [LOCAL ] COUR: Deleted derivative data file. [2025-10-06T18:11:07.757892] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. COUR took 32.0s. Estimated remaining: 4h 17m 22s. Rate: 7.2 symbols/min [2025-10-06T18:11:07.830609] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-06T18:11:07.933075] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:11:07.967970] [DEBUG] [LOCAL ] CPAY: Loaded 30967 existing records from primary storage. [2025-10-06T18:11:07.968280] [INFO ] [MAIN ] CPAY: Loaded 30967 existing records. [2025-10-06T18:11:08.156206] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:11:08.156529] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-06T18:11:08.156587] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-06T18:11:08.157149] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-06T18:11:08.157214] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-06T18:11:08.626885] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-06T18:11:08.667472] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:11:09.425622] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-06T18:11:09.653366] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T18:11:09.824131] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-06T18:11:10.032037] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T18:11:10.225559] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-06T18:11:11.025558] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-06T18:11:11.825578] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-06T18:11:12.013232] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T18:11:12.408879] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-06T18:11:12.439204] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-06T18:11:12.625614] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-06T18:11:13.425600] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-06T18:11:14.090805] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-06T18:11:14.225530] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-06T18:11:14.682511] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-06T18:11:14.896828] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T18:11:15.025548] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-06T18:11:15.825551] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-06T18:11:16.625519] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-06T18:11:16.837728] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T18:11:16.989596] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-06T18:11:17.223427] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T18:11:17.425546] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-06T18:11:18.225568] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-06T18:11:19.025537] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-06T18:11:19.045097] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-06T18:11:19.048235] [INFO ] [REMOTE ] CP: Full fetch complete (77126 records). [2025-10-06T18:11:19.048423] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-06T18:11:19.465223] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-06T18:11:19.465337] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-06T18:11:19.466830] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-06T18:11:19.466900] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-06T18:11:19.469097] [DEBUG] [LOCAL ] CP: Trimmed 77126 records to 53262 (keeping 200 days of data) [2025-10-06T18:11:19.721746] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T18:11:19.826460] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-06T18:11:19.846800] [DEBUG] [LOCAL ] CP: Primary data saved (53262 records). [2025-10-06T18:11:19.846929] [INFO ] [MAIN ] CP: Full history saved. [2025-10-06T18:11:19.847010] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CP took 38.3s. Estimated remaining: 4h 17m 28s. Rate: 7.2 symbols/min [2025-10-06T18:11:20.026202] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:11:20.054994] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T18:11:20.060463] [DEBUG] [LOCAL ] CPF: Loaded 15402 existing records from primary storage. [2025-10-06T18:11:20.070608] [INFO ] [MAIN ] CPF: Loaded 15402 existing records. [2025-10-06T18:11:20.258684] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:11:20.258962] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-06T18:11:20.259010] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-06T18:11:20.259323] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-06T18:11:20.259385] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-06T18:11:20.626837] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-06T18:11:20.626673] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:11:21.167757] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T18:11:21.425535] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-06T18:11:22.037868] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T18:11:22.129532] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-06T18:11:22.225518] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-06T18:11:23.025937] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-06T18:11:23.675472] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T18:11:23.825547] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-06T18:11:24.257059] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T18:11:24.625534] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-06T18:11:25.056367] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T18:11:25.425542] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-06T18:11:25.908165] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T18:11:26.225566] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-06T18:11:26.580677] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T18:11:27.025580] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-06T18:11:27.769084] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T18:11:27.793688] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T18:11:27.825476] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-06T18:11:28.625541] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-06T18:11:29.245602] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T18:11:29.425492] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-06T18:11:29.839169] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T18:11:29.934145] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-06T18:11:30.225536] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-06T18:11:30.624457] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-06T18:11:30.625552] [INFO ] [REMOTE ] CPAC: Full fetch complete (1876 records). [2025-10-06T18:11:30.625679] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-06T18:11:30.822699] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T18:11:30.822978] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:11:30.823052] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:11:30.823129] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-06T18:11:30.823232] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-06T18:11:30.823291] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-06T18:11:30.823337] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-06T18:11:30.823403] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPAC took 29.0s. Estimated remaining: 4h 17m 29s. Rate: 7.2 symbols/min [2025-10-06T18:11:31.003926] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:11:31.004315] [DEBUG] [LOCAL ] CPK: No existing data file found in primary storage. [2025-10-06T18:11:31.004373] [WARN ] [MAIN ] CPK: No existing data found, performing full refresh instead. [2025-10-06T18:11:31.004552] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-06T18:11:31.004605] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-06T18:11:31.004675] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-10-06T18:11:31.004729] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-06T18:11:31.034796] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-06T18:11:31.373803] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:11:31.825534] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-06T18:11:32.083007] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T18:11:32.625534] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-06T18:11:33.113403] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T18:11:33.425578] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-06T18:11:33.608154] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T18:11:34.225556] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-06T18:11:34.323353] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T18:11:35.025480] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-06T18:11:35.499554] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T18:11:35.825535] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-06T18:11:36.250995] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T18:11:36.252953] [INFO ] [REMOTE ] CPA: Full fetch complete (41626 records). [2025-10-06T18:11:36.253081] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-06T18:11:36.627486] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-06T18:11:36.672920] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-06T18:11:36.679029] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-06T18:11:36.680794] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-06T18:11:36.681039] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T18:11:36.681212] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-06T18:11:36.684869] [DEBUG] [LOCAL ] CPA: Trimmed 41626 records to 28283 (keeping 200 days of data) [2025-10-06T18:11:36.862705] [DEBUG] [LOCAL ] CPA: Primary data saved (28283 records). [2025-10-06T18:11:36.862871] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-06T18:11:36.862954] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CPA took 36.5s. Estimated remaining: 4h 17m 12s. Rate: 7.2 symbols/min [2025-10-06T18:11:37.032623] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:11:37.093449] [DEBUG] [LOCAL ] CPNG: Loaded 54451 existing records from primary storage. [2025-10-06T18:11:37.093920] [INFO ] [MAIN ] CPNG: Loaded 54451 existing records. [2025-10-06T18:11:37.281341] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:11:37.281630] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-06T18:11:37.281730] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-06T18:11:37.282185] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-06T18:11:37.282266] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-06T18:11:37.438529] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-06T18:11:37.665849] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:11:37.887409] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T18:11:38.225499] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-06T18:11:38.388262] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T18:11:38.838866] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-06T18:11:39.025566] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-06T18:11:39.825503] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-06T18:11:39.957362] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T18:11:40.625521] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-06T18:11:41.425515] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-06T18:11:41.567139] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T18:11:42.114259] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-06T18:11:42.225563] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-06T18:11:42.480353] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T18:11:43.025617] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-06T18:11:43.825492] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-06T18:11:44.070355] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T18:11:44.331106] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-06T18:11:44.625501] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-06T18:11:44.803158] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T18:11:45.333708] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-06T18:11:45.425560] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-06T18:11:46.225590] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-06T18:11:46.375401] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T18:11:46.961824] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-06T18:11:47.025598] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-06T18:11:47.825571] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-06T18:11:48.070487] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-06T18:11:48.625578] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-06T18:11:48.756213] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T18:11:49.425569] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-06T18:11:49.621341] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T18:11:49.623417] [INFO ] [REMOTE ] CPAY: Full fetch complete (44975 records). [2025-10-06T18:11:49.623531] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-06T18:11:50.012991] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-06T18:11:50.013248] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-06T18:11:50.014079] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-06T18:11:50.014164] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-06T18:11:50.015454] [DEBUG] [LOCAL ] CPAY: Trimmed 44975 records to 30485 (keeping 200 days of data) [2025-10-06T18:11:50.156926] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-06T18:11:50.227833] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-06T18:11:50.231384] [DEBUG] [LOCAL ] CPAY: Primary data saved (30485 records). [2025-10-06T18:11:50.232432] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-06T18:11:50.232571] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPAY took 42.5s. Estimated remaining: 4h 17m 22s. Rate: 7.2 symbols/min [2025-10-06T18:11:51.025608] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-06T18:11:51.825549] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-06T18:11:52.015109] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T18:11:52.173930] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-06T18:11:52.625545] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-06T18:11:52.677698] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-06T18:11:53.425592] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-06T18:11:53.463353] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T18:11:53.465507] [INFO ] [REMOTE ] CPF: Full fetch complete (24112 records). [2025-10-06T18:11:53.465663] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-06T18:11:53.855803] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-06T18:11:53.855941] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-06T18:11:53.856443] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-06T18:11:53.856545] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-06T18:11:53.857374] [DEBUG] [LOCAL ] CPF: Trimmed 24112 records to 15213 (keeping 200 days of data) [2025-10-06T18:11:53.950261] [DEBUG] [LOCAL ] CPF: Primary data saved (15213 records). [2025-10-06T18:11:53.950445] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-06T18:11:53.950539] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPF took 34.1s. Estimated remaining: 4h 16m 57s. Rate: 7.2 symbols/min [2025-10-06T18:11:54.225574] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-06T18:11:54.305702] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-06T18:11:54.307154] [INFO ] [REMOTE ] CPK: Full fetch complete (17994 records). [2025-10-06T18:11:54.307229] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-06T18:11:54.673505] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-06T18:11:54.673669] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-06T18:11:54.674135] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-06T18:11:54.674177] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-06T18:11:54.674892] [DEBUG] [LOCAL ] CPK: Trimmed 17994 records to 13554 (keeping 200 days of data) [2025-10-06T18:11:54.762341] [DEBUG] [LOCAL ] CPK: Primary data saved (13554 records). [2025-10-06T18:11:54.762507] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-06T18:11:54.762583] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPK took 23.9s. Estimated remaining: 4h 16m 22s. Rate: 7.2 symbols/min [2025-10-06T18:11:56.226226] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-06T18:11:56.238276] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-06T18:11:58.455870] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-06T18:11:58.468672] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-06T18:12:00.829307] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-06T18:12:00.841686] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-06T18:12:03.201791] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-06T18:12:03.213266] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-06T18:12:05.331367] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-06T18:12:05.348494] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-06T18:12:07.478728] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-06T18:12:07.495192] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-06T18:12:09.595700] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-06T18:12:09.607884] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-06T18:12:11.693095] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-06T18:12:11.696399] [INFO ] [REMOTE ] CPNG: Full fetch complete (77286 records). [2025-10-06T18:12:11.696557] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-06T18:12:11.698102] [FATAL] [VALIDATOR ] CPNG: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:12:11.698225] [FATAL] [MAIN ] CPNG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:12:11.698269] [WARN ] [MAIN ] CPNG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:12:11.698309] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-06T18:12:11.698571] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-10-06T18:12:11.698609] [INFO ] [LOCAL ] CPNG: Starting deletion of derivative data. [2025-10-06T18:12:11.698937] [DEBUG] [LOCAL ] CPNG: Deleted derivative data file. [2025-10-06T18:12:11.699070] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPNG took 34.8s. Estimated remaining: 4h 16m 45s. Rate: 7.2 symbols/min [2025-10-06T18:12:12.408771] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:12:12.465865] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:12:12.500370] [DEBUG] [LOCAL ] CPS: No existing data file found in primary storage. [2025-10-06T18:12:12.509418] [WARN ] [MAIN ] CPS: No existing data found, performing full refresh instead. [2025-10-06T18:12:12.529043] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-06T18:12:12.507585] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:12:12.531410] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:12:12.531738] [DEBUG] [LOCAL ] CQP: No existing data file found in primary storage. [2025-10-06T18:12:12.532067] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-06T18:12:12.532524] [WARN ] [MAIN ] CQP: No existing data found, performing full refresh instead. [2025-10-06T18:12:12.533767] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-06T18:12:12.532376] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-06T18:12:12.533948] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-06T18:12:12.534036] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-06T18:12:12.577839] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-06T18:12:12.583726] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-06T18:12:13.104189] [DEBUG] [LOCAL ] CPRI: Loaded 53294 existing records from primary storage. [2025-10-06T18:12:13.220501] [DEBUG] [LOCAL ] CPT: Loaded 44977 existing records from primary storage. [2025-10-06T18:12:13.219392] [INFO ] [MAIN ] CPRI: Loaded 53294 existing records. [2025-10-06T18:12:13.231306] [INFO ] [MAIN ] CPT: Loaded 44977 existing records. [2025-10-06T18:12:13.696025] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:12:13.775279] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-06T18:12:13.846769] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:12:13.875163] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-06T18:12:13.896307] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-06T18:12:13.928484] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-06T18:12:13.941429] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:12:13.941820] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-06T18:12:13.952200] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:12:13.952623] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-06T18:12:13.960938] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-06T18:12:13.952888] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-06T18:12:14.010416] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-06T18:12:14.032190] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-06T18:12:14.764694] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:12:14.758154] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:12:14.765231] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-06T18:12:14.765598] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-06T18:12:15.044557] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T18:12:15.049424] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-06T18:12:15.152927] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-06T18:12:15.157998] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-06T18:12:16.095300] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T18:12:16.100311] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-06T18:12:16.295369] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T18:12:16.302897] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-06T18:12:16.330150] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T18:12:16.339331] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-06T18:12:16.466796] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T18:12:16.478778] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-06T18:12:17.093890] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T18:12:17.099977] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-06T18:12:17.179121] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T18:12:17.184928] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-06T18:12:17.815124] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T18:12:17.826165] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-06T18:12:17.957912] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T18:12:17.967616] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-06T18:12:18.223095] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T18:12:18.228886] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-06T18:12:18.501134] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T18:12:18.507951] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-06T18:12:19.179474] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T18:12:19.197296] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-06T18:12:19.235154] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-06T18:12:19.263185] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-06T18:12:19.268845] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-06T18:12:19.271393] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-06T18:12:19.467090] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T18:12:19.474883] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-06T18:12:20.385271] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T18:12:20.390925] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-06T18:12:20.731213] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T18:12:20.739136] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-06T18:12:20.856047] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T18:12:20.866384] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-06T18:12:20.992191] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T18:12:21.007818] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-06T18:12:21.165993] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-06T18:12:21.173034] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-06T18:12:21.468010] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T18:12:21.473878] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-06T18:12:22.367816] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T18:12:22.374268] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-06T18:12:22.544438] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T18:12:22.555638] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-06T18:12:22.626975] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T18:12:22.907606] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-06T18:12:22.995872] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-06T18:12:23.025484] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-06T18:12:23.830668] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-06T18:12:23.848220] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-06T18:12:24.625509] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-06T18:12:24.698051] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-06T18:12:24.810798] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T18:12:25.425536] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-06T18:12:25.857016] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T18:12:26.225486] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-06T18:12:26.373588] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T18:12:26.375209] [INFO ] [REMOTE ] CQP: Full fetch complete (30510 records). [2025-10-06T18:12:26.375293] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-06T18:12:26.785054] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-06T18:12:26.785143] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-06T18:12:26.785780] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-06T18:12:26.785844] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-06T18:12:26.786812] [DEBUG] [LOCAL ] CQP: Trimmed 30510 records to 19102 (keeping 200 days of data) [2025-10-06T18:12:26.919271] [DEBUG] [LOCAL ] CQP: Primary data saved (19102 records). [2025-10-06T18:12:26.919460] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-06T18:12:26.919551] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 15.2s. Estimated remaining: 4h 17m 1s. Rate: 7.2 symbols/min [2025-10-06T18:12:27.026914] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-06T18:12:27.128361] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:12:27.158120] [DEBUG] [LOCAL ] CR: Loaded 24735 existing records from primary storage. [2025-10-06T18:12:27.158436] [INFO ] [MAIN ] CR: Loaded 24735 existing records. [2025-10-06T18:12:27.366843] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:12:27.367372] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-06T18:12:27.367476] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-06T18:12:27.368119] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-06T18:12:27.368267] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-06T18:12:27.456572] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-06T18:12:27.771228] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:12:27.825506] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-06T18:12:28.625521] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-06T18:12:28.875993] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T18:12:28.933240] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-06T18:12:29.425555] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-06T18:12:30.225516] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-06T18:12:30.325752] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T18:12:30.385606] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T18:12:31.025577] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-06T18:12:31.195875] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T18:12:31.197708] [INFO ] [REMOTE ] CPS: Full fetch complete (36300 records). [2025-10-06T18:12:31.197797] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-06T18:12:31.625112] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-06T18:12:31.625445] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-06T18:12:31.626293] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-06T18:12:31.626359] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-06T18:12:31.627662] [DEBUG] [LOCAL ] CPS: Trimmed 36300 records to 25745 (keeping 200 days of data) [2025-10-06T18:12:31.785588] [DEBUG] [LOCAL ] CPS: Primary data saved (25745 records). [2025-10-06T18:12:31.785776] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-06T18:12:31.786014] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 20.1s. Estimated remaining: 4h 16m 40s. Rate: 7.2 symbols/min [2025-10-06T18:12:31.830563] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-06T18:12:31.986093] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:12:31.999717] [DEBUG] [LOCAL ] CRBD: Loaded 9105 existing records from primary storage. [2025-10-06T18:12:31.999988] [INFO ] [MAIN ] CRBD: Loaded 9105 existing records. [2025-10-06T18:12:32.199897] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:12:32.200400] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-06T18:12:32.200622] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-06T18:12:32.214107] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-06T18:12:32.214873] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-06T18:12:32.214662] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T18:12:32.579306] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:12:32.625475] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-06T18:12:33.303876] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T18:12:33.425546] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-06T18:12:33.833616] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-06T18:12:34.225589] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-06T18:12:34.979121] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T18:12:35.025536] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-06T18:12:35.611430] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T18:12:35.825564] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-06T18:12:36.625567] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-06T18:12:36.698598] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T18:12:37.425560] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-06T18:12:37.544022] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-06T18:12:37.580472] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T18:12:38.225594] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-06T18:12:38.992796] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T18:12:39.025546] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-06T18:12:39.135515] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T18:12:39.138548] [INFO ] [REMOTE ] CPT: Full fetch complete (64028 records). [2025-10-06T18:12:39.138680] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-06T18:12:39.557822] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-06T18:12:39.557920] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-06T18:12:39.559044] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-06T18:12:39.559115] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-06T18:12:39.560870] [DEBUG] [LOCAL ] CPT: Trimmed 64028 records to 44378 (keeping 200 days of data) [2025-10-06T18:12:39.800326] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-06T18:12:39.825739] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-06T18:12:39.877131] [DEBUG] [LOCAL ] CPT: Primary data saved (44378 records). [2025-10-06T18:12:39.877312] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-06T18:12:39.877417] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPT took 28.2s. Estimated remaining: 4h 16m 31s. Rate: 7.2 symbols/min [2025-10-06T18:12:40.052101] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:12:40.109570] [DEBUG] [LOCAL ] CRBG: Loaded 53133 existing records from primary storage. [2025-10-06T18:12:40.109984] [INFO ] [MAIN ] CRBG: Loaded 53133 existing records. [2025-10-06T18:12:40.301955] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:12:40.302270] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-06T18:12:40.302322] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-06T18:12:40.302709] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-06T18:12:40.302775] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-06T18:12:40.630939] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-06T18:12:40.691541] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:12:40.700358] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-06T18:12:41.425589] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-06T18:12:42.149329] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T18:12:42.225602] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-06T18:12:43.025634] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-06T18:12:43.272185] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T18:12:43.363479] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T18:12:43.764258] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T18:12:43.825485] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-06T18:12:44.563045] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T18:12:44.625595] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-06T18:12:45.425504] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-06T18:12:45.728306] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T18:12:46.225616] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-06T18:12:46.823511] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T18:12:46.834376] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T18:12:46.837594] [INFO ] [REMOTE ] CPRI: Full fetch complete (76103 records). [2025-10-06T18:12:46.837813] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-06T18:12:47.031397] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-06T18:12:47.264737] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-06T18:12:47.264841] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-06T18:12:47.265808] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-06T18:12:47.265877] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-06T18:12:47.267587] [DEBUG] [LOCAL ] CPRI: Trimmed 76103 records to 52511 (keeping 200 days of data) [2025-10-06T18:12:47.573582] [DEBUG] [LOCAL ] CPRI: Primary data saved (52511 records). [2025-10-06T18:12:47.573788] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-06T18:12:47.573884] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPRI took 35.9s. Estimated remaining: 4h 16m 20s. Rate: 7.2 symbols/min [2025-10-06T18:12:47.750708] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:12:47.750950] [DEBUG] [LOCAL ] CRC: No existing data file found in primary storage. [2025-10-06T18:12:47.750993] [WARN ] [MAIN ] CRC: No existing data found, performing full refresh instead. [2025-10-06T18:12:47.751115] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-06T18:12:47.751157] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-06T18:12:47.751203] [DEBUG] [LOCAL ] CRC: No primary data file found to delete. [2025-10-06T18:12:47.751236] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-06T18:12:47.830742] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-06T18:12:48.112978] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:12:48.234003] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-06T18:12:48.625572] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-06T18:12:48.843627] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-06T18:12:49.425544] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-06T18:12:50.165988] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T18:12:50.225497] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-06T18:12:50.507141] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T18:12:50.966230] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T18:12:51.025506] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-06T18:12:51.709613] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-06T18:12:51.825534] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-06T18:12:52.513686] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T18:12:52.514748] [INFO ] [REMOTE ] CRBD: Full fetch complete (14284 records). [2025-10-06T18:12:52.514824] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-06T18:12:52.630723] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-06T18:12:52.880390] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-06T18:12:52.880516] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-06T18:12:52.880951] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-06T18:12:52.881020] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-06T18:12:52.881978] [DEBUG] [LOCAL ] CRBD: Trimmed 14284 records to 8957 (keeping 200 days of data) [2025-10-06T18:12:52.936183] [DEBUG] [LOCAL ] CRBD: Primary data saved (8957 records). [2025-10-06T18:12:52.936315] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-06T18:12:52.936416] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CRBD took 21.2s. Estimated remaining: 4h 16m 2s. Rate: 7.2 symbols/min [2025-10-06T18:12:53.103144] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:12:53.103321] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-06T18:12:53.103361] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-06T18:12:53.103484] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-06T18:12:53.103528] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-06T18:12:53.103570] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-06T18:12:53.103602] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-06T18:12:53.436795] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-06T18:12:53.477772] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:12:54.047402] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T18:12:54.225621] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-06T18:12:54.662347] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-06T18:12:55.025600] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-06T18:12:55.825578] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-06T18:12:55.987240] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T18:12:55.988936] [INFO ] [REMOTE ] CR: Full fetch complete (34760 records). [2025-10-06T18:12:55.989027] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-06T18:12:56.271552] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-06T18:12:56.416256] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-06T18:12:56.416371] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-06T18:12:56.417352] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-06T18:12:56.417422] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-06T18:12:56.418848] [DEBUG] [LOCAL ] CR: Trimmed 34760 records to 24251 (keeping 200 days of data) [2025-10-06T18:12:56.572678] [DEBUG] [LOCAL ] CR: Primary data saved (24251 records). [2025-10-06T18:12:56.572858] [INFO ] [MAIN ] CR: Full history saved. [2025-10-06T18:12:56.572952] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CR took 29.7s. Estimated remaining: 4h 15m 37s. Rate: 7.2 symbols/min [2025-10-06T18:12:56.635758] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-06T18:12:56.773095] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:12:56.835634] [DEBUG] [LOCAL ] CRGY: Loaded 53284 existing records from primary storage. [2025-10-06T18:12:56.836038] [INFO ] [MAIN ] CRGY: Loaded 53284 existing records. [2025-10-06T18:12:57.015059] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:12:57.015432] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-06T18:12:57.015535] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-06T18:12:57.015852] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-06T18:12:57.015910] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-06T18:12:57.386117] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T18:12:57.390540] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:12:57.425466] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-06T18:12:58.152250] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T18:12:58.225472] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-06T18:12:58.945111] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T18:12:59.025515] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-06T18:12:59.230628] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:12:59.231047] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-06T18:12:59.231138] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:12:59.231187] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-06T18:12:59.231249] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:12:59.231321] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-06T18:12:59.231393] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-06T18:12:59.231428] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-06T18:12:59.231467] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-06T18:12:59.231515] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRCL took 6.3s. Estimated remaining: 4h 15m 9s. Rate: 7.2 symbols/min [2025-10-06T18:12:59.400720] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:12:59.400942] [DEBUG] [LOCAL ] CRH: No existing data file found in primary storage. [2025-10-06T18:12:59.400997] [WARN ] [MAIN ] CRH: No existing data found, performing full refresh instead. [2025-10-06T18:12:59.401107] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-06T18:12:59.401148] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-06T18:12:59.401188] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-06T18:12:59.401224] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-06T18:12:59.758275] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:12:59.811155] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T18:12:59.825481] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-06T18:13:00.625540] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-06T18:13:01.425527] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-06T18:13:01.743088] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-06T18:13:02.225608] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-06T18:13:02.387273] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T18:13:03.025579] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-06T18:13:03.095389] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T18:13:03.825527] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-06T18:13:04.037722] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-06T18:13:04.625565] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-06T18:13:04.705206] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T18:13:05.119845] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-06T18:13:05.425554] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-06T18:13:06.225565] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-06T18:13:06.464447] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-06T18:13:06.598978] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-06T18:13:07.025627] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-06T18:13:07.825497] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-06T18:13:08.113057] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T18:13:08.522375] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-06T18:13:08.625506] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-06T18:13:09.425572] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-06T18:13:09.630961] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T18:13:10.225516] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-06T18:13:10.295886] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T18:13:11.025520] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-06T18:13:11.181970] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T18:13:11.825539] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-06T18:13:11.888360] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T18:13:12.250398] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T18:13:12.625576] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-06T18:13:13.313268] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T18:13:13.425554] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-06T18:13:14.225519] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-06T18:13:14.379431] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T18:13:15.025612] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-06T18:13:15.318771] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T18:13:15.825545] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-06T18:13:15.914483] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T18:13:16.625503] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-06T18:13:16.733901] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T18:13:17.425552] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-06T18:13:17.739394] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-06T18:13:18.195169] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T18:13:18.225485] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-06T18:13:19.025587] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-06T18:13:19.246845] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T18:13:19.825561] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-06T18:13:20.006094] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T18:13:20.395349] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T18:13:20.625541] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-06T18:13:21.425522] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-06T18:13:21.572216] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T18:13:21.801968] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T18:13:21.805301] [INFO ] [REMOTE ] CRC: Full fetch complete (62147 records). [2025-10-06T18:13:21.805543] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-06T18:13:21.806748] [FATAL] [VALIDATOR ] CRC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:13:21.806863] [FATAL] [MAIN ] CRC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:13:21.807041] [WARN ] [MAIN ] CRC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:13:21.807129] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-06T18:13:21.807222] [DEBUG] [LOCAL ] CRC: No primary data file found to delete. [2025-10-06T18:13:21.807261] [INFO ] [LOCAL ] CRC: Starting deletion of derivative data. [2025-10-06T18:13:21.807306] [DEBUG] [LOCAL ] CRC: No derivative data file found to delete. [2025-10-06T18:13:21.807403] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRC took 34.2s. Estimated remaining: 4h 15m 50s. Rate: 7.2 symbols/min [2025-10-06T18:13:21.993243] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:13:22.044457] [DEBUG] [LOCAL ] CRI: Loaded 50562 existing records from primary storage. [2025-10-06T18:13:22.044867] [INFO ] [MAIN ] CRI: Loaded 50562 existing records. [2025-10-06T18:13:22.221770] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:13:22.222092] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-06T18:13:22.222151] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-06T18:13:22.222638] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-06T18:13:22.222730] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-06T18:13:22.233917] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-06T18:13:22.584457] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:13:22.962002] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T18:13:22.965246] [INFO ] [REMOTE ] CRBG: Full fetch complete (75742 records). [2025-10-06T18:13:22.965399] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-06T18:13:23.030773] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-06T18:13:23.377691] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-06T18:13:23.377790] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-06T18:13:23.378665] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-06T18:13:23.378729] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-06T18:13:23.380302] [DEBUG] [LOCAL ] CRBG: Trimmed 75742 records to 52399 (keeping 200 days of data) [2025-10-06T18:13:23.710833] [DEBUG] [LOCAL ] CRBG: Primary data saved (52399 records). [2025-10-06T18:13:23.711049] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-06T18:13:23.711259] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRBG took 43.8s. Estimated remaining: 4h 15m 20s. Rate: 7.2 symbols/min [2025-10-06T18:13:23.829147] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-06T18:13:23.891231] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:13:23.942181] [DEBUG] [LOCAL ] CRK: Loaded 52920 existing records from primary storage. [2025-10-06T18:13:23.942600] [INFO ] [MAIN ] CRK: Loaded 52920 existing records. [2025-10-06T18:13:24.140849] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:13:24.155084] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-06T18:13:24.155166] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-06T18:13:24.155827] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-06T18:13:24.155888] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-06T18:13:24.157037] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-06T18:13:24.531161] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:13:24.625495] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-06T18:13:24.757364] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T18:13:25.302929] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T18:13:25.425525] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-06T18:13:26.193122] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T18:13:26.225479] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-06T18:13:27.032198] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-06T18:13:27.049393] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T18:13:27.825569] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-06T18:13:28.077297] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T18:13:28.625493] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-06T18:13:29.090187] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-06T18:13:29.129468] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T18:13:29.425515] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-06T18:13:30.156084] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T18:13:30.159759] [INFO ] [REMOTE ] CRGY: Full fetch complete (75981 records). [2025-10-06T18:13:30.159930] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-06T18:13:30.236305] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-06T18:13:30.604877] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-06T18:13:30.605041] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-06T18:13:30.606828] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-06T18:13:30.606926] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-06T18:13:30.609549] [DEBUG] [LOCAL ] CRGY: Trimmed 75981 records to 52502 (keeping 200 days of data) [2025-10-06T18:13:30.754481] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-06T18:13:30.993862] [DEBUG] [LOCAL ] CRGY: Primary data saved (52502 records). [2025-10-06T18:13:30.994073] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-06T18:13:30.994182] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRGY took 34.4s. Estimated remaining: 4h 15m 8s. Rate: 7.2 symbols/min [2025-10-06T18:13:31.031535] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-06T18:13:31.183956] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:13:31.234797] [DEBUG] [LOCAL ] CRL: Loaded 43656 existing records from primary storage. [2025-10-06T18:13:31.235411] [INFO ] [MAIN ] CRL: Loaded 43656 existing records. [2025-10-06T18:13:31.422035] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:13:31.422318] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-06T18:13:31.422413] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-06T18:13:31.422740] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-06T18:13:31.422798] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-06T18:13:31.814582] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:13:31.825496] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-06T18:13:32.193520] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-06T18:13:32.625588] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-06T18:13:33.261801] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-06T18:13:33.425509] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-06T18:13:33.542832] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T18:13:34.225505] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-06T18:13:34.343474] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T18:13:35.025586] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-06T18:13:35.472050] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-06T18:13:35.832610] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-06T18:13:35.839260] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T18:13:36.475378] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T18:13:36.625518] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-06T18:13:37.080454] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T18:13:37.425587] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-06T18:13:38.225548] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-06T18:13:38.276846] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T18:13:39.025573] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-06T18:13:39.370854] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-06T18:13:39.373900] [INFO ] [REMOTE ] CRH: Full fetch complete (77301 records). [2025-10-06T18:13:39.374020] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-06T18:13:39.799277] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-06T18:13:39.799406] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-06T18:13:39.800609] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-06T18:13:39.800702] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-06T18:13:39.802361] [DEBUG] [LOCAL ] CRH: Trimmed 77301 records to 53462 (keeping 200 days of data) [2025-10-06T18:13:39.861493] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-06T18:13:40.139091] [DEBUG] [LOCAL ] CRH: Primary data saved (53462 records). [2025-10-06T18:13:40.139269] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-06T18:13:40.139353] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRH took 40.9s. Estimated remaining: 4h 15m 2s. Rate: 7.2 symbols/min [2025-10-06T18:13:40.305611] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:13:40.362110] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-10-06T18:13:40.362475] [INFO ] [MAIN ] CRM: Loaded 54550 existing records. [2025-10-06T18:13:40.546214] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:13:40.546536] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-06T18:13:40.546678] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-06T18:13:40.547506] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-06T18:13:40.547569] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-06T18:13:40.907036] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:13:40.907407] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-06T18:13:40.938917] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-06T18:13:41.425520] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-06T18:13:41.557945] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T18:13:42.225600] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-06T18:13:42.961438] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T18:13:43.025557] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-06T18:13:43.135166] [DEBUG] [REMOTE ] CRI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-06T18:13:43.135595] [WARN ] [REMOTE ] CRI: No data returned for month 2025-09 [2025-10-06T18:13:43.135736] [FATAL] [REMOTE ] CRI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:13:43.135858] [FATAL] [MAIN ] CRI: Failed to fetch primary data. [2025-10-06T18:13:43.135927] [WARN ] [MAIN ] CRI: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:13:43.136004] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-06T18:13:43.136079] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-10-06T18:13:43.136117] [INFO ] [LOCAL ] CRI: Starting deletion of derivative data. [2025-10-06T18:13:43.136432] [DEBUG] [LOCAL ] CRI: Deleted derivative data file. [2025-10-06T18:13:43.137175] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRI took 21.3s. Estimated remaining: 4h 14m 36s. Rate: 7.2 symbols/min [2025-10-06T18:13:43.353198] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:13:43.373670] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-06T18:13:43.424929] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (5.20 seconds). [2025-10-06T18:13:43.470776] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T18:13:43.511790] [DEBUG] [LOCAL ] CRS: Loaded 43817 existing records from primary storage. [2025-10-06T18:13:43.512216] [INFO ] [MAIN ] CRS: Loaded 43817 existing records. [2025-10-06T18:13:43.691364] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:13:43.691681] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-06T18:13:43.691742] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-06T18:13:43.692707] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-06T18:13:43.692768] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-06T18:13:43.835167] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-06T18:13:44.067701] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:13:44.625543] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-06T18:13:45.425625] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-06T18:13:45.729242] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T18:13:46.225490] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-06T18:13:46.369564] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T18:13:47.025564] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-06T18:13:47.825514] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-06T18:13:47.894737] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-06T18:13:48.070546] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-06T18:13:48.625525] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-06T18:13:48.775951] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T18:13:49.425541] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-06T18:13:49.825871] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-06T18:13:50.225572] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-06T18:13:50.358814] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T18:13:51.025555] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-06T18:13:51.235326] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T18:13:51.825544] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-06T18:13:51.874868] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-06T18:13:52.625555] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-06T18:13:52.867505] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T18:13:53.425531] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-06T18:13:54.008431] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-06T18:13:54.081444] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T18:13:54.225563] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-06T18:13:54.939328] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T18:13:55.025505] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-06T18:13:55.825554] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-06T18:13:56.553455] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-06T18:13:56.630739] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-06T18:13:56.646378] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-06T18:13:57.425544] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-06T18:13:57.728262] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T18:13:58.225576] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-06T18:13:58.252203] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T18:13:59.025589] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-06T18:13:59.059839] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T18:13:59.825588] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-06T18:14:00.256182] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T18:14:00.625551] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-06T18:14:00.688472] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-06T18:14:01.018306] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T18:14:01.425550] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-06T18:14:02.225547] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-06T18:14:02.638755] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-06T18:14:02.891813] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T18:14:02.896254] [INFO ] [REMOTE ] CRL: Full fetch complete (63132 records). [2025-10-06T18:14:02.896433] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-06T18:14:03.030635] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-06T18:14:03.459305] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-06T18:14:03.459475] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-06T18:14:03.460571] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-06T18:14:03.460708] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-06T18:14:03.462683] [DEBUG] [LOCAL ] CRL: Trimmed 63132 records to 42885 (keeping 200 days of data) [2025-10-06T18:14:03.826772] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-06T18:14:03.865118] [DEBUG] [LOCAL ] CRL: Primary data saved (42885 records). [2025-10-06T18:14:03.865275] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-06T18:14:03.865371] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRL took 32.9s. Estimated remaining: 4h 15m 10s. Rate: 7.2 symbols/min [2025-10-06T18:14:04.080144] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:14:04.119482] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T18:14:04.134722] [DEBUG] [LOCAL ] CRT: Loaded 5044 existing records from primary storage. [2025-10-06T18:14:04.135238] [INFO ] [MAIN ] CRT: Loaded 5044 existing records. [2025-10-06T18:14:04.333254] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:14:04.333680] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-06T18:14:04.333770] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-06T18:14:04.333950] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-06T18:14:04.334006] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-06T18:14:04.635160] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-06T18:14:04.723150] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:14:04.815785] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-06T18:14:04.818861] [INFO ] [REMOTE ] CRK: Full fetch complete (75591 records). [2025-10-06T18:14:04.819033] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-06T18:14:05.228956] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-06T18:14:05.229073] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-06T18:14:05.230000] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-06T18:14:05.230071] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-06T18:14:05.231730] [DEBUG] [LOCAL ] CRK: Trimmed 75591 records to 52172 (keeping 200 days of data) [2025-10-06T18:14:05.435726] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-06T18:14:05.546525] [DEBUG] [LOCAL ] CRK: Primary data saved (52172 records). [2025-10-06T18:14:05.546720] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-06T18:14:05.546823] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRK took 41.8s. Estimated remaining: 4h 14m 39s. Rate: 7.2 symbols/min [2025-10-06T18:14:05.790159] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:14:05.833240] [DEBUG] [LOCAL ] CSAN: Loaded 42880 existing records from primary storage. [2025-10-06T18:14:05.833637] [INFO ] [MAIN ] CSAN: Loaded 42880 existing records. [2025-10-06T18:14:06.016349] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:14:06.016689] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-06T18:14:06.016924] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-06T18:14:06.017303] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-06T18:14:06.017362] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-06T18:14:06.304129] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T18:14:06.318985] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-06T18:14:06.403355] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:14:06.437808] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-06T18:14:06.488620] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T18:14:06.964363] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-06T18:14:07.025579] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-06T18:14:07.825569] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-06T18:14:08.455798] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-06T18:14:08.625525] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-06T18:14:08.726326] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T18:14:09.278421] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-06T18:14:09.425562] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-06T18:14:10.225544] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-06T18:14:11.025574] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-06T18:14:11.653942] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-06T18:14:11.681955] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-06T18:14:11.825497] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-06T18:14:12.002484] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T18:14:12.625561] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-06T18:14:13.425576] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-06T18:14:13.998197] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-06T18:14:14.225486] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-06T18:14:14.302408] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-06T18:14:14.339488] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T18:14:14.844766] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-06T18:14:15.025572] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-06T18:14:15.825552] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-06T18:14:16.469989] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T18:14:16.625522] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-06T18:14:17.341292] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T18:14:17.425561] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-06T18:14:17.649756] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T18:14:18.172909] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T18:14:18.225498] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-06T18:14:19.025545] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-06T18:14:19.586536] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-06T18:14:19.825550] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-06T18:14:20.326295] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-06T18:14:20.423166] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T18:14:20.625508] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-06T18:14:21.425562] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-06T18:14:21.918906] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T18:14:21.921751] [INFO ] [REMOTE ] CRS: Full fetch complete (62732 records). [2025-10-06T18:14:21.921927] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-06T18:14:22.230635] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-06T18:14:22.319369] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-06T18:14:22.319482] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-06T18:14:22.320312] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-06T18:14:22.320382] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-06T18:14:22.322063] [DEBUG] [LOCAL ] CRS: Trimmed 62732 records to 43201 (keeping 200 days of data) [2025-10-06T18:14:22.597298] [DEBUG] [LOCAL ] CRS: Primary data saved (43201 records). [2025-10-06T18:14:22.597465] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-06T18:14:22.598107] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRS took 39.5s. Estimated remaining: 4h 15m 0s. Rate: 7.2 symbols/min [2025-10-06T18:14:22.771331] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:14:22.808459] [DEBUG] [LOCAL ] CSL: Loaded 31939 existing records from primary storage. [2025-10-06T18:14:22.808850] [INFO ] [MAIN ] CSL: Loaded 31939 existing records. [2025-10-06T18:14:22.993765] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:14:22.999791] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-06T18:14:22.999980] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-06T18:14:23.001012] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-06T18:14:23.000961] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-06T18:14:23.001202] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-06T18:14:23.032599] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-06T18:14:23.129365] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T18:14:23.433998] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:14:23.825536] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-06T18:14:24.625718] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-06T18:14:25.320511] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T18:14:25.321411] [INFO ] [REMOTE ] CRT: Full fetch complete (7557 records). [2025-10-06T18:14:25.321480] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-06T18:14:25.438409] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-06T18:14:25.526007] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T18:14:25.743594] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-06T18:14:25.743731] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-06T18:14:25.743999] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-06T18:14:25.744137] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-06T18:14:25.761362] [DEBUG] [LOCAL ] CRT: Trimmed 7557 records to 5015 (keeping 200 days of data) [2025-10-06T18:14:25.774582] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-06T18:14:25.816674] [DEBUG] [LOCAL ] CRT: Primary data saved (5015 records). [2025-10-06T18:14:25.816835] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-06T18:14:25.816923] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRT took 22.0s. Estimated remaining: 4h 14m 35s. Rate: 7.2 symbols/min [2025-10-06T18:14:25.989586] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:14:26.006542] [DEBUG] [LOCAL ] CSR: Loaded 12973 existing records from primary storage. [2025-10-06T18:14:26.006868] [INFO ] [MAIN ] CSR: Loaded 12973 existing records. [2025-10-06T18:14:26.198554] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:14:26.198901] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-06T18:14:26.198989] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-06T18:14:26.199255] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-06T18:14:26.199345] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-06T18:14:26.232719] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-06T18:14:26.566713] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:14:26.583226] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T18:14:27.025550] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-06T18:14:27.825535] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-06T18:14:28.549226] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-06T18:14:28.625540] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-06T18:14:28.818729] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-06T18:14:29.139054] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T18:14:29.364229] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T18:14:29.425496] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-06T18:14:30.225555] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-06T18:14:30.265482] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T18:14:31.025553] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-06T18:14:31.804158] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T18:14:31.820592] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T18:14:31.825463] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-06T18:14:32.620128] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-06T18:14:32.625458] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-06T18:14:33.425501] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-06T18:14:33.496612] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-06T18:14:34.225613] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-06T18:14:34.731280] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T18:14:34.734833] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-10-06T18:14:34.734972] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-06T18:14:35.031158] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-06T18:14:35.111388] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T18:14:35.275539] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-06T18:14:35.275682] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-06T18:14:35.276948] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-06T18:14:35.277045] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-06T18:14:35.279120] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-10-06T18:14:35.630544] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-06T18:14:35.630760] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-06T18:14:35.630861] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRM took 55.5s. Estimated remaining: 4h 14m 31s. Rate: 7.2 symbols/min [2025-10-06T18:14:35.798160] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:14:35.825581] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-06T18:14:35.846018] [DEBUG] [LOCAL ] CSTM: Loaded 48106 existing records from primary storage. [2025-10-06T18:14:35.846426] [INFO ] [MAIN ] CSTM: Loaded 48106 existing records. [2025-10-06T18:14:36.031422] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:14:36.032031] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-06T18:14:36.032093] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-06T18:14:36.032591] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-06T18:14:36.032688] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-06T18:14:36.410559] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:14:36.518998] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T18:14:36.625499] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-06T18:14:36.683126] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T18:14:37.425593] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-06T18:14:38.002923] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T18:14:38.049106] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-06T18:14:38.225538] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-06T18:14:39.025575] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-06T18:14:39.825515] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-06T18:14:39.885718] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T18:14:39.948301] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T18:14:40.625525] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-06T18:14:40.666156] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T18:14:41.425595] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-06T18:14:41.958193] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T18:14:41.960623] [INFO ] [REMOTE ] CSAN: Full fetch complete (60550 records). [2025-10-06T18:14:41.960759] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-06T18:14:42.230625] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-06T18:14:42.341145] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-06T18:14:42.341246] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-06T18:14:42.342004] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-06T18:14:42.342068] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-06T18:14:42.343444] [DEBUG] [LOCAL ] CSAN: Trimmed 60550 records to 42213 (keeping 200 days of data) [2025-10-06T18:14:42.579456] [DEBUG] [LOCAL ] CSAN: Primary data saved (42213 records). [2025-10-06T18:14:42.579627] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-06T18:14:42.579763] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSAN took 37.0s. Estimated remaining: 4h 14m 18s. Rate: 7.2 symbols/min [2025-10-06T18:14:42.754586] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:14:42.770889] [DEBUG] [LOCAL ] CSV: Loaded 13044 existing records from primary storage. [2025-10-06T18:14:42.771403] [INFO ] [MAIN ] CSV: Loaded 13044 existing records. [2025-10-06T18:14:42.932940] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T18:14:43.004329] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:14:43.004723] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-06T18:14:43.004796] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-06T18:14:43.005604] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-06T18:14:43.005699] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-06T18:14:43.037876] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-06T18:14:43.376471] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:14:43.492688] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T18:14:43.825597] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-06T18:14:44.617435] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T18:14:44.628141] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-06T18:14:45.139030] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T18:14:45.425541] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-06T18:14:45.639820] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-06T18:14:46.225570] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-06T18:14:47.012600] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T18:14:47.025483] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-06T18:14:47.142152] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-06T18:14:47.825537] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-06T18:14:48.625491] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-06T18:14:48.743598] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T18:14:49.169423] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T18:14:49.268396] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-06T18:14:49.425519] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-06T18:14:50.225548] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-06T18:14:50.386594] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-06T18:14:50.907470] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-06T18:14:51.025512] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-06T18:14:51.787788] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T18:14:51.789132] [INFO ] [REMOTE ] CSR: Full fetch complete (17712 records). [2025-10-06T18:14:51.789211] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-06T18:14:51.830706] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-06T18:14:52.183493] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-06T18:14:52.183584] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-06T18:14:52.184003] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-06T18:14:52.184064] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-06T18:14:52.184669] [DEBUG] [LOCAL ] CSR: Trimmed 17712 records to 12915 (keeping 200 days of data) [2025-10-06T18:14:52.268846] [DEBUG] [LOCAL ] CSR: Primary data saved (12915 records). [2025-10-06T18:14:52.269037] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-06T18:14:52.269132] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSR took 26.5s. Estimated remaining: 4h 14m 15s. Rate: 7.2 symbols/min [2025-10-06T18:14:52.444209] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:14:52.444458] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-06T18:14:52.444542] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-06T18:14:52.444695] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-06T18:14:52.444750] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-06T18:14:52.444793] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-06T18:14:52.444824] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-06T18:14:52.630761] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-06T18:14:52.801560] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:14:52.904579] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T18:14:53.425575] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-06T18:14:54.225552] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-06T18:14:54.447745] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T18:14:55.000737] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-06T18:14:55.025487] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-06T18:14:55.240234] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-06T18:14:55.825575] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-06T18:14:56.113736] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T18:14:56.116291] [INFO ] [REMOTE ] CSL: Full fetch complete (45430 records). [2025-10-06T18:14:56.116555] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-06T18:14:56.626483] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-06T18:14:56.646468] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-06T18:14:56.646586] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-06T18:14:56.647671] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-06T18:14:56.647763] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-06T18:14:56.649779] [DEBUG] [LOCAL ] CSL: Trimmed 45430 records to 31516 (keeping 200 days of data) [2025-10-06T18:14:56.879919] [DEBUG] [LOCAL ] CSL: Primary data saved (31516 records). [2025-10-06T18:14:56.880103] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-06T18:14:56.880747] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSL took 34.3s. Estimated remaining: 4h 13m 54s. Rate: 7.2 symbols/min [2025-10-06T18:14:57.087265] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:14:57.087516] [DEBUG] [LOCAL ] CTBB: No existing data file found in primary storage. [2025-10-06T18:14:57.087573] [WARN ] [MAIN ] CTBB: No existing data found, performing full refresh instead. [2025-10-06T18:14:57.087749] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-06T18:14:57.087800] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-06T18:14:57.087844] [DEBUG] [LOCAL ] CTBB: No primary data file found to delete. [2025-10-06T18:14:57.087876] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-06T18:14:57.435971] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-06T18:14:57.480040] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:14:57.507836] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T18:14:57.644346] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T18:14:57.688339] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:14:57.688579] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-06T18:14:57.688695] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:14:57.688747] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-06T18:14:57.688807] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:14:57.688876] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-06T18:14:57.688946] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-06T18:14:57.688982] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-06T18:14:57.689045] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-06T18:14:57.689112] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSW took 5.4s. Estimated remaining: 4h 13m 20s. Rate: 7.2 symbols/min [2025-10-06T18:14:57.853575] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:14:57.853773] [DEBUG] [LOCAL ] CTDD: No existing data file found in primary storage. [2025-10-06T18:14:57.853817] [WARN ] [MAIN ] CTDD: No existing data found, performing full refresh instead. [2025-10-06T18:14:57.853925] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-06T18:14:57.853966] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-06T18:14:57.854009] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-10-06T18:14:57.854040] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-06T18:14:58.203569] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:14:58.225481] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-06T18:14:59.025526] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-06T18:14:59.108040] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-06T18:14:59.825543] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-06T18:15:00.513434] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T18:15:00.625488] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-06T18:15:00.635966] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-06T18:15:01.425632] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-06T18:15:02.036936] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T18:15:02.225575] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-06T18:15:02.358824] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T18:15:03.025507] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-06T18:15:03.062908] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T18:15:03.385230] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-06T18:15:03.825539] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-06T18:15:04.625487] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-06T18:15:04.847131] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T18:15:05.425597] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-06T18:15:06.228735] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-06T18:15:06.232195] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T18:15:06.423230] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T18:15:07.025560] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-06T18:15:07.164023] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T18:15:07.811679] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-06T18:15:07.825470] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-06T18:15:08.625598] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-06T18:15:08.638719] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T18:15:09.425547] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-06T18:15:09.609323] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-06T18:15:09.610632] [INFO ] [REMOTE ] CSV: Full fetch complete (19471 records). [2025-10-06T18:15:09.610774] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-06T18:15:09.971410] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-06T18:15:09.971489] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-06T18:15:09.971905] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-06T18:15:09.971966] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-06T18:15:09.972589] [DEBUG] [LOCAL ] CSV: Trimmed 19471 records to 12801 (keeping 200 days of data) [2025-10-06T18:15:10.048214] [DEBUG] [LOCAL ] CSV: Primary data saved (12801 records). [2025-10-06T18:15:10.048369] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-06T18:15:10.048457] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSV took 27.5s. Estimated remaining: 4h 13m 25s. Rate: 7.2 symbols/min [2025-10-06T18:15:10.155097] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-06T18:15:10.249897] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-06T18:15:10.254059] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:15:10.254354] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-06T18:15:10.254428] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-06T18:15:10.254573] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-06T18:15:10.254632] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-06T18:15:10.254734] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-06T18:15:10.254780] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-06T18:15:10.601071] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:15:10.891155] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-06T18:15:11.025536] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-06T18:15:11.750594] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T18:15:11.825470] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-06T18:15:12.450339] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T18:15:12.625503] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-06T18:15:13.425488] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-06T18:15:13.451613] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-06T18:15:14.225600] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-06T18:15:15.025556] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-06T18:15:15.096304] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-06T18:15:15.098581] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T18:15:15.395005] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:15:15.395363] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-06T18:15:15.395507] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:15:15.395561] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-06T18:15:15.395618] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:15:15.395720] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-06T18:15:15.395829] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-06T18:15:15.395916] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-06T18:15:15.396016] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-06T18:15:15.396117] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTEST took 5.3s. Estimated remaining: 4h 13m 7s. Rate: 7.2 symbols/min [2025-10-06T18:15:15.563348] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:15:15.563620] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-06T18:15:15.563711] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-06T18:15:15.563833] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-06T18:15:15.563877] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-06T18:15:15.563919] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-06T18:15:15.563951] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-06T18:15:15.830811] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-06T18:15:15.913832] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:15:16.625524] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-06T18:15:16.843109] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:15:16.843505] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-06T18:15:16.843600] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:15:16.843683] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-06T18:15:16.843756] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:15:16.843830] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-06T18:15:16.843903] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-06T18:15:16.843939] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-06T18:15:16.844034] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-06T18:15:16.844104] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTEV took 1.4s. Estimated remaining: 4h 12m 36s. Rate: 7.2 symbols/min [2025-10-06T18:15:17.073272] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:15:17.110073] [DEBUG] [LOCAL ] CTO: Loaded 28288 existing records from primary storage. [2025-10-06T18:15:17.110440] [INFO ] [MAIN ] CTO: Loaded 28288 existing records. [2025-10-06T18:15:17.315370] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:15:17.315760] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-06T18:15:17.315819] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-06T18:15:17.316337] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-06T18:15:17.316398] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-06T18:15:17.426018] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-06T18:15:17.578624] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-06T18:15:17.628777] [INFO ] [REMOTE ] CSTM: Full fetch complete (69194 records). [2025-10-06T18:15:17.632172] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-06T18:15:17.827972] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:15:18.120065] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-06T18:15:18.120174] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-06T18:15:18.121074] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-06T18:15:18.121143] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-06T18:15:18.122635] [DEBUG] [LOCAL ] CSTM: Trimmed 69194 records to 47430 (keeping 200 days of data) [2025-10-06T18:15:18.215586] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-06T18:15:18.226015] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-06T18:15:18.426891] [DEBUG] [LOCAL ] CSTM: Primary data saved (47430 records). [2025-10-06T18:15:18.427085] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-06T18:15:18.427254] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CSTM took 42.8s. Estimated remaining: 4h 12m 5s. Rate: 7.2 symbols/min [2025-10-06T18:15:18.600218] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:15:18.636867] [DEBUG] [LOCAL ] CTOS: Loaded 37159 existing records from primary storage. [2025-10-06T18:15:18.637290] [INFO ] [MAIN ] CTOS: Loaded 37159 existing records. [2025-10-06T18:15:18.825382] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:15:18.825716] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-06T18:15:18.825793] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-06T18:15:18.827219] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-06T18:15:18.827284] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-06T18:15:19.026526] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-06T18:15:19.229416] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:15:19.825526] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-06T18:15:19.855169] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T18:15:19.877938] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T18:15:20.561636] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T18:15:20.625530] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-06T18:15:21.425566] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-06T18:15:21.858594] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T18:15:22.158694] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T18:15:22.225588] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-06T18:15:22.835203] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-06T18:15:23.025566] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-06T18:15:23.743852] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T18:15:23.825492] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-06T18:15:24.526305] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T18:15:24.625530] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-06T18:15:25.301176] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-06T18:15:25.425523] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-06T18:15:25.970121] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T18:15:25.971873] [INFO ] [REMOTE ] CTDD: Full fetch complete (8390 records). [2025-10-06T18:15:25.972176] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-06T18:15:26.233483] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-06T18:15:26.370549] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-06T18:15:26.370923] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-06T18:15:26.371344] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-06T18:15:26.371388] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-06T18:15:26.371884] [DEBUG] [LOCAL ] CTDD: Trimmed 8390 records to 5859 (keeping 200 days of data) [2025-10-06T18:15:26.411302] [DEBUG] [LOCAL ] CTDD: Primary data saved (5859 records). [2025-10-06T18:15:26.411481] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-06T18:15:26.411583] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTDD took 28.7s. Estimated remaining: 4h 11m 56s. Rate: 7.2 symbols/min [2025-10-06T18:15:26.597088] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:15:26.664385] [DEBUG] [LOCAL ] CTRA: Loaded 54427 existing records from primary storage. [2025-10-06T18:15:26.664876] [INFO ] [MAIN ] CTRA: Loaded 54427 existing records. [2025-10-06T18:15:26.860171] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T18:15:26.859946] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:15:26.861878] [INFO ] [REMOTE ] CTBB: Full fetch complete (10603 records). [2025-10-06T18:15:26.861779] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-06T18:15:26.862171] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-06T18:15:26.862792] [FATAL] [VALIDATOR ] CTBB: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:15:26.862084] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-06T18:15:26.862925] [FATAL] [MAIN ] CTBB: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:15:26.863134] [WARN ] [MAIN ] CTBB: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:15:26.863214] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-06T18:15:26.863326] [DEBUG] [LOCAL ] CTBB: No primary data file found to delete. [2025-10-06T18:15:26.863398] [INFO ] [LOCAL ] CTBB: Starting deletion of derivative data. [2025-10-06T18:15:26.863454] [DEBUG] [LOCAL ] CTBB: No derivative data file found to delete. [2025-10-06T18:15:26.863520] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTBB took 30.0s. Estimated remaining: 4h 11m 21s. Rate: 7.3 symbols/min [2025-10-06T18:15:26.895159] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-06T18:15:26.938579] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-06T18:15:27.031457] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-06T18:15:27.232745] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:15:27.505011] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:15:27.524941] [DEBUG] [LOCAL ] CTRE: Loaded 49988 existing records from primary storage. [2025-10-06T18:15:27.525375] [INFO ] [MAIN ] CTRE: Loaded 49988 existing records. [2025-10-06T18:15:27.748104] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:15:27.748426] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-06T18:15:27.748507] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-06T18:15:27.750102] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-06T18:15:27.750162] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-06T18:15:27.830696] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-06T18:15:28.105559] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:15:28.597918] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T18:15:28.625535] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-06T18:15:29.090051] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T18:15:29.425557] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-06T18:15:30.226965] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T18:15:30.225556] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-06T18:15:30.805493] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T18:15:31.025546] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-06T18:15:31.825492] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-06T18:15:32.270994] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T18:15:32.373862] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-06T18:15:32.625507] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-06T18:15:33.086263] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T18:15:33.425561] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-06T18:15:33.748856] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T18:15:34.225566] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-06T18:15:35.014776] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T18:15:35.025472] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-06T18:15:35.566071] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-06T18:15:35.825571] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-06T18:15:36.625514] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-06T18:15:36.740795] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T18:15:37.034466] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-06T18:15:37.425591] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-06T18:15:38.003301] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T18:15:38.225539] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-06T18:15:38.601360] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T18:15:39.025546] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-06T18:15:39.825552] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-06T18:15:39.928077] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T18:15:40.328885] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-06T18:15:40.625540] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-06T18:15:41.377099] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T18:15:41.425473] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-06T18:15:41.835152] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T18:15:42.225518] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-06T18:15:42.693446] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-06T18:15:43.025599] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-06T18:15:43.825501] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-06T18:15:43.932881] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T18:15:44.558670] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T18:15:44.625493] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-06T18:15:45.425499] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-06T18:15:45.454267] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T18:15:46.225546] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-06T18:15:46.593016] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-06T18:15:47.025490] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-06T18:15:47.552713] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-06T18:15:47.585188] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T18:15:47.825573] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-06T18:15:48.430761] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T18:15:48.625612] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-06T18:15:49.425533] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-06T18:15:49.534162] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T18:15:49.565380] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T18:15:50.225633] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-06T18:15:50.921579] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T18:15:51.025592] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-06T18:15:51.737462] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T18:15:51.825687] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-06T18:15:52.351589] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T18:15:52.625527] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-06T18:15:53.306842] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T18:15:53.315288] [INFO ] [REMOTE ] CTRE: Full fetch complete (71216 records). [2025-10-06T18:15:53.315701] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-06T18:15:53.428132] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-06T18:15:53.675254] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T18:15:53.727847] [INFO ] [REMOTE ] CTO: Full fetch complete (41759 records). [2025-10-06T18:15:53.746312] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-06T18:15:53.770017] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-06T18:15:53.806016] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-06T18:15:53.844707] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-06T18:15:53.857060] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-06T18:15:53.932805] [DEBUG] [LOCAL ] CTRE: Trimmed 71216 records to 49286 (keeping 200 days of data) [2025-10-06T18:15:54.226100] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-06T18:15:54.318090] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-06T18:15:54.319221] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-06T18:15:54.321126] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-06T18:15:54.322450] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-06T18:15:54.326171] [DEBUG] [LOCAL ] CTO: Trimmed 41759 records to 27723 (keeping 200 days of data) [2025-10-06T18:15:54.657802] [DEBUG] [LOCAL ] CTO: Primary data saved (27723 records). [2025-10-06T18:15:54.659241] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-06T18:15:54.659400] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTO took 37.8s. Estimated remaining: 4h 12m 18s. Rate: 7.2 symbols/min [2025-10-06T18:15:54.863025] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:15:54.865161] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-10-06T18:15:54.866893] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-10-06T18:15:54.869245] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-06T18:15:54.870351] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-06T18:15:54.870787] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-06T18:15:54.871545] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-06T18:15:55.347228] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:15:55.348503] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-06T18:15:55.354233] [DEBUG] [LOCAL ] CTRE: Primary data saved (49286 records). [2025-10-06T18:15:55.354589] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-06T18:15:55.354807] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTRE took 28.5s. Estimated remaining: 4h 11m 44s. Rate: 7.2 symbols/min [2025-10-06T18:15:55.532426] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-06T18:15:55.619043] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:15:55.619404] [DEBUG] [LOCAL ] CTS: No existing data file found in primary storage. [2025-10-06T18:15:55.619464] [WARN ] [MAIN ] CTS: No existing data found, performing full refresh instead. [2025-10-06T18:15:55.619589] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-06T18:15:55.619633] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-06T18:15:55.619758] [DEBUG] [LOCAL ] CTS: No primary data file found to delete. [2025-10-06T18:15:55.619803] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-06T18:15:55.830877] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-06T18:15:56.022257] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T18:15:56.072979] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:15:56.470632] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T18:15:56.625558] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-06T18:15:57.425557] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-06T18:15:57.633074] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T18:15:58.042528] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T18:15:58.225549] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-06T18:15:58.604372] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T18:15:59.025635] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-06T18:15:59.825558] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-06T18:16:00.104044] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T18:16:00.315605] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-06T18:16:00.625556] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-06T18:16:00.831516] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T18:16:01.425573] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-06T18:16:01.790715] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T18:16:02.225579] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-06T18:16:02.376920] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T18:16:03.025564] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-06T18:16:03.694139] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-06T18:16:03.794394] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-06T18:16:03.825480] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-06T18:16:04.625510] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-06T18:16:04.929867] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-06T18:16:05.425590] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-06T18:16:05.861325] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-06T18:16:06.225565] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-06T18:16:07.025575] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-06T18:16:07.068605] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T18:16:07.070760] [INFO ] [REMOTE ] CTOS: Full fetch complete (53315 records). [2025-10-06T18:16:07.070870] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-06T18:16:07.071529] [FATAL] [VALIDATOR ] CTOS: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:16:07.071670] [FATAL] [MAIN ] CTOS: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:16:07.071728] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:16:07.071818] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-06T18:16:07.071907] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-06T18:16:07.072016] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-10-06T18:16:07.072305] [DEBUG] [LOCAL ] CTOS: Deleted derivative data file. [2025-10-06T18:16:07.072407] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTOS took 48.6s. Estimated remaining: 4h 11m 48s. Rate: 7.2 symbols/min [2025-10-06T18:16:07.245203] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:16:07.303326] [DEBUG] [LOCAL ] CTVA: Loaded 54019 existing records from primary storage. [2025-10-06T18:16:07.303767] [INFO ] [MAIN ] CTVA: Loaded 54019 existing records. [2025-10-06T18:16:07.488908] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:16:07.489359] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-06T18:16:07.489477] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-06T18:16:07.499919] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-06T18:16:07.500065] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-06T18:16:07.522299] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T18:16:07.830760] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-06T18:16:07.896753] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:16:08.235883] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T18:16:08.625520] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-06T18:16:09.026119] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T18:16:09.425499] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-06T18:16:10.225542] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-06T18:16:10.714444] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-06T18:16:11.025513] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-06T18:16:11.277321] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T18:16:11.437706] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-06T18:16:11.825561] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-06T18:16:12.625533] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-06T18:16:13.051409] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-06T18:16:13.202215] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T18:16:13.425545] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-06T18:16:13.769003] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T18:16:14.225547] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-06T18:16:14.894930] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T18:16:15.025550] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-06T18:16:15.233869] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-06T18:16:15.825538] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-06T18:16:16.571010] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T18:16:16.625495] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-06T18:16:16.884384] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T18:16:17.425553] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-06T18:16:18.225552] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-06T18:16:18.351683] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T18:16:18.353323] [INFO ] [REMOTE ] CTS: Full fetch complete (26829 records). [2025-10-06T18:16:18.353439] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-06T18:16:18.688984] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-06T18:16:18.785083] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-06T18:16:18.785177] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-06T18:16:18.785678] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-06T18:16:18.785755] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-06T18:16:18.786565] [DEBUG] [LOCAL ] CTS: Trimmed 26829 records to 19411 (keeping 200 days of data) [2025-10-06T18:16:18.907609] [DEBUG] [LOCAL ] CTS: Primary data saved (19411 records). [2025-10-06T18:16:18.907837] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-06T18:16:18.907927] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTS took 23.6s. Estimated remaining: 4h 11m 51s. Rate: 7.2 symbols/min [2025-10-06T18:16:19.030753] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-06T18:16:19.093712] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:16:19.093975] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-06T18:16:19.094022] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-06T18:16:19.094145] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-06T18:16:19.094188] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-06T18:16:19.094230] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-06T18:16:19.094264] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-06T18:16:19.465957] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:16:19.658989] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T18:16:19.661674] [INFO ] [REMOTE ] CTRA: Full fetch complete (77272 records). [2025-10-06T18:16:19.661788] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-06T18:16:19.662852] [FATAL] [VALIDATOR ] CTRA: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:16:19.662955] [FATAL] [MAIN ] CTRA: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:16:19.662998] [WARN ] [MAIN ] CTRA: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:16:19.663037] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-06T18:16:19.663103] [DEBUG] [LOCAL ] CTRA: No primary data file found to delete. [2025-10-06T18:16:19.663137] [INFO ] [LOCAL ] CTRA: Starting deletion of derivative data. [2025-10-06T18:16:19.663357] [DEBUG] [LOCAL ] CTRA: Deleted derivative data file. [2025-10-06T18:16:19.663457] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRA took 53.3s. Estimated remaining: 4h 11m 18s. Rate: 7.2 symbols/min [2025-10-06T18:16:19.830718] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-06T18:16:19.834440] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:16:19.894930] [DEBUG] [LOCAL ] CUBE: Loaded 51365 existing records from primary storage. [2025-10-06T18:16:19.895474] [INFO ] [MAIN ] CUBE: Loaded 51365 existing records. [2025-10-06T18:16:20.075983] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:16:20.076249] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-06T18:16:20.076381] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-06T18:16:20.077817] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-06T18:16:20.077877] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-06T18:16:20.287982] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-06T18:16:20.476559] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:16:20.625512] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-06T18:16:21.057117] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-06T18:16:21.425715] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-06T18:16:21.741386] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-06T18:16:22.225505] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-06T18:16:22.316613] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T18:16:23.025598] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-06T18:16:23.825513] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-06T18:16:24.032251] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T18:16:24.150890] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-06T18:16:24.631053] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-06T18:16:24.645612] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T18:16:25.425594] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-06T18:16:25.784462] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-06T18:16:26.225579] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-06T18:16:26.382538] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T18:16:26.556594] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-06T18:16:27.025612] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-06T18:16:27.825568] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-06T18:16:28.214421] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-06T18:16:28.402075] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T18:16:28.404556] [INFO ] [REMOTE ] CTRI: Full fetch complete (51821 records). [2025-10-06T18:16:28.404751] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-06T18:16:28.405470] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:16:28.405565] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:16:28.405609] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:16:28.405703] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-06T18:16:28.405787] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-06T18:16:28.405823] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-06T18:16:28.405862] [DEBUG] [LOCAL ] CTRI: No derivative data file found to delete. [2025-10-06T18:16:28.405926] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTRI took 33.7s. Estimated remaining: 4h 11m 11s. Rate: 7.2 symbols/min [2025-10-06T18:16:28.586083] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:16:28.613721] [DEBUG] [LOCAL ] CUBI: Loaded 27487 existing records from primary storage. [2025-10-06T18:16:28.614066] [INFO ] [MAIN ] CUBI: Loaded 27487 existing records. [2025-10-06T18:16:28.625525] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-06T18:16:28.797498] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:16:28.797768] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-06T18:16:28.797824] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-06T18:16:28.798679] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-06T18:16:28.798742] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-06T18:16:29.162431] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:16:29.425610] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-06T18:16:29.690456] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-06T18:16:30.225510] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-06T18:16:30.498241] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-06T18:16:31.025705] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-06T18:16:31.446992] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T18:16:31.825571] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-06T18:16:32.309037] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-06T18:16:32.625590] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-06T18:16:32.828038] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T18:16:32.966548] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-06T18:16:33.425621] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-06T18:16:33.766049] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-06T18:16:34.225566] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-06T18:16:35.025615] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-06T18:16:35.825556] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-06T18:16:35.962632] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T18:16:36.625518] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-06T18:16:36.693873] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T18:16:37.129533] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T18:16:37.425688] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-06T18:16:38.102672] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T18:16:38.225568] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-06T18:16:38.588477] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T18:16:38.602310] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T18:16:38.603198] [INFO ] [REMOTE ] CUBB: Full fetch complete (931 records). [2025-10-06T18:16:38.603288] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-06T18:16:38.840842] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-06T18:16:38.841087] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:16:38.841164] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:16:38.841238] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-06T18:16:38.841337] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-06T18:16:38.841376] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-06T18:16:38.841418] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-06T18:16:38.841482] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CUBB took 19.9s. Estimated remaining: 4h 11m 10s. Rate: 7.2 symbols/min [2025-10-06T18:16:39.030536] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-06T18:16:39.032368] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:16:39.086829] [DEBUG] [LOCAL ] CUK: Loaded 51758 existing records from primary storage. [2025-10-06T18:16:39.087243] [INFO ] [MAIN ] CUK: Loaded 51758 existing records. [2025-10-06T18:16:39.261438] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:16:39.261733] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-06T18:16:39.261789] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-06T18:16:39.263009] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-06T18:16:39.263069] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-06T18:16:39.614970] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:16:39.825555] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-06T18:16:40.625700] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-06T18:16:40.808164] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T18:16:41.425579] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-06T18:16:41.487244] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T18:16:41.490493] [INFO ] [REMOTE ] CTVA: Full fetch complete (76992 records). [2025-10-06T18:16:41.490753] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-06T18:16:41.898441] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T18:16:42.061878] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-06T18:16:42.062005] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-06T18:16:42.063059] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-06T18:16:42.063147] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-06T18:16:42.065076] [DEBUG] [LOCAL ] CTVA: Trimmed 76992 records to 53246 (keeping 200 days of data) [2025-10-06T18:16:42.246724] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-06T18:16:42.405073] [DEBUG] [LOCAL ] CTVA: Primary data saved (53246 records). [2025-10-06T18:16:42.405291] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-06T18:16:42.405395] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CTVA took 35.3s. Estimated remaining: 4h 10m 46s. Rate: 7.2 symbols/min [2025-10-06T18:16:42.578491] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:16:42.583244] [DEBUG] [LOCAL ] CULP: Loaded 2970 existing records from primary storage. [2025-10-06T18:16:42.583436] [INFO ] [MAIN ] CULP: Loaded 2970 existing records. [2025-10-06T18:16:42.769879] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:16:42.770142] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-06T18:16:42.770192] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-06T18:16:42.770404] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-06T18:16:42.770466] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-06T18:16:43.036563] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-06T18:16:43.129857] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:16:43.164078] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T18:16:43.825557] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-06T18:16:44.002300] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T18:16:44.073160] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T18:16:44.625599] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-06T18:16:45.425511] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-06T18:16:45.574954] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T18:16:45.731164] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T18:16:46.225494] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-06T18:16:47.025527] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-06T18:16:47.343749] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T18:16:47.825513] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-06T18:16:48.046417] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T18:16:48.153049] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T18:16:48.580606] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-06T18:16:48.625557] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-06T18:16:49.425580] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-06T18:16:50.225562] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-06T18:16:50.360377] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T18:16:51.025493] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-06T18:16:51.298273] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-06T18:16:51.583199] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-06T18:16:51.825572] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-06T18:16:52.558600] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T18:16:52.625573] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-06T18:16:53.425513] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-06T18:16:53.572289] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T18:16:53.625823] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T18:16:54.225540] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-06T18:16:55.025595] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-06T18:16:55.396126] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T18:16:55.825567] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-06T18:16:55.906874] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T18:16:55.910628] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T18:16:56.625596] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-06T18:16:57.425503] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-06T18:16:57.624783] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T18:16:57.907855] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-06T18:16:58.005086] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T18:16:58.225619] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-06T18:16:59.025585] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-06T18:16:59.825609] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-06T18:17:00.034438] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-06T18:17:00.571086] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T18:17:00.574494] [INFO ] [REMOTE ] CUBE: Full fetch complete (73059 records). [2025-10-06T18:17:00.574705] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-06T18:17:00.634008] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-06T18:17:00.991988] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-06T18:17:00.992119] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-06T18:17:00.993139] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-06T18:17:00.993223] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-06T18:17:00.995111] [DEBUG] [LOCAL ] CUBE: Trimmed 73059 records to 50758 (keeping 200 days of data) [2025-10-06T18:17:01.244011] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T18:17:01.357476] [DEBUG] [LOCAL ] CUBE: Primary data saved (50758 records). [2025-10-06T18:17:01.357677] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-06T18:17:01.357792] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBE took 41.7s. Estimated remaining: 4h 11m 12s. Rate: 7.2 symbols/min [2025-10-06T18:17:01.429300] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-06T18:17:01.482028] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T18:17:01.561121] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:17:01.598522] [DEBUG] [LOCAL ] CURB: Loaded 33201 existing records from primary storage. [2025-10-06T18:17:01.598949] [INFO ] [MAIN ] CURB: Loaded 33201 existing records. [2025-10-06T18:17:01.781257] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:17:01.781597] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-06T18:17:01.781682] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-06T18:17:01.782632] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-06T18:17:01.782724] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-06T18:17:02.141063] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:17:02.225544] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-06T18:17:03.025519] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-06T18:17:03.434391] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-06T18:17:03.434688] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T18:17:03.450484] [INFO ] [REMOTE ] CUBI: Full fetch complete (39328 records). [2025-10-06T18:17:03.450700] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-06T18:17:03.677875] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-06T18:17:03.830573] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-06T18:17:03.918045] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-06T18:17:03.918145] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-06T18:17:03.918889] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-06T18:17:03.919049] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-06T18:17:03.920076] [DEBUG] [LOCAL ] CUBI: Trimmed 39328 records to 27064 (keeping 200 days of data) [2025-10-06T18:17:04.099434] [DEBUG] [LOCAL ] CUBI: Primary data saved (27064 records). [2025-10-06T18:17:04.099610] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-06T18:17:04.099771] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBI took 35.7s. Estimated remaining: 4h 10m 46s. Rate: 7.2 symbols/min [2025-10-06T18:17:04.275857] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-06T18:17:04.625579] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-06T18:17:05.129173] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-06T18:17:05.425587] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-06T18:17:06.225554] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-06T18:17:06.951391] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T18:17:07.025559] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-06T18:17:07.252560] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T18:17:07.825530] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-06T18:17:08.317034] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-06T18:17:08.461914] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T18:17:08.625540] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-06T18:17:09.354169] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T18:17:09.425574] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-06T18:17:10.225529] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-06T18:17:11.025535] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-06T18:17:11.229200] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T18:17:11.503222] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T18:17:11.693238] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-06T18:17:11.694028] [INFO ] [REMOTE ] CULP: Full fetch complete (4619 records). [2025-10-06T18:17:11.694101] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-06T18:17:11.694470] [FATAL] [VALIDATOR ] CULP: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:17:11.694556] [FATAL] [MAIN ] CULP: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:17:11.694600] [WARN ] [MAIN ] CULP: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:17:11.694638] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-06T18:17:11.694763] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-06T18:17:11.694809] [INFO ] [LOCAL ] CULP: Starting deletion of derivative data. [2025-10-06T18:17:11.695082] [DEBUG] [LOCAL ] CULP: Deleted derivative data file. [2025-10-06T18:17:11.695179] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CULP took 29.3s. Estimated remaining: 4h 10m 35s. Rate: 7.2 symbols/min [2025-10-06T18:17:11.825510] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-06T18:17:12.625614] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-06T18:17:13.136041] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T18:17:13.425628] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-06T18:17:14.271783] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-06T18:17:14.274788] [INFO ] [REMOTE ] CUK: Full fetch complete (74012 records). [2025-10-06T18:17:14.274966] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-06T18:17:14.677462] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-06T18:17:14.677668] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-06T18:17:14.678736] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-06T18:17:14.678824] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-06T18:17:14.680589] [DEBUG] [LOCAL ] CUK: Trimmed 74012 records to 50984 (keeping 200 days of data) [2025-10-06T18:17:14.927971] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T18:17:14.941068] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-06T18:17:15.026155] [DEBUG] [LOCAL ] CUK: Primary data saved (50984 records). [2025-10-06T18:17:15.026332] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-06T18:17:15.027170] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CUK took 36.2s. Estimated remaining: 4h 10m 11s. Rate: 7.2 symbols/min [2025-10-06T18:17:16.458871] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T18:17:16.467918] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-06T18:17:17.782278] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T18:17:17.788559] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-06T18:17:19.202135] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T18:17:19.209001] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-06T18:17:20.563385] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T18:17:20.571104] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-06T18:17:22.114175] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T18:17:22.123502] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-06T18:17:23.497561] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T18:17:23.504881] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-06T18:17:24.656611] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-06T18:17:24.658838] [INFO ] [REMOTE ] CURB: Full fetch complete (47171 records). [2025-10-06T18:17:24.659313] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-06T18:17:24.662722] [FATAL] [VALIDATOR ] CURB: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:17:24.662850] [FATAL] [MAIN ] CURB: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:17:24.662917] [WARN ] [MAIN ] CURB: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:17:24.662996] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-06T18:17:24.663092] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-06T18:17:24.663209] [INFO ] [LOCAL ] CURB: Starting deletion of derivative data. [2025-10-06T18:17:24.663540] [DEBUG] [LOCAL ] CURB: Deleted derivative data file. [2025-10-06T18:17:24.663690] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CURB took 23.3s. Estimated remaining: 4h 10m 7s. Rate: 7.2 symbols/min [2025-10-06T18:17:25.282311] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:17:25.378216] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:17:25.474681] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:17:25.446863] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:17:25.485242] [DEBUG] [LOCAL ] CVEO: Loaded 15333 existing records from primary storage. [2025-10-06T18:17:25.485898] [INFO ] [MAIN ] CVEO: Loaded 15333 existing records. [2025-10-06T18:17:25.663358] [DEBUG] [LOCAL ] CURV: Loaded 27147 existing records from primary storage. [2025-10-06T18:17:25.729668] [INFO ] [MAIN ] CURV: Loaded 27147 existing records. [2025-10-06T18:17:25.765610] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:17:25.798409] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-06T18:17:25.801335] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-06T18:17:25.801478] [DEBUG] [LOCAL ] CUZ: Loaded 50071 existing records from primary storage. [2025-10-06T18:17:25.852127] [INFO ] [MAIN ] CUZ: Loaded 50071 existing records. [2025-10-06T18:17:25.828856] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-06T18:17:25.853163] [DEBUG] [LOCAL ] CVE: Loaded 54336 existing records from primary storage. [2025-10-06T18:17:25.874311] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-06T18:17:25.913302] [INFO ] [MAIN ] CVE: Loaded 54336 existing records. [2025-10-06T18:17:26.226237] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:17:26.320229] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-06T18:17:26.374393] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-06T18:17:26.407050] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-06T18:17:26.482336] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-06T18:17:26.648160] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:17:26.721257] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-06T18:17:26.764985] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-06T18:17:26.741492] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:17:26.784860] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-06T18:17:26.800801] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-06T18:17:26.842040] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-06T18:17:26.836624] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-06T18:17:26.855504] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-06T18:17:26.929868] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-06T18:17:27.176332] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:17:27.266216] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-06T18:17:27.673782] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:17:27.713897] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-06T18:17:27.945871] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:17:27.941942] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:17:27.946276] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-06T18:17:27.946533] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-06T18:17:28.262756] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-06T18:17:28.265606] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-06T18:17:29.160914] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T18:17:29.163237] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-06T18:17:29.292185] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T18:17:29.300012] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-06T18:17:29.444186] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T18:17:29.454173] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-06T18:17:29.527619] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T18:17:29.538408] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-06T18:17:29.678564] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-06T18:17:29.681798] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-06T18:17:30.457512] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T18:17:30.463387] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-06T18:17:30.783540] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T18:17:30.787494] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-06T18:17:31.009259] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T18:17:31.018633] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-06T18:17:31.390998] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-06T18:17:31.401607] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-06T18:17:31.586859] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T18:17:31.593617] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-06T18:17:31.662200] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-06T18:17:31.825557] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-06T18:17:32.513766] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T18:17:32.625608] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-06T18:17:32.678909] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-06T18:17:32.867753] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-06T18:17:33.155611] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T18:17:33.425581] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-06T18:17:34.225554] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-06T18:17:34.313089] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T18:17:34.515383] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T18:17:35.025574] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-06T18:17:35.825498] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-06T18:17:36.021228] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T18:17:36.121268] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T18:17:36.625601] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-06T18:17:36.846719] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T18:17:37.425588] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-06T18:17:38.225503] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-06T18:17:38.513622] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T18:17:38.599298] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T18:17:39.025542] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-06T18:17:39.279623] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-06T18:17:39.825572] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-06T18:17:40.625579] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-06T18:17:41.010270] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-06T18:17:41.305511] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T18:17:41.425533] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-06T18:17:42.225545] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-06T18:17:42.761494] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-06T18:17:42.785800] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T18:17:42.997954] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T18:17:43.025558] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-06T18:17:43.825551] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-06T18:17:44.625509] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-06T18:17:44.821848] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-06T18:17:45.425585] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-06T18:17:45.527005] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T18:17:46.055798] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-06T18:17:46.225550] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-06T18:17:47.025557] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-06T18:17:47.135829] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T18:17:47.567721] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-06T18:17:47.637352] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T18:17:47.640059] [INFO ] [REMOTE ] CURV: Full fetch complete (38910 records). [2025-10-06T18:17:47.640174] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-06T18:17:47.835581] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-06T18:17:48.038091] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-06T18:17:48.038195] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-06T18:17:48.038833] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-06T18:17:48.038895] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-06T18:17:48.039783] [DEBUG] [LOCAL ] CURV: Trimmed 38910 records to 26819 (keeping 200 days of data) [2025-10-06T18:17:48.191914] [DEBUG] [LOCAL ] CURV: Primary data saved (26819 records). [2025-10-06T18:17:48.192113] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-06T18:17:48.192216] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CURV took 23.5s. Estimated remaining: 4h 10m 48s. Rate: 7.2 symbols/min [2025-10-06T18:17:48.367567] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:17:48.413379] [DEBUG] [LOCAL ] CVI: Loaded 47178 existing records from primary storage. [2025-10-06T18:17:48.413770] [INFO ] [MAIN ] CVI: Loaded 47178 existing records. [2025-10-06T18:17:48.601347] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:17:48.601662] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-06T18:17:48.601777] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-06T18:17:48.602062] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-06T18:17:48.602121] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-06T18:17:48.632383] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-06T18:17:48.975239] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:17:49.425545] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-06T18:17:49.471846] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T18:17:49.567576] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T18:17:49.568944] [INFO ] [REMOTE ] CVEO: Full fetch complete (20406 records). [2025-10-06T18:17:49.569016] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-06T18:17:49.987626] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-06T18:17:49.987763] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-06T18:17:49.988602] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-06T18:17:49.988667] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-06T18:17:49.989397] [DEBUG] [LOCAL ] CVEO: Trimmed 20406 records to 15179 (keeping 200 days of data) [2025-10-06T18:17:50.085251] [DEBUG] [LOCAL ] CVEO: Primary data saved (15179 records). [2025-10-06T18:17:50.085443] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-06T18:17:50.085556] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CVEO took 25.4s. Estimated remaining: 4h 10m 19s. Rate: 7.2 symbols/min [2025-10-06T18:17:50.240510] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-06T18:17:50.278753] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:17:50.297381] [DEBUG] [LOCAL ] CVLG: Loaded 15666 existing records from primary storage. [2025-10-06T18:17:50.297733] [INFO ] [MAIN ] CVLG: Loaded 15666 existing records. [2025-10-06T18:17:50.473621] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:17:50.474006] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-06T18:17:50.474071] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-06T18:17:50.475136] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-06T18:17:50.475196] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-06T18:17:50.825729] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:17:51.025522] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-06T18:17:51.280588] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T18:17:51.787003] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-06T18:17:51.825577] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-06T18:17:52.012664] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T18:17:52.625582] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-06T18:17:53.425586] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-06T18:17:53.775136] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-06T18:17:53.846959] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T18:17:54.225556] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-06T18:17:55.025542] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-06T18:17:55.089920] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T18:17:55.747964] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-06T18:17:55.750578] [INFO ] [REMOTE ] CVE: Full fetch complete (77171 records). [2025-10-06T18:17:55.750718] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-06T18:17:55.751677] [FATAL] [VALIDATOR ] CVE: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:17:55.751770] [FATAL] [MAIN ] CVE: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:17:55.751813] [WARN ] [MAIN ] CVE: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:17:55.751854] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-06T18:17:55.751920] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-06T18:17:55.751954] [INFO ] [LOCAL ] CVE: Starting deletion of derivative data. [2025-10-06T18:17:55.752192] [DEBUG] [LOCAL ] CVE: Deleted derivative data file. [2025-10-06T18:17:55.752291] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CVE took 31.1s. Estimated remaining: 4h 10m 2s. Rate: 7.2 symbols/min [2025-10-06T18:17:55.832980] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-06T18:17:55.855326] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T18:17:55.940704] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:17:55.995671] [DEBUG] [LOCAL ] CVNA: Loaded 53720 existing records from primary storage. [2025-10-06T18:17:55.996151] [INFO ] [MAIN ] CVNA: Loaded 53720 existing records. [2025-10-06T18:17:56.183897] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:17:56.184131] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-06T18:17:56.184178] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-06T18:17:56.184418] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-06T18:17:56.184474] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-06T18:17:56.534664] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:17:56.625496] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-06T18:17:57.425576] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-06T18:17:57.463910] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T18:17:57.624505] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T18:17:58.225517] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-06T18:17:59.025563] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-06T18:17:59.260377] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T18:17:59.707986] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T18:17:59.711331] [INFO ] [REMOTE ] CUZ: Full fetch complete (70778 records). [2025-10-06T18:17:59.711500] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-06T18:17:59.828716] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-06T18:18:00.045664] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T18:18:00.146059] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-06T18:18:00.146149] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-06T18:18:00.147088] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-06T18:18:00.147172] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-06T18:18:00.148713] [DEBUG] [LOCAL ] CUZ: Trimmed 70778 records to 49398 (keeping 200 days of data) [2025-10-06T18:18:00.448945] [DEBUG] [LOCAL ] CUZ: Primary data saved (49398 records). [2025-10-06T18:18:00.449112] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-06T18:18:00.449202] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CUZ took 35.8s. Estimated remaining: 4h 9m 42s. Rate: 7.2 symbols/min [2025-10-06T18:18:00.617406] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:18:00.617595] [DEBUG] [LOCAL ] CVS: No existing data file found in primary storage. [2025-10-06T18:18:00.617631] [WARN ] [MAIN ] CVS: No existing data found, performing full refresh instead. [2025-10-06T18:18:00.617765] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-06T18:18:00.617805] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-06T18:18:00.617845] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-10-06T18:18:00.617876] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-06T18:18:00.630830] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-06T18:18:00.971013] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:18:01.425578] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-06T18:18:01.699899] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T18:18:01.749338] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-06T18:18:02.225534] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-06T18:18:03.025539] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-06T18:18:03.418716] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T18:18:03.536561] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-06T18:18:03.825568] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-06T18:18:04.625594] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-06T18:18:05.274555] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T18:18:05.310978] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-06T18:18:05.425496] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-06T18:18:05.494979] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-06T18:18:05.952987] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-06T18:18:06.225534] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-06T18:18:07.025619] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-06T18:18:07.124228] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T18:18:07.825558] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-06T18:18:08.625614] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-06T18:18:09.192143] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-06T18:18:09.405948] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T18:18:09.407318] [INFO ] [REMOTE ] CVLG: Full fetch complete (20992 records). [2025-10-06T18:18:09.407395] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-06T18:18:09.408031] [FATAL] [VALIDATOR ] CVLG: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:18:09.408132] [FATAL] [MAIN ] CVLG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:18:09.408175] [WARN ] [MAIN ] CVLG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:18:09.408263] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-06T18:18:09.408363] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-06T18:18:09.408414] [INFO ] [LOCAL ] CVLG: Starting deletion of derivative data. [2025-10-06T18:18:09.408718] [DEBUG] [LOCAL ] CVLG: Deleted derivative data file. [2025-10-06T18:18:09.408838] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 19.3s. Estimated remaining: 4h 9m 36s. Rate: 7.2 symbols/min [2025-10-06T18:18:09.430691] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-06T18:18:09.605435] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:18:09.666944] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-10-06T18:18:09.667372] [INFO ] [MAIN ] CVX: Loaded 54540 existing records. [2025-10-06T18:18:09.853001] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:18:09.853304] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-06T18:18:09.853368] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-06T18:18:09.853599] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-06T18:18:09.853639] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-06T18:18:10.219493] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:18:10.225476] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-06T18:18:10.289605] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-06T18:18:11.025543] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-06T18:18:11.197161] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T18:18:11.825548] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-06T18:18:12.342740] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-06T18:18:12.625597] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-06T18:18:12.989348] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-06T18:18:13.425508] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-06T18:18:13.672771] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T18:18:14.225580] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-06T18:18:14.852035] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-06T18:18:15.025508] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-06T18:18:15.462465] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-06T18:18:15.825574] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-06T18:18:16.398032] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-06T18:18:16.625521] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-06T18:18:16.694320] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T18:18:17.425575] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-06T18:18:17.954593] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-06T18:18:18.225551] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-06T18:18:18.765284] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-06T18:18:19.025616] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-06T18:18:19.207578] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T18:18:19.825557] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-06T18:18:20.117879] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T18:18:20.625595] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-06T18:18:21.189797] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-06T18:18:21.425560] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-06T18:18:22.183176] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T18:18:22.225559] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-06T18:18:22.298613] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-06T18:18:23.025536] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-06T18:18:23.325267] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-06T18:18:23.825555] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-06T18:18:23.897906] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T18:18:24.625581] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-06T18:18:25.425517] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-06T18:18:25.644954] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-06T18:18:26.225553] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-06T18:18:26.361614] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-06T18:18:26.725517] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-06T18:18:26.778782] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-06T18:18:27.025552] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-06T18:18:27.825536] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-06T18:18:28.625570] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-06T18:18:28.920358] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-06T18:18:29.249710] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-06T18:18:29.425518] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-06T18:18:29.532022] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T18:18:30.225581] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-06T18:18:30.530571] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-06T18:18:31.025547] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-06T18:18:31.605057] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-06T18:18:31.651087] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T18:18:31.653987] [INFO ] [REMOTE ] CVI: Full fetch complete (67320 records). [2025-10-06T18:18:31.654182] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-06T18:18:31.825800] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-06T18:18:32.065584] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-06T18:18:32.065708] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-06T18:18:32.066539] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-06T18:18:32.066597] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-06T18:18:32.068128] [DEBUG] [LOCAL ] CVI: Trimmed 67320 records to 46494 (keeping 200 days of data) [2025-10-06T18:18:32.346859] [DEBUG] [LOCAL ] CVI: Primary data saved (46494 records). [2025-10-06T18:18:32.347050] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-06T18:18:32.347196] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVI took 44.2s. Estimated remaining: 4h 10m 15s. Rate: 7.2 symbols/min [2025-10-06T18:18:32.527230] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:18:32.527556] [DEBUG] [LOCAL ] CW: No existing data file found in primary storage. [2025-10-06T18:18:32.527626] [WARN ] [MAIN ] CW: No existing data found, performing full refresh instead. [2025-10-06T18:18:32.527802] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-06T18:18:32.527855] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-06T18:18:32.527911] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-10-06T18:18:32.527953] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-06T18:18:32.628242] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-06T18:18:32.880264] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:18:33.211095] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-06T18:18:33.230538] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T18:18:33.233848] [INFO ] [REMOTE ] CVS: Full fetch complete (77813 records). [2025-10-06T18:18:33.233968] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-06T18:18:33.430742] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-06T18:18:33.636603] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-06T18:18:33.636745] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-06T18:18:33.637778] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-06T18:18:33.637844] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-06T18:18:33.639532] [DEBUG] [LOCAL ] CVS: Trimmed 77813 records to 53696 (keeping 200 days of data) [2025-10-06T18:18:33.971946] [DEBUG] [LOCAL ] CVS: Primary data saved (53696 records). [2025-10-06T18:18:33.972118] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-06T18:18:33.972201] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVS took 33.5s. Estimated remaining: 4h 9m 45s. Rate: 7.2 symbols/min [2025-10-06T18:18:34.154190] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:18:34.186867] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-06T18:18:34.225481] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-06T18:18:34.250104] [DEBUG] [LOCAL ] CWAN: Loaded 53184 existing records from primary storage. [2025-10-06T18:18:34.250699] [INFO ] [MAIN ] CWAN: Loaded 53184 existing records. [2025-10-06T18:18:34.437689] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:18:34.437958] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-06T18:18:34.438006] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-06T18:18:34.438254] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-06T18:18:34.438321] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-06T18:18:34.800127] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:18:35.025565] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-06T18:18:35.825516] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-06T18:18:36.024165] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-06T18:18:36.321531] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-06T18:18:36.346840] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T18:18:36.625591] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-06T18:18:37.425637] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-06T18:18:37.795321] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-06T18:18:38.225615] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-06T18:18:39.025575] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-06T18:18:39.094405] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-06T18:18:39.627211] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-06T18:18:39.825491] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-06T18:18:39.899733] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T18:18:40.155922] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T18:18:40.625519] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-06T18:18:41.425542] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-06T18:18:42.085941] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-06T18:18:42.226137] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-06T18:18:42.231718] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T18:18:43.025489] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-06T18:18:43.291435] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-06T18:18:43.294456] [INFO ] [REMOTE ] CVNA: Full fetch complete (76658 records). [2025-10-06T18:18:43.294572] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-06T18:18:43.690787] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-06T18:18:43.690875] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-06T18:18:43.691789] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-06T18:18:43.691855] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-06T18:18:43.693578] [DEBUG] [LOCAL ] CVNA: Trimmed 76658 records to 52929 (keeping 200 days of data) [2025-10-06T18:18:43.864199] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-06T18:18:44.013182] [DEBUG] [LOCAL ] CVNA: Primary data saved (52929 records). [2025-10-06T18:18:44.013356] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-06T18:18:44.014134] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVNA took 48.3s. Estimated remaining: 4h 9m 42s. Rate: 7.2 symbols/min [2025-10-06T18:18:44.193509] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:18:44.197829] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-10-06T18:18:44.198540] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-10-06T18:18:44.199162] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-06T18:18:44.198988] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-06T18:18:44.199263] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-06T18:18:44.199530] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-06T18:18:44.202489] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-06T18:18:44.246227] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-10-06T18:18:44.283414] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-06T18:18:44.899368] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:18:44.917489] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-06T18:18:45.032460] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-06T18:18:45.032778] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-06T18:18:45.034117] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-06T18:18:45.034255] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-06T18:18:45.052892] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 53760 (keeping 200 days of data) [2025-10-06T18:18:45.087881] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-06T18:18:45.250024] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T18:18:45.426740] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-06T18:18:45.595254] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-06T18:18:45.595546] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-06T18:18:45.595718] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CVX took 36.2s. Estimated remaining: 4h 9m 13s. Rate: 7.2 symbols/min [2025-10-06T18:18:45.875755] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:18:45.947756] [DEBUG] [LOCAL ] CWH: Loaded 52068 existing records from primary storage. [2025-10-06T18:18:45.948205] [INFO ] [MAIN ] CWH: Loaded 52068 existing records. [2025-10-06T18:18:46.182357] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:18:46.182830] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-06T18:18:46.182886] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-06T18:18:46.183397] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-06T18:18:46.183679] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-06T18:18:46.238147] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-06T18:18:46.617070] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T18:18:46.639212] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:18:47.025529] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-06T18:18:47.185535] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T18:18:47.553740] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T18:18:47.825549] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-06T18:18:48.541389] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T18:18:48.625480] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-06T18:18:48.844146] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T18:18:49.425607] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-06T18:18:50.089993] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T18:18:50.225555] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-06T18:18:51.025549] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-06T18:18:51.243905] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T18:18:51.766553] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T18:18:51.825492] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-06T18:18:52.625500] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-06T18:18:52.839402] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T18:18:53.425502] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-06T18:18:53.540359] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T18:18:53.826241] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-06T18:18:54.225582] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-06T18:18:54.662267] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T18:18:55.025541] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-06T18:18:55.740629] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T18:18:55.825511] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-06T18:18:56.625554] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-06T18:18:56.969403] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-06T18:18:57.425550] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-06T18:18:57.721541] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T18:18:58.225503] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-06T18:18:58.346322] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T18:18:58.649561] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T18:18:59.025598] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-06T18:18:59.825503] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-06T18:19:00.050246] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-06T18:19:00.625557] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-06T18:19:00.943548] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T18:19:01.129877] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-06T18:19:01.425552] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-06T18:19:02.225538] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-06T18:19:02.350799] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T18:19:02.418167] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T18:19:03.025579] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-06T18:19:03.825504] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-06T18:19:04.091840] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-06T18:19:04.486464] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-06T18:19:04.625545] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-06T18:19:05.425500] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-06T18:19:05.528983] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T18:19:06.160862] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-06T18:19:06.225506] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-06T18:19:06.398192] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-06T18:19:06.930023] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T18:19:06.931409] [INFO ] [REMOTE ] CW: Full fetch complete (33142 records). [2025-10-06T18:19:06.931487] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-06T18:19:06.932105] [FATAL] [VALIDATOR ] CW: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:19:06.932218] [FATAL] [MAIN ] CW: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:19:06.932270] [WARN ] [MAIN ] CW: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:19:06.932337] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-06T18:19:06.932425] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-10-06T18:19:06.932501] [INFO ] [LOCAL ] CW: Starting deletion of derivative data. [2025-10-06T18:19:06.932559] [DEBUG] [LOCAL ] CW: No derivative data file found to delete. [2025-10-06T18:19:06.932638] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CW took 34.6s. Estimated remaining: 4h 9m 46s. Rate: 7.2 symbols/min [2025-10-06T18:19:07.030774] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-06T18:19:07.103445] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:19:07.151636] [DEBUG] [LOCAL ] CWK: Loaded 50148 existing records from primary storage. [2025-10-06T18:19:07.152049] [INFO ] [MAIN ] CWK: Loaded 50148 existing records. [2025-10-06T18:19:07.327635] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:19:07.327918] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-06T18:19:07.327964] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-06T18:19:07.328370] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-06T18:19:07.328428] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-06T18:19:07.678205] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:19:07.825511] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-06T18:19:08.625502] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-06T18:19:08.815393] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T18:19:09.425565] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-06T18:19:09.551754] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T18:19:10.225520] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-06T18:19:10.491269] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-06T18:19:11.025510] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-06T18:19:11.122379] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T18:19:11.825502] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-06T18:19:12.053762] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-06T18:19:12.481412] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T18:19:12.625506] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-06T18:19:13.298336] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T18:19:13.301538] [INFO ] [REMOTE ] CWEN: Full fetch complete (64894 records). [2025-10-06T18:19:13.301730] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-06T18:19:13.430639] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-06T18:19:13.701763] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-06T18:19:13.701863] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-06T18:19:13.702704] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-06T18:19:13.702769] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-06T18:19:13.704235] [DEBUG] [LOCAL ] CWEN: Trimmed 64894 records to 45176 (keeping 200 days of data) [2025-10-06T18:19:13.983137] [DEBUG] [LOCAL ] CWEN: Primary data saved (45176 records). [2025-10-06T18:19:13.983296] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-06T18:19:13.983380] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWEN took 30.0s. Estimated remaining: 4h 9m 33s. Rate: 7.2 symbols/min [2025-10-06T18:19:14.175198] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:19:14.175679] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-10-06T18:19:14.175782] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-10-06T18:19:14.176140] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-06T18:19:14.176267] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-06T18:19:14.176339] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-06T18:19:14.176538] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-06T18:19:14.235475] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-06T18:19:14.389085] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-06T18:19:14.609536] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:19:15.025593] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-06T18:19:15.415505] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T18:19:15.825546] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-06T18:19:16.028341] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-06T18:19:16.031343] [INFO ] [REMOTE ] CWAN: Full fetch complete (75191 records). [2025-10-06T18:19:16.031464] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-06T18:19:16.363208] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T18:19:16.447754] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-06T18:19:16.447882] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-06T18:19:16.448950] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-06T18:19:16.449015] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-06T18:19:16.450580] [DEBUG] [LOCAL ] CWAN: Trimmed 75191 records to 52437 (keeping 200 days of data) [2025-10-06T18:19:16.648603] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-06T18:19:16.760465] [DEBUG] [LOCAL ] CWAN: Primary data saved (52437 records). [2025-10-06T18:19:16.760661] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-06T18:19:16.760786] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWAN took 42.8s. Estimated remaining: 4h 9m 8s. Rate: 7.2 symbols/min [2025-10-06T18:19:16.927841] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:19:16.979764] [DEBUG] [LOCAL ] CX: Loaded 53593 existing records from primary storage. [2025-10-06T18:19:16.980138] [INFO ] [MAIN ] CX: Loaded 53593 existing records. [2025-10-06T18:19:17.156345] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:19:17.156581] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-06T18:19:17.156628] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-06T18:19:17.156916] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-06T18:19:17.156973] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-06T18:19:17.436436] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-06T18:19:17.519056] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:19:17.547882] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T18:19:17.897369] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T18:19:18.225546] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-06T18:19:18.768382] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-06T18:19:19.025598] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-06T18:19:19.507496] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-06T18:19:19.825533] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-06T18:19:20.505441] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T18:19:20.508729] [INFO ] [REMOTE ] CWH: Full fetch complete (73051 records). [2025-10-06T18:19:20.508845] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-06T18:19:20.632273] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-06T18:19:20.937778] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-06T18:19:20.937891] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-06T18:19:20.938803] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-06T18:19:20.938871] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-06T18:19:20.940734] [DEBUG] [LOCAL ] CWH: Trimmed 73051 records to 51312 (keeping 200 days of data) [2025-10-06T18:19:21.272762] [DEBUG] [LOCAL ] CWH: Primary data saved (51312 records). [2025-10-06T18:19:21.272949] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-06T18:19:21.273048] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWH took 35.7s. Estimated remaining: 4h 8m 47s. Rate: 7.2 symbols/min [2025-10-06T18:19:21.451106] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:19:21.430902] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-06T18:19:21.464873] [DEBUG] [LOCAL ] CXE: Loaded 6646 existing records from primary storage. [2025-10-06T18:19:21.465546] [INFO ] [MAIN ] CXE: Loaded 6646 existing records. [2025-10-06T18:19:21.649600] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:19:21.650059] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-06T18:19:21.650149] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-06T18:19:21.650562] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-06T18:19:21.650697] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-06T18:19:21.804543] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-06T18:19:22.113603] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:19:22.225565] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-06T18:19:22.475904] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T18:19:22.753543] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T18:19:22.853279] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-06T18:19:23.025543] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-06T18:19:23.820907] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-06T18:19:23.825459] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-06T18:19:24.625501] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-06T18:19:24.686250] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T18:19:25.425544] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-06T18:19:26.028234] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T18:19:26.225575] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-06T18:19:27.025501] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-06T18:19:27.055288] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T18:19:27.412723] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T18:19:27.825524] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-06T18:19:28.585731] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-06T18:19:28.625478] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-06T18:19:28.797392] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T18:19:29.425619] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-06T18:19:30.230624] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-06T18:19:30.247704] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T18:19:30.715784] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T18:19:31.025545] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-06T18:19:31.079276] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-06T18:19:31.825536] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-06T18:19:32.625545] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-06T18:19:33.091935] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-06T18:19:33.425504] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-06T18:19:33.521630] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T18:19:33.812555] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T18:19:34.225592] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-06T18:19:35.025600] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-06T18:19:35.322786] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-06T18:19:35.547894] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T18:19:35.825557] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-06T18:19:36.625555] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-06T18:19:36.808463] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T18:19:37.411126] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-06T18:19:37.425505] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-06T18:19:37.586199] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T18:19:38.129826] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-06T18:19:38.225593] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-06T18:19:38.806312] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T18:19:39.025583] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-06T18:19:39.825520] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-06T18:19:40.398744] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T18:19:40.625539] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-06T18:19:41.425575] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-06T18:19:41.570995] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T18:19:41.858412] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-06T18:19:42.225590] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-06T18:19:42.838079] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T18:19:42.841000] [INFO ] [REMOTE ] CWK: Full fetch complete (71041 records). [2025-10-06T18:19:42.841132] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-06T18:19:43.028413] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-06T18:19:43.260202] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-06T18:19:43.260394] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-06T18:19:43.261564] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-06T18:19:43.261689] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-06T18:19:43.263250] [DEBUG] [LOCAL ] CWK: Trimmed 71041 records to 49481 (keeping 200 days of data) [2025-10-06T18:19:43.570405] [DEBUG] [LOCAL ] CWK: Primary data saved (49481 records). [2025-10-06T18:19:43.570569] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-06T18:19:43.570679] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWK took 36.6s. Estimated remaining: 4h 9m 23s. Rate: 7.2 symbols/min [2025-10-06T18:19:43.753039] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:19:43.762184] [DEBUG] [LOCAL ] CXH: Loaded 4450 existing records from primary storage. [2025-10-06T18:19:43.762413] [INFO ] [MAIN ] CXH: Loaded 4450 existing records. [2025-10-06T18:19:43.829411] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-06T18:19:43.952433] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:19:43.953353] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-06T18:19:43.953415] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-06T18:19:43.953639] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-06T18:19:43.953725] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-06T18:19:44.245620] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T18:19:44.286516] [INFO ] [REMOTE ] CWT: Full fetch complete (40591 records). [2025-10-06T18:19:44.321319] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-06T18:19:44.329549] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-06T18:19:44.557911] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:19:44.628064] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-06T18:19:44.638377] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T18:19:44.849662] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-06T18:19:44.849771] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-06T18:19:44.850972] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-06T18:19:44.851036] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-06T18:19:44.853177] [DEBUG] [LOCAL ] CWT: Trimmed 40591 records to 27928 (keeping 200 days of data) [2025-10-06T18:19:45.043884] [DEBUG] [LOCAL ] CWT: Primary data saved (27928 records). [2025-10-06T18:19:45.044049] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-06T18:19:45.044144] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWT took 31.1s. Estimated remaining: 4h 8m 53s. Rate: 7.2 symbols/min [2025-10-06T18:19:45.223096] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:19:45.272051] [DEBUG] [LOCAL ] CXM: Loaded 48291 existing records from primary storage. [2025-10-06T18:19:45.272427] [INFO ] [MAIN ] CXM: Loaded 48291 existing records. [2025-10-06T18:19:45.432112] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-06T18:19:45.431880] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-06T18:19:45.467770] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:19:45.468008] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-06T18:19:45.468058] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-06T18:19:45.468340] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-06T18:19:45.468399] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-06T18:19:45.848173] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:19:46.225537] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-06T18:19:46.838381] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T18:19:47.025507] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-06T18:19:47.144318] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T18:19:47.825547] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-06T18:19:48.625520] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-06T18:19:49.286264] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-06T18:19:49.425570] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-06T18:19:49.464865] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T18:19:50.202265] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-06T18:19:50.201004] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T18:19:50.225474] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-06T18:19:51.025544] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-06T18:19:51.579336] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T18:19:51.580316] [INFO ] [REMOTE ] CXE: Full fetch complete (11782 records). [2025-10-06T18:19:51.580395] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-06T18:19:51.835314] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-06T18:19:51.934482] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T18:19:51.980952] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-06T18:19:51.981171] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-06T18:19:51.981510] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-06T18:19:51.981583] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-06T18:19:51.981707] [INFO ] [REMOTE ] CX: Full fetch complete (76374 records). [2025-10-06T18:19:51.982170] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-06T18:19:51.982599] [DEBUG] [LOCAL ] CXE: Trimmed 11782 records to 6286 (keeping 200 days of data) [2025-10-06T18:19:52.323532] [DEBUG] [LOCAL ] CXE: Primary data saved (6286 records). [2025-10-06T18:19:52.326037] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-06T18:19:52.326495] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CXE took 31.1s. Estimated remaining: 4h 8m 42s. Rate: 7.2 symbols/min [2025-10-06T18:19:52.570127] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-06T18:19:52.590069] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-06T18:19:52.593849] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-06T18:19:52.593944] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-06T18:19:52.625359] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:19:52.625798] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-06T18:19:52.626106] [DEBUG] [LOCAL ] CX: Trimmed 76374 records to 52807 (keeping 200 days of data) [2025-10-06T18:19:52.771114] [DEBUG] [LOCAL ] CXT: Loaded 31460 existing records from primary storage. [2025-10-06T18:19:52.773810] [INFO ] [MAIN ] CXT: Loaded 31460 existing records. [2025-10-06T18:19:53.034255] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:19:53.035198] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-06T18:19:53.062305] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-06T18:19:53.065863] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-06T18:19:53.066929] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-06T18:19:53.459988] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:19:53.467149] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-06T18:19:53.468045] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T18:19:53.515099] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T18:19:53.612581] [DEBUG] [LOCAL ] CX: Primary data saved (52807 records). [2025-10-06T18:19:53.612804] [INFO ] [MAIN ] CX: Full history saved. [2025-10-06T18:19:53.612907] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CX took 36.9s. Estimated remaining: 4h 8m 11s. Rate: 7.2 symbols/min [2025-10-06T18:19:53.780053] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:19:53.827780] [DEBUG] [LOCAL ] CXW: Loaded 44678 existing records from primary storage. [2025-10-06T18:19:53.828267] [INFO ] [MAIN ] CXW: Loaded 44678 existing records. [2025-10-06T18:19:54.022118] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:19:54.022386] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-06T18:19:54.022434] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-06T18:19:54.022740] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-06T18:19:54.022798] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-06T18:19:54.233878] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-06T18:19:54.454718] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:19:54.843069] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T18:19:54.885127] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T18:19:55.025549] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-06T18:19:55.825554] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-06T18:19:56.625540] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-06T18:19:57.130351] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-06T18:19:57.344995] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-06T18:19:57.348310] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T18:19:57.425560] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-06T18:19:58.225533] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-06T18:19:58.827495] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T18:19:59.025554] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-06T18:19:59.538973] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T18:19:59.825546] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-06T18:20:00.541947] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T18:20:00.625513] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-06T18:20:01.425576] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-06T18:20:01.600035] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T18:20:02.225600] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-06T18:20:02.574844] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-06T18:20:02.886781] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-06T18:20:02.998465] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T18:20:03.025518] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-06T18:20:03.693969] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T18:20:03.825528] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-06T18:20:04.625558] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-06T18:20:05.425520] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-06T18:20:05.507585] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T18:20:06.225517] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-06T18:20:06.321723] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T18:20:06.991769] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T18:20:07.025492] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-06T18:20:07.825572] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-06T18:20:08.179168] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-06T18:20:08.476003] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T18:20:08.625588] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-06T18:20:08.804344] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T18:20:09.425560] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-06T18:20:10.032316] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T18:20:10.225549] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-06T18:20:10.820700] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T18:20:10.974707] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-06T18:20:11.025521] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-06T18:20:11.825562] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-06T18:20:12.335315] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T18:20:12.344354] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T18:20:12.345571] [INFO ] [REMOTE ] CXH: Full fetch complete (5454 records). [2025-10-06T18:20:12.345671] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-06T18:20:12.630783] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-06T18:20:12.725489] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-06T18:20:12.725581] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-06T18:20:12.725805] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-06T18:20:12.725867] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-06T18:20:12.726256] [DEBUG] [LOCAL ] CXH: Trimmed 5454 records to 4449 (keeping 200 days of data) [2025-10-06T18:20:12.752478] [DEBUG] [LOCAL ] CXH: Primary data saved (4449 records). [2025-10-06T18:20:12.752559] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-06T18:20:12.752636] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXH took 29.2s. Estimated remaining: 4h 8m 37s. Rate: 7.2 symbols/min [2025-10-06T18:20:12.921564] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:20:12.955011] [DEBUG] [LOCAL ] CYD: Loaded 26957 existing records from primary storage. [2025-10-06T18:20:12.955393] [INFO ] [MAIN ] CYD: Loaded 26957 existing records. [2025-10-06T18:20:13.134959] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:20:13.135239] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-06T18:20:13.135287] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-06T18:20:13.135578] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-06T18:20:13.135637] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-06T18:20:13.430834] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-06T18:20:13.503113] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:20:14.225506] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-06T18:20:14.333071] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T18:20:15.025542] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-06T18:20:15.200449] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T18:20:15.825556] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-06T18:20:15.982012] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T18:20:16.446571] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T18:20:16.625546] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-06T18:20:17.258088] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T18:20:17.425523] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-06T18:20:17.651459] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-06T18:20:18.225591] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-06T18:20:18.711004] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T18:20:19.025600] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-06T18:20:19.825564] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-06T18:20:20.520060] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-06T18:20:20.625492] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-06T18:20:21.094314] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T18:20:21.166706] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-06T18:20:21.425627] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-06T18:20:22.165088] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T18:20:22.225493] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-06T18:20:22.694536] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T18:20:22.697324] [INFO ] [REMOTE ] CXM: Full fetch complete (68717 records). [2025-10-06T18:20:22.697445] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-06T18:20:23.034938] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-06T18:20:23.095051] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-06T18:20:23.095151] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-06T18:20:23.096029] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-06T18:20:23.096097] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-06T18:20:23.097922] [DEBUG] [LOCAL ] CXM: Trimmed 68717 records to 47544 (keeping 200 days of data) [2025-10-06T18:20:23.367311] [DEBUG] [LOCAL ] CXM: Primary data saved (47544 records). [2025-10-06T18:20:23.367466] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-06T18:20:23.368138] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXM took 38.3s. Estimated remaining: 4h 8m 36s. Rate: 7.2 symbols/min [2025-10-06T18:20:23.550578] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:20:23.603459] [DEBUG] [LOCAL ] CYH: Loaded 48183 existing records from primary storage. [2025-10-06T18:20:23.603912] [INFO ] [MAIN ] CYH: Loaded 48183 existing records. [2025-10-06T18:20:23.786384] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:20:23.786671] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-06T18:20:23.786816] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-06T18:20:23.799553] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-06T18:20:23.801525] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-06T18:20:23.834969] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T18:20:23.833616] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-06T18:20:24.188445] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:20:24.451362] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T18:20:24.625584] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-06T18:20:24.998423] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T18:20:25.433062] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-06T18:20:25.434819] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T18:20:26.225596] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-06T18:20:26.847476] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T18:20:27.025598] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-06T18:20:27.825565] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-06T18:20:28.132820] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T18:20:28.133007] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T18:20:28.145494] [INFO ] [REMOTE ] CXT: Full fetch complete (45508 records). [2025-10-06T18:20:28.145601] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-06T18:20:28.517598] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-06T18:20:28.517715] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-06T18:20:28.518383] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-06T18:20:28.518423] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-06T18:20:28.519485] [DEBUG] [LOCAL ] CXT: Trimmed 45508 records to 30991 (keeping 200 days of data) [2025-10-06T18:20:28.629214] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-06T18:20:28.707094] [DEBUG] [LOCAL ] CXT: Primary data saved (30991 records). [2025-10-06T18:20:28.707258] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-06T18:20:28.707344] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXT took 36.4s. Estimated remaining: 4h 8m 18s. Rate: 7.2 symbols/min [2025-10-06T18:20:28.912061] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:20:28.964837] [DEBUG] [LOCAL ] D: Loaded 54424 existing records from primary storage. [2025-10-06T18:20:28.965367] [INFO ] [MAIN ] D: Loaded 54424 existing records. [2025-10-06T18:20:29.146542] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:20:29.146943] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-06T18:20:29.147023] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-06T18:20:29.147352] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-06T18:20:29.147410] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-06T18:20:29.428430] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-06T18:20:29.566793] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:20:29.569422] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T18:20:29.596796] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T18:20:30.225506] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-06T18:20:31.025510] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-06T18:20:31.170840] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T18:20:31.825572] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-06T18:20:32.105825] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T18:20:32.625501] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-06T18:20:32.867185] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T18:20:32.927160] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T18:20:33.425547] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-06T18:20:34.003964] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T18:20:34.006582] [INFO ] [REMOTE ] CXW: Full fetch complete (64901 records). [2025-10-06T18:20:34.006743] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-06T18:20:34.230675] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-06T18:20:34.415019] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-06T18:20:34.415124] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-06T18:20:34.415951] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-06T18:20:34.416032] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-06T18:20:34.417544] [DEBUG] [LOCAL ] CXW: Trimmed 64901 records to 43955 (keeping 200 days of data) [2025-10-06T18:20:34.672443] [DEBUG] [LOCAL ] CXW: Primary data saved (43955 records). [2025-10-06T18:20:34.672583] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-06T18:20:34.672688] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CXW took 41.1s. Estimated remaining: 4h 8m 2s. Rate: 7.2 symbols/min [2025-10-06T18:20:34.849630] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:20:34.864460] [DEBUG] [LOCAL ] DAC: Loaded 12664 existing records from primary storage. [2025-10-06T18:20:34.864840] [INFO ] [MAIN ] DAC: Loaded 12664 existing records. [2025-10-06T18:20:35.038508] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-06T18:20:35.043853] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:20:35.044910] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-06T18:20:35.045110] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-06T18:20:35.045342] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-06T18:20:35.045400] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-06T18:20:35.253074] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T18:20:35.470306] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:20:35.541168] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-06T18:20:35.825537] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-06T18:20:36.625499] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-06T18:20:36.660586] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T18:20:36.993917] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T18:20:37.425586] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-06T18:20:38.206615] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T18:20:38.225471] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-06T18:20:38.377970] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T18:20:39.025571] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-06T18:20:39.741598] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T18:20:39.825559] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-06T18:20:40.465508] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T18:20:40.625532] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-06T18:20:41.425507] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-06T18:20:41.513731] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T18:20:41.635248] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T18:20:42.225544] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-06T18:20:43.025573] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-06T18:20:43.096321] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T18:20:43.536110] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T18:20:43.538946] [INFO ] [REMOTE ] CYD: Full fetch complete (33660 records). [2025-10-06T18:20:43.539118] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-06T18:20:43.831688] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-06T18:20:43.927005] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-06T18:20:43.927146] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-06T18:20:43.927860] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-06T18:20:43.927951] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-06T18:20:43.941012] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-06T18:20:43.941179] [DEBUG] [LOCAL ] CYD: Trimmed 33660 records to 26399 (keeping 200 days of data) [2025-10-06T18:20:44.102184] [DEBUG] [LOCAL ] CYD: Primary data saved (26399 records). [2025-10-06T18:20:44.102351] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-06T18:20:44.102438] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CYD took 31.3s. Estimated remaining: 4h 7m 58s. Rate: 7.2 symbols/min [2025-10-06T18:20:44.268975] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:20:44.319332] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-10-06T18:20:44.319701] [INFO ] [MAIN ] DAL: Loaded 54533 existing records. [2025-10-06T18:20:44.494744] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:20:44.494974] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-06T18:20:44.495021] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-06T18:20:44.495267] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-06T18:20:44.495325] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-06T18:20:44.639303] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-06T18:20:44.870200] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:20:45.425553] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-06T18:20:45.681310] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T18:20:46.225498] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-06T18:20:46.257525] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T18:20:47.025615] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-06T18:20:47.119791] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T18:20:47.825552] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-06T18:20:48.143452] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T18:20:48.260578] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-06T18:20:48.625571] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-06T18:20:49.425505] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-06T18:20:49.610672] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T18:20:50.225495] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-06T18:20:50.352474] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T18:20:51.025530] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-06T18:20:51.550220] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-06T18:20:51.633553] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T18:20:51.825534] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-06T18:20:52.625574] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-06T18:20:52.867482] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T18:20:53.425489] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-06T18:20:53.571346] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-06T18:20:53.846581] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-06T18:20:54.225531] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-06T18:20:55.025524] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-06T18:20:55.070909] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T18:20:55.825482] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-06T18:20:55.869825] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-06T18:20:56.325163] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-06T18:20:56.625525] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-06T18:20:57.133753] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T18:20:57.136494] [INFO ] [REMOTE ] CYH: Full fetch complete (69876 records). [2025-10-06T18:20:57.136633] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-06T18:20:57.430755] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-06T18:20:57.554906] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-06T18:20:57.555011] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-06T18:20:57.555876] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-06T18:20:57.555942] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-06T18:20:57.558180] [DEBUG] [LOCAL ] CYH: Trimmed 69876 records to 47591 (keeping 200 days of data) [2025-10-06T18:20:57.821338] [DEBUG] [LOCAL ] CYH: Primary data saved (47591 records). [2025-10-06T18:20:57.821500] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-06T18:20:57.822246] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. CYH took 34.5s. Estimated remaining: 4h 8m 6s. Rate: 7.2 symbols/min [2025-10-06T18:20:57.990394] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:20:57.990609] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-10-06T18:20:57.990674] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-10-06T18:20:57.990800] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-06T18:20:57.990840] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-06T18:20:57.990881] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-06T18:20:57.990913] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-06T18:20:58.232144] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-06T18:20:58.360177] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:20:58.604045] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T18:20:59.025602] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-06T18:20:59.242371] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-06T18:20:59.606920] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-06T18:20:59.825540] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-06T18:21:00.625514] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-06T18:21:00.703598] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T18:21:01.425541] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-06T18:21:01.867787] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-06T18:21:02.225604] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-06T18:21:02.942215] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T18:21:03.025480] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-06T18:21:03.085184] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T18:21:03.188703] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-06T18:21:03.825559] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-06T18:21:04.575166] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T18:21:04.625540] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-06T18:21:05.425508] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-06T18:21:05.578343] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-06T18:21:05.581539] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-10-06T18:21:05.581686] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-06T18:21:05.999226] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-06T18:21:05.999313] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-06T18:21:06.000324] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-06T18:21:06.000405] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-06T18:21:06.002090] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 53645 (keeping 200 days of data) [2025-10-06T18:21:06.231620] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-06T18:21:06.248997] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-06T18:21:06.379407] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T18:21:06.401989] [DEBUG] [LOCAL ] D: Primary data saved (53645 records). [2025-10-06T18:21:06.402115] [INFO ] [MAIN ] D: Full history saved. [2025-10-06T18:21:06.402190] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. D took 37.7s. Estimated remaining: 4h 7m 58s. Rate: 7.2 symbols/min [2025-10-06T18:21:06.569767] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:21:06.592445] [DEBUG] [LOCAL ] DAO: Loaded 20992 existing records from primary storage. [2025-10-06T18:21:06.592720] [INFO ] [MAIN ] DAO: Loaded 20992 existing records. [2025-10-06T18:21:06.773802] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:21:06.774091] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-06T18:21:06.774150] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-06T18:21:06.774437] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-06T18:21:06.774493] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-06T18:21:07.030770] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-06T18:21:07.127850] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:21:07.825551] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-06T18:21:08.480043] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T18:21:08.623188] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-06T18:21:08.630784] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-06T18:21:08.655160] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-06T18:21:09.425538] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-06T18:21:09.449709] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T18:21:09.450863] [INFO ] [REMOTE ] DAC: Full fetch complete (19374 records). [2025-10-06T18:21:09.450937] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-06T18:21:09.822071] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-06T18:21:09.822162] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-06T18:21:09.822629] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-06T18:21:09.822715] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-06T18:21:09.823277] [DEBUG] [LOCAL ] DAC: Trimmed 19374 records to 12528 (keeping 200 days of data) [2025-10-06T18:21:09.905956] [DEBUG] [LOCAL ] DAC: Primary data saved (12528 records). [2025-10-06T18:21:09.906140] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-06T18:21:09.906235] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. DAC took 35.2s. Estimated remaining: 4h 7m 35s. Rate: 7.2 symbols/min [2025-10-06T18:21:10.094580] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:21:10.144307] [DEBUG] [LOCAL ] DAR: Loaded 52592 existing records from primary storage. [2025-10-06T18:21:10.144667] [INFO ] [MAIN ] DAR: Loaded 52592 existing records. [2025-10-06T18:21:10.230780] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-06T18:21:10.336317] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:21:10.336573] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-06T18:21:10.336622] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-06T18:21:10.336911] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-06T18:21:10.336970] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-06T18:21:10.720182] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:21:11.025546] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-06T18:21:11.266692] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T18:21:11.825553] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-06T18:21:12.233256] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-10-06T18:21:12.625493] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-06T18:21:12.720072] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T18:21:13.064258] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T18:21:13.425580] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-06T18:21:14.225554] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-06T18:21:14.895530] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-06T18:21:15.025489] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-06T18:21:15.205976] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T18:21:15.278379] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T18:21:15.825536] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-06T18:21:16.625549] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-06T18:21:17.215169] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-06T18:21:17.297358] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T18:21:17.425507] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-06T18:21:17.825285] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T18:21:18.225563] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-06T18:21:19.027565] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-06T18:21:19.030838] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T18:21:19.375349] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T18:21:19.825581] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-06T18:21:20.625506] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-06T18:21:20.760203] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T18:21:20.778001] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T18:21:21.425586] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-06T18:21:22.225535] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-06T18:21:22.979252] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-06T18:21:23.025485] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-06T18:21:23.202441] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T18:21:23.825544] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-06T18:21:23.893446] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T18:21:24.625553] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-06T18:21:24.847809] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-06T18:21:24.850992] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-10-06T18:21:24.851128] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-06T18:21:25.261217] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-06T18:21:25.261386] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-06T18:21:25.262481] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-06T18:21:25.262551] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-06T18:21:25.264164] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-10-06T18:21:25.431020] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-06T18:21:25.437239] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T18:21:25.671138] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-06T18:21:25.671322] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-06T18:21:25.671445] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAL took 41.6s. Estimated remaining: 4h 7m 50s. Rate: 7.2 symbols/min [2025-10-06T18:21:25.846706] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:21:25.887711] [DEBUG] [LOCAL ] DAVA: Loaded 41673 existing records from primary storage. [2025-10-06T18:21:25.888095] [INFO ] [MAIN ] DAVA: Loaded 41673 existing records. [2025-10-06T18:21:26.088591] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:21:26.089234] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-06T18:21:26.089301] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-06T18:21:26.089575] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-06T18:21:26.089636] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-06T18:21:26.227792] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-06T18:21:26.391747] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T18:21:26.498622] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:21:26.531058] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T18:21:27.025602] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-06T18:21:27.825545] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-06T18:21:27.969838] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T18:21:28.625535] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-06T18:21:28.699066] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T18:21:29.425488] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-06T18:21:29.487539] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T18:21:29.798756] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-06T18:21:30.225568] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-06T18:21:31.031618] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-06T18:21:31.038354] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T18:21:31.339333] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T18:21:31.825546] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-06T18:21:32.625863] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-06T18:21:32.628333] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-06T18:21:32.632430] [INFO ] [REMOTE ] DAN: Full fetch complete (70841 records). [2025-10-06T18:21:32.632586] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-06T18:21:33.036238] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-06T18:21:33.036386] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-06T18:21:33.037386] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-06T18:21:33.037589] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-06T18:21:33.039281] [DEBUG] [LOCAL ] DAN: Trimmed 70841 records to 49053 (keeping 200 days of data) [2025-10-06T18:21:33.273105] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T18:21:33.369099] [DEBUG] [LOCAL ] DAN: Primary data saved (49053 records). [2025-10-06T18:21:33.369257] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-06T18:21:33.369334] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAN took 35.5s. Estimated remaining: 4h 7m 39s. Rate: 7.2 symbols/min [2025-10-06T18:21:33.434885] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-06T18:21:33.543767] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:21:33.589532] [DEBUG] [LOCAL ] DAY: Loaded 50058 existing records from primary storage. [2025-10-06T18:21:33.589905] [INFO ] [MAIN ] DAY: Loaded 50058 existing records. [2025-10-06T18:21:33.778691] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:21:33.779205] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-06T18:21:33.779270] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-06T18:21:33.779572] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-06T18:21:33.779632] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-06T18:21:33.930263] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-06T18:21:34.229665] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:21:34.229821] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-06T18:21:34.955882] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T18:21:35.025535] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-06T18:21:35.641619] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T18:21:35.825580] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-06T18:21:35.839500] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T18:21:35.840901] [INFO ] [REMOTE ] DAO: Full fetch complete (32533 records). [2025-10-06T18:21:35.840979] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-06T18:21:35.841587] [FATAL] [VALIDATOR ] DAO: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:21:35.841699] [FATAL] [MAIN ] DAO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:21:35.841769] [WARN ] [MAIN ] DAO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:21:35.841842] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-06T18:21:35.841961] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-06T18:21:35.842018] [INFO ] [LOCAL ] DAO: Starting deletion of derivative data. [2025-10-06T18:21:35.842255] [DEBUG] [LOCAL ] DAO: Deleted derivative data file. [2025-10-06T18:21:35.842368] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAO took 29.4s. Estimated remaining: 4h 7m 13s. Rate: 7.2 symbols/min [2025-10-06T18:21:36.011713] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:21:36.011975] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-10-06T18:21:36.012032] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-10-06T18:21:36.012149] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-06T18:21:36.012191] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-06T18:21:36.012289] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-10-06T18:21:36.012337] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-06T18:21:36.366417] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:21:36.625538] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-06T18:21:37.425492] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-06T18:21:38.225506] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-06T18:21:38.402860] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T18:21:38.569018] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-10-06T18:21:39.025507] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-06T18:21:39.270745] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T18:21:39.795167] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T18:21:39.825499] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-06T18:21:40.386600] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T18:21:40.625596] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-06T18:21:41.149014] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T18:21:41.425620] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-06T18:21:42.225536] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-06T18:21:42.311196] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T18:21:42.988823] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T18:21:43.025549] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-06T18:21:43.208824] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T18:21:43.825561] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-06T18:21:44.625525] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-06T18:21:44.721908] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T18:21:45.275036] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T18:21:45.279421] [INFO ] [REMOTE ] DAR: Full fetch complete (74643 records). [2025-10-06T18:21:45.279631] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-06T18:21:45.430600] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-06T18:21:45.700435] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-06T18:21:45.700524] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-06T18:21:45.701407] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-06T18:21:45.701472] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-06T18:21:45.703034] [DEBUG] [LOCAL ] DAR: Trimmed 74643 records to 51849 (keeping 200 days of data) [2025-10-06T18:21:46.034096] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T18:21:46.064711] [DEBUG] [LOCAL ] DAR: Primary data saved (51849 records). [2025-10-06T18:21:46.064870] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-06T18:21:46.064971] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAR took 36.2s. Estimated remaining: 4h 7m 11s. Rate: 7.2 symbols/min [2025-10-06T18:21:46.248147] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:21:46.241260] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-06T18:21:46.248490] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-06T18:21:46.248757] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-06T18:21:46.249954] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-06T18:21:46.250005] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-06T18:21:46.250063] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-06T18:21:46.250142] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-06T18:21:46.640837] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:21:47.025555] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-06T18:21:47.277944] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-06T18:21:47.677010] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T18:21:47.825542] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-06T18:21:48.420620] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T18:21:48.625590] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-06T18:21:48.722249] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T18:21:49.425550] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-06T18:21:50.203567] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T18:21:50.225487] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-06T18:21:51.025489] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-06T18:21:51.374153] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-06T18:21:51.825542] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-06T18:21:51.893764] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T18:21:51.905806] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T18:21:52.625536] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-06T18:21:53.425556] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-06T18:21:53.617260] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T18:21:53.619031] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T18:21:54.225588] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-06T18:21:55.004346] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T18:21:55.008225] [INFO ] [REMOTE ] DAVA: Full fetch complete (56216 records). [2025-10-06T18:21:55.008371] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-06T18:21:55.032162] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-06T18:21:55.350047] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T18:21:55.419833] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-06T18:21:55.419926] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-06T18:21:55.420709] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-06T18:21:55.420777] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-06T18:21:55.421982] [DEBUG] [LOCAL ] DAVA: Trimmed 56216 records to 41193 (keeping 200 days of data) [2025-10-06T18:21:55.665603] [DEBUG] [LOCAL ] DAVA: Primary data saved (41193 records). [2025-10-06T18:21:55.665807] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-06T18:21:55.665903] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAVA took 30.0s. Estimated remaining: 4h 7m 6s. Rate: 7.2 symbols/min [2025-10-06T18:21:55.830610] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-06T18:21:55.889088] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:21:55.889415] [DEBUG] [LOCAL ] DBI: No existing data file found in primary storage. [2025-10-06T18:21:55.889462] [WARN ] [MAIN ] DBI: No existing data found, performing full refresh instead. [2025-10-06T18:21:55.889607] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-06T18:21:55.889695] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-06T18:21:55.889755] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-10-06T18:21:55.889789] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-06T18:21:56.368435] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:21:56.625491] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-06T18:21:57.018547] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T18:21:57.425512] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-06T18:21:57.518429] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T18:21:58.225558] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-06T18:21:58.544575] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-06T18:21:59.025551] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-06T18:21:59.508850] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-06T18:21:59.533718] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-06T18:21:59.825573] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-06T18:22:00.625516] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-06T18:22:01.065517] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-06T18:22:01.265208] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T18:22:01.425580] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-06T18:22:02.230704] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-06T18:22:02.249831] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T18:22:03.030762] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-06T18:22:03.042835] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T18:22:03.316229] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T18:22:03.825538] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-06T18:22:04.529885] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T18:22:04.625494] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-06T18:22:05.225990] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T18:22:05.228600] [INFO ] [REMOTE ] DAY: Full fetch complete (71513 records). [2025-10-06T18:22:05.228794] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-06T18:22:05.430742] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-06T18:22:05.624983] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-06T18:22:05.625071] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-06T18:22:05.625926] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-06T18:22:05.625990] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-06T18:22:05.627530] [DEBUG] [LOCAL ] DAY: Trimmed 71513 records to 49247 (keeping 200 days of data) [2025-10-06T18:22:05.920981] [DEBUG] [LOCAL ] DAY: Primary data saved (49247 records). [2025-10-06T18:22:05.921138] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-06T18:22:05.921962] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAY took 32.6s. Estimated remaining: 4h 7m 4s. Rate: 7.2 symbols/min [2025-10-06T18:22:06.105597] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:22:06.119237] [DEBUG] [LOCAL ] DBL: Loaded 9400 existing records from primary storage. [2025-10-06T18:22:06.119534] [INFO ] [MAIN ] DBL: Loaded 9400 existing records. [2025-10-06T18:22:06.226844] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-06T18:22:06.336603] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:22:06.337032] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-06T18:22:06.337287] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-06T18:22:06.337778] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-06T18:22:06.347059] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-06T18:22:06.430943] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T18:22:06.733725] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:22:07.025497] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-06T18:22:07.422094] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T18:22:07.482128] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-06T18:22:07.825574] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-06T18:22:08.625545] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-06T18:22:09.064013] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-06T18:22:09.425512] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-06T18:22:09.885342] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-06T18:22:09.912554] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-06T18:22:10.225544] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-06T18:22:10.908617] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T18:22:11.025496] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-06T18:22:11.825483] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-06T18:22:11.894320] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T18:22:12.256126] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-06T18:22:12.625486] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-06T18:22:13.020184] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T18:22:13.425538] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-06T18:22:14.225497] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-06T18:22:14.271362] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T18:22:14.963122] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-06T18:22:15.025542] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-06T18:22:15.216227] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T18:22:15.825518] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-06T18:22:16.233083] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T18:22:16.625537] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-06T18:22:17.265588] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T18:22:17.425491] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-06T18:22:18.225528] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-06T18:22:18.357401] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-06T18:22:18.360802] [INFO ] [REMOTE ] DB: Full fetch complete (74715 records). [2025-10-06T18:22:18.360979] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-06T18:22:18.840539] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-06T18:22:18.840802] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-06T18:22:18.842234] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-06T18:22:18.842314] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-06T18:22:18.844113] [DEBUG] [LOCAL ] DB: Trimmed 74715 records to 52532 (keeping 200 days of data) [2025-10-06T18:22:19.028891] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-06T18:22:19.069516] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T18:22:19.199179] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T18:22:19.226881] [DEBUG] [LOCAL ] DB: Primary data saved (52532 records). [2025-10-06T18:22:19.227045] [INFO ] [MAIN ] DB: Full history saved. [2025-10-06T18:22:19.227157] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DB took 43.4s. Estimated remaining: 4h 7m 10s. Rate: 7.2 symbols/min [2025-10-06T18:22:19.431177] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:22:19.489556] [DEBUG] [LOCAL ] DBRG: Loaded 50472 existing records from primary storage. [2025-10-06T18:22:19.489949] [INFO ] [MAIN ] DBRG: Loaded 50472 existing records. [2025-10-06T18:22:19.694467] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:22:19.694747] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-06T18:22:19.694800] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-06T18:22:19.695294] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-06T18:22:19.695351] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-06T18:22:19.835844] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-06T18:22:19.962464] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T18:22:20.000516] [INFO ] [REMOTE ] DBD: Full fetch complete (30901 records). [2025-10-06T18:22:20.011846] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-06T18:22:20.044603] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:22:20.055727] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:22:20.067368] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:22:20.067522] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-06T18:22:20.076106] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-06T18:22:20.083923] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-06T18:22:20.090195] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-06T18:22:20.090369] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DBD took 34.0s. Estimated remaining: 4h 6m 40s. Rate: 7.2 symbols/min [2025-10-06T18:22:20.090105] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:22:20.302490] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:22:20.341758] [DEBUG] [LOCAL ] DCI: Loaded 37763 existing records from primary storage. [2025-10-06T18:22:20.342083] [INFO ] [MAIN ] DCI: Loaded 37763 existing records. [2025-10-06T18:22:20.570041] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:22:20.570389] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-06T18:22:20.570462] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-06T18:22:20.570792] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-06T18:22:20.570913] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-06T18:22:20.625606] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-06T18:22:20.699709] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-06T18:22:20.966235] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:22:21.425548] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-06T18:22:22.203102] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T18:22:22.225468] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-06T18:22:23.025573] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-06T18:22:23.055093] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T18:22:23.825498] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-06T18:22:23.862830] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T18:22:24.136503] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T18:22:24.625533] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-06T18:22:24.842505] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T18:22:25.425605] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-06T18:22:26.194468] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-06T18:22:26.199309] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T18:22:26.225512] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-06T18:22:27.025598] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-06T18:22:27.830723] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-06T18:22:27.856938] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T18:22:27.881055] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-06T18:22:28.625607] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-06T18:22:29.356547] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T18:22:29.425563] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-06T18:22:29.896690] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T18:22:30.225496] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-06T18:22:30.305526] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T18:22:31.025609] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-06T18:22:31.825541] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-06T18:22:32.086618] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T18:22:32.377797] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T18:22:32.625627] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-06T18:22:33.420104] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T18:22:33.423543] [INFO ] [REMOTE ] DBI: Full fetch complete (65644 records). [2025-10-06T18:22:33.423734] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-06T18:22:33.430671] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-06T18:22:33.879319] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-06T18:22:33.879500] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-06T18:22:33.880440] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-06T18:22:33.880512] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-06T18:22:33.882267] [DEBUG] [LOCAL ] DBI: Trimmed 65644 records to 44435 (keeping 200 days of data) [2025-10-06T18:22:34.228605] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-06T18:22:34.237939] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T18:22:34.292245] [DEBUG] [LOCAL ] DBI: Primary data saved (44435 records). [2025-10-06T18:22:34.292431] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-06T18:22:34.292518] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBI took 38.6s. Estimated remaining: 4h 6m 49s. Rate: 7.2 symbols/min [2025-10-06T18:22:34.461446] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T18:22:34.575768] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:22:34.599316] [DEBUG] [LOCAL ] DCO: Loaded 14009 existing records from primary storage. [2025-10-06T18:22:34.599637] [INFO ] [MAIN ] DCO: Loaded 14009 existing records. [2025-10-06T18:22:34.797886] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:22:34.798159] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-06T18:22:34.798213] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-06T18:22:34.798579] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-06T18:22:34.798706] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-06T18:22:35.030607] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-06T18:22:35.193695] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:22:35.825534] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-06T18:22:35.940724] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T18:22:36.053338] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T18:22:36.625538] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-06T18:22:37.427981] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-06T18:22:37.433066] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T18:22:37.724472] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T18:22:38.225607] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-06T18:22:39.025521] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-06T18:22:39.086700] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T18:22:39.207124] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T18:22:39.659223] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T18:22:39.660223] [INFO ] [REMOTE ] DBL: Full fetch complete (12564 records). [2025-10-06T18:22:39.660294] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-06T18:22:39.834320] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-06T18:22:40.026078] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-06T18:22:40.026161] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-06T18:22:40.026486] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-06T18:22:40.026526] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-06T18:22:40.027206] [DEBUG] [LOCAL ] DBL: Trimmed 12564 records to 9270 (keeping 200 days of data) [2025-10-06T18:22:40.083398] [DEBUG] [LOCAL ] DBL: Primary data saved (9270 records). [2025-10-06T18:22:40.083547] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-06T18:22:40.083633] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBL took 34.2s. Estimated remaining: 4h 6m 33s. Rate: 7.2 symbols/min [2025-10-06T18:22:40.260730] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:22:40.313980] [DEBUG] [LOCAL ] DD: Loaded 53600 existing records from primary storage. [2025-10-06T18:22:40.314333] [INFO ] [MAIN ] DD: Loaded 53600 existing records. [2025-10-06T18:22:40.489696] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:22:40.489971] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-06T18:22:40.490018] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-06T18:22:40.490258] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-06T18:22:40.490323] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-06T18:22:40.630718] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-06T18:22:40.859155] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:22:41.425695] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-06T18:22:41.465029] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T18:22:41.604371] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T18:22:42.225572] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-06T18:22:43.025531] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-06T18:22:43.127073] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-06T18:22:43.236812] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-06T18:22:43.825543] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-06T18:22:44.625510] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-06T18:22:44.877432] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T18:22:45.413110] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T18:22:45.425472] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-06T18:22:46.225547] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-06T18:22:46.504799] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T18:22:46.860844] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T18:22:47.025531] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-06T18:22:47.825515] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-06T18:22:48.095895] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-06T18:22:48.471560] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T18:22:48.625576] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-06T18:22:49.413942] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T18:22:49.417024] [INFO ] [REMOTE ] DBRG: Full fetch complete (72357 records). [2025-10-06T18:22:49.417183] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-06T18:22:49.431300] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-06T18:22:49.598405] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-06T18:22:49.862303] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-06T18:22:49.862440] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-06T18:22:49.863342] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-06T18:22:49.863406] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-06T18:22:49.865101] [DEBUG] [LOCAL ] DBRG: Trimmed 72357 records to 49774 (keeping 200 days of data) [2025-10-06T18:22:50.171615] [DEBUG] [LOCAL ] DBRG: Primary data saved (49774 records). [2025-10-06T18:22:50.171787] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-06T18:22:50.171876] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DBRG took 30.9s. Estimated remaining: 4h 6m 30s. Rate: 7.2 symbols/min [2025-10-06T18:22:50.231154] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-06T18:22:50.361398] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:22:50.412753] [DEBUG] [LOCAL ] DDD: Loaded 51654 existing records from primary storage. [2025-10-06T18:22:50.413087] [INFO ] [MAIN ] DDD: Loaded 51654 existing records. [2025-10-06T18:22:50.598988] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:22:50.599264] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-06T18:22:50.599312] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-06T18:22:50.599554] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-06T18:22:50.599612] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-06T18:22:50.979693] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:22:51.025468] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-06T18:22:51.109613] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T18:22:51.323881] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T18:22:51.825568] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-06T18:22:52.625532] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-06T18:22:53.425700] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-06T18:23:04.996484] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (11.57 seconds). [2025-10-06T18:23:05.001529] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-06T18:23:06.611970] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (14.79 seconds). [2025-10-06T18:23:06.620358] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-06T18:23:06.669310] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T18:23:06.673920] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-06T18:23:06.703981] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (14.08 seconds). [2025-10-06T18:23:06.714877] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-06T18:23:07.546216] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (16.52 seconds). [2025-10-06T18:23:07.556600] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-06T18:23:07.741906] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T18:23:07.745813] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-06T18:23:08.901379] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-06T18:23:08.903252] [INFO ] [REMOTE ] DCI: Full fetch complete (53531 records). [2025-10-06T18:23:08.903442] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-06T18:23:08.904234] [FATAL] [VALIDATOR ] DCI: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:23:08.904338] [FATAL] [MAIN ] DCI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:23:08.904405] [WARN ] [MAIN ] DCI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:23:08.904478] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-06T18:23:08.904547] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-06T18:23:08.904583] [INFO ] [LOCAL ] DCI: Starting deletion of derivative data. [2025-10-06T18:23:08.904879] [DEBUG] [LOCAL ] DCI: Deleted derivative data file. [2025-10-06T18:23:08.904987] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DCI took 48.8s. Estimated remaining: 4h 6m 52s. Rate: 7.2 symbols/min [2025-10-06T18:23:09.113223] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T18:23:09.120674] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-06T18:23:09.618492] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-06T18:23:09.628817] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-06T18:23:09.879742] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (3.16 seconds). [2025-10-06T18:23:09.891298] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-06T18:23:09.901671] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T18:23:09.902911] [INFO ] [REMOTE ] DCO: Full fetch complete (19061 records). [2025-10-06T18:23:09.902987] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-06T18:23:10.265922] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-06T18:23:10.266011] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-06T18:23:10.266442] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-06T18:23:10.266498] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-06T18:23:10.267340] [DEBUG] [LOCAL ] DCO: Trimmed 19061 records to 13883 (keeping 200 days of data) [2025-10-06T18:23:10.346970] [DEBUG] [LOCAL ] DCO: Primary data saved (13883 records). [2025-10-06T18:23:10.347119] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-06T18:23:10.347240] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 36.1s. Estimated remaining: 4h 6m 24s. Rate: 7.2 symbols/min [2025-10-06T18:23:11.428421] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T18:23:11.438344] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-06T18:23:11.533480] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T18:23:11.545212] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-06T18:23:13.198702] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T18:23:13.212137] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-06T18:23:13.343478] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-06T18:23:13.354680] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-06T18:23:14.966001] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T18:23:14.976893] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-06T18:23:15.075971] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T18:23:15.090021] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-06T18:23:16.681503] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T18:23:16.693445] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-06T18:23:16.884869] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-06T18:23:16.895856] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-06T18:23:18.572482] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T18:23:18.584805] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-06T18:23:18.675011] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-06T18:23:18.685671] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-06T18:23:20.109975] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T18:23:20.113138] [INFO ] [REMOTE ] DD: Full fetch complete (76355 records). [2025-10-06T18:23:20.113263] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-06T18:23:20.550964] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-06T18:23:20.551124] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-06T18:23:20.552183] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-06T18:23:20.562027] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-06T18:23:20.581114] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T18:23:20.591511] [DEBUG] [LOCAL ] DD: Trimmed 76355 records to 52847 (keeping 200 days of data) [2025-10-06T18:23:20.592965] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-06T18:23:20.912202] [DEBUG] [LOCAL ] DD: Primary data saved (52847 records). [2025-10-06T18:23:20.912355] [INFO ] [MAIN ] DD: Full history saved. [2025-10-06T18:23:20.913117] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 40.8s. Estimated remaining: 4h 6m 22s. Rate: 7.2 symbols/min [2025-10-06T18:23:22.485522] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T18:23:22.497255] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-06T18:23:24.286592] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T18:23:24.299018] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-06T18:23:25.798481] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T18:23:25.802053] [INFO ] [REMOTE ] DDD: Full fetch complete (73698 records). [2025-10-06T18:23:25.802220] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-06T18:23:26.219122] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-06T18:23:26.219292] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-06T18:23:26.220843] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-06T18:23:26.220915] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-06T18:23:26.223525] [DEBUG] [LOCAL ] DDD: Trimmed 73698 records to 50902 (keeping 200 days of data) [2025-10-06T18:23:26.553265] [DEBUG] [LOCAL ] DDD: Primary data saved (50902 records). [2025-10-06T18:23:26.553482] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-06T18:23:26.553606] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 36.4s. Estimated remaining: 4h 6m 6s. Rate: 7.2 symbols/min [2025-10-06T18:23:27.484862] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:23:27.584085] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:23:27.584611] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-10-06T18:23:27.602548] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:23:27.596174] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-10-06T18:23:27.617300] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:23:27.618064] [DEBUG] [LOCAL ] DDL: No existing data file found in primary storage. [2025-10-06T18:23:27.618527] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-06T18:23:27.623699] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-10-06T18:23:27.624199] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-06T18:23:27.624288] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-06T18:23:27.624394] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-06T18:23:27.624502] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-06T18:23:27.624669] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-06T18:23:27.624732] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-06T18:23:27.624843] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-06T18:23:27.684933] [DEBUG] [LOCAL ] DDS: Loaded 13150 existing records from primary storage. [2025-10-06T18:23:27.737830] [INFO ] [MAIN ] DDS: Loaded 13150 existing records. [2025-10-06T18:23:28.496634] [DEBUG] [LOCAL ] DE: Loaded 48234 existing records from primary storage. [2025-10-06T18:23:28.561342] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:23:28.602844] [INFO ] [MAIN ] DE: Loaded 48234 existing records. [2025-10-06T18:23:28.641236] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-06T18:23:28.744512] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-06T18:23:28.762087] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:23:28.823169] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-06T18:23:28.793718] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-06T18:23:28.823039] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:23:28.851171] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-06T18:23:28.851335] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-06T18:23:29.159257] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:23:29.183079] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-06T18:23:29.183688] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-06T18:23:29.201888] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-06T18:23:29.237833] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-06T18:23:29.361061] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-06T18:23:29.487718] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-06T18:23:29.539028] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:23:29.545489] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-06T18:23:29.869044] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:23:29.869528] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-06T18:23:30.118400] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T18:23:30.119820] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-06T18:23:30.375061] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T18:23:30.388407] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-06T18:23:30.549108] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-06T18:23:30.554481] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-06T18:23:30.556395] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-06T18:23:30.560271] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-06T18:23:31.017028] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-06T18:23:31.018436] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-06T18:23:31.467541] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T18:23:31.477713] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-06T18:23:31.513897] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T18:23:31.517302] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-06T18:23:31.588020] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-06T18:23:31.590893] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-06T18:23:31.681192] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-06T18:23:31.689090] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-06T18:23:32.050346] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-06T18:23:32.051457] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-06T18:23:32.429840] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-06T18:23:32.431025] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-06T18:23:32.504356] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T18:23:32.508200] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-06T18:23:32.662822] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T18:23:32.670427] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-06T18:23:32.912287] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T18:23:32.922457] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-06T18:23:32.949591] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-06T18:23:32.951334] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-06T18:23:33.357086] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T18:23:33.361264] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-06T18:23:33.395027] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-06T18:23:33.396260] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-06T18:23:33.929769] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-06T18:23:33.931048] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-06T18:23:34.263267] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T18:23:34.267293] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-06T18:23:34.315625] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T18:23:34.324294] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-06T18:23:34.387258] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T18:23:34.397010] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-06T18:23:34.451459] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T18:23:34.452224] [INFO ] [REMOTE ] DDT: Full fetch complete (2870 records). [2025-10-06T18:23:34.452333] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-06T18:23:34.806208] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-06T18:23:34.806291] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-06T18:23:34.806408] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-06T18:23:34.806446] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-06T18:23:34.806841] [DEBUG] [LOCAL ] DDT: Trimmed 2870 records to 2087 (keeping 200 days of data) [2025-10-06T18:23:34.819498] [DEBUG] [LOCAL ] DDT: Primary data saved (2087 records). [2025-10-06T18:23:34.819560] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-06T18:23:34.819621] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 8.2s. Estimated remaining: 4h 5m 57s. Rate: 7.2 symbols/min [2025-10-06T18:23:34.988562] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:23:35.034752] [DEBUG] [LOCAL ] DEA: Loaded 41408 existing records from primary storage. [2025-10-06T18:23:35.035166] [INFO ] [MAIN ] DEA: Loaded 41408 existing records. [2025-10-06T18:23:35.214970] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:23:35.215376] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-06T18:23:35.215479] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-06T18:23:35.215863] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-06T18:23:35.215925] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-06T18:23:35.336811] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T18:23:35.342006] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-06T18:23:35.617710] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:23:35.618067] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-06T18:23:35.887746] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T18:23:35.898001] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-06T18:23:36.143546] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T18:23:36.146785] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-06T18:23:36.361061] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-06T18:23:36.371790] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-06T18:23:37.066909] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-06T18:23:37.070935] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-06T18:23:37.104033] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T18:23:37.289671] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T18:23:37.425534] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-06T18:23:37.708934] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T18:23:37.839932] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T18:23:38.225591] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-06T18:23:38.444184] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T18:23:39.025539] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-06T18:23:39.825498] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-06T18:23:39.968148] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T18:23:39.999721] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T18:23:40.625607] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-06T18:23:41.418437] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T18:23:41.427523] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-06T18:23:41.852740] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T18:23:42.225549] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-06T18:23:42.966736] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T18:23:43.025514] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-06T18:23:43.513024] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-06T18:23:43.784725] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T18:23:43.785870] [INFO ] [REMOTE ] DDS: Full fetch complete (18950 records). [2025-10-06T18:23:43.785942] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-06T18:23:43.830758] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-06T18:23:44.186237] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-06T18:23:44.186401] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-06T18:23:44.187080] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-06T18:23:44.187183] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-06T18:23:44.188311] [DEBUG] [LOCAL ] DDS: Trimmed 18950 records to 12900 (keeping 200 days of data) [2025-10-06T18:23:44.277310] [DEBUG] [LOCAL ] DDS: Primary data saved (12900 records). [2025-10-06T18:23:44.277513] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-06T18:23:44.277614] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 17.7s. Estimated remaining: 4h 5m 52s. Rate: 7.2 symbols/min [2025-10-06T18:23:44.462887] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:23:44.505349] [DEBUG] [LOCAL ] DEC: Loaded 31087 existing records from primary storage. [2025-10-06T18:23:44.505848] [INFO ] [MAIN ] DEC: Loaded 31087 existing records. [2025-10-06T18:23:44.625593] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-06T18:23:44.728357] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:23:44.728952] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-06T18:23:44.729023] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-06T18:23:44.729425] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-06T18:23:44.729486] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-06T18:23:45.135734] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:23:45.426586] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-06T18:23:45.428618] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T18:23:46.225490] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-06T18:23:46.698284] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T18:23:47.025497] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-06T18:23:47.133736] [DEBUG] [REMOTE ] DEC: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-06T18:23:47.134005] [WARN ] [REMOTE ] DEC: No data returned for month 2025-01 [2025-10-06T18:23:47.134092] [FATAL] [REMOTE ] DEC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:23:47.134175] [FATAL] [MAIN ] DEC: Failed to fetch primary data. [2025-10-06T18:23:47.134236] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:23:47.134308] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-06T18:23:47.134410] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-06T18:23:47.134453] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-10-06T18:23:47.134746] [DEBUG] [LOCAL ] DEC: Deleted derivative data file. [2025-10-06T18:23:47.134856] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DEC took 2.9s. Estimated remaining: 4h 5m 28s. Rate: 7.2 symbols/min [2025-10-06T18:23:47.304384] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:23:47.391319] [DEBUG] [LOCAL ] DECK: Loaded 54072 existing records from primary storage. [2025-10-06T18:23:47.393704] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-06T18:23:47.393866] [INFO ] [MAIN ] DECK: Loaded 54072 existing records. [2025-10-06T18:23:47.581704] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:23:47.581999] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-06T18:23:47.582048] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-06T18:23:47.583334] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-06T18:23:47.583394] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-06T18:23:47.830617] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-06T18:23:47.938700] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:23:48.492976] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-06T18:23:48.625505] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-06T18:23:49.425501] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-06T18:23:49.509510] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T18:23:49.844070] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-06T18:23:50.225554] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-06T18:23:51.025562] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-06T18:23:51.127339] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T18:23:51.615600] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-06T18:23:51.618259] [INFO ] [REMOTE ] DDL: Full fetch complete (53192 records). [2025-10-06T18:23:51.618365] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-06T18:23:51.834030] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-06T18:23:52.017809] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-06T18:23:52.017915] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-06T18:23:52.018680] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-06T18:23:52.018744] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-06T18:23:52.019954] [DEBUG] [LOCAL ] DDL: Trimmed 53192 records to 36671 (keeping 200 days of data) [2025-10-06T18:23:52.228898] [DEBUG] [LOCAL ] DDL: Primary data saved (36671 records). [2025-10-06T18:23:52.229114] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-06T18:23:52.229219] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DDL took 25.7s. Estimated remaining: 4h 5m 10s. Rate: 7.2 symbols/min [2025-10-06T18:23:52.421751] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:23:52.457309] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T18:23:52.498061] [DEBUG] [LOCAL ] DEI: Loaded 49012 existing records from primary storage. [2025-10-06T18:23:52.498406] [INFO ] [MAIN ] DEI: Loaded 49012 existing records. [2025-10-06T18:23:52.637255] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-06T18:23:52.680703] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:23:52.681058] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-06T18:23:52.681131] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-06T18:23:52.681559] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-06T18:23:52.681617] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-06T18:23:53.041055] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:23:53.425513] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-06T18:23:53.717702] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T18:23:54.225539] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-06T18:23:54.588621] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-06T18:23:54.974275] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T18:23:55.025540] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-06T18:23:55.825584] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-06T18:23:55.983984] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T18:23:56.625507] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-06T18:23:56.899252] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-06T18:23:57.045438] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T18:23:57.425553] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-06T18:23:58.145785] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T18:23:58.225548] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-06T18:23:59.025551] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-06T18:23:59.456762] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-06T18:23:59.825563] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-06T18:23:59.935281] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T18:23:59.938254] [INFO ] [REMOTE ] DE: Full fetch complete (69540 records). [2025-10-06T18:23:59.938424] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-06T18:24:00.338778] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-06T18:24:00.338910] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-06T18:24:00.339857] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-06T18:24:00.339939] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-06T18:24:00.341481] [DEBUG] [LOCAL ] DE: Trimmed 69540 records to 47559 (keeping 200 days of data) [2025-10-06T18:24:00.642465] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-06T18:24:00.702796] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T18:24:00.716118] [DEBUG] [LOCAL ] DE: Primary data saved (47559 records). [2025-10-06T18:24:00.716433] [INFO ] [MAIN ] DE: Full history saved. [2025-10-06T18:24:00.716600] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DE took 34.1s. Estimated remaining: 4h 5m 2s. Rate: 7.2 symbols/min [2025-10-06T18:24:00.884469] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:24:00.938832] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-10-06T18:24:00.939222] [INFO ] [MAIN ] DELL: Loaded 54515 existing records. [2025-10-06T18:24:01.114465] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:24:01.114716] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-06T18:24:01.114773] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-06T18:24:01.115056] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-06T18:24:01.115112] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-06T18:24:01.437207] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-06T18:24:01.480244] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:24:01.886574] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-06T18:24:01.947204] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T18:24:02.225562] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-06T18:24:02.761063] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T18:24:02.763132] [INFO ] [REMOTE ] DEA: Full fetch complete (62042 records). [2025-10-06T18:24:02.763216] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-06T18:24:02.763915] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:24:02.764007] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:24:02.764049] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:24:02.764087] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-06T18:24:02.764148] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-06T18:24:02.764181] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-06T18:24:02.764356] [DEBUG] [LOCAL ] DEA: Deleted derivative data file. [2025-10-06T18:24:02.765256] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEA took 27.9s. Estimated remaining: 4h 4m 35s. Rate: 7.2 symbols/min [2025-10-06T18:24:02.949341] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:24:03.004328] [DEBUG] [LOCAL ] DEO: Loaded 49783 existing records from primary storage. [2025-10-06T18:24:03.004776] [INFO ] [MAIN ] DEO: Loaded 49783 existing records. [2025-10-06T18:24:03.034907] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-06T18:24:03.209748] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:24:03.209994] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-06T18:24:03.210045] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-06T18:24:03.210539] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-06T18:24:03.210598] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-06T18:24:03.582406] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:24:03.825525] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-06T18:24:04.582804] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T18:24:04.625549] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-06T18:24:04.719974] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-06T18:24:05.425548] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-06T18:24:05.496609] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T18:24:05.972253] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-06T18:24:06.225631] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-06T18:24:07.025604] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-06T18:24:07.816617] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-06T18:24:07.827018] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-06T18:24:08.178105] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T18:24:08.625565] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-06T18:24:08.752471] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T18:24:09.425498] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-06T18:24:09.749373] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T18:24:10.225576] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-06T18:24:10.740360] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-06T18:24:11.025574] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-06T18:24:11.227378] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T18:24:11.825544] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-06T18:24:12.611628] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-06T18:24:12.625468] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-06T18:24:13.239019] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-06T18:24:13.408286] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T18:24:13.425467] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-06T18:24:14.225517] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-06T18:24:14.368098] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T18:24:15.025523] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-06T18:24:15.536676] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-06T18:24:15.825533] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-06T18:24:15.909377] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T18:24:16.625495] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-06T18:24:17.191548] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-06T18:24:17.428773] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-06T18:24:17.435136] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T18:24:18.170844] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T18:24:18.225593] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-06T18:24:19.025584] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-06T18:24:19.792963] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T18:24:19.825583] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-06T18:24:20.018962] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-06T18:24:20.629609] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-06T18:24:20.633979] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T18:24:21.431088] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-06T18:24:21.463910] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T18:24:22.225518] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-06T18:24:22.343132] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T18:24:23.025566] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-06T18:24:23.802128] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-06T18:24:23.825474] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-06T18:24:24.207325] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-06T18:24:24.625497] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-06T18:24:25.018109] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-06T18:24:25.425588] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-06T18:24:26.150370] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-06T18:24:26.225488] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-06T18:24:26.512249] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T18:24:27.025579] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-06T18:24:27.159980] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-06T18:24:27.162986] [INFO ] [REMOTE ] DECK: Full fetch complete (76734 records). [2025-10-06T18:24:27.163096] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-06T18:24:27.558135] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-06T18:24:27.558227] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-06T18:24:27.559273] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-06T18:24:27.559345] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-06T18:24:27.560921] [DEBUG] [LOCAL ] DECK: Trimmed 76734 records to 53291 (keeping 200 days of data) [2025-10-06T18:24:27.843241] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-06T18:24:27.914954] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T18:24:27.937577] [DEBUG] [LOCAL ] DECK: Primary data saved (53291 records). [2025-10-06T18:24:27.937756] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-06T18:24:27.937864] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DECK took 40.8s. Estimated remaining: 4h 5m 16s. Rate: 7.2 symbols/min [2025-10-06T18:24:28.106337] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:24:28.138555] [DEBUG] [LOCAL ] DFH: Loaded 32660 existing records from primary storage. [2025-10-06T18:24:28.138916] [INFO ] [MAIN ] DFH: Loaded 32660 existing records. [2025-10-06T18:24:28.338447] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:24:28.339151] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-06T18:24:28.339228] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-06T18:24:28.339714] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-06T18:24:28.339784] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-06T18:24:28.637738] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-06T18:24:28.781110] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:24:28.846824] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T18:24:29.425604] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-06T18:24:29.948722] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-06T18:24:30.225505] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-06T18:24:30.384636] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T18:24:31.013477] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T18:24:31.025468] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-06T18:24:31.642995] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T18:24:31.645421] [INFO ] [REMOTE ] DEO: Full fetch complete (71135 records). [2025-10-06T18:24:31.645540] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-06T18:24:31.646321] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:24:31.646409] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:24:31.646453] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:24:31.646518] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-06T18:24:31.646584] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-06T18:24:31.646619] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-06T18:24:31.647034] [DEBUG] [LOCAL ] DEO: Deleted derivative data file. [2025-10-06T18:24:31.647589] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DEO took 28.9s. Estimated remaining: 4h 4m 54s. Rate: 7.2 symbols/min [2025-10-06T18:24:31.820125] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:24:31.825512] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-06T18:24:31.846442] [DEBUG] [LOCAL ] DFIN: Loaded 23342 existing records from primary storage. [2025-10-06T18:24:31.846733] [INFO ] [MAIN ] DFIN: Loaded 23342 existing records. [2025-10-06T18:24:32.024349] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:24:32.024565] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-06T18:24:32.024614] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-06T18:24:32.024929] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-06T18:24:32.024987] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-06T18:24:32.385064] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:24:32.404571] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T18:24:32.625541] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-06T18:24:33.235229] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T18:24:33.237974] [INFO ] [REMOTE ] DEI: Full fetch complete (69731 records). [2025-10-06T18:24:33.238102] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-06T18:24:33.433732] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-06T18:24:33.639313] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-06T18:24:33.639430] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-06T18:24:33.640346] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-06T18:24:33.640420] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-06T18:24:33.641909] [DEBUG] [LOCAL ] DEI: Trimmed 69731 records to 48286 (keeping 200 days of data) [2025-10-06T18:24:33.765623] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T18:24:33.968847] [DEBUG] [LOCAL ] DEI: Primary data saved (48286 records). [2025-10-06T18:24:33.969001] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-06T18:24:33.969086] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DEI took 41.7s. Estimated remaining: 4h 4m 28s. Rate: 7.2 symbols/min [2025-10-06T18:24:34.164879] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:24:34.178327] [DEBUG] [LOCAL ] DFP: Loaded 11537 existing records from primary storage. [2025-10-06T18:24:34.178604] [INFO ] [MAIN ] DFP: Loaded 11537 existing records. [2025-10-06T18:24:34.232735] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-06T18:24:34.360432] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:24:34.360625] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-06T18:24:34.360705] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-06T18:24:34.360931] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-06T18:24:34.360989] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-06T18:24:34.723464] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:24:35.025541] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-06T18:24:35.621212] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T18:24:35.830593] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-06T18:24:35.851186] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-06T18:24:35.935020] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-06T18:24:36.625526] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-06T18:24:37.183440] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-06T18:24:37.425514] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-06T18:24:38.198954] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T18:24:38.225489] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-06T18:24:38.709733] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-06T18:24:38.713264] [INFO ] [REMOTE ] DELL: Full fetch complete (77430 records). [2025-10-06T18:24:38.713427] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-06T18:24:38.714465] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:24:38.714568] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:24:38.714617] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:24:38.714691] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-06T18:24:38.714784] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-06T18:24:38.714839] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-10-06T18:24:38.715249] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-10-06T18:24:38.720938] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DELL took 38.0s. Estimated remaining: 4h 4m 10s. Rate: 7.2 symbols/min [2025-10-06T18:24:38.911557] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:24:38.969744] [DEBUG] [LOCAL ] DG: Loaded 54057 existing records from primary storage. [2025-10-06T18:24:38.970103] [INFO ] [MAIN ] DG: Loaded 54057 existing records. [2025-10-06T18:24:39.030725] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-06T18:24:39.090276] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T18:24:39.189722] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:24:39.189953] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-06T18:24:39.190002] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-06T18:24:39.191565] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-06T18:24:39.191627] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-06T18:24:39.571902] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:24:39.825532] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-06T18:24:40.540694] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T18:24:40.625529] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-06T18:24:41.425519] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-06T18:24:41.916055] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-06T18:24:42.062319] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T18:24:42.077731] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-06T18:24:42.225546] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-06T18:24:43.025601] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-06T18:24:43.588703] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T18:24:43.825557] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-06T18:24:44.625494] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-06T18:24:44.739533] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T18:24:44.937207] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T18:24:45.416235] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-06T18:24:45.425453] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-06T18:24:46.225493] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-06T18:24:46.447062] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T18:24:47.025565] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-06T18:24:47.757953] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T18:24:47.825475] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-06T18:24:48.068964] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T18:24:48.625580] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-06T18:24:49.425511] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-06T18:24:49.840925] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-06T18:24:49.966281] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T18:24:50.191793] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T18:24:50.225575] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-06T18:24:51.025575] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-06T18:24:51.605399] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T18:24:51.827976] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-06T18:24:51.830628] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T18:24:52.625543] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-06T18:24:52.932615] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T18:24:53.425548] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-06T18:24:53.443630] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T18:24:54.225543] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-06T18:24:55.025542] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-06T18:24:55.607481] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-06T18:24:55.641545] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T18:24:55.825536] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-06T18:24:55.974452] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-06T18:24:56.625607] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-06T18:24:57.043695] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T18:24:57.425492] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-06T18:24:57.492444] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T18:24:57.493484] [INFO ] [REMOTE ] DFP: Full fetch complete (16070 records). [2025-10-06T18:24:57.493557] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-06T18:24:57.862958] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-06T18:24:57.863044] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-06T18:24:57.863425] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-06T18:24:57.863464] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-06T18:24:57.864039] [DEBUG] [LOCAL ] DFP: Trimmed 16070 records to 11297 (keeping 200 days of data) [2025-10-06T18:24:57.938231] [DEBUG] [LOCAL ] DFP: Primary data saved (11297 records). [2025-10-06T18:24:57.938737] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-06T18:24:57.938903] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFP took 24.0s. Estimated remaining: 4h 4m 33s. Rate: 7.2 symbols/min [2025-10-06T18:24:58.109187] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:24:58.157850] [DEBUG] [LOCAL ] DGX: Loaded 45574 existing records from primary storage. [2025-10-06T18:24:58.158212] [INFO ] [MAIN ] DGX: Loaded 45574 existing records. [2025-10-06T18:24:58.232099] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-06T18:24:58.341859] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:24:58.342165] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-06T18:24:58.342212] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-06T18:24:58.343578] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-06T18:24:58.343638] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-06T18:24:58.719232] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:24:59.000810] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-06T18:24:59.025557] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-06T18:24:59.534330] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-06T18:24:59.825566] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-06T18:25:00.258579] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T18:25:00.260927] [INFO ] [REMOTE ] DFH: Full fetch complete (48416 records). [2025-10-06T18:25:00.261045] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-06T18:25:00.633256] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-06T18:25:00.696576] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-06T18:25:00.696834] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-06T18:25:00.698284] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-06T18:25:00.698367] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-06T18:25:00.700148] [DEBUG] [LOCAL ] DFH: Trimmed 48416 records to 32142 (keeping 200 days of data) [2025-10-06T18:25:00.919828] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T18:25:00.938730] [DEBUG] [LOCAL ] DFH: Primary data saved (32142 records). [2025-10-06T18:25:00.938980] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-06T18:25:00.939109] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFH took 33.0s. Estimated remaining: 4h 4m 9s. Rate: 7.2 symbols/min [2025-10-06T18:25:01.118213] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:25:01.142440] [DEBUG] [LOCAL ] DHF: Loaded 21451 existing records from primary storage. [2025-10-06T18:25:01.142871] [INFO ] [MAIN ] DHF: Loaded 21451 existing records. [2025-10-06T18:25:01.337353] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:25:01.337729] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-06T18:25:01.337805] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-06T18:25:01.338731] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-06T18:25:01.338794] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-06T18:25:01.430829] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-06T18:25:01.779603] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:25:02.225604] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-06T18:25:02.899921] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-06T18:25:03.025481] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-06T18:25:03.396929] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T18:25:03.559849] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-06T18:25:03.825514] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-06T18:25:04.630797] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-06T18:25:04.653680] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T18:25:04.878209] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T18:25:05.425535] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-06T18:25:06.225600] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-06T18:25:06.479284] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-06T18:25:06.571123] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-06T18:25:07.025566] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-06T18:25:07.825540] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-06T18:25:08.213517] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T18:25:08.630819] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-06T18:25:08.658438] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T18:25:08.842617] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T18:25:09.425571] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-06T18:25:10.225530] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-06T18:25:10.512013] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T18:25:10.541943] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T18:25:11.025501] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-06T18:25:11.357583] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T18:25:11.825543] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-06T18:25:12.127501] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-06T18:25:12.625619] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-06T18:25:12.795557] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T18:25:12.797302] [INFO ] [REMOTE ] DFIN: Full fetch complete (33642 records). [2025-10-06T18:25:12.797416] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-06T18:25:13.183606] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-06T18:25:13.183718] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-06T18:25:13.184275] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-06T18:25:13.184328] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-06T18:25:13.185095] [DEBUG] [LOCAL ] DFIN: Trimmed 33642 records to 22914 (keeping 200 days of data) [2025-10-06T18:25:13.321813] [DEBUG] [LOCAL ] DFIN: Primary data saved (22914 records). [2025-10-06T18:25:13.321958] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-06T18:25:13.322056] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFIN took 41.7s. Estimated remaining: 4h 4m 12s. Rate: 7.2 symbols/min [2025-10-06T18:25:13.430726] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-06T18:25:13.494400] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:25:13.494610] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-10-06T18:25:13.494689] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-10-06T18:25:13.494812] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-06T18:25:13.494853] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-06T18:25:13.494892] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-06T18:25:13.494923] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-06T18:25:13.859817] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:25:14.225563] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-06T18:25:14.584064] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T18:25:15.025515] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-06T18:25:15.329544] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T18:25:15.825493] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-06T18:25:16.266967] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-06T18:25:16.625497] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-06T18:25:16.735069] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T18:25:16.738196] [INFO ] [REMOTE ] DG: Full fetch complete (77210 records). [2025-10-06T18:25:16.738339] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-06T18:25:17.157629] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-06T18:25:17.157809] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-06T18:25:17.158859] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-06T18:25:17.158989] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-06T18:25:17.160840] [DEBUG] [LOCAL ] DG: Trimmed 77210 records to 53279 (keeping 200 days of data) [2025-10-06T18:25:17.426358] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-06T18:25:17.545844] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T18:25:17.574707] [DEBUG] [LOCAL ] DG: Primary data saved (53279 records). [2025-10-06T18:25:17.574888] [INFO ] [MAIN ] DG: Full history saved. [2025-10-06T18:25:17.574982] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DG took 38.9s. Estimated remaining: 4h 3m 52s. Rate: 7.2 symbols/min [2025-10-06T18:25:17.746683] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:25:17.747190] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-10-06T18:25:17.747374] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-10-06T18:25:17.747503] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-06T18:25:17.747546] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-06T18:25:17.747590] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-06T18:25:17.747621] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-06T18:25:17.865481] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T18:25:18.151759] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:25:18.225511] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-06T18:25:19.025561] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-06T18:25:19.344353] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T18:25:19.825505] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-06T18:25:20.040900] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T18:25:20.063995] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T18:25:20.625536] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-06T18:25:21.425492] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-06T18:25:21.527335] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T18:25:21.717098] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T18:25:22.225538] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-06T18:25:23.023568] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T18:25:23.033321] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-06T18:25:23.825536] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-06T18:25:24.235173] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-06T18:25:24.634393] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-06T18:25:24.637670] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T18:25:25.003535] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-06T18:25:25.425599] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-06T18:25:26.225591] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-06T18:25:26.434355] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T18:25:27.039999] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-06T18:25:27.046698] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-06T18:25:27.825494] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-06T18:25:27.938907] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T18:25:28.117455] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T18:25:28.120382] [INFO ] [REMOTE ] DHF: Full fetch complete (30123 records). [2025-10-06T18:25:28.120560] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-06T18:25:28.503523] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-06T18:25:28.503622] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-06T18:25:28.504192] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-06T18:25:28.504247] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-06T18:25:28.505211] [DEBUG] [LOCAL ] DHF: Trimmed 30123 records to 21258 (keeping 200 days of data) [2025-10-06T18:25:28.625919] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-06T18:25:28.646320] [DEBUG] [LOCAL ] DHF: Primary data saved (21258 records). [2025-10-06T18:25:28.646468] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-06T18:25:28.646587] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DHF took 27.7s. Estimated remaining: 4h 3m 52s. Rate: 7.2 symbols/min [2025-10-06T18:25:28.869240] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:25:28.942395] [DEBUG] [LOCAL ] DHT: Loaded 48575 existing records from primary storage. [2025-10-06T18:25:28.942992] [INFO ] [MAIN ] DHT: Loaded 48575 existing records. [2025-10-06T18:25:29.247623] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:25:29.247988] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-06T18:25:29.248060] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-06T18:25:29.248367] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-06T18:25:29.248444] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-06T18:25:29.430396] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-06T18:25:29.774764] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:25:30.047706] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-06T18:25:30.225727] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-06T18:25:30.512503] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-06T18:25:31.025714] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-06T18:25:31.319604] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T18:25:31.825546] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-06T18:25:32.176474] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-06T18:25:32.625498] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-06T18:25:32.884928] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T18:25:33.397297] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T18:25:33.425481] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-06T18:25:34.225543] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-06T18:25:34.375225] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T18:25:35.025608] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-06T18:25:35.150795] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T18:25:35.598378] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T18:25:35.825485] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-06T18:25:36.216504] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T18:25:36.625534] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-06T18:25:37.425513] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-06T18:25:37.933851] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-06T18:25:38.079354] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T18:25:38.082033] [INFO ] [REMOTE ] DGX: Full fetch complete (65181 records). [2025-10-06T18:25:38.082137] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-06T18:25:38.230923] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-06T18:25:38.473491] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-06T18:25:38.473571] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-06T18:25:38.474372] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-06T18:25:38.474434] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-06T18:25:38.475678] [DEBUG] [LOCAL ] DGX: Trimmed 65181 records to 44815 (keeping 200 days of data) [2025-10-06T18:25:38.737829] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T18:25:38.810151] [DEBUG] [LOCAL ] DGX: Primary data saved (44815 records). [2025-10-06T18:25:38.810313] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-06T18:25:38.810409] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DGX took 40.9s. Estimated remaining: 4h 3m 49s. Rate: 7.2 symbols/min [2025-10-06T18:25:38.979219] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:25:38.993134] [DEBUG] [LOCAL ] DHX: Loaded 13198 existing records from primary storage. [2025-10-06T18:25:38.993364] [INFO ] [MAIN ] DHX: Loaded 13198 existing records. [2025-10-06T18:25:39.035908] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-06T18:25:39.172848] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:25:39.173045] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-06T18:25:39.173102] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-06T18:25:39.173569] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-06T18:25:39.173628] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-06T18:25:39.548602] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:25:39.825500] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-06T18:25:40.269411] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-06T18:25:40.625487] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-06T18:25:40.759101] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T18:25:41.116010] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-06T18:25:41.425553] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-06T18:25:42.225506] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-06T18:25:42.439589] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T18:25:42.724493] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-06T18:25:43.025496] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-06T18:25:43.184578] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T18:25:43.825540] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-06T18:25:44.625501] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-06T18:25:44.931849] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T18:25:45.116576] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-06T18:25:45.425562] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-06T18:25:46.225525] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-06T18:25:46.351912] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T18:25:46.781494] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-06T18:25:47.025560] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-06T18:25:47.825579] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-06T18:25:48.195909] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-06T18:25:48.625619] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-06T18:25:49.123515] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-06T18:25:49.425588] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-06T18:25:49.463458] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T18:25:49.466612] [INFO ] [REMOTE ] DHI: Full fetch complete (77199 records). [2025-10-06T18:25:49.466810] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-06T18:25:49.834702] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T18:25:49.887577] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-06T18:25:49.887684] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-06T18:25:49.888631] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-06T18:25:49.888742] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-06T18:25:49.890304] [DEBUG] [LOCAL ] DHI: Trimmed 77199 records to 53341 (keeping 200 days of data) [2025-10-06T18:25:50.231716] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-06T18:25:50.235662] [DEBUG] [LOCAL ] DHI: Primary data saved (53341 records). [2025-10-06T18:25:50.235841] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-06T18:25:50.235994] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHI took 36.9s. Estimated remaining: 4h 3m 49s. Rate: 7.2 symbols/min [2025-10-06T18:25:50.411265] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:25:50.426013] [DEBUG] [LOCAL ] DIAX: Loaded 13148 existing records from primary storage. [2025-10-06T18:25:50.426235] [INFO ] [MAIN ] DIAX: Loaded 13148 existing records. [2025-10-06T18:25:50.599905] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:25:50.600125] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-06T18:25:50.600196] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-06T18:25:50.600855] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-06T18:25:50.600933] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-06T18:25:50.950659] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:25:51.025487] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-06T18:25:51.454356] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-06T18:25:51.613359] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T18:25:51.825699] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-06T18:25:51.998510] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T18:25:52.625541] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-06T18:25:52.935982] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T18:25:53.425546] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-06T18:25:54.230768] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-06T18:25:54.243969] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T18:25:54.263041] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T18:25:54.964757] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T18:25:54.967840] [INFO ] [REMOTE ] DHR: Full fetch complete (77277 records). [2025-10-06T18:25:54.967947] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-06T18:25:55.030909] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-06T18:25:55.366240] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-06T18:25:55.366338] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-06T18:25:55.367870] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-06T18:25:55.367935] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-06T18:25:55.371355] [DEBUG] [LOCAL ] DHR: Trimmed 77277 records to 53376 (keeping 200 days of data) [2025-10-06T18:25:55.725897] [DEBUG] [LOCAL ] DHR: Primary data saved (53376 records). [2025-10-06T18:25:55.726063] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-06T18:25:55.726143] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHR took 38.2s. Estimated remaining: 4h 3m 33s. Rate: 7.2 symbols/min [2025-10-06T18:25:55.826568] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-06T18:25:55.844147] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-06T18:25:55.920786] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:25:55.958434] [DEBUG] [LOCAL ] DIN: Loaded 37756 existing records from primary storage. [2025-10-06T18:25:55.958816] [INFO ] [MAIN ] DIN: Loaded 37756 existing records. [2025-10-06T18:25:56.137154] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:25:56.137441] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-06T18:25:56.137503] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-06T18:25:56.138542] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-06T18:25:56.138603] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-06T18:25:56.495020] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:25:56.625565] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-06T18:25:56.648551] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-06T18:25:57.425622] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-06T18:25:57.592111] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T18:25:58.201710] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T18:25:58.225472] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-06T18:25:59.025560] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-06T18:25:59.079478] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T18:25:59.825494] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-06T18:25:59.976102] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-06T18:26:00.570593] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T18:26:00.625603] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-06T18:26:01.378466] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T18:26:01.425503] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-06T18:26:02.225589] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-06T18:26:03.025539] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-06T18:26:03.065719] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T18:26:03.754064] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T18:26:03.755461] [INFO ] [REMOTE ] DHX: Full fetch complete (20617 records). [2025-10-06T18:26:03.755538] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-06T18:26:03.827517] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-06T18:26:04.177031] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-06T18:26:04.215982] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-06T18:26:04.216074] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-06T18:26:04.216606] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-06T18:26:04.216685] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-06T18:26:04.217495] [DEBUG] [LOCAL ] DHX: Trimmed 20617 records to 12976 (keeping 200 days of data) [2025-10-06T18:26:04.299895] [DEBUG] [LOCAL ] DHX: Primary data saved (12976 records). [2025-10-06T18:26:04.300071] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-06T18:26:04.300162] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHX took 25.5s. Estimated remaining: 4h 3m 25s. Rate: 7.2 symbols/min [2025-10-06T18:26:04.478438] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:26:04.532176] [DEBUG] [LOCAL ] DINO: Loaded 53696 existing records from primary storage. [2025-10-06T18:26:04.532527] [INFO ] [MAIN ] DINO: Loaded 53696 existing records. [2025-10-06T18:26:04.634077] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-06T18:26:04.717782] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:26:04.718023] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-06T18:26:04.718070] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-06T18:26:04.718319] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-06T18:26:04.718374] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-06T18:26:05.093132] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:26:05.344903] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T18:26:05.425545] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-06T18:26:06.225507] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-06T18:26:06.331957] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T18:26:06.765359] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T18:26:07.025579] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-06T18:26:07.150363] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T18:26:07.825537] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-06T18:26:08.625512] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-06T18:26:08.722314] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T18:26:08.746081] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-06T18:26:09.425595] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-06T18:26:10.223299] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T18:26:10.227742] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-06T18:26:10.325141] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T18:26:11.025531] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-06T18:26:11.674692] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T18:26:11.825488] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-06T18:26:11.969515] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T18:26:12.625569] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-06T18:26:13.421852] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T18:26:13.429892] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-06T18:26:13.459508] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T18:26:13.461304] [INFO ] [REMOTE ] DIAX: Full fetch complete (17902 records). [2025-10-06T18:26:13.461384] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-06T18:26:13.883126] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-06T18:26:13.883214] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-06T18:26:13.883670] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-06T18:26:13.883733] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-06T18:26:13.884295] [DEBUG] [LOCAL ] DIAX: Trimmed 17902 records to 13131 (keeping 200 days of data) [2025-10-06T18:26:13.966582] [DEBUG] [LOCAL ] DIAX: Primary data saved (13131 records). [2025-10-06T18:26:13.966775] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-06T18:26:13.966904] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DIAX took 23.7s. Estimated remaining: 4h 3m 21s. Rate: 7.2 symbols/min [2025-10-06T18:26:14.143302] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:26:14.200258] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-10-06T18:26:14.200631] [INFO ] [MAIN ] DIS: Loaded 54568 existing records. [2025-10-06T18:26:14.232184] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-06T18:26:14.387259] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:26:14.387476] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-06T18:26:14.387524] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-06T18:26:14.389059] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-06T18:26:14.389121] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-06T18:26:14.748139] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:26:15.025506] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-06T18:26:15.363020] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-06T18:26:15.809034] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T18:26:15.825471] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-06T18:26:16.625613] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-06T18:26:17.425561] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-06T18:26:17.574751] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T18:26:17.622438] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-10-06T18:26:18.189108] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T18:26:18.192162] [INFO ] [REMOTE ] DHT: Full fetch complete (69961 records). [2025-10-06T18:26:18.192295] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-06T18:26:18.235756] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-06T18:26:18.586490] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-06T18:26:18.586684] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-06T18:26:18.587586] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-06T18:26:18.587676] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-06T18:26:18.589099] [DEBUG] [LOCAL ] DHT: Trimmed 69961 records to 47877 (keeping 200 days of data) [2025-10-06T18:26:18.906560] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T18:26:18.923064] [DEBUG] [LOCAL ] DHT: Primary data saved (47877 records). [2025-10-06T18:26:18.923345] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-06T18:26:18.923505] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DHT took 50.3s. Estimated remaining: 4h 3m 3s. Rate: 7.2 symbols/min [2025-10-06T18:26:19.031332] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-06T18:26:19.121428] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:26:19.121725] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-06T18:26:19.121787] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-06T18:26:19.121924] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-06T18:26:19.121968] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-06T18:26:19.122011] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-06T18:26:19.122045] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-06T18:26:19.521940] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:26:19.825568] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-06T18:26:20.429185] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T18:26:20.450730] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-06T18:26:20.625534] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-06T18:26:20.909723] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-06T18:26:21.425601] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-06T18:26:21.765878] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T18:26:22.225560] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-06T18:26:22.656880] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-06T18:26:23.025570] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-06T18:26:23.210956] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-06T18:26:23.825540] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-06T18:26:24.625599] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-06T18:26:25.302090] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-06T18:26:25.425490] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-06T18:26:25.451235] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T18:26:26.225562] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-06T18:26:26.531590] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-06T18:26:27.025533] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-06T18:26:27.351018] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T18:26:27.478494] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-06T18:26:27.825545] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-06T18:26:28.625562] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-06T18:26:28.794891] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-06T18:26:28.969523] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-06T18:26:29.425542] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-06T18:26:30.225498] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-06T18:26:30.387116] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-06T18:26:30.818669] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-06T18:26:30.966123] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T18:26:30.968819] [INFO ] [REMOTE ] DIN: Full fetch complete (55257 records). [2025-10-06T18:26:30.968927] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-06T18:26:31.032952] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-06T18:26:31.393735] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-06T18:26:31.393846] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-06T18:26:31.394574] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-06T18:26:31.394617] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-06T18:26:31.395923] [DEBUG] [LOCAL ] DIN: Trimmed 55257 records to 37218 (keeping 200 days of data) [2025-10-06T18:26:31.510306] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-06T18:26:31.653634] [DEBUG] [LOCAL ] DIN: Primary data saved (37218 records). [2025-10-06T18:26:31.653835] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-06T18:26:31.653926] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIN took 35.9s. Estimated remaining: 4h 3m 7s. Rate: 7.2 symbols/min [2025-10-06T18:26:31.851205] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:26:31.846615] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-06T18:26:31.911094] [DEBUG] [LOCAL ] DK: Loaded 50047 existing records from primary storage. [2025-10-06T18:26:31.911785] [INFO ] [MAIN ] DK: Loaded 50047 existing records. [2025-10-06T18:26:32.125172] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:26:32.125474] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-06T18:26:32.125563] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-06T18:26:32.127105] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-06T18:26:32.127168] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-06T18:26:32.505497] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:26:32.625538] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-06T18:26:33.425557] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-06T18:26:33.673147] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-06T18:26:33.794831] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-06T18:26:34.225549] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-06T18:26:35.025576] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-06T18:26:35.148509] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-06T18:26:35.825543] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-06T18:26:36.158331] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-06T18:26:36.625553] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-06T18:26:36.851959] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T18:26:36.867493] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-06T18:26:37.425546] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-06T18:26:37.749059] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-06T18:26:38.094030] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-06T18:26:38.225508] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-06T18:26:38.549586] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-06T18:26:39.025555] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-06T18:26:39.395090] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-06T18:26:39.825527] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-06T18:26:40.625583] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-06T18:26:41.425549] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-06T18:26:41.642393] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T18:26:41.942660] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T18:26:41.943713] [INFO ] [REMOTE ] DIVY: Full fetch complete (1732 records). [2025-10-06T18:26:41.943884] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-06T18:26:42.161623] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T18:26:42.179196] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:26:42.192797] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:26:42.192984] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-06T18:26:42.193927] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-06T18:26:42.194002] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-06T18:26:42.194068] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-06T18:26:42.195524] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DIVY took 23.3s. Estimated remaining: 4h 3m 5s. Rate: 7.2 symbols/min [2025-10-06T18:26:42.195294] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T18:26:42.226482] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-06T18:26:42.391182] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:26:42.414609] [DEBUG] [LOCAL ] DKL: Loaded 18799 existing records from primary storage. [2025-10-06T18:26:42.415006] [INFO ] [MAIN ] DKL: Loaded 18799 existing records. [2025-10-06T18:26:42.601599] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:26:42.601949] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-06T18:26:42.602026] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-06T18:26:42.603202] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-06T18:26:42.603266] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-06T18:26:42.977384] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:26:43.025580] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-06T18:26:43.825584] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-06T18:26:44.621669] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-06T18:26:44.635155] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T18:26:44.635285] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-06T18:26:45.425557] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-06T18:26:45.521558] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T18:26:46.194725] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T18:26:46.197764] [INFO ] [REMOTE ] DINO: Full fetch complete (76290 records). [2025-10-06T18:26:46.197877] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-06T18:26:46.198638] [FATAL] [VALIDATOR ] DINO: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:26:46.198765] [FATAL] [MAIN ] DINO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:26:46.198808] [WARN ] [MAIN ] DINO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:26:46.198845] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-06T18:26:46.198907] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-06T18:26:46.198941] [INFO ] [LOCAL ] DINO: Starting deletion of derivative data. [2025-10-06T18:26:46.199260] [DEBUG] [LOCAL ] DINO: Deleted derivative data file. [2025-10-06T18:26:46.199359] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DINO took 41.9s. Estimated remaining: 4h 2m 44s. Rate: 7.2 symbols/min [2025-10-06T18:26:46.232267] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-06T18:26:46.381604] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:26:46.432264] [DEBUG] [LOCAL ] DKS: Loaded 50431 existing records from primary storage. [2025-10-06T18:26:46.432676] [INFO ] [MAIN ] DKS: Loaded 50431 existing records. [2025-10-06T18:26:46.618568] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:26:46.618776] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-06T18:26:46.618823] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-06T18:26:46.620229] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-06T18:26:46.620288] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-06T18:26:46.982573] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:26:47.025496] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-06T18:26:47.261672] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T18:26:47.694199] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-06T18:26:47.825522] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-06T18:26:48.625500] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-06T18:26:48.889987] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T18:26:49.425535] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-06T18:26:49.583066] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-06T18:26:49.850941] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-06T18:26:50.225546] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-06T18:26:51.025508] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-06T18:26:51.081678] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T18:26:51.825503] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-06T18:26:52.139036] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T18:26:52.398637] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-06T18:26:52.401745] [INFO ] [REMOTE ] DIS: Full fetch complete (77945 records). [2025-10-06T18:26:52.401875] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-06T18:26:52.630628] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-06T18:26:52.803761] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-06T18:26:52.803876] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-06T18:26:52.804826] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-06T18:26:52.804890] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-06T18:26:52.806515] [DEBUG] [LOCAL ] DIS: Trimmed 77945 records to 53788 (keeping 200 days of data) [2025-10-06T18:26:53.158109] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-06T18:26:53.158438] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-06T18:26:53.159578] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DIS took 39.2s. Estimated remaining: 4h 2m 32s. Rate: 7.2 symbols/min [2025-10-06T18:26:53.344605] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:26:53.374772] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T18:26:53.413450] [DEBUG] [LOCAL ] DLB: Loaded 32449 existing records from primary storage. [2025-10-06T18:26:53.413767] [INFO ] [MAIN ] DLB: Loaded 32449 existing records. [2025-10-06T18:26:53.435379] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-06T18:26:53.603660] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:26:53.603926] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-06T18:26:53.604056] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-06T18:26:53.604382] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-06T18:26:53.604472] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-06T18:26:53.816862] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-06T18:26:53.998896] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:26:54.225551] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-06T18:26:55.025537] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-06T18:26:55.599293] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-06T18:26:55.656391] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T18:26:55.825525] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-06T18:26:56.625546] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-06T18:26:56.907484] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T18:26:57.391756] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T18:26:57.425466] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-06T18:26:58.209562] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T18:26:58.225479] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-06T18:26:58.496070] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T18:26:59.025581] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-06T18:26:59.825557] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-06T18:27:00.328019] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-06T18:27:00.625550] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-06T18:27:00.696464] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T18:27:01.361335] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T18:27:01.425585] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-06T18:27:02.225602] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-06T18:27:02.360005] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T18:27:03.025598] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-06T18:27:03.262117] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T18:27:03.411072] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T18:27:03.825526] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-06T18:27:04.625511] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-06T18:27:04.814752] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T18:27:04.867794] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T18:27:05.425528] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-06T18:27:06.080062] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T18:27:06.225575] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-06T18:27:07.025541] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-06T18:27:07.185875] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T18:27:07.627427] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T18:27:07.825507] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-06T18:27:08.007787] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T18:27:08.625521] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-06T18:27:08.700612] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T18:27:09.425553] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-06T18:27:10.225548] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-06T18:27:10.410011] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-06T18:27:10.579274] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-06T18:27:11.025544] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-06T18:27:11.485051] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T18:27:11.825515] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-06T18:27:12.383697] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T18:27:12.386108] [INFO ] [REMOTE ] DKS: Full fetch complete (71263 records). [2025-10-06T18:27:12.386259] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-06T18:27:12.387258] [FATAL] [VALIDATOR ] DKS: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:27:12.387383] [FATAL] [MAIN ] DKS: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:27:12.387427] [WARN ] [MAIN ] DKS: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:27:12.387507] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-06T18:27:12.387598] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-10-06T18:27:12.387698] [INFO ] [LOCAL ] DKS: Starting deletion of derivative data. [2025-10-06T18:27:12.387990] [DEBUG] [LOCAL ] DKS: Deleted derivative data file. [2025-10-06T18:27:12.388100] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DKS took 26.2s. Estimated remaining: 4h 2m 54s. Rate: 7.2 symbols/min [2025-10-06T18:27:12.569828] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:27:12.578250] [DEBUG] [LOCAL ] DLNG: Loaded 6166 existing records from primary storage. [2025-10-06T18:27:12.578492] [INFO ] [MAIN ] DLNG: Loaded 6166 existing records. [2025-10-06T18:27:12.633359] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-06T18:27:12.767902] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:27:12.768253] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-06T18:27:12.768328] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-06T18:27:12.768725] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-06T18:27:12.768788] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-06T18:27:13.136067] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:27:13.154878] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T18:27:13.425493] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-06T18:27:13.736750] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T18:27:13.964787] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-06T18:27:14.225536] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-06T18:27:15.025638] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-06T18:27:15.545631] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T18:27:15.825554] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-06T18:27:16.004484] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T18:27:16.625530] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-06T18:27:17.099196] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T18:27:17.101754] [INFO ] [REMOTE ] DLB: Full fetch complete (46721 records). [2025-10-06T18:27:17.101853] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-06T18:27:17.102481] [FATAL] [VALIDATOR ] DLB: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:27:17.102565] [FATAL] [MAIN ] DLB: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:27:17.102606] [WARN ] [MAIN ] DLB: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:27:17.102668] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-06T18:27:17.102751] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-06T18:27:17.102787] [INFO ] [LOCAL ] DLB: Starting deletion of derivative data. [2025-10-06T18:27:17.102942] [DEBUG] [LOCAL ] DLB: Deleted derivative data file. [2025-10-06T18:27:17.103043] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DLB took 23.9s. Estimated remaining: 4h 2m 36s. Rate: 7.2 symbols/min [2025-10-06T18:27:17.279156] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:27:17.332394] [DEBUG] [LOCAL ] DLR: Loaded 51668 existing records from primary storage. [2025-10-06T18:27:17.332811] [INFO ] [MAIN ] DLR: Loaded 51668 existing records. [2025-10-06T18:27:17.432848] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-06T18:27:17.523751] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:27:17.524000] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-06T18:27:17.524046] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-06T18:27:17.525755] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-06T18:27:17.525817] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-06T18:27:17.890957] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:27:18.225509] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-06T18:27:18.320239] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-06T18:27:18.321478] [INFO ] [REMOTE ] DKL: Full fetch complete (28377 records). [2025-10-06T18:27:18.321590] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-06T18:27:18.637927] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-06T18:27:18.735027] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-06T18:27:18.735113] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-06T18:27:18.735813] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-06T18:27:18.735892] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-06T18:27:18.736727] [DEBUG] [LOCAL ] DKL: Trimmed 28377 records to 18266 (keeping 200 days of data) [2025-10-06T18:27:18.848780] [DEBUG] [LOCAL ] DKL: Primary data saved (18266 records). [2025-10-06T18:27:18.848936] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-06T18:27:18.849021] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DKL took 36.7s. Estimated remaining: 4h 2m 9s. Rate: 7.2 symbols/min [2025-10-06T18:27:19.032807] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:27:19.033834] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-06T18:27:19.029709] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-06T18:27:19.070382] [DEBUG] [LOCAL ] DLX: Loaded 28911 existing records from primary storage. [2025-10-06T18:27:19.070687] [INFO ] [MAIN ] DLX: Loaded 28911 existing records. [2025-10-06T18:27:19.294362] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:27:19.294627] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-06T18:27:19.294713] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-06T18:27:19.295625] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-06T18:27:19.295725] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-06T18:27:19.705866] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:27:19.825479] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-06T18:27:20.503382] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-06T18:27:20.625503] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-06T18:27:20.914469] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T18:27:21.380090] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T18:27:21.425484] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-06T18:27:22.225546] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-06T18:27:23.025562] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-06T18:27:23.239716] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-06T18:27:23.830704] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-06T18:27:23.861831] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T18:27:24.206817] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T18:27:24.625546] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-06T18:27:25.425497] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-06T18:27:25.687965] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-06T18:27:26.225496] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-06T18:27:26.328153] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T18:27:26.375256] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T18:27:27.025526] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-06T18:27:27.825534] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-06T18:27:28.004475] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T18:27:28.061769] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-06T18:27:28.625545] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-06T18:27:29.425540] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-06T18:27:29.465803] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-06T18:27:29.467775] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T18:27:30.225549] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-06T18:27:31.025500] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-06T18:27:31.498249] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-06T18:27:31.768724] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T18:27:31.772010] [INFO ] [REMOTE ] DK: Full fetch complete (70866 records). [2025-10-06T18:27:31.772188] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-06T18:27:31.831144] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-06T18:27:32.186275] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-06T18:27:32.186375] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-06T18:27:32.187266] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-06T18:27:32.187331] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-06T18:27:32.188989] [DEBUG] [LOCAL ] DK: Trimmed 70866 records to 49324 (keeping 200 days of data) [2025-10-06T18:27:32.330539] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T18:27:32.532797] [DEBUG] [LOCAL ] DK: Primary data saved (49324 records). [2025-10-06T18:27:32.532977] [INFO ] [MAIN ] DK: Full history saved. [2025-10-06T18:27:32.533077] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DK took 1m 1s. Estimated remaining: 4h 2m 15s. Rate: 7.2 symbols/min [2025-10-06T18:27:32.630706] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-06T18:27:32.715311] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:27:32.738111] [DEBUG] [LOCAL ] DLY: Loaded 20380 existing records from primary storage. [2025-10-06T18:27:32.738537] [INFO ] [MAIN ] DLY: Loaded 20380 existing records. [2025-10-06T18:27:32.935012] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:27:32.935276] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-06T18:27:32.935327] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-06T18:27:32.936105] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-06T18:27:32.936176] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-06T18:27:33.260806] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-06T18:27:33.349306] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:27:33.425472] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-06T18:27:33.579159] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T18:27:34.225557] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-06T18:27:34.795031] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T18:27:35.025553] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-06T18:27:35.596733] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T18:27:35.825529] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-06T18:27:35.959189] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-06T18:27:36.625533] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-06T18:27:37.425545] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-06T18:27:37.561571] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T18:27:37.768576] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-06T18:27:37.795130] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-06T18:27:38.225561] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-06T18:27:39.025534] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-06T18:27:39.825510] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-06T18:27:39.938424] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-06T18:27:40.037732] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-06T18:27:40.625570] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-06T18:27:40.874951] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T18:27:41.425548] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-06T18:27:42.152520] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T18:27:42.225482] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-06T18:27:42.561636] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T18:27:43.025492] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-06T18:27:43.476249] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T18:27:43.825540] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-06T18:27:44.610572] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T18:27:44.631357] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-06T18:27:44.637966] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T18:27:45.425543] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-06T18:27:46.047435] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T18:27:46.225505] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-06T18:27:46.393234] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T18:27:46.867086] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T18:27:47.025568] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-06T18:27:47.825516] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-06T18:27:48.391925] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T18:27:48.392813] [INFO ] [REMOTE ] DLNG: Full fetch complete (11881 records). [2025-10-06T18:27:48.392887] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-06T18:27:48.627166] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-06T18:27:48.700206] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-06T18:27:48.751918] [INFO ] [REMOTE ] DLR: Full fetch complete (74089 records). [2025-10-06T18:27:48.786533] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-06T18:27:48.796041] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-06T18:27:48.796171] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-06T18:27:48.796498] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-06T18:27:48.828489] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-06T18:27:48.899347] [DEBUG] [LOCAL ] DLNG: Trimmed 11881 records to 6088 (keeping 200 days of data) [2025-10-06T18:27:49.015808] [DEBUG] [LOCAL ] DLNG: Primary data saved (6088 records). [2025-10-06T18:27:49.040372] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-06T18:27:49.101496] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLNG took 36.7s. Estimated remaining: 4h 2m 30s. Rate: 7.2 symbols/min [2025-10-06T18:27:49.415884] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-06T18:27:49.435274] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:27:49.431331] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-06T18:27:49.436848] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-06T18:27:49.435768] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-06T18:27:49.437000] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-06T18:27:49.442892] [DEBUG] [LOCAL ] DLR: Trimmed 74089 records to 50908 (keeping 200 days of data) [2025-10-06T18:27:49.447558] [DEBUG] [LOCAL ] DMA: Loaded 4595 existing records from primary storage. [2025-10-06T18:27:49.515739] [INFO ] [MAIN ] DMA: Loaded 4595 existing records. [2025-10-06T18:27:49.748439] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:27:49.756553] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-06T18:27:49.760735] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-06T18:27:49.761073] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-06T18:27:49.761454] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-06T18:27:49.803243] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-06T18:27:50.226040] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-06T18:27:50.316580] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:27:50.416930] [DEBUG] [LOCAL ] DLR: Primary data saved (50908 records). [2025-10-06T18:27:50.417113] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-06T18:27:50.417802] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLR took 33.3s. Estimated remaining: 4h 2m 2s. Rate: 7.2 symbols/min [2025-10-06T18:27:50.619991] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:27:50.616263] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-06T18:27:50.638281] [DEBUG] [LOCAL ] DMB: Loaded 10319 existing records from primary storage. [2025-10-06T18:27:50.638541] [INFO ] [MAIN ] DMB: Loaded 10319 existing records. [2025-10-06T18:27:50.835242] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:27:50.835513] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-06T18:27:50.835565] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-06T18:27:50.836235] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-06T18:27:50.836295] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-06T18:27:51.027707] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-06T18:27:51.218094] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:27:51.246765] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T18:27:51.764396] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T18:27:51.825477] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-06T18:27:52.625526] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-06T18:27:52.941075] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T18:27:53.425511] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-06T18:27:53.523238] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T18:27:53.978078] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-06T18:27:54.225531] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-06T18:27:55.025600] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-06T18:27:55.404687] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T18:27:55.407375] [INFO ] [REMOTE ] DLY: Full fetch complete (28486 records). [2025-10-06T18:27:55.407575] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-06T18:27:55.712901] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-06T18:27:55.832790] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-06T18:27:55.871887] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-06T18:27:55.871989] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-06T18:27:55.872595] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-06T18:27:55.872683] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-06T18:27:55.873521] [DEBUG] [LOCAL ] DLY: Trimmed 28486 records to 20190 (keeping 200 days of data) [2025-10-06T18:27:56.000751] [DEBUG] [LOCAL ] DLY: Primary data saved (20190 records). [2025-10-06T18:27:56.000898] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-06T18:27:56.000983] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DLY took 23.5s. Estimated remaining: 4h 1m 46s. Rate: 7.2 symbols/min [2025-10-06T18:27:56.168686] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:27:56.180552] [DEBUG] [LOCAL ] DMO: Loaded 10026 existing records from primary storage. [2025-10-06T18:27:56.180885] [INFO ] [MAIN ] DMO: Loaded 10026 existing records. [2025-10-06T18:27:56.358832] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:27:56.359097] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-06T18:27:56.360045] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-06T18:27:56.360484] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-06T18:27:56.360547] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-06T18:27:56.632499] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-06T18:27:56.714776] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:27:56.833361] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-06T18:27:57.425533] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-06T18:27:57.786712] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-06T18:27:58.225570] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-06T18:27:58.240629] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T18:27:58.931196] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-06T18:27:59.025584] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-06T18:27:59.817720] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T18:27:59.825469] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-06T18:28:00.625589] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-06T18:28:00.635756] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-06T18:28:01.242665] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T18:28:01.425546] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-06T18:28:02.225483] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-06T18:28:02.621138] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T18:28:02.911696] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-06T18:28:03.025531] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-06T18:28:03.548698] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-06T18:28:03.825516] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-06T18:28:04.612875] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-06T18:28:04.625479] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-06T18:28:05.425557] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-06T18:28:05.449213] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T18:28:06.225505] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-06T18:28:06.352851] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T18:28:06.818516] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-06T18:28:07.025594] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-06T18:28:07.820690] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T18:28:07.825628] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-06T18:28:08.625602] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-06T18:28:08.667640] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T18:28:09.354063] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-06T18:28:09.425499] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-06T18:28:10.181993] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-06T18:28:10.225574] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-06T18:28:11.025624] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-06T18:28:11.322781] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T18:28:11.324988] [INFO ] [REMOTE ] DLX: Full fetch complete (41450 records). [2025-10-06T18:28:11.325096] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-06T18:28:11.725994] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-06T18:28:11.726093] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-06T18:28:11.726987] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-06T18:28:11.727055] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-06T18:28:11.728249] [DEBUG] [LOCAL ] DLX: Trimmed 41450 records to 28542 (keeping 200 days of data) [2025-10-06T18:28:11.831092] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-06T18:28:11.833179] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T18:28:11.922806] [DEBUG] [LOCAL ] DLX: Primary data saved (28542 records). [2025-10-06T18:28:11.922990] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-06T18:28:11.923112] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DLX took 53.1s. Estimated remaining: 4h 1m 58s. Rate: 7.2 symbols/min [2025-10-06T18:28:12.109494] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:28:12.157088] [DEBUG] [LOCAL ] DNA: Loaded 49019 existing records from primary storage. [2025-10-06T18:28:12.157469] [INFO ] [MAIN ] DNA: Loaded 49019 existing records. [2025-10-06T18:28:12.337742] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:28:12.337975] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-06T18:28:12.338023] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-06T18:28:12.339258] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-06T18:28:12.339318] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-06T18:28:12.630710] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-06T18:28:12.654843] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-06T18:28:12.729309] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:28:13.235558] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T18:28:13.425548] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-06T18:28:14.176153] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-06T18:28:14.225569] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-06T18:28:14.791466] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-06T18:28:15.025533] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-06T18:28:15.825543] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-06T18:28:16.625533] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-06T18:28:16.800201] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-06T18:28:17.130619] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-06T18:28:17.157684] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-06T18:28:17.425572] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-06T18:28:18.225560] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-06T18:28:18.846175] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-06T18:28:19.025563] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-06T18:28:19.187459] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T18:28:19.620884] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T18:28:19.825528] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-06T18:28:20.625598] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-06T18:28:20.688044] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-06T18:28:21.392771] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T18:28:21.394139] [INFO ] [REMOTE ] DMO: Full fetch complete (14383 records). [2025-10-06T18:28:21.394220] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-06T18:28:21.394759] [FATAL] [VALIDATOR ] DMO: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:28:21.394853] [FATAL] [MAIN ] DMO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:28:21.394904] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:28:21.394981] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-06T18:28:21.395059] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-06T18:28:21.395158] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-10-06T18:28:21.395502] [DEBUG] [LOCAL ] DMO: Deleted derivative data file. [2025-10-06T18:28:21.395625] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DMO took 25.4s. Estimated remaining: 4h 1m 53s. Rate: 7.2 symbols/min [2025-10-06T18:28:21.435433] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-06T18:28:21.590917] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:28:21.633101] [DEBUG] [LOCAL ] DNOW: Loaded 44313 existing records from primary storage. [2025-10-06T18:28:21.633414] [INFO ] [MAIN ] DNOW: Loaded 44313 existing records. [2025-10-06T18:28:21.811711] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:28:21.811967] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-06T18:28:21.812015] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-06T18:28:21.813233] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-06T18:28:21.813292] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-06T18:28:22.071778] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T18:28:22.101635] [INFO ] [REMOTE ] DMA: Full fetch complete (6660 records). [2025-10-06T18:28:22.101805] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-06T18:28:22.233234] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-06T18:28:22.299324] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:28:22.561263] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-06T18:28:22.561358] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-06T18:28:22.561523] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-06T18:28:22.561559] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-06T18:28:22.561961] [DEBUG] [LOCAL ] DMA: Trimmed 6660 records to 4554 (keeping 200 days of data) [2025-10-06T18:28:22.588705] [DEBUG] [LOCAL ] DMA: Primary data saved (4554 records). [2025-10-06T18:28:22.588805] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-06T18:28:22.588885] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMA took 33.5s. Estimated remaining: 4h 1m 25s. Rate: 7.2 symbols/min [2025-10-06T18:28:22.757190] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:28:22.798888] [DEBUG] [LOCAL ] DNP: Loaded 33654 existing records from primary storage. [2025-10-06T18:28:22.799211] [INFO ] [MAIN ] DNP: Loaded 33654 existing records. [2025-10-06T18:28:22.974675] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:28:22.974930] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-06T18:28:22.974978] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-06T18:28:22.976069] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-06T18:28:22.976130] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-06T18:28:23.032751] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-06T18:28:23.357476] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:28:23.812432] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T18:28:23.813434] [INFO ] [REMOTE ] DMB: Full fetch complete (14906 records). [2025-10-06T18:28:23.813935] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-06T18:28:23.814356] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:28:23.814554] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:28:23.814626] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:28:23.814719] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-06T18:28:23.814785] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-06T18:28:23.814820] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-06T18:28:23.815075] [DEBUG] [LOCAL ] DMB: Deleted derivative data file. [2025-10-06T18:28:23.815164] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DMB took 33.4s. Estimated remaining: 4h 0m 58s. Rate: 7.2 symbols/min [2025-10-06T18:28:23.835924] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-06T18:28:23.995170] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:28:24.055255] [DEBUG] [LOCAL ] DOC: Loaded 54318 existing records from primary storage. [2025-10-06T18:28:24.055714] [INFO ] [MAIN ] DOC: Loaded 54318 existing records. [2025-10-06T18:28:24.240212] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:28:24.240551] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-06T18:28:24.240681] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-06T18:28:24.242268] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-06T18:28:24.242327] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-06T18:28:24.562413] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-06T18:28:24.647937] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-06T18:28:24.653216] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:28:25.337442] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T18:28:25.425538] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-06T18:28:26.225553] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-06T18:28:26.508544] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T18:28:27.025508] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-06T18:28:27.081829] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T18:28:27.360673] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T18:28:27.825527] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-06T18:28:28.625505] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-06T18:28:28.708599] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T18:28:29.210064] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T18:28:29.425477] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-06T18:28:29.885287] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T18:28:30.225577] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-06T18:28:30.882224] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T18:28:31.025570] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-06T18:28:31.825484] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-06T18:28:32.048392] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T18:28:32.342136] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T18:28:32.625627] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-06T18:28:33.425500] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-06T18:28:33.462749] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T18:28:33.945984] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T18:28:34.225585] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-06T18:28:35.025552] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-06T18:28:35.181151] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T18:28:35.825534] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-06T18:28:36.013617] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-06T18:28:36.625576] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-06T18:28:36.699539] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T18:28:37.425609] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-06T18:28:37.547147] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T18:28:38.225736] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-06T18:28:38.232031] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T18:28:39.025503] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-06T18:28:39.440741] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-06T18:28:39.671883] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T18:28:39.825497] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-06T18:28:40.430282] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T18:28:40.625590] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-06T18:28:41.425514] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-06T18:28:41.654488] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T18:28:41.996711] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T18:28:42.225516] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-06T18:28:42.396489] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T18:28:43.025559] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-06T18:28:43.768932] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T18:28:43.825517] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-06T18:28:44.411590] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T18:28:44.625536] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-06T18:28:45.405889] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T18:28:45.425480] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-06T18:28:46.225500] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-06T18:28:46.255045] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T18:28:47.022556] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T18:28:47.031577] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-06T18:28:47.825528] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-06T18:28:48.053905] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-06T18:28:48.625528] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-06T18:28:48.933816] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T18:28:49.353969] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T18:28:49.357805] [INFO ] [REMOTE ] DNOW: Full fetch complete (63015 records). [2025-10-06T18:28:49.357971] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-06T18:28:49.430689] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-06T18:28:49.815993] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-06T18:28:49.816099] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-06T18:28:49.817323] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-06T18:28:49.817402] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-06T18:28:49.819321] [DEBUG] [LOCAL ] DNOW: Trimmed 63015 records to 43717 (keeping 200 days of data) [2025-10-06T18:28:50.085582] [DEBUG] [LOCAL ] DNOW: Primary data saved (43717 records). [2025-10-06T18:28:50.085753] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-06T18:28:50.085844] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNOW took 28.7s. Estimated remaining: 4h 1m 38s. Rate: 7.2 symbols/min [2025-10-06T18:28:50.225532] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-06T18:28:50.680061] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-06T18:28:50.683698] [INFO ] [REMOTE ] DNA: Full fetch complete (70991 records). [2025-10-06T18:28:50.683915] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-06T18:28:51.026212] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T18:28:51.055386] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-06T18:28:51.134505] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-06T18:28:51.134609] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-06T18:28:51.135530] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-06T18:28:51.135595] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-06T18:28:51.137197] [DEBUG] [LOCAL ] DNA: Trimmed 70991 records to 48384 (keeping 200 days of data) [2025-10-06T18:28:51.413182] [DEBUG] [LOCAL ] DNA: Primary data saved (48384 records). [2025-10-06T18:28:51.413359] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-06T18:28:51.413450] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNA took 39.5s. Estimated remaining: 4h 1m 11s. Rate: 7.2 symbols/min [2025-10-06T18:28:52.086163] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T18:28:52.098622] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-06T18:28:52.331107] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T18:28:52.333157] [INFO ] [REMOTE ] DNP: Full fetch complete (49220 records). [2025-10-06T18:28:52.333260] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-06T18:28:52.713593] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-06T18:28:52.713707] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-06T18:28:52.714449] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-06T18:28:52.714512] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-06T18:28:52.715701] [DEBUG] [LOCAL ] DNP: Trimmed 49220 records to 33242 (keeping 200 days of data) [2025-10-06T18:28:52.912337] [DEBUG] [LOCAL ] DNP: Primary data saved (33242 records). [2025-10-06T18:28:52.912492] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-06T18:28:52.912579] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNP took 30.3s. Estimated remaining: 4h 0m 44s. Rate: 7.2 symbols/min [2025-10-06T18:28:54.032668] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-06T18:28:54.046756] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-06T18:28:55.841566] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T18:28:55.852577] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-06T18:28:57.799410] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-06T18:28:57.812543] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-06T18:28:59.866476] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-06T18:28:59.879918] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-06T18:29:01.721853] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T18:29:01.733429] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-06T18:29:03.337471] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-06T18:29:03.341204] [INFO ] [REMOTE ] DOC: Full fetch complete (77388 records). [2025-10-06T18:29:03.341492] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-06T18:29:03.751670] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-06T18:29:03.751796] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-06T18:29:03.752943] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-06T18:29:03.753013] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-06T18:29:03.754592] [DEBUG] [LOCAL ] DOC: Trimmed 77388 records to 53551 (keeping 200 days of data) [2025-10-06T18:29:04.086127] [DEBUG] [LOCAL ] DOC: Primary data saved (53551 records). [2025-10-06T18:29:04.086291] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-06T18:29:04.086966] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DOC took 40.3s. Estimated remaining: 4h 0m 43s. Rate: 7.2 symbols/min [2025-10-06T18:29:04.695209] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:29:04.839385] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:29:04.845074] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:29:04.845960] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:29:04.846335] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-10-06T18:29:04.847079] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-10-06T18:29:04.847689] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-06T18:29:04.847748] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-06T18:29:04.847794] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-06T18:29:04.847827] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-06T18:29:05.099783] [DEBUG] [LOCAL ] DOUG: Loaded 34792 existing records from primary storage. [2025-10-06T18:29:05.137480] [INFO ] [MAIN ] DOUG: Loaded 34792 existing records. [2025-10-06T18:29:05.234351] [DEBUG] [LOCAL ] DOLE: Loaded 39011 existing records from primary storage. [2025-10-06T18:29:05.317313] [INFO ] [MAIN ] DOLE: Loaded 39011 existing records. [2025-10-06T18:29:05.323406] [DEBUG] [LOCAL ] DOCN: Loaded 51332 existing records from primary storage. [2025-10-06T18:29:05.420148] [INFO ] [MAIN ] DOCN: Loaded 51332 existing records. [2025-10-06T18:29:05.731189] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:29:05.742698] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:29:05.813807] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-06T18:29:05.824485] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-06T18:29:05.835627] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-06T18:29:05.873312] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:29:05.874348] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-06T18:29:05.874422] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-06T18:29:05.880461] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-06T18:29:05.880397] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-06T18:29:05.891026] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-06T18:29:05.896631] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-06T18:29:06.031737] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:29:06.113343] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-06T18:29:06.129004] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-06T18:29:06.178812] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-06T18:29:06.179057] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-06T18:29:07.023577] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:29:07.066877] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:29:07.051468] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-06T18:29:07.074808] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-06T18:29:07.137918] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:29:07.138366] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-06T18:29:07.716002] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T18:29:07.726337] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-06T18:29:08.303624] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T18:29:08.314369] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-06T18:29:08.367038] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T18:29:08.375612] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-06T18:29:08.672339] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T18:29:08.680682] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-06T18:29:09.316340] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T18:29:09.326421] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-06T18:29:09.503977] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T18:29:09.513496] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-06T18:29:09.690897] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T18:29:09.698417] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-06T18:29:10.082878] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T18:29:10.093477] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-06T18:29:10.916126] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T18:29:10.928391] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-06T18:29:10.987487] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T18:29:10.995313] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-06T18:29:11.103447] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T18:29:11.113787] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-06T18:29:11.151669] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T18:29:11.158615] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-06T18:29:12.585063] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-06T18:29:12.604460] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T18:29:12.613343] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-06T18:29:12.615572] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-06T18:29:12.673410] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T18:29:12.687782] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-06T18:29:12.722997] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T18:29:12.734433] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-06T18:29:13.922041] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-06T18:29:13.929457] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-06T18:29:14.048704] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T18:29:14.056825] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-06T18:29:14.598084] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T18:29:14.610157] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-06T18:29:15.473741] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T18:29:15.483538] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-06T18:29:15.559885] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T18:29:15.825533] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-06T18:29:16.684870] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (3.95 seconds). [2025-10-06T18:29:16.731733] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-06T18:29:16.759166] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-06T18:29:16.805795] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T18:29:17.376735] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T18:29:17.425541] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-06T18:29:18.225513] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-06T18:29:18.607612] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-06T18:29:18.877062] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T18:29:19.025585] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-06T18:29:19.695671] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-06T18:29:19.825526] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-06T18:29:20.479635] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T18:29:20.625528] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-06T18:29:21.425561] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-06T18:29:21.641511] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T18:29:22.026541] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-06T18:29:22.225560] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-06T18:29:22.485155] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T18:29:23.025530] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-06T18:29:23.762873] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T18:29:23.825487] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-06T18:29:24.522374] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T18:29:24.625532] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-06T18:29:25.425526] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-06T18:29:25.797873] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-06T18:29:26.020156] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T18:29:26.225548] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-06T18:29:26.647559] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T18:29:26.650228] [INFO ] [REMOTE ] DOLE: Full fetch complete (54055 records). [2025-10-06T18:29:26.650351] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-06T18:29:27.033959] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-06T18:29:27.037312] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-06T18:29:27.038877] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-06T18:29:27.039790] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-06T18:29:27.039874] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-06T18:29:27.041290] [DEBUG] [LOCAL ] DOLE: Trimmed 54055 records to 38603 (keeping 200 days of data) [2025-10-06T18:29:27.288545] [DEBUG] [LOCAL ] DOLE: Primary data saved (38603 records). [2025-10-06T18:29:27.288731] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-06T18:29:27.288828] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOLE took 23.2s. Estimated remaining: 4h 1m 15s. Rate: 7.2 symbols/min [2025-10-06T18:29:27.396059] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T18:29:27.438300] [INFO ] [REMOTE ] DOUG: Full fetch complete (50981 records). [2025-10-06T18:29:27.466313] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-06T18:29:27.470181] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:29:27.470501] [DEBUG] [LOCAL ] DOV: No existing data file found in primary storage. [2025-10-06T18:29:27.470547] [WARN ] [MAIN ] DOV: No existing data found, performing full refresh instead. [2025-10-06T18:29:27.470691] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-06T18:29:27.506331] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-06T18:29:27.532311] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-10-06T18:29:27.541502] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-06T18:29:27.827909] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-06T18:29:28.296376] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-06T18:29:28.296045] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:29:28.296870] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-06T18:29:28.298203] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-06T18:29:28.298279] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-06T18:29:28.300044] [DEBUG] [LOCAL ] DOUG: Trimmed 50981 records to 34381 (keeping 200 days of data) [2025-10-06T18:29:28.521183] [DEBUG] [LOCAL ] DOUG: Primary data saved (34381 records). [2025-10-06T18:29:28.521397] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-06T18:29:28.521507] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOUG took 24.4s. Estimated remaining: 4h 0m 47s. Rate: 7.2 symbols/min [2025-10-06T18:29:28.628581] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-06T18:29:28.713523] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:29:28.714023] [DEBUG] [LOCAL ] DOW: No existing data file found in primary storage. [2025-10-06T18:29:28.714152] [WARN ] [MAIN ] DOW: No existing data found, performing full refresh instead. [2025-10-06T18:29:28.714425] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-06T18:29:28.714501] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-06T18:29:28.714783] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-10-06T18:29:28.714904] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-06T18:29:29.081828] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-06T18:29:29.181861] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:29:29.383523] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T18:29:29.425492] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-06T18:29:30.228704] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-06T18:29:30.232126] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T18:29:31.025531] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-06T18:29:31.099954] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-06T18:29:31.103200] [INFO ] [REMOTE ] DOCN: Full fetch complete (71952 records). [2025-10-06T18:29:31.103342] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-06T18:29:31.500304] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-06T18:29:31.500426] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-06T18:29:31.501513] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-06T18:29:31.501598] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-06T18:29:31.503268] [DEBUG] [LOCAL ] DOCN: Trimmed 71952 records to 50703 (keeping 200 days of data) [2025-10-06T18:29:31.811050] [DEBUG] [LOCAL ] DOCN: Primary data saved (50703 records). [2025-10-06T18:29:31.811230] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-06T18:29:31.811320] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOCN took 27.7s. Estimated remaining: 4h 0m 25s. Rate: 7.2 symbols/min [2025-10-06T18:29:31.845190] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-06T18:29:31.987177] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:29:32.004541] [DEBUG] [LOCAL ] DPG: Loaded 13698 existing records from primary storage. [2025-10-06T18:29:32.004839] [INFO ] [MAIN ] DPG: Loaded 13698 existing records. [2025-10-06T18:29:32.192002] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:29:32.192334] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-06T18:29:32.192565] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-06T18:29:32.192883] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-06T18:29:32.193064] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-06T18:29:32.354094] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-06T18:29:32.606724] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:29:32.625474] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-06T18:29:32.672498] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-06T18:29:33.425572] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-06T18:29:33.524223] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T18:29:34.025506] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-06T18:29:34.225573] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-06T18:29:34.996146] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T18:29:35.025517] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-06T18:29:35.825535] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-06T18:29:35.915671] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T18:29:36.625547] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-06T18:29:36.761684] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T18:29:37.425546] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-06T18:29:37.477046] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T18:29:38.051128] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-06T18:29:38.225563] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-06T18:29:39.025539] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-06T18:29:39.204583] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-06T18:29:39.772288] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T18:29:39.775495] [INFO ] [REMOTE ] DOCS: Full fetch complete (74201 records). [2025-10-06T18:29:39.775669] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-06T18:29:39.831979] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-06T18:29:40.191906] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-06T18:29:40.192009] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-06T18:29:40.193119] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-06T18:29:40.193189] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-06T18:29:40.195180] [DEBUG] [LOCAL ] DOCS: Trimmed 74201 records to 51060 (keeping 200 days of data) [2025-10-06T18:29:40.522597] [DEBUG] [LOCAL ] DOCS: Primary data saved (51060 records). [2025-10-06T18:29:40.522852] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-06T18:29:40.522968] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCS took 36.4s. Estimated remaining: 4h 0m 18s. Rate: 7.2 symbols/min [2025-10-06T18:29:40.629890] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-06T18:29:40.713527] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:29:40.752487] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T18:29:40.802577] [DEBUG] [LOCAL ] DQ: Loaded 44035 existing records from primary storage. [2025-10-06T18:29:40.803038] [INFO ] [MAIN ] DQ: Loaded 44035 existing records. [2025-10-06T18:29:41.004498] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:29:41.004842] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-06T18:29:41.004913] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-06T18:29:41.006405] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-06T18:29:41.006478] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-06T18:29:41.404030] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:29:41.425506] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-06T18:29:41.462426] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T18:29:41.619343] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T18:29:42.225589] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-06T18:29:43.025557] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-06T18:29:43.110619] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-06T18:29:43.388276] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-06T18:29:43.825517] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-06T18:29:44.578111] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T18:29:44.625606] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-06T18:29:45.425522] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-06T18:29:45.646455] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T18:29:46.226368] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-06T18:29:46.226457] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-06T18:29:47.025702] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-06T18:29:47.063256] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-06T18:29:47.244639] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T18:29:47.825531] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-06T18:29:48.580212] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T18:29:48.625521] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-06T18:29:49.376910] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-06T18:29:49.425535] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-06T18:29:50.225582] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-06T18:29:50.264609] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T18:29:51.025504] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-06T18:29:51.521683] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-06T18:29:51.697048] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T18:29:51.825530] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-06T18:29:52.588101] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T18:29:52.625595] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-06T18:29:53.425592] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-06T18:29:53.730999] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-06T18:29:54.225524] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-06T18:29:54.333965] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T18:29:54.373794] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T18:29:55.025571] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-06T18:29:55.623129] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T18:29:55.825537] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-06T18:29:56.540726] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T18:29:56.625568] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-06T18:29:57.183834] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T18:29:57.186909] [INFO ] [REMOTE ] DOV: Full fetch complete (65226 records). [2025-10-06T18:29:57.187075] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-06T18:29:57.430735] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-06T18:29:57.624588] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-06T18:29:57.624935] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-06T18:29:57.625989] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-06T18:29:57.626060] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-06T18:29:57.628563] [DEBUG] [LOCAL ] DOV: Trimmed 65226 records to 45461 (keeping 200 days of data) [2025-10-06T18:29:57.956009] [DEBUG] [LOCAL ] DOV: Primary data saved (45461 records). [2025-10-06T18:29:57.956211] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-06T18:29:57.956338] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DOV took 30.7s. Estimated remaining: 4h 0m 34s. Rate: 7.2 symbols/min [2025-10-06T18:29:58.138965] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:29:58.178809] [DEBUG] [LOCAL ] DRD: Loaded 37644 existing records from primary storage. [2025-10-06T18:29:58.179220] [INFO ] [MAIN ] DRD: Loaded 37644 existing records. [2025-10-06T18:29:58.238971] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-06T18:29:58.383806] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:29:58.384115] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-06T18:29:58.384165] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-06T18:29:58.385319] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-06T18:29:58.385381] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-06T18:29:58.682489] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-06T18:29:58.802128] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:29:58.932246] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-06T18:29:59.025610] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-06T18:29:59.825512] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-06T18:29:59.961112] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T18:30:00.625545] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-06T18:30:01.287910] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-06T18:30:01.317508] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T18:30:01.425554] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-06T18:30:02.230738] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-06T18:30:02.247970] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T18:30:02.522022] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T18:30:03.025543] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-06T18:30:03.172583] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-06T18:30:03.825523] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-06T18:30:04.625589] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-06T18:30:05.091280] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-06T18:30:05.094501] [INFO ] [REMOTE ] DOW: Full fetch complete (77401 records). [2025-10-06T18:30:05.094683] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-06T18:30:05.095571] [FATAL] [VALIDATOR ] DOW: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:30:05.095767] [FATAL] [MAIN ] DOW: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:30:05.095854] [WARN ] [MAIN ] DOW: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:30:05.095947] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-06T18:30:05.096062] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-10-06T18:30:05.096120] [INFO ] [LOCAL ] DOW: Starting deletion of derivative data. [2025-10-06T18:30:05.096199] [DEBUG] [LOCAL ] DOW: No derivative data file found to delete. [2025-10-06T18:30:05.096302] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DOW took 36.6s. Estimated remaining: 4h 0m 22s. Rate: 7.2 symbols/min [2025-10-06T18:30:05.287361] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:30:05.287719] [DEBUG] [LOCAL ] DRH: No existing data file found in primary storage. [2025-10-06T18:30:05.287774] [WARN ] [MAIN ] DRH: No existing data found, performing full refresh instead. [2025-10-06T18:30:05.287895] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-06T18:30:05.287938] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-06T18:30:05.288007] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-06T18:30:05.288050] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-06T18:30:05.408054] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T18:30:05.425969] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-06T18:30:05.426408] [INFO ] [REMOTE ] DPG: Full fetch complete (18965 records). [2025-10-06T18:30:05.443928] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-06T18:30:05.868330] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-06T18:30:06.054230] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:30:06.181818] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-06T18:30:06.181915] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-06T18:30:06.182506] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-06T18:30:06.182555] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-06T18:30:06.183432] [DEBUG] [LOCAL ] DPG: Trimmed 18965 records to 13375 (keeping 200 days of data) [2025-10-06T18:30:06.227001] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-06T18:30:06.275372] [DEBUG] [LOCAL ] DPG: Primary data saved (13375 records). [2025-10-06T18:30:06.275545] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-06T18:30:06.275672] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DPG took 34.5s. Estimated remaining: 3h 59m 55s. Rate: 7.2 symbols/min [2025-10-06T18:30:06.462715] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:30:06.519796] [DEBUG] [LOCAL ] DRI: Loaded 48491 existing records from primary storage. [2025-10-06T18:30:06.520266] [INFO ] [MAIN ] DRI: Loaded 48491 existing records. [2025-10-06T18:30:06.780029] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:30:06.780524] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-06T18:30:06.780711] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-06T18:30:06.782321] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-06T18:30:06.782391] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-06T18:30:07.006969] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T18:30:07.030633] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-06T18:30:07.239798] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:30:07.837011] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-06T18:30:07.844809] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T18:30:08.625550] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-06T18:30:08.677324] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T18:30:09.425701] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-06T18:30:09.972574] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-06T18:30:10.225604] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-06T18:30:10.445799] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T18:30:10.622696] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-06T18:30:11.025553] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-06T18:30:11.825525] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-06T18:30:12.030514] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T18:30:12.591566] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T18:30:12.625516] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-06T18:30:13.168394] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T18:30:13.425621] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-06T18:30:14.082374] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T18:30:14.225558] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-06T18:30:14.955739] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T18:30:15.025517] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-06T18:30:15.825512] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-06T18:30:16.042797] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T18:30:16.415945] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T18:30:16.625537] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-06T18:30:17.425615] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-06T18:30:17.711193] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T18:30:18.225606] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-06T18:30:18.473063] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T18:30:18.815543] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T18:30:19.025528] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-06T18:30:19.825602] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-06T18:30:20.505687] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-06T18:30:20.508618] [INFO ] [REMOTE ] DQ: Full fetch complete (63130 records). [2025-10-06T18:30:20.508777] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-06T18:30:20.630738] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-06T18:30:20.916720] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-06T18:30:20.916847] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-06T18:30:20.917895] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-06T18:30:20.917987] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-06T18:30:20.919633] [DEBUG] [LOCAL ] DQ: Trimmed 63130 records to 43466 (keeping 200 days of data) [2025-10-06T18:30:21.059877] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-06T18:30:21.228286] [DEBUG] [LOCAL ] DQ: Primary data saved (43466 records). [2025-10-06T18:30:21.228434] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-06T18:30:21.228514] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DQ took 40.7s. Estimated remaining: 4h 0m 4s. Rate: 7.2 symbols/min [2025-10-06T18:30:21.427360] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:30:21.406813] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T18:30:21.427751] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-10-06T18:30:21.427522] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-06T18:30:21.436564] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-10-06T18:30:21.437778] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-06T18:30:21.437850] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-06T18:30:21.437907] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-06T18:30:21.437942] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-06T18:30:21.787441] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:30:22.225593] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-06T18:30:22.455447] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T18:30:23.025563] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-06T18:30:23.262081] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T18:30:23.530970] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T18:30:23.825534] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-06T18:30:24.437804] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T18:30:24.625494] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-06T18:30:24.968942] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T18:30:25.425552] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-06T18:30:26.226263] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-06T18:30:26.227203] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-06T18:30:26.402000] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T18:30:27.025566] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-06T18:30:27.741010] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T18:30:27.825483] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-06T18:30:27.871277] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T18:30:28.625536] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-06T18:30:29.425491] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-06T18:30:29.474410] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T18:30:30.225503] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-06T18:30:30.386694] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T18:30:31.025497] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-06T18:30:31.130836] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T18:30:31.514731] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-06T18:30:31.825513] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-06T18:30:32.554711] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T18:30:32.557427] [INFO ] [REMOTE ] DRD: Full fetch complete (50130 records). [2025-10-06T18:30:32.557523] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-06T18:30:32.632739] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-06T18:30:32.978909] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-06T18:30:32.979040] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-06T18:30:32.979889] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-06T18:30:32.979954] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-06T18:30:32.981079] [DEBUG] [LOCAL ] DRD: Trimmed 50130 records to 37053 (keeping 200 days of data) [2025-10-06T18:30:33.243175] [DEBUG] [LOCAL ] DRD: Primary data saved (37053 records). [2025-10-06T18:30:33.243386] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-06T18:30:33.243511] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 35.3s. Estimated remaining: 4h 0m 5s. Rate: 7.2 symbols/min [2025-10-06T18:30:33.429022] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-06T18:30:33.434734] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:30:33.471150] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T18:30:33.504080] [DEBUG] [LOCAL ] DSL: Loaded 28880 existing records from primary storage. [2025-10-06T18:30:33.504445] [INFO ] [MAIN ] DSL: Loaded 28880 existing records. [2025-10-06T18:30:33.729895] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:30:33.730414] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-06T18:30:33.730540] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-06T18:30:33.730979] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-06T18:30:33.731041] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-06T18:30:33.852562] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-06T18:30:34.147879] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:30:34.225619] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-06T18:30:35.025568] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-06T18:30:35.423919] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-06T18:30:35.825530] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-06T18:30:35.931503] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T18:30:35.934774] [INFO ] [REMOTE ] DRI: Full fetch complete (69552 records). [2025-10-06T18:30:35.935078] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-06T18:30:36.121367] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T18:30:36.394022] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-06T18:30:36.394131] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-06T18:30:36.395109] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-06T18:30:36.395182] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-06T18:30:36.396960] [DEBUG] [LOCAL ] DRI: Trimmed 69552 records to 47748 (keeping 200 days of data) [2025-10-06T18:30:36.638450] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-06T18:30:36.740725] [DEBUG] [LOCAL ] DRI: Primary data saved (47748 records). [2025-10-06T18:30:36.740938] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-06T18:30:36.741110] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRI took 30.5s. Estimated remaining: 3h 59m 44s. Rate: 7.2 symbols/min [2025-10-06T18:30:36.932851] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:30:36.955903] [DEBUG] [LOCAL ] DSM: Loaded 15256 existing records from primary storage. [2025-10-06T18:30:36.956315] [INFO ] [MAIN ] DSM: Loaded 15256 existing records. [2025-10-06T18:30:37.161851] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:30:37.162121] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-06T18:30:37.162171] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-06T18:30:37.162474] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-06T18:30:37.162536] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-06T18:30:37.432045] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-06T18:30:37.564490] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:30:37.598997] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T18:30:37.804502] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-06T18:30:38.225569] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-06T18:30:38.409145] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T18:30:39.025543] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-06T18:30:39.355887] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-06T18:30:39.492445] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-06T18:30:39.825532] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-06T18:30:40.600777] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-06T18:30:40.625524] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-06T18:30:41.403264] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T18:30:41.425482] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-06T18:30:42.179073] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-06T18:30:42.225513] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-06T18:30:42.953679] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T18:30:43.025552] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-06T18:30:43.825539] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-06T18:30:44.603714] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T18:30:44.607054] [INFO ] [REMOTE ] DRH: Full fetch complete (71915 records). [2025-10-06T18:30:44.607252] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-06T18:30:44.634119] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-06T18:30:45.076278] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-06T18:30:45.076411] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-06T18:30:45.092948] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-06T18:30:45.093758] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-06T18:30:45.094789] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-06T18:30:45.102367] [DEBUG] [LOCAL ] DRH: Trimmed 71915 records to 50446 (keeping 200 days of data) [2025-10-06T18:30:45.410633] [DEBUG] [LOCAL ] DRH: Primary data saved (50446 records). [2025-10-06T18:30:45.410832] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-06T18:30:45.410924] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRH took 40.3s. Estimated remaining: 3h 59m 36s. Rate: 7.2 symbols/min [2025-10-06T18:30:45.431809] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-06T18:30:45.585438] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:30:45.590143] [DEBUG] [LOCAL ] DSMC: Loaded 1903 existing records from primary storage. [2025-10-06T18:30:45.590313] [INFO ] [MAIN ] DSMC: Loaded 1903 existing records. [2025-10-06T18:30:45.731131] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T18:30:45.789274] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:30:45.789520] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-06T18:30:45.789567] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-06T18:30:45.789798] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-06T18:30:45.789857] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-06T18:30:46.093565] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T18:30:46.113357] [INFO ] [REMOTE ] DRLL: Full fetch complete (15122 records). [2025-10-06T18:30:46.113580] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-06T18:30:46.120380] [FATAL] [VALIDATOR ] DRLL: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:30:46.130783] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:30:46.160544] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:30:46.176995] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-06T18:30:46.197541] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:30:46.197909] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-06T18:30:46.198317] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-10-06T18:30:46.198434] [DEBUG] [LOCAL ] DRLL: No derivative data file found to delete. [2025-10-06T18:30:46.198585] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRLL took 25.0s. Estimated remaining: 3h 59m 8s. Rate: 7.2 symbols/min [2025-10-06T18:30:46.230735] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-06T18:30:46.375635] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:30:46.400956] [DEBUG] [LOCAL ] DSU: Loaded 22916 existing records from primary storage. [2025-10-06T18:30:46.401262] [INFO ] [MAIN ] DSU: Loaded 22916 existing records. [2025-10-06T18:30:46.577957] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:30:46.578228] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-06T18:30:46.578277] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-06T18:30:46.578493] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-06T18:30:46.578559] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-06T18:30:46.934187] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:30:47.025554] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-06T18:30:47.453883] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T18:30:47.825530] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-06T18:30:48.408988] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T18:30:48.625560] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-06T18:30:48.860436] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T18:30:49.425567] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-06T18:30:49.591459] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-06T18:30:50.016802] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T18:30:50.225545] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-06T18:30:51.025498] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-06T18:30:51.322930] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T18:30:51.825537] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-06T18:30:52.213467] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-06T18:30:52.625558] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-06T18:30:52.959885] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T18:30:52.979062] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-06T18:30:53.425589] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-06T18:30:54.225528] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-06T18:30:54.667540] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-06T18:30:55.025508] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-06T18:30:55.077024] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T18:30:55.474901] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-06T18:30:55.825509] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-06T18:30:56.625499] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-06T18:30:56.902511] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T18:30:57.425510] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-06T18:30:57.775271] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-06T18:30:57.879437] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-06T18:30:58.225528] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-06T18:30:58.806819] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-06T18:30:59.025582] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-06T18:30:59.822758] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-06T18:30:59.825725] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-06T18:31:00.625594] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-06T18:31:00.980574] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T18:31:01.163560] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T18:31:01.425615] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-06T18:31:02.023312] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T18:31:02.225625] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-06T18:31:03.025533] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-06T18:31:03.290697] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T18:31:03.359290] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-06T18:31:03.825580] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-06T18:31:04.579763] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-06T18:31:04.582406] [INFO ] [REMOTE ] DSM: Full fetch complete (24344 records). [2025-10-06T18:31:04.582483] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-06T18:31:04.636017] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-06T18:31:04.978936] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-06T18:31:04.979039] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-06T18:31:04.979607] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-06T18:31:04.979676] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-06T18:31:04.980391] [DEBUG] [LOCAL ] DSM: Trimmed 24344 records to 14715 (keeping 200 days of data) [2025-10-06T18:31:05.068265] [DEBUG] [LOCAL ] DSM: Primary data saved (14715 records). [2025-10-06T18:31:05.068431] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-06T18:31:05.068518] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSM took 28.3s. Estimated remaining: 3h 59m 27s. Rate: 7.2 symbols/min [2025-10-06T18:31:05.240992] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:31:05.241185] [DEBUG] [LOCAL ] DSX: No existing data file found in primary storage. [2025-10-06T18:31:05.241220] [WARN ] [MAIN ] DSX: No existing data found, performing full refresh instead. [2025-10-06T18:31:05.241333] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-06T18:31:05.241373] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-06T18:31:05.241413] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-06T18:31:05.241445] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-06T18:31:05.435867] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-06T18:31:05.595348] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:31:05.936627] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-06T18:31:06.115439] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T18:31:06.225551] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-06T18:31:07.025500] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-06T18:31:07.411281] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T18:31:07.825521] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-06T18:31:08.147329] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T18:31:08.625497] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-06T18:31:09.068911] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-06T18:31:09.082302] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-06T18:31:09.425535] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-06T18:31:10.225611] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-06T18:31:10.975443] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T18:31:11.025493] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-06T18:31:11.404137] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T18:31:11.825525] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-06T18:31:11.873530] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T18:31:12.625518] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-06T18:31:12.963415] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T18:31:13.158129] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-06T18:31:13.425521] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-06T18:31:14.225535] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-06T18:31:14.575149] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-06T18:31:14.576913] [INFO ] [REMOTE ] DSL: Full fetch complete (41362 records). [2025-10-06T18:31:14.577005] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-06T18:31:14.577559] [FATAL] [VALIDATOR ] DSL: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:31:14.577704] [FATAL] [MAIN ] DSL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:31:14.577750] [WARN ] [MAIN ] DSL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:31:14.577789] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-06T18:31:14.577847] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-06T18:31:14.577882] [INFO ] [LOCAL ] DSL: Starting deletion of derivative data. [2025-10-06T18:31:14.578206] [DEBUG] [LOCAL ] DSL: Deleted derivative data file. [2025-10-06T18:31:14.578350] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSL took 41.3s. Estimated remaining: 3h 59m 22s. Rate: 7.2 symbols/min [2025-10-06T18:31:14.755816] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:31:14.760820] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T18:31:14.761781] [INFO ] [REMOTE ] DSMC: Full fetch complete (2859 records). [2025-10-06T18:31:14.761873] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-06T18:31:14.762244] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:31:14.762325] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:31:14.762367] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:31:14.762402] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-06T18:31:14.762451] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-06T18:31:14.762484] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-06T18:31:14.762722] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-10-06T18:31:14.762819] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSMC took 29.4s. Estimated remaining: 3h 58m 52s. Rate: 7.2 symbols/min [2025-10-06T18:31:14.936473] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:31:14.936744] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-06T18:31:14.936792] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-06T18:31:14.936907] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-06T18:31:14.936947] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-06T18:31:14.936991] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-06T18:31:14.937023] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-06T18:31:15.028607] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-06T18:31:15.147041] [DEBUG] [LOCAL ] DT: Loaded 53705 existing records from primary storage. [2025-10-06T18:31:15.185613] [INFO ] [MAIN ] DT: Loaded 53705 existing records. [2025-10-06T18:31:15.582026] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:31:15.601870] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:31:15.602059] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-06T18:31:15.602131] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-06T18:31:15.602469] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-06T18:31:15.602541] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-06T18:31:15.833740] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-06T18:31:15.958585] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:31:16.365853] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T18:31:16.625490] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-06T18:31:16.790245] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T18:31:17.371239] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-06T18:31:17.425547] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-06T18:31:17.998431] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-06T18:31:18.225625] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-06T18:31:18.697175] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-06T18:31:19.025628] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-06T18:31:19.825523] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-06T18:31:20.304328] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-06T18:31:20.421704] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-06T18:31:20.625591] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-06T18:31:21.215915] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-06T18:31:21.425581] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-06T18:31:22.050940] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-06T18:31:22.225546] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-06T18:31:23.025686] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-06T18:31:23.368056] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T18:31:23.825503] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-06T18:31:24.260624] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T18:31:24.421489] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T18:31:24.625542] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-06T18:31:25.425521] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-06T18:31:25.798140] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T18:31:26.046245] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-06T18:31:26.225601] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-06T18:31:27.025598] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-06T18:31:27.358699] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-06T18:31:27.696535] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-06T18:31:27.825515] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-06T18:31:28.506322] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-06T18:31:28.625546] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-06T18:31:29.345600] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-06T18:31:29.346621] [INFO ] [REMOTE ] DTB: Full fetch complete (6835 records). [2025-10-06T18:31:29.346729] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-06T18:31:29.430766] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-06T18:31:29.736070] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-06T18:31:29.736411] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-06T18:31:29.736621] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-06T18:31:29.736694] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-06T18:31:29.737151] [DEBUG] [LOCAL ] DTB: Trimmed 6835 records to 4928 (keeping 200 days of data) [2025-10-06T18:31:29.768269] [DEBUG] [LOCAL ] DTB: Primary data saved (4928 records). [2025-10-06T18:31:29.768364] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-06T18:31:29.768432] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DTB took 15.0s. Estimated remaining: 3h 59m 1s. Rate: 7.2 symbols/min [2025-10-06T18:31:29.936349] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:31:29.987126] [DEBUG] [LOCAL ] DTE: Loaded 48375 existing records from primary storage. [2025-10-06T18:31:29.987520] [INFO ] [MAIN ] DTE: Loaded 48375 existing records. [2025-10-06T18:31:30.161197] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:31:30.161504] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-06T18:31:30.161552] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-06T18:31:30.162201] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-06T18:31:30.162261] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-06T18:31:30.234607] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-06T18:31:30.561548] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:31:31.025496] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-06T18:31:31.140514] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T18:31:31.739549] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T18:31:31.825510] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-06T18:31:32.625546] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-06T18:31:32.737204] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T18:31:33.054172] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T18:31:33.387513] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T18:31:33.389388] [INFO ] [REMOTE ] DSU: Full fetch complete (32909 records). [2025-10-06T18:31:33.389479] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-06T18:31:33.430633] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-06T18:31:33.836114] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-06T18:31:33.836203] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-06T18:31:33.836822] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-06T18:31:33.836884] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-06T18:31:33.837753] [DEBUG] [LOCAL ] DSU: Trimmed 32909 records to 22739 (keeping 200 days of data) [2025-10-06T18:31:33.976093] [DEBUG] [LOCAL ] DSU: Primary data saved (22739 records). [2025-10-06T18:31:33.976242] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-06T18:31:33.976335] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSU took 47.8s. Estimated remaining: 3h 58m 42s. Rate: 7.2 symbols/min [2025-10-06T18:31:34.141404] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:31:34.141586] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-06T18:31:34.141630] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-06T18:31:34.141768] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-06T18:31:34.141809] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-06T18:31:34.141851] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-06T18:31:34.141882] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-06T18:31:34.230802] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-06T18:31:34.497070] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:31:35.025511] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-06T18:31:35.189554] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T18:31:35.218744] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T18:31:35.825510] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-06T18:31:36.625494] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-06T18:31:36.674858] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-06T18:31:37.190761] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-06T18:31:37.286267] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T18:31:37.425496] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-06T18:31:38.225550] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-06T18:31:38.516730] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T18:31:38.644161] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-06T18:31:39.025566] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-06T18:31:39.825541] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-06T18:31:40.625484] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-06T18:31:40.714955] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T18:31:40.972229] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T18:31:41.425555] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-06T18:31:42.225563] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-06T18:31:42.279235] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-06T18:31:42.281696] [INFO ] [REMOTE ] DSX: Full fetch complete (36414 records). [2025-10-06T18:31:42.281799] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-06T18:31:42.572223] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-06T18:31:42.602085] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-06T18:31:42.711872] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-06T18:31:42.711954] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-06T18:31:42.712521] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-06T18:31:42.712559] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-06T18:31:42.713417] [DEBUG] [LOCAL ] DSX: Trimmed 36414 records to 24112 (keeping 200 days of data) [2025-10-06T18:31:42.854602] [DEBUG] [LOCAL ] DSX: Primary data saved (24112 records). [2025-10-06T18:31:42.854769] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-06T18:31:42.854849] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DSX took 37.8s. Estimated remaining: 3h 58m 35s. Rate: 7.2 symbols/min [2025-10-06T18:31:43.028082] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:31:43.028205] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-06T18:31:43.039211] [DEBUG] [LOCAL ] DTG: Loaded 6011 existing records from primary storage. [2025-10-06T18:31:43.039549] [INFO ] [MAIN ] DTG: Loaded 6011 existing records. [2025-10-06T18:31:43.229012] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:31:43.229356] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-06T18:31:43.229420] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-06T18:31:43.229610] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-06T18:31:43.229703] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-06T18:31:43.597604] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:31:43.825510] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-06T18:31:44.285358] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-06T18:31:44.625585] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-06T18:31:44.755610] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T18:31:45.153281] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-06T18:31:45.425556] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-06T18:31:46.225545] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-06T18:31:46.678608] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-06T18:31:47.025508] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-06T18:31:47.057205] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T18:31:47.825494] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-06T18:31:47.890702] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T18:31:48.625534] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-06T18:31:48.975637] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-06T18:31:49.425594] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-06T18:31:49.736261] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T18:31:49.804604] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-06T18:31:50.225543] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-06T18:31:50.825175] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T18:31:51.025556] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-06T18:31:51.381919] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-06T18:31:51.825523] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-06T18:31:52.259549] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-06T18:31:52.625533] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-06T18:31:53.228052] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T18:31:53.228874] [INFO ] [REMOTE ] DTF: Full fetch complete (2050 records). [2025-10-06T18:31:53.228966] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-06T18:31:53.421231] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-06T18:31:53.421497] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:31:53.421596] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:31:53.421692] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-06T18:31:53.421767] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-06T18:31:53.421802] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-06T18:31:53.421840] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-06T18:31:53.421898] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DTF took 19.4s. Estimated remaining: 3h 58m 32s. Rate: 7.2 symbols/min [2025-10-06T18:31:53.431952] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-06T18:31:53.600356] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:31:53.600603] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-06T18:31:53.600736] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-06T18:31:53.600869] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-06T18:31:53.600913] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-06T18:31:53.601005] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-06T18:31:53.601046] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-06T18:31:53.972186] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:31:54.225547] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-06T18:31:54.430204] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:31:54.430563] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-06T18:31:54.430674] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:31:54.430733] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-06T18:31:54.430794] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:31:54.430844] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-06T18:31:54.430902] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-06T18:31:54.430936] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-06T18:31:54.430990] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-06T18:31:54.431059] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTK took 1.0s. Estimated remaining: 3h 58m 5s. Rate: 7.2 symbols/min [2025-10-06T18:31:54.602527] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:31:54.602792] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-10-06T18:31:54.602847] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-10-06T18:31:54.602964] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-06T18:31:54.603005] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-06T18:31:54.603045] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-06T18:31:54.603076] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-06T18:31:55.028015] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-06T18:31:55.036615] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:31:55.133604] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T18:31:55.603884] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T18:31:55.825578] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-06T18:31:56.625550] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-06T18:31:57.232918] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T18:31:57.322878] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-06T18:31:57.425539] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-06T18:31:58.225564] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-06T18:31:58.920914] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T18:31:59.025521] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-06T18:31:59.067857] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T18:31:59.615434] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-06T18:31:59.825568] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-06T18:32:00.625556] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-06T18:32:01.425558] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-06T18:32:01.867621] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-06T18:32:02.024620] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T18:32:02.225514] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-06T18:32:02.299793] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T18:32:03.025580] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-06T18:32:03.825507] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-06T18:32:04.037684] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T18:32:04.433036] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-06T18:32:04.616290] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T18:32:04.625677] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-06T18:32:05.425582] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-06T18:32:05.948570] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T18:32:06.225545] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-06T18:32:07.025569] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-06T18:32:07.140628] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T18:32:07.565837] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T18:32:07.629947] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-06T18:32:07.825509] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-06T18:32:08.442150] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-06T18:32:08.625530] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-06T18:32:09.345334] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-06T18:32:09.346340] [INFO ] [REMOTE ] DTG: Full fetch complete (8916 records). [2025-10-06T18:32:09.346412] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-06T18:32:09.430691] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-06T18:32:09.742616] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-06T18:32:09.742765] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-06T18:32:09.743015] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-06T18:32:09.743068] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-06T18:32:09.743530] [DEBUG] [LOCAL ] DTG: Trimmed 8916 records to 5777 (keeping 200 days of data) [2025-10-06T18:32:09.780197] [DEBUG] [LOCAL ] DTG: Primary data saved (5777 records). [2025-10-06T18:32:09.780363] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-06T18:32:09.780458] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTG took 26.9s. Estimated remaining: 3h 58m 15s. Rate: 7.2 symbols/min [2025-10-06T18:32:09.950932] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:32:09.951149] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-06T18:32:09.951187] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-06T18:32:09.951307] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-06T18:32:09.951348] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-06T18:32:09.951388] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-06T18:32:09.951420] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-06T18:32:10.234548] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-06T18:32:10.343235] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:32:11.025536] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-06T18:32:11.117002] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T18:32:11.821891] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T18:32:11.825484] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-06T18:32:11.825778] [INFO ] [REMOTE ] DTE: Full fetch complete (68844 records). [2025-10-06T18:32:11.826917] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-06T18:32:11.995082] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T18:32:12.267307] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-06T18:32:12.267408] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-06T18:32:12.268329] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-06T18:32:12.268394] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-06T18:32:12.269810] [DEBUG] [LOCAL ] DTE: Trimmed 68844 records to 47627 (keeping 200 days of data) [2025-10-06T18:32:12.578511] [DEBUG] [LOCAL ] DTE: Primary data saved (47627 records). [2025-10-06T18:32:12.578718] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-06T18:32:12.579767] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTE took 42.8s. Estimated remaining: 3h 57m 52s. Rate: 7.2 symbols/min [2025-10-06T18:32:12.630871] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-06T18:32:12.769165] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:32:12.831370] [DEBUG] [LOCAL ] DUK: Loaded 54233 existing records from primary storage. [2025-10-06T18:32:12.831782] [INFO ] [MAIN ] DUK: Loaded 54233 existing records. [2025-10-06T18:32:13.025019] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:32:13.025271] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-06T18:32:13.025317] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-06T18:32:13.025745] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-06T18:32:13.025802] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-06T18:32:13.420156] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:32:13.425496] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-06T18:32:13.810902] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T18:32:14.225739] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-06T18:32:14.529169] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T18:32:14.877770] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-06T18:32:15.025725] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-06T18:32:15.414097] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-06T18:32:15.825547] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-06T18:32:16.423986] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T18:32:16.625552] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-06T18:32:16.962676] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T18:32:17.179513] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-06T18:32:17.425542] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-06T18:32:18.225592] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-06T18:32:19.018795] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T18:32:19.021913] [INFO ] [REMOTE ] DT: Full fetch complete (76674 records). [2025-10-06T18:32:19.022032] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-06T18:32:19.034575] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-06T18:32:19.419978] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-06T18:32:19.420087] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-06T18:32:19.421026] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-06T18:32:19.421114] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-06T18:32:19.422674] [DEBUG] [LOCAL ] DT: Trimmed 76674 records to 52945 (keeping 200 days of data) [2025-10-06T18:32:19.750813] [DEBUG] [LOCAL ] DT: Primary data saved (52945 records). [2025-10-06T18:32:19.751005] [INFO ] [MAIN ] DT: Full history saved. [2025-10-06T18:32:19.751119] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DT took 1m 5s. Estimated remaining: 3h 57m 41s. Rate: 7.2 symbols/min [2025-10-06T18:32:19.837709] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-06T18:32:19.947179] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:32:19.982873] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T18:32:20.004833] [DEBUG] [LOCAL ] DUKB: Loaded 6427 existing records from primary storage. [2025-10-06T18:32:20.005147] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-06T18:32:20.007088] [INFO ] [MAIN ] DUKB: Loaded 6427 existing records. [2025-10-06T18:32:20.183535] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:32:20.183819] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-06T18:32:20.183868] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-06T18:32:20.184052] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-06T18:32:20.184108] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-06T18:32:20.566586] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:32:20.625589] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-06T18:32:21.425564] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-06T18:32:21.560823] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T18:32:21.727921] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T18:32:22.146813] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T18:32:22.225534] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-06T18:32:22.939380] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-06T18:32:23.025492] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-06T18:32:23.536196] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-06T18:32:23.825551] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-06T18:32:24.450155] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-06T18:32:24.625585] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-06T18:32:25.221594] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T18:32:25.425578] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-06T18:32:26.225736] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-06T18:32:27.025518] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-06T18:32:27.137336] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T18:32:27.694901] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-06T18:32:27.825568] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-06T18:32:28.431128] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T18:32:28.625560] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-06T18:32:28.663429] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-06T18:32:29.361176] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T18:32:29.425536] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-06T18:32:30.129969] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-06T18:32:30.225593] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-06T18:32:31.025520] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-06T18:32:31.084711] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-06T18:32:31.621119] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T18:32:31.825573] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-06T18:32:32.446015] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-06T18:32:32.446905] [INFO ] [REMOTE ] DTW: Full fetch complete (7486 records). [2025-10-06T18:32:32.447008] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-06T18:32:32.447469] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:32:32.447558] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:32:32.447629] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:32:32.447724] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-06T18:32:32.447810] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-06T18:32:32.447867] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-06T18:32:32.447927] [DEBUG] [LOCAL ] DTW: No derivative data file found to delete. [2025-10-06T18:32:32.448004] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTW took 22.7s. Estimated remaining: 3h 57m 44s. Rate: 7.2 symbols/min [2025-10-06T18:32:32.619569] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:32:32.625520] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-06T18:32:32.679183] [DEBUG] [LOCAL ] DV: Loaded 52046 existing records from primary storage. [2025-10-06T18:32:32.679669] [INFO ] [MAIN ] DV: Loaded 52046 existing records. [2025-10-06T18:32:32.873096] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:32:32.873378] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-06T18:32:32.873432] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-06T18:32:32.873862] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-06T18:32:32.873923] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-06T18:32:33.256050] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:32:33.425616] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-06T18:32:34.143455] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-06T18:32:34.225507] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-06T18:32:34.334476] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T18:32:34.824235] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T18:32:35.025545] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-06T18:32:35.604276] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-06T18:32:35.825547] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-06T18:32:36.625545] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-06T18:32:37.094859] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T18:32:37.095708] [INFO ] [REMOTE ] DUKB: Full fetch complete (9440 records). [2025-10-06T18:32:37.095777] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-06T18:32:37.447120] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-06T18:32:37.455576] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-06T18:32:37.455834] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-06T18:32:37.456219] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-06T18:32:37.457079] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-06T18:32:37.457722] [DEBUG] [LOCAL ] DUKB: Trimmed 9440 records to 6368 (keeping 200 days of data) [2025-10-06T18:32:37.499186] [DEBUG] [LOCAL ] DUKB: Primary data saved (6368 records). [2025-10-06T18:32:37.499318] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-06T18:32:37.499403] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DUKB took 17.7s. Estimated remaining: 3h 57m 27s. Rate: 7.2 symbols/min [2025-10-06T18:32:37.673033] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:32:37.715336] [DEBUG] [LOCAL ] DVA: Loaded 41630 existing records from primary storage. [2025-10-06T18:32:37.715712] [INFO ] [MAIN ] DVA: Loaded 41630 existing records. [2025-10-06T18:32:37.914393] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:32:37.914619] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-06T18:32:37.914999] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-06T18:32:37.915398] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-06T18:32:37.915495] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-06T18:32:38.084516] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-06T18:32:38.230757] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-06T18:32:38.341092] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:32:39.026739] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-06T18:32:39.029929] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T18:32:39.825584] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-06T18:32:40.277233] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-06T18:32:40.606760] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T18:32:40.625534] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-06T18:32:41.179672] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T18:32:41.425602] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-06T18:32:41.679317] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T18:32:42.225551] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-06T18:32:43.006232] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T18:32:43.025480] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-06T18:32:43.546677] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T18:32:43.825531] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-06T18:32:44.625488] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-06T18:32:44.962155] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T18:32:45.425549] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-06T18:32:45.611623] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T18:32:46.225494] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-06T18:32:46.320881] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T18:32:46.566040] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T18:32:46.568268] [INFO ] [REMOTE ] DTM: Full fetch complete (64509 records). [2025-10-06T18:32:46.568371] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-06T18:32:46.569287] [FATAL] [VALIDATOR ] DTM: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:32:46.569373] [FATAL] [MAIN ] DTM: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:32:46.569416] [WARN ] [MAIN ] DTM: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:32:46.569454] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-06T18:32:46.569592] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-06T18:32:46.569689] [INFO ] [LOCAL ] DTM: Starting deletion of derivative data. [2025-10-06T18:32:46.569789] [DEBUG] [LOCAL ] DTM: No derivative data file found to delete. [2025-10-06T18:32:46.569898] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DTM took 52.1s. Estimated remaining: 3h 57m 20s. Rate: 7.2 symbols/min [2025-10-06T18:32:46.738708] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:32:46.790525] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-10-06T18:32:46.790948] [INFO ] [MAIN ] DVN: Loaded 54479 existing records. [2025-10-06T18:32:46.973320] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:32:46.973530] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-06T18:32:46.973595] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-06T18:32:46.974134] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-06T18:32:46.974210] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-06T18:32:47.031268] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-06T18:32:47.330661] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:32:47.743940] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T18:32:47.825580] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-06T18:32:48.625561] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-06T18:32:49.032996] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-06T18:32:49.430757] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-06T18:32:49.445892] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T18:32:50.225590] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-06T18:32:50.598455] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-06T18:32:51.025531] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-06T18:32:51.193228] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T18:32:51.833216] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-06T18:32:51.869683] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T18:32:52.625520] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-06T18:32:52.738384] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T18:32:53.429359] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-06T18:32:53.445470] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T18:32:54.225501] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-06T18:32:54.631596] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-06T18:32:54.974215] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T18:32:55.025570] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-06T18:32:55.825562] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-06T18:32:55.992792] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T18:32:56.625548] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-06T18:32:56.655397] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T18:32:56.658780] [INFO ] [REMOTE ] DUK: Full fetch complete (77400 records). [2025-10-06T18:32:56.658969] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-06T18:32:57.058600] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-06T18:32:57.058859] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-06T18:32:57.059820] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-06T18:32:57.059889] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-06T18:32:57.061436] [DEBUG] [LOCAL ] DUK: Trimmed 77400 records to 53450 (keeping 200 days of data) [2025-10-06T18:32:57.329317] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T18:32:57.427025] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-06T18:32:57.440665] [DEBUG] [LOCAL ] DUK: Primary data saved (53450 records). [2025-10-06T18:32:57.440792] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-06T18:32:57.441846] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DUK took 44.9s. Estimated remaining: 3h 57m 18s. Rate: 7.2 symbols/min [2025-10-06T18:32:57.611620] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:32:57.668436] [DEBUG] [LOCAL ] DX: Loaded 53234 existing records from primary storage. [2025-10-06T18:32:57.668839] [INFO ] [MAIN ] DX: Loaded 53234 existing records. [2025-10-06T18:32:57.848419] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:32:57.848903] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-06T18:32:57.848965] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-06T18:32:57.849465] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-06T18:32:57.849524] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-06T18:32:57.999284] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T18:32:58.230743] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-06T18:32:58.301522] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:32:58.888439] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-06T18:32:59.025480] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-06T18:32:59.825492] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-06T18:33:00.625552] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-06T18:33:00.673477] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-06T18:33:01.037525] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-06T18:33:01.383143] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T18:33:01.425478] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-06T18:33:01.796445] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T18:33:02.225541] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-06T18:33:02.906535] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T18:33:03.025550] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-06T18:33:03.825485] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-06T18:33:04.020954] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T18:33:04.471993] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T18:33:04.625569] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-06T18:33:05.425514] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-06T18:33:05.554280] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T18:33:06.225511] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-06T18:33:06.391587] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T18:33:07.025505] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-06T18:33:07.505271] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-06T18:33:07.825623] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-06T18:33:07.983188] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T18:33:08.169599] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T18:33:08.172281] [INFO ] [REMOTE ] DVA: Full fetch complete (59905 records). [2025-10-06T18:33:08.172398] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-06T18:33:08.559194] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-06T18:33:08.559305] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-06T18:33:08.560150] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-06T18:33:08.560221] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-06T18:33:08.561552] [DEBUG] [LOCAL ] DVA: Trimmed 59905 records to 41094 (keeping 200 days of data) [2025-10-06T18:33:08.653884] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-06T18:33:08.819478] [DEBUG] [LOCAL ] DVA: Primary data saved (41094 records). [2025-10-06T18:33:08.819631] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-06T18:33:08.819752] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DVA took 31.3s. Estimated remaining: 3h 57m 18s. Rate: 7.2 symbols/min [2025-10-06T18:33:08.985419] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:33:09.037194] [DEBUG] [LOCAL ] DXC: Loaded 50520 existing records from primary storage. [2025-10-06T18:33:09.037614] [INFO ] [MAIN ] DXC: Loaded 50520 existing records. [2025-10-06T18:33:09.249474] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:33:09.249893] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-06T18:33:09.249996] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-06T18:33:09.250316] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-06T18:33:09.250373] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-06T18:33:09.430815] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-06T18:33:09.621501] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:33:09.966822] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-06T18:33:10.225494] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-06T18:33:10.335595] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T18:33:11.025563] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-06T18:33:11.392160] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-06T18:33:11.825566] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-06T18:33:12.046149] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T18:33:12.625547] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-06T18:33:12.714604] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-06T18:33:12.717700] [INFO ] [REMOTE ] DV: Full fetch complete (73556 records). [2025-10-06T18:33:12.717818] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-06T18:33:13.140405] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-06T18:33:13.140492] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-06T18:33:13.141390] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-06T18:33:13.141455] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-06T18:33:13.143064] [DEBUG] [LOCAL ] DV: Trimmed 73556 records to 51300 (keeping 200 days of data) [2025-10-06T18:33:13.439458] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-06T18:33:13.489330] [DEBUG] [LOCAL ] DV: Primary data saved (51300 records). [2025-10-06T18:33:13.489502] [INFO ] [MAIN ] DV: Full history saved. [2025-10-06T18:33:13.489591] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DV took 41.0s. Estimated remaining: 3h 56m 60s. Rate: 7.2 symbols/min [2025-10-06T18:33:13.704346] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:33:13.749354] [DEBUG] [LOCAL ] DXYZ: Loaded 37604 existing records from primary storage. [2025-10-06T18:33:13.749688] [INFO ] [MAIN ] DXYZ: Loaded 37604 existing records. [2025-10-06T18:33:13.911167] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-06T18:33:13.983599] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:33:13.984993] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-06T18:33:13.985450] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-06T18:33:13.986155] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-06T18:33:13.986236] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-06T18:33:14.124699] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T18:33:14.230678] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-06T18:33:14.411369] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:33:15.025552] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-06T18:33:15.317474] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-06T18:33:15.378843] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T18:33:15.825541] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-06T18:33:16.625605] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-06T18:33:17.425612] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-06T18:33:17.675395] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-06T18:33:17.757501] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-06T18:33:18.225521] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-06T18:33:18.620567] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T18:33:19.025703] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-06T18:33:19.417279] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-06T18:33:19.825555] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-06T18:33:20.244200] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-06T18:33:20.625600] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-06T18:33:21.159079] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-06T18:33:21.425492] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-06T18:33:21.833060] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-06T18:33:22.225489] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-06T18:33:22.328502] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T18:33:23.025485] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-06T18:33:23.142620] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T18:33:23.825494] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-06T18:33:24.082603] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-06T18:33:24.625545] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-06T18:33:24.818772] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T18:33:25.425494] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-06T18:33:25.619522] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T18:33:26.224113] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T18:33:26.234586] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-06T18:33:27.025504] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-06T18:33:27.104539] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T18:33:27.825561] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-06T18:33:27.999842] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T18:33:28.625562] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-06T18:33:29.124214] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-06T18:33:29.425503] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-06T18:33:29.759318] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-06T18:33:30.180963] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-06T18:33:30.225478] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-06T18:33:31.025498] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-06T18:33:31.096053] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T18:33:31.825507] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-06T18:33:32.115890] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-06T18:33:32.625503] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-06T18:33:32.908434] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-06T18:33:32.911662] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-10-06T18:33:32.911793] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-06T18:33:33.296155] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-06T18:33:33.296273] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-06T18:33:33.297285] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-06T18:33:33.297457] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-06T18:33:33.299065] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 53699 (keeping 200 days of data) [2025-10-06T18:33:33.425722] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-06T18:33:33.463946] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T18:33:33.682307] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-10-06T18:33:33.682464] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-06T18:33:33.682562] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DVN took 47.1s. Estimated remaining: 3h 57m 22s. Rate: 7.2 symbols/min [2025-10-06T18:33:33.851324] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:33:33.886869] [DEBUG] [LOCAL ] DY: Loaded 29368 existing records from primary storage. [2025-10-06T18:33:33.887590] [INFO ] [MAIN ] DY: Loaded 29368 existing records. [2025-10-06T18:33:34.078611] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:33:34.079041] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-06T18:33:34.079096] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-06T18:33:34.079537] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-06T18:33:34.079607] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-06T18:33:34.230811] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-06T18:33:34.466865] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:33:34.491109] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-06T18:33:35.025499] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-06T18:33:35.123581] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T18:33:35.823973] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T18:33:35.826571] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-06T18:33:35.827827] [INFO ] [REMOTE ] DX: Full fetch complete (75497 records). [2025-10-06T18:33:35.827914] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-06T18:33:36.251813] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-06T18:33:36.251996] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-06T18:33:36.253337] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-06T18:33:36.253412] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-06T18:33:36.255497] [DEBUG] [LOCAL ] DX: Trimmed 75497 records to 52483 (keeping 200 days of data) [2025-10-06T18:33:36.607961] [DEBUG] [LOCAL ] DX: Primary data saved (52483 records). [2025-10-06T18:33:36.608258] [INFO ] [MAIN ] DX: Full history saved. [2025-10-06T18:33:36.609238] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DX took 39.2s. Estimated remaining: 3h 56m 59s. Rate: 7.2 symbols/min [2025-10-06T18:33:36.643034] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-06T18:33:36.806320] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:33:36.806704] [DEBUG] [LOCAL ] E: No existing data file found in primary storage. [2025-10-06T18:33:36.806778] [WARN ] [MAIN ] E: No existing data found, performing full refresh instead. [2025-10-06T18:33:36.807125] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-06T18:33:36.807239] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-06T18:33:36.807402] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-10-06T18:33:36.807462] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-06T18:33:37.001669] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T18:33:37.231514] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:33:37.256581] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T18:33:37.425553] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-06T18:33:38.225523] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-06T18:33:38.471070] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-06T18:33:38.549512] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T18:33:39.025620] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-06T18:33:39.825493] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-06T18:33:39.852592] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T18:33:40.625490] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-06T18:33:40.800586] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-06T18:33:40.803553] [INFO ] [REMOTE ] DXC: Full fetch complete (69518 records). [2025-10-06T18:33:40.803744] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-06T18:33:41.204029] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-06T18:33:41.204225] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-06T18:33:41.205439] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-06T18:33:41.205503] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-06T18:33:41.206901] [DEBUG] [LOCAL ] DXC: Trimmed 69518 records to 49859 (keeping 200 days of data) [2025-10-06T18:33:41.433172] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-06T18:33:41.439883] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T18:33:41.550535] [DEBUG] [LOCAL ] DXC: Primary data saved (49859 records). [2025-10-06T18:33:41.550835] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-06T18:33:41.550974] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DXC took 32.7s. Estimated remaining: 3h 56m 42s. Rate: 7.2 symbols/min [2025-10-06T18:33:41.726207] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:33:41.768066] [DEBUG] [LOCAL ] EAF: Loaded 43181 existing records from primary storage. [2025-10-06T18:33:41.768401] [INFO ] [MAIN ] EAF: Loaded 43181 existing records. [2025-10-06T18:33:41.954145] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:33:41.954706] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-06T18:33:41.954821] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-06T18:33:41.955363] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-06T18:33:41.955430] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-06T18:33:42.105945] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-06T18:33:42.230722] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-06T18:33:42.376207] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:33:43.025561] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-06T18:33:43.332517] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T18:33:43.573992] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T18:33:43.825543] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-06T18:33:44.625502] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-06T18:33:44.796202] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T18:33:45.425534] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-06T18:33:45.559345] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T18:33:46.225581] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-06T18:33:46.344728] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T18:33:47.016381] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T18:33:47.025734] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-06T18:33:47.825565] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-06T18:33:48.219826] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-06T18:33:48.223140] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57706 records). [2025-10-06T18:33:48.223282] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-06T18:33:48.664091] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-06T18:33:48.646574] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-06T18:33:48.666040] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-06T18:33:48.667751] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-06T18:33:48.676875] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-06T18:33:48.692671] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T18:33:48.702587] [DEBUG] [LOCAL ] DXYZ: Trimmed 57706 records to 36973 (keeping 200 days of data) [2025-10-06T18:33:48.973727] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36973 records). [2025-10-06T18:33:48.974113] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-06T18:33:48.974309] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DXYZ took 35.5s. Estimated remaining: 3h 56m 32s. Rate: 7.2 symbols/min [2025-10-06T18:33:49.201943] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:33:49.202278] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-10-06T18:33:49.202492] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-10-06T18:33:49.202769] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-06T18:33:49.202817] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-06T18:33:49.202862] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-06T18:33:49.202992] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-06T18:33:49.387995] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T18:33:49.447583] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-06T18:33:49.703309] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:33:49.957600] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-06T18:33:50.225542] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-06T18:33:50.900721] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T18:33:51.025593] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-06T18:33:51.600057] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T18:33:51.825519] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-06T18:33:52.630679] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-06T18:33:52.653246] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T18:33:53.375493] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T18:33:53.425479] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-06T18:33:53.731749] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T18:33:54.225556] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-06T18:33:55.026145] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T18:33:55.026220] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-06T18:33:55.641867] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T18:33:55.825503] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-06T18:33:56.048458] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T18:33:56.625593] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-06T18:33:57.218617] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T18:33:57.425597] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-06T18:33:58.225583] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-06T18:33:58.314023] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T18:33:58.804789] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T18:33:58.835866] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T18:33:59.025537] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-06T18:33:59.825505] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-06T18:34:00.625556] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-06T18:34:00.789293] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T18:34:01.084797] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T18:34:01.086941] [INFO ] [REMOTE ] E: Full fetch complete (47929 records). [2025-10-06T18:34:01.087081] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-06T18:34:01.088045] [FATAL] [VALIDATOR ] E: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:34:01.088149] [FATAL] [MAIN ] E: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:34:01.088218] [WARN ] [MAIN ] E: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:34:01.088284] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-06T18:34:01.088370] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-10-06T18:34:01.088408] [INFO ] [LOCAL ] E: Starting deletion of derivative data. [2025-10-06T18:34:01.088449] [DEBUG] [LOCAL ] E: No derivative data file found to delete. [2025-10-06T18:34:01.088508] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. E took 24.5s. Estimated remaining: 3h 56m 33s. Rate: 7.2 symbols/min [2025-10-06T18:34:01.196668] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T18:34:01.266359] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:34:01.297144] [DEBUG] [LOCAL ] EARN: Loaded 30021 existing records from primary storage. [2025-10-06T18:34:01.297482] [INFO ] [MAIN ] EARN: Loaded 30021 existing records. [2025-10-06T18:34:01.440424] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-06T18:34:01.480867] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:34:01.481099] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-06T18:34:01.481147] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-06T18:34:01.481450] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-06T18:34:01.481510] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-06T18:34:01.867879] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:34:02.225546] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-06T18:34:02.740146] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-06T18:34:03.025552] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-06T18:34:03.825543] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-06T18:34:04.034687] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T18:34:04.514912] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-06T18:34:04.514622] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T18:34:04.625606] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-06T18:34:05.425601] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-06T18:34:05.945399] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T18:34:06.225551] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-06T18:34:07.025485] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-06T18:34:07.275686] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T18:34:07.586977] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-06T18:34:07.654027] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-06T18:34:07.825547] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-06T18:34:08.625561] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-06T18:34:09.425587] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-06T18:34:09.872489] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-06T18:34:10.000944] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T18:34:10.225603] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-06T18:34:10.445227] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T18:34:11.025486] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-06T18:34:11.502842] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T18:34:11.506694] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-06T18:34:11.825537] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-06T18:34:12.625554] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-06T18:34:13.106495] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-06T18:34:13.416139] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T18:34:13.425468] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-06T18:34:14.225597] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-06T18:34:14.876313] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T18:34:15.025558] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-06T18:34:15.811016] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T18:34:15.830572] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-06T18:34:15.839782] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-06T18:34:16.567349] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-06T18:34:16.625586] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-06T18:34:17.146512] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T18:34:17.147418] [INFO ] [REMOTE ] EAI: Full fetch complete (6167 records). [2025-10-06T18:34:17.147492] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-06T18:34:17.427676] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-06T18:34:17.513516] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-06T18:34:17.513623] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-06T18:34:17.513874] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-06T18:34:17.513947] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-06T18:34:17.514353] [DEBUG] [LOCAL ] EAI: Trimmed 6167 records to 3998 (keeping 200 days of data) [2025-10-06T18:34:17.539082] [DEBUG] [LOCAL ] EAI: Primary data saved (3998 records). [2025-10-06T18:34:17.539191] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-06T18:34:17.539260] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. EAI took 28.6s. Estimated remaining: 3h 56m 45s. Rate: 7.2 symbols/min [2025-10-06T18:34:17.704480] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:34:17.704721] [DEBUG] [LOCAL ] EAT: No existing data file found in primary storage. [2025-10-06T18:34:17.704771] [WARN ] [MAIN ] EAT: No existing data found, performing full refresh instead. [2025-10-06T18:34:17.704883] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-06T18:34:17.704923] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-06T18:34:17.704962] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-06T18:34:17.704993] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-06T18:34:18.068445] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:34:18.225529] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-06T18:34:18.438714] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T18:34:18.440201] [INFO ] [REMOTE ] DY: Full fetch complete (43996 records). [2025-10-06T18:34:18.440280] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-06T18:34:18.440827] [FATAL] [VALIDATOR ] DY: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:34:18.440913] [FATAL] [MAIN ] DY: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:34:18.441044] [WARN ] [MAIN ] DY: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:34:18.441108] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-06T18:34:18.441174] [DEBUG] [LOCAL ] DY: No primary data file found to delete. [2025-10-06T18:34:18.441209] [INFO ] [LOCAL ] DY: Starting deletion of derivative data. [2025-10-06T18:34:18.441487] [DEBUG] [LOCAL ] DY: Deleted derivative data file. [2025-10-06T18:34:18.441578] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. DY took 44.8s. Estimated remaining: 3h 56m 18s. Rate: 7.2 symbols/min [2025-10-06T18:34:18.608518] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:34:18.644770] [DEBUG] [LOCAL ] EB: Loaded 37650 existing records from primary storage. [2025-10-06T18:34:18.645086] [INFO ] [MAIN ] EB: Loaded 37650 existing records. [2025-10-06T18:34:18.820574] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:34:18.820880] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-06T18:34:18.820941] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-06T18:34:18.821238] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-06T18:34:18.821316] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-06T18:34:19.030990] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-06T18:34:19.179929] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:34:19.825546] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-06T18:34:20.254077] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-06T18:34:20.288927] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T18:34:20.625532] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-06T18:34:21.314633] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T18:34:21.425529] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-06T18:34:22.225522] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-06T18:34:22.443760] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T18:34:22.509581] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T18:34:23.025589] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-06T18:34:23.438852] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T18:34:23.825540] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-06T18:34:24.548198] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T18:34:24.625477] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-06T18:34:25.425501] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-06T18:34:25.593703] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T18:34:26.225553] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-06T18:34:26.236393] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T18:34:26.740202] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T18:34:27.025492] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-06T18:34:27.516921] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-06T18:34:27.825548] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-06T18:34:28.102745] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T18:34:28.104808] [INFO ] [REMOTE ] EAF: Full fetch complete (63374 records). [2025-10-06T18:34:28.105052] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-06T18:34:28.500416] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-06T18:34:28.500543] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-06T18:34:28.501451] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-06T18:34:28.501543] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-06T18:34:28.503166] [DEBUG] [LOCAL ] EAF: Trimmed 63374 records to 42328 (keeping 200 days of data) [2025-10-06T18:34:28.667042] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-06T18:34:28.757030] [DEBUG] [LOCAL ] EAF: Primary data saved (42328 records). [2025-10-06T18:34:28.757179] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-06T18:34:28.757281] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EAF took 47.2s. Estimated remaining: 3h 56m 14s. Rate: 7.2 symbols/min [2025-10-06T18:34:28.847368] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T18:34:28.849109] [INFO ] [REMOTE ] EARN: Full fetch complete (45598 records). [2025-10-06T18:34:28.849200] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-06T18:34:28.849729] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:34:28.849813] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:34:28.849984] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:34:28.850074] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-06T18:34:28.850167] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-06T18:34:28.850245] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-10-06T18:34:28.850515] [DEBUG] [LOCAL ] EARN: Deleted derivative data file. [2025-10-06T18:34:28.850612] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EARN took 27.8s. Estimated remaining: 3h 55m 45s. Rate: 7.2 symbols/min [2025-10-06T18:34:29.425582] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-06T18:34:30.250960] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T18:34:30.260230] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-06T18:34:31.131954] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T18:34:31.143097] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-06T18:34:31.736160] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T18:34:31.825560] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-06T18:34:33.197362] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-06T18:34:33.208595] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-06T18:34:33.273427] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T18:34:33.425525] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-06T18:34:34.988854] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T18:34:34.999189] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-06T18:34:35.034023] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T18:34:35.047190] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-06T18:34:36.416738] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T18:34:36.425268] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-06T18:34:36.671596] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T18:34:36.682026] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-06T18:34:37.814239] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T18:34:37.821474] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-06T18:34:38.460372] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T18:34:38.471743] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-06T18:34:38.982707] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T18:34:38.984893] [INFO ] [REMOTE ] EB: Full fetch complete (56000 records). [2025-10-06T18:34:38.985005] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-06T18:34:39.384159] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-06T18:34:39.384284] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-06T18:34:39.385459] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-06T18:34:39.385552] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-06T18:34:39.387486] [DEBUG] [LOCAL ] EB: Trimmed 56000 records to 36985 (keeping 200 days of data) [2025-10-06T18:34:39.618068] [DEBUG] [LOCAL ] EB: Primary data saved (36985 records). [2025-10-06T18:34:39.618316] [INFO ] [MAIN ] EB: Full history saved. [2025-10-06T18:34:39.618466] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EB took 21.2s. Estimated remaining: 3h 55m 43s. Rate: 7.2 symbols/min [2025-10-06T18:34:40.108054] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T18:34:40.118480] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-06T18:34:41.863947] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T18:34:41.875627] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-06T18:34:43.652096] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-06T18:34:43.655673] [INFO ] [REMOTE ] EAT: Full fetch complete (72072 records). [2025-10-06T18:34:43.655825] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-06T18:34:44.100278] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-06T18:34:44.100401] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-06T18:34:44.101819] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-06T18:34:44.101899] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-06T18:34:44.103905] [DEBUG] [LOCAL ] EAT: Trimmed 72072 records to 49806 (keeping 200 days of data) [2025-10-06T18:34:44.428168] [DEBUG] [LOCAL ] EAT: Primary data saved (49806 records). [2025-10-06T18:34:44.428350] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-06T18:34:44.428446] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EAT took 26.9s. Estimated remaining: 3h 55m 26s. Rate: 7.2 symbols/min [2025-10-06T18:34:45.174414] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:34:45.165212] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:34:45.234116] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:34:45.239239] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:34:45.263199] [DEBUG] [LOCAL ] EBF: Loaded 19506 existing records from primary storage. [2025-10-06T18:34:45.263747] [INFO ] [MAIN ] EBF: Loaded 19506 existing records. [2025-10-06T18:34:45.535063] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:34:45.551566] [DEBUG] [LOCAL ] EBR: Loaded 43694 existing records from primary storage. [2025-10-06T18:34:45.552282] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-06T18:34:45.553346] [DEBUG] [LOCAL ] EC: Loaded 49923 existing records from primary storage. [2025-10-06T18:34:45.554242] [DEBUG] [LOCAL ] EBS: Loaded 47245 existing records from primary storage. [2025-10-06T18:34:45.555125] [INFO ] [MAIN ] EBS: Loaded 47245 existing records. [2025-10-06T18:34:45.560500] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-06T18:34:45.554604] [INFO ] [MAIN ] EBR: Loaded 43694 existing records. [2025-10-06T18:34:45.566297] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-06T18:34:45.572789] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-06T18:34:45.560877] [INFO ] [MAIN ] EC: Loaded 49923 existing records. [2025-10-06T18:34:46.376938] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:34:46.356543] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:34:46.396229] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:34:46.410486] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-06T18:34:46.421086] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-06T18:34:46.421222] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-06T18:34:46.421367] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-06T18:34:46.439821] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-06T18:34:46.480666] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-06T18:34:46.470164] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-06T18:34:46.470023] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-06T18:34:46.494282] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-06T18:34:46.494504] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-06T18:34:46.499952] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-06T18:34:46.512819] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-06T18:34:46.810007] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:34:46.857820] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-06T18:34:47.671105] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:34:47.703550] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-06T18:34:47.772419] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:34:47.789704] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-06T18:34:47.796129] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:34:47.797529] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-06T18:34:48.311674] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T18:34:48.315448] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-06T18:34:49.282435] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T18:34:49.287441] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-06T18:34:49.594544] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T18:34:49.607867] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-06T18:34:49.833847] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-06T18:34:49.846217] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-06T18:34:49.985077] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-06T18:34:49.996470] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-06T18:34:50.364914] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T18:34:50.369923] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-06T18:34:51.054199] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T18:34:51.064259] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-06T18:34:51.198360] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-06T18:34:51.208256] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-06T18:34:51.506852] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T18:34:51.512823] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-06T18:34:51.735206] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T18:34:51.746140] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-06T18:34:52.193558] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T18:34:52.201802] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-06T18:34:52.658486] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T18:34:52.664014] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-06T18:34:52.814716] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T18:34:53.425497] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-06T18:34:53.452593] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T18:34:53.634843] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T18:34:53.777080] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T18:34:54.225531] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-06T18:34:55.025587] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-06T18:34:55.147971] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T18:34:55.724135] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-06T18:34:55.810958] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T18:34:55.825484] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-06T18:34:56.625545] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-06T18:34:57.371204] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T18:34:57.425537] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-06T18:34:57.756046] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T18:34:58.225528] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-06T18:34:59.030667] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-06T18:34:59.051546] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T18:34:59.835859] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-06T18:34:59.839713] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T18:35:00.625551] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-06T18:35:00.776913] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T18:35:00.982883] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-06T18:35:01.425601] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-06T18:35:02.229500] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-06T18:35:02.237371] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T18:35:03.025505] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-06T18:35:03.324860] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T18:35:03.607232] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-06T18:35:03.825538] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-06T18:35:04.625488] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-06T18:35:05.042180] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-06T18:35:05.425506] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-06T18:35:05.865635] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T18:35:05.891213] [INFO ] [REMOTE ] EBF: Full fetch complete (27535 records). [2025-10-06T18:35:05.902424] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-06T18:35:05.905731] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-06T18:35:06.230761] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-06T18:35:06.299633] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-06T18:35:06.299766] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-06T18:35:06.300217] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-06T18:35:06.300262] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-06T18:35:06.300964] [DEBUG] [LOCAL ] EBF: Trimmed 27535 records to 19101 (keeping 200 days of data) [2025-10-06T18:35:06.417514] [DEBUG] [LOCAL ] EBF: Primary data saved (19101 records). [2025-10-06T18:35:06.417706] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-06T18:35:06.417822] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 22.0s. Estimated remaining: 3h 55m 51s. Rate: 7.2 symbols/min [2025-10-06T18:35:06.587593] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:35:06.620298] [DEBUG] [LOCAL ] ECAT: Loaded 29940 existing records from primary storage. [2025-10-06T18:35:06.620590] [INFO ] [MAIN ] ECAT: Loaded 29940 existing records. [2025-10-06T18:35:06.802209] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:35:06.802711] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-06T18:35:06.802835] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-06T18:35:06.803107] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-06T18:35:06.803165] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-06T18:35:07.044856] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-06T18:35:07.140816] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T18:35:07.203741] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:35:07.825507] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-06T18:35:08.159382] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-06T18:35:08.259013] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T18:35:08.625630] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-06T18:35:09.024912] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T18:35:09.425542] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-06T18:35:10.002565] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T18:35:10.225486] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-06T18:35:10.888233] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T18:35:10.891396] [INFO ] [REMOTE ] EBR: Full fetch complete (62561 records). [2025-10-06T18:35:10.891583] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-06T18:35:11.034828] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-06T18:35:11.290488] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-06T18:35:11.290590] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-06T18:35:11.291412] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-06T18:35:11.291493] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-06T18:35:11.292970] [DEBUG] [LOCAL ] EBR: Trimmed 62561 records to 43038 (keeping 200 days of data) [2025-10-06T18:35:11.548791] [DEBUG] [LOCAL ] EBR: Primary data saved (43038 records). [2025-10-06T18:35:11.548944] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-06T18:35:11.549033] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EBR took 27.1s. Estimated remaining: 3h 55m 35s. Rate: 7.2 symbols/min [2025-10-06T18:35:11.723620] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:35:11.764041] [DEBUG] [LOCAL ] ECC: Loaded 43966 existing records from primary storage. [2025-10-06T18:35:11.764373] [INFO ] [MAIN ] ECC: Loaded 43966 existing records. [2025-10-06T18:35:11.828088] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-06T18:35:11.945455] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:35:11.945742] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-06T18:35:11.945795] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-06T18:35:11.946069] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-06T18:35:11.946127] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-06T18:35:12.349116] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:35:12.351230] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-06T18:35:12.377828] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T18:35:12.625577] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-06T18:35:13.425604] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-06T18:35:14.127285] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-06T18:35:14.225596] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-06T18:35:14.267957] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T18:35:15.025555] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-06T18:35:15.411188] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-06T18:35:15.466819] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T18:35:15.825546] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-06T18:35:16.259126] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T18:35:16.625538] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-06T18:35:17.431221] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-06T18:35:17.435762] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T18:35:18.195869] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T18:35:18.225483] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-06T18:35:18.779473] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T18:35:19.025590] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-06T18:35:19.825499] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-06T18:35:19.917106] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T18:35:20.355976] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T18:35:20.625518] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-06T18:35:21.425565] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-06T18:35:21.522831] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T18:35:22.225502] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-06T18:35:22.391916] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T18:35:22.743514] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T18:35:22.745895] [INFO ] [REMOTE ] EBS: Full fetch complete (66977 records). [2025-10-06T18:35:22.746024] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-06T18:35:22.746700] [FATAL] [VALIDATOR ] EBS: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:35:22.746786] [FATAL] [MAIN ] EBS: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:35:22.746832] [WARN ] [MAIN ] EBS: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:35:22.746907] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-06T18:35:22.747018] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-06T18:35:22.747084] [INFO ] [LOCAL ] EBS: Starting deletion of derivative data. [2025-10-06T18:35:22.747432] [DEBUG] [LOCAL ] EBS: Deleted derivative data file. [2025-10-06T18:35:22.747573] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBS took 38.3s. Estimated remaining: 3h 55m 33s. Rate: 7.2 symbols/min [2025-10-06T18:35:22.916385] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:35:22.916624] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-06T18:35:22.916701] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-06T18:35:22.916819] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-06T18:35:22.916859] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-06T18:35:22.916909] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-06T18:35:22.916974] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-06T18:35:23.030731] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-06T18:35:23.284796] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:35:23.490683] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T18:35:23.493147] [INFO ] [REMOTE ] EC: Full fetch complete (71548 records). [2025-10-06T18:35:23.493274] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-06T18:35:23.493973] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:35:23.494062] [FATAL] [MAIN ] EC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:35:23.494104] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:35:23.494195] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-06T18:35:23.494264] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-06T18:35:23.494298] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-10-06T18:35:23.494476] [DEBUG] [LOCAL ] EC: Deleted derivative data file. [2025-10-06T18:35:23.494571] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EC took 39.1s. Estimated remaining: 3h 55m 6s. Rate: 7.2 symbols/min [2025-10-06T18:35:23.660628] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:35:23.660889] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-06T18:35:23.660929] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-06T18:35:23.661041] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-06T18:35:23.661083] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-06T18:35:23.661122] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-06T18:35:23.661151] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-06T18:35:23.837710] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-06T18:35:24.013792] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:35:24.625478] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-06T18:35:25.118414] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-06T18:35:25.238798] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T18:35:25.247785] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-06T18:35:25.425503] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-06T18:35:26.008043] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-06T18:35:26.225546] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-06T18:35:27.025488] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-06T18:35:27.256238] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T18:35:27.825553] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-06T18:35:28.201639] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T18:35:28.336551] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-06T18:35:28.625542] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-06T18:35:28.958847] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-06T18:35:29.425547] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-06T18:35:29.992998] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T18:35:30.225572] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-06T18:35:30.788244] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-06T18:35:31.025560] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-06T18:35:31.345814] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-06T18:35:31.825544] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-06T18:35:32.153360] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-06T18:35:32.625553] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-06T18:35:33.425570] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-06T18:35:34.225511] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-06T18:35:34.274678] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T18:35:34.529999] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T18:35:34.684146] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-06T18:35:35.025549] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-06T18:35:35.825560] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-06T18:35:36.346477] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-06T18:35:36.368968] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T18:35:36.625525] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-06T18:35:37.143102] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-06T18:35:37.425564] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-06T18:35:38.225552] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-06T18:35:38.632336] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-06T18:35:38.753192] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T18:35:39.025587] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-06T18:35:39.825564] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-06T18:35:40.246742] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-06T18:35:40.625560] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-06T18:35:40.786618] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T18:35:40.975687] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-06T18:35:41.425617] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-06T18:35:41.858026] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T18:35:42.225602] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-06T18:35:42.564190] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-06T18:35:43.025603] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-06T18:35:43.825559] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-06T18:35:44.625502] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-06T18:35:44.731943] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T18:35:45.050267] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-06T18:35:45.080265] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T18:35:45.081863] [INFO ] [REMOTE ] ECAT: Full fetch complete (42747 records). [2025-10-06T18:35:45.081942] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-06T18:35:45.082436] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:35:45.082519] [FATAL] [MAIN ] ECAT: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:35:45.082561] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:35:45.082600] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-06T18:35:45.082684] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-06T18:35:45.082738] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-10-06T18:35:45.083001] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-10-06T18:35:45.083098] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECAT took 38.7s. Estimated remaining: 3h 55m 30s. Rate: 7.2 symbols/min [2025-10-06T18:35:45.250593] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:35:45.250824] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-06T18:35:45.250870] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-06T18:35:45.250983] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-06T18:35:45.251022] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-06T18:35:45.251074] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-06T18:35:45.251144] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-06T18:35:45.435278] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-06T18:35:45.612366] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:35:45.902940] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T18:35:45.903677] [INFO ] [REMOTE ] ECCU: Full fetch complete (4496 records). [2025-10-06T18:35:45.903749] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-06T18:35:46.095334] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T18:35:46.095632] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:35:46.095757] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:35:46.095858] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-06T18:35:46.095940] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-06T18:35:46.095978] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-06T18:35:46.096018] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-10-06T18:35:46.096099] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECCU took 22.6s. Estimated remaining: 3h 55m 4s. Rate: 7.2 symbols/min [2025-10-06T18:35:46.226735] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-06T18:35:46.300325] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:35:46.300488] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-06T18:35:46.300524] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-06T18:35:46.300634] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-06T18:35:46.300713] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-06T18:35:46.300760] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-06T18:35:46.300792] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-06T18:35:46.650067] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:35:46.907740] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-06T18:35:47.025731] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-06T18:35:47.500310] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-06T18:35:47.825553] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-06T18:35:48.461776] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-06T18:35:48.625497] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-06T18:35:49.094360] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-06T18:35:49.425540] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-06T18:35:50.225539] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-06T18:35:50.552214] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-06T18:35:51.025514] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-06T18:35:51.172363] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T18:35:51.424540] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-06T18:35:51.825745] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-06T18:35:52.155995] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-06T18:35:52.625547] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-06T18:35:53.075792] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-06T18:35:53.425549] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-06T18:35:53.863788] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-06T18:35:54.225550] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-06T18:35:54.570511] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-06T18:35:55.025532] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-06T18:35:55.346713] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-06T18:35:55.825529] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-06T18:35:56.246286] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-06T18:35:56.247075] [INFO ] [REMOTE ] ECCC: Full fetch complete (1303 records). [2025-10-06T18:35:56.247144] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-06T18:35:56.442206] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-06T18:35:56.442445] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:35:56.442515] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:35:56.442668] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-06T18:35:56.442757] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-06T18:35:56.442796] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-06T18:35:56.442839] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-06T18:35:56.442904] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCC took 33.7s. Estimated remaining: 3h 55m 0s. Rate: 7.2 symbols/min [2025-10-06T18:35:56.622257] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:35:56.625501] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-06T18:35:56.665569] [DEBUG] [LOCAL ] ECG: Loaded 34260 existing records from primary storage. [2025-10-06T18:35:56.666024] [INFO ] [MAIN ] ECG: Loaded 34260 existing records. [2025-10-06T18:35:56.842440] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:35:56.842719] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-06T18:35:56.842777] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-06T18:35:56.843104] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-06T18:35:56.843163] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-06T18:35:57.111718] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-06T18:35:57.202356] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:35:57.425538] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-06T18:35:57.847318] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-06T18:35:58.225537] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-06T18:35:58.556246] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-06T18:35:59.025546] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-06T18:35:59.825547] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-06T18:36:00.235971] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-06T18:36:00.607514] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T18:36:00.625480] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-06T18:36:01.425580] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-06T18:36:01.860067] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T18:36:02.225494] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-06T18:36:02.405129] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T18:36:02.579215] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-06T18:36:03.025567] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-06T18:36:03.825546] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-06T18:36:04.261035] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-06T18:36:04.625558] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-06T18:36:04.704949] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T18:36:04.933535] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-06T18:36:05.425583] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-06T18:36:06.225571] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-06T18:36:06.921993] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T18:36:07.025575] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-06T18:36:07.693295] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T18:36:07.696208] [INFO ] [REMOTE ] ECC: Full fetch complete (61012 records). [2025-10-06T18:36:07.696362] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-06T18:36:07.836143] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-06T18:36:08.096386] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-06T18:36:08.096510] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-06T18:36:08.097545] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-06T18:36:08.097669] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-06T18:36:08.099211] [DEBUG] [LOCAL ] ECC: Trimmed 61012 records to 43187 (keeping 200 days of data) [2025-10-06T18:36:08.303186] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T18:36:08.304265] [INFO ] [REMOTE ] ECCX: Full fetch complete (1509 records). [2025-10-06T18:36:08.304706] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-06T18:36:08.495201] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-06T18:36:08.496594] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:36:08.497693] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:36:08.498306] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-06T18:36:08.498776] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-06T18:36:08.499239] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-06T18:36:08.499354] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-06T18:36:08.500284] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCX took 22.4s. Estimated remaining: 3h 55m 1s. Rate: 7.2 symbols/min [2025-10-06T18:36:08.625486] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-06T18:36:08.714826] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:36:08.710967] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T18:36:08.759082] [DEBUG] [LOCAL ] ECC: Primary data saved (43187 records). [2025-10-06T18:36:08.759294] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-06T18:36:08.759869] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECC took 57.2s. Estimated remaining: 3h 54m 33s. Rate: 7.2 symbols/min [2025-10-06T18:36:08.971191] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:36:08.987369] [DEBUG] [LOCAL ] ECL: Loaded 47436 existing records from primary storage. [2025-10-06T18:36:08.987848] [INFO ] [MAIN ] ECL: Loaded 47436 existing records. [2025-10-06T18:36:09.174761] [DEBUG] [LOCAL ] ECO: Loaded 18643 existing records from primary storage. [2025-10-06T18:36:09.194014] [INFO ] [MAIN ] ECO: Loaded 18643 existing records. [2025-10-06T18:36:09.238662] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:36:09.275234] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-06T18:36:09.289286] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-06T18:36:09.303899] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-06T18:36:09.325003] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-06T18:36:09.327544] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-06T18:36:09.434451] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-06T18:36:09.511242] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:36:09.532370] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-06T18:36:09.551430] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-06T18:36:09.571962] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-06T18:36:09.580262] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-06T18:36:09.976631] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:36:09.996373] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T18:36:10.153970] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:36:10.225479] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-06T18:36:11.025596] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-06T18:36:11.357171] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-06T18:36:11.825547] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-06T18:36:11.928161] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T18:36:12.625553] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-06T18:36:13.282519] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T18:36:13.425555] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-06T18:36:14.225558] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-06T18:36:14.602888] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T18:36:14.603609] [INFO ] [REMOTE ] ECCW: Full fetch complete (1411 records). [2025-10-06T18:36:14.603728] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-06T18:36:14.793215] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-06T18:36:14.793590] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:36:14.793742] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:36:14.793876] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-06T18:36:14.794123] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-06T18:36:14.794258] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-06T18:36:14.794482] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-06T18:36:14.794675] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECCW took 29.7s. Estimated remaining: 3h 54m 19s. Rate: 7.2 symbols/min [2025-10-06T18:36:15.027758] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:36:15.026629] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-06T18:36:15.030973] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-06T18:36:15.043464] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T18:36:15.089157] [DEBUG] [LOCAL ] ECVT: Loaded 43747 existing records from primary storage. [2025-10-06T18:36:15.089560] [INFO ] [MAIN ] ECVT: Loaded 43747 existing records. [2025-10-06T18:36:15.292776] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:36:15.293060] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-06T18:36:15.293106] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-06T18:36:15.293343] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-06T18:36:15.293399] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-06T18:36:15.643260] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:36:15.825528] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-06T18:36:16.260933] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T18:36:16.625535] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-06T18:36:17.425506] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-06T18:36:17.458984] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T18:36:17.831956] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-06T18:36:18.225597] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-06T18:36:19.025502] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-06T18:36:19.123564] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T18:36:19.372394] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-06T18:36:19.825537] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-06T18:36:20.280609] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T18:36:20.625571] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-06T18:36:21.425553] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-06T18:36:21.530201] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T18:36:21.709288] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-06T18:36:22.225588] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-06T18:36:22.756764] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T18:36:23.025552] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-06T18:36:23.669391] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T18:36:23.825526] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-06T18:36:24.625565] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-06T18:36:24.789136] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T18:36:25.337563] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T18:36:25.425475] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-06T18:36:25.596238] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T18:36:26.225583] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-06T18:36:26.764566] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T18:36:27.025543] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-06T18:36:27.543714] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T18:36:27.825554] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-06T18:36:28.200549] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T18:36:28.625535] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-06T18:36:29.425492] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-06T18:36:29.718196] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T18:36:29.720256] [INFO ] [REMOTE ] ECG: Full fetch complete (51229 records). [2025-10-06T18:36:29.720349] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-06T18:36:30.046116] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-06T18:36:30.174287] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-06T18:36:30.174380] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-06T18:36:30.175115] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-06T18:36:30.175179] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-06T18:36:30.176280] [DEBUG] [LOCAL ] ECG: Trimmed 51229 records to 33612 (keeping 200 days of data) [2025-10-06T18:36:30.232383] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-06T18:36:30.378765] [DEBUG] [LOCAL ] ECG: Primary data saved (33612 records). [2025-10-06T18:36:30.378941] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-06T18:36:30.379035] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECG took 33.9s. Estimated remaining: 3h 54m 28s. Rate: 7.2 symbols/min [2025-10-06T18:36:30.553429] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:36:30.568184] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T18:36:30.631456] [DEBUG] [LOCAL ] ED: Loaded 53511 existing records from primary storage. [2025-10-06T18:36:30.631923] [INFO ] [MAIN ] ED: Loaded 53511 existing records. [2025-10-06T18:36:30.808764] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:36:30.809144] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-06T18:36:30.809205] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-06T18:36:30.809492] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-06T18:36:30.809549] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-06T18:36:31.033034] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-06T18:36:31.172481] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:36:31.816358] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T18:36:31.825462] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-06T18:36:31.865265] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T18:36:32.625573] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-06T18:36:32.962731] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T18:36:33.425545] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-06T18:36:34.225547] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-06T18:36:34.279740] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T18:36:34.483404] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T18:36:35.025524] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-06T18:36:35.708481] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T18:36:35.825549] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-06T18:36:36.625577] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-06T18:36:37.365593] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-06T18:36:37.425470] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-06T18:36:37.531123] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T18:36:37.896419] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-06T18:36:38.225554] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-06T18:36:39.025626] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-06T18:36:39.231956] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-06T18:36:39.303039] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T18:36:39.304456] [INFO ] [REMOTE ] ECO: Full fetch complete (28764 records). [2025-10-06T18:36:39.304538] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-06T18:36:39.668709] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-06T18:36:39.668805] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-06T18:36:39.669325] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-06T18:36:39.669364] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-06T18:36:39.670059] [DEBUG] [LOCAL ] ECO: Trimmed 28764 records to 18421 (keeping 200 days of data) [2025-10-06T18:36:39.786709] [DEBUG] [LOCAL ] ECO: Primary data saved (18421 records). [2025-10-06T18:36:39.786872] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-06T18:36:39.786962] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECO took 31.0s. Estimated remaining: 3h 54m 22s. Rate: 7.2 symbols/min [2025-10-06T18:36:39.830678] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-06T18:36:39.957086] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:36:39.988881] [DEBUG] [LOCAL ] EDD: Loaded 27540 existing records from primary storage. [2025-10-06T18:36:39.989170] [INFO ] [MAIN ] EDD: Loaded 27540 existing records. [2025-10-06T18:36:40.180406] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:36:40.180727] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-06T18:36:40.180794] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-06T18:36:40.181027] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-06T18:36:40.181084] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-06T18:36:40.542487] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:36:40.625502] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-06T18:36:40.738970] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T18:36:41.343395] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T18:36:41.425476] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-06T18:36:41.847699] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T18:36:42.225560] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-06T18:36:43.025584] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-06T18:36:43.212158] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T18:36:43.825502] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-06T18:36:43.867183] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T18:36:44.019774] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T18:36:44.625605] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-06T18:36:45.425551] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-06T18:36:45.660391] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T18:36:45.850548] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T18:36:46.225568] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-06T18:36:46.858055] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T18:36:46.860838] [INFO ] [REMOTE ] ECL: Full fetch complete (67716 records). [2025-10-06T18:36:46.861009] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-06T18:36:46.862055] [FATAL] [VALIDATOR ] ECL: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:36:46.862158] [FATAL] [MAIN ] ECL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:36:46.862202] [WARN ] [MAIN ] ECL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:36:46.862272] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-06T18:36:46.862362] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-10-06T18:36:46.862402] [INFO ] [LOCAL ] ECL: Starting deletion of derivative data. [2025-10-06T18:36:46.862631] [DEBUG] [LOCAL ] ECL: Deleted derivative data file. [2025-10-06T18:36:46.862764] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECL took 38.4s. Estimated remaining: 3h 54m 11s. Rate: 7.2 symbols/min [2025-10-06T18:36:47.028403] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-06T18:36:47.050493] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:36:47.070572] [DEBUG] [LOCAL ] EDF: Loaded 13491 existing records from primary storage. [2025-10-06T18:36:47.070930] [INFO ] [MAIN ] EDF: Loaded 13491 existing records. [2025-10-06T18:36:47.261631] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:36:47.261959] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-06T18:36:47.262011] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-06T18:36:47.262265] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-06T18:36:47.262323] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-06T18:36:47.409919] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T18:36:47.677065] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:36:47.825548] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-06T18:36:48.625529] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-06T18:36:48.953480] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-06T18:36:49.003000] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T18:36:49.425543] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-06T18:36:49.943250] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T18:36:50.225551] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-06T18:36:50.966194] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T18:36:51.025564] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-06T18:36:51.351079] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T18:36:51.783626] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-06T18:36:51.825575] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-06T18:36:52.625579] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-06T18:36:53.061221] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T18:36:53.425552] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-06T18:36:54.225552] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-06T18:36:54.348984] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T18:36:55.025536] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-06T18:36:55.327065] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T18:36:55.355342] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T18:36:55.825540] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-06T18:36:56.552043] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T18:36:56.625548] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-06T18:36:56.782299] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T18:36:57.425536] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-06T18:36:57.932014] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T18:36:58.225543] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-06T18:36:58.750201] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T18:36:59.025618] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-06T18:36:59.825488] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-06T18:37:00.190108] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T18:37:00.202293] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T18:37:00.625552] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-06T18:37:01.093163] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-06T18:37:01.425602] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-06T18:37:02.225621] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-06T18:37:02.547216] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-06T18:37:02.828596] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-06T18:37:02.891333] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T18:37:02.894206] [INFO ] [REMOTE ] ECVT: Full fetch complete (60246 records). [2025-10-06T18:37:02.894423] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-06T18:37:03.033195] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-06T18:37:03.276095] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-06T18:37:03.276184] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-06T18:37:03.276943] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-06T18:37:03.277024] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-06T18:37:03.278230] [DEBUG] [LOCAL ] ECVT: Trimmed 60246 records to 43195 (keeping 200 days of data) [2025-10-06T18:37:03.526188] [DEBUG] [LOCAL ] ECVT: Primary data saved (43195 records). [2025-10-06T18:37:03.526368] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-06T18:37:03.526490] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECVT took 48.7s. Estimated remaining: 3h 54m 22s. Rate: 7.2 symbols/min [2025-10-06T18:37:03.699505] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:37:03.718373] [DEBUG] [LOCAL ] EDN: Loaded 18464 existing records from primary storage. [2025-10-06T18:37:03.718669] [INFO ] [MAIN ] EDN: Loaded 18464 existing records. [2025-10-06T18:37:03.830732] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-06T18:37:03.903191] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:37:03.903684] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-06T18:37:03.903817] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-06T18:37:03.904088] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-06T18:37:03.904145] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-06T18:37:04.162487] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T18:37:04.293568] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:37:04.625611] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-06T18:37:05.431760] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-06T18:37:05.432765] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-06T18:37:05.436950] [INFO ] [REMOTE ] ED: Full fetch complete (76319 records). [2025-10-06T18:37:05.437087] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-06T18:37:05.835369] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-06T18:37:05.835468] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-06T18:37:05.836371] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-06T18:37:05.836436] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-06T18:37:05.837993] [DEBUG] [LOCAL ] ED: Trimmed 76319 records to 52735 (keeping 200 days of data) [2025-10-06T18:37:06.205920] [DEBUG] [LOCAL ] ED: Primary data saved (52735 records). [2025-10-06T18:37:06.206143] [INFO ] [MAIN ] ED: Full history saved. [2025-10-06T18:37:06.207577] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. ED took 35.8s. Estimated remaining: 3h 54m 0s. Rate: 7.2 symbols/min [2025-10-06T18:37:06.242980] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-06T18:37:06.336487] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T18:37:06.441298] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-06T18:37:06.445426] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:37:06.506233] [DEBUG] [LOCAL ] EDU: Loaded 45595 existing records from primary storage. [2025-10-06T18:37:06.506735] [INFO ] [MAIN ] EDU: Loaded 45595 existing records. [2025-10-06T18:37:06.711783] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:37:06.712139] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-06T18:37:06.712203] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-06T18:37:06.712521] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-06T18:37:06.712584] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-06T18:37:07.030789] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-06T18:37:07.112805] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:37:07.618665] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T18:37:07.620505] [INFO ] [REMOTE ] EDD: Full fetch complete (38803 records). [2025-10-06T18:37:07.620591] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-06T18:37:07.837253] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-06T18:37:08.002227] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-06T18:37:08.002346] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-06T18:37:08.003101] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-06T18:37:08.003223] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-06T18:37:08.004620] [DEBUG] [LOCAL ] EDD: Trimmed 38803 records to 27034 (keeping 200 days of data) [2025-10-06T18:37:08.103254] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T18:37:08.187592] [DEBUG] [LOCAL ] EDD: Primary data saved (27034 records). [2025-10-06T18:37:08.187774] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-06T18:37:08.187866] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. EDD took 28.4s. Estimated remaining: 3h 53m 36s. Rate: 7.2 symbols/min [2025-10-06T18:37:08.352741] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:37:08.352944] [DEBUG] [LOCAL ] EE: No existing data file found in primary storage. [2025-10-06T18:37:08.352998] [WARN ] [MAIN ] EE: No existing data found, performing full refresh instead. [2025-10-06T18:37:08.353108] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-06T18:37:08.353148] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-06T18:37:08.353188] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-06T18:37:08.353221] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-06T18:37:08.514720] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-06T18:37:08.630766] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-06T18:37:08.728150] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:37:09.425560] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-06T18:37:10.225510] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-06T18:37:10.407793] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T18:37:10.467240] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T18:37:11.025577] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-06T18:37:11.812134] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T18:37:11.825472] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-06T18:37:11.871393] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T18:37:12.625556] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-06T18:37:12.964673] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T18:37:13.425548] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-06T18:37:13.697001] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T18:37:14.225544] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-06T18:37:14.908601] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-06T18:37:15.025553] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-06T18:37:15.343944] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T18:37:15.825536] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-06T18:37:16.078918] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T18:37:16.625560] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-06T18:37:17.425512] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-06T18:37:17.524773] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T18:37:17.891911] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T18:37:18.225503] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-06T18:37:18.569150] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T18:37:18.801069] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-06T18:37:19.025537] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-06T18:37:19.825533] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-06T18:37:20.550290] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T18:37:20.625498] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-06T18:37:20.751894] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T18:37:20.753242] [INFO ] [REMOTE ] EDF: Full fetch complete (20711 records). [2025-10-06T18:37:20.753343] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-06T18:37:21.168546] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-06T18:37:21.168664] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-06T18:37:21.169271] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-06T18:37:21.169314] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-06T18:37:21.170150] [DEBUG] [LOCAL ] EDF: Trimmed 20711 records to 13267 (keeping 200 days of data) [2025-10-06T18:37:21.252588] [DEBUG] [LOCAL ] EDF: Primary data saved (13267 records). [2025-10-06T18:37:21.252793] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-06T18:37:21.252896] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. EDF took 34.4s. Estimated remaining: 3h 53m 39s. Rate: 7.2 symbols/min [2025-10-06T18:37:21.432124] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-06T18:37:21.435899] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:37:21.437280] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-06T18:37:21.437401] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-06T18:37:21.437555] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-06T18:37:21.437626] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-06T18:37:21.437716] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-06T18:37:21.437757] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-06T18:37:21.842326] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:37:21.843980] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-06T18:37:22.225556] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-06T18:37:23.025501] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-06T18:37:23.068747] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T18:37:23.087793] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-06T18:37:23.825548] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-06T18:37:24.300160] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-06T18:37:24.625494] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-06T18:37:24.752363] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T18:37:25.425536] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-06T18:37:26.225516] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-06T18:37:26.389378] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T18:37:26.660682] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T18:37:26.663059] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-06T18:37:27.025547] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-06T18:37:27.648996] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T18:37:27.825550] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-06T18:37:28.395350] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-06T18:37:28.625570] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-06T18:37:29.425544] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-06T18:37:29.895587] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-06T18:37:30.225578] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-06T18:37:30.710802] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-06T18:37:30.872093] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T18:37:31.025564] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-06T18:37:31.825523] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-06T18:37:32.310290] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-06T18:37:32.434514] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T18:37:32.625547] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-06T18:37:33.211548] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T18:37:33.425585] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-06T18:37:34.225594] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-06T18:37:34.987790] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T18:37:35.025548] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-06T18:37:35.331020] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T18:37:35.825534] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-06T18:37:36.614303] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T18:37:36.625459] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-06T18:37:36.820390] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T18:37:37.425570] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-06T18:37:37.935509] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-06T18:37:38.225544] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-06T18:37:38.427323] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T18:37:38.717176] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-06T18:37:39.025543] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-06T18:37:39.825556] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-06T18:37:40.585978] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T18:37:40.625483] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-06T18:37:41.151377] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T18:37:41.425530] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-06T18:37:42.074418] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T18:37:42.077621] [INFO ] [REMOTE ] EDU: Full fetch complete (66485 records). [2025-10-06T18:37:42.077791] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-06T18:37:42.235123] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-06T18:37:42.387244] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T18:37:42.424549] [INFO ] [REMOTE ] EE: Full fetch complete (43656 records). [2025-10-06T18:37:42.445721] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-06T18:37:42.655733] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-06T18:37:42.661722] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-06T18:37:42.670020] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-06T18:37:42.690261] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-06T18:37:42.752006] [DEBUG] [LOCAL ] EDU: Trimmed 66485 records to 44860 (keeping 200 days of data) [2025-10-06T18:37:43.027996] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-06T18:37:43.214928] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-06T18:37:43.215157] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-06T18:37:43.216917] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-06T18:37:43.277924] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-06T18:37:43.310726] [DEBUG] [LOCAL ] EE: Trimmed 43656 records to 32610 (keeping 200 days of data) [2025-10-06T18:37:43.519915] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T18:37:43.534258] [DEBUG] [LOCAL ] EDU: Primary data saved (44860 records). [2025-10-06T18:37:43.535906] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-06T18:37:43.536817] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDU took 37.3s. Estimated remaining: 3h 54m 4s. Rate: 7.1 symbols/min [2025-10-06T18:37:43.581173] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-06T18:37:43.796513] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:37:43.797890] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-10-06T18:37:43.797973] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-10-06T18:37:43.799109] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-06T18:37:43.799498] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-06T18:37:43.800498] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-06T18:37:43.800863] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-06T18:37:43.831023] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-06T18:37:44.228357] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:37:44.234509] [DEBUG] [LOCAL ] EE: Primary data saved (32610 records). [2025-10-06T18:37:44.234681] [INFO ] [MAIN ] EE: Full history saved. [2025-10-06T18:37:44.234831] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EE took 36.0s. Estimated remaining: 3h 53m 37s. Rate: 7.2 symbols/min [2025-10-06T18:37:44.496225] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:37:44.555137] [DEBUG] [LOCAL ] EFC: Loaded 46894 existing records from primary storage. [2025-10-06T18:37:44.555693] [INFO ] [MAIN ] EFC: Loaded 46894 existing records. [2025-10-06T18:37:44.627553] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-06T18:37:44.854781] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:37:44.861696] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T18:37:44.861921] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-06T18:37:44.862021] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-06T18:37:44.864572] [INFO ] [REMOTE ] EDN: Full fetch complete (29882 records). [2025-10-06T18:37:44.864717] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-06T18:37:44.864999] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-06T18:37:44.919750] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-06T18:37:45.154860] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T18:37:45.198469] [INFO ] [REMOTE ] EEA: Full fetch complete (3893 records). [2025-10-06T18:37:45.258713] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-06T18:37:45.438913] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-06T18:37:46.055064] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-06T18:37:46.046570] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T18:37:46.067697] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-06T18:37:46.067890] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:37:46.078801] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:37:46.084702] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-06T18:37:46.095296] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-06T18:37:46.114146] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-06T18:37:46.151524] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:37:46.152550] [DEBUG] [LOCAL ] EDN: Trimmed 29882 records to 18203 (keeping 200 days of data) [2025-10-06T18:37:46.152746] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-06T18:37:46.153137] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-06T18:37:46.153555] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-06T18:37:46.153734] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EEA took 24.9s. Estimated remaining: 3h 53m 14s. Rate: 7.2 symbols/min [2025-10-06T18:37:46.241308] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-06T18:37:46.428159] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:37:46.459129] [DEBUG] [LOCAL ] EDN: Primary data saved (18203 records). [2025-10-06T18:37:46.459362] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-06T18:37:46.459469] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EDN took 42.9s. Estimated remaining: 3h 52m 46s. Rate: 7.2 symbols/min [2025-10-06T18:37:46.532276] [DEBUG] [LOCAL ] EFR: Loaded 14886 existing records from primary storage. [2025-10-06T18:37:46.570371] [INFO ] [MAIN ] EFR: Loaded 14886 existing records. [2025-10-06T18:37:46.743773] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:37:46.810044] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T18:37:46.841022] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:37:46.852613] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-06T18:37:46.852850] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-06T18:37:46.853184] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-06T18:37:46.853255] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-06T18:37:46.907185] [DEBUG] [LOCAL ] EFT: Loaded 13268 existing records from primary storage. [2025-10-06T18:37:46.934309] [INFO ] [MAIN ] EFT: Loaded 13268 existing records. [2025-10-06T18:37:47.028552] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-06T18:37:47.386450] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:37:47.426136] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-06T18:37:47.458575] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-06T18:37:47.458499] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:37:47.458975] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-06T18:37:47.459036] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-06T18:37:47.823180] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:37:47.825473] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-06T18:37:48.107240] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T18:37:48.213635] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-06T18:37:48.625607] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-06T18:37:48.996550] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T18:37:49.425539] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-06T18:37:49.520495] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T18:37:50.202214] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T18:37:50.225533] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-06T18:37:50.994788] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T18:37:51.025541] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-06T18:37:51.604771] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T18:37:51.825551] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-06T18:37:52.573610] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T18:37:52.625569] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-06T18:37:53.425722] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-06T18:37:54.184985] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T18:37:54.225870] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-06T18:37:54.229555] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T18:37:55.025535] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-06T18:37:55.299462] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T18:37:55.807540] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T18:37:55.825477] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-06T18:37:56.625549] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-06T18:37:56.872575] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-06T18:37:57.425577] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-06T18:37:58.179082] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T18:37:58.225541] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-06T18:37:58.294103] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T18:37:59.025607] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-06T18:37:59.825639] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-06T18:37:59.869550] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-06T18:37:59.968514] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T18:38:00.625497] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-06T18:38:00.701554] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T18:38:01.425590] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-06T18:38:02.225598] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-06T18:38:02.411964] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T18:38:02.517703] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T18:38:03.025587] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-06T18:38:03.351484] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T18:38:03.825559] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-06T18:38:04.014308] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T18:38:04.625512] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-06T18:38:05.425588] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-06T18:38:05.514706] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-06T18:38:05.579463] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T18:38:06.013788] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T18:38:06.225547] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-06T18:38:07.025562] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-06T18:38:07.045553] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T18:38:07.825566] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-06T18:38:08.073206] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-06T18:38:08.625566] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-06T18:38:09.429330] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-06T18:38:09.434679] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T18:38:09.718791] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T18:38:10.225554] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-06T18:38:10.241139] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T18:38:11.025583] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-06T18:38:11.825578] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-06T18:38:11.954914] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T18:38:12.213567] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T18:38:12.607036] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-06T18:38:12.625513] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-06T18:38:13.402984] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T18:38:13.404241] [INFO ] [REMOTE ] EFR: Full fetch complete (18969 records). [2025-10-06T18:38:13.404323] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-06T18:38:13.404877] [FATAL] [VALIDATOR ] EFR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:38:13.405050] [FATAL] [MAIN ] EFR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:38:13.405118] [WARN ] [MAIN ] EFR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:38:13.405197] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-06T18:38:13.405265] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-10-06T18:38:13.405300] [INFO ] [LOCAL ] EFR: Starting deletion of derivative data. [2025-10-06T18:38:13.405532] [DEBUG] [LOCAL ] EFR: Deleted derivative data file. [2025-10-06T18:38:13.405627] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EFR took 27.3s. Estimated remaining: 3h 53m 22s. Rate: 7.2 symbols/min [2025-10-06T18:38:13.430699] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-06T18:38:13.602389] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:38:13.602787] [DEBUG] [LOCAL ] EFX: No existing data file found in primary storage. [2025-10-06T18:38:13.602838] [WARN ] [MAIN ] EFX: No existing data found, performing full refresh instead. [2025-10-06T18:38:13.602986] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-06T18:38:13.603027] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-06T18:38:13.603072] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-10-06T18:38:13.603102] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-06T18:38:13.987826] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:38:14.225573] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-06T18:38:14.471218] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T18:38:15.025628] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-06T18:38:15.727528] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T18:38:15.813247] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-06T18:38:15.825493] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-06T18:38:16.625540] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-06T18:38:16.746919] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-06T18:38:17.425581] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-06T18:38:18.225557] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-06T18:38:18.273298] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-06T18:38:19.025596] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-06T18:38:19.046261] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T18:38:19.047745] [INFO ] [REMOTE ] EFT: Full fetch complete (17900 records). [2025-10-06T18:38:19.047826] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-06T18:38:19.048254] [FATAL] [VALIDATOR ] EFT: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:38:19.048503] [FATAL] [MAIN ] EFT: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:38:19.048572] [WARN ] [MAIN ] EFT: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:38:19.048692] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-06T18:38:19.048777] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-10-06T18:38:19.048813] [INFO ] [LOCAL ] EFT: Starting deletion of derivative data. [2025-10-06T18:38:19.049110] [DEBUG] [LOCAL ] EFT: Deleted derivative data file. [2025-10-06T18:38:19.049208] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFT took 32.6s. Estimated remaining: 3h 53m 7s. Rate: 7.2 symbols/min [2025-10-06T18:38:19.224591] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:38:19.257198] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T18:38:19.295475] [DEBUG] [LOCAL ] EFXT: Loaded 29657 existing records from primary storage. [2025-10-06T18:38:19.295894] [INFO ] [MAIN ] EFXT: Loaded 29657 existing records. [2025-10-06T18:38:19.485400] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:38:19.485851] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-06T18:38:19.485916] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-06T18:38:19.486214] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-06T18:38:19.486273] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-06T18:38:19.830738] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-06T18:38:19.863881] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:38:20.348012] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T18:38:20.625549] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-06T18:38:21.425539] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-06T18:38:21.844097] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-06T18:38:22.225507] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-06T18:38:22.322982] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T18:38:22.355319] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T18:38:23.025553] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-06T18:38:23.637937] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T18:38:23.638999] [INFO ] [REMOTE ] EEX: Full fetch complete (19126 records). [2025-10-06T18:38:23.639074] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-06T18:38:23.832584] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-06T18:38:24.044214] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-06T18:38:24.056856] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-06T18:38:24.056971] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-06T18:38:24.057829] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-06T18:38:24.057921] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-06T18:38:24.058072] [INFO ] [REMOTE ] EFC: Full fetch complete (66194 records). [2025-10-06T18:38:24.058734] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-06T18:38:24.059425] [DEBUG] [LOCAL ] EEX: Trimmed 19126 records to 11058 (keeping 200 days of data) [2025-10-06T18:38:24.060475] [FATAL] [VALIDATOR ] EFC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:38:24.061061] [FATAL] [MAIN ] EFC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:38:24.061137] [WARN ] [MAIN ] EFC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:38:24.061215] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-06T18:38:24.061301] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-06T18:38:24.061341] [INFO ] [LOCAL ] EFC: Starting deletion of derivative data. [2025-10-06T18:38:24.061896] [DEBUG] [LOCAL ] EFC: Deleted derivative data file. [2025-10-06T18:38:24.087765] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFC took 39.9s. Estimated remaining: 3h 52m 51s. Rate: 7.2 symbols/min [2025-10-06T18:38:24.304018] [DEBUG] [LOCAL ] EEX: Primary data saved (11058 records). [2025-10-06T18:38:24.305765] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-06T18:38:24.321880] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EEX took 40.8s. Estimated remaining: 3h 52m 23s. Rate: 7.2 symbols/min [2025-10-06T18:38:24.325361] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:38:24.526733] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:38:24.541701] [DEBUG] [LOCAL ] EG: Loaded 28480 existing records from primary storage. [2025-10-06T18:38:24.542341] [INFO ] [MAIN ] EG: Loaded 28480 existing records. [2025-10-06T18:38:24.629713] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-06T18:38:24.757238] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:38:24.757605] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-06T18:38:24.757689] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-06T18:38:24.757989] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-06T18:38:24.758048] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-06T18:38:24.904400] [DEBUG] [LOCAL ] EGO: Loaded 52369 existing records from primary storage. [2025-10-06T18:38:24.935017] [INFO ] [MAIN ] EGO: Loaded 52369 existing records. [2025-10-06T18:38:25.352835] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:38:25.397246] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-06T18:38:25.397110] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:38:25.397598] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-06T18:38:25.398581] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-06T18:38:25.398738] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-06T18:38:25.430882] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-06T18:38:25.728153] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T18:38:25.832572] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:38:26.225580] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-06T18:38:26.637871] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T18:38:26.874420] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T18:38:27.025561] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-06T18:38:27.178209] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T18:38:27.825543] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-06T18:38:28.531233] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T18:38:28.625487] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-06T18:38:29.291363] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T18:38:29.425611] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-06T18:38:30.132269] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T18:38:30.225538] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-06T18:38:30.564283] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-06T18:38:31.025601] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-06T18:38:31.788702] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T18:38:31.825534] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-06T18:38:32.337220] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T18:38:32.625542] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-06T18:38:33.425513] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-06T18:38:33.560627] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T18:38:33.626055] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T18:38:34.225551] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-06T18:38:34.997384] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T18:38:35.025482] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-06T18:38:35.244545] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T18:38:35.825536] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-06T18:38:36.342444] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T18:38:36.625582] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-06T18:38:37.417073] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T18:38:37.425473] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-06T18:38:38.077768] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T18:38:38.225595] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-06T18:38:38.871801] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T18:38:39.025512] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-06T18:38:39.825497] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-06T18:38:39.880082] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T18:38:40.178549] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T18:38:40.625488] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-06T18:38:40.716015] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-06T18:38:41.425548] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-06T18:38:42.225527] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-06T18:38:42.356095] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T18:38:43.025553] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-06T18:38:43.101271] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T18:38:43.199193] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T18:38:43.825534] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-06T18:38:44.625557] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-06T18:38:45.037272] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T18:38:45.227187] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-06T18:38:45.425535] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-06T18:38:45.894726] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T18:38:45.897892] [INFO ] [REMOTE ] EFX: Full fetch complete (64556 records). [2025-10-06T18:38:45.898050] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-06T18:38:46.226629] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-06T18:38:46.330974] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-06T18:38:46.331260] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-06T18:38:46.332477] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-06T18:38:46.332594] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-06T18:38:46.334225] [DEBUG] [LOCAL ] EFX: Trimmed 64556 records to 44615 (keeping 200 days of data) [2025-10-06T18:38:46.454337] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-06T18:38:46.646775] [DEBUG] [LOCAL ] EFX: Primary data saved (44615 records). [2025-10-06T18:38:46.646937] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-06T18:38:46.647016] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFX took 33.2s. Estimated remaining: 3h 52m 47s. Rate: 7.2 symbols/min [2025-10-06T18:38:46.813015] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:38:46.847003] [DEBUG] [LOCAL ] EGP: Loaded 31284 existing records from primary storage. [2025-10-06T18:38:46.847329] [INFO ] [MAIN ] EGP: Loaded 31284 existing records. [2025-10-06T18:38:47.028616] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-06T18:38:47.028450] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:38:47.030016] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-06T18:38:47.030077] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-06T18:38:47.030364] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-06T18:38:47.030501] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-06T18:38:47.384475] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:38:47.512774] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T18:38:47.825551] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-06T18:38:48.625519] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-06T18:38:48.779062] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T18:38:49.162355] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T18:38:49.425554] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-06T18:38:49.989500] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T18:38:49.992017] [INFO ] [REMOTE ] EG: Full fetch complete (43441 records). [2025-10-06T18:38:49.992227] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-06T18:38:50.230741] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-06T18:38:50.414989] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-06T18:38:50.415234] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-06T18:38:50.417799] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-06T18:38:50.418624] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T18:38:50.418945] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-06T18:38:50.426908] [DEBUG] [LOCAL ] EG: Trimmed 43441 records to 27903 (keeping 200 days of data) [2025-10-06T18:38:50.628155] [DEBUG] [LOCAL ] EG: Primary data saved (27903 records). [2025-10-06T18:38:50.628367] [INFO ] [MAIN ] EG: Full history saved. [2025-10-06T18:38:50.628483] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EG took 26.5s. Estimated remaining: 3h 52m 29s. Rate: 7.2 symbols/min [2025-10-06T18:38:50.816241] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:38:50.816528] [DEBUG] [LOCAL ] EGY: No existing data file found in primary storage. [2025-10-06T18:38:50.816586] [WARN ] [MAIN ] EGY: No existing data found, performing full refresh instead. [2025-10-06T18:38:50.816755] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-06T18:38:50.816800] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-06T18:38:50.816840] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-06T18:38:50.816872] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-06T18:38:51.033417] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-06T18:38:51.189690] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:38:51.363370] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T18:38:51.825573] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-06T18:38:52.625504] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-06T18:38:52.818409] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T18:38:53.159181] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T18:38:53.425546] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-06T18:38:53.668988] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-06T18:38:54.225575] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-06T18:38:54.792966] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T18:38:55.025538] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-06T18:38:55.659379] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T18:38:55.825537] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-06T18:38:56.504558] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T18:38:56.625552] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-06T18:38:57.346559] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T18:38:57.425539] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-06T18:38:58.023219] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T18:38:58.225586] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-06T18:38:58.754143] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-06T18:38:59.025614] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-06T18:38:59.365063] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-06T18:38:59.825578] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-06T18:39:00.309337] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T18:39:00.625619] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-06T18:39:01.387822] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T18:39:01.425586] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-06T18:39:01.985379] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T18:39:01.988080] [INFO ] [REMOTE ] EFXT: Full fetch complete (44166 records). [2025-10-06T18:39:01.988338] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-06T18:39:02.230692] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-06T18:39:02.388383] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-06T18:39:02.388493] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-06T18:39:02.389475] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-06T18:39:02.389553] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-06T18:39:02.390931] [DEBUG] [LOCAL ] EFXT: Trimmed 44166 records to 29254 (keeping 200 days of data) [2025-10-06T18:39:02.582134] [DEBUG] [LOCAL ] EFXT: Primary data saved (29254 records). [2025-10-06T18:39:02.582397] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-06T18:39:02.582522] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EFXT took 43.5s. Estimated remaining: 3h 52m 29s. Rate: 7.2 symbols/min [2025-10-06T18:39:02.761159] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:39:02.796613] [DEBUG] [LOCAL ] EHAB: Loaded 29954 existing records from primary storage. [2025-10-06T18:39:02.796980] [INFO ] [MAIN ] EHAB: Loaded 29954 existing records. [2025-10-06T18:39:02.986893] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:39:02.987423] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-06T18:39:02.987491] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-06T18:39:02.987848] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-06T18:39:02.987908] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-06T18:39:03.045466] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-06T18:39:03.333136] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T18:39:03.411262] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:39:03.785882] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T18:39:03.825475] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-06T18:39:04.625582] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-06T18:39:04.874237] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T18:39:05.214561] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T18:39:05.425587] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-06T18:39:06.225514] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-06T18:39:06.255890] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T18:39:06.750064] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T18:39:07.025615] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-06T18:39:07.223032] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T18:39:07.825536] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-06T18:39:08.536883] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T18:39:08.625542] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-06T18:39:08.782333] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T18:39:08.784398] [INFO ] [REMOTE ] EGP: Full fetch complete (45464 records). [2025-10-06T18:39:08.784516] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-06T18:39:09.208031] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-06T18:39:09.208213] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-06T18:39:09.209280] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-06T18:39:09.209354] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-06T18:39:09.211166] [DEBUG] [LOCAL ] EGP: Trimmed 45464 records to 30780 (keeping 200 days of data) [2025-10-06T18:39:09.425889] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-06T18:39:09.440718] [DEBUG] [LOCAL ] EGP: Primary data saved (30780 records). [2025-10-06T18:39:09.440939] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-06T18:39:09.441094] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EGP took 22.8s. Estimated remaining: 3h 52m 17s. Rate: 7.2 symbols/min [2025-10-06T18:39:09.632493] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:39:09.689626] [DEBUG] [LOCAL ] EHC: Loaded 41700 existing records from primary storage. [2025-10-06T18:39:09.690138] [INFO ] [MAIN ] EHC: Loaded 41700 existing records. [2025-10-06T18:39:09.894570] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:39:09.894929] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-06T18:39:09.894984] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-06T18:39:09.895594] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-06T18:39:09.895702] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-06T18:39:10.235400] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-06T18:39:10.283593] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:39:10.607531] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-06T18:39:10.611732] [INFO ] [REMOTE ] EGO: Full fetch complete (73804 records). [2025-10-06T18:39:10.611879] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-06T18:39:11.030370] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-06T18:39:11.049286] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-06T18:39:11.049545] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-06T18:39:11.052089] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-06T18:39:11.052403] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-06T18:39:11.084070] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T18:39:11.093589] [DEBUG] [LOCAL ] EGO: Trimmed 73804 records to 51656 (keeping 200 days of data) [2025-10-06T18:39:11.359257] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T18:39:11.450172] [DEBUG] [LOCAL ] EGO: Primary data saved (51656 records). [2025-10-06T18:39:11.450405] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-06T18:39:11.450519] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGO took 47.1s. Estimated remaining: 3h 51m 53s. Rate: 7.2 symbols/min [2025-10-06T18:39:11.630966] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:39:11.642969] [DEBUG] [LOCAL ] EHI: Loaded 10783 existing records from primary storage. [2025-10-06T18:39:11.643228] [INFO ] [MAIN ] EHI: Loaded 10783 existing records. [2025-10-06T18:39:11.827622] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-06T18:39:11.831745] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:39:11.833670] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-06T18:39:11.833753] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-06T18:39:11.834347] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-06T18:39:11.834438] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-06T18:39:12.211196] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:39:12.559236] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T18:39:12.625594] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-06T18:39:13.047581] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T18:39:13.425563] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-06T18:39:13.975512] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-06T18:39:14.225513] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-06T18:39:14.726489] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-06T18:39:15.025549] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-06T18:39:15.810026] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T18:39:15.825466] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-06T18:39:16.379271] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T18:39:16.625538] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-06T18:39:17.347770] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T18:39:17.425591] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-06T18:39:18.225516] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-06T18:39:18.413871] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T18:39:18.691363] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T18:39:19.019957] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T18:39:19.025466] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-06T18:39:19.825500] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-06T18:39:19.995029] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T18:39:20.625563] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-06T18:39:21.374141] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T18:39:21.425512] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-06T18:39:21.611097] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-06T18:39:22.225513] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-06T18:39:22.329311] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T18:39:23.025556] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-06T18:39:23.825559] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-06T18:39:23.888910] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T18:39:23.950271] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T18:39:24.625574] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-06T18:39:24.676270] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T18:39:25.425527] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-06T18:39:25.740183] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T18:39:26.230098] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-06T18:39:26.232796] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-06T18:39:27.025571] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-06T18:39:27.595232] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T18:39:27.825541] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-06T18:39:27.934871] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-06T18:39:28.625557] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-06T18:39:29.425561] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-06T18:39:29.539265] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T18:39:30.174975] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-06T18:39:30.225616] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-06T18:39:30.426555] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T18:39:31.025610] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-06T18:39:31.825568] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-06T18:39:31.873182] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T18:39:32.571477] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T18:39:32.625507] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-06T18:39:33.129390] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T18:39:33.425603] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-06T18:39:34.225513] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-06T18:39:34.257434] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-06T18:39:34.334234] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T18:39:35.025609] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-06T18:39:35.716524] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T18:39:35.825572] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-06T18:39:36.148264] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T18:39:36.501142] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-06T18:39:36.502263] [INFO ] [REMOTE ] EHI: Full fetch complete (16240 records). [2025-10-06T18:39:36.502336] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-06T18:39:36.502859] [FATAL] [VALIDATOR ] EHI: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:39:36.502944] [FATAL] [MAIN ] EHI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:39:36.503002] [WARN ] [MAIN ] EHI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:39:36.503040] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-06T18:39:36.503139] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-10-06T18:39:36.503215] [INFO ] [LOCAL ] EHI: Starting deletion of derivative data. [2025-10-06T18:39:36.503497] [DEBUG] [LOCAL ] EHI: Deleted derivative data file. [2025-10-06T18:39:36.503739] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EHI took 25.1s. Estimated remaining: 3h 52m 24s. Rate: 7.1 symbols/min [2025-10-06T18:39:36.630729] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-06T18:39:36.680581] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:39:36.705719] [DEBUG] [LOCAL ] EIC: Loaded 23785 existing records from primary storage. [2025-10-06T18:39:36.706067] [INFO ] [MAIN ] EIC: Loaded 23785 existing records. [2025-10-06T18:39:36.890944] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:39:36.891230] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-06T18:39:36.891284] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-06T18:39:36.892093] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-06T18:39:36.892152] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-06T18:39:37.237205] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:39:37.425537] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-06T18:39:38.081215] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T18:39:38.084523] [INFO ] [REMOTE ] EGY: Full fetch complete (61356 records). [2025-10-06T18:39:38.084711] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-06T18:39:38.231951] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-06T18:39:38.503018] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-06T18:39:38.503145] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-06T18:39:38.504371] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-06T18:39:38.504460] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-06T18:39:38.506261] [DEBUG] [LOCAL ] EGY: Trimmed 61356 records to 41895 (keeping 200 days of data) [2025-10-06T18:39:38.790440] [DEBUG] [LOCAL ] EGY: Primary data saved (41895 records). [2025-10-06T18:39:38.791239] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-06T18:39:38.791740] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EGY took 48.2s. Estimated remaining: 3h 52m 1s. Rate: 7.2 symbols/min [2025-10-06T18:39:38.988223] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T18:39:39.013707] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:39:39.022409] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-06T18:39:39.022461] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-06T18:39:39.022594] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-06T18:39:39.022638] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-06T18:39:39.022734] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-06T18:39:39.022775] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-06T18:39:39.034830] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-06T18:39:39.409566] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:39:39.436106] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T18:39:39.437827] [INFO ] [REMOTE ] EHAB: Full fetch complete (40873 records). [2025-10-06T18:39:39.437910] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-06T18:39:39.438501] [FATAL] [VALIDATOR ] EHAB: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:39:39.438590] [FATAL] [MAIN ] EHAB: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:39:39.438632] [WARN ] [MAIN ] EHAB: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:39:39.438712] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-06T18:39:39.438785] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-06T18:39:39.438929] [INFO ] [LOCAL ] EHAB: Starting deletion of derivative data. [2025-10-06T18:39:39.439141] [DEBUG] [LOCAL ] EHAB: Deleted derivative data file. [2025-10-06T18:39:39.439261] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHAB took 36.9s. Estimated remaining: 3h 51m 35s. Rate: 7.2 symbols/min [2025-10-06T18:39:39.610667] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:39:39.610933] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-06T18:39:39.610987] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-06T18:39:39.611103] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-06T18:39:39.611145] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-06T18:39:39.611189] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-06T18:39:39.611220] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-06T18:39:39.830734] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-06T18:39:39.965097] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:39:40.313549] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T18:39:40.625592] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-06T18:39:41.398226] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T18:39:41.425500] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-06T18:39:41.437486] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T18:39:42.225489] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-06T18:39:42.350578] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T18:39:42.778353] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-06T18:39:43.025552] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-06T18:39:43.441392] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-06T18:39:43.825547] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-06T18:39:44.625551] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-06T18:39:44.943999] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-06T18:39:45.164626] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T18:39:45.425502] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-06T18:39:46.225562] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-06T18:39:46.561766] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-06T18:39:46.667211] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T18:39:46.669609] [INFO ] [REMOTE ] EHC: Full fetch complete (58621 records). [2025-10-06T18:39:46.669757] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-06T18:39:46.670467] [FATAL] [VALIDATOR ] EHC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:39:46.670561] [FATAL] [MAIN ] EHC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:39:46.670604] [WARN ] [MAIN ] EHC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:39:46.670666] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-06T18:39:46.670753] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-10-06T18:39:46.670790] [INFO ] [LOCAL ] EHC: Starting deletion of derivative data. [2025-10-06T18:39:46.671050] [DEBUG] [LOCAL ] EHC: Deleted derivative data file. [2025-10-06T18:39:46.671156] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EHC took 37.2s. Estimated remaining: 3h 51m 24s. Rate: 7.2 symbols/min [2025-10-06T18:39:46.880033] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:39:46.880384] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-06T18:39:46.880456] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-06T18:39:46.880585] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-06T18:39:46.880628] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-06T18:39:46.880753] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-06T18:39:46.880794] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-06T18:39:47.031423] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-06T18:39:47.262525] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:39:47.444590] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-06T18:39:47.825555] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-06T18:39:48.625597] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-06T18:39:49.067091] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T18:39:49.276249] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-06T18:39:49.425543] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-06T18:39:50.225554] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-06T18:39:50.671136] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T18:39:50.671353] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-06T18:39:51.025562] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-06T18:39:51.825575] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-06T18:39:52.154022] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T18:39:52.199331] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-06T18:39:52.625600] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-06T18:39:53.043944] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-06T18:39:53.425594] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-06T18:39:53.774468] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-06T18:39:54.225553] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-06T18:39:54.589299] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-06T18:39:55.025561] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-06T18:39:55.366022] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-06T18:39:55.825541] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-06T18:39:56.288890] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-06T18:39:56.625562] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-06T18:39:56.960449] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-06T18:39:57.425562] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-06T18:39:57.797787] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-06T18:39:57.798532] [INFO ] [REMOTE ] EICA: Full fetch complete (1298 records). [2025-10-06T18:39:57.798605] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-06T18:39:58.003801] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-06T18:39:58.004066] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:39:58.004137] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:39:58.004216] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-06T18:39:58.004297] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-06T18:39:58.004353] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-06T18:39:58.004394] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-06T18:39:58.004454] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EICA took 19.2s. Estimated remaining: 3h 51m 22s. Rate: 7.2 symbols/min [2025-10-06T18:39:58.182179] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:39:58.207277] [DEBUG] [LOCAL ] EIG: Loaded 20583 existing records from primary storage. [2025-10-06T18:39:58.207632] [INFO ] [MAIN ] EIG: Loaded 20583 existing records. [2025-10-06T18:39:58.230744] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-06T18:39:58.400349] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:39:58.400639] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-06T18:39:58.400731] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-06T18:39:58.401718] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-06T18:39:58.401780] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-06T18:39:58.782013] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:39:59.025541] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-06T18:39:59.625679] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T18:39:59.654082] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T18:39:59.825547] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-06T18:40:00.494289] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-06T18:40:00.625531] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-06T18:40:01.272394] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-06T18:40:01.425563] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-06T18:40:02.076352] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-06T18:40:02.225614] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-06T18:40:02.817830] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-06T18:40:03.025596] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-06T18:40:03.825554] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-06T18:40:04.232119] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T18:40:04.261439] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-06T18:40:04.625544] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-06T18:40:05.425522] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-06T18:40:05.633214] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T18:40:06.022443] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T18:40:06.225551] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-06T18:40:06.868717] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-06T18:40:07.025581] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-06T18:40:07.698352] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-06T18:40:07.825556] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-06T18:40:08.625504] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-06T18:40:08.770580] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T18:40:08.772364] [INFO ] [REMOTE ] EIC: Full fetch complete (34750 records). [2025-10-06T18:40:08.772459] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-06T18:40:09.202772] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-06T18:40:09.202884] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-06T18:40:09.203550] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-06T18:40:09.203616] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-06T18:40:09.204905] [DEBUG] [LOCAL ] EIC: Trimmed 34750 records to 23167 (keeping 200 days of data) [2025-10-06T18:40:09.315452] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-06T18:40:09.373678] [DEBUG] [LOCAL ] EIC: Primary data saved (23167 records). [2025-10-06T18:40:09.373849] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-06T18:40:09.373950] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EIC took 32.9s. Estimated remaining: 3h 51m 21s. Rate: 7.2 symbols/min [2025-10-06T18:40:09.435724] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-06T18:40:09.587403] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:40:09.645276] [DEBUG] [LOCAL ] EIX: Loaded 54120 existing records from primary storage. [2025-10-06T18:40:09.645753] [INFO ] [MAIN ] EIX: Loaded 54120 existing records. [2025-10-06T18:40:09.864416] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:40:09.864770] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-06T18:40:09.864833] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-06T18:40:09.866497] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-06T18:40:09.866582] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-06T18:40:10.230866] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-06T18:40:10.229610] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-06T18:40:10.332947] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:40:10.744318] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-06T18:40:11.025580] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-06T18:40:11.825602] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-06T18:40:12.415972] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T18:40:12.625576] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-06T18:40:13.093621] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-06T18:40:13.336637] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-06T18:40:13.425617] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-06T18:40:13.888289] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-06T18:40:14.225604] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-06T18:40:14.776407] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T18:40:14.777453] [INFO ] [REMOTE ] EICB: Full fetch complete (2725 records). [2025-10-06T18:40:14.777539] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-06T18:40:14.974717] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T18:40:14.974952] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:40:14.975080] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:40:14.975155] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-06T18:40:14.975225] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-06T18:40:14.975261] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-06T18:40:14.975298] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-06T18:40:14.975356] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EICB took 35.5s. Estimated remaining: 3h 51m 6s. Rate: 7.2 symbols/min [2025-10-06T18:40:15.025550] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-06T18:40:15.825567] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-06T18:40:16.456884] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T18:40:16.457932] [INFO ] [REMOTE ] EICC: Full fetch complete (8304 records). [2025-10-06T18:40:16.458011] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-06T18:40:16.458385] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:40:16.458469] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:40:16.458512] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:40:16.458554] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-06T18:40:16.458612] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-06T18:40:16.458670] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-06T18:40:16.458763] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-06T18:40:16.458862] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICC took 29.8s. Estimated remaining: 3h 50m 42s. Rate: 7.2 symbols/min [2025-10-06T18:40:16.625611] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-06T18:40:17.019469] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-06T18:40:17.425613] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-06T18:40:17.939494] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T18:40:18.225566] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-06T18:40:19.137851] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T18:40:19.141373] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-06T18:40:19.196890] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T18:40:19.825601] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-06T18:40:19.974111] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T18:40:20.625606] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-06T18:40:21.696032] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T18:40:21.697541] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T18:40:21.714792] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-06T18:40:22.225623] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-06T18:40:22.854173] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T18:40:23.025503] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-06T18:40:24.147980] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-06T18:40:24.153816] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-06T18:40:24.284542] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-06T18:40:24.625552] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-06T18:40:25.185240] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T18:40:25.425567] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-06T18:40:26.425264] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T18:40:26.438317] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-06T18:40:26.836395] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T18:40:27.025621] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-06T18:40:28.498194] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T18:40:28.507081] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-06T18:40:28.675287] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-06T18:40:28.686752] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-06T18:40:29.622442] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T18:40:29.627360] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-06T18:40:30.582515] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T18:40:30.583986] [INFO ] [REMOTE ] EIG: Full fetch complete (27146 records). [2025-10-06T18:40:30.584062] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-06T18:40:30.989530] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-06T18:40:31.002542] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-06T18:40:31.013600] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-06T18:40:31.014826] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-06T18:40:31.014926] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-06T18:40:31.015691] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-06T18:40:31.017396] [DEBUG] [LOCAL ] EIG: Trimmed 27146 records to 20309 (keeping 200 days of data) [2025-10-06T18:40:31.144234] [DEBUG] [LOCAL ] EIG: Primary data saved (20309 records). [2025-10-06T18:40:31.144404] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-06T18:40:31.144490] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EIG took 33.1s. Estimated remaining: 3h 50m 48s. Rate: 7.2 symbols/min [2025-10-06T18:40:33.058148] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-06T18:40:33.070373] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-06T18:40:35.114369] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-06T18:40:35.126188] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-06T18:40:36.793997] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-06T18:40:36.797116] [INFO ] [REMOTE ] EIX: Full fetch complete (77076 records). [2025-10-06T18:40:36.797243] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-06T18:40:37.184932] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-06T18:40:37.185056] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-06T18:40:37.186019] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-06T18:40:37.186084] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-06T18:40:37.187767] [DEBUG] [LOCAL ] EIX: Trimmed 77076 records to 53343 (keeping 200 days of data) [2025-10-06T18:40:37.509113] [DEBUG] [LOCAL ] EIX: Primary data saved (53343 records). [2025-10-06T18:40:37.509282] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-06T18:40:37.509373] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIX took 28.1s. Estimated remaining: 3h 50m 35s. Rate: 7.2 symbols/min [2025-10-06T18:40:38.083613] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:40:38.111344] [DEBUG] [LOCAL ] ELC: No existing data file found in primary storage. [2025-10-06T18:40:38.116725] [WARN ] [MAIN ] ELC: No existing data found, performing full refresh instead. [2025-10-06T18:40:38.153551] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-06T18:40:38.154220] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-06T18:40:38.179676] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-06T18:40:38.198145] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-06T18:40:38.247306] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:40:38.209600] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:40:38.249790] [DEBUG] [LOCAL ] EL: No existing data file found in primary storage. [2025-10-06T18:40:38.285087] [WARN ] [MAIN ] EL: No existing data found, performing full refresh instead. [2025-10-06T18:40:38.284955] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:40:38.323045] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-06T18:40:38.358077] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-06T18:40:38.381098] [DEBUG] [LOCAL ] EL: No primary data file found to delete. [2025-10-06T18:40:38.384041] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-06T18:40:38.964876] [DEBUG] [LOCAL ] ELF: Loaded 52899 existing records from primary storage. [2025-10-06T18:40:38.958290] [DEBUG] [LOCAL ] ELAN: Loaded 54031 existing records from primary storage. [2025-10-06T18:40:38.990379] [INFO ] [MAIN ] ELAN: Loaded 54031 existing records. [2025-10-06T18:40:38.998480] [INFO ] [MAIN ] ELF: Loaded 52899 existing records. [2025-10-06T18:40:39.531728] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:40:39.565039] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-06T18:40:39.838831] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:40:39.834757] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:40:39.826515] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:40:39.839760] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-06T18:40:39.839496] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-06T18:40:39.840898] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-06T18:40:39.841056] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-06T18:40:39.840978] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-06T18:40:39.843458] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-06T18:40:39.843537] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-06T18:40:39.878907] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-06T18:40:39.919253] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-06T18:40:40.565740] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:40:40.575333] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-06T18:40:40.587984] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-06T18:40:40.653457] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-06T18:40:40.657398] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:40:40.658665] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-06T18:40:41.251395] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T18:40:41.253480] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-06T18:40:42.025191] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-06T18:40:42.026830] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-06T18:40:42.070225] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-06T18:40:42.086491] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-06T18:40:42.559176] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-06T18:40:42.570950] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-06T18:40:42.603130] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-06T18:40:42.604573] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-06T18:40:42.688214] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-06T18:40:42.698995] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-06T18:40:43.424715] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T18:40:43.426608] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-06T18:40:43.989763] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T18:40:43.992637] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-06T18:40:44.066117] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-06T18:40:44.077790] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-06T18:40:44.107787] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T18:40:44.119523] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-06T18:40:44.219248] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T18:40:44.536798] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-06T18:40:44.625485] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-06T18:40:45.206310] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-06T18:40:45.425566] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-06T18:40:45.547096] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-06T18:40:46.168946] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-06T18:40:46.182151] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-06T18:40:46.225475] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-06T18:40:46.791896] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-06T18:40:47.025553] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-06T18:40:47.707179] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-06T18:40:47.708059] [INFO ] [REMOTE ] ELC: Full fetch complete (5098 records). [2025-10-06T18:40:47.708129] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-06T18:40:47.830787] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-06T18:40:48.081725] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-06T18:40:48.081827] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-06T18:40:48.081992] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-06T18:40:48.082032] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-06T18:40:48.082490] [DEBUG] [LOCAL ] ELC: Trimmed 5098 records to 3501 (keeping 200 days of data) [2025-10-06T18:40:48.105100] [DEBUG] [LOCAL ] ELC: Primary data saved (3501 records). [2025-10-06T18:40:48.105288] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-06T18:40:48.105386] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 10.6s. Estimated remaining: 3h 50m 32s. Rate: 7.2 symbols/min [2025-10-06T18:40:48.282567] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:40:48.322488] [DEBUG] [LOCAL ] ELME: Loaded 39824 existing records from primary storage. [2025-10-06T18:40:48.322844] [INFO ] [MAIN ] ELME: Loaded 39824 existing records. [2025-10-06T18:40:48.503464] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:40:48.503757] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-06T18:40:48.503810] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-06T18:40:48.505310] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-06T18:40:48.505373] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-06T18:40:48.630711] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-06T18:40:48.874189] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:40:49.425629] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-06T18:40:49.837217] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-06T18:40:50.225611] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-06T18:40:50.368898] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T18:40:50.574596] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T18:40:51.025595] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-06T18:40:51.825542] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-06T18:40:52.385182] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T18:40:52.507348] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-06T18:40:52.625545] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-06T18:40:53.401676] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T18:40:53.425533] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-06T18:40:54.029106] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T18:40:54.225593] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-06T18:40:55.025705] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-06T18:40:55.557742] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-06T18:40:55.709686] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T18:40:55.825565] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-06T18:40:56.625604] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-06T18:40:57.398443] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-06T18:40:57.425515] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-06T18:40:57.516119] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T18:40:58.225563] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-06T18:40:58.751013] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-06T18:40:59.025550] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-06T18:40:59.512008] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-06T18:40:59.798960] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T18:40:59.825598] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-06T18:41:00.625547] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-06T18:41:00.906320] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-06T18:41:01.425578] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-06T18:41:01.669310] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T18:41:02.225547] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-06T18:41:03.025522] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-06T18:41:03.115354] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-06T18:41:03.584359] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-06T18:41:03.825516] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-06T18:41:03.958117] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T18:41:04.553391] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T18:41:04.625515] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-06T18:41:05.425564] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-06T18:41:06.088111] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T18:41:06.184455] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-06T18:41:06.225488] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-06T18:41:07.025491] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-06T18:41:07.266221] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T18:41:07.478988] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-06T18:41:07.825584] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-06T18:41:08.625545] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-06T18:41:09.141469] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-06T18:41:09.425500] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-06T18:41:09.793581] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-06T18:41:10.225548] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-06T18:41:10.564432] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-06T18:41:11.025534] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-06T18:41:11.437586] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T18:41:11.668307] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-06T18:41:11.825515] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-06T18:41:12.625551] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-06T18:41:12.832562] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T18:41:13.425699] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-06T18:41:13.747554] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-06T18:41:14.225506] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-06T18:41:14.498813] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-06T18:41:14.551358] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T18:41:14.553536] [INFO ] [REMOTE ] ELME: Full fetch complete (55829 records). [2025-10-06T18:41:14.553701] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-06T18:41:14.554575] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:41:14.554696] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:41:14.554745] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:41:14.554784] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-06T18:41:14.554888] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-06T18:41:14.554943] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-10-06T18:41:14.555262] [DEBUG] [LOCAL ] ELME: Deleted derivative data file. [2025-10-06T18:41:14.555903] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. ELME took 26.5s. Estimated remaining: 3h 51m 4s. Rate: 7.1 symbols/min [2025-10-06T18:41:14.733990] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:41:14.762525] [DEBUG] [LOCAL ] ELP: Loaded 25951 existing records from primary storage. [2025-10-06T18:41:14.762915] [INFO ] [MAIN ] ELP: Loaded 25951 existing records. [2025-10-06T18:41:14.942125] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:41:14.942391] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-06T18:41:14.942448] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-06T18:41:14.943282] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-06T18:41:14.943342] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-06T18:41:15.032367] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-06T18:41:15.294062] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:41:15.825543] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-06T18:41:16.034753] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-06T18:41:16.037829] [INFO ] [REMOTE ] ELF: Full fetch complete (75275 records). [2025-10-06T18:41:16.037977] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-06T18:41:16.427010] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-06T18:41:16.427096] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-06T18:41:16.427980] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-06T18:41:16.428045] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-06T18:41:16.429796] [DEBUG] [LOCAL ] ELF: Trimmed 75275 records to 52098 (keeping 200 days of data) [2025-10-06T18:41:16.555299] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-06T18:41:16.561367] [INFO ] [REMOTE ] ELAN: Full fetch complete (76870 records). [2025-10-06T18:41:16.561542] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-06T18:41:16.636128] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-06T18:41:17.162679] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-06T18:41:17.166808] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-06T18:41:17.171902] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-06T18:41:17.172009] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-06T18:41:17.172119] [DEBUG] [LOCAL ] ELF: Primary data saved (52098 records). [2025-10-06T18:41:17.172477] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-06T18:41:17.172611] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELF took 39.6s. Estimated remaining: 3h 50m 43s. Rate: 7.1 symbols/min [2025-10-06T18:41:17.260502] [DEBUG] [LOCAL ] ELAN: Trimmed 76870 records to 53267 (keeping 200 days of data) [2025-10-06T18:41:17.453274] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:41:17.454982] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-06T18:41:17.455989] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-06T18:41:17.456736] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-06T18:41:17.458504] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-06T18:41:17.458953] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-06T18:41:17.459284] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-06T18:41:17.718300] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-06T18:41:17.762543] [INFO ] [REMOTE ] EL: Full fetch complete (77275 records). [2025-10-06T18:41:17.777148] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-06T18:41:17.977781] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:41:18.043932] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-06T18:41:18.263925] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T18:41:18.304807] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-06T18:41:18.474632] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-06T18:41:18.476097] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-06T18:41:18.478016] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-06T18:41:18.478396] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-06T18:41:18.483363] [DEBUG] [LOCAL ] EL: Trimmed 77275 records to 53370 (keeping 200 days of data) [2025-10-06T18:41:18.673697] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-06T18:41:18.722779] [DEBUG] [LOCAL ] ELAN: Primary data saved (53267 records). [2025-10-06T18:41:18.723787] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-06T18:41:18.724801] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. ELAN took 41.2s. Estimated remaining: 3h 50m 19s. Rate: 7.2 symbols/min [2025-10-06T18:41:19.038541] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:41:19.038715] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-06T18:41:19.111462] [DEBUG] [LOCAL ] ELS: Loaded 50194 existing records from primary storage. [2025-10-06T18:41:19.150966] [INFO ] [MAIN ] ELS: Loaded 50194 existing records. [2025-10-06T18:41:19.431885] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:41:19.433130] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-06T18:41:19.433222] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-06T18:41:19.436007] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-06T18:41:19.436365] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-06T18:41:19.511800] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-06T18:41:19.541371] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T18:41:19.539548] [DEBUG] [LOCAL ] EL: Primary data saved (53370 records). [2025-10-06T18:41:19.577826] [INFO ] [MAIN ] EL: Full history saved. [2025-10-06T18:41:19.589412] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. EL took 42.1s. Estimated remaining: 3h 49m 53s. Rate: 7.2 symbols/min [2025-10-06T18:41:19.825674] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-06T18:41:19.931247] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:41:19.939531] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-10-06T18:41:19.944974] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-10-06T18:41:19.966119] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-06T18:41:19.971338] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-06T18:41:19.971424] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-06T18:41:19.971485] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-06T18:41:20.130333] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:41:20.378319] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:41:20.625491] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-06T18:41:21.082683] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T18:41:21.425499] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-06T18:41:22.225513] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-06T18:41:22.494976] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T18:41:22.529981] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T18:41:22.562606] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-06T18:41:23.025551] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-06T18:41:23.825552] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-06T18:41:24.334317] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-06T18:41:24.625541] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-06T18:41:25.250273] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T18:41:25.425535] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-06T18:41:26.225581] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-06T18:41:26.378846] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T18:41:26.631307] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-06T18:41:27.025502] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-06T18:41:27.094222] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T18:41:27.489576] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-06T18:41:27.825548] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-06T18:41:28.625487] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-06T18:41:28.922686] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T18:41:29.425553] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-06T18:41:29.998980] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T18:41:30.225579] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-06T18:41:30.611787] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T18:41:31.025576] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-06T18:41:31.561582] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T18:41:31.825569] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-06T18:41:32.374087] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T18:41:32.625622] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-06T18:41:33.392121] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T18:41:33.425589] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-06T18:41:33.866599] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-06T18:41:34.225507] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-06T18:41:34.265315] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T18:41:34.561215] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-06T18:41:35.025537] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-06T18:41:35.825538] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-06T18:41:36.625494] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-06T18:41:36.968496] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T18:41:37.425563] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-06T18:41:37.741164] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T18:41:37.768119] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T18:41:38.225567] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-06T18:41:38.679422] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T18:41:39.025547] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-06T18:41:39.825495] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-06T18:41:40.087482] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T18:41:40.173408] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-06T18:41:40.204864] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-06T18:41:40.625525] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-06T18:41:41.425588] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-06T18:41:42.230825] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-06T18:41:42.244952] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T18:41:42.590009] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-06T18:41:42.964290] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T18:41:43.025478] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-06T18:41:43.281167] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-06T18:41:43.825532] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-06T18:41:44.625543] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-06T18:41:44.835298] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T18:41:44.837046] [INFO ] [REMOTE ] ELP: Full fetch complete (37008 records). [2025-10-06T18:41:44.837137] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-06T18:41:45.211695] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-06T18:41:45.211802] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-06T18:41:45.212627] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-06T18:41:45.212737] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-06T18:41:45.213723] [DEBUG] [LOCAL ] ELP: Trimmed 37008 records to 25589 (keeping 200 days of data) [2025-10-06T18:41:45.364206] [DEBUG] [LOCAL ] ELP: Primary data saved (25589 records). [2025-10-06T18:41:45.364372] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-06T18:41:45.364465] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELP took 30.8s. Estimated remaining: 3h 50m 24s. Rate: 7.1 symbols/min [2025-10-06T18:41:45.430771] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-06T18:41:45.541087] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:41:45.541268] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-06T18:41:45.541305] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-06T18:41:45.541441] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-06T18:41:45.541495] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-06T18:41:45.541539] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-06T18:41:45.541572] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-06T18:41:45.900912] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:41:45.969254] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T18:41:45.969976] [INFO ] [REMOTE ] ELPC: Full fetch complete (1435 records). [2025-10-06T18:41:45.970047] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-06T18:41:46.145959] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-06T18:41:46.146184] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:41:46.146254] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:41:46.146341] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-06T18:41:46.146440] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-06T18:41:46.146516] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-06T18:41:46.146620] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-06T18:41:46.146737] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. ELPC took 29.0s. Estimated remaining: 3h 49m 59s. Rate: 7.1 symbols/min [2025-10-06T18:41:46.235388] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-06T18:41:46.317212] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:41:46.339448] [DEBUG] [LOCAL ] EMD: Loaded 21522 existing records from primary storage. [2025-10-06T18:41:46.339770] [INFO ] [MAIN ] EMD: Loaded 21522 existing records. [2025-10-06T18:41:46.523190] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:41:46.523599] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-06T18:41:46.523887] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-06T18:41:46.524181] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-06T18:41:46.524238] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-06T18:41:46.882905] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:41:46.917068] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-06T18:41:47.025570] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-06T18:41:47.825499] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-06T18:41:48.159557] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-06T18:41:48.444782] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T18:41:48.625527] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-06T18:41:49.425505] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-06T18:41:49.627005] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:41:49.631292] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-06T18:41:49.632303] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:41:49.632387] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-06T18:41:49.632455] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:41:49.632535] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-06T18:41:49.632699] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-06T18:41:49.632792] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-06T18:41:49.632843] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-06T18:41:49.632906] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. EMA took 4.3s. Estimated remaining: 3h 49m 39s. Rate: 7.2 symbols/min [2025-10-06T18:41:49.825052] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:41:49.856342] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-06T18:41:49.904445] [DEBUG] [LOCAL ] EME: Loaded 31702 existing records from primary storage. [2025-10-06T18:41:49.904908] [INFO ] [MAIN ] EME: Loaded 31702 existing records. [2025-10-06T18:41:50.102785] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:41:50.103253] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-06T18:41:50.103400] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-06T18:41:50.103889] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-06T18:41:50.103954] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-06T18:41:50.229509] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-06T18:41:50.253034] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T18:41:50.517450] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:41:51.025523] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-06T18:41:51.825576] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-06T18:41:51.957771] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T18:41:52.549262] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T18:41:52.625516] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-06T18:41:53.425635] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-06T18:41:53.493084] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T18:41:54.023804] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T18:41:54.225553] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-06T18:41:54.329303] [DEBUG] [REMOTE ] ELS: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-06T18:41:54.329592] [WARN ] [REMOTE ] ELS: No data returned for month 2025-10 [2025-10-06T18:41:54.329741] [FATAL] [REMOTE ] ELS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:41:54.329902] [FATAL] [MAIN ] ELS: Failed to fetch primary data. [2025-10-06T18:41:54.329976] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:41:54.330058] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-06T18:41:54.330172] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-06T18:41:54.330252] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-10-06T18:41:54.330516] [DEBUG] [LOCAL ] ELS: Deleted derivative data file. [2025-10-06T18:41:54.330639] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. ELS took 35.6s. Estimated remaining: 3h 49m 23s. Rate: 7.2 symbols/min [2025-10-06T18:41:54.515663] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:41:54.522513] [DEBUG] [LOCAL ] EMF: Loaded 3480 existing records from primary storage. [2025-10-06T18:41:54.522806] [INFO ] [MAIN ] EMF: Loaded 3480 existing records. [2025-10-06T18:41:54.704785] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:41:54.704974] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-06T18:41:54.705021] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-06T18:41:54.705205] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-06T18:41:54.705261] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-06T18:41:55.034766] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-06T18:41:55.063892] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:41:55.105290] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-06T18:41:55.109093] [INFO ] [REMOTE ] ELV: Full fetch complete (73161 records). [2025-10-06T18:41:55.109270] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-06T18:41:55.524856] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-06T18:41:55.524989] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-06T18:41:55.526674] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-06T18:41:55.526744] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-06T18:41:55.528831] [DEBUG] [LOCAL ] ELV: Trimmed 73161 records to 50614 (keeping 200 days of data) [2025-10-06T18:41:55.834802] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-06T18:41:55.881802] [DEBUG] [LOCAL ] ELV: Primary data saved (50614 records). [2025-10-06T18:41:55.882010] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-06T18:41:55.882106] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. ELV took 36.3s. Estimated remaining: 3h 48m 59s. Rate: 7.2 symbols/min [2025-10-06T18:41:56.059818] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:41:56.115869] [DEBUG] [LOCAL ] EMN: Loaded 51219 existing records from primary storage. [2025-10-06T18:41:56.116342] [INFO ] [MAIN ] EMN: Loaded 51219 existing records. [2025-10-06T18:41:56.314017] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:41:56.314501] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-06T18:41:56.314558] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-06T18:41:56.314861] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-06T18:41:56.314921] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-06T18:41:56.629059] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-06T18:41:56.739216] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T18:41:56.737688] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:41:56.886702] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T18:41:57.425500] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-06T18:41:57.732576] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T18:41:58.225564] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-06T18:41:58.974071] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T18:41:59.025499] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-06T18:41:59.063140] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T18:41:59.702046] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-06T18:41:59.825529] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-06T18:42:00.625539] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-06T18:42:01.154105] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T18:42:01.343628] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T18:42:01.425533] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-06T18:42:02.015303] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-06T18:42:02.225763] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-06T18:42:03.025633] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-06T18:42:03.538949] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-06T18:42:03.825736] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-06T18:42:03.827585] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T18:42:04.382310] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-06T18:42:04.625574] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-06T18:42:05.245455] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-06T18:42:05.425567] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-06T18:42:06.225611] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-06T18:42:06.716915] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-06T18:42:07.025547] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-06T18:42:07.311556] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T18:42:07.825540] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-06T18:42:07.852496] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-06T18:42:08.625566] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-06T18:42:09.214757] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T18:42:09.425540] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-06T18:42:10.225571] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-06T18:42:10.344935] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T18:42:10.688628] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T18:42:10.689484] [INFO ] [REMOTE ] EMF: Full fetch complete (7012 records). [2025-10-06T18:42:10.689553] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-06T18:42:10.995119] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T18:42:11.028346] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-06T18:42:11.127411] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-06T18:42:11.127520] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-06T18:42:11.127822] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-06T18:42:11.127888] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-06T18:42:11.128429] [DEBUG] [LOCAL ] EMF: Trimmed 7012 records to 3285 (keeping 200 days of data) [2025-10-06T18:42:11.150524] [DEBUG] [LOCAL ] EMF: Primary data saved (3285 records). [2025-10-06T18:42:11.150747] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-06T18:42:11.150877] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMF took 16.8s. Estimated remaining: 3h 49m 6s. Rate: 7.2 symbols/min [2025-10-06T18:42:11.334951] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:42:11.355977] [DEBUG] [LOCAL ] EMO: Loaded 12774 existing records from primary storage. [2025-10-06T18:42:11.356306] [INFO ] [MAIN ] EMO: Loaded 12774 existing records. [2025-10-06T18:42:11.539739] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:42:11.540110] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-06T18:42:11.540173] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-06T18:42:11.540476] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-06T18:42:11.540539] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-06T18:42:11.830778] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-06T18:42:11.955444] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:42:12.251939] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-06T18:42:12.625571] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-06T18:42:13.292285] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T18:42:13.425566] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-06T18:42:14.134558] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T18:42:14.198833] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-06T18:42:14.225467] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-06T18:42:15.025567] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-06T18:42:15.153229] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-06T18:42:15.825510] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-06T18:42:16.215742] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T18:42:16.469353] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-06T18:42:16.625545] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-06T18:42:17.425493] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-06T18:42:17.511850] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T18:42:18.225594] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-06T18:42:19.000782] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T18:42:19.025469] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-06T18:42:19.320322] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T18:42:19.750151] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-06T18:42:19.825555] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-06T18:42:20.575235] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T18:42:20.625544] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-06T18:42:21.364149] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T18:42:21.425499] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-06T18:42:22.225605] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-06T18:42:22.309869] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T18:42:23.025615] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-06T18:42:23.825702] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-06T18:42:24.036578] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T18:42:24.398965] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T18:42:24.402977] [INFO ] [REMOTE ] EME: Full fetch complete (46913 records). [2025-10-06T18:42:24.403263] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-06T18:42:24.629894] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-06T18:42:24.924381] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T18:42:25.060524] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-06T18:42:25.060711] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-06T18:42:25.062292] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-06T18:42:25.062398] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-06T18:42:25.064168] [DEBUG] [LOCAL ] EME: Trimmed 46913 records to 31251 (keeping 200 days of data) [2025-10-06T18:42:25.318101] [DEBUG] [LOCAL ] EME: Primary data saved (31251 records). [2025-10-06T18:42:25.318321] [INFO ] [MAIN ] EME: Full history saved. [2025-10-06T18:42:25.319222] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EME took 35.7s. Estimated remaining: 3h 49m 11s. Rate: 7.2 symbols/min [2025-10-06T18:42:25.426239] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-06T18:42:25.514165] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:42:25.524515] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-06T18:42:25.530769] [DEBUG] [LOCAL ] EMP: Loaded 3108 existing records from primary storage. [2025-10-06T18:42:25.531015] [INFO ] [MAIN ] EMP: Loaded 3108 existing records. [2025-10-06T18:42:25.716674] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:42:25.717166] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-06T18:42:25.717220] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-06T18:42:25.717509] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-06T18:42:25.717568] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-06T18:42:26.075936] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:42:26.225558] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-06T18:42:26.641342] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T18:42:26.941268] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-06T18:42:27.025616] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-06T18:42:27.477518] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-06T18:42:27.825547] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-06T18:42:28.625603] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-06T18:42:29.072675] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-06T18:42:29.425631] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-06T18:42:29.584987] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T18:42:30.225574] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-06T18:42:30.434227] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-06T18:42:31.025507] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-06T18:42:31.268929] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T18:42:31.637633] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T18:42:31.825548] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-06T18:42:32.625540] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-06T18:42:32.767565] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T18:42:32.769922] [INFO ] [REMOTE ] EMD: Full fetch complete (32449 records). [2025-10-06T18:42:32.770042] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-06T18:42:33.165967] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-06T18:42:33.166053] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-06T18:42:33.166479] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-06T18:42:33.166519] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-06T18:42:33.167362] [DEBUG] [LOCAL ] EMD: Trimmed 32449 records to 21095 (keeping 200 days of data) [2025-10-06T18:42:33.295300] [DEBUG] [LOCAL ] EMD: Primary data saved (21095 records). [2025-10-06T18:42:33.295452] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-06T18:42:33.295535] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMD took 47.1s. Estimated remaining: 3h 49m 1s. Rate: 7.2 symbols/min [2025-10-06T18:42:33.432999] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-06T18:42:33.465044] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:42:33.525111] [DEBUG] [LOCAL ] EMR: Loaded 54022 existing records from primary storage. [2025-10-06T18:42:33.525484] [INFO ] [MAIN ] EMR: Loaded 54022 existing records. [2025-10-06T18:42:33.698127] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:42:33.698346] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-06T18:42:33.698392] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-06T18:42:33.699396] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-06T18:42:33.699455] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-06T18:42:34.050027] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:42:34.225568] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-06T18:42:34.296616] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T18:42:34.498061] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-06T18:42:35.025516] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-06T18:42:35.825525] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-06T18:42:36.065799] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T18:42:36.109846] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-06T18:42:36.391826] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-06T18:42:36.625540] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-06T18:42:37.425501] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-06T18:42:37.567128] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T18:42:37.568516] [INFO ] [REMOTE ] EMO: Full fetch complete (17364 records). [2025-10-06T18:42:37.568587] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-06T18:42:37.961805] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-06T18:42:37.961911] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-06T18:42:37.962321] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-06T18:42:37.962406] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-06T18:42:37.963007] [DEBUG] [LOCAL ] EMO: Trimmed 17364 records to 12701 (keeping 200 days of data) [2025-10-06T18:42:38.039068] [DEBUG] [LOCAL ] EMO: Primary data saved (12701 records). [2025-10-06T18:42:38.039227] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-06T18:42:38.039312] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMO took 26.9s. Estimated remaining: 3h 48m 45s. Rate: 7.2 symbols/min [2025-10-06T18:42:38.204194] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:42:38.225537] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-06T18:42:38.266919] [DEBUG] [LOCAL ] ENB: Loaded 54287 existing records from primary storage. [2025-10-06T18:42:38.267381] [INFO ] [MAIN ] ENB: Loaded 54287 existing records. [2025-10-06T18:42:38.440401] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:42:38.440676] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-06T18:42:38.440777] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-06T18:42:38.441341] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-06T18:42:38.441399] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-06T18:42:38.727252] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-06T18:42:38.810480] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:42:39.025578] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-06T18:42:39.074512] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T18:42:39.825567] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-06T18:42:40.160851] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-06T18:42:40.625493] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-06T18:42:40.768862] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T18:42:41.362022] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-06T18:42:41.425562] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-06T18:42:42.225625] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-06T18:42:43.025516] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-06T18:42:43.117822] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T18:42:43.563586] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T18:42:43.825503] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-06T18:42:44.273793] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-06T18:42:44.625545] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-06T18:42:45.425560] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-06T18:42:45.882907] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-06T18:42:46.225603] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-06T18:42:46.336759] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T18:42:46.781563] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-06T18:42:47.025498] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-06T18:42:47.302436] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T18:42:47.825562] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-06T18:42:48.364086] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T18:42:48.365032] [INFO ] [REMOTE ] EMP: Full fetch complete (4299 records). [2025-10-06T18:42:48.365103] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-06T18:42:48.630372] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-06T18:42:48.806518] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-06T18:42:48.806627] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-06T18:42:48.806897] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-06T18:42:48.806978] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-06T18:42:48.807452] [DEBUG] [LOCAL ] EMP: Trimmed 4299 records to 3074 (keeping 200 days of data) [2025-10-06T18:42:48.859091] [DEBUG] [LOCAL ] EMP: Primary data saved (3074 records). [2025-10-06T18:42:48.860668] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T18:42:48.861015] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-06T18:42:48.872684] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMP took 23.6s. Estimated remaining: 3h 48m 42s. Rate: 7.2 symbols/min [2025-10-06T18:42:49.039757] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:42:49.046013] [DEBUG] [LOCAL ] ENFY: Loaded 3201 existing records from primary storage. [2025-10-06T18:42:49.046208] [INFO ] [MAIN ] ENFY: Loaded 3201 existing records. [2025-10-06T18:42:49.242897] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:42:49.243211] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-06T18:42:49.243259] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-06T18:42:49.243490] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-06T18:42:49.243548] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-06T18:42:49.436838] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-06T18:42:49.609245] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:42:50.225509] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-06T18:42:50.495265] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-06T18:42:51.025596] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-06T18:42:51.324677] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T18:42:51.825568] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-06T18:42:51.871526] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-06T18:42:51.875716] [INFO ] [REMOTE ] EMN: Full fetch complete (72122 records). [2025-10-06T18:42:51.875934] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-06T18:42:52.363206] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-06T18:42:52.363355] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-06T18:42:52.364348] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-06T18:42:52.364524] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-06T18:42:52.366416] [DEBUG] [LOCAL ] EMN: Trimmed 72122 records to 50602 (keeping 200 days of data) [2025-10-06T18:42:52.515355] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T18:42:52.630110] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-06T18:42:52.734150] [DEBUG] [LOCAL ] EMN: Primary data saved (50602 records). [2025-10-06T18:42:52.734331] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-06T18:42:52.734440] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMN took 56.9s. Estimated remaining: 3h 48m 23s. Rate: 7.2 symbols/min [2025-10-06T18:42:52.901667] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:42:52.937380] [DEBUG] [LOCAL ] ENIC: Loaded 36843 existing records from primary storage. [2025-10-06T18:42:52.937741] [INFO ] [MAIN ] ENIC: Loaded 36843 existing records. [2025-10-06T18:42:53.118288] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:42:53.118552] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-06T18:42:53.118611] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-06T18:42:53.118938] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-06T18:42:53.119000] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-06T18:42:53.430617] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-06T18:42:53.488322] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:42:53.560092] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T18:42:53.662999] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T18:42:54.225612] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-06T18:42:55.025498] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-06T18:42:55.375418] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T18:42:55.741660] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-06T18:42:55.825490] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-06T18:42:56.047765] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T18:42:56.625555] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-06T18:42:57.256391] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T18:42:57.425492] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-06T18:42:57.944809] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T18:42:58.225534] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-06T18:42:59.025504] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-06T18:42:59.219345] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T18:42:59.825517] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-06T18:43:00.103760] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-06T18:43:00.166946] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T18:43:00.625558] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-06T18:43:01.425513] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-06T18:43:01.948790] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-06T18:43:01.977541] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T18:43:02.036616] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-06T18:43:02.225548] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-06T18:43:03.025541] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-06T18:43:03.825535] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-06T18:43:03.997761] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T18:43:04.625496] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-06T18:43:04.945462] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-06T18:43:05.157822] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-06T18:43:05.234319] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T18:43:05.425552] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-06T18:43:06.225539] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-06T18:43:07.025571] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-06T18:43:07.388771] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T18:43:07.782534] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T18:43:07.825482] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-06T18:43:08.625498] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-06T18:43:08.960505] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-06T18:43:09.258806] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T18:43:09.425565] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-06T18:43:10.225518] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-06T18:43:10.262750] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T18:43:10.266414] [INFO ] [REMOTE ] ENB: Full fetch complete (77488 records). [2025-10-06T18:43:10.266559] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-06T18:43:10.703836] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-06T18:43:10.703951] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-06T18:43:10.705249] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-06T18:43:10.705322] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-06T18:43:10.707390] [DEBUG] [LOCAL ] ENB: Trimmed 77488 records to 53507 (keeping 200 days of data) [2025-10-06T18:43:11.030032] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-06T18:43:11.085317] [DEBUG] [LOCAL ] ENB: Primary data saved (53507 records). [2025-10-06T18:43:11.085551] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-06T18:43:11.086864] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. ENB took 33.0s. Estimated remaining: 3h 48m 37s. Rate: 7.1 symbols/min [2025-10-06T18:43:11.271090] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:43:11.275080] [DEBUG] [LOCAL ] ENO: Loaded 1938 existing records from primary storage. [2025-10-06T18:43:11.275280] [INFO ] [MAIN ] ENO: Loaded 1938 existing records. [2025-10-06T18:43:11.488611] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:43:11.489804] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-06T18:43:11.489990] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-06T18:43:11.490619] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-06T18:43:11.490775] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-06T18:43:11.616354] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-06T18:43:11.827688] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-06T18:43:11.834892] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-06T18:43:11.834770] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T18:43:12.015302] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:43:12.439080] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T18:43:12.625561] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-06T18:43:13.425626] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-06T18:43:14.111444] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T18:43:14.134564] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T18:43:14.225508] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-06T18:43:15.025585] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-06T18:43:15.563678] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T18:43:15.775075] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-06T18:43:15.825511] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-06T18:43:16.304928] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-06T18:43:16.625559] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-06T18:43:17.101697] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-06T18:43:17.425634] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-06T18:43:18.225574] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-06T18:43:18.778625] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T18:43:19.025492] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-06T18:43:19.101867] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T18:43:19.825541] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-06T18:43:20.278570] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-06T18:43:20.628840] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-06T18:43:20.633706] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-06T18:43:20.637788] [INFO ] [REMOTE ] EMR: Full fetch complete (77098 records). [2025-10-06T18:43:20.637982] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-06T18:43:21.033437] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-06T18:43:21.033545] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-06T18:43:21.034468] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-06T18:43:21.034533] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-06T18:43:21.036080] [DEBUG] [LOCAL ] EMR: Trimmed 77098 records to 53243 (keeping 200 days of data) [2025-10-06T18:43:21.276446] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-06T18:43:21.376888] [DEBUG] [LOCAL ] EMR: Primary data saved (53243 records). [2025-10-06T18:43:21.377054] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-06T18:43:21.378204] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. EMR took 48.1s. Estimated remaining: 3h 48m 33s. Rate: 7.1 symbols/min [2025-10-06T18:43:21.434817] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-06T18:43:21.563794] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:43:21.620917] [DEBUG] [LOCAL ] ENOV: Loaded 45484 existing records from primary storage. [2025-10-06T18:43:21.621356] [INFO ] [MAIN ] ENOV: Loaded 45484 existing records. [2025-10-06T18:43:21.820308] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:43:21.820683] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-06T18:43:21.820755] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-06T18:43:21.822230] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-06T18:43:21.822295] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-06T18:43:22.012138] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-06T18:43:22.202619] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:43:22.225515] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-06T18:43:22.747531] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T18:43:22.748510] [INFO ] [REMOTE ] ENFY: Full fetch complete (5677 records). [2025-10-06T18:43:22.748582] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-06T18:43:23.030778] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-06T18:43:23.129944] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-06T18:43:23.130066] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-06T18:43:23.130358] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-06T18:43:23.130422] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-06T18:43:23.130909] [DEBUG] [LOCAL ] ENFY: Trimmed 5677 records to 3206 (keeping 200 days of data) [2025-10-06T18:43:23.151763] [DEBUG] [LOCAL ] ENFY: Primary data saved (3206 records). [2025-10-06T18:43:23.151941] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-06T18:43:23.152062] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENFY took 34.3s. Estimated remaining: 3h 48m 10s. Rate: 7.2 symbols/min [2025-10-06T18:43:23.324972] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:43:23.376029] [DEBUG] [LOCAL ] ENR: Loaded 43463 existing records from primary storage. [2025-10-06T18:43:23.376482] [INFO ] [MAIN ] ENR: Loaded 43463 existing records. [2025-10-06T18:43:23.596356] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:43:23.596841] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-06T18:43:23.596914] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-06T18:43:23.598593] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-06T18:43:23.598703] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-06T18:43:23.682820] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-06T18:43:23.830732] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-06T18:43:24.019221] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:43:24.625548] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-06T18:43:25.240164] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T18:43:25.242168] [INFO ] [REMOTE ] ENIC: Full fetch complete (51379 records). [2025-10-06T18:43:25.242275] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-06T18:43:25.430998] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-06T18:43:25.649916] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-06T18:43:25.650019] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-06T18:43:25.650843] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-06T18:43:25.650924] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-06T18:43:25.652175] [DEBUG] [LOCAL ] ENIC: Trimmed 51379 records to 36237 (keeping 200 days of data) [2025-10-06T18:43:25.892152] [DEBUG] [LOCAL ] ENIC: Primary data saved (36237 records). [2025-10-06T18:43:25.892348] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-06T18:43:25.892473] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENIC took 33.2s. Estimated remaining: 3h 47m 49s. Rate: 7.2 symbols/min [2025-10-06T18:43:26.115261] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:43:26.143220] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T18:43:26.179008] [DEBUG] [LOCAL ] ENS: Loaded 29820 existing records from primary storage. [2025-10-06T18:43:26.179407] [INFO ] [MAIN ] ENS: Loaded 29820 existing records. [2025-10-06T18:43:26.235165] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-06T18:43:26.366229] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:43:26.366511] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-06T18:43:26.366557] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-06T18:43:26.366805] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-06T18:43:26.366862] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-06T18:43:26.733508] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:43:26.752568] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T18:43:27.020619] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T18:43:27.025458] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-06T18:43:27.450590] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-06T18:43:27.825540] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-06T18:43:28.251214] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-06T18:43:28.625545] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-06T18:43:29.425539] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-06T18:43:29.968272] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T18:43:30.225591] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-06T18:43:30.433051] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T18:43:31.025582] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-06T18:43:31.318122] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T18:43:31.447229] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-06T18:43:31.825537] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-06T18:43:32.625540] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-06T18:43:32.952482] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T18:43:33.055486] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-06T18:43:33.425528] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-06T18:43:34.225532] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-06T18:43:34.720888] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T18:43:35.025545] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-06T18:43:35.392661] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-06T18:43:35.393521] [INFO ] [REMOTE ] ENO: Full fetch complete (3089 records). [2025-10-06T18:43:35.393596] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-06T18:43:35.394028] [FATAL] [VALIDATOR ] ENO: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:43:35.394116] [FATAL] [MAIN ] ENO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:43:35.394160] [WARN ] [MAIN ] ENO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:43:35.394210] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-06T18:43:35.394319] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-06T18:43:35.394372] [INFO ] [LOCAL ] ENO: Starting deletion of derivative data. [2025-10-06T18:43:35.394626] [DEBUG] [LOCAL ] ENO: Deleted derivative data file. [2025-10-06T18:43:35.394747] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENO took 24.3s. Estimated remaining: 3h 47m 43s. Rate: 7.2 symbols/min [2025-10-06T18:43:35.581804] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:43:35.607405] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T18:43:35.636480] [DEBUG] [LOCAL ] ENVA: Loaded 25618 existing records from primary storage. [2025-10-06T18:43:35.636810] [INFO ] [MAIN ] ENVA: Loaded 25618 existing records. [2025-10-06T18:43:35.810528] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:43:35.810788] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-06T18:43:35.810837] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-06T18:43:35.811047] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-06T18:43:35.811103] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-06T18:43:35.830903] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-06T18:43:36.166800] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:43:36.625541] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-06T18:43:37.117810] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-06T18:43:37.425535] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-06T18:43:37.775561] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T18:43:38.225590] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-06T18:43:39.025769] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-06T18:43:39.025673] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T18:43:39.392837] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-06T18:43:39.825498] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-06T18:43:40.067140] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T18:43:40.625585] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-06T18:43:41.247855] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T18:43:41.425536] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-06T18:43:41.988677] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-06T18:43:42.225556] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-06T18:43:42.937443] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T18:43:43.025483] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-06T18:43:43.721171] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T18:43:43.825536] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-06T18:43:44.415204] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T18:43:44.625558] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-06T18:43:45.173757] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-06T18:43:45.425572] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-06T18:43:46.225607] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-06T18:43:46.295253] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T18:43:46.874806] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T18:43:47.025542] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-06T18:43:47.375369] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T18:43:47.825574] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-06T18:43:47.902725] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T18:43:48.625562] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-06T18:43:49.425837] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-06T18:43:49.503875] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T18:43:49.839247] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-06T18:43:50.225567] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-06T18:43:50.698034] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T18:43:51.025600] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-06T18:43:51.825568] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-06T18:43:51.943966] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T18:43:52.355845] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T18:43:52.625566] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-06T18:43:53.425522] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-06T18:43:53.529686] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T18:43:53.954017] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T18:43:54.225538] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-06T18:43:54.757898] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-06T18:43:55.025542] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-06T18:43:55.825576] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-06T18:43:55.984117] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T18:43:56.328856] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-06T18:43:56.625560] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-06T18:43:56.897078] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T18:43:57.425549] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-06T18:43:57.464147] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T18:43:57.466283] [INFO ] [REMOTE ] ENS: Full fetch complete (42235 records). [2025-10-06T18:43:57.466383] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-06T18:43:57.899209] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-06T18:43:57.899331] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-06T18:43:57.900084] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-06T18:43:57.900148] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-06T18:43:57.901219] [DEBUG] [LOCAL ] ENS: Trimmed 42235 records to 29382 (keeping 200 days of data) [2025-10-06T18:43:58.093200] [DEBUG] [LOCAL ] ENS: Primary data saved (29382 records). [2025-10-06T18:43:58.093377] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-06T18:43:58.093472] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENS took 32.2s. Estimated remaining: 3h 48m 6s. Rate: 7.1 symbols/min [2025-10-06T18:43:58.231876] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-06T18:43:58.264026] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:43:58.278978] [DEBUG] [LOCAL ] EOD: Loaded 14703 existing records from primary storage. [2025-10-06T18:43:58.279237] [INFO ] [MAIN ] EOD: Loaded 14703 existing records. [2025-10-06T18:43:58.468526] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:43:58.468785] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-06T18:43:58.468837] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-06T18:43:58.469350] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-06T18:43:58.469410] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-06T18:43:58.848957] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:43:58.877576] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T18:43:59.025526] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-06T18:43:59.630078] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-06T18:43:59.825562] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-06T18:44:00.078097] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T18:44:00.625604] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-06T18:44:00.960457] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-06T18:44:01.425584] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-06T18:44:01.905234] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T18:44:02.225739] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-06T18:44:02.935372] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-06T18:44:02.959603] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T18:44:02.962387] [INFO ] [REMOTE ] ENR: Full fetch complete (58823 records). [2025-10-06T18:44:02.962524] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-06T18:44:03.030640] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-06T18:44:03.354963] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-06T18:44:03.355057] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-06T18:44:03.355929] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-06T18:44:03.355994] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-06T18:44:03.357342] [DEBUG] [LOCAL ] ENR: Trimmed 58823 records to 43088 (keeping 200 days of data) [2025-10-06T18:44:03.618024] [DEBUG] [LOCAL ] ENR: Primary data saved (43088 records). [2025-10-06T18:44:03.618209] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-06T18:44:03.618910] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENR took 40.5s. Estimated remaining: 3h 47m 51s. Rate: 7.1 symbols/min [2025-10-06T18:44:03.789901] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:44:03.827864] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-06T18:44:03.853217] [DEBUG] [LOCAL ] EOG: Loaded 54124 existing records from primary storage. [2025-10-06T18:44:03.853576] [INFO ] [MAIN ] EOG: Loaded 54124 existing records. [2025-10-06T18:44:04.035856] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:44:04.036112] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-06T18:44:04.036876] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-06T18:44:04.038353] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-06T18:44:04.038414] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-06T18:44:04.404853] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:44:04.420327] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T18:44:04.625501] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-06T18:44:05.430121] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-06T18:44:05.432802] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T18:44:05.485549] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T18:44:06.225611] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-06T18:44:06.399846] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T18:44:06.402517] [INFO ] [REMOTE ] ENVA: Full fetch complete (36805 records). [2025-10-06T18:44:06.402701] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-06T18:44:06.778196] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-06T18:44:06.778296] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-06T18:44:06.778986] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-06T18:44:06.779050] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-06T18:44:06.779972] [DEBUG] [LOCAL ] ENVA: Trimmed 36805 records to 25317 (keeping 200 days of data) [2025-10-06T18:44:06.930953] [DEBUG] [LOCAL ] ENVA: Primary data saved (25317 records). [2025-10-06T18:44:06.931124] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-06T18:44:06.931229] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENVA took 31.5s. Estimated remaining: 3h 47m 32s. Rate: 7.2 symbols/min [2025-10-06T18:44:07.030770] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-06T18:44:07.106068] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:44:07.106253] [DEBUG] [LOCAL ] EOI: No existing data file found in primary storage. [2025-10-06T18:44:07.106309] [WARN ] [MAIN ] EOI: No existing data found, performing full refresh instead. [2025-10-06T18:44:07.106421] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-06T18:44:07.106463] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-06T18:44:07.106507] [DEBUG] [LOCAL ] EOI: No primary data file found to delete. [2025-10-06T18:44:07.106541] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-06T18:44:07.492467] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:44:07.568454] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T18:44:07.571324] [INFO ] [REMOTE ] ENOV: Full fetch complete (63299 records). [2025-10-06T18:44:07.571464] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-06T18:44:07.831635] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-06T18:44:07.968480] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-06T18:44:07.968588] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-06T18:44:07.969459] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-06T18:44:07.969523] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-06T18:44:07.971061] [DEBUG] [LOCAL ] ENOV: Trimmed 63299 records to 44760 (keeping 200 days of data) [2025-10-06T18:44:08.228528] [DEBUG] [LOCAL ] ENOV: Primary data saved (44760 records). [2025-10-06T18:44:08.228710] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-06T18:44:08.228807] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENOV took 46.9s. Estimated remaining: 3h 47m 8s. Rate: 7.2 symbols/min [2025-10-06T18:44:08.415218] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:44:08.415491] [DEBUG] [LOCAL ] EOS: No existing data file found in primary storage. [2025-10-06T18:44:08.415531] [WARN ] [MAIN ] EOS: No existing data found, performing full refresh instead. [2025-10-06T18:44:08.415695] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-06T18:44:08.415751] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-06T18:44:08.415798] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-10-06T18:44:08.415832] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-06T18:44:08.630805] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-06T18:44:08.849787] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T18:44:08.854410] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:44:09.056129] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-06T18:44:09.425562] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-06T18:44:09.909235] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T18:44:10.225550] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-06T18:44:10.801028] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-06T18:44:11.025502] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-06T18:44:11.210344] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T18:44:11.825541] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-06T18:44:11.968362] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-06T18:44:12.602062] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T18:44:12.625476] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-06T18:44:13.425509] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-06T18:44:13.511329] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-06T18:44:14.225580] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-06T18:44:14.753553] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-06T18:44:15.025502] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-06T18:44:15.187880] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T18:44:15.825567] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-06T18:44:15.992825] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T18:44:16.595520] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-06T18:44:16.625547] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-06T18:44:17.347877] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-06T18:44:17.425564] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-06T18:44:18.213323] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-06T18:44:18.225461] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-06T18:44:19.025720] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-06T18:44:19.026637] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T18:44:19.825528] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-06T18:44:19.932973] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T18:44:20.625613] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-06T18:44:20.666668] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T18:44:21.425702] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-06T18:44:21.705685] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T18:44:22.216280] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T18:44:22.217711] [INFO ] [REMOTE ] EOI: Full fetch complete (16248 records). [2025-10-06T18:44:22.217785] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-06T18:44:22.230786] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-06T18:44:22.582000] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-06T18:44:22.582094] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-06T18:44:22.582369] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-06T18:44:22.582408] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-06T18:44:22.583011] [DEBUG] [LOCAL ] EOI: Trimmed 16248 records to 10822 (keeping 200 days of data) [2025-10-06T18:44:22.648330] [DEBUG] [LOCAL ] EOI: Primary data saved (10822 records). [2025-10-06T18:44:22.648471] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-06T18:44:22.648557] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOI took 15.7s. Estimated remaining: 3h 47m 13s. Rate: 7.2 symbols/min [2025-10-06T18:44:22.816817] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:44:22.827115] [DEBUG] [LOCAL ] EOT: Loaded 6963 existing records from primary storage. [2025-10-06T18:44:22.827394] [INFO ] [MAIN ] EOT: Loaded 6963 existing records. [2025-10-06T18:44:23.003990] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:44:23.004235] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-06T18:44:23.004282] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-06T18:44:23.004533] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-06T18:44:23.004591] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-06T18:44:23.034380] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-06T18:44:23.376322] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:44:23.383231] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-06T18:44:23.825535] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-06T18:44:24.130399] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T18:44:24.625592] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-06T18:44:24.975629] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T18:44:25.425550] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-06T18:44:26.202689] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T18:44:26.225581] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-06T18:44:26.567611] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-06T18:44:26.915344] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-06T18:44:27.025559] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-06T18:44:27.825534] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-06T18:44:28.111621] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-06T18:44:28.571534] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T18:44:28.625481] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-06T18:44:29.329551] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-06T18:44:29.425539] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-06T18:44:30.089327] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-06T18:44:30.225545] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-06T18:44:31.025519] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-06T18:44:31.333776] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T18:44:31.780304] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T18:44:31.825532] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-06T18:44:32.443025] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-06T18:44:32.625485] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-06T18:44:33.425506] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-06T18:44:33.545967] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T18:44:33.547586] [INFO ] [REMOTE ] EOD: Full fetch complete (20507 records). [2025-10-06T18:44:33.547683] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-06T18:44:33.902969] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-06T18:44:33.903059] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-06T18:44:33.903525] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-06T18:44:33.903566] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-06T18:44:33.904154] [DEBUG] [LOCAL ] EOD: Trimmed 20507 records to 14608 (keeping 200 days of data) [2025-10-06T18:44:33.992185] [DEBUG] [LOCAL ] EOD: Primary data saved (14608 records). [2025-10-06T18:44:33.992348] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-06T18:44:33.992441] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOD took 35.9s. Estimated remaining: 3h 47m 11s. Rate: 7.1 symbols/min [2025-10-06T18:44:34.165561] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:44:34.195360] [DEBUG] [LOCAL ] EPAC: Loaded 27317 existing records from primary storage. [2025-10-06T18:44:34.195688] [INFO ] [MAIN ] EPAC: Loaded 27317 existing records. [2025-10-06T18:44:34.230619] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-06T18:44:34.379059] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:44:34.379320] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-06T18:44:34.379366] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-06T18:44:34.380112] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-06T18:44:34.380172] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-06T18:44:34.749949] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:44:35.025489] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-06T18:44:35.159887] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-06T18:44:35.162042] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T18:44:35.734463] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T18:44:35.825540] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-06T18:44:36.620843] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T18:44:36.625464] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-06T18:44:37.425555] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-06T18:44:37.843424] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T18:44:38.225546] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-06T18:44:38.940291] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T18:44:39.002854] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T18:44:39.025466] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-06T18:44:39.825511] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-06T18:44:39.914298] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-06T18:44:40.625504] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-06T18:44:41.001132] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T18:44:41.287122] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T18:44:41.289306] [INFO ] [REMOTE ] EOS: Full fetch complete (23475 records). [2025-10-06T18:44:41.289422] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-06T18:44:41.430785] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-06T18:44:41.693250] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-06T18:44:41.693355] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-06T18:44:41.694303] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-06T18:44:41.694373] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-06T18:44:41.695324] [DEBUG] [LOCAL ] EOS: Trimmed 23475 records to 15387 (keeping 200 days of data) [2025-10-06T18:44:41.815319] [DEBUG] [LOCAL ] EOS: Primary data saved (15387 records). [2025-10-06T18:44:41.815593] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-06T18:44:41.815737] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOS took 33.6s. Estimated remaining: 3h 47m 1s. Rate: 7.1 symbols/min [2025-10-06T18:44:41.994532] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:44:42.039303] [DEBUG] [LOCAL ] EPAM: Loaded 40286 existing records from primary storage. [2025-10-06T18:44:42.039697] [INFO ] [MAIN ] EPAM: Loaded 40286 existing records. [2025-10-06T18:44:42.231182] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-06T18:44:42.238218] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:44:42.238963] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-06T18:44:42.239107] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-06T18:44:42.240512] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-06T18:44:42.240597] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-06T18:44:42.374717] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-06T18:44:42.626439] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:44:43.025547] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-06T18:44:43.825531] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-06T18:44:44.064353] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T18:44:44.283770] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-06T18:44:44.495863] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T18:44:44.625567] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-06T18:44:45.425620] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-06T18:44:45.759685] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T18:44:46.225603] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-06T18:44:46.241495] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-06T18:44:47.025546] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-06T18:44:47.609148] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-06T18:44:47.610166] [INFO ] [REMOTE ] EOT: Full fetch complete (10735 records). [2025-10-06T18:44:47.610238] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-06T18:44:47.830757] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-06T18:44:47.980828] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-06T18:44:47.980954] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-06T18:44:47.981237] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-06T18:44:47.981384] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-06T18:44:47.982105] [DEBUG] [LOCAL ] EOT: Trimmed 10735 records to 6792 (keeping 200 days of data) [2025-10-06T18:44:48.024717] [DEBUG] [LOCAL ] EOT: Primary data saved (6792 records). [2025-10-06T18:44:48.025056] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-06T18:44:48.025370] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOT took 25.4s. Estimated remaining: 3h 46m 48s. Rate: 7.2 symbols/min [2025-10-06T18:44:48.172923] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-06T18:44:48.261029] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:44:48.304882] [DEBUG] [LOCAL ] EPC: Loaded 40372 existing records from primary storage. [2025-10-06T18:44:48.305292] [INFO ] [MAIN ] EPC: Loaded 40372 existing records. [2025-10-06T18:44:48.496817] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:44:48.497040] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-06T18:44:48.497087] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-06T18:44:48.498403] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-06T18:44:48.498466] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-06T18:44:48.636016] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-06T18:44:48.905384] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:44:49.251743] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T18:44:49.425547] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-06T18:44:50.208555] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T18:44:50.225485] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-06T18:44:51.031051] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-06T18:44:51.047354] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T18:44:51.805058] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T18:44:51.825522] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-06T18:44:51.909298] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-06T18:44:52.625733] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-06T18:44:53.425614] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-06T18:44:53.649567] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-06T18:44:53.964786] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T18:44:54.225545] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-06T18:44:54.440744] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T18:44:55.025636] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-06T18:44:55.602349] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T18:44:55.825519] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-06T18:44:56.256068] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T18:44:56.625604] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-06T18:44:56.733862] [DEBUG] [REMOTE ] EPAC: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-06T18:44:56.734252] [WARN ] [REMOTE ] EPAC: No data returned for month 2025-07 [2025-10-06T18:44:56.734364] [FATAL] [REMOTE ] EPAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:44:56.734467] [FATAL] [MAIN ] EPAC: Failed to fetch primary data. [2025-10-06T18:44:56.734541] [WARN ] [MAIN ] EPAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:44:56.734624] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-06T18:44:56.734757] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-10-06T18:44:56.734820] [INFO ] [LOCAL ] EPAC: Starting deletion of derivative data. [2025-10-06T18:44:56.735213] [DEBUG] [LOCAL ] EPAC: Deleted derivative data file. [2025-10-06T18:44:56.735322] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EPAC took 22.7s. Estimated remaining: 3h 46m 40s. Rate: 7.2 symbols/min [2025-10-06T18:44:56.929790] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:44:56.988616] [DEBUG] [LOCAL ] EPD: Loaded 54388 existing records from primary storage. [2025-10-06T18:44:56.989125] [INFO ] [MAIN ] EPD: Loaded 54388 existing records. [2025-10-06T18:44:57.220064] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:44:57.220308] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-06T18:44:57.220369] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-06T18:44:57.221978] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-06T18:44:57.222044] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-06T18:44:57.430626] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-06T18:44:57.639093] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:44:57.670152] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T18:44:58.225612] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-06T18:44:58.974988] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T18:44:59.025567] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-06T18:44:59.825537] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-06T18:45:00.112270] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T18:45:00.505438] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T18:45:00.625601] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-06T18:45:01.286971] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T18:45:01.425594] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-06T18:45:02.225540] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-06T18:45:02.284768] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T18:45:03.025613] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-06T18:45:03.421694] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-06T18:45:03.825577] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-06T18:45:03.991532] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-06T18:45:03.995093] [INFO ] [REMOTE ] EOG: Full fetch complete (77279 records). [2025-10-06T18:45:03.995292] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-06T18:45:04.437333] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-06T18:45:04.437485] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-06T18:45:04.438477] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-06T18:45:04.438558] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-06T18:45:04.440234] [DEBUG] [LOCAL ] EOG: Trimmed 77279 records to 53344 (keeping 200 days of data) [2025-10-06T18:45:04.630214] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-06T18:45:04.776747] [DEBUG] [LOCAL ] EOG: Primary data saved (53344 records). [2025-10-06T18:45:04.776898] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-06T18:45:04.777564] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EOG took 1m 1s. Estimated remaining: 3h 46m 31s. Rate: 7.2 symbols/min [2025-10-06T18:45:04.955634] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:45:04.956095] [DEBUG] [LOCAL ] EPR: No existing data file found in primary storage. [2025-10-06T18:45:04.956195] [WARN ] [MAIN ] EPR: No existing data found, performing full refresh instead. [2025-10-06T18:45:04.956373] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-06T18:45:04.956426] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-06T18:45:04.956475] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-06T18:45:04.956531] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-06T18:45:05.195190] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-06T18:45:05.395976] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:45:05.419899] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T18:45:05.428452] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-06T18:45:06.225543] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-06T18:45:06.342488] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T18:45:07.025573] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-06T18:45:07.402711] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T18:45:07.441890] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-06T18:45:07.825561] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-06T18:45:08.625499] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-06T18:45:08.753155] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T18:45:09.420772] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T18:45:09.429424] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-06T18:45:10.225517] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-06T18:45:10.326442] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T18:45:11.025510] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-06T18:45:11.644311] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-06T18:45:11.714829] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T18:45:11.825545] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-06T18:45:12.625521] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-06T18:45:12.728626] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T18:45:13.425596] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-06T18:45:13.649857] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T18:45:14.225543] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-06T18:45:14.443572] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T18:45:14.935310] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T18:45:15.025492] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-06T18:45:15.790146] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T18:45:15.825473] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-06T18:45:16.625586] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-06T18:45:16.751135] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T18:45:17.425537] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-06T18:45:17.497418] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T18:45:18.139056] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T18:45:18.225487] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-06T18:45:19.025534] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-06T18:45:19.402766] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-06T18:45:19.834230] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-06T18:45:19.855877] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T18:45:20.625516] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-06T18:45:20.893960] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T18:45:21.425547] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-06T18:45:21.938847] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-06T18:45:22.225531] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-06T18:45:22.271078] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T18:45:23.025499] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-06T18:45:23.067758] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T18:45:23.782058] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T18:45:23.825492] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-06T18:45:24.249312] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T18:45:24.251797] [INFO ] [REMOTE ] EPC: Full fetch complete (56771 records). [2025-10-06T18:45:24.251973] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-06T18:45:24.252861] [FATAL] [VALIDATOR ] EPC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:45:24.252972] [FATAL] [MAIN ] EPC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:45:24.253015] [WARN ] [MAIN ] EPC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:45:24.253068] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-06T18:45:24.253175] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-06T18:45:24.253249] [INFO ] [LOCAL ] EPC: Starting deletion of derivative data. [2025-10-06T18:45:24.253599] [DEBUG] [LOCAL ] EPC: Deleted derivative data file. [2025-10-06T18:45:24.253763] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPC took 36.2s. Estimated remaining: 3h 46m 47s. Rate: 7.1 symbols/min [2025-10-06T18:45:24.430281] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:45:24.485253] [DEBUG] [LOCAL ] EPRT: Loaded 49188 existing records from primary storage. [2025-10-06T18:45:24.485634] [INFO ] [MAIN ] EPRT: Loaded 49188 existing records. [2025-10-06T18:45:24.631364] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-06T18:45:24.674876] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:45:24.675175] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-06T18:45:24.675224] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-06T18:45:24.676854] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-06T18:45:24.677114] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-06T18:45:25.046326] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:45:25.425491] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-06T18:45:25.531461] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T18:45:25.536067] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-10-06T18:45:25.536224] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-06T18:45:25.946730] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-06T18:45:25.946830] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-06T18:45:25.947828] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-06T18:45:25.947892] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-06T18:45:25.949467] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 53611 (keeping 200 days of data) [2025-10-06T18:45:26.220605] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T18:45:26.230725] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-06T18:45:26.321868] [DEBUG] [LOCAL ] EPD: Primary data saved (53611 records). [2025-10-06T18:45:26.322048] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-06T18:45:26.322138] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPD took 29.6s. Estimated remaining: 3h 46m 25s. Rate: 7.1 symbols/min [2025-10-06T18:45:26.488620] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:45:26.488856] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-06T18:45:26.488897] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-06T18:45:26.489010] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-06T18:45:26.489051] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-06T18:45:26.489092] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-06T18:45:26.489122] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-06T18:45:26.843847] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:45:27.025497] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-06T18:45:27.115342] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T18:45:27.779160] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T18:45:27.825528] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-06T18:45:28.559498] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T18:45:28.562296] [INFO ] [REMOTE ] EPAM: Full fetch complete (56035 records). [2025-10-06T18:45:28.562458] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-06T18:45:28.630711] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-06T18:45:29.028073] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-06T18:45:29.028236] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-06T18:45:29.029216] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-06T18:45:29.029391] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-06T18:45:29.031778] [DEBUG] [LOCAL ] EPAM: Trimmed 56035 records to 39686 (keeping 200 days of data) [2025-10-06T18:45:29.071784] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T18:45:29.345335] [DEBUG] [LOCAL ] EPAM: Primary data saved (39686 records). [2025-10-06T18:45:29.345574] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-06T18:45:29.345706] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPAM took 47.5s. Estimated remaining: 3h 46m 5s. Rate: 7.2 symbols/min [2025-10-06T18:45:29.430840] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-06T18:45:29.539863] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:45:29.540108] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-10-06T18:45:29.540148] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-10-06T18:45:29.540283] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-06T18:45:29.540330] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-06T18:45:29.540372] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-10-06T18:45:29.540406] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-06T18:45:29.943254] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:45:30.225589] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-06T18:45:30.358778] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T18:45:30.414526] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T18:45:31.025570] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-06T18:45:31.825542] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-06T18:45:31.884616] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T18:45:32.315435] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T18:45:32.625535] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-06T18:45:32.685298] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T18:45:33.425540] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-06T18:45:34.191432] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-06T18:45:34.219754] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T18:45:34.228682] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-06T18:45:35.025600] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-06T18:45:35.825501] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-06T18:45:35.854674] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T18:45:36.630322] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-06T18:45:36.633903] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T18:45:36.702278] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T18:45:37.425564] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-06T18:45:38.225602] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-06T18:45:38.260829] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T18:45:38.264555] [INFO ] [REMOTE ] EPR: Full fetch complete (63025 records). [2025-10-06T18:45:38.264794] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-06T18:45:38.692182] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-06T18:45:38.692331] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-06T18:45:38.693701] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-06T18:45:38.693779] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-06T18:45:38.695745] [DEBUG] [LOCAL ] EPR: Trimmed 63025 records to 43944 (keeping 200 days of data) [2025-10-06T18:45:39.017620] [DEBUG] [LOCAL ] EPR: Primary data saved (43944 records). [2025-10-06T18:45:39.017819] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-06T18:45:39.017906] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPR took 34.2s. Estimated remaining: 3h 45m 59s. Rate: 7.2 symbols/min [2025-10-06T18:45:39.030862] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-06T18:45:39.198550] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:45:39.198917] [DEBUG] [LOCAL ] EQNR: No existing data file found in primary storage. [2025-10-06T18:45:39.199032] [WARN ] [MAIN ] EQNR: No existing data found, performing full refresh instead. [2025-10-06T18:45:39.199201] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-06T18:45:39.199327] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-06T18:45:39.199477] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-10-06T18:45:39.199590] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-06T18:45:39.392816] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-06T18:45:39.626231] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:45:39.825537] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-06T18:45:39.972444] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T18:45:40.021350] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T18:45:40.625575] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-06T18:45:41.425540] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-06T18:45:41.586939] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T18:45:42.225513] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-06T18:45:42.397021] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T18:45:43.025489] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-06T18:45:43.196955] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T18:45:43.763365] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T18:45:43.825500] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-06T18:45:43.834858] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T18:45:44.625533] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-06T18:45:45.305767] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-06T18:45:45.425576] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-06T18:45:45.621031] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T18:45:46.225613] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-06T18:45:47.025499] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-06T18:45:47.158173] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T18:45:47.580281] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T18:45:47.825555] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-06T18:45:48.625539] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-06T18:45:48.708621] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T18:45:49.425502] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-06T18:45:49.572631] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T18:45:49.666880] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T18:45:50.225619] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-06T18:45:51.025543] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-06T18:45:51.069001] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T18:45:51.731466] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T18:45:51.825544] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-06T18:45:52.009291] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-06T18:45:52.625573] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-06T18:45:53.425507] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-06T18:45:53.746747] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T18:45:54.164108] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T18:45:54.225563] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-06T18:45:55.025578] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-06T18:45:55.258230] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T18:45:55.830635] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-06T18:45:55.844046] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T18:45:55.880470] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-06T18:45:56.625737] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-06T18:45:57.425528] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-06T18:45:57.866807] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-06T18:45:58.059594] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T18:45:58.063031] [INFO ] [REMOTE ] EPRT: Full fetch complete (68935 records). [2025-10-06T18:45:58.063172] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-06T18:45:58.232687] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-06T18:45:58.349737] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T18:45:58.383511] [INFO ] [REMOTE ] EQBK: Full fetch complete (15422 records). [2025-10-06T18:45:58.396169] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-06T18:45:58.402628] [FATAL] [VALIDATOR ] EQBK: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T18:45:58.418137] [FATAL] [MAIN ] EQBK: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:45:58.437691] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:45:58.456926] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-06T18:45:58.457718] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-06T18:45:58.473492] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-06T18:45:58.492598] [DEBUG] [LOCAL ] EQBK: No derivative data file found to delete. [2025-10-06T18:45:58.492780] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EQBK took 32.2s. Estimated remaining: 3h 46m 14s. Rate: 7.1 symbols/min [2025-10-06T18:45:58.528142] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-06T18:45:58.539865] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-06T18:45:58.573082] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-06T18:45:58.588940] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-06T18:45:58.652802] [DEBUG] [LOCAL ] EPRT: Trimmed 68935 records to 48481 (keeping 200 days of data) [2025-10-06T18:45:58.671296] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:45:58.836613] [DEBUG] [LOCAL ] EQR: Loaded 52274 existing records from primary storage. [2025-10-06T18:45:58.845073] [INFO ] [MAIN ] EQR: Loaded 52274 existing records. [2025-10-06T18:45:59.027704] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-06T18:45:59.167883] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:45:59.171149] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-06T18:45:59.171480] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-06T18:45:59.173609] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-06T18:45:59.174844] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-06T18:45:59.581931] [DEBUG] [LOCAL ] EPRT: Primary data saved (48481 records). [2025-10-06T18:45:59.598431] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-06T18:45:59.598585] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EPRT took 35.3s. Estimated remaining: 3h 45m 51s. Rate: 7.1 symbols/min [2025-10-06T18:45:59.602224] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:45:59.825561] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-06T18:45:59.986761] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T18:46:00.625501] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-06T18:46:00.706372] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T18:46:01.429905] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-06T18:46:01.436945] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T18:46:02.225545] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-06T18:46:02.280462] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T18:46:03.025509] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-06T18:46:03.238287] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-06T18:46:03.830635] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-06T18:46:03.846377] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T18:46:04.545067] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T18:46:04.625499] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-06T18:46:05.295504] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T18:46:05.425569] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-06T18:46:05.887799] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T18:46:06.225560] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-06T18:46:07.025733] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-06T18:46:07.311342] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T18:46:07.737979] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T18:46:07.742750] [INFO ] [REMOTE ] EQH: Full fetch complete (76385 records). [2025-10-06T18:46:07.743005] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-06T18:46:07.830623] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-06T18:46:08.197576] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-06T18:46:08.197818] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-06T18:46:08.199482] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-06T18:46:08.199564] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-06T18:46:08.201915] [DEBUG] [LOCAL ] EQH: Trimmed 76385 records to 52656 (keeping 200 days of data) [2025-10-06T18:46:08.562513] [DEBUG] [LOCAL ] EQH: Primary data saved (52656 records). [2025-10-06T18:46:08.562765] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-06T18:46:08.562889] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 39.2s. Estimated remaining: 3h 45m 43s. Rate: 7.1 symbols/min [2025-10-06T18:46:08.699021] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T18:46:08.710441] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-06T18:46:09.507856] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-06T18:46:09.511470] [INFO ] [REMOTE ] EQNR: Full fetch complete (76801 records). [2025-10-06T18:46:09.511691] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-06T18:46:09.902068] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-06T18:46:09.902205] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-06T18:46:09.903242] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-06T18:46:09.903363] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-06T18:46:09.905049] [DEBUG] [LOCAL ] EQNR: Trimmed 76801 records to 53023 (keeping 200 days of data) [2025-10-06T18:46:10.157412] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T18:46:10.170681] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-06T18:46:10.273952] [DEBUG] [LOCAL ] EQNR: Primary data saved (53023 records). [2025-10-06T18:46:10.274132] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-06T18:46:10.274234] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 31.3s. Estimated remaining: 3h 45m 21s. Rate: 7.2 symbols/min [2025-10-06T18:46:11.848779] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T18:46:11.866332] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-06T18:46:13.417875] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T18:46:13.428426] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-06T18:46:14.997575] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T18:46:15.009000] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-06T18:46:16.649266] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T18:46:16.660759] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-06T18:46:18.415343] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T18:46:18.427334] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-06T18:46:19.941936] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T18:46:19.945048] [INFO ] [REMOTE ] EQR: Full fetch complete (74056 records). [2025-10-06T18:46:19.945232] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-06T18:46:20.348987] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-06T18:46:20.349106] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-06T18:46:20.350138] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-06T18:46:20.350212] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-06T18:46:20.351800] [DEBUG] [LOCAL ] EQR: Trimmed 74056 records to 51571 (keeping 200 days of data) [2025-10-06T18:46:20.673736] [DEBUG] [LOCAL ] EQR: Primary data saved (51571 records). [2025-10-06T18:46:20.673888] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-06T18:46:20.673993] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQR took 22.2s. Estimated remaining: 3h 45m 17s. Rate: 7.2 symbols/min [2025-10-06T18:46:21.217983] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:46:21.296444] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:46:21.354275] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:46:21.374851] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:46:21.375320] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-06T18:46:21.375593] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-06T18:46:21.378373] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-06T18:46:21.378483] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-06T18:46:21.378603] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-06T18:46:21.378761] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-06T18:46:21.429858] [DEBUG] [LOCAL ] EQV: Loaded 2754 existing records from primary storage. [2025-10-06T18:46:21.459747] [INFO ] [MAIN ] EQV: Loaded 2754 existing records. [2025-10-06T18:46:21.745905] [DEBUG] [LOCAL ] ERJ: Loaded 51385 existing records from primary storage. [2025-10-06T18:46:21.776822] [INFO ] [MAIN ] ERJ: Loaded 51385 existing records. [2025-10-06T18:46:21.901322] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-10-06T18:46:21.991302] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:46:21.991734] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-06T18:46:22.002503] [INFO ] [MAIN ] EQT: Loaded 54462 existing records. [2025-10-06T18:46:22.002733] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-06T18:46:22.150685] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-06T18:46:22.174767] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-06T18:46:22.375214] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:46:22.429597] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-06T18:46:22.489996] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:46:22.551319] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-06T18:46:22.599597] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-06T18:46:22.611740] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:46:22.631913] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-06T18:46:22.666060] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-06T18:46:22.671357] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-06T18:46:22.671475] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-06T18:46:22.771583] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-06T18:46:22.828055] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-06T18:46:23.122977] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:46:23.158908] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-06T18:46:23.166547] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-06T18:46:23.207011] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-06T18:46:23.549260] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:46:23.567696] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-06T18:46:23.588856] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:46:23.589416] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-06T18:46:23.635622] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-06T18:46:23.636724] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-06T18:46:23.979855] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-06T18:46:23.980935] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-06T18:46:23.982493] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T18:46:23.984665] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-06T18:46:24.263402] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-06T18:46:24.264635] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-06T18:46:24.775789] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-06T18:46:24.782403] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-06T18:46:24.783999] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-06T18:46:24.786353] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-06T18:46:25.036845] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T18:46:25.046330] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-06T18:46:25.440502] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-06T18:46:25.442180] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-06T18:46:25.568106] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T18:46:25.568986] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-06T18:46:25.615352] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-06T18:46:25.626527] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-06T18:46:25.925448] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-06T18:46:25.986772] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-06T18:46:26.225542] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-06T18:46:26.702329] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T18:46:26.740704] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-06T18:46:27.025718] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-06T18:46:27.542715] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-06T18:46:27.544274] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T18:46:27.825472] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-06T18:46:28.360156] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-06T18:46:28.625586] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-06T18:46:29.425584] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-06T18:46:30.121303] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T18:46:30.225478] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-06T18:46:31.025531] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-06T18:46:31.406559] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-06T18:46:31.566123] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-06T18:46:31.825486] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-06T18:46:32.066548] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-06T18:46:32.567798] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T18:46:32.625529] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-06T18:46:33.056425] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-06T18:46:33.425687] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-06T18:46:34.225577] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-06T18:46:34.576906] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-06T18:46:34.577682] [INFO ] [REMOTE ] EQV: Full fetch complete (5765 records). [2025-10-06T18:46:34.577752] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-06T18:46:34.944871] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-06T18:46:34.944979] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-06T18:46:34.945168] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-06T18:46:34.945207] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-06T18:46:34.945710] [DEBUG] [LOCAL ] EQV: Trimmed 5765 records to 2713 (keeping 200 days of data) [2025-10-06T18:46:34.961729] [DEBUG] [LOCAL ] EQV: Primary data saved (2713 records). [2025-10-06T18:46:34.961796] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-06T18:46:34.961877] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQV took 14.3s. Estimated remaining: 3h 45m 21s. Rate: 7.1 symbols/min [2025-10-06T18:46:35.026149] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-06T18:46:35.135369] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:46:35.175407] [DEBUG] [LOCAL ] ERO: Loaded 41941 existing records from primary storage. [2025-10-06T18:46:35.175736] [INFO ] [MAIN ] ERO: Loaded 41941 existing records. [2025-10-06T18:46:35.355483] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:46:35.355735] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-06T18:46:35.355897] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-06T18:46:35.356976] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-06T18:46:35.357038] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-06T18:46:35.595826] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-06T18:46:35.660017] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-06T18:46:35.818068] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:46:35.825531] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-06T18:46:36.625543] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-06T18:46:37.191947] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-06T18:46:37.425491] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-06T18:46:37.664707] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T18:46:38.005257] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-06T18:46:38.225556] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-06T18:46:38.728120] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-06T18:46:38.729086] [INFO ] [REMOTE ] EQS: Full fetch complete (2486 records). [2025-10-06T18:46:38.729180] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-06T18:46:38.908339] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-06T18:46:38.908582] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:46:38.908674] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:46:38.908745] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-06T18:46:38.908838] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-06T18:46:38.908892] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-06T18:46:38.908949] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-06T18:46:38.909030] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. EQS took 18.2s. Estimated remaining: 3h 45m 3s. Rate: 7.1 symbols/min [2025-10-06T18:46:39.030738] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-06T18:46:39.091056] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:46:39.148453] [DEBUG] [LOCAL ] ES: Loaded 53348 existing records from primary storage. [2025-10-06T18:46:39.148859] [INFO ] [MAIN ] ES: Loaded 53348 existing records. [2025-10-06T18:46:39.323915] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:46:39.324149] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-06T18:46:39.324220] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-06T18:46:39.325580] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-06T18:46:39.325663] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-06T18:46:39.669616] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:46:39.825519] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-06T18:46:40.543478] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T18:46:40.625482] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-06T18:46:41.105785] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T18:46:41.425543] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-06T18:46:42.071887] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T18:46:42.225505] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-06T18:46:42.706836] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T18:46:43.025519] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-06T18:46:43.572074] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T18:46:43.825525] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-06T18:46:44.625568] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-06T18:46:44.703299] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T18:46:45.425506] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-06T18:46:45.462370] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T18:46:46.197499] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T18:46:46.225487] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-06T18:46:47.025513] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-06T18:46:47.098480] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T18:46:47.825499] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-06T18:46:47.885131] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T18:46:48.625492] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-06T18:46:49.197523] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-06T18:46:49.425504] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-06T18:46:49.705809] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T18:46:50.211839] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T18:46:50.225471] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-06T18:46:50.960543] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T18:46:51.025491] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-06T18:46:51.673508] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T18:46:51.825560] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-06T18:46:52.470272] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T18:46:52.625487] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-06T18:46:53.271344] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T18:46:53.425490] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-06T18:46:54.225500] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-06T18:46:54.294223] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T18:46:54.687023] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T18:46:55.025572] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-06T18:46:55.825548] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-06T18:46:56.001177] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T18:46:56.625566] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-06T18:46:56.909442] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-06T18:46:57.425604] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-06T18:46:57.461292] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T18:46:58.225733] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-06T18:46:58.277930] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T18:46:59.025540] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-06T18:46:59.070266] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T18:46:59.791585] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-06T18:46:59.794841] [INFO ] [REMOTE ] ERJ: Full fetch complete (72489 records). [2025-10-06T18:46:59.795013] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-06T18:46:59.830700] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-06T18:47:00.215354] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-06T18:47:00.215481] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-06T18:47:00.216443] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-06T18:47:00.216523] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-06T18:47:00.218237] [DEBUG] [LOCAL ] ERJ: Trimmed 72489 records to 50587 (keeping 200 days of data) [2025-10-06T18:47:00.530239] [DEBUG] [LOCAL ] ERJ: Primary data saved (50587 records). [2025-10-06T18:47:00.530703] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-06T18:47:00.530845] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. ERJ took 39.8s. Estimated remaining: 3h 45m 22s. Rate: 7.1 symbols/min [2025-10-06T18:47:00.630350] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-06T18:47:00.706172] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:47:00.737423] [DEBUG] [LOCAL ] ESAB: Loaded 26556 existing records from primary storage. [2025-10-06T18:47:00.737762] [INFO ] [MAIN ] ESAB: Loaded 26556 existing records. [2025-10-06T18:47:00.919933] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:47:00.920361] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-06T18:47:00.920560] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-06T18:47:00.931613] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-06T18:47:00.950966] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-06T18:47:01.024140] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-06T18:47:01.320222] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:47:01.425512] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-06T18:47:01.549816] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T18:47:02.225500] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-06T18:47:02.343796] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T18:47:02.605261] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-06T18:47:03.025516] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-06T18:47:03.804364] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T18:47:03.807199] [INFO ] [REMOTE ] ERO: Full fetch complete (59622 records). [2025-10-06T18:47:03.807305] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-06T18:47:03.830696] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-06T18:47:04.189833] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-06T18:47:04.189944] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-06T18:47:04.190795] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-06T18:47:04.190869] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-06T18:47:04.192379] [DEBUG] [LOCAL ] ERO: Trimmed 59622 records to 41364 (keeping 200 days of data) [2025-10-06T18:47:04.475481] [DEBUG] [LOCAL ] ERO: Primary data saved (41364 records). [2025-10-06T18:47:04.475677] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-06T18:47:04.477134] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. ERO took 29.5s. Estimated remaining: 3h 45m 5s. Rate: 7.1 symbols/min [2025-10-06T18:47:04.630784] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-06T18:47:04.713830] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:47:04.737827] [DEBUG] [LOCAL ] ESE: Loaded 16903 existing records from primary storage. [2025-10-06T18:47:04.738182] [INFO ] [MAIN ] ESE: Loaded 16903 existing records. [2025-10-06T18:47:05.027493] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:47:05.028586] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-06T18:47:05.028919] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-06T18:47:05.057438] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T18:47:05.054982] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-06T18:47:05.064370] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-06T18:47:05.368341] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-06T18:47:05.439052] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-06T18:47:05.703302] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:47:06.101609] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T18:47:06.225539] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-06T18:47:06.562138] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T18:47:07.025589] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-06T18:47:07.838998] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-06T18:47:07.841599] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T18:47:07.888398] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-06T18:47:08.625495] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-06T18:47:09.086444] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-06T18:47:09.425550] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-06T18:47:09.716463] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T18:47:10.225548] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-06T18:47:10.983549] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T18:47:11.025479] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-06T18:47:11.129938] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T18:47:11.825547] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-06T18:47:12.283205] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T18:47:12.289038] [INFO ] [REMOTE ] ES: Full fetch complete (76232 records). [2025-10-06T18:47:12.289167] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-06T18:47:12.637780] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-06T18:47:12.681596] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-06T18:47:12.681720] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-06T18:47:12.682761] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-06T18:47:12.682829] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-06T18:47:12.684592] [DEBUG] [LOCAL ] ES: Trimmed 76232 records to 52594 (keeping 200 days of data) [2025-10-06T18:47:12.922752] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T18:47:13.056150] [DEBUG] [LOCAL ] ES: Primary data saved (52594 records). [2025-10-06T18:47:13.056319] [INFO ] [MAIN ] ES: Full history saved. [2025-10-06T18:47:13.056407] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ES took 34.1s. Estimated remaining: 3h 44m 57s. Rate: 7.1 symbols/min [2025-10-06T18:47:13.227542] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:47:13.282681] [DEBUG] [LOCAL ] ESI: Loaded 51476 existing records from primary storage. [2025-10-06T18:47:13.283038] [INFO ] [MAIN ] ESI: Loaded 51476 existing records. [2025-10-06T18:47:13.453390] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-06T18:47:13.458878] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:47:13.459141] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-06T18:47:13.459379] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-06T18:47:13.461283] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-06T18:47:13.461344] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-06T18:47:13.835395] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:47:13.983075] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T18:47:14.225537] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-06T18:47:15.025499] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-06T18:47:15.331995] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T18:47:15.358721] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-06T18:47:15.362137] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-10-06T18:47:15.362286] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-06T18:47:15.808261] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-06T18:47:15.808352] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-06T18:47:15.809335] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-06T18:47:15.809403] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-06T18:47:15.810941] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 53682 (keeping 200 days of data) [2025-10-06T18:47:15.865896] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-06T18:47:16.144632] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-10-06T18:47:16.144822] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-06T18:47:16.144912] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. EQT took 55.5s. Estimated remaining: 3h 44m 37s. Rate: 7.1 symbols/min [2025-10-06T18:47:16.313998] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:47:16.350754] [DEBUG] [LOCAL ] ESNT: Loaded 38930 existing records from primary storage. [2025-10-06T18:47:16.351071] [INFO ] [MAIN ] ESNT: Loaded 38930 existing records. [2025-10-06T18:47:16.529988] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:47:16.530320] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-06T18:47:16.530516] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-06T18:47:16.531842] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-06T18:47:16.531904] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-06T18:47:16.629286] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-06T18:47:16.812144] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T18:47:16.918184] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T18:47:16.999006] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:47:17.425540] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-06T18:47:17.778535] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T18:47:18.174382] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T18:47:18.225550] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-06T18:47:19.025505] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-06T18:47:19.279671] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-06T18:47:19.825537] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-06T18:47:20.617008] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T18:47:20.626777] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-06T18:47:21.298191] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T18:47:21.346683] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-06T18:47:21.425563] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-06T18:47:22.225549] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-06T18:47:22.535395] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-06T18:47:23.025551] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-06T18:47:23.606792] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T18:47:23.825495] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-06T18:47:23.871509] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T18:47:24.625541] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-06T18:47:24.894374] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T18:47:25.425622] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-06T18:47:26.159784] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T18:47:26.225601] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-06T18:47:26.774279] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T18:47:27.025513] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-06T18:47:27.825528] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-06T18:47:28.069486] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T18:47:28.114273] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T18:47:28.116060] [INFO ] [REMOTE ] ESAB: Full fetch complete (35981 records). [2025-10-06T18:47:28.116133] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-06T18:47:28.500762] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-06T18:47:28.500862] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-06T18:47:28.501663] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-06T18:47:28.501737] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-06T18:47:28.502795] [DEBUG] [LOCAL ] ESAB: Trimmed 35981 records to 26153 (keeping 200 days of data) [2025-10-06T18:47:28.625588] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-06T18:47:28.691978] [DEBUG] [LOCAL ] ESAB: Primary data saved (26153 records). [2025-10-06T18:47:28.692152] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-06T18:47:28.692261] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESAB took 28.2s. Estimated remaining: 3h 44m 37s. Rate: 7.1 symbols/min [2025-10-06T18:47:28.904613] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:47:28.950158] [DEBUG] [LOCAL ] ESRT: Loaded 47041 existing records from primary storage. [2025-10-06T18:47:28.950513] [INFO ] [MAIN ] ESRT: Loaded 47041 existing records. [2025-10-06T18:47:29.128458] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:47:29.128811] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-06T18:47:29.128875] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-06T18:47:29.130102] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-06T18:47:29.130162] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-06T18:47:29.429070] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-06T18:47:29.496539] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:47:29.525539] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T18:47:29.601391] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T18:47:30.225527] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-06T18:47:30.978368] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T18:47:31.025561] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-06T18:47:31.707060] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T18:47:31.826165] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T18:47:31.825813] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-06T18:47:31.829559] [INFO ] [REMOTE ] ESE: Full fetch complete (22391 records). [2025-10-06T18:47:31.829663] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-06T18:47:32.227828] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-06T18:47:32.227919] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-06T18:47:32.228415] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-06T18:47:32.228454] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-06T18:47:32.229114] [DEBUG] [LOCAL ] ESE: Trimmed 22391 records to 16617 (keeping 200 days of data) [2025-10-06T18:47:32.335698] [DEBUG] [LOCAL ] ESE: Primary data saved (16617 records). [2025-10-06T18:47:32.335878] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-06T18:47:32.335968] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESE took 27.9s. Estimated remaining: 3h 44m 19s. Rate: 7.1 symbols/min [2025-10-06T18:47:32.503252] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:47:32.539771] [DEBUG] [LOCAL ] ESS: Loaded 30332 existing records from primary storage. [2025-10-06T18:47:32.540117] [INFO ] [MAIN ] ESS: Loaded 30332 existing records. [2025-10-06T18:47:32.633242] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-06T18:47:32.726204] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:47:32.726474] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-06T18:47:32.726523] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-06T18:47:32.727692] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-06T18:47:32.727754] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-06T18:47:33.074318] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:47:33.425531] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-06T18:47:33.505470] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T18:47:33.694969] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T18:47:34.225557] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-06T18:47:34.872272] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T18:47:35.025493] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-06T18:47:35.420793] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-06T18:47:35.825550] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-06T18:47:36.560777] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T18:47:36.625546] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-06T18:47:37.276094] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T18:47:37.425574] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-06T18:47:38.225559] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-06T18:47:38.300797] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T18:47:38.795707] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T18:47:39.025591] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-06T18:47:39.562304] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T18:47:39.825555] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-06T18:47:40.501509] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T18:47:40.625500] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-06T18:47:40.744861] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-06T18:47:41.425550] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-06T18:47:42.181673] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T18:47:42.225538] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-06T18:47:42.567084] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T18:47:43.025584] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-06T18:47:43.819147] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T18:47:43.829482] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-06T18:47:44.636211] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-06T18:47:44.642350] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T18:47:45.365681] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T18:47:45.425527] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-06T18:47:46.167522] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T18:47:46.225574] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-06T18:47:46.853578] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T18:47:47.025592] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-06T18:47:47.495385] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-06T18:47:47.825546] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-06T18:47:48.279924] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T18:47:48.625544] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-06T18:47:49.177042] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T18:47:49.425522] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-06T18:47:49.968866] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T18:47:50.225562] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-06T18:47:51.025518] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-06T18:47:51.118228] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T18:47:51.825497] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-06T18:47:51.922238] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T18:47:52.478592] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T18:47:52.625569] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-06T18:47:53.012625] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T18:47:53.425599] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-06T18:47:54.152823] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T18:47:54.156588] [INFO ] [REMOTE ] ESI: Full fetch complete (72757 records). [2025-10-06T18:47:54.156783] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-06T18:47:54.230945] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-06T18:47:54.605681] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-06T18:47:54.605856] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-06T18:47:54.607531] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-06T18:47:54.607673] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-06T18:47:54.610303] [DEBUG] [LOCAL ] ESI: Trimmed 72757 records to 50703 (keeping 200 days of data) [2025-10-06T18:47:54.742638] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T18:47:54.982670] [DEBUG] [LOCAL ] ESI: Primary data saved (50703 records). [2025-10-06T18:47:54.982880] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-06T18:47:54.982981] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESI took 41.9s. Estimated remaining: 3h 44m 40s. Rate: 7.1 symbols/min [2025-10-06T18:47:55.030819] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-06T18:47:55.172760] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:47:55.229117] [DEBUG] [LOCAL ] ESTC: Loaded 50664 existing records from primary storage. [2025-10-06T18:47:55.229556] [INFO ] [MAIN ] ESTC: Loaded 50664 existing records. [2025-10-06T18:47:55.424422] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:47:55.424756] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-06T18:47:55.424814] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-06T18:47:55.426291] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-06T18:47:55.426355] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-06T18:47:55.833218] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-06T18:47:55.839276] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:47:55.921239] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T18:47:56.388232] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T18:47:56.390896] [INFO ] [REMOTE ] ESNT: Full fetch complete (57092 records). [2025-10-06T18:47:56.391028] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-06T18:47:56.626601] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-06T18:47:56.793941] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-06T18:47:56.794052] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-06T18:47:56.794881] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-06T18:47:56.794951] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-06T18:47:56.796418] [DEBUG] [LOCAL ] ESNT: Trimmed 57092 records to 38283 (keeping 200 days of data) [2025-10-06T18:47:57.032596] [DEBUG] [LOCAL ] ESNT: Primary data saved (38283 records). [2025-10-06T18:47:57.032971] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-06T18:47:57.033130] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESNT took 40.9s. Estimated remaining: 3h 44m 19s. Rate: 7.1 symbols/min [2025-10-06T18:47:57.153291] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T18:47:57.233469] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:47:57.286736] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-10-06T18:47:57.287152] [INFO ] [MAIN ] ET: Loaded 54569 existing records. [2025-10-06T18:47:57.430631] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-06T18:47:57.493311] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:47:57.493589] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-06T18:47:57.493664] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-06T18:47:57.495427] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-06T18:47:57.495493] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-06T18:47:57.874060] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:47:58.225566] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-06T18:47:58.581637] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-06T18:47:59.035558] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-06T18:47:59.042487] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T18:47:59.825538] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-06T18:48:00.098363] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T18:48:00.100623] [INFO ] [REMOTE ] ESS: Full fetch complete (43470 records). [2025-10-06T18:48:00.100784] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-06T18:48:00.520848] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-06T18:48:00.521073] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-06T18:48:00.521975] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-06T18:48:00.522077] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-06T18:48:00.523541] [DEBUG] [LOCAL ] ESS: Trimmed 43470 records to 29925 (keeping 200 days of data) [2025-10-06T18:48:00.627845] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-06T18:48:00.671494] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-06T18:48:00.797232] [DEBUG] [LOCAL ] ESS: Primary data saved (29925 records). [2025-10-06T18:48:00.797546] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-06T18:48:00.798378] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESS took 28.5s. Estimated remaining: 3h 44m 1s. Rate: 7.1 symbols/min [2025-10-06T18:48:00.990710] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:48:01.007827] [DEBUG] [LOCAL ] ETB: Loaded 12368 existing records from primary storage. [2025-10-06T18:48:01.008156] [INFO ] [MAIN ] ETB: Loaded 12368 existing records. [2025-10-06T18:48:01.217078] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:48:01.217562] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-06T18:48:01.217707] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-06T18:48:01.218378] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-06T18:48:01.218497] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-06T18:48:01.437162] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-06T18:48:01.600305] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T18:48:01.681523] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:48:01.942908] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T18:48:02.225551] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-06T18:48:03.025571] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-06T18:48:03.282231] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-06T18:48:03.298002] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T18:48:03.303428] [INFO ] [REMOTE ] ESRT: Full fetch complete (66441 records). [2025-10-06T18:48:03.303591] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-06T18:48:03.721093] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-06T18:48:03.721216] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-06T18:48:03.722666] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-06T18:48:03.722742] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-06T18:48:03.724699] [DEBUG] [LOCAL ] ESRT: Trimmed 66441 records to 46288 (keeping 200 days of data) [2025-10-06T18:48:03.825902] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-06T18:48:03.838470] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T18:48:04.035892] [DEBUG] [LOCAL ] ESRT: Primary data saved (46288 records). [2025-10-06T18:48:04.036122] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-06T18:48:04.036265] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESRT took 35.3s. Estimated remaining: 3h 43m 41s. Rate: 7.1 symbols/min [2025-10-06T18:48:04.217479] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:48:04.248997] [DEBUG] [LOCAL ] ETD: Loaded 27784 existing records from primary storage. [2025-10-06T18:48:04.249386] [INFO ] [MAIN ] ETD: Loaded 27784 existing records. [2025-10-06T18:48:04.428135] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:48:04.428429] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-06T18:48:04.428480] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-06T18:48:04.429518] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-06T18:48:04.429581] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-06T18:48:04.633050] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-06T18:48:04.798747] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:48:05.425610] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-06T18:48:05.484102] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T18:48:06.225567] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-06T18:48:06.265977] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-06T18:48:06.820906] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-06T18:48:07.025537] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-06T18:48:07.825541] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-06T18:48:07.986293] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T18:48:08.173457] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-06T18:48:08.411231] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-06T18:48:08.625541] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-06T18:48:09.425539] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-06T18:48:09.577907] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T18:48:10.225546] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-06T18:48:11.025567] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-06T18:48:11.426262] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T18:48:11.632353] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T18:48:11.670732] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-06T18:48:11.825530] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-06T18:48:12.625595] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-06T18:48:13.425623] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-06T18:48:13.568083] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-06T18:48:14.048705] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-06T18:48:14.225700] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-06T18:48:14.898464] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T18:48:15.025569] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-06T18:48:15.825583] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-06T18:48:16.126948] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T18:48:16.168987] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-06T18:48:16.625539] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-06T18:48:17.425614] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-06T18:48:17.572037] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-06T18:48:17.573849] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T18:48:18.225586] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-06T18:48:18.670312] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T18:48:18.839352] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-06T18:48:19.025607] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-06T18:48:19.825536] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-06T18:48:19.856830] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-06T18:48:20.625550] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-06T18:48:21.425612] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-06T18:48:21.965718] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T18:48:21.979213] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T18:48:22.041752] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-06T18:48:22.225557] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-06T18:48:23.025569] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-06T18:48:23.417627] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T18:48:23.825568] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-06T18:48:24.594995] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-06T18:48:24.625556] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-06T18:48:25.258189] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-06T18:48:25.425500] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-06T18:48:25.507885] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-06T18:48:25.509714] [INFO ] [REMOTE ] ETB: Full fetch complete (18325 records). [2025-10-06T18:48:25.510119] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-06T18:48:25.884203] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-06T18:48:25.884294] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-06T18:48:25.884736] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-06T18:48:25.884798] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-06T18:48:25.885343] [DEBUG] [LOCAL ] ETB: Trimmed 18325 records to 12264 (keeping 200 days of data) [2025-10-06T18:48:25.961144] [DEBUG] [LOCAL ] ETB: Primary data saved (12264 records). [2025-10-06T18:48:25.961303] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-06T18:48:25.961397] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ETB took 25.2s. Estimated remaining: 3h 44m 1s. Rate: 7.1 symbols/min [2025-10-06T18:48:26.129233] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:48:26.148395] [DEBUG] [LOCAL ] ETG: Loaded 16693 existing records from primary storage. [2025-10-06T18:48:26.148711] [INFO ] [MAIN ] ETG: Loaded 16693 existing records. [2025-10-06T18:48:26.230740] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-06T18:48:26.327789] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:48:26.328057] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-06T18:48:26.328107] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-06T18:48:26.328873] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-06T18:48:26.328933] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-06T18:48:26.686739] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:48:27.025614] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-06T18:48:27.124780] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T18:48:27.491766] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T18:48:27.825514] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-06T18:48:28.261946] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T18:48:28.625558] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-06T18:48:29.425563] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-06T18:48:29.526089] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-06T18:48:29.980092] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-06T18:48:30.225517] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-06T18:48:30.607466] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T18:48:31.025620] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-06T18:48:31.436079] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T18:48:31.825628] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-06T18:48:32.625626] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-06T18:48:32.819028] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-06T18:48:32.821530] [INFO ] [REMOTE ] ETD: Full fetch complete (38438 records). [2025-10-06T18:48:32.821734] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-06T18:48:32.970195] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-06T18:48:33.271383] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-06T18:48:33.271472] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-06T18:48:33.272201] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-06T18:48:33.272286] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-06T18:48:33.273146] [DEBUG] [LOCAL ] ETD: Trimmed 38438 records to 27331 (keeping 200 days of data) [2025-10-06T18:48:33.426968] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-06T18:48:33.455214] [DEBUG] [LOCAL ] ETD: Primary data saved (27331 records). [2025-10-06T18:48:33.455462] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-06T18:48:33.455577] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ETD took 29.4s. Estimated remaining: 3h 43m 51s. Rate: 7.1 symbols/min [2025-10-06T18:48:33.632820] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:48:33.653154] [DEBUG] [LOCAL ] ETJ: Loaded 17112 existing records from primary storage. [2025-10-06T18:48:33.653497] [INFO ] [MAIN ] ETJ: Loaded 17112 existing records. [2025-10-06T18:48:33.840608] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:48:33.840916] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-06T18:48:33.840966] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-06T18:48:33.841732] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-06T18:48:33.841793] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-06T18:48:34.256669] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:48:34.252274] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-06T18:48:34.367801] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T18:48:34.547278] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-06T18:48:35.025602] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-06T18:48:35.825550] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-06T18:48:36.056817] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T18:48:36.100063] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T18:48:36.625567] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-06T18:48:37.425547] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-06T18:48:37.794871] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-06T18:48:37.798131] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-06T18:48:37.798282] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-06T18:48:38.232209] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-06T18:48:38.228423] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-06T18:48:38.232705] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-06T18:48:38.235013] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-06T18:48:38.235195] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-06T18:48:38.236915] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-10-06T18:48:38.465748] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T18:48:38.512367] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T18:48:38.629194] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-06T18:48:38.629362] [INFO ] [MAIN ] ET: Full history saved. [2025-10-06T18:48:38.629448] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ET took 41.6s. Estimated remaining: 3h 43m 36s. Rate: 7.1 symbols/min [2025-10-06T18:48:38.799969] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:48:38.853097] [DEBUG] [LOCAL ] ETN: Loaded 53510 existing records from primary storage. [2025-10-06T18:48:38.853473] [INFO ] [MAIN ] ETN: Loaded 53510 existing records. [2025-10-06T18:48:39.031045] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-06T18:48:39.036696] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:48:39.037021] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-06T18:48:39.037072] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-06T18:48:39.038600] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-06T18:48:39.038848] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-06T18:48:39.372859] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T18:48:39.417746] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:48:39.825535] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-06T18:48:40.621534] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T18:48:40.625058] [INFO ] [REMOTE ] ESTC: Full fetch complete (72089 records). [2025-10-06T18:48:40.625213] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-06T18:48:40.625633] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-06T18:48:41.055549] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-06T18:48:41.055691] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-06T18:48:41.056916] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-06T18:48:41.056984] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-06T18:48:41.059098] [DEBUG] [LOCAL ] ESTC: Trimmed 72089 records to 50008 (keeping 200 days of data) [2025-10-06T18:48:41.379117] [DEBUG] [LOCAL ] ESTC: Primary data saved (50008 records). [2025-10-06T18:48:41.379315] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-06T18:48:41.379445] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ESTC took 46.4s. Estimated remaining: 3h 43m 16s. Rate: 7.1 symbols/min [2025-10-06T18:48:41.436250] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-06T18:48:41.578482] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:48:41.590102] [DEBUG] [LOCAL ] ETO: Loaded 6702 existing records from primary storage. [2025-10-06T18:48:41.590509] [INFO ] [MAIN ] ETO: Loaded 6702 existing records. [2025-10-06T18:48:41.813548] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:48:41.816865] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T18:48:41.817063] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-06T18:48:41.818954] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-06T18:48:41.822565] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-06T18:48:41.822759] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-06T18:48:41.988972] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-06T18:48:42.239862] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-06T18:48:42.246428] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:48:42.276260] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-06T18:48:43.025578] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-06T18:48:43.612901] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T18:48:43.825576] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-06T18:48:44.279786] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-06T18:48:44.625556] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-06T18:48:44.887479] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T18:48:45.354969] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T18:48:45.425506] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-06T18:48:46.016897] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-06T18:48:46.225564] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-06T18:48:47.025532] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-06T18:48:47.259138] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T18:48:47.825545] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-06T18:48:48.027767] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T18:48:48.432568] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T18:48:48.625589] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-06T18:48:49.425556] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-06T18:48:49.784976] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T18:48:50.225524] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-06T18:48:50.436370] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-06T18:48:50.824216] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T18:48:51.025563] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-06T18:48:51.825549] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-06T18:48:52.625560] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-06T18:48:52.774491] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T18:48:52.928482] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-06T18:48:53.219343] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-06T18:48:53.425606] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-06T18:48:54.179442] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T18:48:54.225502] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-06T18:48:55.025487] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-06T18:48:55.100951] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T18:48:55.468822] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-06T18:48:55.825550] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-06T18:48:56.625527] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-06T18:48:56.815595] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T18:48:57.425592] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-06T18:48:58.222900] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T18:48:58.224332] [INFO ] [REMOTE ] ETG: Full fetch complete (24904 records). [2025-10-06T18:48:58.224428] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-06T18:48:58.236173] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-06T18:48:58.598150] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-06T18:48:58.598397] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-06T18:48:58.598986] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-06T18:48:58.599064] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-06T18:48:58.600033] [DEBUG] [LOCAL ] ETG: Trimmed 24904 records to 16551 (keeping 200 days of data) [2025-10-06T18:48:58.702626] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-06T18:48:58.740721] [DEBUG] [LOCAL ] ETG: Primary data saved (16551 records). [2025-10-06T18:48:58.740863] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-06T18:48:58.740956] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETG took 32.8s. Estimated remaining: 3h 43m 26s. Rate: 7.1 symbols/min [2025-10-06T18:48:58.877261] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-06T18:48:58.930096] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:48:58.986977] [DEBUG] [LOCAL ] ETR: Loaded 54002 existing records from primary storage. [2025-10-06T18:48:58.987386] [INFO ] [MAIN ] ETR: Loaded 54002 existing records. [2025-10-06T18:48:59.030728] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-06T18:48:59.169506] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:48:59.169780] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-06T18:48:59.169840] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-06T18:48:59.171447] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-06T18:48:59.171507] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-06T18:48:59.527574] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:48:59.825546] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-06T18:49:00.625613] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-06T18:49:01.152117] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-06T18:49:01.425507] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-06T18:49:01.554007] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T18:49:01.646155] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T18:49:02.225534] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-06T18:49:03.025557] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-06T18:49:03.350398] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-06T18:49:03.739421] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-06T18:49:03.825512] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-06T18:49:03.893182] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T18:49:04.625550] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-06T18:49:05.425502] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-06T18:49:05.544499] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T18:49:05.662508] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T18:49:05.866630] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-06T18:49:06.225605] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-06T18:49:07.025592] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-06T18:49:07.825554] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-06T18:49:08.015223] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T18:49:08.625590] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-06T18:49:08.721334] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T18:49:08.723154] [INFO ] [REMOTE ] ETJ: Full fetch complete (25756 records). [2025-10-06T18:49:08.723225] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-06T18:49:09.112536] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-06T18:49:09.112617] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-06T18:49:09.113260] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-06T18:49:09.113314] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-06T18:49:09.113995] [DEBUG] [LOCAL ] ETJ: Trimmed 25756 records to 16949 (keeping 200 days of data) [2025-10-06T18:49:09.226145] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-06T18:49:09.264979] [DEBUG] [LOCAL ] ETJ: Primary data saved (16949 records). [2025-10-06T18:49:09.265146] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-06T18:49:09.265240] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETJ took 35.8s. Estimated remaining: 3h 43m 22s. Rate: 7.1 symbols/min [2025-10-06T18:49:09.372487] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T18:49:09.426676] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-06T18:49:09.448520] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:49:09.448623] [DEBUG] [LOCAL ] ETV: No existing data file found in primary storage. [2025-10-06T18:49:09.448694] [WARN ] [MAIN ] ETV: No existing data found, performing full refresh instead. [2025-10-06T18:49:09.448811] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-06T18:49:09.448854] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-06T18:49:09.448896] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-10-06T18:49:09.448930] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-06T18:49:09.812756] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:49:10.137151] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T18:49:10.138410] [INFO ] [REMOTE ] ETO: Full fetch complete (9524 records). [2025-10-06T18:49:10.138479] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-06T18:49:10.230744] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-06T18:49:10.506883] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-06T18:49:10.506969] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-06T18:49:10.507223] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-06T18:49:10.507260] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-06T18:49:10.507729] [DEBUG] [LOCAL ] ETO: Trimmed 9524 records to 6695 (keeping 200 days of data) [2025-10-06T18:49:10.548326] [DEBUG] [LOCAL ] ETO: Primary data saved (6695 records). [2025-10-06T18:49:10.548421] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-06T18:49:10.548507] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETO took 29.2s. Estimated remaining: 3h 42m 59s. Rate: 7.1 symbols/min [2025-10-06T18:49:10.718262] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:49:10.744254] [DEBUG] [LOCAL ] ETW: Loaded 25554 existing records from primary storage. [2025-10-06T18:49:10.744557] [INFO ] [MAIN ] ETW: Loaded 25554 existing records. [2025-10-06T18:49:10.921020] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:49:10.921277] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-06T18:49:10.921331] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-06T18:49:10.922125] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-06T18:49:10.922185] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-06T18:49:11.026334] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-06T18:49:11.287512] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:49:11.825503] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-06T18:49:12.056802] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T18:49:12.146975] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T18:49:12.625595] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-06T18:49:13.425585] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-06T18:49:13.893194] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-06T18:49:13.997706] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T18:49:14.225589] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-06T18:49:15.025566] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-06T18:49:15.211532] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-06T18:49:15.238967] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T18:49:15.825570] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-06T18:49:15.984508] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T18:49:16.625591] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-06T18:49:17.425558] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-06T18:49:17.892009] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-06T18:49:18.225511] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-06T18:49:18.326321] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T18:49:18.527223] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T18:49:19.025544] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-06T18:49:19.825494] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-06T18:49:20.039791] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-06T18:49:20.042857] [INFO ] [REMOTE ] ETN: Full fetch complete (76556 records). [2025-10-06T18:49:20.042982] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-06T18:49:20.335607] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T18:49:20.506718] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-06T18:49:20.506818] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-06T18:49:20.507892] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-06T18:49:20.507977] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-06T18:49:20.509528] [DEBUG] [LOCAL ] ETN: Trimmed 76556 records to 52723 (keeping 200 days of data) [2025-10-06T18:49:20.625565] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-06T18:49:20.847355] [DEBUG] [LOCAL ] ETN: Primary data saved (52723 records). [2025-10-06T18:49:20.847576] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-06T18:49:20.849063] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETN took 42.2s. Estimated remaining: 3h 42m 54s. Rate: 7.1 symbols/min [2025-10-06T18:49:21.031989] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:49:21.042858] [DEBUG] [LOCAL ] ETX: Loaded 5236 existing records from primary storage. [2025-10-06T18:49:21.043182] [INFO ] [MAIN ] ETX: Loaded 5236 existing records. [2025-10-06T18:49:21.236537] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:49:21.247899] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-06T18:49:21.254412] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-06T18:49:21.255945] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T18:49:21.255997] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-06T18:49:21.262057] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-06T18:49:21.431123] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-06T18:49:21.654589] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:49:21.756562] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T18:49:22.225550] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-06T18:49:23.025535] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-06T18:49:23.175138] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T18:49:23.200369] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T18:49:23.825582] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-06T18:49:23.860489] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-06T18:49:24.390261] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T18:49:24.625551] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-06T18:49:25.164344] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-06T18:49:25.425592] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-06T18:49:25.887048] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-06T18:49:26.225595] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-06T18:49:27.025621] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-06T18:49:27.687599] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T18:49:27.825578] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-06T18:49:28.173196] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T18:49:28.374941] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-06T18:49:28.625551] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-06T18:49:29.165900] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-06T18:49:29.425541] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-06T18:49:30.225588] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-06T18:49:30.770526] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-06T18:49:31.025475] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-06T18:49:31.689920] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T18:49:31.716274] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T18:49:31.825552] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-06T18:49:32.625539] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-06T18:49:33.425525] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-06T18:49:33.610974] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T18:49:33.661109] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T18:49:34.154373] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T18:49:34.225496] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-06T18:49:34.821133] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T18:49:35.025554] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-06T18:49:35.825498] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-06T18:49:36.086310] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T18:49:36.623925] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-06T18:49:36.629083] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-06T18:49:37.425534] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-06T18:49:37.752498] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T18:49:38.225619] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-06T18:49:38.953308] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T18:49:38.957307] [INFO ] [REMOTE ] ETR: Full fetch complete (77093 records). [2025-10-06T18:49:38.957496] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-06T18:49:39.030791] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-06T18:49:39.344206] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-06T18:49:39.426952] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-06T18:49:39.427128] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-06T18:49:39.429072] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-06T18:49:39.429164] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-06T18:49:39.431412] [DEBUG] [LOCAL ] ETR: Trimmed 77093 records to 53231 (keeping 200 days of data) [2025-10-06T18:49:39.798964] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-06T18:49:39.812809] [DEBUG] [LOCAL ] ETR: Primary data saved (53231 records). [2025-10-06T18:49:39.813022] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-06T18:49:39.813858] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETR took 41.1s. Estimated remaining: 3h 43m 7s. Rate: 7.1 symbols/min [2025-10-06T18:49:39.835583] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-06T18:49:40.048812] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:49:40.078295] [DEBUG] [LOCAL ] ETY: Loaded 23218 existing records from primary storage. [2025-10-06T18:49:40.078736] [INFO ] [MAIN ] ETY: Loaded 23218 existing records. [2025-10-06T18:49:40.263465] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:49:40.263839] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-06T18:49:40.263893] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-06T18:49:40.264822] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-06T18:49:40.264885] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-06T18:49:40.569361] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T18:49:40.632089] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-06T18:49:40.667008] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:49:41.425553] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-06T18:49:41.638621] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T18:49:41.641078] [INFO ] [REMOTE ] ETV: Full fetch complete (32068 records). [2025-10-06T18:49:41.641223] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-06T18:49:42.041230] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-06T18:49:42.041361] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-06T18:49:42.042511] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-06T18:49:42.042578] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-06T18:49:42.043627] [DEBUG] [LOCAL ] ETV: Trimmed 32068 records to 21817 (keeping 200 days of data) [2025-10-06T18:49:42.111609] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T18:49:42.145669] [INFO ] [REMOTE ] ETX: Full fetch complete (7056 records). [2025-10-06T18:49:42.150342] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-06T18:49:42.230602] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-06T18:49:42.502620] [DEBUG] [LOCAL ] ETV: Primary data saved (21817 records). [2025-10-06T18:49:42.513038] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-06T18:49:42.518252] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETV took 33.3s. Estimated remaining: 3h 42m 47s. Rate: 7.1 symbols/min [2025-10-06T18:49:42.682897] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-06T18:49:42.683016] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-06T18:49:42.683224] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-06T18:49:42.683520] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-06T18:49:42.723556] [DEBUG] [LOCAL ] ETX: Trimmed 7056 records to 5157 (keeping 200 days of data) [2025-10-06T18:49:42.757241] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:49:42.805149] [DEBUG] [LOCAL ] EVC: Loaded 18787 existing records from primary storage. [2025-10-06T18:49:42.806211] [INFO ] [MAIN ] EVC: Loaded 18787 existing records. [2025-10-06T18:49:42.889621] [DEBUG] [LOCAL ] ETX: Primary data saved (5157 records). [2025-10-06T18:49:42.906724] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-06T18:49:42.917713] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETX took 22.1s. Estimated remaining: 3h 42m 22s. Rate: 7.1 symbols/min [2025-10-06T18:49:43.045999] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-06T18:49:43.103731] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:49:43.114760] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-06T18:49:43.120241] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-06T18:49:43.136610] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-06T18:49:43.147675] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-06T18:49:43.269185] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:49:43.546421] [DEBUG] [LOCAL ] EVEX: Loaded 31245 existing records from primary storage. [2025-10-06T18:49:43.570557] [INFO ] [MAIN ] EVEX: Loaded 31245 existing records. [2025-10-06T18:49:43.650173] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T18:49:43.690842] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:49:43.836479] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-06T18:49:43.843418] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:49:43.844904] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-06T18:49:43.844994] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-06T18:49:43.846076] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-06T18:49:43.846152] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-06T18:49:44.232101] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:49:44.248791] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-06T18:49:44.625586] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-06T18:49:44.930002] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T18:49:45.425594] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-06T18:49:45.883671] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T18:49:46.225533] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-06T18:49:46.482314] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T18:49:47.025602] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-06T18:49:47.733236] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T18:49:47.825536] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-06T18:49:48.108703] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T18:49:48.110838] [INFO ] [REMOTE ] ETW: Full fetch complete (36549 records). [2025-10-06T18:49:48.110927] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-06T18:49:48.523134] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-06T18:49:48.523266] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-06T18:49:48.524596] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-06T18:49:48.524705] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-06T18:49:48.526153] [DEBUG] [LOCAL ] ETW: Trimmed 36549 records to 25222 (keeping 200 days of data) [2025-10-06T18:49:48.625734] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-06T18:49:48.694164] [DEBUG] [LOCAL ] ETW: Primary data saved (25222 records). [2025-10-06T18:49:48.694372] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-06T18:49:48.694483] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETW took 38.1s. Estimated remaining: 3h 42m 9s. Rate: 7.1 symbols/min [2025-10-06T18:49:48.875806] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:49:48.888386] [DEBUG] [LOCAL ] EVF: Loaded 9646 existing records from primary storage. [2025-10-06T18:49:48.888755] [INFO ] [MAIN ] EVF: Loaded 9646 existing records. [2025-10-06T18:49:49.086141] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T18:49:49.105938] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:49:49.108383] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-06T18:49:49.108480] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-06T18:49:49.108919] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-06T18:49:49.108983] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-06T18:49:49.430775] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-06T18:49:49.488555] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:49:49.567600] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T18:49:50.225617] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-06T18:49:50.529173] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T18:49:51.025541] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-06T18:49:51.664595] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T18:49:51.825502] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-06T18:49:51.982265] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T18:49:52.625602] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-06T18:49:52.944588] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T18:49:53.408931] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T18:49:53.425472] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-06T18:49:54.225531] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-06T18:49:54.613434] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-06T18:49:55.025551] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-06T18:49:55.223525] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T18:49:55.625466] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T18:49:55.825529] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-06T18:49:56.474896] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-06T18:49:56.625554] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-06T18:49:57.425484] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-06T18:49:57.810161] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T18:49:57.964514] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-06T18:49:58.225538] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-06T18:49:59.025553] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-06T18:49:59.269785] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T18:49:59.825572] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-06T18:50:00.062918] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T18:50:00.625564] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-06T18:50:00.651045] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-06T18:50:01.425616] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-06T18:50:02.168056] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T18:50:02.172336] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T18:50:02.225598] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-06T18:50:03.025570] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-06T18:50:03.248305] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T18:50:03.826005] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-06T18:50:04.221045] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T18:50:04.625538] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-06T18:50:04.946803] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-06T18:50:05.425565] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-06T18:50:05.777914] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T18:50:06.065433] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-06T18:50:06.225555] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-06T18:50:07.025528] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-06T18:50:07.212726] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T18:50:07.825573] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-06T18:50:07.901852] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T18:50:08.625546] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-06T18:50:08.769076] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-06T18:50:09.425541] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-06T18:50:09.697712] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T18:50:10.225571] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-06T18:50:10.440631] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T18:50:11.025549] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-06T18:50:11.224163] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T18:50:11.783925] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-06T18:50:11.825528] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-06T18:50:12.622315] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T18:50:12.624128] [INFO ] [REMOTE ] EVC: Full fetch complete (29780 records). [2025-10-06T18:50:12.624544] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-06T18:50:12.630738] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-06T18:50:13.022016] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-06T18:50:13.022142] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-06T18:50:13.023180] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-06T18:50:13.023251] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-06T18:50:13.024378] [DEBUG] [LOCAL ] EVC: Trimmed 29780 records to 18396 (keeping 200 days of data) [2025-10-06T18:50:13.150360] [DEBUG] [LOCAL ] EVC: Primary data saved (18396 records). [2025-10-06T18:50:13.150837] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-06T18:50:13.150976] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. EVC took 30.6s. Estimated remaining: 3h 42m 33s. Rate: 7.1 symbols/min [2025-10-06T18:50:13.336165] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:50:13.345867] [DEBUG] [LOCAL ] EVG: Loaded 6027 existing records from primary storage. [2025-10-06T18:50:13.346216] [INFO ] [MAIN ] EVG: Loaded 6027 existing records. [2025-10-06T18:50:13.430937] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-06T18:50:13.469238] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T18:50:13.487783] [INFO ] [REMOTE ] EVF: Full fetch complete (12382 records). [2025-10-06T18:50:13.498334] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-06T18:50:13.671290] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:50:13.686230] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-06T18:50:13.686322] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-06T18:50:13.703133] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-06T18:50:13.708418] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-06T18:50:14.237549] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-06T18:50:14.318983] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-06T18:50:14.324789] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-06T18:50:14.340684] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-06T18:50:14.360791] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-06T18:50:14.405626] [DEBUG] [LOCAL ] EVF: Trimmed 12382 records to 9540 (keeping 200 days of data) [2025-10-06T18:50:14.405524] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:50:14.467480] [DEBUG] [LOCAL ] EVF: Primary data saved (9540 records). [2025-10-06T18:50:14.467697] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-06T18:50:14.467818] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVF took 25.8s. Estimated remaining: 3h 42m 10s. Rate: 7.1 symbols/min [2025-10-06T18:50:14.655908] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:50:14.670929] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T18:50:14.724289] [DEBUG] [LOCAL ] EVH: Loaded 50116 existing records from primary storage. [2025-10-06T18:50:14.724726] [INFO ] [MAIN ] EVH: Loaded 50116 existing records. [2025-10-06T18:50:14.917194] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:50:14.917620] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-06T18:50:14.917736] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-06T18:50:14.919273] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-06T18:50:14.919338] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-06T18:50:15.030586] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-06T18:50:15.308784] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:50:15.310715] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T18:50:15.825490] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-06T18:50:16.010222] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T18:50:16.625536] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-06T18:50:16.995105] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T18:50:16.997479] [INFO ] [REMOTE ] ETY: Full fetch complete (34377 records). [2025-10-06T18:50:16.997565] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-06T18:50:17.413366] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-06T18:50:17.413545] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-06T18:50:17.414696] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-06T18:50:17.414785] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-06T18:50:17.416489] [DEBUG] [LOCAL ] ETY: Trimmed 34377 records to 22976 (keeping 200 days of data) [2025-10-06T18:50:17.491048] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-06T18:50:17.591472] [DEBUG] [LOCAL ] ETY: Primary data saved (22976 records). [2025-10-06T18:50:17.591699] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-06T18:50:17.591889] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. ETY took 37.8s. Estimated remaining: 3h 41m 51s. Rate: 7.1 symbols/min [2025-10-06T18:50:17.785601] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:50:17.801532] [DEBUG] [LOCAL ] EVN: Loaded 11412 existing records from primary storage. [2025-10-06T18:50:17.801957] [INFO ] [MAIN ] EVN: Loaded 11412 existing records. [2025-10-06T18:50:17.998867] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:50:17.999320] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-06T18:50:17.999501] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-06T18:50:18.000345] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-06T18:50:18.000413] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-06T18:50:18.192078] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-06T18:50:18.231272] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-06T18:50:18.407131] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:50:18.440137] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T18:50:19.025588] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-06T18:50:19.377043] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T18:50:19.825547] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-06T18:50:20.382071] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-06T18:50:20.632680] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-06T18:50:20.638822] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T18:50:21.233617] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-06T18:50:21.425534] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-06T18:50:22.142146] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-06T18:50:22.225598] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-06T18:50:23.025565] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-06T18:50:23.219544] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T18:50:23.825548] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-06T18:50:24.625554] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-06T18:50:24.684567] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T18:50:24.685573] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T18:50:25.160783] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-06T18:50:25.425545] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-06T18:50:26.071197] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-06T18:50:26.225542] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-06T18:50:26.820613] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T18:50:27.025591] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-06T18:50:27.607823] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T18:50:27.825550] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-06T18:50:28.421874] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T18:50:28.625522] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-06T18:50:29.425568] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-06T18:50:30.205660] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T18:50:30.225522] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-06T18:50:30.237281] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T18:50:31.025580] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-06T18:50:31.800602] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T18:50:31.825531] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-06T18:50:31.895389] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T18:50:32.420433] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-06T18:50:32.625549] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-06T18:50:33.425552] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-06T18:50:34.199301] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T18:50:34.225493] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-06T18:50:34.260222] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-06T18:50:34.798903] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T18:50:34.800185] [INFO ] [REMOTE ] EVG: Full fetch complete (8252 records). [2025-10-06T18:50:34.800299] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-06T18:50:35.035091] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-06T18:50:35.193932] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-06T18:50:35.194041] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-06T18:50:35.194337] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-06T18:50:35.194380] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-06T18:50:35.194911] [DEBUG] [LOCAL ] EVG: Trimmed 8252 records to 5987 (keeping 200 days of data) [2025-10-06T18:50:35.233004] [DEBUG] [LOCAL ] EVG: Primary data saved (5987 records). [2025-10-06T18:50:35.233152] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-06T18:50:35.233245] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVG took 22.1s. Estimated remaining: 3h 42m 1s. Rate: 7.1 symbols/min [2025-10-06T18:50:35.415509] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:50:35.460040] [DEBUG] [LOCAL ] EVR: Loaded 35297 existing records from primary storage. [2025-10-06T18:50:35.460419] [INFO ] [MAIN ] EVR: Loaded 35297 existing records. [2025-10-06T18:50:35.663628] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:50:35.663935] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-06T18:50:35.663992] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-06T18:50:35.665231] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-06T18:50:35.665292] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-06T18:50:35.835215] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-06T18:50:36.054844] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:50:36.602030] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-06T18:50:36.625480] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-06T18:50:36.730201] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T18:50:37.364869] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T18:50:37.425557] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-06T18:50:38.225540] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-06T18:50:39.028926] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-06T18:50:39.038096] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T18:50:39.700237] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T18:50:39.825539] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-06T18:50:40.402338] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T18:50:40.625547] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-06T18:50:41.425610] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-06T18:50:41.486781] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T18:50:41.688558] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T18:50:42.147753] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-06T18:50:42.225525] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-06T18:50:43.025554] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-06T18:50:43.648719] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T18:50:43.825533] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-06T18:50:44.630639] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-06T18:50:44.653995] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T18:50:45.326400] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T18:50:45.425533] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-06T18:50:46.225523] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-06T18:50:46.309862] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T18:50:47.025548] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-06T18:50:47.192771] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T18:50:47.733090] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T18:50:47.736210] [INFO ] [REMOTE ] EVEX: Full fetch complete (42477 records). [2025-10-06T18:50:47.736320] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-06T18:50:47.834487] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-06T18:50:48.140670] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-06T18:50:48.140793] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-06T18:50:48.141820] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-06T18:50:48.141904] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-06T18:50:48.143239] [DEBUG] [LOCAL ] EVEX: Trimmed 42477 records to 30942 (keeping 200 days of data) [2025-10-06T18:50:48.322238] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T18:50:48.327361] [INFO ] [REMOTE ] EVH: Full fetch complete (71803 records). [2025-10-06T18:50:48.329826] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-06T18:50:48.440812] [DEBUG] [LOCAL ] EVEX: Primary data saved (30942 records). [2025-10-06T18:50:48.446610] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-06T18:50:48.456976] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVEX took 1m 6s. Estimated remaining: 3h 42m 2s. Rate: 7.1 symbols/min [2025-10-06T18:50:48.638376] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-06T18:50:48.911459] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:50:49.025445] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-06T18:50:49.025569] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-06T18:50:49.026806] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-06T18:50:49.026891] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-06T18:50:49.034823] [DEBUG] [LOCAL ] EVH: Trimmed 71803 records to 49465 (keeping 200 days of data) [2025-10-06T18:50:49.036251] [DEBUG] [LOCAL ] EVT: Loaded 17194 existing records from primary storage. [2025-10-06T18:50:49.037172] [INFO ] [MAIN ] EVT: Loaded 17194 existing records. [2025-10-06T18:50:49.315322] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:50:49.317672] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-06T18:50:49.318682] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-06T18:50:49.320201] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-06T18:50:49.320285] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-06T18:50:49.470405] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-06T18:50:49.501468] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-06T18:50:49.811144] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:50:49.891865] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-06T18:50:49.993204] [DEBUG] [LOCAL ] EVH: Primary data saved (49465 records). [2025-10-06T18:50:49.993403] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-06T18:50:49.993499] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVH took 35.5s. Estimated remaining: 3h 41m 40s. Rate: 7.1 symbols/min [2025-10-06T18:50:50.170580] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:50:50.196743] [DEBUG] [LOCAL ] EVTC: Loaded 26688 existing records from primary storage. [2025-10-06T18:50:50.197038] [INFO ] [MAIN ] EVTC: Loaded 26688 existing records. [2025-10-06T18:50:50.230827] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-06T18:50:50.388763] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:50:50.389018] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-06T18:50:50.389066] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-06T18:50:50.389932] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-06T18:50:50.389996] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-06T18:50:50.521748] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T18:50:50.759771] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:50:51.025537] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-06T18:50:51.718135] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-06T18:50:51.825526] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-06T18:50:51.859380] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T18:50:51.861414] [INFO ] [REMOTE ] EVN: Full fetch complete (17813 records). [2025-10-06T18:50:51.861507] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-06T18:50:52.294593] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-06T18:50:52.294719] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-06T18:50:52.295190] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-06T18:50:52.295232] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-06T18:50:52.295862] [DEBUG] [LOCAL ] EVN: Trimmed 17813 records to 11130 (keeping 200 days of data) [2025-10-06T18:50:52.363856] [DEBUG] [LOCAL ] EVN: Primary data saved (11130 records). [2025-10-06T18:50:52.364076] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-06T18:50:52.364202] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVN took 34.8s. Estimated remaining: 3h 41m 20s. Rate: 7.1 symbols/min [2025-10-06T18:50:52.585257] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:50:52.630738] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-06T18:50:52.633964] [DEBUG] [LOCAL ] EVTL: Loaded 39032 existing records from primary storage. [2025-10-06T18:50:52.634386] [INFO ] [MAIN ] EVTL: Loaded 39032 existing records. [2025-10-06T18:50:52.888109] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:50:52.888378] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-06T18:50:52.888429] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-06T18:50:52.888927] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-06T18:50:52.888988] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-06T18:50:53.361529] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:50:53.391241] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T18:50:53.425610] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-06T18:50:53.687074] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-06T18:50:54.225593] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-06T18:50:54.952557] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-06T18:50:55.025534] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-06T18:50:55.490388] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T18:50:55.825539] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-06T18:50:56.257394] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T18:50:56.625541] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-06T18:50:56.884544] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-06T18:50:57.425636] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-06T18:50:57.638563] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T18:50:58.225625] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-06T18:50:58.585457] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T18:50:59.025615] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-06T18:50:59.405242] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T18:50:59.825586] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-06T18:51:00.287792] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T18:51:00.625625] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-06T18:51:01.185227] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-06T18:51:01.425604] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-06T18:51:02.186733] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T18:51:02.225613] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-06T18:51:02.609540] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T18:51:02.611634] [INFO ] [REMOTE ] EVR: Full fetch complete (50790 records). [2025-10-06T18:51:02.611761] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-06T18:51:03.033225] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-06T18:51:03.037838] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-06T18:51:03.037979] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-06T18:51:03.039207] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-06T18:51:03.039367] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-06T18:51:03.041333] [DEBUG] [LOCAL ] EVR: Trimmed 50790 records to 34649 (keeping 200 days of data) [2025-10-06T18:51:03.297020] [DEBUG] [LOCAL ] EVR: Primary data saved (34649 records). [2025-10-06T18:51:03.297499] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-06T18:51:03.297701] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVR took 28.1s. Estimated remaining: 3h 41m 16s. Rate: 7.1 symbols/min [2025-10-06T18:51:03.494049] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:51:03.536078] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T18:51:03.554184] [DEBUG] [LOCAL ] EVTR: Loaded 24179 existing records from primary storage. [2025-10-06T18:51:03.555109] [INFO ] [MAIN ] EVTR: Loaded 24179 existing records. [2025-10-06T18:51:03.758117] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:51:03.758572] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-06T18:51:03.758628] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-06T18:51:03.758993] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-06T18:51:03.759055] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-06T18:51:03.829303] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-06T18:51:04.157725] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T18:51:04.163429] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:51:04.625602] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-06T18:51:05.145168] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T18:51:05.425510] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-06T18:51:05.714334] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-06T18:51:06.225564] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-06T18:51:06.711250] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-06T18:51:06.944107] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-06T18:51:07.025560] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-06T18:51:07.825562] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-06T18:51:08.335257] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T18:51:08.625508] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-06T18:51:08.802886] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T18:51:09.425586] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-06T18:51:09.637871] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-06T18:51:10.225499] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-06T18:51:10.371623] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T18:51:11.025493] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-06T18:51:11.186985] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T18:51:11.825500] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-06T18:51:11.927042] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-06T18:51:12.625507] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-06T18:51:12.855827] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T18:51:13.425545] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-06T18:51:13.734007] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T18:51:14.225596] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-06T18:51:14.648601] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T18:51:15.025589] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-06T18:51:15.702126] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T18:51:15.825536] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-06T18:51:16.044358] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T18:51:16.625526] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-06T18:51:16.795689] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T18:51:17.425520] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-06T18:51:17.678763] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-06T18:51:18.225577] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-06T18:51:19.025505] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-06T18:51:19.108022] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T18:51:19.221775] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T18:51:19.825505] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-06T18:51:19.978085] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T18:51:20.625558] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-06T18:51:21.425500] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-06T18:51:21.769349] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-06T18:51:21.804444] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-06T18:51:22.225538] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-06T18:51:22.492058] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T18:51:23.025512] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-06T18:51:23.453212] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-06T18:51:23.825522] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-06T18:51:23.917820] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-06T18:51:24.625559] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-06T18:51:25.425571] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-06T18:51:25.540977] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T18:51:25.694067] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-06T18:51:26.225556] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-06T18:51:26.447738] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T18:51:26.449829] [INFO ] [REMOTE ] EVTC: Full fetch complete (38087 records). [2025-10-06T18:51:26.449929] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-06T18:51:26.864506] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-06T18:51:26.864623] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-06T18:51:26.865382] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-06T18:51:26.865450] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-06T18:51:26.866621] [DEBUG] [LOCAL ] EVTC: Trimmed 38087 records to 26337 (keeping 200 days of data) [2025-10-06T18:51:27.024478] [DEBUG] [LOCAL ] EVTC: Primary data saved (26337 records). [2025-10-06T18:51:27.024678] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-06T18:51:27.024792] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVTC took 37.0s. Estimated remaining: 3h 41m 38s. Rate: 7.1 symbols/min [2025-10-06T18:51:27.030637] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-06T18:51:27.151034] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T18:51:27.174499] [INFO ] [REMOTE ] EVT: Full fetch complete (25300 records). [2025-10-06T18:51:27.187122] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-06T18:51:27.240840] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:51:27.645153] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-06T18:51:27.646582] [DEBUG] [LOCAL ] EW: Loaded 54180 existing records from primary storage. [2025-10-06T18:51:27.646854] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-06T18:51:27.647583] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-06T18:51:27.647869] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-06T18:51:27.648199] [INFO ] [MAIN ] EW: Loaded 54180 existing records. [2025-10-06T18:51:27.718968] [DEBUG] [LOCAL ] EVT: Trimmed 25300 records to 16858 (keeping 200 days of data) [2025-10-06T18:51:27.826666] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-06T18:51:27.923623] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:51:27.924607] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-06T18:51:27.925299] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-06T18:51:27.926509] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-06T18:51:27.926868] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-06T18:51:28.318456] [DEBUG] [LOCAL ] EVT: Primary data saved (16858 records). [2025-10-06T18:51:28.322321] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-06T18:51:28.322223] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:51:28.322598] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVT took 39.9s. Estimated remaining: 3h 41m 16s. Rate: 7.1 symbols/min [2025-10-06T18:51:28.494189] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:51:28.529476] [DEBUG] [LOCAL ] EXG: Loaded 34616 existing records from primary storage. [2025-10-06T18:51:28.529857] [INFO ] [MAIN ] EXG: Loaded 34616 existing records. [2025-10-06T18:51:28.629806] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-06T18:51:28.713736] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:51:28.714786] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-06T18:51:28.714841] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-06T18:51:28.715088] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-06T18:51:28.715151] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-06T18:51:29.081672] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:51:29.138538] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-06T18:51:29.140047] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-06T18:51:29.425550] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-06T18:51:30.166100] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T18:51:30.225551] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-06T18:51:31.025560] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-06T18:51:31.204563] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-06T18:51:31.208104] [INFO ] [REMOTE ] EVTL: Full fetch complete (52736 records). [2025-10-06T18:51:31.208229] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-06T18:51:31.694368] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-06T18:51:31.694585] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-06T18:51:31.695945] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-06T18:51:31.696089] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-06T18:51:31.709752] [DEBUG] [LOCAL ] EVTL: Trimmed 52736 records to 38735 (keeping 200 days of data) [2025-10-06T18:51:31.729255] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T18:51:31.829804] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-06T18:51:31.982033] [DEBUG] [LOCAL ] EVTL: Primary data saved (38735 records). [2025-10-06T18:51:31.982285] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-06T18:51:31.983143] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTL took 39.6s. Estimated remaining: 3h 40m 58s. Rate: 7.1 symbols/min [2025-10-06T18:51:32.183789] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:51:32.254028] [DEBUG] [LOCAL ] EXK: Loaded 53915 existing records from primary storage. [2025-10-06T18:51:32.254614] [INFO ] [MAIN ] EXK: Loaded 53915 existing records. [2025-10-06T18:51:32.452007] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:51:32.452394] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-06T18:51:32.452453] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-06T18:51:32.452788] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-06T18:51:32.452884] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-06T18:51:32.581821] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T18:51:32.631499] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-06T18:51:32.851206] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:51:33.425564] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-06T18:51:33.484952] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T18:51:33.629986] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T18:51:33.632062] [INFO ] [REMOTE ] EVTR: Full fetch complete (32656 records). [2025-10-06T18:51:33.632157] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-06T18:51:34.010881] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-06T18:51:34.010969] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-06T18:51:34.011585] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-06T18:51:34.011625] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-06T18:51:34.012362] [DEBUG] [LOCAL ] EVTR: Trimmed 32656 records to 24050 (keeping 200 days of data) [2025-10-06T18:51:34.162628] [DEBUG] [LOCAL ] EVTR: Primary data saved (24050 records). [2025-10-06T18:51:34.162810] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-06T18:51:34.162899] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTR took 30.9s. Estimated remaining: 3h 40m 37s. Rate: 7.1 symbols/min [2025-10-06T18:51:34.230797] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-06T18:51:34.333819] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:51:34.366399] [DEBUG] [LOCAL ] EXP: Loaded 29982 existing records from primary storage. [2025-10-06T18:51:34.366723] [INFO ] [MAIN ] EXP: Loaded 29982 existing records. [2025-10-06T18:51:34.546062] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:51:34.546346] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-06T18:51:34.546399] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-06T18:51:34.546746] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-06T18:51:34.546804] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-06T18:51:34.926674] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:51:35.025576] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-06T18:51:35.129003] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T18:51:35.825509] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-06T18:51:35.996478] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T18:51:36.105332] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T18:51:36.625536] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-06T18:51:37.425558] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-06T18:51:37.562575] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T18:51:38.225497] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-06T18:51:38.463548] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T18:51:38.740633] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T18:51:39.025604] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-06T18:51:39.825561] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-06T18:51:39.956609] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T18:51:40.425775] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T18:51:40.625531] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-06T18:51:41.425503] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-06T18:51:41.704613] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-06T18:51:41.955483] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T18:51:42.225528] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-06T18:51:43.025492] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-06T18:51:43.229810] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T18:51:43.825837] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-06T18:51:43.826937] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T18:51:44.356106] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T18:51:44.625534] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-06T18:51:45.094799] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-06T18:51:45.425541] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-06T18:51:46.225566] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-06T18:51:46.508498] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-06T18:51:46.541845] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T18:51:47.025545] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-06T18:51:47.825555] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-06T18:51:47.999029] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T18:51:48.424488] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T18:51:48.625512] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-06T18:51:49.313173] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T18:51:49.425544] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-06T18:51:50.156998] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T18:51:50.225529] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-06T18:51:50.745596] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T18:51:51.025615] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-06T18:51:51.693906] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T18:51:51.825607] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-06T18:51:51.998571] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T18:51:52.625715] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-06T18:51:53.425533] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-06T18:51:53.686586] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T18:51:53.974556] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T18:51:54.225548] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-06T18:51:54.343353] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T18:51:55.025601] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-06T18:51:55.825622] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-06T18:51:56.059885] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T18:51:56.327914] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T18:51:56.625602] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-06T18:51:57.332336] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T18:51:57.425575] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-06T18:51:58.020232] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T18:51:58.225560] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-06T18:51:59.025564] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-06T18:51:59.330109] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-06T18:51:59.430747] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T18:51:59.825564] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-06T18:51:59.939247] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T18:52:00.625562] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-06T18:52:01.425519] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-06T18:52:01.784993] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T18:52:01.787373] [INFO ] [REMOTE ] EXG: Full fetch complete (49954 records). [2025-10-06T18:52:01.787496] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-06T18:52:01.954213] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-06T18:52:02.230721] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-06T18:52:02.324064] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-06T18:52:02.324205] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-06T18:52:02.325757] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-06T18:52:02.325845] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-06T18:52:02.327631] [DEBUG] [LOCAL ] EXG: Trimmed 49954 records to 34162 (keeping 200 days of data) [2025-10-06T18:52:02.621353] [DEBUG] [LOCAL ] EXG: Primary data saved (34162 records). [2025-10-06T18:52:02.621600] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-06T18:52:02.621780] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EXG took 34.3s. Estimated remaining: 3h 41m 8s. Rate: 7.1 symbols/min [2025-10-06T18:52:02.800132] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T18:52:02.804177] [INFO ] [REMOTE ] EW: Full fetch complete (77349 records). [2025-10-06T18:52:02.804418] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-06T18:52:03.032404] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-06T18:52:03.447200] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-06T18:52:03.453678] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-06T18:52:03.453881] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-06T18:52:03.454985] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-06T18:52:03.455413] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-06T18:52:03.456961] [DEBUG] [LOCAL ] EW: Trimmed 77349 records to 53402 (keeping 200 days of data) [2025-10-06T18:52:03.772032] [DEBUG] [LOCAL ] EW: Primary data saved (53402 records). [2025-10-06T18:52:03.772196] [INFO ] [MAIN ] EW: Full history saved. [2025-10-06T18:52:03.772283] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EW took 36.7s. Estimated remaining: 3h 40m 46s. Rate: 7.1 symbols/min [2025-10-06T18:52:03.825493] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-06T18:52:04.979279] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T18:52:04.980214] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-06T18:52:04.993407] [INFO ] [REMOTE ] EXP: Full fetch complete (42956 records). [2025-10-06T18:52:04.994027] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-06T18:52:04.993941] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-06T18:52:05.380023] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-06T18:52:05.380122] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-06T18:52:05.380859] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-06T18:52:05.380922] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-06T18:52:05.382092] [DEBUG] [LOCAL ] EXP: Trimmed 42956 records to 29678 (keeping 200 days of data) [2025-10-06T18:52:05.570352] [DEBUG] [LOCAL ] EXP: Primary data saved (29678 records). [2025-10-06T18:52:05.570858] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-06T18:52:05.571024] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXP took 31.4s. Estimated remaining: 3h 40m 24s. Rate: 7.1 symbols/min [2025-10-06T18:52:07.086616] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-06T18:52:07.099762] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-06T18:52:08.718472] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-06T18:52:08.721730] [INFO ] [REMOTE ] EXK: Full fetch complete (76554 records). [2025-10-06T18:52:08.721831] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-06T18:52:09.111327] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-06T18:52:09.111455] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-06T18:52:09.112568] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-06T18:52:09.112739] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-06T18:52:09.114892] [DEBUG] [LOCAL ] EXK: Trimmed 76554 records to 53138 (keeping 200 days of data) [2025-10-06T18:52:09.423265] [DEBUG] [LOCAL ] EXK: Primary data saved (53138 records). [2025-10-06T18:52:09.423439] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-06T18:52:09.424208] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXK took 37.4s. Estimated remaining: 3h 40m 7s. Rate: 7.1 symbols/min [2025-10-06T18:52:10.050193] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:52:10.139373] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:52:10.180037] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:52:10.160456] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:52:10.226771] [DEBUG] [LOCAL ] EXR: Loaded 45914 existing records from primary storage. [2025-10-06T18:52:10.240266] [INFO ] [MAIN ] EXR: Loaded 45914 existing records. [2025-10-06T18:52:10.369207] [DEBUG] [LOCAL ] FAF: Loaded 42190 existing records from primary storage. [2025-10-06T18:52:10.386425] [INFO ] [MAIN ] FAF: Loaded 42190 existing records. [2025-10-06T18:52:10.525277] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-10-06T18:52:10.606690] [DEBUG] [LOCAL ] EXPD: Loaded 48594 existing records from primary storage. [2025-10-06T18:52:10.630492] [INFO ] [MAIN ] F: Loaded 54600 existing records. [2025-10-06T18:52:10.641876] [INFO ] [MAIN ] EXPD: Loaded 48594 existing records. [2025-10-06T18:52:10.707959] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:52:10.728199] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-06T18:52:10.776241] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-06T18:52:10.890374] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-06T18:52:10.890202] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:52:10.929173] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-06T18:52:10.961122] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-06T18:52:10.971606] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-06T18:52:11.075981] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-06T18:52:11.088844] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-06T18:52:11.091989] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:52:11.146242] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-06T18:52:11.279113] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-06T18:52:11.259401] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:52:11.298849] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-06T18:52:11.324915] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-06T18:52:11.319657] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-06T18:52:11.341742] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-06T18:52:11.341883] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-06T18:52:11.414624] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-06T18:52:12.332105] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:52:12.395578] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-06T18:52:12.493029] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:52:12.539329] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-06T18:52:12.612865] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:52:12.641329] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-06T18:52:12.791511] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:52:12.791867] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-06T18:52:13.862384] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T18:52:13.870132] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-06T18:52:13.968984] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T18:52:13.978154] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-06T18:52:14.374490] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T18:52:14.384132] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-06T18:52:14.820202] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-06T18:52:14.832557] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-06T18:52:14.865139] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T18:52:14.875192] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-06T18:52:15.629525] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-06T18:52:15.639743] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-06T18:52:15.947767] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T18:52:15.957788] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-06T18:52:16.135567] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T18:52:16.142756] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-06T18:52:17.143727] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T18:52:17.153451] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-06T18:52:17.211735] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T18:52:17.220823] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-06T18:52:17.261553] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-06T18:52:17.425493] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-06T18:52:17.569327] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T18:52:18.225717] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-06T18:52:18.802127] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T18:52:18.872807] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T18:52:19.025553] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-06T18:52:19.668028] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T18:52:19.798081] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-06T18:52:19.825535] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-06T18:52:20.625531] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-06T18:52:20.777189] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T18:52:21.425511] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-06T18:52:21.476932] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T18:52:22.225538] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-06T18:52:22.965039] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T18:52:23.025475] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-06T18:52:23.127931] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-06T18:52:23.825511] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-06T18:52:23.910280] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T18:52:24.440340] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T18:52:24.625525] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-06T18:52:25.425633] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-06T18:52:26.233789] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-06T18:52:26.235766] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-06T18:52:26.327816] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T18:52:26.960291] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T18:52:27.025484] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-06T18:52:27.777226] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T18:52:27.825513] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-06T18:52:28.625549] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-06T18:52:29.404171] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T18:52:29.425462] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-06T18:52:29.512761] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-06T18:52:29.985928] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T18:52:30.225560] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-06T18:52:30.761867] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-06T18:52:31.025508] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-06T18:52:31.647129] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T18:52:31.825551] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-06T18:52:32.625509] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-06T18:52:32.665065] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T18:52:33.425563] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-06T18:52:33.940483] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T18:52:33.943267] [INFO ] [REMOTE ] FAF: Full fetch complete (57752 records). [2025-10-06T18:52:33.943408] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-06T18:52:34.229574] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-06T18:52:34.379585] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-06T18:52:34.456466] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-06T18:52:34.456563] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-06T18:52:34.457415] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-06T18:52:34.461104] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-06T18:52:34.463031] [DEBUG] [LOCAL ] FAF: Trimmed 57752 records to 41653 (keeping 200 days of data) [2025-10-06T18:52:34.729325] [DEBUG] [LOCAL ] FAF: Primary data saved (41653 records). [2025-10-06T18:52:34.729481] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-06T18:52:34.729597] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. FAF took 25.3s. Estimated remaining: 3h 40m 32s. Rate: 7.1 symbols/min [2025-10-06T18:52:34.903714] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:52:34.982577] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T18:52:34.981198] [DEBUG] [LOCAL ] FBIN: Loaded 51057 existing records from primary storage. [2025-10-06T18:52:34.994391] [INFO ] [MAIN ] FBIN: Loaded 51057 existing records. [2025-10-06T18:52:35.030602] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-06T18:52:35.170851] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:52:35.171106] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-06T18:52:35.171155] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-06T18:52:35.171526] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-06T18:52:35.171582] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-06T18:52:35.520283] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:52:35.825549] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-06T18:52:35.971917] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T18:52:36.625535] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-06T18:52:37.164461] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T18:52:37.425528] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-06T18:52:37.759588] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-06T18:52:38.166148] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T18:52:38.225474] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-06T18:52:39.025508] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-06T18:52:39.127638] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T18:52:39.825813] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-06T18:52:39.826869] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-06T18:52:39.831158] [INFO ] [REMOTE ] EXR: Full fetch complete (65917 records). [2025-10-06T18:52:39.831291] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-06T18:52:40.232387] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-06T18:52:40.232560] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-06T18:52:40.234282] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-06T18:52:40.234396] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-06T18:52:40.236547] [DEBUG] [LOCAL ] EXR: Trimmed 65917 records to 45249 (keeping 200 days of data) [2025-10-06T18:52:40.554876] [DEBUG] [LOCAL ] EXR: Primary data saved (45249 records). [2025-10-06T18:52:40.555106] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-06T18:52:40.555247] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXR took 31.1s. Estimated remaining: 3h 40m 18s. Rate: 7.1 symbols/min [2025-10-06T18:52:40.635138] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-06T18:52:40.737001] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:52:40.768394] [DEBUG] [LOCAL ] FBK: Loaded 26556 existing records from primary storage. [2025-10-06T18:52:40.768791] [INFO ] [MAIN ] FBK: Loaded 26556 existing records. [2025-10-06T18:52:40.961746] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:52:40.962297] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-06T18:52:40.962351] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-06T18:52:40.962688] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-06T18:52:40.962784] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-06T18:52:41.347241] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:52:41.382275] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-06T18:52:41.425502] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-06T18:52:41.516720] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T18:52:41.991299] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-06T18:52:42.225526] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-06T18:52:43.025514] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-06T18:52:43.250877] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-06T18:52:43.712635] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-06T18:52:43.825515] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-06T18:52:44.504247] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T18:52:44.507721] [INFO ] [REMOTE ] EXPD: Full fetch complete (69275 records). [2025-10-06T18:52:44.507885] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-06T18:52:44.625928] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-06T18:52:44.946121] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-06T18:52:44.946237] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-06T18:52:44.947612] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-06T18:52:44.947704] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-06T18:52:44.949537] [DEBUG] [LOCAL ] EXPD: Trimmed 69275 records to 47837 (keeping 200 days of data) [2025-10-06T18:52:45.272963] [DEBUG] [LOCAL ] EXPD: Primary data saved (47837 records). [2025-10-06T18:52:45.273184] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-06T18:52:45.274467] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXPD took 35.8s. Estimated remaining: 3h 40m 2s. Rate: 7.1 symbols/min [2025-10-06T18:52:45.434243] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-06T18:52:45.471010] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:52:45.510334] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T18:52:45.570141] [DEBUG] [LOCAL ] FBP: Loaded 46650 existing records from primary storage. [2025-10-06T18:52:45.570530] [INFO ] [MAIN ] FBP: Loaded 46650 existing records. [2025-10-06T18:52:45.745190] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T18:52:45.773718] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:52:45.778156] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-06T18:52:45.778500] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-06T18:52:45.778766] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-06T18:52:45.778827] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-06T18:52:46.151162] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:52:46.225512] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-06T18:52:47.025560] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-06T18:52:47.756089] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T18:52:47.779529] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-06T18:52:47.783413] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-06T18:52:47.783573] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-06T18:52:47.831336] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-06T18:52:48.205404] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-06T18:52:48.205548] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-06T18:52:48.207127] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-06T18:52:48.207483] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-06T18:52:48.209789] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-06T18:52:48.576757] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-06T18:52:48.576953] [INFO ] [MAIN ] F: Full history saved. [2025-10-06T18:52:48.577054] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 39.1s. Estimated remaining: 3h 39m 44s. Rate: 7.1 symbols/min [2025-10-06T18:52:48.627006] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-06T18:52:48.773553] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:52:48.813263] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-06T18:52:48.857066] [DEBUG] [LOCAL ] FBRT: Loaded 35221 existing records from primary storage. [2025-10-06T18:52:48.857498] [INFO ] [MAIN ] FBRT: Loaded 35221 existing records. [2025-10-06T18:52:49.045494] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:52:49.045833] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-06T18:52:49.045919] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-06T18:52:49.046212] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-06T18:52:49.046272] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-06T18:52:49.431029] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-06T18:52:49.438252] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:52:49.475187] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T18:52:49.641872] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T18:52:50.225533] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-06T18:52:51.025556] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-06T18:52:51.179187] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T18:52:51.251482] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T18:52:51.825557] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-06T18:52:52.551231] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T18:52:52.625555] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-06T18:52:53.170811] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T18:52:53.425541] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-06T18:52:54.008289] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T18:52:54.225558] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-06T18:52:55.025610] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-06T18:52:55.137350] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T18:52:55.831384] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-06T18:52:55.849603] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T18:52:56.306774] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-06T18:52:56.625555] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-06T18:52:57.047398] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T18:52:57.425548] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-06T18:52:57.763916] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T18:52:58.225598] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-06T18:52:58.876166] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T18:52:59.025532] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-06T18:52:59.265786] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T18:52:59.825557] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-06T18:53:00.333474] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T18:53:00.625551] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-06T18:53:01.233634] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T18:53:01.425554] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-06T18:53:02.225562] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-06T18:53:02.392067] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T18:53:02.661207] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-06T18:53:03.025611] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-06T18:53:03.825516] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-06T18:53:03.885981] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T18:53:03.889044] [INFO ] [REMOTE ] FBIN: Full fetch complete (72696 records). [2025-10-06T18:53:03.889159] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-06T18:53:04.277892] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-06T18:53:04.278040] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-06T18:53:04.279104] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-06T18:53:04.279219] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-06T18:53:04.280893] [DEBUG] [LOCAL ] FBIN: Trimmed 72696 records to 50431 (keeping 200 days of data) [2025-10-06T18:53:04.526628] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T18:53:04.621544] [DEBUG] [LOCAL ] FBIN: Primary data saved (50431 records). [2025-10-06T18:53:04.621741] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-06T18:53:04.622659] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBIN took 29.9s. Estimated remaining: 3h 39m 50s. Rate: 7.1 symbols/min [2025-10-06T18:53:04.644702] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-06T18:53:04.801738] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:53:04.820065] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T18:53:04.842878] [DEBUG] [LOCAL ] FC: Loaded 15641 existing records from primary storage. [2025-10-06T18:53:04.843151] [INFO ] [MAIN ] FC: Loaded 15641 existing records. [2025-10-06T18:53:05.026828] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:53:05.027140] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-06T18:53:05.027197] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-06T18:53:05.027435] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-06T18:53:05.031169] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-06T18:53:05.391533] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:53:05.425594] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-06T18:53:06.225534] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-06T18:53:06.327085] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T18:53:06.796757] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-06T18:53:06.963764] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-06T18:53:07.025544] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-06T18:53:07.825677] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-06T18:53:08.383381] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T18:53:08.625626] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-06T18:53:08.817118] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T18:53:09.425581] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-06T18:53:10.025873] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T18:53:10.225566] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-06T18:53:10.347634] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T18:53:11.025562] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-06T18:53:11.603607] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T18:53:11.825593] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-06T18:53:12.625586] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-06T18:53:12.696089] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T18:53:12.842333] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T18:53:13.425621] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-06T18:53:13.752862] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T18:53:14.225541] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-06T18:53:14.445387] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T18:53:15.025486] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-06T18:53:15.327817] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T18:53:15.330342] [INFO ] [REMOTE ] FBK: Full fetch complete (34017 records). [2025-10-06T18:53:15.330426] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-06T18:53:15.731376] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-06T18:53:15.731482] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-06T18:53:15.732547] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-06T18:53:15.732617] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-06T18:53:15.733942] [DEBUG] [LOCAL ] FBK: Trimmed 34017 records to 26494 (keeping 200 days of data) [2025-10-06T18:53:15.827717] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-06T18:53:15.910620] [DEBUG] [LOCAL ] FBK: Primary data saved (26494 records). [2025-10-06T18:53:15.910863] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-06T18:53:15.911018] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBK took 35.4s. Estimated remaining: 3h 39m 48s. Rate: 7.1 symbols/min [2025-10-06T18:53:16.094091] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:53:16.142334] [DEBUG] [LOCAL ] FCF: Loaded 39961 existing records from primary storage. [2025-10-06T18:53:16.142756] [INFO ] [MAIN ] FCF: Loaded 39961 existing records. [2025-10-06T18:53:16.347740] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:53:16.348127] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-06T18:53:16.348180] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-06T18:53:16.348707] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-06T18:53:16.348769] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-06T18:53:16.628492] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-06T18:53:16.695425] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T18:53:16.781283] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:53:17.110434] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T18:53:17.425524] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-06T18:53:17.525736] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T18:53:18.225544] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-06T18:53:18.820088] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T18:53:19.025585] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-06T18:53:19.717506] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T18:53:19.825487] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-06T18:53:19.863752] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T18:53:20.625532] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-06T18:53:20.929289] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T18:53:20.932320] [INFO ] [REMOTE ] FBP: Full fetch complete (66488 records). [2025-10-06T18:53:20.932443] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-06T18:53:21.341458] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-06T18:53:21.341578] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-06T18:53:21.342627] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-06T18:53:21.342719] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-06T18:53:21.344402] [DEBUG] [LOCAL ] FBP: Trimmed 66488 records to 45899 (keeping 200 days of data) [2025-10-06T18:53:21.435456] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-06T18:53:21.634872] [DEBUG] [LOCAL ] FBP: Primary data saved (45899 records). [2025-10-06T18:53:21.635046] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-06T18:53:21.635147] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBP took 36.4s. Estimated remaining: 3h 39m 34s. Rate: 7.1 symbols/min [2025-10-06T18:53:21.818453] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:53:21.848800] [DEBUG] [LOCAL ] FCN: Loaded 26319 existing records from primary storage. [2025-10-06T18:53:21.849130] [INFO ] [MAIN ] FCN: Loaded 26319 existing records. [2025-10-06T18:53:22.039484] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:53:22.040068] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-06T18:53:22.040283] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-06T18:53:22.048029] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-06T18:53:22.060418] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-06T18:53:22.067328] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T18:53:22.251312] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-06T18:53:22.440790] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:53:22.651157] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T18:53:23.025504] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-06T18:53:23.161227] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T18:53:23.825541] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-06T18:53:24.077205] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T18:53:24.625560] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-06T18:53:24.864068] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T18:53:25.425594] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-06T18:53:25.715265] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T18:53:26.225535] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-06T18:53:26.679029] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-06T18:53:27.025554] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-06T18:53:27.471210] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T18:53:27.473766] [INFO ] [REMOTE ] FBRT: Full fetch complete (49105 records). [2025-10-06T18:53:27.473885] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-06T18:53:27.832603] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-06T18:53:27.874604] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-06T18:53:27.874706] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-06T18:53:27.875480] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-06T18:53:27.875520] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-06T18:53:27.876877] [DEBUG] [LOCAL ] FBRT: Trimmed 49105 records to 34881 (keeping 200 days of data) [2025-10-06T18:53:28.120054] [DEBUG] [LOCAL ] FBRT: Primary data saved (34881 records). [2025-10-06T18:53:28.120291] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-06T18:53:28.120415] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBRT took 39.5s. Estimated remaining: 3h 39m 22s. Rate: 7.1 symbols/min [2025-10-06T18:53:28.299622] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:53:28.340109] [DEBUG] [LOCAL ] FCPT: Loaded 37913 existing records from primary storage. [2025-10-06T18:53:28.340510] [INFO ] [MAIN ] FCPT: Loaded 37913 existing records. [2025-10-06T18:53:28.529850] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:53:28.530335] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-06T18:53:28.530496] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-06T18:53:28.530992] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-06T18:53:28.531053] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-06T18:53:28.630673] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-06T18:53:28.878084] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T18:53:28.972692] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:53:28.988548] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T18:53:29.425476] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-06T18:53:29.819427] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T18:53:30.225568] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-06T18:53:30.892693] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T18:53:31.025505] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-06T18:53:31.176953] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T18:53:31.825575] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-06T18:53:32.380343] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T18:53:32.625554] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-06T18:53:33.098797] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T18:53:33.425579] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-06T18:53:33.529820] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T18:53:34.225572] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-06T18:53:34.553723] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T18:53:34.988570] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T18:53:34.989932] [INFO ] [REMOTE ] FC: Full fetch complete (21782 records). [2025-10-06T18:53:34.990004] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-06T18:53:35.030768] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-06T18:53:35.390183] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-06T18:53:35.390293] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-06T18:53:35.390822] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-06T18:53:35.390885] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-06T18:53:35.391475] [DEBUG] [LOCAL ] FC: Trimmed 21782 records to 15376 (keeping 200 days of data) [2025-10-06T18:53:35.479227] [DEBUG] [LOCAL ] FC: Primary data saved (15376 records). [2025-10-06T18:53:35.479390] [INFO ] [MAIN ] FC: Full history saved. [2025-10-06T18:53:35.479477] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 30.9s. Estimated remaining: 3h 39m 11s. Rate: 7.1 symbols/min [2025-10-06T18:53:35.649185] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:53:35.649425] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-06T18:53:35.649468] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-06T18:53:35.649624] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-06T18:53:35.649699] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-06T18:53:35.649770] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-06T18:53:35.649805] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-06T18:53:35.825890] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-06T18:53:36.017966] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:53:36.462385] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T18:53:36.625501] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-06T18:53:37.278573] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T18:53:37.425549] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-06T18:53:38.115350] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T18:53:38.225502] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-06T18:53:38.641259] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-06T18:53:39.025527] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-06T18:53:39.595734] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-06T18:53:39.825507] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-06T18:53:40.095084] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T18:53:40.625539] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-06T18:53:41.170381] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T18:53:41.425542] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-06T18:53:41.968503] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T18:53:42.225573] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-06T18:53:42.434995] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T18:53:42.438174] [INFO ] [REMOTE ] FCF: Full fetch complete (58196 records). [2025-10-06T18:53:42.438334] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-06T18:53:42.519428] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-10-06T18:53:42.871481] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-06T18:53:42.871626] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-06T18:53:42.872830] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-06T18:53:42.872947] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-06T18:53:42.875530] [DEBUG] [LOCAL ] FCF: Trimmed 58196 records to 39322 (keeping 200 days of data) [2025-10-06T18:53:43.059329] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-06T18:53:43.136528] [DEBUG] [LOCAL ] FCF: Primary data saved (39322 records). [2025-10-06T18:53:43.136767] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-06T18:53:43.136913] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCF took 27.2s. Estimated remaining: 3h 39m 1s. Rate: 7.1 symbols/min [2025-10-06T18:53:43.318031] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:53:43.336947] [DEBUG] [LOCAL ] FCT: Loaded 14890 existing records from primary storage. [2025-10-06T18:53:43.337272] [INFO ] [MAIN ] FCT: Loaded 14890 existing records. [2025-10-06T18:53:43.530853] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:53:43.531161] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-06T18:53:43.531215] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-06T18:53:43.531518] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-06T18:53:43.531579] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-06T18:53:43.830747] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-06T18:53:43.900195] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:53:44.336047] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-06T18:53:44.625564] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-06T18:53:45.374837] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T18:53:45.425478] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-06T18:53:45.676967] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T18:53:46.225580] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-06T18:53:46.912614] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T18:53:47.025500] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-06T18:53:47.252598] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-06T18:53:47.433585] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-06T18:53:47.825590] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-06T18:53:48.247086] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-06T18:53:48.625608] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-06T18:53:49.425490] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-06T18:53:49.759497] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T18:53:50.225618] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-06T18:53:50.407976] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T18:53:51.025588] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-06T18:53:51.296347] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T18:53:51.298535] [INFO ] [REMOTE ] FCN: Full fetch complete (35714 records). [2025-10-06T18:53:51.298711] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-06T18:53:51.686589] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-06T18:53:51.686785] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-06T18:53:51.687596] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-06T18:53:51.687682] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-06T18:53:51.688912] [DEBUG] [LOCAL ] FCN: Trimmed 35714 records to 25991 (keeping 200 days of data) [2025-10-06T18:53:51.834461] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-06T18:53:51.847146] [DEBUG] [LOCAL ] FCN: Primary data saved (25991 records). [2025-10-06T18:53:51.847308] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-06T18:53:51.847401] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCN took 30.2s. Estimated remaining: 3h 38m 53s. Rate: 7.1 symbols/min [2025-10-06T18:53:51.976045] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T18:53:52.045712] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:53:52.104063] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-10-06T18:53:52.104506] [INFO ] [MAIN ] FCX: Loaded 54480 existing records. [2025-10-06T18:53:52.298783] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:53:52.299386] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-06T18:53:52.299464] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-06T18:53:52.299802] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-06T18:53:52.299864] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-06T18:53:52.634906] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-06T18:53:52.661051] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:53:53.178892] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T18:53:53.425556] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-06T18:53:53.606521] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T18:53:54.225502] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-06T18:53:54.502765] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-06T18:53:54.867726] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T18:53:55.025602] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-06T18:53:55.825592] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-06T18:53:56.454104] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-06T18:53:56.483607] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T18:53:56.625569] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-06T18:53:57.425640] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-06T18:53:57.932185] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-06T18:53:58.225544] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-06T18:53:59.025548] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-06T18:53:59.326532] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T18:53:59.345015] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-06T18:53:59.362507] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T18:53:59.825541] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-06T18:54:00.625808] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-06T18:54:00.750764] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-06T18:54:01.032307] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-06T18:54:01.425548] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-06T18:54:02.225513] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-06T18:54:02.450002] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T18:54:02.569569] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-06T18:54:03.025554] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-06T18:54:03.825535] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-06T18:54:03.952994] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T18:54:04.625577] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-06T18:54:05.425597] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-06T18:54:05.556013] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T18:54:05.820297] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-06T18:54:05.867123] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-06T18:54:06.225561] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-06T18:54:06.664758] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-06T18:54:07.025539] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-06T18:54:07.825552] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-06T18:54:08.571703] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T18:54:08.625577] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-06T18:54:08.755634] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T18:54:08.975181] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-06T18:54:08.975981] [INFO ] [REMOTE ] FCRX: Full fetch complete (1683 records). [2025-10-06T18:54:08.976143] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-06T18:54:09.157961] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-06T18:54:09.158232] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:54:09.158316] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:54:09.158405] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-06T18:54:09.158494] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-06T18:54:09.158544] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-06T18:54:09.158600] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-06T18:54:09.158723] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCRX took 33.7s. Estimated remaining: 3h 39m 2s. Rate: 7.1 symbols/min [2025-10-06T18:54:09.330677] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:54:09.371802] [DEBUG] [LOCAL ] FDP: Loaded 30517 existing records from primary storage. [2025-10-06T18:54:09.372118] [INFO ] [MAIN ] FDP: Loaded 30517 existing records. [2025-10-06T18:54:09.435876] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-06T18:54:09.553428] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:54:09.553715] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-06T18:54:09.553809] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-06T18:54:09.554069] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-06T18:54:09.554125] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-06T18:54:09.898870] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:54:10.225533] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-06T18:54:11.025492] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-06T18:54:11.099820] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T18:54:11.101370] [INFO ] [REMOTE ] FCT: Full fetch complete (21200 records). [2025-10-06T18:54:11.101457] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-06T18:54:11.485488] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-06T18:54:11.485688] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-06T18:54:11.486357] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-06T18:54:11.486416] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-06T18:54:11.487506] [DEBUG] [LOCAL ] FCT: Trimmed 21200 records to 14710 (keeping 200 days of data) [2025-10-06T18:54:11.576277] [DEBUG] [LOCAL ] FCT: Primary data saved (14710 records). [2025-10-06T18:54:11.576439] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-06T18:54:11.576527] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCT took 28.4s. Estimated remaining: 3h 38m 42s. Rate: 7.1 symbols/min [2025-10-06T18:54:11.757178] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:54:11.789011] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-06T18:54:11.820706] [DEBUG] [LOCAL ] FDS: Loaded 27155 existing records from primary storage. [2025-10-06T18:54:11.821040] [INFO ] [MAIN ] FDS: Loaded 27155 existing records. [2025-10-06T18:54:11.833292] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-06T18:54:12.011296] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:54:12.011603] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-06T18:54:12.011685] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-06T18:54:12.012003] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-06T18:54:12.012061] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-06T18:54:12.318468] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T18:54:12.357058] [INFO ] [REMOTE ] FCPT: Full fetch complete (53843 records). [2025-10-06T18:54:12.366152] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-06T18:54:12.433045] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:54:12.630854] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-06T18:54:12.793856] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-06T18:54:12.793993] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-06T18:54:12.795179] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-06T18:54:12.795251] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-06T18:54:12.796870] [DEBUG] [LOCAL ] FCPT: Trimmed 53843 records to 37322 (keeping 200 days of data) [2025-10-06T18:54:13.060506] [DEBUG] [LOCAL ] FCPT: Primary data saved (37322 records). [2025-10-06T18:54:13.060780] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-06T18:54:13.060935] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCPT took 44.9s. Estimated remaining: 3h 38m 20s. Rate: 7.1 symbols/min [2025-10-06T18:54:13.279886] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:54:13.337615] [DEBUG] [LOCAL ] FDX: Loaded 52286 existing records from primary storage. [2025-10-06T18:54:13.338119] [INFO ] [MAIN ] FDX: Loaded 52286 existing records. [2025-10-06T18:54:13.430699] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-06T18:54:13.549202] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:54:13.549512] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-06T18:54:13.549574] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-06T18:54:13.549822] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-06T18:54:13.549891] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-06T18:54:13.925776] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:54:13.943588] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T18:54:14.021909] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-06T18:54:14.225502] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-06T18:54:14.590635] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T18:54:15.025551] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-06T18:54:15.825484] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-06T18:54:15.922590] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T18:54:16.625545] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-06T18:54:17.047394] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T18:54:17.137682] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-06T18:54:17.425534] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-06T18:54:17.722131] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T18:54:18.225546] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-06T18:54:19.025497] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-06T18:54:19.262972] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T18:54:19.390160] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T18:54:19.825534] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-06T18:54:20.625502] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-06T18:54:20.888158] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T18:54:20.944692] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T18:54:21.425520] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-06T18:54:22.225500] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-06T18:54:22.593281] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-06T18:54:22.734029] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T18:54:23.025545] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-06T18:54:23.617130] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T18:54:23.825576] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-06T18:54:24.262334] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T18:54:24.625568] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-06T18:54:25.425595] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-06T18:54:26.000538] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T18:54:26.168784] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-06T18:54:26.225541] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-06T18:54:26.661520] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T18:54:27.025546] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-06T18:54:27.825513] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-06T18:54:28.178923] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T18:54:28.247869] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T18:54:28.625536] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-06T18:54:28.835274] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-06T18:54:29.425538] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-06T18:54:30.225583] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-06T18:54:30.683579] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T18:54:30.813384] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-06T18:54:31.025576] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-06T18:54:31.421081] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-06T18:54:31.825537] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-06T18:54:32.625497] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-06T18:54:33.008246] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-06T18:54:33.023506] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-06T18:54:33.026835] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-06T18:54:33.027121] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-06T18:54:33.442161] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-06T18:54:33.448056] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-06T18:54:33.448229] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-06T18:54:33.449611] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-06T18:54:33.449867] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-06T18:54:33.452135] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 53700 (keeping 200 days of data) [2025-10-06T18:54:33.814781] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-10-06T18:54:33.814978] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-06T18:54:33.815076] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FCX took 42.0s. Estimated remaining: 3h 38m 36s. Rate: 7.1 symbols/min [2025-10-06T18:54:34.009138] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:54:34.068114] [DEBUG] [LOCAL ] FE: Loaded 54208 existing records from primary storage. [2025-10-06T18:54:34.068583] [INFO ] [MAIN ] FE: Loaded 54208 existing records. [2025-10-06T18:54:34.229365] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-06T18:54:34.263905] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:54:34.266178] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-06T18:54:34.266261] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-06T18:54:34.266752] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-06T18:54:34.266829] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-06T18:54:34.678335] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-06T18:54:34.703546] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:54:34.812399] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T18:54:35.025580] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-06T18:54:35.825493] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-06T18:54:35.877522] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T18:54:36.266869] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T18:54:36.625542] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-06T18:54:37.425506] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-06T18:54:37.499318] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T18:54:37.553293] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T18:54:38.225690] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-06T18:54:39.025548] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-06T18:54:39.466058] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-06T18:54:39.825488] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-06T18:54:39.884505] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T18:54:40.053435] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T18:54:40.055831] [INFO ] [REMOTE ] FDP: Full fetch complete (42953 records). [2025-10-06T18:54:40.055942] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-06T18:54:40.478472] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-06T18:54:40.478633] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-06T18:54:40.479727] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-06T18:54:40.479798] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-06T18:54:40.481207] [DEBUG] [LOCAL ] FDP: Trimmed 42953 records to 30103 (keeping 200 days of data) [2025-10-06T18:54:40.625811] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-06T18:54:40.723178] [DEBUG] [LOCAL ] FDP: Primary data saved (30103 records). [2025-10-06T18:54:40.723382] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-06T18:54:40.723490] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FDP took 31.6s. Estimated remaining: 3h 38m 24s. Rate: 7.1 symbols/min [2025-10-06T18:54:40.968911] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:54:40.969280] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-06T18:54:40.969351] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-06T18:54:40.969526] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-06T18:54:40.969589] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-06T18:54:40.969685] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-06T18:54:40.969759] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-06T18:54:41.432526] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-06T18:54:41.478623] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:54:41.577804] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-06T18:54:41.580845] [INFO ] [REMOTE ] FDS: Full fetch complete (37951 records). [2025-10-06T18:54:41.581001] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-06T18:54:41.982786] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-06T18:54:41.983029] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-06T18:54:41.984280] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-06T18:54:41.984359] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-06T18:54:41.985854] [DEBUG] [LOCAL ] FDS: Trimmed 37951 records to 26884 (keeping 200 days of data) [2025-10-06T18:54:42.177713] [DEBUG] [LOCAL ] FDS: Primary data saved (26884 records). [2025-10-06T18:54:42.177900] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-06T18:54:42.178044] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FDS took 30.6s. Estimated remaining: 3h 38m 3s. Rate: 7.1 symbols/min [2025-10-06T18:54:42.249535] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-06T18:54:42.407998] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:54:42.412160] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T18:54:42.501216] [DEBUG] [LOCAL ] FERG: Loaded 49585 existing records from primary storage. [2025-10-06T18:54:42.501781] [INFO ] [MAIN ] FERG: Loaded 49585 existing records. [2025-10-06T18:54:42.712179] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-06T18:54:42.711925] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:54:42.714150] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-06T18:54:42.714321] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-06T18:54:42.714634] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-06T18:54:42.714764] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-06T18:54:43.028494] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-06T18:54:43.109475] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:54:43.468363] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-06T18:54:43.483384] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-06T18:54:43.825561] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-06T18:54:44.625571] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-06T18:54:45.425581] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-06T18:54:45.653024] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T18:54:46.225566] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-06T18:54:46.378771] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T18:54:46.648894] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-06T18:54:47.025565] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-06T18:54:47.440563] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-06T18:54:47.825564] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-06T18:54:48.254124] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-06T18:54:48.625512] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-06T18:54:48.714424] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T18:54:49.086863] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-06T18:54:49.425558] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-06T18:54:50.225596] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-06T18:54:50.652251] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-06T18:54:51.032236] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-06T18:54:51.039341] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T18:54:51.389269] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-06T18:54:51.825550] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-06T18:54:52.164414] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-06T18:54:52.625543] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-06T18:54:52.970850] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-06T18:54:53.425590] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-06T18:54:54.225537] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-06T18:54:55.025560] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-06T18:54:55.078610] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T18:54:55.496122] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-06T18:54:55.825503] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-06T18:54:55.978685] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T18:54:56.625599] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-06T18:54:57.082848] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T18:54:57.083816] [INFO ] [REMOTE ] FENG: Full fetch complete (2260 records). [2025-10-06T18:54:57.083902] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-06T18:54:57.295666] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T18:54:57.295979] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T18:54:57.296071] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T18:54:57.296171] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-06T18:54:57.296283] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-06T18:54:57.296353] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-06T18:54:57.296400] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-06T18:54:57.296485] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FENG took 16.6s. Estimated remaining: 3h 38m 7s. Rate: 7.1 symbols/min [2025-10-06T18:54:57.430734] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-06T18:54:57.491792] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:54:57.509708] [DEBUG] [LOCAL ] FET: Loaded 13092 existing records from primary storage. [2025-10-06T18:54:57.510004] [INFO ] [MAIN ] FET: Loaded 13092 existing records. [2025-10-06T18:54:57.718432] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:54:57.718971] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-06T18:54:57.719175] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-06T18:54:57.719541] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-06T18:54:57.719627] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-06T18:54:58.145380] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-06T18:54:58.152399] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:54:58.225596] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-06T18:54:59.025583] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-06T18:54:59.307887] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-06T18:54:59.825563] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-06T18:55:00.048049] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T18:55:00.625626] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-06T18:55:00.757917] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T18:55:01.105469] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-06T18:55:01.425599] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-06T18:55:02.225498] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-06T18:55:02.580823] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-06T18:55:02.995220] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T18:55:03.025541] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-06T18:55:03.825509] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-06T18:55:04.151199] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-06T18:55:04.625511] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-06T18:55:05.021188] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-06T18:55:05.082377] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T18:55:05.425520] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-06T18:55:05.488567] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T18:55:06.225551] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-06T18:55:07.025557] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-06T18:55:07.288599] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-06T18:55:07.292280] [INFO ] [REMOTE ] FDX: Full fetch complete (74451 records). [2025-10-06T18:55:07.292432] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-06T18:55:07.726768] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-06T18:55:07.727011] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-06T18:55:07.728446] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-06T18:55:07.728534] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-06T18:55:07.730601] [DEBUG] [LOCAL ] FDX: Trimmed 74451 records to 51530 (keeping 200 days of data) [2025-10-06T18:55:07.830345] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-06T18:55:07.837062] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T18:55:08.135281] [DEBUG] [LOCAL ] FDX: Primary data saved (51530 records). [2025-10-06T18:55:08.135501] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-06T18:55:08.135608] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FDX took 55.1s. Estimated remaining: 3h 38m 3s. Rate: 7.1 symbols/min [2025-10-06T18:55:08.315426] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:55:08.346697] [DEBUG] [LOCAL ] FF: Loaded 25223 existing records from primary storage. [2025-10-06T18:55:08.347107] [INFO ] [MAIN ] FF: Loaded 25223 existing records. [2025-10-06T18:55:08.545147] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:55:08.545416] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-06T18:55:08.545465] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-06T18:55:08.545875] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-06T18:55:08.545956] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-06T18:55:08.630632] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-06T18:55:08.713016] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T18:55:08.950929] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:55:08.987414] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-06T18:55:09.425560] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-06T18:55:10.225513] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-06T18:55:10.275841] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T18:55:10.994070] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T18:55:11.025514] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-06T18:55:11.113141] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-06T18:55:11.825554] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-06T18:55:12.625543] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-06T18:55:12.664944] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-06T18:55:12.880494] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T18:55:13.425543] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-06T18:55:14.225523] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-06T18:55:14.340727] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T18:55:14.361024] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T18:55:14.986877] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-06T18:55:15.025525] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-06T18:55:15.825496] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-06T18:55:16.177010] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-06T18:55:16.338692] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-06T18:55:16.625604] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-06T18:55:17.425511] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-06T18:55:17.577106] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T18:55:18.225587] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-06T18:55:18.958550] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T18:55:18.962018] [INFO ] [REMOTE ] FE: Full fetch complete (77275 records). [2025-10-06T18:55:18.962168] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-06T18:55:19.030761] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-06T18:55:19.354564] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-06T18:55:19.354686] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-06T18:55:19.355753] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-06T18:55:19.355817] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-06T18:55:19.357827] [DEBUG] [LOCAL ] FE: Trimmed 77275 records to 53430 (keeping 200 days of data) [2025-10-06T18:55:19.701931] [DEBUG] [LOCAL ] FE: Primary data saved (53430 records). [2025-10-06T18:55:19.702126] [INFO ] [MAIN ] FE: Full history saved. [2025-10-06T18:55:19.702221] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FE took 45.9s. Estimated remaining: 3h 38m 1s. Rate: 7.1 symbols/min [2025-10-06T18:55:19.829931] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-06T18:55:19.877248] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:55:19.887373] [DEBUG] [LOCAL ] FFA: Loaded 6012 existing records from primary storage. [2025-10-06T18:55:19.887673] [INFO ] [MAIN ] FFA: Loaded 6012 existing records. [2025-10-06T18:55:20.018350] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-06T18:55:20.081924] [INFO ] [REMOTE ] FERG: Full fetch complete (70925 records). [2025-10-06T18:55:20.087886] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-06T18:55:20.087569] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:55:20.088432] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-06T18:55:20.088619] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-06T18:55:20.101078] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-06T18:55:20.146598] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-06T18:55:20.566500] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T18:55:20.629299] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-06T18:55:20.839844] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-06T18:55:20.874703] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-06T18:55:20.876077] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-06T18:55:20.880364] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-06T18:55:20.923497] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T18:55:20.982775] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:55:20.984229] [DEBUG] [LOCAL ] FERG: Trimmed 70925 records to 48790 (keeping 200 days of data) [2025-10-06T18:55:21.316937] [DEBUG] [LOCAL ] FERG: Primary data saved (48790 records). [2025-10-06T18:55:21.317116] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-06T18:55:21.317227] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FERG took 39.1s. Estimated remaining: 3h 37m 39s. Rate: 7.1 symbols/min [2025-10-06T18:55:21.430752] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-06T18:55:21.488393] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:55:21.510044] [DEBUG] [LOCAL ] FFC: Loaded 16957 existing records from primary storage. [2025-10-06T18:55:21.510370] [INFO ] [MAIN ] FFC: Loaded 16957 existing records. [2025-10-06T18:55:21.684222] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:55:21.684519] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-06T18:55:21.684568] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-06T18:55:21.684889] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-06T18:55:21.684947] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-06T18:55:22.059964] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:55:22.144932] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T18:55:22.225561] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-06T18:55:22.424105] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T18:55:23.025489] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-06T18:55:23.220316] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T18:55:23.825503] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-06T18:55:23.841531] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T18:55:23.842913] [INFO ] [REMOTE ] FET: Full fetch complete (18372 records). [2025-10-06T18:55:23.842986] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-06T18:55:24.259746] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-06T18:55:24.259897] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-06T18:55:24.260509] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-06T18:55:24.260553] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-06T18:55:24.261294] [DEBUG] [LOCAL ] FET: Trimmed 18372 records to 12814 (keeping 200 days of data) [2025-10-06T18:55:24.346347] [DEBUG] [LOCAL ] FET: Primary data saved (12814 records). [2025-10-06T18:55:24.346556] [INFO ] [MAIN ] FET: Full history saved. [2025-10-06T18:55:24.346683] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FET took 27.0s. Estimated remaining: 3h 37m 21s. Rate: 7.1 symbols/min [2025-10-06T18:55:24.461116] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-06T18:55:24.539264] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:55:24.581892] [DEBUG] [LOCAL ] FFWM: Loaded 36233 existing records from primary storage. [2025-10-06T18:55:24.582287] [INFO ] [MAIN ] FFWM: Loaded 36233 existing records. [2025-10-06T18:55:24.630817] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-06T18:55:24.782143] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:55:24.782442] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-06T18:55:24.782493] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-06T18:55:24.782997] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-06T18:55:24.783057] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-06T18:55:25.162990] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:55:25.425546] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-06T18:55:26.016492] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T18:55:26.225582] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-06T18:55:26.477862] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T18:55:27.025540] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-06T18:55:27.082232] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T18:55:27.825525] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-06T18:55:28.382716] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T18:55:28.625504] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-06T18:55:28.794278] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T18:55:29.425495] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-06T18:55:29.742306] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-06T18:55:30.225590] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-06T18:55:30.363416] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T18:55:30.984601] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-06T18:55:31.025570] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-06T18:55:31.825573] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-06T18:55:32.088704] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-06T18:55:32.409357] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T18:55:32.625535] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-06T18:55:33.369017] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T18:55:33.425476] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-06T18:55:34.225558] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-06T18:55:34.256612] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-06T18:55:35.025683] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-06T18:55:35.159685] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-06T18:55:35.825543] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-06T18:55:36.216236] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T18:55:36.625500] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-06T18:55:37.083579] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T18:55:37.425518] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-06T18:55:37.671539] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T18:55:38.225499] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-06T18:55:38.491418] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T18:55:38.786319] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T18:55:39.025616] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-06T18:55:39.490251] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-06T18:55:39.825533] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-06T18:55:40.438799] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-06T18:55:40.625488] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-06T18:55:41.425620] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-06T18:55:41.999906] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T18:55:42.225569] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-06T18:55:42.422686] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-06T18:55:42.835192] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T18:55:43.025515] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-06T18:55:43.755220] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T18:55:43.825543] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-06T18:55:44.625712] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-06T18:55:45.165030] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T18:55:45.234681] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T18:55:45.235807] [INFO ] [REMOTE ] FFA: Full fetch complete (8599 records). [2025-10-06T18:55:45.235878] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-06T18:55:45.431313] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-06T18:55:45.605275] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-06T18:55:45.605363] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-06T18:55:45.605612] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-06T18:55:45.605677] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-06T18:55:45.606163] [DEBUG] [LOCAL ] FFA: Trimmed 8599 records to 5960 (keeping 200 days of data) [2025-10-06T18:55:45.643393] [DEBUG] [LOCAL ] FFA: Primary data saved (5960 records). [2025-10-06T18:55:45.643560] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-06T18:55:45.643690] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FFA took 25.9s. Estimated remaining: 3h 37m 36s. Rate: 7.1 symbols/min [2025-10-06T18:55:45.819595] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:55:45.843947] [DEBUG] [LOCAL ] FG: Loaded 23125 existing records from primary storage. [2025-10-06T18:55:45.844262] [INFO ] [MAIN ] FG: Loaded 23125 existing records. [2025-10-06T18:55:46.031974] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:55:46.032268] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-06T18:55:46.032324] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-06T18:55:46.032889] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-06T18:55:46.033002] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-06T18:55:46.230839] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-06T18:55:46.452305] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:55:46.495869] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T18:55:47.025612] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-06T18:55:47.363689] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-06T18:55:47.788438] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-06T18:55:47.825535] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-06T18:55:48.595354] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T18:55:48.625552] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-06T18:55:49.425604] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-06T18:55:49.459305] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T18:55:50.109792] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-06T18:55:50.111371] [INFO ] [REMOTE ] FF: Full fetch complete (36719 records). [2025-10-06T18:55:50.111455] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-06T18:55:50.230683] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-06T18:55:50.487157] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-06T18:55:50.487242] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-06T18:55:50.488013] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-06T18:55:50.488076] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-06T18:55:50.488971] [DEBUG] [LOCAL ] FF: Trimmed 36719 records to 24656 (keeping 200 days of data) [2025-10-06T18:55:50.636557] [DEBUG] [LOCAL ] FF: Primary data saved (24656 records). [2025-10-06T18:55:50.636740] [INFO ] [MAIN ] FF: Full history saved. [2025-10-06T18:55:50.636838] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FF took 42.5s. Estimated remaining: 3h 37m 22s. Rate: 7.1 symbols/min [2025-10-06T18:55:50.813785] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:55:50.820701] [DEBUG] [LOCAL ] FGN: Loaded 3930 existing records from primary storage. [2025-10-06T18:55:50.820931] [INFO ] [MAIN ] FGN: Loaded 3930 existing records. [2025-10-06T18:55:51.006484] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:55:51.006810] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-06T18:55:51.006880] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-06T18:55:51.007129] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-06T18:55:51.007206] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-06T18:55:51.030688] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-06T18:55:51.466799] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:55:51.491085] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T18:55:51.825549] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-06T18:55:52.226475] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T18:55:52.625590] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-06T18:55:53.203838] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T18:55:53.249387] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-06T18:55:53.251498] [INFO ] [REMOTE ] FFC: Full fetch complete (24761 records). [2025-10-06T18:55:53.251739] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-06T18:55:53.430877] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-06T18:55:53.649854] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-06T18:55:53.649945] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-06T18:55:53.650535] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-06T18:55:53.650589] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-06T18:55:53.651234] [DEBUG] [LOCAL ] FFC: Trimmed 24761 records to 16713 (keeping 200 days of data) [2025-10-06T18:55:53.752125] [DEBUG] [LOCAL ] FFC: Primary data saved (16713 records). [2025-10-06T18:55:53.752286] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-06T18:55:53.752382] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FFC took 32.4s. Estimated remaining: 3h 37m 3s. Rate: 7.1 symbols/min [2025-10-06T18:55:53.947891] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:55:53.948115] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-06T18:55:53.948198] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-06T18:55:53.948322] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-06T18:55:53.948363] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-06T18:55:53.948408] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-06T18:55:53.948446] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-06T18:55:54.227932] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-06T18:55:54.310016] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:55:54.920168] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T18:55:55.025493] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-06T18:55:55.410256] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T18:55:55.825569] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-06T18:55:55.969570] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T18:55:56.206026] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-06T18:55:56.625567] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-06T18:55:56.807780] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:55:56.808148] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-06T18:55:56.808238] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:55:56.808286] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-06T18:55:56.808326] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:55:56.808365] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-06T18:55:56.808429] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-06T18:55:56.808462] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-06T18:55:56.808500] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-06T18:55:56.808548] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGSN took 3.1s. Estimated remaining: 3h 36m 45s. Rate: 7.1 symbols/min [2025-10-06T18:55:56.980527] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:55:57.028962] [DEBUG] [LOCAL ] FHI: Loaded 40721 existing records from primary storage. [2025-10-06T18:55:57.029441] [INFO ] [MAIN ] FHI: Loaded 40721 existing records. [2025-10-06T18:55:57.214147] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:55:57.214364] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-06T18:55:57.214419] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-06T18:55:57.214679] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-06T18:55:57.214738] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-06T18:55:57.433452] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-06T18:55:57.612143] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:55:58.171690] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-06T18:55:58.225548] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-06T18:55:59.025542] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-06T18:55:59.825558] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-06T18:55:59.879886] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T18:56:00.330330] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-06T18:56:00.625570] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-06T18:56:00.904885] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T18:56:01.425561] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-06T18:56:01.541781] [DEBUG] [REMOTE ] FG: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-06T18:56:01.542185] [WARN ] [REMOTE ] FG: No data returned for month 2025-07 [2025-10-06T18:56:01.542341] [FATAL] [REMOTE ] FG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:56:01.542435] [FATAL] [MAIN ] FG: Failed to fetch primary data. [2025-10-06T18:56:01.542499] [WARN ] [MAIN ] FG: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:56:01.542574] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-06T18:56:01.542671] [DEBUG] [LOCAL ] FG: No primary data file found to delete. [2025-10-06T18:56:01.542731] [INFO ] [LOCAL ] FG: Starting deletion of derivative data. [2025-10-06T18:56:01.543021] [DEBUG] [LOCAL ] FG: Deleted derivative data file. [2025-10-06T18:56:01.543160] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FG took 15.9s. Estimated remaining: 3h 36m 29s. Rate: 7.1 symbols/min [2025-10-06T18:56:01.722173] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:56:01.781220] [DEBUG] [LOCAL ] FHN: Loaded 54145 existing records from primary storage. [2025-10-06T18:56:01.781607] [INFO ] [MAIN ] FHN: Loaded 54145 existing records. [2025-10-06T18:56:01.976441] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:56:01.976950] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-06T18:56:01.977048] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-06T18:56:01.986547] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-06T18:56:01.999725] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-06T18:56:02.087364] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T18:56:02.230725] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-06T18:56:02.373727] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:56:03.025552] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-06T18:56:03.491593] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-06T18:56:03.804721] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T18:56:03.825481] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-06T18:56:04.625533] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-06T18:56:05.068084] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-06T18:56:05.425552] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-06T18:56:05.734875] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-06T18:56:06.225551] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-06T18:56:07.025542] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-06T18:56:07.183371] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T18:56:07.430357] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T18:56:07.825607] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-06T18:56:08.436449] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T18:56:08.625548] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-06T18:56:08.934731] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T18:56:09.425558] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-06T18:56:09.602947] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T18:56:10.225529] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-06T18:56:10.917731] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T18:56:11.025518] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-06T18:56:11.403538] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T18:56:11.405902] [INFO ] [REMOTE ] FFWM: Full fetch complete (51784 records). [2025-10-06T18:56:11.406014] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-06T18:56:11.805131] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-06T18:56:11.805251] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-06T18:56:11.806186] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-06T18:56:11.806296] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-06T18:56:11.807706] [DEBUG] [LOCAL ] FFWM: Trimmed 51784 records to 35744 (keeping 200 days of data) [2025-10-06T18:56:11.858159] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-06T18:56:12.012274] [DEBUG] [LOCAL ] FFWM: Primary data saved (35744 records). [2025-10-06T18:56:12.012444] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-06T18:56:12.012558] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FFWM took 47.7s. Estimated remaining: 3h 36m 25s. Rate: 7.1 symbols/min [2025-10-06T18:56:12.182615] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:56:12.237866] [DEBUG] [LOCAL ] FI: Loaded 54278 existing records from primary storage. [2025-10-06T18:56:12.238281] [INFO ] [MAIN ] FI: Loaded 54278 existing records. [2025-10-06T18:56:12.415894] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:56:12.416143] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-06T18:56:12.416250] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-06T18:56:12.416639] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-06T18:56:12.416739] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-06T18:56:12.631021] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-06T18:56:12.640987] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T18:56:12.816442] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:56:13.274075] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-06T18:56:13.425575] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-06T18:56:13.622942] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T18:56:14.018568] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-06T18:56:14.225536] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-06T18:56:15.025566] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-06T18:56:15.752281] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-06T18:56:15.779305] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T18:56:15.825527] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-06T18:56:16.625546] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-06T18:56:17.425539] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-06T18:56:17.550467] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T18:56:18.036280] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T18:56:18.036463] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-06T18:56:18.225538] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-06T18:56:19.025555] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-06T18:56:19.499332] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T18:56:19.502170] [INFO ] [REMOTE ] FHI: Full fetch complete (57614 records). [2025-10-06T18:56:19.502293] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-06T18:56:19.837363] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-06T18:56:19.895872] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-06T18:56:19.895992] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-06T18:56:19.896959] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-06T18:56:19.897026] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-06T18:56:19.898959] [DEBUG] [LOCAL ] FHI: Trimmed 57614 records to 40064 (keeping 200 days of data) [2025-10-06T18:56:20.151343] [DEBUG] [LOCAL ] FHI: Primary data saved (40064 records). [2025-10-06T18:56:20.151494] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-06T18:56:20.151579] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FHI took 23.3s. Estimated remaining: 3h 36m 16s. Rate: 7.1 symbols/min [2025-10-06T18:56:20.329361] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:56:20.352930] [DEBUG] [LOCAL ] FICO: Loaded 21102 existing records from primary storage. [2025-10-06T18:56:20.353369] [INFO ] [MAIN ] FICO: Loaded 21102 existing records. [2025-10-06T18:56:20.537627] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:56:20.537911] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-06T18:56:20.537962] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-06T18:56:20.538220] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-06T18:56:20.538297] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-06T18:56:20.633912] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-06T18:56:20.912577] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:56:20.944495] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-06T18:56:21.198798] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-06T18:56:21.425542] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-06T18:56:21.651365] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T18:56:22.225554] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-06T18:56:23.025553] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-06T18:56:23.142611] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T18:56:23.587360] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T18:56:23.825498] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-06T18:56:23.964999] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T18:56:24.376708] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-06T18:56:24.625535] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-06T18:56:25.150726] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T18:56:25.151485] [INFO ] [REMOTE ] FGN: Full fetch complete (5749 records). [2025-10-06T18:56:25.151575] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-06T18:56:25.431566] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-06T18:56:25.576686] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-06T18:56:25.576806] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-06T18:56:25.577049] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-06T18:56:25.577092] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-06T18:56:25.577662] [DEBUG] [LOCAL ] FGN: Trimmed 5749 records to 3847 (keeping 200 days of data) [2025-10-06T18:56:25.603293] [DEBUG] [LOCAL ] FGN: Primary data saved (3847 records). [2025-10-06T18:56:25.603434] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-06T18:56:25.603531] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FGN took 35.0s. Estimated remaining: 3h 36m 2s. Rate: 7.1 symbols/min [2025-10-06T18:56:25.808296] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:56:25.808569] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-06T18:56:25.808611] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-06T18:56:25.808758] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-06T18:56:25.808802] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-06T18:56:25.808844] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-06T18:56:25.808876] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-06T18:56:26.199270] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:56:26.225556] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-06T18:56:26.537978] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-06T18:56:26.657983] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T18:56:27.025543] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-06T18:56:27.825493] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-06T18:56:28.091047] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-06T18:56:28.120679] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T18:56:28.625577] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-06T18:56:29.425586] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-06T18:56:30.225554] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-06T18:56:30.368732] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T18:56:30.746314] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T18:56:31.025509] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-06T18:56:31.339689] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-06T18:56:31.390620] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T18:56:31.825554] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-06T18:56:32.069882] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-06T18:56:32.625592] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-06T18:56:32.949907] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-06T18:56:33.425545] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-06T18:56:34.225554] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-06T18:56:34.445795] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T18:56:35.025561] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-06T18:56:35.825516] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-06T18:56:36.169202] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-06T18:56:36.631362] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-06T18:56:36.644939] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T18:56:36.920499] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T18:56:37.425555] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-06T18:56:37.748203] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-06T18:56:38.225585] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-06T18:56:38.583605] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:56:38.584034] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-06T18:56:38.584128] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:56:38.584214] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-06T18:56:38.584275] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:56:38.584355] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-06T18:56:38.584449] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-06T18:56:38.584503] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-06T18:56:38.584558] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-06T18:56:38.584631] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FIG took 13.0s. Estimated remaining: 3h 36m 2s. Rate: 7.1 symbols/min [2025-10-06T18:56:38.756917] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:56:38.810347] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-06T18:56:38.865877] [DEBUG] [LOCAL ] FIGS: Loaded 49571 existing records from primary storage. [2025-10-06T18:56:38.866254] [INFO ] [MAIN ] FIGS: Loaded 49571 existing records. [2025-10-06T18:56:39.039819] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-06T18:56:39.046233] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:56:39.047433] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-06T18:56:39.047517] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-06T18:56:39.047880] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-06T18:56:39.047941] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-06T18:56:39.408265] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:56:39.825557] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-06T18:56:40.421519] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T18:56:40.625601] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-06T18:56:41.425537] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-06T18:56:41.474999] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T18:56:41.496934] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-06T18:56:42.225603] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-06T18:56:43.025505] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-06T18:56:43.432874] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-06T18:56:43.768273] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T18:56:43.825613] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-06T18:56:44.625562] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-06T18:56:44.817560] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T18:56:45.425590] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-06T18:56:45.666060] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T18:56:45.776542] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T18:56:46.225533] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-06T18:56:46.788168] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-06T18:56:47.025614] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-06T18:56:47.825560] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-06T18:56:48.333510] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-06T18:56:48.368796] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T18:56:48.625577] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-06T18:56:49.260198] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T18:56:49.425540] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-06T18:56:49.777433] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T18:56:50.225540] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-06T18:56:51.025533] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-06T18:56:51.124018] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T18:56:51.638596] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T18:56:51.825571] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-06T18:56:52.274439] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T18:56:52.276739] [INFO ] [REMOTE ] FICO: Full fetch complete (29068 records). [2025-10-06T18:56:52.276820] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-06T18:56:52.641631] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-06T18:56:52.698333] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-06T18:56:52.698498] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-06T18:56:52.699492] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-06T18:56:52.699584] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-06T18:56:52.700850] [DEBUG] [LOCAL ] FICO: Trimmed 29068 records to 21078 (keeping 200 days of data) [2025-10-06T18:56:52.845411] [DEBUG] [LOCAL ] FICO: Primary data saved (21078 records). [2025-10-06T18:56:52.845578] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-06T18:56:52.845757] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FICO took 32.7s. Estimated remaining: 3h 36m 4s. Rate: 7.1 symbols/min [2025-10-06T18:56:53.029554] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:56:53.082318] [DEBUG] [LOCAL ] FIHL: Loaded 40409 existing records from primary storage. [2025-10-06T18:56:53.082766] [INFO ] [MAIN ] FIHL: Loaded 40409 existing records. [2025-10-06T18:56:53.286245] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:56:53.286761] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-06T18:56:53.286831] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-06T18:56:53.288184] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-06T18:56:53.288456] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-06T18:56:53.442696] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-06T18:56:53.664668] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:56:53.809861] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T18:56:54.230281] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-06T18:56:54.234841] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T18:56:54.240227] [INFO ] [REMOTE ] FHN: Full fetch complete (77285 records). [2025-10-06T18:56:54.240407] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-06T18:56:54.660960] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-06T18:56:54.661067] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-06T18:56:54.662348] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-06T18:56:54.662415] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-06T18:56:54.664282] [DEBUG] [LOCAL ] FHN: Trimmed 77285 records to 53368 (keeping 200 days of data) [2025-10-06T18:56:55.016115] [DEBUG] [LOCAL ] FHN: Primary data saved (53368 records). [2025-10-06T18:56:55.016302] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-06T18:56:55.016401] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FHN took 53.5s. Estimated remaining: 3h 35m 44s. Rate: 7.1 symbols/min [2025-10-06T18:56:55.051794] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-06T18:56:55.239719] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T18:56:55.236822] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:56:55.264982] [DEBUG] [LOCAL ] FINS: Loaded 8348 existing records from primary storage. [2025-10-06T18:56:55.265252] [INFO ] [MAIN ] FINS: Loaded 8348 existing records. [2025-10-06T18:56:55.519103] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:56:55.519633] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-06T18:56:55.519768] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-06T18:56:55.520150] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-06T18:56:55.520332] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-06T18:56:55.843547] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-06T18:56:55.863050] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T18:56:55.949842] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:56:56.625548] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-06T18:56:56.681358] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T18:56:57.425544] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-06T18:56:57.498437] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T18:56:57.553250] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T18:56:58.225529] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-06T18:56:59.025556] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-06T18:56:59.157717] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-06T18:56:59.161325] [INFO ] [REMOTE ] FI: Full fetch complete (77208 records). [2025-10-06T18:56:59.161490] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-06T18:56:59.611435] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-06T18:56:59.612238] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-06T18:56:59.612483] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-06T18:56:59.617573] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-06T18:56:59.617682] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-06T18:56:59.619818] [DEBUG] [LOCAL ] FI: Trimmed 77208 records to 53525 (keeping 200 days of data) [2025-10-06T18:56:59.843335] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-06T18:56:59.913726] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T18:57:00.022379] [DEBUG] [LOCAL ] FI: Primary data saved (53525 records). [2025-10-06T18:57:00.022573] [INFO ] [MAIN ] FI: Full history saved. [2025-10-06T18:57:00.024005] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FI took 48.0s. Estimated remaining: 3h 35m 30s. Rate: 7.1 symbols/min [2025-10-06T18:57:00.211986] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:57:00.263551] [DEBUG] [LOCAL ] FINV: Loaded 45997 existing records from primary storage. [2025-10-06T18:57:00.263961] [INFO ] [MAIN ] FINV: Loaded 45997 existing records. [2025-10-06T18:57:00.458012] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:57:00.458277] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-06T18:57:00.458328] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-06T18:57:00.458628] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-06T18:57:00.458712] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-06T18:57:00.649195] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-06T18:57:00.773327] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T18:57:00.863110] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:57:01.425567] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-06T18:57:02.036045] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T18:57:02.225545] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-06T18:57:02.400019] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T18:57:02.703158] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-06T18:57:03.025589] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-06T18:57:03.825571] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-06T18:57:04.447009] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T18:57:04.625538] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-06T18:57:05.425526] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-06T18:57:05.488060] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T18:57:05.967956] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T18:57:06.225678] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-06T18:57:06.545561] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T18:57:07.025503] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-06T18:57:07.103037] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T18:57:07.825540] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-06T18:57:08.457709] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T18:57:08.625537] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-06T18:57:09.411391] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T18:57:09.425474] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-06T18:57:10.088126] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T18:57:10.225583] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-06T18:57:10.916857] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T18:57:10.920194] [INFO ] [REMOTE ] FIGS: Full fetch complete (71010 records). [2025-10-06T18:57:10.920324] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-06T18:57:11.026893] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-06T18:57:11.340638] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-06T18:57:11.340846] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-06T18:57:11.342094] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-06T18:57:11.342163] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-06T18:57:11.344194] [DEBUG] [LOCAL ] FIGS: Trimmed 71010 records to 48868 (keeping 200 days of data) [2025-10-06T18:57:11.653002] [DEBUG] [LOCAL ] FIGS: Primary data saved (48868 records). [2025-10-06T18:57:11.653270] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-06T18:57:11.653535] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FIGS took 33.1s. Estimated remaining: 3h 35m 27s. Rate: 7.1 symbols/min [2025-10-06T18:57:11.831256] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-06T18:57:11.868423] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:57:11.875293] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T18:57:11.938966] [DEBUG] [LOCAL ] FIS: Loaded 54138 existing records from primary storage. [2025-10-06T18:57:11.939433] [INFO ] [MAIN ] FIS: Loaded 54138 existing records. [2025-10-06T18:57:12.122566] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:57:12.122897] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-06T18:57:12.122949] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-06T18:57:12.123243] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-06T18:57:12.123301] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-06T18:57:12.501556] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:57:12.625505] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-06T18:57:12.668169] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T18:57:12.668745] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-06T18:57:13.425546] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-06T18:57:14.225553] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-06T18:57:14.366115] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-06T18:57:14.369703] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T18:57:15.025596] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-06T18:57:15.399150] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T18:57:15.825579] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-06T18:57:16.625555] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-06T18:57:16.794499] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T18:57:17.221628] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T18:57:17.233498] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T18:57:17.425548] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-06T18:57:18.225537] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-06T18:57:18.826011] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T18:57:19.025542] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-06T18:57:19.729449] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T18:57:19.825501] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-06T18:57:19.969237] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T18:57:20.625554] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-06T18:57:21.425544] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-06T18:57:21.490742] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T18:57:21.983029] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T18:57:21.984078] [INFO ] [REMOTE ] FINS: Full fetch complete (12054 records). [2025-10-06T18:57:21.984153] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-06T18:57:22.172859] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T18:57:22.230990] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-06T18:57:22.425801] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-06T18:57:22.425909] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-06T18:57:22.426529] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-06T18:57:22.426596] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-06T18:57:22.427150] [DEBUG] [LOCAL ] FINS: Trimmed 12054 records to 8268 (keeping 200 days of data) [2025-10-06T18:57:22.482346] [DEBUG] [LOCAL ] FINS: Primary data saved (8268 records). [2025-10-06T18:57:22.482553] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-06T18:57:22.482690] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINS took 27.5s. Estimated remaining: 3h 35m 23s. Rate: 7.1 symbols/min [2025-10-06T18:57:22.662030] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:57:22.699142] [DEBUG] [LOCAL ] FIX: Loaded 30134 existing records from primary storage. [2025-10-06T18:57:22.699713] [INFO ] [MAIN ] FIX: Loaded 30134 existing records. [2025-10-06T18:57:22.891686] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:57:22.891991] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-06T18:57:22.892041] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-06T18:57:22.892312] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-06T18:57:22.892374] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-06T18:57:23.030720] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-06T18:57:23.286100] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:57:23.819066] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T18:57:23.827696] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-06T18:57:24.631943] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-06T18:57:24.640111] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T18:57:25.049766] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T18:57:25.425547] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-06T18:57:26.225503] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-06T18:57:26.423278] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T18:57:26.879418] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T18:57:27.025600] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-06T18:57:27.689248] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T18:57:27.825560] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-06T18:57:28.625501] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-06T18:57:28.750830] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T18:57:29.234934] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T18:57:29.425555] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-06T18:57:30.225601] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-06T18:57:30.476294] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T18:57:30.729052] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T18:57:31.025541] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-06T18:57:31.328758] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T18:57:31.825535] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-06T18:57:32.559774] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T18:57:32.625525] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-06T18:57:33.425497] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-06T18:57:33.748264] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-06T18:57:34.055233] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T18:57:34.058435] [INFO ] [REMOTE ] FINV: Full fetch complete (63651 records). [2025-10-06T18:57:34.058567] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-06T18:57:34.228294] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-06T18:57:34.478920] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-06T18:57:34.479041] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-06T18:57:34.480167] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-06T18:57:34.480240] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-06T18:57:34.482050] [DEBUG] [LOCAL ] FINV: Trimmed 63651 records to 45189 (keeping 200 days of data) [2025-10-06T18:57:34.761086] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T18:57:34.765985] [INFO ] [REMOTE ] FIHL: Full fetch complete (55924 records). [2025-10-06T18:57:34.766370] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-06T18:57:34.901246] [DEBUG] [LOCAL ] FINV: Primary data saved (45189 records). [2025-10-06T18:57:34.911842] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-06T18:57:34.933616] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FINV took 34.9s. Estimated remaining: 3h 35m 22s. Rate: 7.1 symbols/min [2025-10-06T18:57:35.036028] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-06T18:57:35.196865] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-06T18:57:35.196981] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-06T18:57:35.197992] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-06T18:57:35.198058] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-06T18:57:35.200289] [DEBUG] [LOCAL ] FIHL: Trimmed 55924 records to 39695 (keeping 200 days of data) [2025-10-06T18:57:35.457538] [DEBUG] [LOCAL ] FIHL: Primary data saved (39695 records). [2025-10-06T18:57:35.457772] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-06T18:57:35.457886] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FIHL took 42.6s. Estimated remaining: 3h 34m 59s. Rate: 7.1 symbols/min [2025-10-06T18:57:36.052161] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T18:57:36.064288] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-06T18:57:36.652807] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T18:57:36.663562] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-06T18:57:37.939593] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-06T18:57:37.952233] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-06T18:57:38.262003] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T18:57:38.270951] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-06T18:57:39.662216] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T18:57:39.669401] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-06T18:57:39.829515] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T18:57:39.842712] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-06T18:57:40.855446] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T18:57:40.861764] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-06T18:57:41.604295] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T18:57:41.616843] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-06T18:57:42.259616] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-06T18:57:42.266849] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-06T18:57:43.187927] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-06T18:57:43.191326] [INFO ] [REMOTE ] FIS: Full fetch complete (77183 records). [2025-10-06T18:57:43.191463] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-06T18:57:43.627331] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-06T18:57:43.627509] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-06T18:57:43.628974] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-06T18:57:43.644242] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-06T18:57:43.649278] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T18:57:43.656995] [DEBUG] [LOCAL ] FIS: Trimmed 77183 records to 53356 (keeping 200 days of data) [2025-10-06T18:57:43.657531] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-06T18:57:44.026616] [DEBUG] [LOCAL ] FIS: Primary data saved (53356 records). [2025-10-06T18:57:44.026833] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-06T18:57:44.026933] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIS took 32.4s. Estimated remaining: 3h 34m 51s. Rate: 7.1 symbols/min [2025-10-06T18:57:44.961223] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-06T18:57:44.967927] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-06T18:57:46.140455] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T18:57:46.142420] [INFO ] [REMOTE ] FIX: Full fetch complete (45417 records). [2025-10-06T18:57:46.142506] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-06T18:57:46.530751] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-06T18:57:46.530865] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-06T18:57:46.531846] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-06T18:57:46.531912] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-06T18:57:46.533230] [DEBUG] [LOCAL ] FIX: Trimmed 45417 records to 29431 (keeping 200 days of data) [2025-10-06T18:57:46.739176] [DEBUG] [LOCAL ] FIX: Primary data saved (29431 records). [2025-10-06T18:57:46.739352] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-06T18:57:46.739447] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIX took 24.3s. Estimated remaining: 3h 34m 32s. Rate: 7.1 symbols/min [2025-10-06T18:57:47.462241] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:57:47.467982] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:57:47.546478] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:57:47.609672] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:57:47.610183] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-06T18:57:47.610320] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-06T18:57:47.610460] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-06T18:57:47.610535] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-06T18:57:47.612740] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-06T18:57:47.612855] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-06T18:57:47.652873] [DEBUG] [LOCAL ] FLC: Loaded 5459 existing records from primary storage. [2025-10-06T18:57:47.681138] [INFO ] [MAIN ] FLC: Loaded 5459 existing records. [2025-10-06T18:57:47.952621] [DEBUG] [LOCAL ] FLNG: Loaded 34143 existing records from primary storage. [2025-10-06T18:57:48.006628] [INFO ] [MAIN ] FLNG: Loaded 34143 existing records. [2025-10-06T18:57:48.239590] [DEBUG] [LOCAL ] FLG: Loaded 54100 existing records from primary storage. [2025-10-06T18:57:48.300039] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:57:48.331378] [INFO ] [MAIN ] FLG: Loaded 54100 existing records. [2025-10-06T18:57:48.365194] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-06T18:57:48.428765] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:57:48.449972] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-06T18:57:48.476163] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-06T18:57:48.567538] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-06T18:57:48.589862] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:57:48.609380] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-06T18:57:48.609669] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-06T18:57:48.631811] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-06T18:57:48.767217] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-06T18:57:48.816277] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:57:48.822185] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-06T18:57:48.815967] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:57:48.859074] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-06T18:57:48.859266] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-06T18:57:48.882523] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:57:48.905525] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-06T18:57:48.905627] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-06T18:57:48.959232] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-06T18:57:48.959380] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:57:49.007616] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-06T18:57:48.992180] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-06T18:57:49.112142] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-06T18:57:49.181088] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-06T18:57:49.267347] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-06T18:57:49.388835] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 2.6s. Estimated remaining: 3h 34m 14s. Rate: 7.1 symbols/min [2025-10-06T18:57:49.553016] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:57:49.654710] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-06T18:57:49.958257] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:57:50.019582] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-06T18:57:50.113819] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:57:50.179678] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:57:50.180231] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-06T18:57:50.241894] [DEBUG] [LOCAL ] FLO: Loaded 52669 existing records from primary storage. [2025-10-06T18:57:50.242335] [INFO ] [MAIN ] FLO: Loaded 52669 existing records. [2025-10-06T18:57:50.427620] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:57:50.427945] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-06T18:57:50.427993] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-06T18:57:50.429974] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-06T18:57:50.430036] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-06T18:57:50.564391] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-06T18:57:50.586836] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-06T18:57:50.827706] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:57:50.828430] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-06T18:57:51.273101] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-06T18:57:51.275299] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-06T18:57:51.526517] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T18:57:51.535063] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-06T18:57:51.645698] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-06T18:57:51.648127] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-06T18:57:51.990013] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T18:57:52.002362] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-06T18:57:52.262661] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T18:57:52.554104] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T18:57:52.626118] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-06T18:57:52.626042] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T18:57:53.425549] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-06T18:57:53.882266] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T18:57:54.225533] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-06T18:57:54.315002] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T18:57:54.931848] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T18:57:55.025528] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-06T18:57:55.825501] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-06T18:57:55.897126] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T18:57:56.587539] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T18:57:56.625576] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-06T18:57:56.673219] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T18:57:57.425549] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-06T18:57:57.987395] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T18:57:58.225534] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-06T18:57:58.518296] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T18:57:59.025551] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-06T18:57:59.591793] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-06T18:57:59.626521] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T18:57:59.825531] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-06T18:58:00.625554] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-06T18:58:01.425517] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-06T18:58:01.519691] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T18:58:02.021252] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T18:58:02.225515] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-06T18:58:02.377354] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T18:58:02.985532] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-06T18:58:03.025570] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-06T18:58:03.825583] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-06T18:58:04.625523] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-06T18:58:04.793569] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T18:58:05.425521] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-06T18:58:05.673049] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T18:58:05.729918] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T18:58:06.040133] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-06T18:58:06.225538] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-06T18:58:07.025573] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-06T18:58:07.825538] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-06T18:58:08.185343] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-06T18:58:08.369936] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T18:58:08.370866] [INFO ] [REMOTE ] FLC: Full fetch complete (7905 records). [2025-10-06T18:58:08.370943] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-06T18:58:08.634121] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-06T18:58:08.777205] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-06T18:58:08.777448] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-06T18:58:08.777889] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-06T18:58:08.777977] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-06T18:58:08.778634] [DEBUG] [LOCAL ] FLC: Trimmed 7905 records to 5358 (keeping 200 days of data) [2025-10-06T18:58:08.814989] [DEBUG] [LOCAL ] FLC: Primary data saved (5358 records). [2025-10-06T18:58:08.815266] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-06T18:58:08.815466] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 22.1s. Estimated remaining: 3h 34m 25s. Rate: 7.1 symbols/min [2025-10-06T18:58:08.993625] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:58:08.994140] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-06T18:58:08.994199] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-06T18:58:08.994341] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-06T18:58:09.006199] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-06T18:58:09.022268] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-06T18:58:09.025434] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-06T18:58:09.109106] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-06T18:58:09.432607] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-06T18:58:09.432540] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:58:10.131367] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T18:58:10.225524] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-06T18:58:10.809550] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-06T18:58:11.025548] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-06T18:58:11.236591] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T18:58:11.237209] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-06T18:58:11.237363] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T18:58:11.237551] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-06T18:58:11.237667] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T18:58:11.237765] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-06T18:58:11.237947] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-06T18:58:11.238009] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-06T18:58:11.238055] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-06T18:58:11.238107] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLOC took 2.4s. Estimated remaining: 3h 34m 6s. Rate: 7.1 symbols/min [2025-10-06T18:58:11.424375] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:58:11.492284] [DEBUG] [LOCAL ] FLR: Loaded 53897 existing records from primary storage. [2025-10-06T18:58:11.492743] [INFO ] [MAIN ] FLR: Loaded 53897 existing records. [2025-10-06T18:58:11.680240] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:58:11.688000] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-06T18:58:11.695840] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-06T18:58:11.704802] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T18:58:11.704925] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-06T18:58:11.711725] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-06T18:58:11.830753] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-06T18:58:12.075461] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:58:12.625533] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-06T18:58:13.425577] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-06T18:58:13.646603] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T18:58:14.225496] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-06T18:58:14.338229] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T18:58:15.025531] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-06T18:58:15.107094] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T18:58:15.645156] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T18:58:15.825488] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-06T18:58:16.385913] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T18:58:16.625555] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-06T18:58:17.425512] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-06T18:58:17.551805] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T18:58:18.225513] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-06T18:58:18.322902] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T18:58:18.919818] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T18:58:18.922914] [INFO ] [REMOTE ] FLG: Full fetch complete (77305 records). [2025-10-06T18:58:18.923039] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-06T18:58:19.025982] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-06T18:58:19.317286] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-06T18:58:19.317391] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-06T18:58:19.318500] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-06T18:58:19.318567] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-06T18:58:19.320271] [DEBUG] [LOCAL ] FLG: Trimmed 77305 records to 53331 (keeping 200 days of data) [2025-10-06T18:58:19.670552] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T18:58:19.690291] [DEBUG] [LOCAL ] FLG: Primary data saved (53331 records). [2025-10-06T18:58:19.690485] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-06T18:58:19.690583] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLG took 32.9s. Estimated remaining: 3h 33m 58s. Rate: 7.1 symbols/min [2025-10-06T18:58:19.837275] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-06T18:58:19.871175] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:58:19.922111] [DEBUG] [LOCAL ] FLS: Loaded 50938 existing records from primary storage. [2025-10-06T18:58:19.922502] [INFO ] [MAIN ] FLS: Loaded 50938 existing records. [2025-10-06T18:58:20.096877] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:58:20.097138] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-06T18:58:20.097187] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-06T18:58:20.098701] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-06T18:58:20.098764] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-06T18:58:20.459972] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:58:20.625551] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-06T18:58:20.673075] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T18:58:21.425523] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-06T18:58:21.988852] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-06T18:58:22.131986] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T18:58:22.225478] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-06T18:58:22.918393] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T18:58:23.025487] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-06T18:58:23.805033] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T18:58:23.825487] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-06T18:58:24.163138] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-06T18:58:24.625557] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-06T18:58:25.273381] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T18:58:25.425499] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-06T18:58:26.225626] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-06T18:58:26.322021] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T18:58:27.030627] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-06T18:58:27.045940] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T18:58:27.408616] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T18:58:27.410721] [INFO ] [REMOTE ] FLNG: Full fetch complete (50449 records). [2025-10-06T18:58:27.410814] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-06T18:58:27.809214] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-06T18:58:27.809319] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-06T18:58:27.810240] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-06T18:58:27.810334] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-06T18:58:27.811803] [DEBUG] [LOCAL ] FLNG: Trimmed 50449 records to 33633 (keeping 200 days of data) [2025-10-06T18:58:27.867589] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-06T18:58:28.031279] [DEBUG] [LOCAL ] FLNG: Primary data saved (33633 records). [2025-10-06T18:58:28.031469] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-06T18:58:28.031566] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLNG took 41.3s. Estimated remaining: 3h 33m 49s. Rate: 7.1 symbols/min [2025-10-06T18:58:28.211843] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:58:28.265815] [DEBUG] [LOCAL ] FLUT: Loaded 51557 existing records from primary storage. [2025-10-06T18:58:28.266288] [INFO ] [MAIN ] FLUT: Loaded 51557 existing records. [2025-10-06T18:58:28.451314] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:58:28.451544] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-06T18:58:28.451595] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-06T18:58:28.453125] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-06T18:58:28.453188] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-06T18:58:28.630198] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-06T18:58:28.778010] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-06T18:58:28.824898] [INFO ] [REMOTE ] FLO: Full fetch complete (75022 records). [2025-10-06T18:58:28.846721] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:58:28.846812] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-06T18:58:29.293764] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-06T18:58:29.293899] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-06T18:58:29.296070] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-06T18:58:29.296399] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-06T18:58:29.298898] [DEBUG] [LOCAL ] FLO: Trimmed 75022 records to 51944 (keeping 200 days of data) [2025-10-06T18:58:29.433408] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-06T18:58:29.668220] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T18:58:29.841507] [DEBUG] [LOCAL ] FLO: Primary data saved (51944 records). [2025-10-06T18:58:29.841832] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-06T18:58:29.842008] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLO took 40.4s. Estimated remaining: 3h 33m 29s. Rate: 7.1 symbols/min [2025-10-06T18:58:30.146715] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:58:30.179519] [DEBUG] [LOCAL ] FLXR: Loaded 20820 existing records from primary storage. [2025-10-06T18:58:30.179981] [INFO ] [MAIN ] FLXR: Loaded 20820 existing records. [2025-10-06T18:58:30.231633] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-06T18:58:30.402558] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:58:30.403012] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-06T18:58:30.403130] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-06T18:58:30.404339] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-06T18:58:30.404443] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-06T18:58:30.679322] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-06T18:58:30.869250] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:58:30.944025] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T18:58:31.025519] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-06T18:58:31.825563] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-06T18:58:31.864774] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T18:58:32.629391] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-06T18:58:32.636088] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T18:58:33.425595] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-06T18:58:33.576027] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T18:58:34.140252] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-06T18:58:34.225527] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-06T18:58:34.366433] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T18:58:35.025501] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-06T18:58:35.042742] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T18:58:35.825563] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-06T18:58:36.625674] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-06T18:58:36.707941] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T18:58:37.410045] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T18:58:37.425464] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-06T18:58:38.225552] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-06T18:58:38.356826] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T18:58:39.025496] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-06T18:58:39.036591] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-06T18:58:39.396560] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-06T18:58:39.825543] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-06T18:58:40.625550] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-06T18:58:40.952932] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-06T18:58:41.175819] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T18:58:41.425535] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-06T18:58:41.603893] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T18:58:42.225604] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-06T18:58:43.025515] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-06T18:58:43.431485] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-06T18:58:43.825505] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-06T18:58:43.916621] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T18:58:44.011964] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T18:58:44.625548] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-06T18:58:45.425617] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-06T18:58:45.551425] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T18:58:45.622369] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T18:58:46.225536] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-06T18:58:47.030721] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-06T18:58:47.045475] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T18:58:47.634975] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T18:58:47.825573] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-06T18:58:48.625506] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-06T18:58:48.697386] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-06T18:58:48.701115] [INFO ] [REMOTE ] FLR: Full fetch complete (76480 records). [2025-10-06T18:58:48.701256] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-06T18:58:49.203290] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-06T18:58:49.203413] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-06T18:58:49.204551] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-06T18:58:49.204662] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-06T18:58:49.206536] [DEBUG] [LOCAL ] FLR: Trimmed 76480 records to 53157 (keeping 200 days of data) [2025-10-06T18:58:49.432082] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-06T18:58:49.434869] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-06T18:58:49.439899] [INFO ] [REMOTE ] FLS: Full fetch complete (71716 records). [2025-10-06T18:58:49.441105] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-06T18:58:49.915929] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-06T18:58:49.916336] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-06T18:58:49.917710] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-06T18:58:49.918094] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-06T18:58:49.922387] [DEBUG] [LOCAL ] FLS: Trimmed 71716 records to 50202 (keeping 200 days of data) [2025-10-06T18:58:50.139633] [DEBUG] [LOCAL ] FLR: Primary data saved (53157 records). [2025-10-06T18:58:50.140352] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-06T18:58:50.142363] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLR took 38.9s. Estimated remaining: 3h 33m 42s. Rate: 7.1 symbols/min [2025-10-06T18:58:50.329278] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:58:50.496283] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-06T18:58:50.525718] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T18:58:50.528072] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-06T18:58:50.559632] [DEBUG] [LOCAL ] FMC: Loaded 52558 existing records from primary storage. [2025-10-06T18:58:50.562107] [INFO ] [MAIN ] FMC: Loaded 52558 existing records. [2025-10-06T18:58:50.805805] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:58:50.806293] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-06T18:58:50.806369] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-06T18:58:50.810755] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-06T18:58:50.812683] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-06T18:58:51.030868] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-06T18:58:51.100125] [DEBUG] [LOCAL ] FLS: Primary data saved (50202 records). [2025-10-06T18:58:51.120729] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-06T18:58:51.123585] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLS took 31.4s. Estimated remaining: 3h 33m 20s. Rate: 7.1 symbols/min [2025-10-06T18:58:51.309433] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:58:51.377200] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:58:51.384913] [DEBUG] [LOCAL ] FMN: Loaded 5644 existing records from primary storage. [2025-10-06T18:58:51.385137] [INFO ] [MAIN ] FMN: Loaded 5644 existing records. [2025-10-06T18:58:51.604737] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:58:51.605076] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-06T18:58:51.605142] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-06T18:58:51.605546] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-06T18:58:51.605621] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-06T18:58:51.832271] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-06T18:58:51.974234] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:58:52.096895] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-06T18:58:52.317755] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T18:58:52.625552] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-06T18:58:53.425520] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-06T18:58:53.577279] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T18:58:53.687602] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T18:58:53.855176] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-06T18:58:54.225581] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-06T18:58:54.830163] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T18:58:55.025626] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-06T18:58:55.825551] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-06T18:58:56.546795] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-06T18:58:56.625520] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-06T18:58:56.794006] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T18:58:57.425767] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-06T18:58:57.425693] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-06T18:58:58.225500] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-06T18:58:58.587876] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-06T18:58:59.025545] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-06T18:58:59.825526] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-06T18:58:59.841115] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T18:58:59.987034] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T18:59:00.625543] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-06T18:59:01.425566] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-06T18:59:01.467053] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T18:59:02.225523] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-06T18:59:02.333275] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T18:59:02.336627] [INFO ] [REMOTE ] FLUT: Full fetch complete (72957 records). [2025-10-06T18:59:02.336847] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-06T18:59:02.656069] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T18:59:02.674939] [INFO ] [REMOTE ] FLXR: Full fetch complete (25957 records). [2025-10-06T18:59:02.685421] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-06T18:59:02.810995] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-06T18:59:02.826361] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T18:59:02.862029] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-06T18:59:02.865687] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-06T18:59:02.887580] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-06T18:59:02.943866] [DEBUG] [LOCAL ] FLUT: Trimmed 72957 records to 50782 (keeping 200 days of data) [2025-10-06T18:59:03.091283] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-06T18:59:03.344890] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-06T18:59:03.345350] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-06T18:59:03.347003] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-06T18:59:03.347395] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-06T18:59:03.350387] [DEBUG] [LOCAL ] FLXR: Trimmed 25957 records to 20614 (keeping 200 days of data) [2025-10-06T18:59:03.624206] [DEBUG] [LOCAL ] FLXR: Primary data saved (20614 records). [2025-10-06T18:59:03.625702] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-06T18:59:03.626708] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLXR took 33.8s. Estimated remaining: 3h 33m 19s. Rate: 7.1 symbols/min [2025-10-06T18:59:03.823256] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:59:03.829103] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-06T18:59:03.836457] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T18:59:03.883171] [DEBUG] [LOCAL ] FMS: Loaded 30400 existing records from primary storage. [2025-10-06T18:59:03.885055] [INFO ] [MAIN ] FMS: Loaded 30400 existing records. [2025-10-06T18:59:04.146050] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:59:04.147533] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-06T18:59:04.147958] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-06T18:59:04.151750] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-06T18:59:04.153228] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-06T18:59:04.437949] [DEBUG] [LOCAL ] FLUT: Primary data saved (50782 records). [2025-10-06T18:59:04.449585] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-06T18:59:04.449776] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLUT took 36.4s. Estimated remaining: 3h 32m 57s. Rate: 7.1 symbols/min [2025-10-06T18:59:04.641738] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-06T18:59:04.725860] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:59:04.750947] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:59:04.798532] [DEBUG] [LOCAL ] FMX: Loaded 41194 existing records from primary storage. [2025-10-06T18:59:04.798944] [INFO ] [MAIN ] FMX: Loaded 41194 existing records. [2025-10-06T18:59:05.012848] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:59:05.013169] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-06T18:59:05.013257] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-06T18:59:05.014974] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-06T18:59:05.015056] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-06T18:59:05.428303] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-06T18:59:05.436608] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-06T18:59:05.478351] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:59:05.737686] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T18:59:06.225545] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-06T18:59:06.693698] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T18:59:06.813234] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T18:59:07.025579] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-06T18:59:07.646257] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-06T18:59:07.825531] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-06T18:59:08.326732] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-06T18:59:08.327783] [INFO ] [REMOTE ] FMN: Full fetch complete (9930 records). [2025-10-06T18:59:08.327858] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-06T18:59:08.630684] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-06T18:59:08.725357] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-06T18:59:08.725521] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-06T18:59:08.726021] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-06T18:59:08.726087] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-06T18:59:08.726590] [DEBUG] [LOCAL ] FMN: Trimmed 9930 records to 5340 (keeping 200 days of data) [2025-10-06T18:59:08.763692] [DEBUG] [LOCAL ] FMN: Primary data saved (5340 records). [2025-10-06T18:59:08.763898] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-06T18:59:08.764005] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMN took 17.6s. Estimated remaining: 3h 32m 41s. Rate: 7.1 symbols/min [2025-10-06T18:59:08.943241] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:59:08.946700] [DEBUG] [LOCAL ] FMY: Loaded 1401 existing records from primary storage. [2025-10-06T18:59:08.946900] [INFO ] [MAIN ] FMY: Loaded 1401 existing records. [2025-10-06T18:59:09.127703] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:59:09.128014] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-06T18:59:09.128063] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-06T18:59:09.128282] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-06T18:59:09.128342] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-06T18:59:09.430830] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-06T18:59:09.489848] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:59:10.225555] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-06T18:59:10.587592] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-06T18:59:10.668552] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T18:59:11.025506] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-06T18:59:11.624566] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T18:59:11.825497] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-06T18:59:12.163052] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-06T18:59:12.177987] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T18:59:12.625559] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-06T18:59:13.425513] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-06T18:59:14.225582] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-06T18:59:14.376485] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T18:59:14.886933] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T18:59:15.025553] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-06T18:59:15.639760] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T18:59:15.825555] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-06T18:59:16.136547] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T18:59:16.625549] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-06T18:59:17.231531] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T18:59:17.425607] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-06T18:59:17.794011] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-06T18:59:18.225519] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-06T18:59:18.477954] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-06T18:59:18.663160] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T18:59:19.025572] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-06T18:59:19.825553] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-06T18:59:20.625722] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-06T18:59:20.703683] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T18:59:20.906870] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T18:59:21.425565] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-06T18:59:22.126766] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T18:59:22.225545] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-06T18:59:22.573186] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-06T18:59:22.999469] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T18:59:23.025492] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-06T18:59:23.825532] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-06T18:59:24.251286] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-06T18:59:24.488999] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-06T18:59:24.625564] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-06T18:59:25.425552] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-06T18:59:25.821989] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-06T18:59:25.926978] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-06T18:59:26.225516] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-06T18:59:27.025553] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-06T18:59:27.662062] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T18:59:27.825516] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-06T18:59:28.175795] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-06T18:59:28.252040] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T18:59:28.625524] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-06T18:59:29.425583] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-06T18:59:29.929971] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T18:59:30.225551] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-06T18:59:30.664702] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-06T18:59:31.025516] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-06T18:59:31.151663] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T18:59:31.825571] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-06T18:59:32.487690] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T18:59:32.625540] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-06T18:59:33.120430] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T18:59:33.425519] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-06T18:59:34.142419] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T18:59:34.225577] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-06T18:59:34.803117] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T18:59:35.025545] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-06T18:59:35.536760] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-06T18:59:35.825535] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-06T18:59:36.070524] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T18:59:36.625543] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-06T18:59:36.978025] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-06T18:59:36.980037] [INFO ] [REMOTE ] FMS: Full fetch complete (42490 records). [2025-10-06T18:59:36.980339] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-06T18:59:37.094630] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-06T18:59:37.379278] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-06T18:59:37.379386] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-06T18:59:37.380385] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-06T18:59:37.380453] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-06T18:59:37.381685] [DEBUG] [LOCAL ] FMS: Trimmed 42490 records to 30006 (keeping 200 days of data) [2025-10-06T18:59:37.433163] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-06T18:59:37.574670] [DEBUG] [LOCAL ] FMS: Primary data saved (30006 records). [2025-10-06T18:59:37.574876] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-06T18:59:37.574983] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMS took 33.9s. Estimated remaining: 3h 33m 9s. Rate: 7.1 symbols/min [2025-10-06T18:59:37.753092] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:59:37.796582] [DEBUG] [LOCAL ] FN: Loaded 39003 existing records from primary storage. [2025-10-06T18:59:37.796970] [INFO ] [MAIN ] FN: Loaded 39003 existing records. [2025-10-06T18:59:37.978906] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:59:37.979244] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-06T18:59:37.979299] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-06T18:59:37.979725] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-06T18:59:37.979787] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-06T18:59:38.230810] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-06T18:59:38.376201] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:59:39.025614] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-06T18:59:39.117220] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T18:59:39.825545] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-06T18:59:39.828473] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-06T18:59:39.832125] [INFO ] [REMOTE ] FMC: Full fetch complete (75121 records). [2025-10-06T18:59:39.832213] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-06T18:59:40.231111] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-06T18:59:40.231291] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-06T18:59:40.232543] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-06T18:59:40.239423] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-06T18:59:40.252411] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T18:59:40.259216] [DEBUG] [LOCAL ] FMC: Trimmed 75121 records to 51802 (keeping 200 days of data) [2025-10-06T18:59:40.592947] [DEBUG] [LOCAL ] FMC: Primary data saved (51802 records). [2025-10-06T18:59:40.593108] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-06T18:59:40.593196] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMC took 50.5s. Estimated remaining: 3h 32m 51s. Rate: 7.1 symbols/min [2025-10-06T18:59:40.635848] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-06T18:59:40.762198] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:59:40.822829] [DEBUG] [LOCAL ] FNB: Loaded 53238 existing records from primary storage. [2025-10-06T18:59:40.823175] [INFO ] [MAIN ] FNB: Loaded 53238 existing records. [2025-10-06T18:59:41.002539] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:59:41.002808] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-06T18:59:41.002866] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-06T18:59:41.004219] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-06T18:59:41.004281] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-06T18:59:41.288489] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T18:59:41.312056] [INFO ] [REMOTE ] FMX: Full fetch complete (57783 records). [2025-10-06T18:59:41.329981] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-06T18:59:41.429816] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-06T18:59:41.438314] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:59:41.748334] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-06T18:59:41.748416] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-06T18:59:41.749192] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-06T18:59:41.749255] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-06T18:59:41.750693] [DEBUG] [LOCAL ] FMX: Trimmed 57783 records to 40749 (keeping 200 days of data) [2025-10-06T18:59:41.887413] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T18:59:41.888301] [INFO ] [REMOTE ] FMY: Full fetch complete (1963 records). [2025-10-06T18:59:41.888375] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-06T18:59:42.230961] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-06T18:59:42.283558] [DEBUG] [LOCAL ] FMX: Primary data saved (40749 records). [2025-10-06T18:59:42.294580] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-06T18:59:42.313254] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMX took 37.9s. Estimated remaining: 3h 32m 31s. Rate: 7.1 symbols/min [2025-10-06T18:59:42.505414] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-06T18:59:42.514103] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T18:59:42.524380] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-06T18:59:42.525131] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-06T18:59:42.525233] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-06T18:59:42.531253] [DEBUG] [LOCAL ] FMY: Trimmed 1963 records to 1383 (keeping 200 days of data) [2025-10-06T18:59:42.607600] [DEBUG] [LOCAL ] FMY: Primary data saved (1383 records). [2025-10-06T18:59:42.608562] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:59:42.608732] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-06T18:59:42.609128] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMY took 33.8s. Estimated remaining: 3h 32m 8s. Rate: 7.1 symbols/min [2025-10-06T18:59:42.781630] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T18:59:42.818558] [DEBUG] [LOCAL ] FND: Loaded 52854 existing records from primary storage. [2025-10-06T18:59:42.819044] [INFO ] [MAIN ] FND: Loaded 52854 existing records. [2025-10-06T18:59:43.012491] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:59:43.028033] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-06T18:59:43.026999] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-06T18:59:43.028189] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-06T18:59:43.030001] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-06T18:59:43.030132] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-06T18:59:43.029912] [DEBUG] [LOCAL ] FNF: Loaded 49705 existing records from primary storage. [2025-10-06T18:59:43.103580] [INFO ] [MAIN ] FNF: Loaded 49705 existing records. [2025-10-06T18:59:43.519689] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T18:59:43.523433] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-06T18:59:43.523524] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-06T18:59:43.530310] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-06T18:59:43.535547] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-06T18:59:43.683700] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:59:43.832595] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-06T18:59:44.012551] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T18:59:44.043927] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T18:59:44.625598] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-06T18:59:44.716910] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T18:59:45.211401] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T18:59:45.425553] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-06T18:59:46.198497] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T18:59:46.225564] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-06T18:59:46.987449] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T18:59:47.025571] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-06T18:59:47.308442] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T18:59:47.825563] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-06T18:59:48.625580] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T18:59:48.625771] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-06T18:59:49.425510] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-06T18:59:49.536761] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T18:59:50.225537] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-06T18:59:50.322596] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T18:59:51.025565] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-06T18:59:51.245835] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T18:59:51.717223] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T18:59:51.825575] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-06T18:59:52.616991] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T18:59:52.626326] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-06T18:59:53.425495] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-06T18:59:53.616995] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-06T18:59:54.225541] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-06T18:59:54.321877] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T18:59:54.857697] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-06T18:59:55.025577] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-06T18:59:55.825560] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-06T18:59:56.086186] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T18:59:56.625623] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-06T18:59:56.755586] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T18:59:57.351119] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T18:59:57.425557] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-06T18:59:58.059917] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T18:59:58.225565] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-06T18:59:58.783505] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T18:59:59.025557] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-06T18:59:59.825538] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-06T18:59:59.920728] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T19:00:00.625594] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-06T19:00:00.856172] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T19:00:01.425623] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-06T19:00:01.693692] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-06T19:00:02.190141] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T19:00:02.225823] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-06T19:00:03.006673] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T19:00:03.025551] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-06T19:00:03.825598] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-06T19:00:03.994339] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-06T19:00:04.625572] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-06T19:00:05.002181] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T19:00:05.425542] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-06T19:00:05.919109] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-06T19:00:06.225529] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-06T19:00:06.798293] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-06T19:00:07.025531] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-06T19:00:07.482443] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-06T19:00:07.825543] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-06T19:00:08.625521] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-06T19:00:08.813703] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T19:00:08.937190] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-06T19:00:09.167812] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T19:00:09.171731] [INFO ] [REMOTE ] FN: Full fetch complete (56253 records). [2025-10-06T19:00:09.171995] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-06T19:00:09.437635] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-06T19:00:09.610376] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-06T19:00:09.610489] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-06T19:00:09.611658] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-06T19:00:09.611752] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-06T19:00:09.613280] [DEBUG] [LOCAL ] FN: Trimmed 56253 records to 38314 (keeping 200 days of data) [2025-10-06T19:00:09.865059] [DEBUG] [LOCAL ] FN: Primary data saved (38314 records). [2025-10-06T19:00:09.865318] [INFO ] [MAIN ] FN: Full history saved. [2025-10-06T19:00:09.866115] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FN took 32.3s. Estimated remaining: 3h 32m 33s. Rate: 7.1 symbols/min [2025-10-06T19:00:10.097868] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:00:10.160615] [DEBUG] [LOCAL ] FNV: Loaded 46785 existing records from primary storage. [2025-10-06T19:00:10.161130] [INFO ] [MAIN ] FNV: Loaded 46785 existing records. [2025-10-06T19:00:10.230800] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-06T19:00:10.391730] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:00:10.392375] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-06T19:00:10.392451] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-06T19:00:10.403638] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-06T19:00:10.408906] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-06T19:00:10.522806] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-06T19:00:10.900544] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:00:11.025490] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-06T19:00:11.074249] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T19:00:11.825496] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-06T19:00:11.897598] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T19:00:12.625492] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-06T19:00:12.718875] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T19:00:13.349497] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-06T19:00:13.353169] [INFO ] [REMOTE ] FNF: Full fetch complete (69687 records). [2025-10-06T19:00:13.353301] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-06T19:00:13.434426] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-06T19:00:13.784159] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-06T19:00:13.784276] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-06T19:00:13.785377] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-06T19:00:13.785446] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-06T19:00:13.787277] [DEBUG] [LOCAL ] FNF: Trimmed 69687 records to 48975 (keeping 200 days of data) [2025-10-06T19:00:14.108594] [DEBUG] [LOCAL ] FNF: Primary data saved (48975 records). [2025-10-06T19:00:14.108811] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-06T19:00:14.108982] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FNF took 31.5s. Estimated remaining: 3h 32m 17s. Rate: 7.1 symbols/min [2025-10-06T19:00:14.226746] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-06T19:00:14.303593] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-06T19:00:14.324859] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:00:14.331459] [INFO ] [REMOTE ] FNB: Full fetch complete (75875 records). [2025-10-06T19:00:14.331799] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-06T19:00:14.459261] [DEBUG] [LOCAL ] FOA: Loaded 13268 existing records from primary storage. [2025-10-06T19:00:14.475575] [INFO ] [MAIN ] FOA: Loaded 13268 existing records. [2025-10-06T19:00:14.914405] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:00:14.941026] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-06T19:00:14.975569] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-06T19:00:14.978743] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-06T19:00:15.025334] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-06T19:00:15.025093] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-06T19:00:15.030589] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-06T19:00:15.051218] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-06T19:00:15.080364] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-06T19:00:15.168597] [DEBUG] [LOCAL ] FNB: Trimmed 75875 records to 52507 (keeping 200 days of data) [2025-10-06T19:00:15.606972] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:00:15.608137] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-06T19:00:15.653192] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-06T19:00:15.833356] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-06T19:00:15.888901] [DEBUG] [LOCAL ] FNB: Primary data saved (52507 records). [2025-10-06T19:00:15.889110] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-06T19:00:15.889265] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNB took 35.3s. Estimated remaining: 3h 31m 57s. Rate: 7.1 symbols/min [2025-10-06T19:00:16.074767] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:00:16.087080] [DEBUG] [LOCAL ] FOF: Loaded 8526 existing records from primary storage. [2025-10-06T19:00:16.087367] [INFO ] [MAIN ] FOF: Loaded 8526 existing records. [2025-10-06T19:00:16.289526] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:00:16.289987] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-06T19:00:16.290217] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-06T19:00:16.290812] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-06T19:00:16.304627] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-06T19:00:16.426714] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-06T19:00:16.630396] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-06T19:00:16.788858] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:00:16.803709] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-06T19:00:17.421926] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T19:00:17.430563] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-06T19:00:18.225501] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-06T19:00:18.453927] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T19:00:19.025563] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-06T19:00:19.538796] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-06T19:00:19.825554] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-06T19:00:20.066101] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-06T19:00:20.110408] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T19:00:20.549134] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-06T19:00:20.625551] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-06T19:00:21.327340] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-06T19:00:21.425550] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-06T19:00:22.152026] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T19:00:22.225545] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-06T19:00:23.025524] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-06T19:00:23.247049] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T19:00:23.825561] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-06T19:00:24.625540] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-06T19:00:24.780582] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T19:00:24.861605] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T19:00:25.425609] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-06T19:00:26.176903] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T19:00:26.230622] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-06T19:00:26.248403] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T19:00:27.025568] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-06T19:00:27.267059] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T19:00:27.825574] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-06T19:00:28.610996] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T19:00:28.625462] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-06T19:00:28.727219] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T19:00:29.425541] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-06T19:00:30.009452] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T19:00:30.046124] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T19:00:30.225551] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-06T19:00:31.025603] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-06T19:00:31.760351] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T19:00:31.825578] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-06T19:00:32.018378] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T19:00:32.625592] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-06T19:00:33.425520] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-06T19:00:33.488468] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T19:00:33.493145] [INFO ] [REMOTE ] FND: Full fetch complete (74640 records). [2025-10-06T19:00:33.493355] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-06T19:00:33.936135] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-06T19:00:33.936519] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-06T19:00:33.938164] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-06T19:00:33.938254] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-06T19:00:33.940269] [DEBUG] [LOCAL ] FND: Trimmed 74640 records to 52088 (keeping 200 days of data) [2025-10-06T19:00:34.057280] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-06T19:00:34.224487] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T19:00:34.234381] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-06T19:00:34.362891] [DEBUG] [LOCAL ] FND: Primary data saved (52088 records). [2025-10-06T19:00:34.363177] [INFO ] [MAIN ] FND: Full history saved. [2025-10-06T19:00:34.363294] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FND took 52.0s. Estimated remaining: 3h 32m 7s. Rate: 7.1 symbols/min [2025-10-06T19:00:34.545356] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:00:34.567991] [DEBUG] [LOCAL ] FOR: Loaded 20020 existing records from primary storage. [2025-10-06T19:00:34.568369] [INFO ] [MAIN ] FOR: Loaded 20020 existing records. [2025-10-06T19:00:34.773332] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:00:34.773624] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-06T19:00:34.773710] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-06T19:00:34.774441] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-06T19:00:34.774505] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-06T19:00:35.030633] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-06T19:00:35.158964] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T19:00:35.186102] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:00:35.612568] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-06T19:00:35.825543] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-06T19:00:36.625557] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-06T19:00:37.354981] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T19:00:37.356280] [INFO ] [REMOTE ] FOF: Full fetch complete (11907 records). [2025-10-06T19:00:37.356384] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-06T19:00:37.430613] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-06T19:00:37.767310] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T19:00:37.813462] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-06T19:00:37.813674] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-06T19:00:37.814337] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-06T19:00:37.815048] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-06T19:00:37.815708] [DEBUG] [LOCAL ] FOF: Trimmed 11907 records to 8463 (keeping 200 days of data) [2025-10-06T19:00:37.868399] [DEBUG] [LOCAL ] FOF: Primary data saved (8463 records). [2025-10-06T19:00:37.868574] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-06T19:00:37.868695] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FOF took 22.0s. Estimated remaining: 3h 31m 50s. Rate: 7.1 symbols/min [2025-10-06T19:00:38.048394] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:00:38.103304] [DEBUG] [LOCAL ] FOUR: Loaded 50298 existing records from primary storage. [2025-10-06T19:00:38.103725] [INFO ] [MAIN ] FOUR: Loaded 50298 existing records. [2025-10-06T19:00:38.230603] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-06T19:00:38.308397] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:00:38.308887] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-06T19:00:38.308939] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-06T19:00:38.310519] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-06T19:00:38.310581] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-06T19:00:38.485699] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-06T19:00:38.709267] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:00:39.025582] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-06T19:00:39.042143] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-06T19:00:39.825549] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-06T19:00:40.208128] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T19:00:40.625543] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-06T19:00:41.258811] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T19:00:41.262781] [INFO ] [REMOTE ] FNV: Full fetch complete (66406 records). [2025-10-06T19:00:41.262948] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-06T19:00:41.431313] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-06T19:00:41.674223] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-06T19:00:41.674358] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-06T19:00:41.675405] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-06T19:00:41.675557] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-06T19:00:41.690010] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T19:00:41.694754] [DEBUG] [LOCAL ] FNV: Trimmed 66406 records to 46139 (keeping 200 days of data) [2025-10-06T19:00:42.017169] [DEBUG] [LOCAL ] FNV: Primary data saved (46139 records). [2025-10-06T19:00:42.017855] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-06T19:00:42.018602] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FNV took 32.2s. Estimated remaining: 3h 31m 34s. Rate: 7.1 symbols/min [2025-10-06T19:00:42.201714] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:00:42.225117] [DEBUG] [LOCAL ] FPF: Loaded 18584 existing records from primary storage. [2025-10-06T19:00:42.225466] [INFO ] [MAIN ] FPF: Loaded 18584 existing records. [2025-10-06T19:00:42.225575] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-06T19:00:42.373973] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-06T19:00:42.431196] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:00:42.431464] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-06T19:00:42.431514] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-06T19:00:42.432381] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-06T19:00:42.432443] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-06T19:00:42.787938] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:00:43.025565] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-06T19:00:43.405520] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T19:00:43.825551] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-06T19:00:43.966736] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-06T19:00:44.625531] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-06T19:00:44.941744] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T19:00:45.425502] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-06T19:00:45.801010] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-06T19:00:46.225617] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-06T19:00:46.880518] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T19:00:47.025597] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-06T19:00:47.825553] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-06T19:00:48.060783] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T19:00:48.118264] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T19:00:48.446256] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-06T19:00:48.447497] [INFO ] [REMOTE ] FOA: Full fetch complete (22244 records). [2025-10-06T19:00:48.447595] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-06T19:00:48.632634] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-06T19:00:48.829553] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-06T19:00:48.829696] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-06T19:00:48.830373] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-06T19:00:48.830419] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-06T19:00:48.831343] [DEBUG] [LOCAL ] FOA: Trimmed 22244 records to 13043 (keeping 200 days of data) [2025-10-06T19:00:48.909393] [DEBUG] [LOCAL ] FOA: Primary data saved (13043 records). [2025-10-06T19:00:48.909589] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-06T19:00:48.909765] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOA took 34.8s. Estimated remaining: 3h 31m 23s. Rate: 7.1 symbols/min [2025-10-06T19:00:49.079746] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:00:49.102992] [DEBUG] [LOCAL ] FPH: Loaded 19674 existing records from primary storage. [2025-10-06T19:00:49.103289] [INFO ] [MAIN ] FPH: Loaded 19674 existing records. [2025-10-06T19:00:49.284177] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:00:49.284485] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-06T19:00:49.284533] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-06T19:00:49.285139] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-06T19:00:49.285199] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-06T19:00:49.430849] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-06T19:00:49.680079] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:00:49.692880] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-06T19:00:50.225568] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-06T19:00:50.495453] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T19:00:51.025603] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-06T19:00:51.489537] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T19:00:51.722279] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-06T19:00:51.825556] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-06T19:00:52.625573] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-06T19:00:53.203970] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T19:00:53.425570] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-06T19:00:53.647583] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T19:00:54.225535] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-06T19:00:54.350028] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T19:00:55.025598] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-06T19:00:55.420117] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T19:00:55.825536] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-06T19:00:56.625591] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-06T19:00:56.766997] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T19:00:56.796885] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T19:00:57.425569] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-06T19:00:57.691993] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T19:00:58.214202] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T19:00:58.215625] [INFO ] [REMOTE ] FOR: Full fetch complete (29854 records). [2025-10-06T19:00:58.215743] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-06T19:00:58.230737] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-06T19:00:58.606250] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-06T19:00:58.606391] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-06T19:00:58.607527] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-06T19:00:58.607599] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-06T19:00:58.608541] [DEBUG] [LOCAL ] FOR: Trimmed 29854 records to 19733 (keeping 200 days of data) [2025-10-06T19:00:58.727202] [DEBUG] [LOCAL ] FOR: Primary data saved (19733 records). [2025-10-06T19:00:58.727389] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-06T19:00:58.727537] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOR took 24.4s. Estimated remaining: 3h 31m 17s. Rate: 7.1 symbols/min [2025-10-06T19:00:58.896680] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:00:58.930852] [DEBUG] [LOCAL ] FPI: Loaded 31480 existing records from primary storage. [2025-10-06T19:00:58.931150] [INFO ] [MAIN ] FPI: Loaded 31480 existing records. [2025-10-06T19:00:59.030730] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-06T19:00:59.112634] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:00:59.112860] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-06T19:00:59.112908] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-06T19:00:59.114776] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-06T19:00:59.114840] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-06T19:00:59.405456] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-06T19:00:59.487085] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:00:59.825563] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-06T19:01:00.625493] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-06T19:01:00.953291] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T19:01:00.986590] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-06T19:01:01.425546] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-06T19:01:01.760249] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T19:01:02.225537] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-06T19:01:02.498725] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T19:01:03.025537] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-06T19:01:03.179423] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-06T19:01:03.825497] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-06T19:01:03.952184] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T19:01:04.625577] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-06T19:01:04.827383] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T19:01:05.425589] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-06T19:01:05.999187] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T19:01:06.225538] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-06T19:01:06.600011] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T19:01:07.025579] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-06T19:01:07.403670] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-06T19:01:07.825607] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-06T19:01:08.581767] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T19:01:08.625510] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-06T19:01:08.856938] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T19:01:09.425570] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-06T19:01:10.225562] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-06T19:01:10.309166] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T19:01:10.353216] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T19:01:11.025572] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-06T19:01:11.113359] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-06T19:01:11.825582] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-06T19:01:12.625611] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-06T19:01:12.750029] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T19:01:12.872107] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T19:01:13.425624] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-06T19:01:13.620151] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T19:01:14.225542] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-06T19:01:15.025545] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-06T19:01:15.119164] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T19:01:15.143739] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T19:01:15.146000] [INFO ] [REMOTE ] FPF: Full fetch complete (26686 records). [2025-10-06T19:01:15.146175] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-06T19:01:15.538284] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-06T19:01:15.538394] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-06T19:01:15.539426] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-06T19:01:15.539503] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-06T19:01:15.540459] [DEBUG] [LOCAL ] FPF: Trimmed 26686 records to 18409 (keeping 200 days of data) [2025-10-06T19:01:15.671487] [DEBUG] [LOCAL ] FPF: Primary data saved (18409 records). [2025-10-06T19:01:15.671718] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-06T19:01:15.671839] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPF took 33.7s. Estimated remaining: 3h 31m 23s. Rate: 7.1 symbols/min [2025-10-06T19:01:15.833895] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-06T19:01:15.864447] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:01:15.920691] [DEBUG] [LOCAL ] FR: Loaded 47072 existing records from primary storage. [2025-10-06T19:01:15.921154] [INFO ] [MAIN ] FR: Loaded 47072 existing records. [2025-10-06T19:01:16.118975] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:01:16.119283] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-06T19:01:16.119337] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-06T19:01:16.120766] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-06T19:01:16.120831] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-06T19:01:16.541323] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:01:16.559079] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T19:01:16.625554] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-06T19:01:16.851585] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T19:01:16.853308] [INFO ] [REMOTE ] FPH: Full fetch complete (31323 records). [2025-10-06T19:01:16.853393] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-06T19:01:17.277880] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-06T19:01:17.277978] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-06T19:01:17.279106] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-06T19:01:17.279175] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-06T19:01:17.280180] [DEBUG] [LOCAL ] FPH: Trimmed 31323 records to 19298 (keeping 200 days of data) [2025-10-06T19:01:17.400755] [DEBUG] [LOCAL ] FPH: Primary data saved (19298 records). [2025-10-06T19:01:17.400969] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-06T19:01:17.401133] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FPH took 28.5s. Estimated remaining: 3h 31m 3s. Rate: 7.1 symbols/min [2025-10-06T19:01:17.430887] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-06T19:01:17.579805] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:01:17.598281] [DEBUG] [LOCAL ] FRA: Loaded 14755 existing records from primary storage. [2025-10-06T19:01:17.598608] [INFO ] [MAIN ] FRA: Loaded 14755 existing records. [2025-10-06T19:01:17.840296] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:01:17.840612] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-06T19:01:17.840699] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-06T19:01:17.841443] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-06T19:01:17.841504] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-06T19:01:18.226020] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:01:18.226139] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-06T19:01:18.441632] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-06T19:01:19.006470] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T19:01:19.025490] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-06T19:01:19.698929] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T19:01:19.825533] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-06T19:01:20.354112] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T19:01:20.625564] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-06T19:01:21.403843] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T19:01:21.425478] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-06T19:01:22.225587] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-06T19:01:22.604993] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T19:01:22.885168] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T19:01:23.025483] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-06T19:01:23.242326] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-06T19:01:23.825565] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-06T19:01:24.569792] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T19:01:24.625605] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-06T19:01:25.421970] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T19:01:25.430164] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-06T19:01:25.810257] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T19:01:26.225559] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-06T19:01:27.025512] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-06T19:01:27.206028] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T19:01:27.242539] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T19:01:27.825559] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-06T19:01:28.349600] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T19:01:28.625621] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-06T19:01:29.425491] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-06T19:01:29.474553] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T19:01:29.644573] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T19:01:30.225560] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-06T19:01:30.556369] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T19:01:31.025607] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-06T19:01:31.305758] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-06T19:01:31.825528] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-06T19:01:31.909152] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T19:01:32.625509] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-06T19:01:32.657756] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T19:01:33.425532] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-06T19:01:33.931821] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T19:01:34.225538] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-06T19:01:35.025560] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-06T19:01:35.205364] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-06T19:01:35.208616] [INFO ] [REMOTE ] FOUR: Full fetch complete (72067 records). [2025-10-06T19:01:35.208756] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-06T19:01:35.597135] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-06T19:01:35.597298] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-06T19:01:35.598458] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-06T19:01:35.598614] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-06T19:01:35.600449] [DEBUG] [LOCAL ] FOUR: Trimmed 72067 records to 49579 (keeping 200 days of data) [2025-10-06T19:01:35.837283] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-06T19:01:35.853042] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T19:01:35.949939] [DEBUG] [LOCAL ] FOUR: Primary data saved (49579 records). [2025-10-06T19:01:35.950100] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-06T19:01:35.950193] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FOUR took 58.1s. Estimated remaining: 3h 31m 12s. Rate: 7.1 symbols/min [2025-10-06T19:01:36.080257] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T19:01:36.139544] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:01:36.160514] [DEBUG] [LOCAL ] FRGE: Loaded 17810 existing records from primary storage. [2025-10-06T19:01:36.160821] [INFO ] [MAIN ] FRGE: Loaded 17810 existing records. [2025-10-06T19:01:36.342950] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:01:36.344111] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-06T19:01:36.344175] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-06T19:01:36.345304] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-06T19:01:36.345381] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-06T19:01:36.626535] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-06T19:01:36.706764] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:01:36.900871] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T19:01:36.903028] [INFO ] [REMOTE ] FPI: Full fetch complete (44253 records). [2025-10-06T19:01:36.903111] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-06T19:01:37.272697] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-06T19:01:37.272800] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-06T19:01:37.273535] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-06T19:01:37.273576] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-06T19:01:37.274574] [DEBUG] [LOCAL ] FPI: Trimmed 44253 records to 31057 (keeping 200 days of data) [2025-10-06T19:01:37.440011] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-06T19:01:37.494114] [DEBUG] [LOCAL ] FPI: Primary data saved (31057 records). [2025-10-06T19:01:37.494352] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-06T19:01:37.494481] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPI took 38.8s. Estimated remaining: 3h 30m 52s. Rate: 7.1 symbols/min [2025-10-06T19:01:37.681742] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:01:37.738413] [DEBUG] [LOCAL ] FRO: Loaded 52466 existing records from primary storage. [2025-10-06T19:01:37.738851] [INFO ] [MAIN ] FRO: Loaded 52466 existing records. [2025-10-06T19:01:37.919249] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:01:37.919722] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-06T19:01:37.919870] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-06T19:01:37.921597] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-06T19:01:37.921693] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-06T19:01:38.226507] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-06T19:01:38.313524] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:01:38.341053] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T19:01:38.886417] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T19:01:39.025501] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-06T19:01:39.243693] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T19:01:39.825528] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-06T19:01:40.383849] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T19:01:40.625541] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-06T19:01:41.425498] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-06T19:01:41.482323] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T19:01:41.864522] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-06T19:01:42.225509] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-06T19:01:42.718920] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T19:01:43.031661] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-06T19:01:43.033482] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-06T19:01:43.825530] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-06T19:01:44.625490] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-06T19:01:44.991291] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-06T19:01:45.425524] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-06T19:01:45.571811] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T19:01:45.625626] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T19:01:45.987907] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T19:01:45.989205] [INFO ] [REMOTE ] FRA: Full fetch complete (23964 records). [2025-10-06T19:01:45.989275] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-06T19:01:46.233302] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-06T19:01:46.365054] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-06T19:01:46.365224] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-06T19:01:46.365860] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-06T19:01:46.365923] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-06T19:01:46.366910] [DEBUG] [LOCAL ] FRA: Trimmed 23964 records to 14576 (keeping 200 days of data) [2025-10-06T19:01:46.459991] [DEBUG] [LOCAL ] FRA: Primary data saved (14576 records). [2025-10-06T19:01:46.460203] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-06T19:01:46.460509] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FRA took 29.1s. Estimated remaining: 3h 30m 44s. Rate: 7.1 symbols/min [2025-10-06T19:01:46.631344] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:01:46.631603] [DEBUG] [LOCAL ] FRT: No existing data file found in primary storage. [2025-10-06T19:01:46.631684] [WARN ] [MAIN ] FRT: No existing data found, performing full refresh instead. [2025-10-06T19:01:46.631830] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-06T19:01:46.631874] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-06T19:01:46.631915] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-10-06T19:01:46.631948] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-06T19:01:46.980968] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:01:47.025555] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-06T19:01:47.826077] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-06T19:01:47.829040] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T19:01:48.419114] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T19:01:48.625539] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-06T19:01:49.425576] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-06T19:01:49.700910] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-06T19:01:50.220871] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T19:01:50.229217] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-06T19:01:50.926960] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T19:01:51.025546] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-06T19:01:51.495820] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T19:01:51.825529] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-06T19:01:52.625814] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-06T19:01:52.868748] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-06T19:01:52.924115] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T19:01:53.425535] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-06T19:01:53.754563] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T19:01:54.225530] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-06T19:01:55.025515] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-06T19:01:55.418963] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-06T19:01:55.450729] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T19:01:55.453695] [INFO ] [REMOTE ] FR: Full fetch complete (66741 records). [2025-10-06T19:01:55.453804] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-06T19:01:55.838060] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-06T19:01:55.842325] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-06T19:01:55.842384] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-06T19:01:55.843342] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-06T19:01:55.843498] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-06T19:01:55.845012] [DEBUG] [LOCAL ] FR: Trimmed 66741 records to 46451 (keeping 200 days of data) [2025-10-06T19:01:56.139742] [DEBUG] [LOCAL ] FR: Primary data saved (46451 records). [2025-10-06T19:01:56.139992] [INFO ] [MAIN ] FR: Full history saved. [2025-10-06T19:01:56.140907] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FR took 40.5s. Estimated remaining: 3h 30m 38s. Rate: 7.1 symbols/min [2025-10-06T19:01:56.317979] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:01:56.365031] [DEBUG] [LOCAL ] FSCO: Loaded 38288 existing records from primary storage. [2025-10-06T19:01:56.365369] [INFO ] [MAIN ] FSCO: Loaded 38288 existing records. [2025-10-06T19:01:56.555368] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:01:56.555778] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-06T19:01:56.555900] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-06T19:01:56.556195] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-06T19:01:56.556255] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-06T19:01:56.626423] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-06T19:01:56.867192] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-06T19:01:56.966780] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:01:57.425551] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-06T19:01:57.564848] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T19:01:57.808221] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-06T19:01:58.225533] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-06T19:01:58.874195] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T19:01:59.025582] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-06T19:01:59.136508] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-06T19:01:59.825573] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-06T19:02:00.639046] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-06T19:02:00.642227] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T19:02:01.433602] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-06T19:02:01.456596] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T19:02:01.636042] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T19:02:02.225581] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-06T19:02:03.025527] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-06T19:02:03.140818] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T19:02:03.826043] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-06T19:02:03.827877] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-06T19:02:04.086416] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T19:02:04.625603] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-06T19:02:04.910540] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T19:02:05.425579] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-06T19:02:06.157770] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T19:02:06.225533] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-06T19:02:07.025573] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-06T19:02:07.428962] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-06T19:02:07.641311] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T19:02:07.825727] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-06T19:02:08.609874] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T19:02:08.625465] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-06T19:02:09.425591] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-06T19:02:09.656829] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-06T19:02:10.133570] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T19:02:10.134968] [INFO ] [REMOTE ] FRGE: Full fetch complete (32068 records). [2025-10-06T19:02:10.135081] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-06T19:02:10.230784] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-06T19:02:10.316789] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T19:02:10.624228] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-06T19:02:10.624380] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-06T19:02:10.625524] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-06T19:02:10.625609] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-06T19:02:10.626685] [DEBUG] [LOCAL ] FRGE: Trimmed 32068 records to 17112 (keeping 200 days of data) [2025-10-06T19:02:10.738126] [DEBUG] [LOCAL ] FRGE: Primary data saved (17112 records). [2025-10-06T19:02:10.738313] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-06T19:02:10.738410] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRGE took 34.8s. Estimated remaining: 3h 30m 41s. Rate: 7.1 symbols/min [2025-10-06T19:02:10.930250] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:02:10.998595] [DEBUG] [LOCAL ] FSK: Loaded 50184 existing records from primary storage. [2025-10-06T19:02:10.999049] [INFO ] [MAIN ] FSK: Loaded 50184 existing records. [2025-10-06T19:02:11.033832] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-06T19:02:11.211511] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:02:11.212492] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-06T19:02:11.212544] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-06T19:02:11.213004] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-06T19:02:11.213064] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-06T19:02:11.624261] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:02:11.685754] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T19:02:11.825560] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-06T19:02:12.625567] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-06T19:02:12.762248] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-06T19:02:12.765286] [INFO ] [REMOTE ] FRO: Full fetch complete (75204 records). [2025-10-06T19:02:12.765561] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-06T19:02:13.196238] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-06T19:02:13.196423] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-06T19:02:13.197663] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-06T19:02:13.197779] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-06T19:02:13.199455] [DEBUG] [LOCAL ] FRO: Trimmed 75204 records to 51693 (keeping 200 days of data) [2025-10-06T19:02:13.323491] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T19:02:13.433442] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-06T19:02:13.573504] [DEBUG] [LOCAL ] FRO: Primary data saved (51693 records). [2025-10-06T19:02:13.573714] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-06T19:02:13.573826] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRO took 36.1s. Estimated remaining: 3h 30m 22s. Rate: 7.1 symbols/min [2025-10-06T19:02:13.755729] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:02:13.811143] [DEBUG] [LOCAL ] FSLY: Loaded 52001 existing records from primary storage. [2025-10-06T19:02:13.811579] [INFO ] [MAIN ] FSLY: Loaded 52001 existing records. [2025-10-06T19:02:14.009873] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:02:14.010309] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-06T19:02:14.010435] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-06T19:02:14.011923] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-06T19:02:14.011988] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-06T19:02:14.226554] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-06T19:02:14.347454] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T19:02:14.459202] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:02:14.490543] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T19:02:15.025595] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-06T19:02:15.825565] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-06T19:02:15.966399] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T19:02:16.625588] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-06T19:02:17.080724] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-06T19:02:17.159077] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T19:02:17.170568] [INFO ] [REMOTE ] FRT: Full fetch complete (60408 records). [2025-10-06T19:02:17.170902] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-06T19:02:17.425927] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-06T19:02:17.742893] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-06T19:02:17.743016] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-06T19:02:17.744091] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-06T19:02:17.744163] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-06T19:02:17.745628] [DEBUG] [LOCAL ] FRT: Trimmed 60408 records to 41945 (keeping 200 days of data) [2025-10-06T19:02:18.066338] [DEBUG] [LOCAL ] FRT: Primary data saved (41945 records). [2025-10-06T19:02:18.066535] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-06T19:02:18.066698] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRT took 31.6s. Estimated remaining: 3h 30m 7s. Rate: 7.1 symbols/min [2025-10-06T19:02:18.252026] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-06T19:02:18.256540] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:02:18.298197] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T19:02:18.357744] [DEBUG] [LOCAL ] FSM: Loaded 54070 existing records from primary storage. [2025-10-06T19:02:18.358196] [INFO ] [MAIN ] FSM: Loaded 54070 existing records. [2025-10-06T19:02:18.539684] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:02:18.539957] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-06T19:02:18.540010] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-06T19:02:18.540269] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-06T19:02:18.540329] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-06T19:02:18.908159] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:02:19.025580] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-06T19:02:19.313749] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T19:02:19.607270] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T19:02:19.825536] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-06T19:02:20.625504] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-06T19:02:20.711499] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T19:02:21.425497] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-06T19:02:21.621443] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T19:02:22.225541] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-06T19:02:22.229401] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T19:02:22.646949] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T19:02:23.025556] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-06T19:02:23.825504] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-06T19:02:23.929303] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T19:02:24.424241] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T19:02:24.625594] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-06T19:02:25.173887] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T19:02:25.425609] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-06T19:02:26.225517] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-06T19:02:26.336756] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T19:02:26.789268] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T19:02:27.025570] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-06T19:02:27.706735] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T19:02:27.825553] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-06T19:02:28.229060] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T19:02:28.625573] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-06T19:02:29.425532] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-06T19:02:29.583522] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T19:02:30.225614] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-06T19:02:30.284787] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T19:02:30.816182] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-06T19:02:30.821351] [INFO ] [REMOTE ] FSCO: Full fetch complete (54584 records). [2025-10-06T19:02:30.821597] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-06T19:02:31.033137] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-06T19:02:31.232149] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-06T19:02:31.232249] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-06T19:02:31.233170] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-06T19:02:31.233257] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-06T19:02:31.234599] [DEBUG] [LOCAL ] FSCO: Trimmed 54584 records to 37913 (keeping 200 days of data) [2025-10-06T19:02:31.458778] [DEBUG] [LOCAL ] FSCO: Primary data saved (37913 records). [2025-10-06T19:02:31.458949] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-06T19:02:31.459576] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FSCO took 35.3s. Estimated remaining: 3h 30m 7s. Rate: 7.1 symbols/min [2025-10-06T19:02:31.635708] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:02:31.676722] [DEBUG] [LOCAL ] FSS: Loaded 34548 existing records from primary storage. [2025-10-06T19:02:31.677101] [INFO ] [MAIN ] FSS: Loaded 34548 existing records. [2025-10-06T19:02:31.837120] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-06T19:02:31.878071] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:02:31.878836] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-06T19:02:31.878952] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-06T19:02:31.879320] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-06T19:02:31.879386] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-06T19:02:32.024404] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-06T19:02:32.348228] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:02:32.625518] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-06T19:02:32.939746] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T19:02:33.425510] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-06T19:02:33.601615] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T19:02:34.225521] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-06T19:02:34.260419] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T19:02:34.574441] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T19:02:35.025535] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-06T19:02:35.825524] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-06T19:02:36.042681] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T19:02:36.136117] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T19:02:36.625584] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-06T19:02:37.425566] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-06T19:02:37.602524] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T19:02:38.225552] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-06T19:02:38.406509] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T19:02:39.030946] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-06T19:02:39.050106] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T19:02:39.831024] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-06T19:02:39.837013] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-06T19:02:40.348559] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T19:02:40.625547] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-06T19:02:41.425493] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-06T19:02:41.546764] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T19:02:42.225618] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-06T19:02:42.328706] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-06T19:02:42.331973] [INFO ] [REMOTE ] FSK: Full fetch complete (71609 records). [2025-10-06T19:02:42.332131] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-06T19:02:42.767248] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-06T19:02:42.767347] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-06T19:02:42.768476] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-06T19:02:42.768550] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-06T19:02:42.770400] [DEBUG] [LOCAL ] FSK: Trimmed 71609 records to 49404 (keeping 200 days of data) [2025-10-06T19:02:43.028397] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-06T19:02:43.093741] [DEBUG] [LOCAL ] FSK: Primary data saved (49404 records). [2025-10-06T19:02:43.093933] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-06T19:02:43.094068] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 32.4s. Estimated remaining: 3h 30m 5s. Rate: 7.1 symbols/min [2025-10-06T19:02:43.278691] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:02:43.289915] [DEBUG] [LOCAL ] FT: Loaded 6616 existing records from primary storage. [2025-10-06T19:02:43.290191] [INFO ] [MAIN ] FT: Loaded 6616 existing records. [2025-10-06T19:02:43.482057] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-06T19:02:43.513913] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:02:43.524706] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-06T19:02:43.524922] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-06T19:02:43.525398] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-06T19:02:43.525504] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-06T19:02:43.696241] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T19:02:43.830723] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-06T19:02:43.960610] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:02:44.625530] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-06T19:02:44.876865] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-06T19:02:45.425604] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-06T19:02:45.730710] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T19:02:45.855707] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T19:02:46.072084] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-06T19:02:46.225589] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-06T19:02:47.025556] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-06T19:02:47.817991] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T19:02:47.821297] [INFO ] [REMOTE ] FSLY: Full fetch complete (74888 records). [2025-10-06T19:02:47.821450] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-06T19:02:47.833816] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-06T19:02:48.228461] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-06T19:02:48.228583] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-06T19:02:48.229737] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-06T19:02:48.229807] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-06T19:02:48.231469] [DEBUG] [LOCAL ] FSLY: Trimmed 74888 records to 51238 (keeping 200 days of data) [2025-10-06T19:02:48.463664] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T19:02:48.569442] [DEBUG] [LOCAL ] FSLY: Primary data saved (51238 records). [2025-10-06T19:02:48.569623] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-06T19:02:48.569767] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSLY took 35.0s. Estimated remaining: 3h 29m 51s. Rate: 7.1 symbols/min [2025-10-06T19:02:48.633145] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-06T19:02:48.744395] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:02:48.759330] [DEBUG] [LOCAL ] FTHY: Loaded 12277 existing records from primary storage. [2025-10-06T19:02:48.759592] [INFO ] [MAIN ] FTHY: Loaded 12277 existing records. [2025-10-06T19:02:48.941332] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:02:48.941567] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-06T19:02:48.941617] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-06T19:02:48.942275] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-06T19:02:48.942337] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-06T19:02:49.316615] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:02:49.344574] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T19:02:49.425496] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-06T19:02:50.225542] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-06T19:02:50.451963] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T19:02:50.477070] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T19:02:50.911679] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-06T19:02:51.025537] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-06T19:02:51.679515] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-06T19:02:51.825492] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-06T19:02:52.554192] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T19:02:52.625480] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-06T19:02:53.265115] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-06T19:02:53.425538] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-06T19:02:54.225784] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-06T19:02:54.420512] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T19:02:55.025548] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-06T19:02:55.332809] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T19:02:55.825542] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-06T19:02:56.470386] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-06T19:02:56.625568] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-06T19:02:56.722212] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-06T19:02:56.725375] [INFO ] [REMOTE ] FSM: Full fetch complete (76793 records). [2025-10-06T19:02:56.725763] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-06T19:02:57.138753] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-06T19:02:57.138895] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-06T19:02:57.139968] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-06T19:02:57.140039] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-06T19:02:57.141617] [DEBUG] [LOCAL ] FSM: Trimmed 76793 records to 53295 (keeping 200 days of data) [2025-10-06T19:02:57.438280] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-06T19:02:57.445594] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-06T19:02:57.471492] [DEBUG] [LOCAL ] FSM: Primary data saved (53295 records). [2025-10-06T19:02:57.471703] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-06T19:02:57.471816] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FSM took 39.4s. Estimated remaining: 3h 29m 44s. Rate: 7.1 symbols/min [2025-10-06T19:02:57.645453] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:02:57.706784] [DEBUG] [LOCAL ] FTI: Loaded 54076 existing records from primary storage. [2025-10-06T19:02:57.707173] [INFO ] [MAIN ] FTI: Loaded 54076 existing records. [2025-10-06T19:02:57.883055] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:02:57.883272] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-06T19:02:57.883327] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-06T19:02:57.885264] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-06T19:02:57.885326] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-06T19:02:58.163763] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T19:02:58.235423] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-06T19:02:58.248348] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:02:58.956556] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-06T19:02:59.025536] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-06T19:02:59.825549] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-06T19:03:00.364843] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T19:03:00.378373] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-06T19:03:00.625506] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-06T19:03:01.425599] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-06T19:03:02.128289] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T19:03:02.225544] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-06T19:03:03.025581] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-06T19:03:03.326305] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T19:03:03.492087] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-06T19:03:03.512377] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T19:03:03.825538] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-06T19:03:04.625578] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-06T19:03:05.425520] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-06T19:03:05.534619] [DEBUG] [REMOTE ] FT: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-06T19:03:05.535166] [WARN ] [REMOTE ] FT: No data returned for month 2025-07 [2025-10-06T19:03:05.535363] [FATAL] [REMOTE ] FT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:03:05.535819] [FATAL] [MAIN ] FT: Failed to fetch primary data. [2025-10-06T19:03:05.538026] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T19:03:05.536187] [WARN ] [MAIN ] FT: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:03:05.538282] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-06T19:03:05.548903] [DEBUG] [LOCAL ] FT: No primary data file found to delete. [2025-10-06T19:03:05.549856] [INFO ] [LOCAL ] FT: Starting deletion of derivative data. [2025-10-06T19:03:05.550165] [DEBUG] [LOCAL ] FT: Deleted derivative data file. [2025-10-06T19:03:05.550251] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FT took 22.5s. Estimated remaining: 3h 29m 35s. Rate: 7.1 symbols/min [2025-10-06T19:03:05.899294] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-06T19:03:06.225536] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-06T19:03:06.712573] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-06T19:03:07.025531] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-06T19:03:07.803106] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T19:03:07.825463] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-06T19:03:08.613943] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-06T19:03:08.625460] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-06T19:03:09.405409] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-06T19:03:09.425468] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-06T19:03:10.225634] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-06T19:03:10.249983] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T19:03:10.251822] [INFO ] [REMOTE ] FTHY: Full fetch complete (17695 records). [2025-10-06T19:03:10.252008] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-06T19:03:10.634922] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-06T19:03:10.635024] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-06T19:03:10.635509] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-06T19:03:10.635596] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-06T19:03:10.636482] [DEBUG] [LOCAL ] FTHY: Trimmed 17695 records to 12272 (keeping 200 days of data) [2025-10-06T19:03:10.717516] [DEBUG] [LOCAL ] FTHY: Primary data saved (12272 records). [2025-10-06T19:03:10.717745] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-06T19:03:10.717867] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FTHY took 22.1s. Estimated remaining: 3h 29m 21s. Rate: 7.1 symbols/min [2025-10-06T19:03:11.025595] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-06T19:03:11.502550] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T19:03:11.504794] [INFO ] [REMOTE ] FSS: Full fetch complete (48482 records). [2025-10-06T19:03:11.504876] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-06T19:03:11.876582] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-06T19:03:11.876696] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-06T19:03:11.877486] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-06T19:03:11.877557] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-06T19:03:11.878683] [DEBUG] [LOCAL ] FSS: Trimmed 48482 records to 34047 (keeping 200 days of data) [2025-10-06T19:03:12.101741] [DEBUG] [LOCAL ] FSS: Primary data saved (34047 records). [2025-10-06T19:03:12.101950] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-06T19:03:12.102717] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FSS took 40.6s. Estimated remaining: 3h 29m 0s. Rate: 7.1 symbols/min [2025-10-06T19:03:12.687920] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T19:03:12.698419] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-06T19:03:14.549603] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T19:03:14.561849] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-06T19:03:16.332426] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T19:03:16.344667] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-06T19:03:17.981187] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T19:03:17.993026] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-06T19:03:19.749740] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T19:03:19.761411] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-06T19:03:21.759624] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-06T19:03:21.772450] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-06T19:03:23.485223] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T19:03:23.500688] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-06T19:03:25.363431] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-06T19:03:25.376958] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-06T19:03:27.017031] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T19:03:27.021674] [INFO ] [REMOTE ] FTI: Full fetch complete (77133 records). [2025-10-06T19:03:27.021863] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-06T19:03:27.462456] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-06T19:03:27.462556] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-06T19:03:27.463602] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-06T19:03:27.463695] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-06T19:03:27.465247] [DEBUG] [LOCAL ] FTI: Trimmed 77133 records to 53298 (keeping 200 days of data) [2025-10-06T19:03:27.800778] [DEBUG] [LOCAL ] FTI: Primary data saved (53298 records). [2025-10-06T19:03:27.800975] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-06T19:03:27.801084] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 30.3s. Estimated remaining: 3h 29m 4s. Rate: 7.1 symbols/min [2025-10-06T19:03:28.530282] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:03:28.531750] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:03:28.533688] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:03:28.536289] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:03:28.543928] [DEBUG] [LOCAL ] FTWO: Loaded 1873 existing records from primary storage. [2025-10-06T19:03:28.544795] [INFO ] [MAIN ] FTWO: Loaded 1873 existing records. [2025-10-06T19:03:28.769418] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:03:28.769748] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-06T19:03:28.769803] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-06T19:03:28.770114] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-06T19:03:28.770172] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-06T19:03:28.845583] [DEBUG] [LOCAL ] FTK: Loaded 32705 existing records from primary storage. [2025-10-06T19:03:28.847181] [DEBUG] [LOCAL ] FTS: Loaded 42797 existing records from primary storage. [2025-10-06T19:03:28.884729] [INFO ] [MAIN ] FTK: Loaded 32705 existing records. [2025-10-06T19:03:28.900411] [INFO ] [MAIN ] FTS: Loaded 42797 existing records. [2025-10-06T19:03:29.065175] [DEBUG] [LOCAL ] FTV: Loaded 53708 existing records from primary storage. [2025-10-06T19:03:29.144783] [INFO ] [MAIN ] FTV: Loaded 53708 existing records. [2025-10-06T19:03:29.597058] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:03:29.649676] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-06T19:03:29.663765] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:03:29.687248] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-06T19:03:29.690283] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-06T19:03:29.722447] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-06T19:03:29.732929] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-06T19:03:29.733165] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-06T19:03:29.732848] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:03:29.733448] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-06T19:03:29.738688] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-06T19:03:29.755743] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-06T19:03:29.893294] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:03:29.909274] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-06T19:03:29.919312] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-06T19:03:29.973418] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-06T19:03:29.989281] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-06T19:03:30.692952] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:03:30.646420] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-06T19:03:30.719561] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-06T19:03:30.714689] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-06T19:03:30.867342] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:03:30.902122] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-06T19:03:30.907603] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:03:30.907887] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-06T19:03:31.402140] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-06T19:03:31.403815] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-06T19:03:31.843692] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T19:03:31.845302] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-06T19:03:31.917894] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-06T19:03:31.926697] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-06T19:03:32.058046] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T19:03:32.063108] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-06T19:03:32.131923] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-06T19:03:32.133841] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-06T19:03:32.627424] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-06T19:03:32.629326] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-06T19:03:32.632430] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T19:03:32.643222] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-06T19:03:32.833145] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T19:03:32.838613] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-06T19:03:33.204074] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-06T19:03:33.205390] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-06T19:03:33.378976] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T19:03:33.387053] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-06T19:03:33.498966] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-06T19:03:33.500407] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-06T19:03:33.802203] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-06T19:03:33.803946] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-06T19:03:33.819329] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T19:03:33.824748] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-06T19:03:34.154773] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T19:03:34.165501] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-06T19:03:34.252051] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-06T19:03:34.253508] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-06T19:03:34.618509] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-06T19:03:34.619937] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-06T19:03:34.960312] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T19:03:35.025247] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T19:03:35.031365] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-06T19:03:35.194224] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T19:03:35.195071] [INFO ] [REMOTE ] FTWO: Full fetch complete (3342 records). [2025-10-06T19:03:35.195140] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-06T19:03:35.566915] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-06T19:03:35.567053] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-06T19:03:35.567266] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-06T19:03:35.567370] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-06T19:03:35.567873] [DEBUG] [LOCAL ] FTWO: Trimmed 3342 records to 1872 (keeping 200 days of data) [2025-10-06T19:03:35.579978] [DEBUG] [LOCAL ] FTWO: Primary data saved (1872 records). [2025-10-06T19:03:35.580046] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-06T19:03:35.580116] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 7.8s. Estimated remaining: 3h 28m 55s. Rate: 7.1 symbols/min [2025-10-06T19:03:35.757334] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:03:35.804876] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T19:03:35.825475] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-06T19:03:35.865852] [DEBUG] [LOCAL ] FUBO: Loaded 54477 existing records from primary storage. [2025-10-06T19:03:35.866224] [INFO ] [MAIN ] FUBO: Loaded 54477 existing records. [2025-10-06T19:03:36.043522] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:03:36.043804] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-06T19:03:36.043854] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-06T19:03:36.045103] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-06T19:03:36.045162] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-06T19:03:36.402778] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:03:36.559570] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T19:03:36.625496] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-06T19:03:37.134507] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T19:03:37.425556] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-06T19:03:38.225538] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-06T19:03:38.510780] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-06T19:03:39.032201] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-06T19:03:39.069215] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T19:03:39.556364] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T19:03:39.825557] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-06T19:03:40.235379] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T19:03:40.625604] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-06T19:03:41.401381] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T19:03:41.425487] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-06T19:03:42.225507] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-06T19:03:42.271066] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T19:03:42.840419] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T19:03:43.025551] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-06T19:03:43.697964] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T19:03:43.825552] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-06T19:03:44.197114] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T19:03:44.625526] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-06T19:03:44.857480] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T19:03:45.425574] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-06T19:03:46.225546] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-06T19:03:46.324056] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T19:03:46.756401] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-06T19:03:47.025540] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-06T19:03:47.825541] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-06T19:03:48.408124] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T19:03:48.599925] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-06T19:03:48.625481] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-06T19:03:49.425580] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-06T19:03:49.567577] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T19:03:50.225610] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-06T19:03:50.962186] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-06T19:03:51.013516] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T19:03:51.025587] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-06T19:03:51.704415] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T19:03:51.825554] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-06T19:03:52.625539] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-06T19:03:53.197440] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-06T19:03:53.425606] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-06T19:03:53.692434] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-06T19:03:53.731426] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T19:03:54.225553] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-06T19:03:55.025502] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-06T19:03:55.357582] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-06T19:03:55.377575] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-06T19:03:55.382114] [INFO ] [REMOTE ] FTS: Full fetch complete (60275 records). [2025-10-06T19:03:55.382274] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-06T19:03:55.769497] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-06T19:03:55.769589] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-06T19:03:55.770426] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-06T19:03:55.770491] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-06T19:03:55.771755] [DEBUG] [LOCAL ] FTS: Trimmed 60275 records to 42375 (keeping 200 days of data) [2025-10-06T19:03:55.827728] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-06T19:03:56.022209] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T19:03:56.027010] [INFO ] [REMOTE ] FTK: Full fetch complete (43446 records). [2025-10-06T19:03:56.032487] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-06T19:03:56.168374] [DEBUG] [LOCAL ] FTS: Primary data saved (42375 records). [2025-10-06T19:03:56.184151] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-06T19:03:56.220143] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTS took 28.4s. Estimated remaining: 3h 29m 7s. Rate: 7.1 symbols/min [2025-10-06T19:03:56.580242] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:03:56.630790] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-06T19:03:56.635007] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-06T19:03:56.635141] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-06T19:03:56.636194] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-06T19:03:56.637750] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-06T19:03:56.639878] [DEBUG] [LOCAL ] FTK: Trimmed 43446 records to 32430 (keeping 200 days of data) [2025-10-06T19:03:56.759695] [DEBUG] [LOCAL ] FUL: Loaded 33460 existing records from primary storage. [2025-10-06T19:03:56.763635] [INFO ] [MAIN ] FUL: Loaded 33460 existing records. [2025-10-06T19:03:56.956149] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:03:56.956902] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-06T19:03:56.958789] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-06T19:03:56.961733] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-06T19:03:56.961839] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-06T19:03:57.321107] [DEBUG] [LOCAL ] FTK: Primary data saved (32430 records). [2025-10-06T19:03:57.321386] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-06T19:03:57.321877] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTK took 29.5s. Estimated remaining: 3h 28m 46s. Rate: 7.1 symbols/min [2025-10-06T19:03:57.536211] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:03:57.552398] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-06T19:03:57.632164] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:03:57.685121] [DEBUG] [LOCAL ] FUN: Loaded 52377 existing records from primary storage. [2025-10-06T19:03:57.685516] [INFO ] [MAIN ] FUN: Loaded 52377 existing records. [2025-10-06T19:03:57.875260] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:03:57.875673] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-06T19:03:57.875739] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-06T19:03:57.877517] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-06T19:03:57.877618] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-06T19:03:58.277443] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:03:58.278399] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-06T19:03:58.314581] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-06T19:03:58.483882] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T19:03:58.775373] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T19:03:59.025574] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-06T19:03:59.698295] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T19:03:59.825546] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-06T19:04:00.625636] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-06T19:04:01.348569] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-06T19:04:01.396014] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T19:04:01.425603] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-06T19:04:02.043312] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T19:04:02.048467] [INFO ] [REMOTE ] FTV: Full fetch complete (76379 records). [2025-10-06T19:04:02.048756] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-06T19:04:02.240584] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-06T19:04:02.512470] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-06T19:04:02.512586] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-06T19:04:02.513878] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-06T19:04:02.513951] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-06T19:04:02.515994] [DEBUG] [LOCAL ] FTV: Trimmed 76379 records to 52977 (keeping 200 days of data) [2025-10-06T19:04:02.875687] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T19:04:02.904998] [DEBUG] [LOCAL ] FTV: Primary data saved (52977 records). [2025-10-06T19:04:02.905206] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-06T19:04:02.905316] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 35.1s. Estimated remaining: 3h 28m 33s. Rate: 7.1 symbols/min [2025-10-06T19:04:03.030772] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-06T19:04:03.090707] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:04:03.116256] [DEBUG] [LOCAL ] FVR: Loaded 21967 existing records from primary storage. [2025-10-06T19:04:03.116607] [INFO ] [MAIN ] FVR: Loaded 21967 existing records. [2025-10-06T19:04:03.292671] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:04:03.293022] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-06T19:04:03.293072] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-06T19:04:03.293854] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-06T19:04:03.293914] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-06T19:04:03.677660] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:04:03.825504] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-06T19:04:03.863898] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T19:04:04.625608] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-06T19:04:04.895401] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T19:04:05.055020] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-06T19:04:05.425541] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-06T19:04:05.791250] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T19:04:06.225575] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-06T19:04:06.709799] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T19:04:07.025544] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-06T19:04:07.825546] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-06T19:04:08.328860] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-06T19:04:08.603207] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T19:04:08.625472] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-06T19:04:08.647310] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T19:04:09.425571] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-06T19:04:10.225529] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-06T19:04:10.408256] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-06T19:04:11.025524] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-06T19:04:11.599427] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-06T19:04:11.659065] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T19:04:11.825605] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-06T19:04:12.625570] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-06T19:04:12.694979] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T19:04:13.144172] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T19:04:13.399477] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-06T19:04:13.425555] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-06T19:04:14.225506] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-06T19:04:14.470766] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T19:04:15.025558] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-06T19:04:15.830675] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-06T19:04:15.852478] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T19:04:16.260402] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T19:04:16.625504] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-06T19:04:16.981177] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T19:04:17.425560] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-06T19:04:18.225517] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-06T19:04:18.581301] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T19:04:18.600569] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-06T19:04:18.605760] [INFO ] [REMOTE ] FUBO: Full fetch complete (77768 records). [2025-10-06T19:04:18.605970] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-06T19:04:19.030828] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-06T19:04:19.158700] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-06T19:04:19.158854] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-06T19:04:19.160981] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-06T19:04:19.161161] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-06T19:04:19.164024] [DEBUG] [LOCAL ] FUBO: Trimmed 77768 records to 53700 (keeping 200 days of data) [2025-10-06T19:04:19.621322] [DEBUG] [LOCAL ] FUBO: Primary data saved (53700 records). [2025-10-06T19:04:19.621561] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-06T19:04:19.621769] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUBO took 44.0s. Estimated remaining: 3h 28m 39s. Rate: 7.1 symbols/min [2025-10-06T19:04:19.834772] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-06T19:04:19.868636] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:04:19.920854] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T19:04:19.972827] [DEBUG] [LOCAL ] FVRR: Loaded 40657 existing records from primary storage. [2025-10-06T19:04:19.973284] [INFO ] [MAIN ] FVRR: Loaded 40657 existing records. [2025-10-06T19:04:20.166014] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:04:20.166260] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-06T19:04:20.166308] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-06T19:04:20.167869] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-06T19:04:20.167930] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-06T19:04:20.539793] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:04:20.626896] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T19:04:20.625705] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-06T19:04:20.954572] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-06T19:04:21.425537] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-06T19:04:22.225560] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-06T19:04:22.404751] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T19:04:22.965324] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T19:04:23.025494] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-06T19:04:23.260606] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T19:04:23.825542] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-06T19:04:24.598346] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T19:04:24.625495] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-06T19:04:25.063072] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T19:04:25.425590] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-06T19:04:26.179267] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T19:04:26.225555] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-06T19:04:27.025507] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-06T19:04:27.425247] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-06T19:04:27.754472] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T19:04:27.825526] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-06T19:04:28.111951] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T19:04:28.625604] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-06T19:04:29.159578] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T19:04:29.425557] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-06T19:04:30.225490] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-06T19:04:30.235313] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-06T19:04:30.238423] [INFO ] [REMOTE ] FUN: Full fetch complete (72940 records). [2025-10-06T19:04:30.238542] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-06T19:04:30.523873] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T19:04:30.673639] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-06T19:04:30.673808] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-06T19:04:30.674983] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-06T19:04:30.675063] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-06T19:04:30.677101] [DEBUG] [LOCAL ] FUN: Trimmed 72940 records to 51688 (keeping 200 days of data) [2025-10-06T19:04:30.982293] [DEBUG] [LOCAL ] FUN: Primary data saved (51688 records). [2025-10-06T19:04:30.982460] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-06T19:04:30.982553] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUN took 33.7s. Estimated remaining: 3h 28m 35s. Rate: 7.1 symbols/min [2025-10-06T19:04:31.037736] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-06T19:04:31.155310] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:04:31.158566] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-10-06T19:04:31.158773] [INFO ] [MAIN ] FXED: Loaded 1259 existing records. [2025-10-06T19:04:31.334901] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:04:31.335140] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-06T19:04:31.335195] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-06T19:04:31.335407] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-06T19:04:31.335469] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-06T19:04:31.702807] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:04:31.797635] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T19:04:31.825481] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-06T19:04:32.184759] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T19:04:32.239611] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-06T19:04:32.625587] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-06T19:04:33.425552] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-06T19:04:33.479631] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-06T19:04:33.481061] [INFO ] [REMOTE ] FVR: Full fetch complete (30170 records). [2025-10-06T19:04:33.481132] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-06T19:04:33.872633] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-06T19:04:33.872786] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-06T19:04:33.873724] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-06T19:04:33.873789] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-06T19:04:33.874744] [DEBUG] [LOCAL ] FVR: Trimmed 30170 records to 21748 (keeping 200 days of data) [2025-10-06T19:04:34.013749] [DEBUG] [LOCAL ] FVR: Primary data saved (21748 records). [2025-10-06T19:04:34.013965] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-06T19:04:34.014116] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FVR took 31.1s. Estimated remaining: 3h 28m 18s. Rate: 7.1 symbols/min [2025-10-06T19:04:34.203952] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:04:34.236139] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-06T19:04:34.262631] [DEBUG] [LOCAL ] G: Loaded 50591 existing records from primary storage. [2025-10-06T19:04:34.263097] [INFO ] [MAIN ] G: Loaded 50591 existing records. [2025-10-06T19:04:34.442072] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:04:34.442360] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-06T19:04:34.442414] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-06T19:04:34.444247] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-06T19:04:34.444308] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-06T19:04:34.699725] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-06T19:04:34.808948] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:04:34.830889] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T19:04:35.025535] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-06T19:04:35.825553] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-06T19:04:36.190563] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-06T19:04:36.625512] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-06T19:04:36.740098] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T19:04:36.975423] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-06T19:04:37.425557] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-06T19:04:37.916074] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-06T19:04:38.225556] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-06T19:04:38.566020] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-06T19:04:39.025533] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-06T19:04:39.393899] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-06T19:04:39.825553] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-06T19:04:40.625546] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-06T19:04:41.068053] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T19:04:41.075619] [INFO ] [REMOTE ] FUL: Full fetch complete (47764 records). [2025-10-06T19:04:41.075832] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-06T19:04:41.078075] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-06T19:04:41.434242] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-06T19:04:41.479688] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-06T19:04:41.479811] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-06T19:04:41.480700] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-06T19:04:41.480768] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-06T19:04:41.482023] [DEBUG] [LOCAL ] FUL: Trimmed 47764 records to 32931 (keeping 200 days of data) [2025-10-06T19:04:41.722360] [DEBUG] [LOCAL ] FUL: Primary data saved (32931 records). [2025-10-06T19:04:41.722590] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-06T19:04:41.722780] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUL took 45.5s. Estimated remaining: 3h 28m 8s. Rate: 7.1 symbols/min [2025-10-06T19:04:41.944120] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:04:41.976266] [DEBUG] [LOCAL ] GAB: Loaded 28299 existing records from primary storage. [2025-10-06T19:04:41.976622] [INFO ] [MAIN ] GAB: Loaded 28299 existing records. [2025-10-06T19:04:42.200415] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:04:42.201208] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-06T19:04:42.201273] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-06T19:04:42.202513] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-06T19:04:42.202576] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-06T19:04:42.232598] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-06T19:04:42.556484] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:04:42.751431] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-06T19:04:43.025507] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-06T19:04:43.184668] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T19:04:43.825519] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-06T19:04:44.254214] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T19:04:44.263929] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-06T19:04:44.625563] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-06T19:04:45.425559] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-06T19:04:45.718957] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T19:04:46.225584] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-06T19:04:47.019413] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T19:04:47.029150] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-06T19:04:47.253411] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T19:04:47.480166] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T19:04:47.480991] [INFO ] [REMOTE ] FXED: Full fetch complete (1806 records). [2025-10-06T19:04:47.481063] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-06T19:04:47.828023] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-06T19:04:47.860249] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-06T19:04:47.860346] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-06T19:04:47.860513] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-06T19:04:47.860570] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-06T19:04:47.861149] [DEBUG] [LOCAL ] FXED: Trimmed 1806 records to 1246 (keeping 200 days of data) [2025-10-06T19:04:47.870503] [DEBUG] [LOCAL ] FXED: Primary data saved (1246 records). [2025-10-06T19:04:47.870623] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-06T19:04:47.870787] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FXED took 16.9s. Estimated remaining: 3h 27m 56s. Rate: 7.1 symbols/min [2025-10-06T19:04:48.051587] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:04:48.058054] [DEBUG] [LOCAL ] GAM: Loaded 4101 existing records from primary storage. [2025-10-06T19:04:48.058366] [INFO ] [MAIN ] GAM: Loaded 4101 existing records. [2025-10-06T19:04:48.233310] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:04:48.233815] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-06T19:04:48.233882] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-06T19:04:48.234261] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-06T19:04:48.234321] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-06T19:04:48.589660] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:04:48.625481] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-06T19:04:49.397160] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-06T19:04:49.426958] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-06T19:04:49.430079] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T19:04:50.049323] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T19:04:50.225521] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-06T19:04:50.904226] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-06T19:04:51.025524] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-06T19:04:51.805576] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T19:04:51.825479] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-06T19:04:52.625534] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-06T19:04:53.204203] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T19:04:53.350624] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T19:04:53.425504] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-06T19:04:54.046095] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-06T19:04:54.225541] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-06T19:04:55.025546] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-06T19:04:55.767607] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T19:04:55.825478] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-06T19:04:56.358488] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-06T19:04:56.625545] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-06T19:04:57.123245] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-06T19:04:57.425603] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-06T19:04:57.846575] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T19:04:57.849352] [INFO ] [REMOTE ] FVRR: Full fetch complete (59158 records). [2025-10-06T19:04:57.849471] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-06T19:04:58.228950] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-06T19:04:58.228686] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-06T19:04:58.229096] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-06T19:04:58.230083] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-06T19:04:58.231129] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-06T19:04:58.232777] [DEBUG] [LOCAL ] FVRR: Trimmed 59158 records to 40140 (keeping 200 days of data) [2025-10-06T19:04:58.512134] [DEBUG] [LOCAL ] FVRR: Primary data saved (40140 records). [2025-10-06T19:04:58.514109] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-06T19:04:58.513974] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T19:04:58.514404] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FVRR took 38.9s. Estimated remaining: 3h 27m 51s. Rate: 7.1 symbols/min [2025-10-06T19:04:58.704908] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:04:58.710835] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-06T19:04:58.770043] [DEBUG] [LOCAL ] GAP: Loaded 54434 existing records from primary storage. [2025-10-06T19:04:58.770520] [INFO ] [MAIN ] GAP: Loaded 54434 existing records. [2025-10-06T19:04:58.951561] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:04:58.951890] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-06T19:04:58.951966] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-06T19:04:58.954121] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-06T19:04:58.954188] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-06T19:04:59.030741] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-06T19:04:59.324636] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:04:59.825548] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-06T19:05:00.610602] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-06T19:05:00.625465] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-06T19:05:00.699439] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T19:05:01.356845] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-06T19:05:01.425565] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-06T19:05:02.225580] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-06T19:05:03.025551] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-06T19:05:03.473167] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T19:05:03.509197] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-06T19:05:03.538990] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-06T19:05:03.825514] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-06T19:05:04.625568] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-06T19:05:04.952806] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T19:05:05.425550] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-06T19:05:06.143617] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T19:05:06.225507] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-06T19:05:07.025513] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-06T19:05:07.092816] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T19:05:07.389908] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T19:05:07.515699] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-06T19:05:07.516804] [INFO ] [REMOTE ] GAM: Full fetch complete (6694 records). [2025-10-06T19:05:07.516895] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-06T19:05:07.830604] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-06T19:05:07.972523] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-06T19:05:07.972678] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-06T19:05:07.972927] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-06T19:05:07.972995] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-06T19:05:07.973418] [DEBUG] [LOCAL ] GAM: Trimmed 6694 records to 4002 (keeping 200 days of data) [2025-10-06T19:05:08.001356] [DEBUG] [LOCAL ] GAM: Primary data saved (4002 records). [2025-10-06T19:05:08.001499] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-06T19:05:08.001591] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. GAM took 20.1s. Estimated remaining: 3h 27m 44s. Rate: 7.1 symbols/min [2025-10-06T19:05:08.215536] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:05:08.242029] [DEBUG] [LOCAL ] GATX: Loaded 18362 existing records from primary storage. [2025-10-06T19:05:08.242419] [INFO ] [MAIN ] GATX: Loaded 18362 existing records. [2025-10-06T19:05:08.449697] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:05:08.450072] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-06T19:05:08.450130] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-06T19:05:08.451025] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-06T19:05:08.451086] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-06T19:05:08.638180] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-06T19:05:08.815502] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:05:09.425538] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-06T19:05:09.511805] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T19:05:09.565808] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T19:05:10.225499] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-06T19:05:10.462438] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T19:05:11.025709] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-06T19:05:11.537605] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T19:05:11.825584] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-06T19:05:12.625576] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-06T19:05:12.700971] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T19:05:12.826508] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T19:05:12.828411] [INFO ] [REMOTE ] GAB: Full fetch complete (39597 records). [2025-10-06T19:05:12.828527] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-06T19:05:13.244402] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-06T19:05:13.244660] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-06T19:05:13.245467] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-06T19:05:13.245582] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-06T19:05:13.257145] [DEBUG] [LOCAL ] GAB: Trimmed 39597 records to 27872 (keeping 200 days of data) [2025-10-06T19:05:13.258991] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T19:05:13.425986] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-06T19:05:13.434533] [DEBUG] [LOCAL ] GAB: Primary data saved (27872 records). [2025-10-06T19:05:13.434710] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-06T19:05:13.434814] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAB took 31.7s. Estimated remaining: 3h 27m 31s. Rate: 7.1 symbols/min [2025-10-06T19:05:13.604171] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:05:13.620182] [DEBUG] [LOCAL ] GBAB: Loaded 13203 existing records from primary storage. [2025-10-06T19:05:13.620425] [INFO ] [MAIN ] GBAB: Loaded 13203 existing records. [2025-10-06T19:05:13.799607] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:05:13.799878] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-06T19:05:13.799928] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-06T19:05:13.800482] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-06T19:05:13.800542] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-06T19:05:14.176345] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:05:14.225597] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-06T19:05:15.025574] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-06T19:05:15.281628] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-06T19:05:15.454450] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-06T19:05:15.825534] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-06T19:05:16.535715] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T19:05:16.625491] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-06T19:05:17.202942] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T19:05:17.425579] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-06T19:05:18.225623] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-06T19:05:18.342220] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-06T19:05:18.362872] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T19:05:19.025520] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-06T19:05:19.170320] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T19:05:19.825610] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-06T19:05:20.625514] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-06T19:05:20.794505] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T19:05:21.378618] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T19:05:21.425568] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-06T19:05:21.732034] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T19:05:22.225615] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-06T19:05:22.771798] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T19:05:22.774960] [INFO ] [REMOTE ] G: Full fetch complete (71653 records). [2025-10-06T19:05:22.775103] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-06T19:05:23.030857] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-06T19:05:23.161995] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-06T19:05:23.162089] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-06T19:05:23.163105] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-06T19:05:23.163171] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-06T19:05:23.164639] [DEBUG] [LOCAL ] G: Trimmed 71653 records to 49955 (keeping 200 days of data) [2025-10-06T19:05:23.487449] [DEBUG] [LOCAL ] G: Primary data saved (49955 records). [2025-10-06T19:05:23.487698] [INFO ] [MAIN ] G: Full history saved. [2025-10-06T19:05:23.488401] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. G took 49.5s. Estimated remaining: 3h 27m 25s. Rate: 7.1 symbols/min [2025-10-06T19:05:23.671604] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:05:23.723507] [DEBUG] [LOCAL ] GBCI: Loaded 40821 existing records from primary storage. [2025-10-06T19:05:23.723915] [INFO ] [MAIN ] GBCI: Loaded 40821 existing records. [2025-10-06T19:05:23.837702] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-06T19:05:23.909670] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:05:23.910569] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-06T19:05:23.910794] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-06T19:05:23.912166] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-06T19:05:23.912479] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-06T19:05:24.054634] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T19:05:24.141492] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T19:05:24.380637] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:05:24.625545] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-06T19:05:24.742291] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-06T19:05:25.425557] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-06T19:05:25.763508] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T19:05:26.225537] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-06T19:05:27.033772] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-06T19:05:27.047999] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-06T19:05:27.112123] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T19:05:27.825592] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-06T19:05:27.866701] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-06T19:05:28.625614] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-06T19:05:28.821984] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T19:05:29.425573] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-06T19:05:30.050595] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T19:05:30.225614] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-06T19:05:30.416102] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T19:05:31.025573] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-06T19:05:31.825506] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-06T19:05:32.128999] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T19:05:32.514726] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T19:05:32.608820] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T19:05:32.625479] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-06T19:05:33.425501] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-06T19:05:33.633792] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-06T19:05:34.225539] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-06T19:05:34.805489] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T19:05:35.025498] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-06T19:05:35.319795] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T19:05:35.825509] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-06T19:05:36.469944] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T19:05:36.625508] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-06T19:05:36.741991] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T19:05:36.743357] [INFO ] [REMOTE ] GATX: Full fetch complete (25176 records). [2025-10-06T19:05:36.743473] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-06T19:05:37.134084] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-06T19:05:37.134200] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-06T19:05:37.135473] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-06T19:05:37.135606] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-06T19:05:37.136802] [DEBUG] [LOCAL ] GATX: Trimmed 25176 records to 18134 (keeping 200 days of data) [2025-10-06T19:05:37.269637] [DEBUG] [LOCAL ] GATX: Primary data saved (18134 records). [2025-10-06T19:05:37.269925] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-06T19:05:37.270035] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GATX took 29.3s. Estimated remaining: 3h 27m 26s. Rate: 7.1 symbols/min [2025-10-06T19:05:37.430892] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-06T19:05:37.469818] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:05:37.470279] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-06T19:05:37.470370] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-06T19:05:37.470718] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-06T19:05:37.470870] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-06T19:05:37.470929] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-06T19:05:37.470965] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-06T19:05:37.597259] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T19:05:37.892015] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:05:38.225545] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-06T19:05:39.031702] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-06T19:05:39.037247] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T19:05:39.825535] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-06T19:05:39.933926] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-06T19:05:40.163663] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T19:05:40.625623] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-06T19:05:41.239864] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T19:05:41.425558] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-06T19:05:42.218139] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T19:05:42.221430] [INFO ] [REMOTE ] GAP: Full fetch complete (77633 records). [2025-10-06T19:05:42.221569] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-06T19:05:42.233833] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-06T19:05:42.635253] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-06T19:05:42.635424] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-06T19:05:42.636616] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-06T19:05:42.636746] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-06T19:05:42.638475] [DEBUG] [LOCAL ] GAP: Trimmed 77633 records to 53653 (keeping 200 days of data) [2025-10-06T19:05:42.769984] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T19:05:43.003606] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-06T19:05:43.003819] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-06T19:05:43.003915] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GAP took 44.5s. Estimated remaining: 3h 27m 13s. Rate: 7.1 symbols/min [2025-10-06T19:05:43.034535] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-06T19:05:43.186605] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:05:43.195742] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T19:05:43.237680] [DEBUG] [LOCAL ] GBTG: Loaded 40575 existing records from primary storage. [2025-10-06T19:05:43.238038] [INFO ] [MAIN ] GBTG: Loaded 40575 existing records. [2025-10-06T19:05:43.413366] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:05:43.413616] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-06T19:05:43.413703] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-06T19:05:43.414014] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-06T19:05:43.414071] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-06T19:05:43.770948] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:05:43.773598] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T19:05:43.825505] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-06T19:05:44.221594] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-06T19:05:44.625553] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-06T19:05:44.946596] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-06T19:05:45.425574] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-06T19:05:45.846879] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-06T19:05:46.225549] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-06T19:05:46.571627] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-06T19:05:47.025547] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-06T19:05:47.382464] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-06T19:05:47.825504] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-06T19:05:48.625573] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-06T19:05:49.183080] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T19:05:49.407422] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-06T19:05:49.425553] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-06T19:05:50.225556] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-06T19:05:50.457037] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-06T19:05:50.818000] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T19:05:51.025552] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-06T19:05:51.825574] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-06T19:05:52.073494] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-06T19:05:52.453414] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T19:05:52.625547] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-06T19:05:53.425668] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-06T19:05:54.125976] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T19:05:54.225577] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-06T19:05:54.297922] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T19:05:54.299302] [INFO ] [REMOTE ] GBAB: Full fetch complete (19592 records). [2025-10-06T19:05:54.299413] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-06T19:05:54.736368] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-06T19:05:54.736498] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-06T19:05:54.737298] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-06T19:05:54.737367] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-06T19:05:54.738274] [DEBUG] [LOCAL ] GBAB: Trimmed 19592 records to 12982 (keeping 200 days of data) [2025-10-06T19:05:54.828109] [DEBUG] [LOCAL ] GBAB: Primary data saved (12982 records). [2025-10-06T19:05:54.828312] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-06T19:05:54.828438] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GBAB took 41.4s. Estimated remaining: 3h 27m 10s. Rate: 7.1 symbols/min [2025-10-06T19:05:55.024460] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:05:55.025593] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-06T19:05:55.059340] [DEBUG] [LOCAL ] GBX: Loaded 29520 existing records from primary storage. [2025-10-06T19:05:55.059745] [INFO ] [MAIN ] GBX: Loaded 29520 existing records. [2025-10-06T19:05:55.256785] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:05:55.257115] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-06T19:05:55.257168] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-06T19:05:55.257577] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-06T19:05:55.257639] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-06T19:05:55.656917] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:05:55.658328] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T19:05:55.663234] [INFO ] [REMOTE ] GBCI: Full fetch complete (58512 records). [2025-10-06T19:05:55.663374] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-06T19:05:55.831346] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-06T19:05:56.113005] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-06T19:05:56.113128] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-06T19:05:56.114462] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-06T19:05:56.114533] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-06T19:05:56.116390] [DEBUG] [LOCAL ] GBCI: Trimmed 58512 records to 40436 (keeping 200 days of data) [2025-10-06T19:05:56.384196] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T19:05:56.407997] [DEBUG] [LOCAL ] GBCI: Primary data saved (40436 records). [2025-10-06T19:05:56.408178] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-06T19:05:56.408982] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBCI took 32.9s. Estimated remaining: 3h 26m 50s. Rate: 7.1 symbols/min [2025-10-06T19:05:56.540930] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T19:05:56.623865] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:05:56.625492] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-06T19:05:56.679228] [DEBUG] [LOCAL ] GCI: Loaded 44716 existing records from primary storage. [2025-10-06T19:05:56.679688] [INFO ] [MAIN ] GCI: Loaded 44716 existing records. [2025-10-06T19:05:56.868606] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:05:56.868977] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-06T19:05:56.869043] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-06T19:05:56.869411] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-06T19:05:56.869490] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-06T19:05:57.276783] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:05:57.425564] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-06T19:05:57.873991] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T19:05:58.225606] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-06T19:05:58.941754] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T19:05:59.025602] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-06T19:05:59.363932] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-06T19:05:59.618105] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T19:05:59.825547] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-06T19:06:00.625561] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-06T19:06:01.156984] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-06T19:06:01.425589] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-06T19:06:02.201137] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T19:06:02.225493] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-06T19:06:02.572152] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-06T19:06:02.572993] [INFO ] [REMOTE ] GBLI: Full fetch complete (1325 records). [2025-10-06T19:06:02.573068] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-06T19:06:02.796887] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-06T19:06:02.797213] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T19:06:02.797380] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T19:06:02.797511] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-06T19:06:02.797636] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-06T19:06:02.797810] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-06T19:06:02.797887] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-06T19:06:02.798027] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBLI took 25.5s. Estimated remaining: 3h 26m 39s. Rate: 7.1 symbols/min [2025-10-06T19:06:02.914214] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T19:06:03.016354] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:06:03.032230] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-06T19:06:03.046027] [DEBUG] [LOCAL ] GCO: Loaded 24918 existing records from primary storage. [2025-10-06T19:06:03.046423] [INFO ] [MAIN ] GCO: Loaded 24918 existing records. [2025-10-06T19:06:03.235918] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:06:03.236255] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-06T19:06:03.236308] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-06T19:06:03.236571] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-06T19:06:03.236632] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-06T19:06:03.606017] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:06:03.825558] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-06T19:06:04.552131] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T19:06:04.625606] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-06T19:06:05.246229] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T19:06:05.425590] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-06T19:06:05.742752] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T19:06:06.225573] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-06T19:06:06.892457] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T19:06:07.025538] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-06T19:06:07.383434] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T19:06:07.825565] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-06T19:06:08.364102] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T19:06:08.625584] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-06T19:06:08.778318] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T19:06:09.425607] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-06T19:06:09.904460] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T19:06:10.225567] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-06T19:06:10.895739] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-06T19:06:11.025596] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-06T19:06:11.810339] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T19:06:11.825478] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-06T19:06:12.414346] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T19:06:12.625537] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-06T19:06:13.061512] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T19:06:13.425579] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-06T19:06:14.115113] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T19:06:14.225590] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-06T19:06:14.506275] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-06T19:06:15.025506] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-06T19:06:15.809122] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T19:06:15.825488] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-06T19:06:16.252320] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T19:06:16.625574] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-06T19:06:17.425486] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-06T19:06:17.463934] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T19:06:17.550849] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T19:06:18.225512] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-06T19:06:18.966752] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T19:06:19.023553] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-06T19:06:19.028590] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-06T19:06:19.825556] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-06T19:06:20.541994] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T19:06:20.625523] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-06T19:06:20.763153] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-06T19:06:21.425577] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-06T19:06:22.225491] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-06T19:06:22.287842] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T19:06:22.466267] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T19:06:23.025531] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-06T19:06:23.379127] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T19:06:23.825535] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-06T19:06:24.625586] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-06T19:06:24.691875] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T19:06:25.075493] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T19:06:25.079187] [INFO ] [REMOTE ] GBTG: Full fetch complete (56593 records). [2025-10-06T19:06:25.079390] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-06T19:06:25.443217] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-06T19:06:25.504686] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-06T19:06:25.504922] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-06T19:06:25.506005] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-06T19:06:25.506107] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-06T19:06:25.524010] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T19:06:25.524173] [DEBUG] [LOCAL ] GBTG: Trimmed 56593 records to 40019 (keeping 200 days of data) [2025-10-06T19:06:25.761409] [DEBUG] [LOCAL ] GBTG: Primary data saved (40019 records). [2025-10-06T19:06:25.761574] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-06T19:06:25.761687] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBTG took 42.8s. Estimated remaining: 3h 26m 54s. Rate: 7.1 symbols/min [2025-10-06T19:06:25.932050] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:06:25.956472] [DEBUG] [LOCAL ] GCTS: Loaded 20197 existing records from primary storage. [2025-10-06T19:06:25.956796] [INFO ] [MAIN ] GCTS: Loaded 20197 existing records. [2025-10-06T19:06:26.136045] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:06:26.136319] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-06T19:06:26.136367] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-06T19:06:26.136569] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-06T19:06:26.136627] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-06T19:06:26.233817] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-06T19:06:26.559450] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:06:26.990675] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T19:06:27.025499] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-06T19:06:27.127691] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-06T19:06:27.825497] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-06T19:06:28.160934] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T19:06:28.625535] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-06T19:06:29.118070] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T19:06:29.121419] [INFO ] [REMOTE ] GCI: Full fetch complete (63243 records). [2025-10-06T19:06:29.121588] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-06T19:06:29.431946] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-06T19:06:29.537001] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-06T19:06:29.537184] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-06T19:06:29.538744] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-06T19:06:29.538894] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-06T19:06:29.540560] [DEBUG] [LOCAL ] GCI: Trimmed 63243 records to 44118 (keeping 200 days of data) [2025-10-06T19:06:29.663134] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T19:06:29.832533] [DEBUG] [LOCAL ] GCI: Primary data saved (44118 records). [2025-10-06T19:06:29.832750] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-06T19:06:29.832868] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GCI took 33.4s. Estimated remaining: 3h 26m 38s. Rate: 7.1 symbols/min [2025-10-06T19:06:30.027787] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:06:30.028093] [DEBUG] [LOCAL ] GCV: No existing data file found in primary storage. [2025-10-06T19:06:30.028133] [WARN ] [MAIN ] GCV: No existing data found, performing full refresh instead. [2025-10-06T19:06:30.028270] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-06T19:06:30.028315] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-06T19:06:30.028358] [DEBUG] [LOCAL ] GCV: No primary data file found to delete. [2025-10-06T19:06:30.028391] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-06T19:06:30.231627] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-06T19:06:30.412239] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:06:30.689563] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T19:06:31.025536] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-06T19:06:31.252025] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T19:06:31.253910] [INFO ] [REMOTE ] GCO: Full fetch complete (35323 records). [2025-10-06T19:06:31.254018] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-06T19:06:31.626458] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-06T19:06:31.626557] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-06T19:06:31.627357] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-06T19:06:31.627421] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-06T19:06:31.628584] [DEBUG] [LOCAL ] GCO: Trimmed 35323 records to 24281 (keeping 200 days of data) [2025-10-06T19:06:31.774508] [DEBUG] [LOCAL ] GCO: Primary data saved (24281 records). [2025-10-06T19:06:31.774699] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-06T19:06:31.774805] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCO took 29.0s. Estimated remaining: 3h 26m 19s. Rate: 7.1 symbols/min [2025-10-06T19:06:31.830673] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-06T19:06:31.952713] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:06:32.005876] [DEBUG] [LOCAL ] GD: Loaded 47780 existing records from primary storage. [2025-10-06T19:06:32.006242] [INFO ] [MAIN ] GD: Loaded 47780 existing records. [2025-10-06T19:06:32.184425] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:06:32.198432] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-06T19:06:32.198972] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-06T19:06:32.204064] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-06T19:06:32.204768] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-06T19:06:32.205121] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-06T19:06:32.556146] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:06:32.625510] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-06T19:06:32.920563] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-06T19:06:33.425543] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-06T19:06:33.799044] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T19:06:33.985128] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-06T19:06:34.225535] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-06T19:06:34.862985] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-06T19:06:35.025559] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-06T19:06:35.825541] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-06T19:06:36.625564] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-06T19:06:36.812885] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T19:06:36.916388] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T19:06:36.968384] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-06T19:06:37.425597] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-06T19:06:38.225605] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-06T19:06:38.625131] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T19:06:39.025576] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-06T19:06:39.613612] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-06T19:06:39.825547] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-06T19:06:40.048680] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T19:06:40.625612] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-06T19:06:41.258233] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T19:06:41.425553] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-06T19:06:41.686154] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T19:06:41.688901] [INFO ] [REMOTE ] GBX: Full fetch complete (42796 records). [2025-10-06T19:06:41.689028] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-06T19:06:42.066322] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-06T19:06:42.066414] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-06T19:06:42.067227] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-06T19:06:42.067304] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-06T19:06:42.068296] [DEBUG] [LOCAL ] GBX: Trimmed 42796 records to 29064 (keeping 200 days of data) [2025-10-06T19:06:42.233039] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-06T19:06:42.250299] [DEBUG] [LOCAL ] GBX: Primary data saved (29064 records). [2025-10-06T19:06:42.250408] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-06T19:06:42.250491] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GBX took 47.4s. Estimated remaining: 3h 26m 14s. Rate: 7.1 symbols/min [2025-10-06T19:06:42.433707] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:06:42.481245] [DEBUG] [LOCAL ] GDDY: Loaded 50457 existing records from primary storage. [2025-10-06T19:06:42.481613] [INFO ] [MAIN ] GDDY: Loaded 50457 existing records. [2025-10-06T19:06:42.660573] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:06:42.660837] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-06T19:06:42.660886] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-06T19:06:42.661208] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-06T19:06:42.661264] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-06T19:06:43.010256] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:06:43.025479] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-06T19:06:43.220901] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T19:06:43.266866] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T19:06:43.825572] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-06T19:06:44.421673] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T19:06:44.422766] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-06T19:06:44.625552] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-06T19:06:45.425589] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-06T19:06:46.225594] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-06T19:06:46.241840] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T19:06:46.498684] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T19:06:47.025539] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-06T19:06:47.662976] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-06T19:06:47.825533] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-06T19:06:47.922206] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T19:06:48.451953] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-06T19:06:48.625545] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-06T19:06:49.425571] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-06T19:06:50.225585] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-06T19:06:50.317185] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T19:06:51.025494] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-06T19:06:51.104554] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T19:06:51.239399] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-06T19:06:51.825551] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-06T19:06:52.542600] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T19:06:52.625490] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-06T19:06:52.986309] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-06T19:06:53.418388] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-06T19:06:53.425475] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-06T19:06:54.225545] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-06T19:06:54.953169] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-06T19:06:55.022104] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T19:06:55.031850] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-06T19:06:55.784505] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T19:06:55.825490] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-06T19:06:56.589752] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T19:06:56.590893] [INFO ] [REMOTE ] GCV: Full fetch complete (9516 records). [2025-10-06T19:06:56.590965] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-06T19:06:56.630799] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-06T19:06:56.951666] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-06T19:06:56.951768] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-06T19:06:56.952054] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-06T19:06:56.952094] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-06T19:06:56.952546] [DEBUG] [LOCAL ] GCV: Trimmed 9516 records to 7525 (keeping 200 days of data) [2025-10-06T19:06:56.996880] [DEBUG] [LOCAL ] GCV: Primary data saved (7525 records). [2025-10-06T19:06:56.997043] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-06T19:06:56.997124] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCV took 27.2s. Estimated remaining: 3h 26m 16s. Rate: 7.1 symbols/min [2025-10-06T19:06:57.164575] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:06:57.172599] [DEBUG] [LOCAL ] GDIV: Loaded 3667 existing records from primary storage. [2025-10-06T19:06:57.172811] [INFO ] [MAIN ] GDIV: Loaded 3667 existing records. [2025-10-06T19:06:57.356723] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:06:57.357044] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-06T19:06:57.357096] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-06T19:06:57.357390] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-06T19:06:57.357451] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-06T19:06:57.431154] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-06T19:06:57.685421] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T19:06:57.708732] [INFO ] [REMOTE ] GCTS: Full fetch complete (26937 records). [2025-10-06T19:06:57.737504] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-06T19:06:57.838620] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:06:58.146429] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-06T19:06:58.146517] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-06T19:06:58.147186] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-06T19:06:58.147247] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-06T19:06:58.148019] [DEBUG] [LOCAL ] GCTS: Trimmed 26937 records to 20127 (keeping 200 days of data) [2025-10-06T19:06:58.227302] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-06T19:06:58.264999] [DEBUG] [LOCAL ] GCTS: Primary data saved (20127 records). [2025-10-06T19:06:58.265161] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-06T19:06:58.265246] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GCTS took 32.5s. Estimated remaining: 3h 25m 56s. Rate: 7.1 symbols/min [2025-10-06T19:06:58.440965] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:06:58.446412] [DEBUG] [LOCAL ] GDL: Loaded 2587 existing records from primary storage. [2025-10-06T19:06:58.446616] [INFO ] [MAIN ] GDL: Loaded 2587 existing records. [2025-10-06T19:06:58.621566] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:06:58.621838] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-06T19:06:58.621888] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-06T19:06:58.622093] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-06T19:06:58.622163] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-06T19:06:58.973585] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:06:59.025482] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-06T19:06:59.242166] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T19:06:59.484774] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-06T19:06:59.825495] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-06T19:06:59.881925] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T19:07:00.625529] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-06T19:07:01.425500] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-06T19:07:01.605700] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-06T19:07:02.157029] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T19:07:02.202563] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T19:07:02.225483] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-06T19:07:03.025537] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-06T19:07:03.437969] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-06T19:07:03.812791] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T19:07:03.825461] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-06T19:07:04.625582] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-06T19:07:05.063271] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-06T19:07:05.425525] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-06T19:07:05.697632] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-06T19:07:05.970260] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-06T19:07:06.225539] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-06T19:07:06.714099] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-06T19:07:07.025547] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-06T19:07:07.825552] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-06T19:07:08.626102] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-06T19:07:08.632896] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T19:07:08.690407] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T19:07:09.088681] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-06T19:07:09.425560] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-06T19:07:10.036912] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T19:07:10.225540] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-06T19:07:11.025595] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-06T19:07:11.825512] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-06T19:07:12.149721] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-06T19:07:12.253875] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-06T19:07:12.567685] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T19:07:12.570793] [INFO ] [REMOTE ] GDDY: Full fetch complete (71680 records). [2025-10-06T19:07:12.570894] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-06T19:07:12.632229] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-06T19:07:12.967211] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-06T19:07:12.967370] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-06T19:07:12.968977] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-06T19:07:12.969043] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-06T19:07:12.970919] [DEBUG] [LOCAL ] GDDY: Trimmed 71680 records to 49828 (keeping 200 days of data) [2025-10-06T19:07:13.294932] [DEBUG] [LOCAL ] GDDY: Primary data saved (49828 records). [2025-10-06T19:07:13.295104] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-06T19:07:13.295234] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GDDY took 31.0s. Estimated remaining: 3h 25m 58s. Rate: 7.1 symbols/min [2025-10-06T19:07:13.435039] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-06T19:07:13.474388] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:07:13.485860] [DEBUG] [LOCAL ] GDO: Loaded 6068 existing records from primary storage. [2025-10-06T19:07:13.486144] [INFO ] [MAIN ] GDO: Loaded 6068 existing records. [2025-10-06T19:07:13.769664] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:07:13.770005] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-06T19:07:13.770064] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-06T19:07:13.770390] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-06T19:07:13.770474] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-06T19:07:14.067607] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-06T19:07:14.228345] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-06T19:07:14.309711] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:07:14.410214] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T19:07:14.762887] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-06T19:07:15.025545] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-06T19:07:15.832725] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-06T19:07:15.833817] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T19:07:16.480798] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-06T19:07:16.625582] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-06T19:07:17.425596] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-06T19:07:18.099560] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-06T19:07:18.225510] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-06T19:07:18.323914] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T19:07:18.691894] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T19:07:18.692710] [INFO ] [REMOTE ] GDL: Full fetch complete (3632 records). [2025-10-06T19:07:18.692780] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-06T19:07:19.044306] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-06T19:07:19.044497] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-06T19:07:19.044697] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-06T19:07:19.037458] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-06T19:07:19.044829] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-06T19:07:19.046209] [DEBUG] [LOCAL ] GDL: Trimmed 3632 records to 2554 (keeping 200 days of data) [2025-10-06T19:07:19.061881] [DEBUG] [LOCAL ] GDL: Primary data saved (2554 records). [2025-10-06T19:07:19.061949] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-06T19:07:19.062021] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GDL took 20.8s. Estimated remaining: 3h 25m 46s. Rate: 7.1 symbols/min [2025-10-06T19:07:19.229087] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:07:19.269228] [DEBUG] [LOCAL ] GDOT: Loaded 38866 existing records from primary storage. [2025-10-06T19:07:19.269537] [INFO ] [MAIN ] GDOT: Loaded 38866 existing records. [2025-10-06T19:07:19.444230] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:07:19.444431] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-06T19:07:19.444478] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-06T19:07:19.444795] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-06T19:07:19.444865] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-06T19:07:19.551556] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-06T19:07:19.805928] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:07:19.825467] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-06T19:07:20.625568] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-06T19:07:21.105156] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T19:07:21.219454] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-06T19:07:21.425520] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-06T19:07:22.005970] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T19:07:22.225530] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-06T19:07:22.843345] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T19:07:23.025538] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-06T19:07:23.825553] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-06T19:07:24.255563] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T19:07:24.427580] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T19:07:24.625492] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-06T19:07:25.425547] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-06T19:07:25.471131] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T19:07:26.122876] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T19:07:26.225502] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-06T19:07:26.820270] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-06T19:07:27.025561] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-06T19:07:27.586639] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-06T19:07:27.825539] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-06T19:07:28.392169] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-06T19:07:28.625555] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-06T19:07:29.425597] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-06T19:07:29.898303] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-06T19:07:30.054492] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T19:07:30.057392] [INFO ] [REMOTE ] GD: Full fetch complete (70149 records). [2025-10-06T19:07:30.057518] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-06T19:07:30.228806] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-06T19:07:30.445582] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-06T19:07:30.445717] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-06T19:07:30.446789] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-06T19:07:30.446857] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-06T19:07:30.449315] [DEBUG] [LOCAL ] GD: Trimmed 70149 records to 47000 (keeping 200 days of data) [2025-10-06T19:07:30.747887] [DEBUG] [LOCAL ] GD: Primary data saved (47000 records). [2025-10-06T19:07:30.748052] [INFO ] [MAIN ] GD: Full history saved. [2025-10-06T19:07:30.748143] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GD took 59.0s. Estimated remaining: 3h 25m 43s. Rate: 7.1 symbols/min [2025-10-06T19:07:30.855137] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-06T19:07:30.926518] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:07:30.950373] [DEBUG] [LOCAL ] GDV: Loaded 19748 existing records from primary storage. [2025-10-06T19:07:30.950695] [INFO ] [MAIN ] GDV: Loaded 19748 existing records. [2025-10-06T19:07:31.030744] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-06T19:07:31.145205] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:07:31.145489] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-06T19:07:31.145541] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-06T19:07:31.145794] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-06T19:07:31.145858] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-06T19:07:31.532247] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:07:31.732390] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-06T19:07:31.825538] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-06T19:07:32.625609] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-06T19:07:32.695123] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T19:07:33.425544] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-06T19:07:34.134562] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T19:07:34.225561] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-06T19:07:34.456310] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T19:07:34.819170] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T19:07:35.025568] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-06T19:07:35.825563] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-06T19:07:36.306464] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-06T19:07:36.529530] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-06T19:07:36.625613] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-06T19:07:37.425495] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-06T19:07:37.590086] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-06T19:07:37.912527] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-06T19:07:37.913422] [INFO ] [REMOTE ] GDIV: Full fetch complete (5473 records). [2025-10-06T19:07:37.913494] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-06T19:07:38.230739] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-06T19:07:38.302687] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-06T19:07:38.302816] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-06T19:07:38.303083] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-06T19:07:38.303150] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-06T19:07:38.303803] [DEBUG] [LOCAL ] GDIV: Trimmed 5473 records to 3609 (keeping 200 days of data) [2025-10-06T19:07:38.330119] [DEBUG] [LOCAL ] GDIV: Primary data saved (3609 records). [2025-10-06T19:07:38.330295] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-06T19:07:38.330406] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDIV took 41.3s. Estimated remaining: 3h 25m 33s. Rate: 7.1 symbols/min [2025-10-06T19:07:38.521278] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:07:38.585376] [DEBUG] [LOCAL ] GE: Loaded 54493 existing records from primary storage. [2025-10-06T19:07:38.585900] [INFO ] [MAIN ] GE: Loaded 54493 existing records. [2025-10-06T19:07:38.775591] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:07:38.775929] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-06T19:07:38.775986] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-06T19:07:38.776496] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-06T19:07:38.776556] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-06T19:07:39.031223] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-06T19:07:39.062746] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-06T19:07:39.167256] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:07:39.825520] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-06T19:07:40.148995] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T19:07:40.411808] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T19:07:40.412879] [INFO ] [REMOTE ] GDO: Full fetch complete (9012 records). [2025-10-06T19:07:40.412957] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-06T19:07:40.635811] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-06T19:07:40.807021] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-06T19:07:40.807129] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-06T19:07:40.807522] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-06T19:07:40.807597] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-06T19:07:40.808128] [DEBUG] [LOCAL ] GDO: Trimmed 9012 records to 5937 (keeping 200 days of data) [2025-10-06T19:07:40.847094] [DEBUG] [LOCAL ] GDO: Primary data saved (5937 records). [2025-10-06T19:07:40.847249] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-06T19:07:40.847375] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDO took 27.6s. Estimated remaining: 3h 25m 15s. Rate: 7.1 symbols/min [2025-10-06T19:07:41.043738] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:07:41.069846] [DEBUG] [LOCAL ] GEF: Loaded 20967 existing records from primary storage. [2025-10-06T19:07:41.070187] [INFO ] [MAIN ] GEF: Loaded 20967 existing records. [2025-10-06T19:07:41.277490] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:07:41.277824] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-06T19:07:41.277875] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-06T19:07:41.278166] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-06T19:07:41.278233] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-06T19:07:41.431165] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-06T19:07:41.669789] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:07:42.225584] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-06T19:07:42.894636] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-06T19:07:43.025730] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-06T19:07:43.066250] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T19:07:43.090426] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T19:07:43.825540] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-06T19:07:44.625607] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-06T19:07:44.969022] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T19:07:45.325046] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-06T19:07:45.368243] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T19:07:45.425510] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-06T19:07:46.225502] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-06T19:07:46.460754] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T19:07:47.025568] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-06T19:07:47.825553] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-06T19:07:48.133070] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T19:07:48.367215] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T19:07:48.625559] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-06T19:07:48.960082] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T19:07:49.425544] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-06T19:07:49.849239] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T19:07:50.225544] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-06T19:07:51.025509] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-06T19:07:51.230344] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-06T19:07:51.547455] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-06T19:07:51.825578] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-06T19:07:52.525412] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T19:07:52.625636] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-06T19:07:52.799055] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-06T19:07:53.425536] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-06T19:07:53.870155] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T19:07:54.225551] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-06T19:07:54.420932] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T19:07:55.025535] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-06T19:07:55.819275] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T19:07:55.828475] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-06T19:07:56.625613] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-06T19:07:56.842638] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-06T19:07:57.400320] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-06T19:07:57.425493] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-06T19:07:58.090956] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T19:07:58.093621] [INFO ] [REMOTE ] GDOT: Full fetch complete (53204 records). [2025-10-06T19:07:58.093753] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-06T19:07:58.240500] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-06T19:07:58.499359] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-06T19:07:58.499467] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-06T19:07:58.500851] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-06T19:07:58.500944] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-06T19:07:58.502895] [DEBUG] [LOCAL ] GDOT: Trimmed 53204 records to 38015 (keeping 200 days of data) [2025-10-06T19:07:58.735487] [DEBUG] [LOCAL ] GDOT: Primary data saved (38015 records). [2025-10-06T19:07:58.735711] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-06T19:07:58.735820] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDOT took 39.7s. Estimated remaining: 3h 25m 22s. Rate: 7.1 symbols/min [2025-10-06T19:07:58.939877] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:07:58.979964] [DEBUG] [LOCAL ] GEL: Loaded 33461 existing records from primary storage. [2025-10-06T19:07:58.980338] [INFO ] [MAIN ] GEL: Loaded 33461 existing records. [2025-10-06T19:07:59.031150] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-06T19:07:59.198980] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:07:59.199529] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-06T19:07:59.199745] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-06T19:07:59.200071] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-06T19:07:59.200130] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-06T19:07:59.607749] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T19:07:59.649984] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:07:59.673353] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T19:07:59.679073] [INFO ] [REMOTE ] GDV: Full fetch complete (28573 records). [2025-10-06T19:07:59.678953] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-06T19:07:59.690097] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-06T19:07:59.834497] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-06T19:08:00.089732] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-06T19:08:00.089919] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-06T19:08:00.091397] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-06T19:08:00.091470] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-06T19:08:00.092620] [DEBUG] [LOCAL ] GDV: Trimmed 28573 records to 19450 (keeping 200 days of data) [2025-10-06T19:08:00.229825] [DEBUG] [LOCAL ] GDV: Primary data saved (19450 records). [2025-10-06T19:08:00.230053] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-06T19:08:00.230171] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GDV took 29.5s. Estimated remaining: 3h 25m 2s. Rate: 7.1 symbols/min [2025-10-06T19:08:00.415512] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:08:00.481411] [DEBUG] [LOCAL ] GENI: Loaded 53710 existing records from primary storage. [2025-10-06T19:08:00.481911] [INFO ] [MAIN ] GENI: Loaded 53710 existing records. [2025-10-06T19:08:00.630002] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-06T19:08:00.677315] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:08:00.677883] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-06T19:08:00.677974] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-06T19:08:00.678338] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-06T19:08:00.678411] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-06T19:08:00.896739] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T19:08:01.083219] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:08:01.425549] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-06T19:08:01.912696] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T19:08:02.225533] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-06T19:08:03.025513] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-06T19:08:03.133863] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T19:08:03.429761] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T19:08:03.825507] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-06T19:08:04.625488] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-06T19:08:04.868774] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T19:08:05.041398] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-06T19:08:05.425602] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-06T19:08:05.655834] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T19:08:06.225596] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-06T19:08:06.447076] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T19:08:07.025617] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-06T19:08:07.522539] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T19:08:07.825541] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-06T19:08:07.933008] [DEBUG] [REMOTE ] GEL: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-06T19:08:07.933352] [WARN ] [REMOTE ] GEL: No data returned for month 2025-03 [2025-10-06T19:08:07.933443] [FATAL] [REMOTE ] GEL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:08:07.933633] [FATAL] [MAIN ] GEL: Failed to fetch primary data. [2025-10-06T19:08:07.933715] [WARN ] [MAIN ] GEL: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:08:07.933786] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-06T19:08:07.933850] [DEBUG] [LOCAL ] GEL: No primary data file found to delete. [2025-10-06T19:08:07.933883] [INFO ] [LOCAL ] GEL: Starting deletion of derivative data. [2025-10-06T19:08:07.934242] [DEBUG] [LOCAL ] GEL: Deleted derivative data file. [2025-10-06T19:08:07.934330] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GEL took 9.2s. Estimated remaining: 3h 24m 52s. Rate: 7.1 symbols/min [2025-10-06T19:08:08.099972] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:08:08.150706] [DEBUG] [LOCAL ] GEO: Loaded 52673 existing records from primary storage. [2025-10-06T19:08:08.151072] [INFO ] [MAIN ] GEO: Loaded 52673 existing records. [2025-10-06T19:08:08.326519] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:08:08.326820] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-06T19:08:08.326871] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-06T19:08:08.327220] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-06T19:08:08.327277] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-06T19:08:08.630779] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-06T19:08:08.691245] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:08:08.909999] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T19:08:09.425622] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-06T19:08:09.857567] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-06T19:08:10.225545] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-06T19:08:11.025579] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-06T19:08:11.258154] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T19:08:11.260249] [INFO ] [REMOTE ] GEF: Full fetch complete (29508 records). [2025-10-06T19:08:11.260497] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-06T19:08:11.650317] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-06T19:08:11.650442] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-06T19:08:11.651328] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-06T19:08:11.651409] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-06T19:08:11.652317] [DEBUG] [LOCAL ] GEF: Trimmed 29508 records to 20723 (keeping 200 days of data) [2025-10-06T19:08:11.788429] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-06T19:08:11.826118] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-06T19:08:11.829578] [DEBUG] [LOCAL ] GEF: Primary data saved (20723 records). [2025-10-06T19:08:11.829779] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-06T19:08:11.829873] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GEF took 31.0s. Estimated remaining: 3h 24m 37s. Rate: 7.1 symbols/min [2025-10-06T19:08:12.000400] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:08:12.039554] [DEBUG] [LOCAL ] GES: Loaded 39908 existing records from primary storage. [2025-10-06T19:08:12.039923] [INFO ] [MAIN ] GES: Loaded 39908 existing records. [2025-10-06T19:08:12.217316] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:08:12.217735] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-06T19:08:12.217871] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-06T19:08:12.218296] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-06T19:08:12.218433] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-06T19:08:12.506984] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T19:08:12.633220] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-06T19:08:12.633099] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:08:13.425552] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-06T19:08:14.123508] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-06T19:08:14.225474] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-06T19:08:14.388259] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T19:08:15.025574] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-06T19:08:15.056452] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T19:08:15.825593] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-06T19:08:16.362309] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-06T19:08:16.625563] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-06T19:08:16.822967] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T19:08:17.425577] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-06T19:08:17.484215] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T19:08:18.225555] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-06T19:08:18.629901] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-06T19:08:18.633989] [INFO ] [REMOTE ] GE: Full fetch complete (77777 records). [2025-10-06T19:08:18.634176] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-06T19:08:19.037267] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-06T19:08:19.100984] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-06T19:08:19.101095] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-06T19:08:19.102311] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-06T19:08:19.102384] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-06T19:08:19.104143] [DEBUG] [LOCAL ] GE: Trimmed 77777 records to 53712 (keeping 200 days of data) [2025-10-06T19:08:19.517250] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-06T19:08:19.559014] [DEBUG] [LOCAL ] GE: Primary data saved (53712 records). [2025-10-06T19:08:19.559252] [INFO ] [MAIN ] GE: Full history saved. [2025-10-06T19:08:19.560120] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GE took 41.2s. Estimated remaining: 3h 24m 27s. Rate: 7.1 symbols/min [2025-10-06T19:08:19.765800] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:08:19.803470] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T19:08:19.825577] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-06T19:08:19.854704] [DEBUG] [LOCAL ] GETY: Loaded 36087 existing records from primary storage. [2025-10-06T19:08:19.855038] [INFO ] [MAIN ] GETY: Loaded 36087 existing records. [2025-10-06T19:08:20.037808] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:08:20.038093] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-06T19:08:20.038141] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-06T19:08:20.038404] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-06T19:08:20.038479] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-06T19:08:20.412549] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:08:20.625618] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-06T19:08:20.706514] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T19:08:21.425611] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-06T19:08:21.638750] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T19:08:22.037397] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-06T19:08:22.225538] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-06T19:08:22.521829] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T19:08:23.025568] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-06T19:08:23.825576] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-06T19:08:24.121729] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-06T19:08:24.625558] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-06T19:08:24.770582] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T19:08:25.260337] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-06T19:08:25.425515] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-06T19:08:25.941229] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T19:08:26.225558] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-06T19:08:27.025498] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-06T19:08:27.156448] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T19:08:27.821134] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T19:08:27.829827] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-06T19:08:28.625507] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-06T19:08:28.723225] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T19:08:29.425504] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-06T19:08:29.745348] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-06T19:08:30.081123] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T19:08:30.225515] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-06T19:08:31.025579] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-06T19:08:31.155137] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T19:08:31.588619] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T19:08:31.825514] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-06T19:08:32.625511] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-06T19:08:32.844622] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T19:08:33.337770] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T19:08:33.425565] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-06T19:08:34.044035] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T19:08:34.225833] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-06T19:08:35.025507] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-06T19:08:35.206185] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T19:08:35.638713] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T19:08:35.825521] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-06T19:08:36.460784] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T19:08:36.625595] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-06T19:08:37.180792] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T19:08:37.425608] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-06T19:08:38.062805] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T19:08:38.225559] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-06T19:08:38.846927] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T19:08:39.025548] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-06T19:08:39.819987] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T19:08:39.828698] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-06T19:08:40.625489] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-06T19:08:40.735179] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T19:08:41.425512] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-06T19:08:41.549100] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-06T19:08:41.553127] [INFO ] [REMOTE ] GENI: Full fetch complete (75542 records). [2025-10-06T19:08:41.553290] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-06T19:08:42.054476] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-06T19:08:42.062460] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-06T19:08:42.074962] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-06T19:08:42.075056] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-06T19:08:42.077020] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T19:08:42.085475] [DEBUG] [LOCAL ] GENI: Trimmed 75542 records to 52944 (keeping 200 days of data) [2025-10-06T19:08:42.251216] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-06T19:08:42.404097] [DEBUG] [LOCAL ] GENI: Primary data saved (52944 records). [2025-10-06T19:08:42.404267] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-06T19:08:42.405126] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GENI took 42.2s. Estimated remaining: 3h 24m 42s. Rate: 7.1 symbols/min [2025-10-06T19:08:42.616864] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:08:42.686609] [DEBUG] [LOCAL ] GEV: Loaded 53810 existing records from primary storage. [2025-10-06T19:08:42.687060] [INFO ] [MAIN ] GEV: Loaded 53810 existing records. [2025-10-06T19:08:42.878020] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T19:08:42.898733] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:08:42.899447] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-06T19:08:42.899498] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-06T19:08:42.899902] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-06T19:08:42.899962] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-06T19:08:43.039926] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-06T19:08:43.258677] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:08:43.714256] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T19:08:43.825512] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-06T19:08:44.409515] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T19:08:44.413125] [INFO ] [REMOTE ] GES: Full fetch complete (59281 records). [2025-10-06T19:08:44.413317] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-06T19:08:44.630821] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-06T19:08:44.841369] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-06T19:08:44.841473] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-06T19:08:44.842464] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-06T19:08:44.842529] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-06T19:08:44.843926] [DEBUG] [LOCAL ] GES: Trimmed 59281 records to 38989 (keeping 200 days of data) [2025-10-06T19:08:45.091497] [DEBUG] [LOCAL ] GES: Primary data saved (38989 records). [2025-10-06T19:08:45.091769] [INFO ] [MAIN ] GES: Full history saved. [2025-10-06T19:08:45.091899] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GES took 33.3s. Estimated remaining: 3h 24m 24s. Rate: 7.1 symbols/min [2025-10-06T19:08:45.261854] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:08:45.267715] [DEBUG] [LOCAL ] GF: Loaded 2996 existing records from primary storage. [2025-10-06T19:08:45.267891] [INFO ] [MAIN ] GF: Loaded 2996 existing records. [2025-10-06T19:08:45.436978] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-06T19:08:45.442197] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:08:45.442963] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-06T19:08:45.443814] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-06T19:08:45.444051] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-06T19:08:45.444108] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-06T19:08:45.797085] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:08:46.110168] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-06T19:08:46.225498] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-06T19:08:46.585965] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T19:08:46.761058] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T19:08:46.763385] [INFO ] [REMOTE ] GETY: Full fetch complete (55528 records). [2025-10-06T19:08:46.763488] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-06T19:08:47.034616] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-06T19:08:47.165339] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-06T19:08:47.165467] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-06T19:08:47.166524] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-06T19:08:47.166588] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-06T19:08:47.168250] [DEBUG] [LOCAL ] GETY: Trimmed 55528 records to 35319 (keeping 200 days of data) [2025-10-06T19:08:47.374529] [DEBUG] [LOCAL ] GETY: Primary data saved (35319 records). [2025-10-06T19:08:47.374756] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-06T19:08:47.374856] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GETY took 27.8s. Estimated remaining: 3h 24m 6s. Rate: 7.1 symbols/min [2025-10-06T19:08:47.825585] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-06T19:08:48.423245] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-06T19:08:48.578058] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-06T19:08:48.625481] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-06T19:08:48.890548] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-06T19:08:49.425596] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-06T19:08:50.209312] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T19:08:50.225470] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-06T19:08:50.808467] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-06T19:08:50.824561] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T19:08:51.025554] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-06T19:08:51.825591] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-06T19:08:52.564213] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T19:08:52.625535] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-06T19:08:53.226709] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-06T19:08:53.242343] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-06T19:08:53.425551] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-06T19:08:54.029882] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T19:08:54.225530] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-06T19:08:55.025557] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-06T19:08:55.501084] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-06T19:08:55.718381] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T19:08:55.721352] [INFO ] [REMOTE ] GEO: Full fetch complete (75460 records). [2025-10-06T19:08:55.721472] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-06T19:08:55.830745] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-06T19:08:56.123395] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-06T19:08:56.123491] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-06T19:08:56.124487] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-06T19:08:56.124550] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-06T19:08:56.126044] [DEBUG] [LOCAL ] GEO: Trimmed 75460 records to 51904 (keeping 200 days of data) [2025-10-06T19:08:56.453007] [DEBUG] [LOCAL ] GEO: Primary data saved (51904 records). [2025-10-06T19:08:56.453210] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-06T19:08:56.453338] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GEO took 48.5s. Estimated remaining: 3h 23m 59s. Rate: 7.1 symbols/min [2025-10-06T19:08:56.625560] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-06T19:08:57.070574] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-06T19:08:57.425588] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-06T19:08:58.371423] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T19:08:58.374184] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-06T19:08:58.378177] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-06T19:08:58.890721] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-06T19:08:59.025703] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-06T19:08:59.825541] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-06T19:09:00.208729] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T19:09:00.209564] [INFO ] [REMOTE ] GF: Full fetch complete (5118 records). [2025-10-06T19:09:00.209678] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-06T19:09:00.582910] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-06T19:09:00.583011] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-06T19:09:00.583231] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-06T19:09:00.583270] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-06T19:09:00.583639] [DEBUG] [LOCAL ] GF: Trimmed 5118 records to 2827 (keeping 200 days of data) [2025-10-06T19:09:00.600777] [DEBUG] [LOCAL ] GF: Primary data saved (2827 records). [2025-10-06T19:09:00.600854] [INFO ] [MAIN ] GF: Full history saved. [2025-10-06T19:09:00.600934] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GF took 15.5s. Estimated remaining: 3h 23m 43s. Rate: 7.1 symbols/min [2025-10-06T19:09:01.503617] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-06T19:09:01.516559] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-06T19:09:03.798937] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-06T19:09:03.810031] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-06T19:09:06.396682] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-06T19:09:06.408902] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-06T19:09:08.498535] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-06T19:09:08.510017] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-06T19:09:11.032790] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-06T19:09:11.045444] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-06T19:09:13.308229] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-06T19:09:13.311369] [INFO ] [REMOTE ] GEV: Full fetch complete (76914 records). [2025-10-06T19:09:13.311509] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-06T19:09:13.714465] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-06T19:09:13.714562] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-06T19:09:13.715808] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-06T19:09:13.715898] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-06T19:09:13.717534] [DEBUG] [LOCAL ] GEV: Trimmed 76914 records to 53024 (keeping 200 days of data) [2025-10-06T19:09:14.065586] [DEBUG] [LOCAL ] GEV: Primary data saved (53024 records). [2025-10-06T19:09:14.065791] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-06T19:09:14.066939] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 31.7s. Estimated remaining: 3h 23m 43s. Rate: 7.1 symbols/min [2025-10-06T19:09:14.711853] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:09:14.755059] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:09:14.800447] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:09:14.799430] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:09:14.819343] [DEBUG] [LOCAL ] GFR: Loaded 8439 existing records from primary storage. [2025-10-06T19:09:14.819824] [INFO ] [MAIN ] GFR: Loaded 8439 existing records. [2025-10-06T19:09:15.014436] [DEBUG] [LOCAL ] GFF: Loaded 30788 existing records from primary storage. [2025-10-06T19:09:15.036532] [INFO ] [MAIN ] GFF: Loaded 30788 existing records. [2025-10-06T19:09:15.088227] [DEBUG] [LOCAL ] GFI: Loaded 53875 existing records from primary storage. [2025-10-06T19:09:15.140318] [INFO ] [MAIN ] GFI: Loaded 53875 existing records. [2025-10-06T19:09:15.189425] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:09:15.214857] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-06T19:09:15.215044] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-06T19:09:15.256116] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-06T19:09:15.226054] [DEBUG] [LOCAL ] GFL: Loaded 48679 existing records from primary storage. [2025-10-06T19:09:15.261561] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-06T19:09:15.298863] [INFO ] [MAIN ] GFL: Loaded 48679 existing records. [2025-10-06T19:09:15.551080] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:09:15.597106] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-06T19:09:15.682772] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-06T19:09:15.716032] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-06T19:09:15.832747] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:09:15.835781] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:09:15.826706] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-06T19:09:15.882310] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-06T19:09:15.870146] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-06T19:09:15.911800] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-06T19:09:15.906552] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-06T19:09:15.979032] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-06T19:09:16.008243] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-06T19:09:15.994300] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-06T19:09:16.064435] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-06T19:09:16.448520] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:09:16.518509] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-06T19:09:16.931082] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:09:16.971604] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-06T19:09:17.144727] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:09:17.187349] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-06T19:09:17.231801] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:09:17.232393] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-06T19:09:17.386410] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T19:09:17.390072] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-06T19:09:17.827698] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-06T19:09:17.830292] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-06T19:09:18.436552] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-06T19:09:18.445634] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-06T19:09:18.525873] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T19:09:18.532261] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-06T19:09:18.624303] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-06T19:09:18.626400] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T19:09:18.640908] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-06T19:09:18.641551] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-06T19:09:19.399820] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T19:09:19.403043] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-06T19:09:19.618210] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T19:09:19.625635] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-06T19:09:19.770115] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T19:09:19.780516] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-06T19:09:20.153701] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T19:09:20.157154] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-06T19:09:20.338606] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T19:09:20.350391] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-06T19:09:20.848778] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T19:09:20.855181] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-06T19:09:20.993456] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-06T19:09:20.996964] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-06T19:09:21.082462] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T19:09:21.091993] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-06T19:09:21.687264] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T19:09:21.689484] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-06T19:09:21.874136] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T19:09:21.884803] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-06T19:09:22.230261] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T19:09:22.237712] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-06T19:09:22.283555] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T19:09:22.285752] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-06T19:09:22.674801] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T19:09:22.687036] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-06T19:09:22.835126] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T19:09:23.025603] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-06T19:09:23.580174] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T19:09:23.721504] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T19:09:23.748216] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T19:09:23.825480] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-06T19:09:24.158674] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T19:09:24.596832] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T19:09:24.597938] [INFO ] [REMOTE ] GFR: Full fetch complete (12466 records). [2025-10-06T19:09:24.598023] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-06T19:09:24.630777] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-06T19:09:24.961133] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-06T19:09:24.961223] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-06T19:09:24.961523] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-06T19:09:24.961562] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-06T19:09:24.962065] [DEBUG] [LOCAL ] GFR: Trimmed 12466 records to 8022 (keeping 200 days of data) [2025-10-06T19:09:25.005813] [DEBUG] [LOCAL ] GFR: Primary data saved (8022 records). [2025-10-06T19:09:25.005980] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-06T19:09:25.006121] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 10.9s. Estimated remaining: 3h 23m 39s. Rate: 7.1 symbols/min [2025-10-06T19:09:25.176969] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:09:25.231313] [DEBUG] [LOCAL ] GGB: Loaded 51859 existing records from primary storage. [2025-10-06T19:09:25.231793] [INFO ] [MAIN ] GGB: Loaded 51859 existing records. [2025-10-06T19:09:25.406635] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:09:25.406913] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-06T19:09:25.406972] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-06T19:09:25.407203] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-06T19:09:25.407259] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-06T19:09:25.439276] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-06T19:09:25.764555] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:09:26.225601] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-06T19:09:26.760982] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-06T19:09:27.024369] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T19:09:27.034343] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-06T19:09:27.417355] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T19:09:27.825508] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-06T19:09:28.625548] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-06T19:09:28.709354] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T19:09:28.768896] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T19:09:29.425598] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-06T19:09:30.096272] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-06T19:09:30.225612] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-06T19:09:31.025707] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-06T19:09:31.555293] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-06T19:09:31.636438] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T19:09:31.825479] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-06T19:09:32.152059] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T19:09:32.625619] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-06T19:09:33.336589] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T19:09:33.425580] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-06T19:09:34.225565] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-06T19:09:34.543540] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-06T19:09:34.690915] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T19:09:35.025598] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-06T19:09:35.495833] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T19:09:35.825565] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-06T19:09:36.625562] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-06T19:09:37.117278] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-06T19:09:37.430674] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-06T19:09:37.446208] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T19:09:38.225550] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-06T19:09:38.383538] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T19:09:38.864865] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T19:09:39.025583] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-06T19:09:39.825544] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-06T19:09:40.062263] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T19:09:40.181616] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-06T19:09:40.625525] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-06T19:09:41.113884] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-06T19:09:41.425586] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-06T19:09:42.225607] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-06T19:09:42.454661] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T19:09:42.822688] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T19:09:42.825703] [INFO ] [REMOTE ] GFL: Full fetch complete (69257 records). [2025-10-06T19:09:42.825821] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-06T19:09:43.031452] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-06T19:09:43.212747] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-06T19:09:43.212859] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-06T19:09:43.213878] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-06T19:09:43.213943] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-06T19:09:43.215462] [DEBUG] [LOCAL ] GFL: Trimmed 69257 records to 47867 (keeping 200 days of data) [2025-10-06T19:09:43.503920] [DEBUG] [LOCAL ] GFL: Primary data saved (47867 records). [2025-10-06T19:09:43.504094] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-06T19:09:43.504211] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFL took 29.4s. Estimated remaining: 3h 23m 46s. Rate: 7.1 symbols/min [2025-10-06T19:09:43.669539] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:09:43.712992] [DEBUG] [LOCAL ] GGG: Loaded 41546 existing records from primary storage. [2025-10-06T19:09:43.713336] [INFO ] [MAIN ] GGG: Loaded 41546 existing records. [2025-10-06T19:09:43.830667] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-06T19:09:43.895502] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:09:43.895944] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-06T19:09:43.896012] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-06T19:09:43.896443] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-06T19:09:43.896507] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-06T19:09:44.255161] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:09:44.264065] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T19:09:44.300995] [INFO ] [REMOTE ] GFF: Full fetch complete (44219 records). [2025-10-06T19:09:44.301785] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-06T19:09:44.307158] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-06T19:09:44.630736] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-06T19:09:44.715599] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-06T19:09:44.715746] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-06T19:09:44.716706] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-06T19:09:44.716770] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-06T19:09:44.717933] [DEBUG] [LOCAL ] GFF: Trimmed 44219 records to 30332 (keeping 200 days of data) [2025-10-06T19:09:44.906288] [DEBUG] [LOCAL ] GFF: Primary data saved (30332 records). [2025-10-06T19:09:44.906469] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-06T19:09:44.906562] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFF took 30.8s. Estimated remaining: 3h 23m 26s. Rate: 7.1 symbols/min [2025-10-06T19:09:45.080263] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:09:45.098157] [DEBUG] [LOCAL ] GGT: Loaded 14275 existing records from primary storage. [2025-10-06T19:09:45.098490] [INFO ] [MAIN ] GGT: Loaded 14275 existing records. [2025-10-06T19:09:45.289543] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:09:45.289848] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-06T19:09:45.289900] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-06T19:09:45.290136] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-06T19:09:45.290193] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-06T19:09:45.428637] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-06T19:09:45.610676] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-06T19:09:45.701317] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:09:46.040492] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-06T19:09:46.225557] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-06T19:09:47.025496] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-06T19:09:47.100247] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T19:09:47.119961] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-06T19:09:47.123248] [INFO ] [REMOTE ] GFI: Full fetch complete (76456 records). [2025-10-06T19:09:47.123376] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-06T19:09:47.604343] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-06T19:09:47.604478] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-06T19:09:47.605947] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-06T19:09:47.606018] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-06T19:09:47.607848] [DEBUG] [LOCAL ] GFI: Trimmed 76456 records to 53100 (keeping 200 days of data) [2025-10-06T19:09:47.848206] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-06T19:09:47.966580] [DEBUG] [LOCAL ] GFI: Primary data saved (53100 records). [2025-10-06T19:09:47.966793] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-06T19:09:47.966905] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 33.9s. Estimated remaining: 3h 23m 10s. Rate: 7.1 symbols/min [2025-10-06T19:09:48.140325] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:09:48.145380] [DEBUG] [LOCAL ] GGZ: Loaded 2447 existing records from primary storage. [2025-10-06T19:09:48.145567] [INFO ] [MAIN ] GGZ: Loaded 2447 existing records. [2025-10-06T19:09:48.322874] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:09:48.323192] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-06T19:09:48.323245] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-06T19:09:48.323455] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-06T19:09:48.323512] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-06T19:09:48.613458] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T19:09:48.631087] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-06T19:09:48.699620] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:09:48.729380] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T19:09:49.425548] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-06T19:09:50.211738] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-06T19:09:50.225458] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-06T19:09:50.534277] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T19:09:51.025519] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-06T19:09:51.090545] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-06T19:09:51.825570] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-06T19:09:52.625486] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-06T19:09:52.752574] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T19:09:53.246386] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T19:09:53.263517] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-06T19:09:53.425499] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-06T19:09:54.225610] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-06T19:09:55.018626] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T19:09:55.030700] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-06T19:09:55.595738] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-06T19:09:55.825514] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-06T19:09:55.890164] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T19:09:56.457077] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T19:09:56.625478] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-06T19:09:57.071629] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-06T19:09:57.425529] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-06T19:09:58.225561] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-06T19:09:58.992740] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T19:09:59.025474] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-06T19:09:59.203158] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T19:09:59.825540] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-06T19:10:00.599716] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T19:10:00.625469] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-06T19:10:01.425554] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-06T19:10:01.448554] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-06T19:10:01.451548] [INFO ] [REMOTE ] GGB: Full fetch complete (74088 records). [2025-10-06T19:10:01.451694] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-06T19:10:01.858095] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-06T19:10:01.858223] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-06T19:10:01.859433] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-06T19:10:01.859542] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-06T19:10:01.861155] [DEBUG] [LOCAL ] GGB: Trimmed 74088 records to 51155 (keeping 200 days of data) [2025-10-06T19:10:01.980473] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-06T19:10:02.029481] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T19:10:02.225775] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-06T19:10:02.241519] [DEBUG] [LOCAL ] GGB: Primary data saved (51155 records). [2025-10-06T19:10:02.241729] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-06T19:10:02.241838] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGB took 37.2s. Estimated remaining: 3h 23m 10s. Rate: 7.1 symbols/min [2025-10-06T19:10:02.417976] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:10:02.424304] [DEBUG] [LOCAL ] GHC: Loaded 2749 existing records from primary storage. [2025-10-06T19:10:02.424503] [INFO ] [MAIN ] GHC: Loaded 2749 existing records. [2025-10-06T19:10:02.618775] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:10:02.619101] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-06T19:10:02.619158] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-06T19:10:02.619341] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-06T19:10:02.619398] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-06T19:10:03.004835] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:10:03.025483] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-06T19:10:03.479090] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-06T19:10:03.825504] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-06T19:10:03.915315] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T19:10:04.625494] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-06T19:10:04.868510] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T19:10:05.424319] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-06T19:10:05.425841] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-06T19:10:05.973439] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-06T19:10:06.225511] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-06T19:10:07.025535] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-06T19:10:07.540451] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-06T19:10:07.746426] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T19:10:07.825532] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-06T19:10:08.625507] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-06T19:10:08.846439] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T19:10:09.169678] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-06T19:10:09.425510] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-06T19:10:10.087152] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-06T19:10:10.225564] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-06T19:10:11.025569] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-06T19:10:11.155475] [DEBUG] [REMOTE ] GHC: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-06T19:10:11.155909] [WARN ] [REMOTE ] GHC: No data returned for month 2025-04 [2025-10-06T19:10:11.156001] [FATAL] [REMOTE ] GHC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:10:11.156088] [FATAL] [MAIN ] GHC: Failed to fetch primary data. [2025-10-06T19:10:11.156150] [WARN ] [MAIN ] GHC: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:10:11.156222] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-06T19:10:11.156289] [DEBUG] [LOCAL ] GHC: No primary data file found to delete. [2025-10-06T19:10:11.156324] [INFO ] [LOCAL ] GHC: Starting deletion of derivative data. [2025-10-06T19:10:11.156600] [DEBUG] [LOCAL ] GHC: Deleted derivative data file. [2025-10-06T19:10:11.156714] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GHC took 8.9s. Estimated remaining: 3h 23m 3s. Rate: 7.1 symbols/min [2025-10-06T19:10:11.268925] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-06T19:10:11.342132] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:10:11.348397] [DEBUG] [LOCAL ] GHG: Loaded 3234 existing records from primary storage. [2025-10-06T19:10:11.348630] [INFO ] [MAIN ] GHG: Loaded 3234 existing records. [2025-10-06T19:10:11.521699] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:10:11.521989] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-06T19:10:11.522036] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-06T19:10:11.522242] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-06T19:10:11.522299] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-06T19:10:11.830850] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-06T19:10:11.935406] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:10:12.625536] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-06T19:10:13.203438] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-06T19:10:13.360526] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T19:10:13.425535] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-06T19:10:13.876561] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-06T19:10:14.225541] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-06T19:10:14.809172] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T19:10:15.025542] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-06T19:10:15.467238] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T19:10:15.825530] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-06T19:10:16.297513] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-06T19:10:16.625683] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-06T19:10:17.425553] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-06T19:10:17.939731] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-06T19:10:17.985425] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T19:10:17.988106] [INFO ] [REMOTE ] GGG: Full fetch complete (59414 records). [2025-10-06T19:10:17.988212] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-06T19:10:18.230761] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-06T19:10:18.382992] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-06T19:10:18.383096] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-06T19:10:18.384103] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-06T19:10:18.384170] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-06T19:10:18.385551] [DEBUG] [LOCAL ] GGG: Trimmed 59414 records to 40905 (keeping 200 days of data) [2025-10-06T19:10:18.633097] [DEBUG] [LOCAL ] GGG: Primary data saved (40905 records). [2025-10-06T19:10:18.633258] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-06T19:10:18.633340] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGG took 35.1s. Estimated remaining: 3h 22m 53s. Rate: 7.1 symbols/min [2025-10-06T19:10:18.806187] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:10:18.816853] [DEBUG] [LOCAL ] GHI: Loaded 7159 existing records from primary storage. [2025-10-06T19:10:18.817088] [INFO ] [MAIN ] GHI: Loaded 7159 existing records. [2025-10-06T19:10:18.958446] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-06T19:10:18.998721] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:10:18.999044] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-06T19:10:18.999093] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-06T19:10:18.999311] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-06T19:10:18.999369] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-06T19:10:19.030597] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-06T19:10:19.352976] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:10:19.544552] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-06T19:10:19.825523] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-06T19:10:20.382964] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-06T19:10:20.625562] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-06T19:10:21.425517] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-06T19:10:21.573560] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-06T19:10:22.225501] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-06T19:10:22.353675] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T19:10:23.025565] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-06T19:10:23.062524] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T19:10:23.586759] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T19:10:23.825544] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-06T19:10:24.123835] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-06T19:10:24.625570] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-06T19:10:25.050108] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-06T19:10:25.051164] [INFO ] [REMOTE ] GGZ: Full fetch complete (4140 records). [2025-10-06T19:10:25.051254] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-06T19:10:25.430756] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-06T19:10:25.441180] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-06T19:10:25.441374] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-06T19:10:25.441562] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-06T19:10:25.441623] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-06T19:10:25.442108] [DEBUG] [LOCAL ] GGZ: Trimmed 4140 records to 2424 (keeping 200 days of data) [2025-10-06T19:10:25.460728] [DEBUG] [LOCAL ] GGZ: Primary data saved (2424 records). [2025-10-06T19:10:25.460919] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-06T19:10:25.461050] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGZ took 37.5s. Estimated remaining: 3h 22m 42s. Rate: 7.1 symbols/min [2025-10-06T19:10:25.640538] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:10:25.648460] [DEBUG] [LOCAL ] GHLD: Loaded 4227 existing records from primary storage. [2025-10-06T19:10:25.648743] [INFO ] [MAIN ] GHLD: Loaded 4227 existing records. [2025-10-06T19:10:25.826923] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:10:25.827217] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-06T19:10:25.827269] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-06T19:10:25.827538] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-06T19:10:25.827628] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-06T19:10:26.041996] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-06T19:10:26.230694] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-06T19:10:26.236430] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:10:27.025558] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-06T19:10:27.159487] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T19:10:27.160923] [INFO ] [REMOTE ] GGT: Full fetch complete (18761 records). [2025-10-06T19:10:27.160998] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-06T19:10:27.509460] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-06T19:10:27.546765] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-06T19:10:27.546877] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-06T19:10:27.547482] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-06T19:10:27.547523] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-06T19:10:27.548280] [DEBUG] [LOCAL ] GGT: Trimmed 18761 records to 14104 (keeping 200 days of data) [2025-10-06T19:10:27.636797] [DEBUG] [LOCAL ] GGT: Primary data saved (14104 records). [2025-10-06T19:10:27.636996] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-06T19:10:27.637110] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GGT took 42.7s. Estimated remaining: 3h 22m 24s. Rate: 7.1 symbols/min [2025-10-06T19:10:27.809138] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:10:27.826620] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-06T19:10:27.827198] [DEBUG] [LOCAL ] GHM: Loaded 14245 existing records from primary storage. [2025-10-06T19:10:27.828535] [INFO ] [MAIN ] GHM: Loaded 14245 existing records. [2025-10-06T19:10:28.007011] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:10:28.007317] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-06T19:10:28.007382] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-06T19:10:28.007884] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-06T19:10:28.007947] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-06T19:10:28.360905] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:10:28.514733] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-06T19:10:28.625503] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-06T19:10:29.343560] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T19:10:29.425522] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-06T19:10:30.225529] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-06T19:10:30.236053] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T19:10:30.712275] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-06T19:10:31.025595] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-06T19:10:31.825575] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-06T19:10:32.178253] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T19:10:32.424167] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T19:10:32.625585] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-06T19:10:33.044938] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-06T19:10:33.425573] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-06T19:10:34.225549] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-06T19:10:34.365328] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-06T19:10:34.568472] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-06T19:10:35.025620] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-06T19:10:35.510196] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-06T19:10:35.825540] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-06T19:10:36.625488] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-06T19:10:36.860427] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T19:10:37.098262] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T19:10:37.099096] [INFO ] [REMOTE ] GHG: Full fetch complete (4044 records). [2025-10-06T19:10:37.099166] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-06T19:10:37.439153] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-06T19:10:37.462722] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-06T19:10:37.462825] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-06T19:10:37.463074] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-06T19:10:37.463156] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-06T19:10:37.463797] [DEBUG] [LOCAL ] GHG: Trimmed 4044 records to 3180 (keeping 200 days of data) [2025-10-06T19:10:37.482435] [DEBUG] [LOCAL ] GHG: Primary data saved (3180 records). [2025-10-06T19:10:37.482683] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-06T19:10:37.482825] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHG took 26.3s. Estimated remaining: 3h 22m 18s. Rate: 7.1 symbols/min [2025-10-06T19:10:37.652351] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:10:37.679083] [DEBUG] [LOCAL ] GHY: Loaded 21190 existing records from primary storage. [2025-10-06T19:10:37.679406] [INFO ] [MAIN ] GHY: Loaded 21190 existing records. [2025-10-06T19:10:37.880547] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:10:37.880999] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-06T19:10:37.881050] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-06T19:10:37.881327] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-06T19:10:37.881384] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-06T19:10:38.183958] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T19:10:38.231458] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-06T19:10:38.253822] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:10:38.700419] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-06T19:10:39.025565] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-06T19:10:39.825518] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-06T19:10:40.092252] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T19:10:40.248772] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-06T19:10:40.625545] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-06T19:10:40.988063] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-06T19:10:41.425856] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-06T19:10:42.225614] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-06T19:10:42.401887] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T19:10:43.025507] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-06T19:10:43.102226] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-06T19:10:43.544189] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-06T19:10:43.825570] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-06T19:10:44.535146] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T19:10:44.625512] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-06T19:10:45.295262] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-06T19:10:45.425548] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-06T19:10:46.225509] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-06T19:10:46.281470] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-06T19:10:47.025497] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-06T19:10:47.056264] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T19:10:47.595860] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-06T19:10:47.825543] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-06T19:10:48.572674] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-06T19:10:48.625539] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-06T19:10:49.185951] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T19:10:49.186783] [INFO ] [REMOTE ] GHLD: Full fetch complete (4816 records). [2025-10-06T19:10:49.186944] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-06T19:10:49.431588] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-06T19:10:49.554533] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-06T19:10:49.554618] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-06T19:10:49.554799] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-06T19:10:49.554852] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-06T19:10:49.555203] [DEBUG] [LOCAL ] GHLD: Trimmed 4816 records to 4174 (keeping 200 days of data) [2025-10-06T19:10:49.580275] [DEBUG] [LOCAL ] GHLD: Primary data saved (4174 records). [2025-10-06T19:10:49.580340] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-06T19:10:49.580412] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHLD took 24.1s. Estimated remaining: 3h 22m 15s. Rate: 7.1 symbols/min [2025-10-06T19:10:49.755842] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:10:49.793484] [DEBUG] [LOCAL ] GIB: Loaded 32516 existing records from primary storage. [2025-10-06T19:10:49.793854] [INFO ] [MAIN ] GIB: Loaded 32516 existing records. [2025-10-06T19:10:49.971019] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:10:49.971345] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-06T19:10:49.971408] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-06T19:10:49.971684] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-06T19:10:49.971760] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-06T19:10:50.230833] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-06T19:10:50.342689] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:10:50.438753] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T19:10:51.025600] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-06T19:10:51.536757] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T19:10:51.743163] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-06T19:10:51.825474] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-06T19:10:52.625515] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-06T19:10:52.799248] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T19:10:53.425515] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-06T19:10:53.689403] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-06T19:10:54.225564] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-06T19:10:54.682997] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T19:10:54.899624] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-06T19:10:54.900750] [INFO ] [REMOTE ] GHI: Full fetch complete (11587 records). [2025-10-06T19:10:54.900824] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-06T19:10:55.039718] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-06T19:10:55.264939] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-06T19:10:55.265054] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-06T19:10:55.265402] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-06T19:10:55.265462] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-06T19:10:55.266006] [DEBUG] [LOCAL ] GHI: Trimmed 11587 records to 7131 (keeping 200 days of data) [2025-10-06T19:10:55.309509] [DEBUG] [LOCAL ] GHI: Primary data saved (7131 records). [2025-10-06T19:10:55.309638] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-06T19:10:55.309761] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHI took 36.7s. Estimated remaining: 3h 22m 2s. Rate: 7.1 symbols/min [2025-10-06T19:10:55.475676] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:10:55.491910] [DEBUG] [LOCAL ] GIC: Loaded 13632 existing records from primary storage. [2025-10-06T19:10:55.492184] [INFO ] [MAIN ] GIC: Loaded 13632 existing records. [2025-10-06T19:10:55.665091] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:10:55.665321] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-06T19:10:55.665367] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-06T19:10:55.665533] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-06T19:10:55.665571] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-06T19:10:55.836525] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-06T19:10:56.032774] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:10:56.098981] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T19:10:56.625544] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-06T19:10:57.083793] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T19:10:57.425526] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-06T19:10:57.832915] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-06T19:10:58.225488] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-06T19:10:58.544841] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T19:10:59.025534] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-06T19:10:59.218980] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T19:10:59.825490] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-06T19:11:00.205421] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T19:11:00.625495] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-06T19:11:00.666843] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T19:11:01.425598] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-06T19:11:02.126238] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T19:11:02.225575] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-06T19:11:02.521589] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T19:11:03.025545] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-06T19:11:03.317208] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T19:11:03.825577] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-06T19:11:04.555151] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T19:11:04.556562] [INFO ] [REMOTE ] GHM: Full fetch complete (21787 records). [2025-10-06T19:11:04.556668] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-06T19:11:04.631762] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-06T19:11:04.768162] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T19:11:04.958935] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-06T19:11:04.959025] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-06T19:11:04.959494] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-06T19:11:04.959712] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-06T19:11:04.960338] [DEBUG] [LOCAL ] GHM: Trimmed 21787 records to 14084 (keeping 200 days of data) [2025-10-06T19:11:05.044686] [DEBUG] [LOCAL ] GHM: Primary data saved (14084 records). [2025-10-06T19:11:05.044879] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-06T19:11:05.044973] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHM took 37.4s. Estimated remaining: 3h 21m 56s. Rate: 7.1 symbols/min [2025-10-06T19:11:05.224319] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:11:05.289498] [DEBUG] [LOCAL ] GIL: Loaded 44048 existing records from primary storage. [2025-10-06T19:11:05.290065] [INFO ] [MAIN ] GIL: Loaded 44048 existing records. [2025-10-06T19:11:05.430747] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-06T19:11:05.502736] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:11:05.503588] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-06T19:11:05.503689] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-06T19:11:05.504075] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-06T19:11:05.504138] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-06T19:11:05.828085] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T19:11:05.915801] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:11:06.225494] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-06T19:11:06.449524] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T19:11:07.025495] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-06T19:11:07.257420] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-06T19:11:07.825510] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-06T19:11:08.159628] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T19:11:08.625545] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-06T19:11:09.425511] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-06T19:11:09.501902] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T19:11:09.708669] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T19:11:10.202864] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T19:11:10.225471] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-06T19:11:11.025615] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-06T19:11:11.665347] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T19:11:11.825516] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-06T19:11:12.008173] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T19:11:12.625585] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-06T19:11:12.995313] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T19:11:13.425503] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-06T19:11:13.647151] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T19:11:13.648987] [INFO ] [REMOTE ] GHY: Full fetch complete (32266 records). [2025-10-06T19:11:13.649072] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-06T19:11:14.027206] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-06T19:11:14.027323] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-06T19:11:14.028155] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-06T19:11:14.028218] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-06T19:11:14.029052] [DEBUG] [LOCAL ] GHY: Trimmed 32266 records to 20917 (keeping 200 days of data) [2025-10-06T19:11:14.170710] [DEBUG] [LOCAL ] GHY: Primary data saved (20917 records). [2025-10-06T19:11:14.170893] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-06T19:11:14.171032] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GHY took 36.7s. Estimated remaining: 3h 21m 48s. Rate: 7.1 symbols/min [2025-10-06T19:11:14.238507] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-06T19:11:14.350460] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:11:14.408157] [DEBUG] [LOCAL ] GIS: Loaded 54452 existing records from primary storage. [2025-10-06T19:11:14.408518] [INFO ] [MAIN ] GIS: Loaded 54452 existing records. [2025-10-06T19:11:14.582727] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:11:14.582965] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-06T19:11:14.583020] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-06T19:11:14.583293] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-06T19:11:14.583349] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-06T19:11:14.937950] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:11:15.025475] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-06T19:11:15.167252] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T19:11:15.449735] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T19:11:15.825619] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-06T19:11:16.576421] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T19:11:16.625473] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-06T19:11:17.017214] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T19:11:17.425562] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-06T19:11:18.225548] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-06T19:11:18.519874] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T19:11:18.701411] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T19:11:19.025547] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-06T19:11:19.084002] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-06T19:11:19.825535] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-06T19:11:20.621698] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-06T19:11:20.625470] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-06T19:11:20.833086] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T19:11:21.425597] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-06T19:11:21.744544] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T19:11:22.225539] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-06T19:11:22.837165] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T19:11:23.025494] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-06T19:11:23.145708] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T19:11:23.825518] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-06T19:11:24.411934] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T19:11:24.625502] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-06T19:11:25.377546] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T19:11:25.425486] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-06T19:11:25.830069] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T19:11:25.831276] [INFO ] [REMOTE ] GIC: Full fetch complete (20167 records). [2025-10-06T19:11:25.831365] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-06T19:11:26.191239] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-06T19:11:26.191334] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-06T19:11:26.191902] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-06T19:11:26.191965] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-06T19:11:26.192521] [DEBUG] [LOCAL ] GIC: Trimmed 20167 records to 13433 (keeping 200 days of data) [2025-10-06T19:11:26.226282] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-06T19:11:26.277721] [DEBUG] [LOCAL ] GIC: Primary data saved (13433 records). [2025-10-06T19:11:26.277851] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-06T19:11:26.277935] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIC took 31.0s. Estimated remaining: 3h 21m 46s. Rate: 7.1 symbols/min [2025-10-06T19:11:26.445097] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:11:26.487541] [DEBUG] [LOCAL ] GKOS: Loaded 43313 existing records from primary storage. [2025-10-06T19:11:26.487955] [INFO ] [MAIN ] GKOS: Loaded 43313 existing records. [2025-10-06T19:11:26.669394] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:11:26.669769] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-06T19:11:26.669898] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-06T19:11:26.670157] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-06T19:11:26.670213] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-06T19:11:27.025520] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-06T19:11:27.115993] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:11:27.144332] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T19:11:27.825525] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-06T19:11:28.202222] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-06T19:11:28.469921] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T19:11:28.625522] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-06T19:11:29.275020] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T19:11:29.425513] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-06T19:11:29.719258] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T19:11:29.721478] [INFO ] [REMOTE ] GIB: Full fetch complete (45733 records). [2025-10-06T19:11:29.721563] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-06T19:11:30.095119] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-06T19:11:30.095214] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-06T19:11:30.096143] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-06T19:11:30.096221] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-06T19:11:30.097322] [DEBUG] [LOCAL ] GIB: Trimmed 45733 records to 31983 (keeping 200 days of data) [2025-10-06T19:11:30.225678] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-06T19:11:30.301002] [DEBUG] [LOCAL ] GIB: Primary data saved (31983 records). [2025-10-06T19:11:30.301188] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-06T19:11:30.301279] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIB took 40.7s. Estimated remaining: 3h 21m 30s. Rate: 7.1 symbols/min [2025-10-06T19:11:30.466746] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:11:30.509079] [DEBUG] [LOCAL ] GL: Loaded 38326 existing records from primary storage. [2025-10-06T19:11:30.509424] [INFO ] [MAIN ] GL: Loaded 38326 existing records. [2025-10-06T19:11:30.684765] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:11:30.685054] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-06T19:11:30.685102] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-06T19:11:30.685336] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-06T19:11:30.685394] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-06T19:11:31.028796] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-06T19:11:31.070309] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:11:31.066535] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T19:11:31.825552] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-06T19:11:31.880595] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T19:11:32.495880] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-06T19:11:32.625495] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-06T19:11:33.310050] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T19:11:33.425526] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-06T19:11:33.944436] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T19:11:34.225608] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-06T19:11:34.570617] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-06T19:11:35.025554] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-06T19:11:35.744441] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T19:11:35.825597] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-06T19:11:36.625578] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-06T19:11:37.000762] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-06T19:11:37.425567] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-06T19:11:37.495997] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T19:11:38.224410] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T19:11:38.233269] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-06T19:11:39.025528] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-06T19:11:39.321481] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-06T19:11:39.755826] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T19:11:39.825507] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-06T19:11:40.597083] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T19:11:40.625488] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-06T19:11:41.291026] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T19:11:41.425501] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-06T19:11:42.046994] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T19:11:42.225543] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-06T19:11:42.962196] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T19:11:43.025529] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-06T19:11:43.825516] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-06T19:11:44.156307] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-06T19:11:44.188164] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T19:11:44.191390] [INFO ] [REMOTE ] GIL: Full fetch complete (61666 records). [2025-10-06T19:11:44.191506] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-06T19:11:44.592306] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-06T19:11:44.592413] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-06T19:11:44.593349] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-06T19:11:44.593417] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-06T19:11:44.594774] [DEBUG] [LOCAL ] GIL: Trimmed 61666 records to 43543 (keeping 200 days of data) [2025-10-06T19:11:44.646265] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-06T19:11:44.860866] [DEBUG] [LOCAL ] GIL: Primary data saved (43543 records). [2025-10-06T19:11:44.861033] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-06T19:11:44.862102] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GIL took 39.8s. Estimated remaining: 3h 21m 31s. Rate: 7.1 symbols/min [2025-10-06T19:11:45.033008] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:11:45.085782] [DEBUG] [LOCAL ] GLOB: Loaded 48346 existing records from primary storage. [2025-10-06T19:11:45.086195] [INFO ] [MAIN ] GLOB: Loaded 48346 existing records. [2025-10-06T19:11:45.262548] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:11:45.262790] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-06T19:11:45.262839] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-06T19:11:45.263109] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-06T19:11:45.263167] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-06T19:11:45.426829] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-06T19:11:45.633174] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:11:45.658700] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T19:11:46.225551] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-06T19:11:46.683149] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-06T19:11:47.036528] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-06T19:11:47.041829] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T19:11:47.825534] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-06T19:11:47.888805] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T19:11:48.535126] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T19:11:48.625556] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-06T19:11:49.278137] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T19:11:49.425560] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-06T19:11:50.086129] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T19:11:50.225529] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-06T19:11:51.025507] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-06T19:11:51.456344] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-06T19:11:51.710604] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T19:11:51.825536] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-06T19:11:52.574437] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T19:11:52.625542] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-06T19:11:53.208490] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T19:11:53.211319] [INFO ] [REMOTE ] GKOS: Full fetch complete (60080 records). [2025-10-06T19:11:53.211450] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-06T19:11:53.433310] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-06T19:11:53.712873] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-06T19:11:53.713157] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-06T19:11:53.714378] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-06T19:11:53.714448] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-06T19:11:53.716107] [DEBUG] [LOCAL ] GKOS: Trimmed 60080 records to 42686 (keeping 200 days of data) [2025-10-06T19:11:54.086329] [DEBUG] [LOCAL ] GKOS: Primary data saved (42686 records). [2025-10-06T19:11:54.086549] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-06T19:11:54.086744] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GKOS took 27.8s. Estimated remaining: 3h 21m 24s. Rate: 7.1 symbols/min [2025-10-06T19:11:54.246370] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-06T19:11:54.277858] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T19:11:54.363252] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:11:54.378618] [DEBUG] [LOCAL ] GLP: Loaded 9445 existing records from primary storage. [2025-10-06T19:11:54.379000] [INFO ] [MAIN ] GLP: Loaded 9445 existing records. [2025-10-06T19:11:54.606036] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:11:54.606452] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-06T19:11:54.606568] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-06T19:11:54.607062] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-06T19:11:54.607121] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-06T19:11:55.009088] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:11:55.025481] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-06T19:11:55.054301] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-06T19:11:55.057619] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-10-06T19:11:55.057789] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-06T19:11:55.446783] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-06T19:11:55.446890] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-06T19:11:55.447994] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-06T19:11:55.448062] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-06T19:11:55.449810] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 53672 (keeping 200 days of data) [2025-10-06T19:11:55.700406] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T19:11:55.825585] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-06T19:11:55.826897] [DEBUG] [LOCAL ] GIS: Primary data saved (53672 records). [2025-10-06T19:11:55.827848] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-06T19:11:55.829063] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GIS took 41.7s. Estimated remaining: 3h 21m 6s. Rate: 7.1 symbols/min [2025-10-06T19:11:55.946262] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T19:11:56.019686] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:11:56.075427] [DEBUG] [LOCAL ] GLW: Loaded 54416 existing records from primary storage. [2025-10-06T19:11:56.075837] [INFO ] [MAIN ] GLW: Loaded 54416 existing records. [2025-10-06T19:11:56.253829] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:11:56.254129] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-06T19:11:56.254178] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-06T19:11:56.254475] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-06T19:11:56.254532] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-06T19:11:56.604926] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:11:56.625488] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-06T19:11:57.425502] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-06T19:11:57.518948] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T19:11:58.190368] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-06T19:11:58.226423] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-06T19:11:58.226342] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T19:11:59.024557] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T19:11:59.027232] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-06T19:11:59.825542] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-06T19:12:00.625511] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-06T19:12:01.052313] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-06T19:12:01.207779] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-06T19:12:01.425516] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-06T19:12:01.637035] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T19:12:02.225554] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-06T19:12:03.025557] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-06T19:12:03.296413] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-06T19:12:03.825494] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-06T19:12:03.877389] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T19:12:04.007236] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-06T19:12:04.625539] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-06T19:12:05.425550] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-06T19:12:05.894535] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-06T19:12:06.225504] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-06T19:12:06.510813] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T19:12:06.833382] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T19:12:06.964329] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T19:12:07.025525] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-06T19:12:07.825497] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-06T19:12:07.903363] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T19:12:08.625550] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-06T19:12:09.030357] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T19:12:09.032853] [INFO ] [REMOTE ] GL: Full fetch complete (55337 records). [2025-10-06T19:12:09.032994] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-06T19:12:09.259727] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-06T19:12:09.426407] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-06T19:12:09.463758] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-06T19:12:09.463890] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-06T19:12:09.465139] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-06T19:12:09.465215] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-06T19:12:09.466536] [DEBUG] [LOCAL ] GL: Trimmed 55337 records to 37789 (keeping 200 days of data) [2025-10-06T19:12:09.720253] [DEBUG] [LOCAL ] GL: Primary data saved (37789 records). [2025-10-06T19:12:09.720463] [INFO ] [MAIN ] GL: Full history saved. [2025-10-06T19:12:09.720580] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GL took 39.4s. Estimated remaining: 3h 21m 5s. Rate: 7.1 symbols/min [2025-10-06T19:12:09.901214] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:12:09.951734] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-10-06T19:12:09.952153] [INFO ] [MAIN ] GM: Loaded 54508 existing records. [2025-10-06T19:12:10.133749] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:12:10.134055] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-06T19:12:10.134104] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-06T19:12:10.134434] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-06T19:12:10.134492] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-06T19:12:10.230780] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-06T19:12:10.539298] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:12:11.025511] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-06T19:12:11.032440] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T19:12:11.671205] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-06T19:12:11.825734] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-06T19:12:12.147865] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T19:12:12.625592] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-06T19:12:13.425505] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-06T19:12:13.490948] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T19:12:14.182091] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-06T19:12:14.225502] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-06T19:12:14.441483] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T19:12:14.789148] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-06T19:12:15.025556] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-06T19:12:15.825549] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-06T19:12:16.625541] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-06T19:12:16.636420] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T19:12:16.637694] [INFO ] [REMOTE ] GLP: Full fetch complete (14342 records). [2025-10-06T19:12:16.637768] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-06T19:12:17.032832] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-06T19:12:17.051870] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-06T19:12:17.052131] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-06T19:12:17.052516] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-06T19:12:17.052595] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-06T19:12:17.053603] [DEBUG] [LOCAL ] GLP: Trimmed 14342 records to 9299 (keeping 200 days of data) [2025-10-06T19:12:17.108991] [DEBUG] [LOCAL ] GLP: Primary data saved (9299 records). [2025-10-06T19:12:17.109147] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-06T19:12:17.109231] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLP took 23.0s. Estimated remaining: 3h 20m 55s. Rate: 7.1 symbols/min [2025-10-06T19:12:17.285635] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:12:17.336189] [DEBUG] [LOCAL ] GME: Loaded 54542 existing records from primary storage. [2025-10-06T19:12:17.336555] [INFO ] [MAIN ] GME: Loaded 54542 existing records. [2025-10-06T19:12:17.434838] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-06T19:12:17.536847] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:12:17.537134] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-06T19:12:17.537189] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-06T19:12:17.537923] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-06T19:12:17.537986] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-06T19:12:17.895457] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:12:18.225613] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-06T19:12:18.454273] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T19:12:19.025507] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-06T19:12:19.126201] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T19:12:19.825543] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-06T19:12:20.244833] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-06T19:12:20.625588] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-06T19:12:21.425593] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-06T19:12:21.607751] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-06T19:12:21.851152] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-06T19:12:22.225543] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-06T19:12:22.785348] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-06T19:12:23.025611] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-06T19:12:23.126448] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T19:12:23.825557] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-06T19:12:24.210389] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-06T19:12:24.625623] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-06T19:12:25.425744] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-06T19:12:25.461007] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T19:12:25.464605] [INFO ] [REMOTE ] GLOB: Full fetch complete (64497 records). [2025-10-06T19:12:25.464780] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-06T19:12:25.900837] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-06T19:12:25.940196] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-06T19:12:25.940309] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-06T19:12:25.941470] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-06T19:12:25.941535] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-06T19:12:25.942909] [DEBUG] [LOCAL ] GLOB: Trimmed 64497 records to 47770 (keeping 200 days of data) [2025-10-06T19:12:26.225777] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-06T19:12:26.230376] [DEBUG] [LOCAL ] GLOB: Primary data saved (47770 records). [2025-10-06T19:12:26.230563] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-06T19:12:26.232245] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLOB took 41.4s. Estimated remaining: 3h 20m 48s. Rate: 7.1 symbols/min [2025-10-06T19:12:26.402954] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:12:26.452900] [DEBUG] [LOCAL ] GMED: Loaded 49085 existing records from primary storage. [2025-10-06T19:12:26.453279] [INFO ] [MAIN ] GMED: Loaded 49085 existing records. [2025-10-06T19:12:26.629795] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:12:26.630241] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-06T19:12:26.630363] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-06T19:12:26.637097] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-06T19:12:26.637715] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-06T19:12:26.637989] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-06T19:12:26.711526] [INFO ] [REMOTE ] GLW: Full fetch complete (77619 records). [2025-10-06T19:12:26.722506] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-06T19:12:27.310446] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:12:27.321813] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-06T19:12:27.433472] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-06T19:12:27.433716] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-06T19:12:27.434902] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-06T19:12:27.435032] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-06T19:12:27.437362] [DEBUG] [LOCAL ] GLW: Trimmed 77619 records to 53636 (keeping 200 days of data) [2025-10-06T19:12:27.573588] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-06T19:12:27.823468] [DEBUG] [LOCAL ] GLW: Primary data saved (53636 records). [2025-10-06T19:12:27.823636] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-06T19:12:27.823763] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GLW took 32.0s. Estimated remaining: 3h 20m 29s. Rate: 7.1 symbols/min [2025-10-06T19:12:27.835556] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-06T19:12:27.995402] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:12:28.039508] [DEBUG] [LOCAL ] GMRE: Loaded 37705 existing records from primary storage. [2025-10-06T19:12:28.039879] [INFO ] [MAIN ] GMRE: Loaded 37705 existing records. [2025-10-06T19:12:28.216627] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:12:28.216931] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-06T19:12:28.216978] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-06T19:12:28.217424] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-06T19:12:28.217482] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-06T19:12:28.585314] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:12:28.615791] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-06T19:12:28.625806] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-06T19:12:28.916841] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T19:12:29.425544] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-06T19:12:29.732721] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T19:12:29.988548] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T19:12:30.225561] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-06T19:12:31.025602] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-06T19:12:31.201479] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T19:12:31.600166] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-06T19:12:31.825566] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-06T19:12:32.280343] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T19:12:32.625555] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-06T19:12:33.425513] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-06T19:12:33.842636] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-06T19:12:34.225822] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-06T19:12:34.228971] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T19:12:35.025590] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-06T19:12:35.789751] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T19:12:35.825485] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-06T19:12:35.906978] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-06T19:12:36.625559] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-06T19:12:36.757130] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T19:12:36.915034] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-06T19:12:37.425528] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-06T19:12:38.225586] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-06T19:12:38.916795] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T19:12:39.025493] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-06T19:12:39.266990] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-06T19:12:39.825546] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-06T19:12:40.190938] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-06T19:12:40.433968] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T19:12:40.625551] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-06T19:12:41.425537] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-06T19:12:42.225552] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-06T19:12:42.374262] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-06T19:12:42.580794] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-06T19:12:42.894227] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T19:12:43.025497] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-06T19:12:43.752341] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T19:12:43.825492] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-06T19:12:44.625495] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-06T19:12:44.746437] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T19:12:45.425538] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-06T19:12:46.113485] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T19:12:46.225594] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-06T19:12:46.520952] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-06T19:12:47.025762] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-06T19:12:47.458115] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-06T19:12:47.770244] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T19:12:47.825507] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-06T19:12:48.625566] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-06T19:12:49.136547] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-06T19:12:49.425556] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-06T19:12:49.717441] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T19:12:49.779787] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-06T19:12:50.225587] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-06T19:12:51.025555] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-06T19:12:51.089298] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T19:12:51.825566] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-06T19:12:52.125542] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-06T19:12:52.128729] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-06T19:12:52.128849] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-06T19:12:52.532759] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-06T19:12:52.532892] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-06T19:12:52.534104] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-06T19:12:52.534194] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-06T19:12:52.560064] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T19:12:52.568780] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53729 (keeping 200 days of data) [2025-10-06T19:12:52.632867] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-06T19:12:52.903073] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-06T19:12:52.903256] [INFO ] [MAIN ] GM: Full history saved. [2025-10-06T19:12:52.903348] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GM took 43.2s. Estimated remaining: 3h 20m 46s. Rate: 7.1 symbols/min [2025-10-06T19:12:53.076613] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:12:53.100501] [DEBUG] [LOCAL ] GNE: Loaded 18024 existing records from primary storage. [2025-10-06T19:12:53.100875] [INFO ] [MAIN ] GNE: Loaded 18024 existing records. [2025-10-06T19:12:53.285746] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:12:53.285998] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-06T19:12:53.286047] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-06T19:12:53.286968] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-06T19:12:53.287030] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-06T19:12:53.439010] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-06T19:12:53.440379] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-06T19:12:53.482239] [INFO ] [REMOTE ] GMED: Full fetch complete (69788 records). [2025-10-06T19:12:53.531335] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-06T19:12:53.879878] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:12:54.144100] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-06T19:12:54.144189] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-06T19:12:54.145167] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-06T19:12:54.145234] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-06T19:12:54.146700] [DEBUG] [LOCAL ] GMED: Trimmed 69788 records to 48398 (keeping 200 days of data) [2025-10-06T19:12:54.231156] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-06T19:12:54.433471] [DEBUG] [LOCAL ] GMED: Primary data saved (48398 records). [2025-10-06T19:12:54.433668] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-06T19:12:54.434516] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMED took 28.2s. Estimated remaining: 3h 20m 27s. Rate: 7.1 symbols/min [2025-10-06T19:12:54.605503] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:12:54.648996] [DEBUG] [LOCAL ] GNK: Loaded 40862 existing records from primary storage. [2025-10-06T19:12:54.649339] [INFO ] [MAIN ] GNK: Loaded 40862 existing records. [2025-10-06T19:12:54.832594] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:12:54.832925] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-06T19:12:54.833132] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-06T19:12:54.834669] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-06T19:12:54.834737] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-06T19:12:55.048005] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T19:12:55.139920] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-06T19:12:55.176077] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T19:12:55.259584] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:12:55.300991] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-06T19:12:55.825539] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-06T19:12:56.584368] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T19:12:56.600162] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T19:12:56.625493] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-06T19:12:57.346029] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-06T19:12:57.425549] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-06T19:12:58.225593] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-06T19:12:58.806934] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T19:12:59.025541] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-06T19:12:59.611114] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T19:12:59.825551] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-06T19:12:59.883162] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-06T19:13:00.625508] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-06T19:13:01.425536] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-06T19:13:02.072758] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T19:13:02.221937] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-06T19:13:02.225458] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-06T19:13:02.247725] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-06T19:13:02.251072] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-06T19:13:02.251203] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-06T19:13:02.667782] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-06T19:13:02.667900] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-06T19:13:02.668946] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-06T19:13:02.669011] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-06T19:13:02.670544] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53775 (keeping 200 days of data) [2025-10-06T19:13:03.003763] [DEBUG] [LOCAL ] GME: Primary data saved (53775 records). [2025-10-06T19:13:03.004087] [INFO ] [MAIN ] GME: Full history saved. [2025-10-06T19:13:03.004327] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GME took 45.9s. Estimated remaining: 3h 20m 19s. Rate: 7.1 symbols/min [2025-10-06T19:13:03.035288] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-06T19:13:03.196897] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:13:03.198288] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T19:13:03.244115] [DEBUG] [LOCAL ] GNL: Loaded 47502 existing records from primary storage. [2025-10-06T19:13:03.244531] [INFO ] [MAIN ] GNL: Loaded 47502 existing records. [2025-10-06T19:13:03.427059] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:13:03.427383] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-06T19:13:03.427447] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-06T19:13:03.428735] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-06T19:13:03.428794] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-06T19:13:03.796126] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:13:03.825471] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-06T19:13:04.537456] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T19:13:04.625576] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-06T19:13:05.425533] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-06T19:13:05.550497] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T19:13:05.764878] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T19:13:06.225595] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-06T19:13:06.600598] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T19:13:06.602792] [INFO ] [REMOTE ] GMRE: Full fetch complete (53138 records). [2025-10-06T19:13:06.602897] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-06T19:13:06.979688] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-06T19:13:06.979815] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-06T19:13:06.980723] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-06T19:13:06.980785] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-06T19:13:06.982094] [DEBUG] [LOCAL ] GMRE: Trimmed 53138 records to 37203 (keeping 200 days of data) [2025-10-06T19:13:07.035118] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-06T19:13:07.222177] [DEBUG] [LOCAL ] GMRE: Primary data saved (37203 records). [2025-10-06T19:13:07.222370] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-06T19:13:07.222465] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GMRE took 39.4s. Estimated remaining: 3h 20m 4s. Rate: 7.1 symbols/min [2025-10-06T19:13:07.339500] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-06T19:13:07.413227] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:13:07.460323] [DEBUG] [LOCAL ] GNRC: Loaded 45779 existing records from primary storage. [2025-10-06T19:13:07.460694] [INFO ] [MAIN ] GNRC: Loaded 45779 existing records. [2025-10-06T19:13:07.639146] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:13:07.639477] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-06T19:13:07.639547] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-06T19:13:07.640942] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-06T19:13:07.641006] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-06T19:13:07.833116] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-06T19:13:07.989440] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:13:08.625570] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-06T19:13:08.745694] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T19:13:09.060675] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T19:13:09.425582] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-06T19:13:10.217063] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T19:13:10.226685] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-06T19:13:10.421624] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T19:13:11.025540] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-06T19:13:11.717714] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T19:13:11.718980] [INFO ] [REMOTE ] GNE: Full fetch complete (22511 records). [2025-10-06T19:13:11.719099] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-06T19:13:11.826880] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-06T19:13:11.918995] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T19:13:12.141875] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-06T19:13:12.141994] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-06T19:13:12.142683] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-06T19:13:12.142778] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-06T19:13:12.143869] [DEBUG] [LOCAL ] GNE: Trimmed 22511 records to 17825 (keeping 200 days of data) [2025-10-06T19:13:12.257724] [DEBUG] [LOCAL ] GNE: Primary data saved (17825 records). [2025-10-06T19:13:12.257932] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-06T19:13:12.258032] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNE took 19.4s. Estimated remaining: 3h 19m 51s. Rate: 7.1 symbols/min [2025-10-06T19:13:12.440211] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:13:12.450287] [DEBUG] [LOCAL ] GNT: Loaded 8269 existing records from primary storage. [2025-10-06T19:13:12.450536] [INFO ] [MAIN ] GNT: Loaded 8269 existing records. [2025-10-06T19:13:12.638312] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-06T19:13:12.644862] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:13:12.645156] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-06T19:13:12.645255] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-06T19:13:12.646771] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-06T19:13:12.646834] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-06T19:13:12.999207] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:13:13.249004] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T19:13:13.425552] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-06T19:13:14.225575] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-06T19:13:14.663450] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-06T19:13:14.815489] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T19:13:15.025556] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-06T19:13:15.170871] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T19:13:15.636865] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T19:13:15.825558] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-06T19:13:16.625592] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-06T19:13:17.325299] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-06T19:13:17.432501] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-06T19:13:17.449506] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T19:13:18.225592] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-06T19:13:19.025516] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-06T19:13:19.152255] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T19:13:19.670031] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-06T19:13:19.808835] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T19:13:19.825467] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-06T19:13:20.625572] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-06T19:13:21.171405] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T19:13:21.425628] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-06T19:13:22.223004] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T19:13:22.231834] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-06T19:13:22.240330] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T19:13:23.025545] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-06T19:13:23.708032] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-06T19:13:23.828076] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-06T19:13:23.832189] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T19:13:24.625552] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-06T19:13:25.425513] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-06T19:13:25.456848] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T19:13:26.190120] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T19:13:26.225494] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-06T19:13:26.245566] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-06T19:13:27.025537] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-06T19:13:27.607137] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T19:13:27.750354] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-06T19:13:27.825560] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-06T19:13:28.447418] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-06T19:13:28.625569] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-06T19:13:29.425563] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-06T19:13:30.203026] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T19:13:30.225478] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-06T19:13:30.794297] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T19:13:30.797875] [INFO ] [REMOTE ] GNK: Full fetch complete (57154 records). [2025-10-06T19:13:30.798034] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-06T19:13:31.036889] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-06T19:13:31.212286] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-06T19:13:31.212396] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-06T19:13:31.213481] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-06T19:13:31.213554] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-06T19:13:31.215362] [DEBUG] [LOCAL ] GNK: Trimmed 57154 records to 40229 (keeping 200 days of data) [2025-10-06T19:13:31.486320] [DEBUG] [LOCAL ] GNK: Primary data saved (40229 records). [2025-10-06T19:13:31.486502] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-06T19:13:31.487324] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNK took 37.1s. Estimated remaining: 3h 19m 58s. Rate: 7.1 symbols/min [2025-10-06T19:13:31.673052] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:13:31.731306] [DEBUG] [LOCAL ] GNW: Loaded 52096 existing records from primary storage. [2025-10-06T19:13:31.731773] [INFO ] [MAIN ] GNW: Loaded 52096 existing records. [2025-10-06T19:13:31.829145] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-06T19:13:31.929239] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:13:31.938122] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-06T19:13:31.939435] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T19:13:31.939807] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-06T19:13:31.970849] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-06T19:13:31.971006] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-06T19:13:32.061477] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T19:13:32.384102] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:13:32.625585] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-06T19:13:33.290793] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-06T19:13:33.292100] [INFO ] [REMOTE ] GNT: Full fetch complete (10943 records). [2025-10-06T19:13:33.292176] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-06T19:13:33.425622] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-06T19:13:33.729618] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T19:13:33.730088] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-06T19:13:33.740537] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-06T19:13:33.741525] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-06T19:13:33.741673] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-06T19:13:33.742362] [DEBUG] [LOCAL ] GNT: Trimmed 10943 records to 8216 (keeping 200 days of data) [2025-10-06T19:13:33.794436] [DEBUG] [LOCAL ] GNT: Primary data saved (8216 records). [2025-10-06T19:13:33.794606] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-06T19:13:33.794743] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNT took 21.5s. Estimated remaining: 3h 19m 41s. Rate: 7.1 symbols/min [2025-10-06T19:13:33.980792] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:13:34.027439] [DEBUG] [LOCAL ] GOF: Loaded 43182 existing records from primary storage. [2025-10-06T19:13:34.027889] [INFO ] [MAIN ] GOF: Loaded 43182 existing records. [2025-10-06T19:13:34.208997] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:13:34.209314] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-06T19:13:34.209389] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-06T19:13:34.210810] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-06T19:13:34.210871] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-06T19:13:34.231771] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-06T19:13:34.575149] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:13:35.025503] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-06T19:13:35.106582] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T19:13:35.825538] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-06T19:13:36.058206] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T19:13:36.608398] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T19:13:36.625555] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-06T19:13:37.074046] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-06T19:13:37.425629] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-06T19:13:38.232736] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-06T19:13:38.249316] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T19:13:39.021361] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T19:13:39.033763] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-06T19:13:39.825580] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-06T19:13:39.969170] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T19:13:40.625512] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-06T19:13:40.796773] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T19:13:41.427482] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-06T19:13:41.435340] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T19:13:42.233416] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-06T19:13:42.239202] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T19:13:42.575003] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-06T19:13:42.577868] [INFO ] [REMOTE ] GNL: Full fetch complete (68227 records). [2025-10-06T19:13:42.577959] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-06T19:13:42.962635] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-06T19:13:42.962790] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-06T19:13:42.963798] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-06T19:13:42.963866] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-06T19:13:42.965604] [DEBUG] [LOCAL ] GNL: Trimmed 68227 records to 46772 (keeping 200 days of data) [2025-10-06T19:13:43.051359] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-06T19:13:43.244270] [DEBUG] [LOCAL ] GNL: Primary data saved (46772 records). [2025-10-06T19:13:43.244448] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-06T19:13:43.244538] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNL took 40.2s. Estimated remaining: 3h 19m 34s. Rate: 7.1 symbols/min [2025-10-06T19:13:43.422702] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:13:43.456029] [DEBUG] [LOCAL ] GOLF: Loaded 31654 existing records from primary storage. [2025-10-06T19:13:43.456401] [INFO ] [MAIN ] GOLF: Loaded 31654 existing records. [2025-10-06T19:13:43.648246] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:13:43.648850] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-06T19:13:43.648964] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-06T19:13:43.650077] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-06T19:13:43.650144] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-06T19:13:43.832702] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-06T19:13:44.043111] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:13:44.072963] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T19:13:44.625514] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-06T19:13:44.720546] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T19:13:45.425517] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-06T19:13:45.479273] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T19:13:46.153632] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T19:13:46.225575] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-06T19:13:46.515059] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-06T19:13:47.025618] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-06T19:13:47.825503] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-06T19:13:47.915049] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T19:13:48.264260] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T19:13:48.625533] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-06T19:13:49.425492] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-06T19:13:50.225565] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-06T19:13:50.286211] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T19:13:50.483328] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-06T19:13:50.543312] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T19:13:51.025557] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-06T19:13:51.741420] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T19:13:51.825545] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-06T19:13:52.462703] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T19:13:52.465407] [INFO ] [REMOTE ] GNRC: Full fetch complete (65330 records). [2025-10-06T19:13:52.465524] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-06T19:13:52.648788] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-06T19:13:52.864154] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-06T19:13:52.864251] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-06T19:13:52.865270] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-06T19:13:52.865337] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-06T19:13:52.866732] [DEBUG] [LOCAL ] GNRC: Trimmed 65330 records to 45174 (keeping 200 days of data) [2025-10-06T19:13:53.148330] [DEBUG] [LOCAL ] GNRC: Primary data saved (45174 records). [2025-10-06T19:13:53.148484] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-06T19:13:53.148568] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNRC took 45.9s. Estimated remaining: 3h 19m 28s. Rate: 7.1 symbols/min [2025-10-06T19:13:53.326946] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:13:53.375593] [DEBUG] [LOCAL ] GOOS: Loaded 45626 existing records from primary storage. [2025-10-06T19:13:53.376015] [INFO ] [MAIN ] GOOS: Loaded 45626 existing records. [2025-10-06T19:13:53.430604] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-06T19:13:53.562245] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:13:53.562626] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-06T19:13:53.562735] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-06T19:13:53.563292] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-06T19:13:53.563469] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-06T19:13:53.741508] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-06T19:13:53.965022] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:13:54.225534] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-06T19:13:54.309286] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T19:13:54.859188] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-06T19:13:55.025529] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-06T19:13:55.471429] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T19:13:55.825543] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-06T19:13:56.523637] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T19:13:56.625524] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-06T19:13:57.262252] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T19:13:57.425499] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-06T19:13:58.091513] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T19:13:58.225536] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-06T19:13:58.991531] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T19:13:59.025471] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-06T19:13:59.798367] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T19:13:59.825531] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-06T19:14:00.630634] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-06T19:14:00.645148] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T19:14:01.425503] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-06T19:14:01.552344] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T19:14:02.225497] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-06T19:14:02.436535] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T19:14:02.774162] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-06T19:14:03.025587] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-06T19:14:03.564329] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-06T19:14:03.825567] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-06T19:14:04.354141] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T19:14:04.625543] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-06T19:14:05.205356] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T19:14:05.425546] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-06T19:14:06.236116] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-06T19:14:06.256946] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T19:14:07.025539] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-06T19:14:07.197261] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T19:14:07.825546] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-06T19:14:07.883772] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T19:14:08.625545] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-06T19:14:08.715220] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T19:14:09.337331] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T19:14:09.425539] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-06T19:14:09.554714] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T19:14:10.225613] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-06T19:14:11.025615] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T19:14:11.025727] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-06T19:14:11.516293] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T19:14:11.519825] [INFO ] [REMOTE ] GNW: Full fetch complete (73642 records). [2025-10-06T19:14:11.519969] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-06T19:14:11.830936] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-06T19:14:11.968623] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-06T19:14:11.968801] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-06T19:14:11.969961] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-06T19:14:11.970074] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-06T19:14:11.971858] [DEBUG] [LOCAL ] GNW: Trimmed 73642 records to 51370 (keeping 200 days of data) [2025-10-06T19:14:12.262310] [DEBUG] [LOCAL ] GNW: Primary data saved (51370 records). [2025-10-06T19:14:12.262472] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-06T19:14:12.263744] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNW took 40.8s. Estimated remaining: 3h 19m 35s. Rate: 7.1 symbols/min [2025-10-06T19:14:12.431538] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:14:12.471949] [DEBUG] [LOCAL ] GOTU: Loaded 38853 existing records from primary storage. [2025-10-06T19:14:12.472303] [INFO ] [MAIN ] GOTU: Loaded 38853 existing records. [2025-10-06T19:14:12.629796] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-06T19:14:12.653865] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:14:12.655508] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-06T19:14:12.655692] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-06T19:14:12.656164] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-06T19:14:12.656239] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-06T19:14:12.774799] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-06T19:14:12.792281] [INFO ] [REMOTE ] GOF: Full fetch complete (62102 records). [2025-10-06T19:14:12.802716] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-06T19:14:13.385552] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:14:13.436294] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-06T19:14:13.486030] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-06T19:14:13.486305] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-06T19:14:13.488035] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-06T19:14:13.488195] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-06T19:14:13.490025] [DEBUG] [LOCAL ] GOF: Trimmed 62102 records to 42540 (keeping 200 days of data) [2025-10-06T19:14:13.646067] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T19:14:13.816711] [DEBUG] [LOCAL ] GOF: Primary data saved (42540 records). [2025-10-06T19:14:13.816936] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-06T19:14:13.817046] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOF took 40.0s. Estimated remaining: 3h 19m 16s. Rate: 7.1 symbols/min [2025-10-06T19:14:14.006775] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:14:14.007227] [DEBUG] [LOCAL ] GPC: No existing data file found in primary storage. [2025-10-06T19:14:14.007307] [WARN ] [MAIN ] GPC: No existing data found, performing full refresh instead. [2025-10-06T19:14:14.007708] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-06T19:14:14.007808] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-06T19:14:14.025598] [DEBUG] [LOCAL ] GPC: No primary data file found to delete. [2025-10-06T19:14:14.028406] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-06T19:14:14.076790] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T19:14:14.234189] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-06T19:14:14.491018] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:14:15.025588] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-06T19:14:15.150389] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T19:14:15.570338] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T19:14:15.825559] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-06T19:14:16.345015] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T19:14:16.625548] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-06T19:14:17.425628] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-06T19:14:17.712756] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-06T19:14:17.930470] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T19:14:17.933111] [INFO ] [REMOTE ] GOOS: Full fetch complete (65346 records). [2025-10-06T19:14:17.933243] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-06T19:14:18.229390] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-06T19:14:18.326507] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-06T19:14:18.326611] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-06T19:14:18.327764] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-06T19:14:18.327832] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-06T19:14:18.329289] [DEBUG] [LOCAL ] GOOS: Trimmed 65346 records to 44826 (keeping 200 days of data) [2025-10-06T19:14:18.559971] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T19:14:18.569193] [INFO ] [REMOTE ] GOLF: Full fetch complete (45170 records). [2025-10-06T19:14:18.570226] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-06T19:14:19.018049] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-06T19:14:19.018506] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-06T19:14:19.019709] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-06T19:14:19.020515] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-06T19:14:19.026501] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-06T19:14:19.026784] [DEBUG] [LOCAL ] GOOS: Primary data saved (44826 records). [2025-10-06T19:14:19.028243] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-06T19:14:19.028512] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GOOS took 25.9s. Estimated remaining: 3h 19m 3s. Rate: 7.1 symbols/min [2025-10-06T19:14:19.028384] [DEBUG] [LOCAL ] GOLF: Trimmed 45170 records to 31144 (keeping 200 days of data) [2025-10-06T19:14:19.307756] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:14:19.335996] [DEBUG] [LOCAL ] GPI: Loaded 14844 existing records from primary storage. [2025-10-06T19:14:19.337439] [INFO ] [MAIN ] GPI: Loaded 14844 existing records. [2025-10-06T19:14:19.535484] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:14:19.536030] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-06T19:14:19.536679] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-06T19:14:19.538053] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-06T19:14:19.538436] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-06T19:14:19.997176] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:14:19.992805] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T19:14:20.007134] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-06T19:14:20.017953] [DEBUG] [LOCAL ] GOLF: Primary data saved (31144 records). [2025-10-06T19:14:20.018045] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-06T19:14:20.018128] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOLF took 36.8s. Estimated remaining: 3h 18m 44s. Rate: 7.1 symbols/min [2025-10-06T19:14:20.183914] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:14:20.190989] [DEBUG] [LOCAL ] GPJA: Loaded 4272 existing records from primary storage. [2025-10-06T19:14:20.191181] [INFO ] [MAIN ] GPJA: Loaded 4272 existing records. [2025-10-06T19:14:20.363447] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:14:20.363705] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-06T19:14:20.363766] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-06T19:14:20.363942] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-06T19:14:20.363999] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-06T19:14:20.626924] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-06T19:14:20.717080] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:14:20.840380] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-06T19:14:21.059142] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-06T19:14:21.425540] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-06T19:14:22.225511] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-06T19:14:22.288900] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-06T19:14:22.321982] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T19:14:23.025579] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-06T19:14:23.322560] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T19:14:23.805264] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T19:14:23.825466] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-06T19:14:24.348873] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-06T19:14:24.625605] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-06T19:14:25.425528] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-06T19:14:25.607800] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T19:14:26.225530] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-06T19:14:27.025572] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-06T19:14:27.248932] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-06T19:14:27.427021] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T19:14:27.578496] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-06T19:14:27.825560] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-06T19:14:28.625555] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-06T19:14:29.184182] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-06T19:14:29.425552] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-06T19:14:29.555296] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T19:14:29.868119] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-06T19:14:30.225529] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-06T19:14:30.958924] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T19:14:31.025545] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-06T19:14:31.597702] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-06T19:14:31.825523] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-06T19:14:32.413819] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T19:14:32.625556] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-06T19:14:33.425534] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-06T19:14:34.225504] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-06T19:14:34.297250] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T19:14:34.709518] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-06T19:14:35.025512] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-06T19:14:35.825555] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-06T19:14:36.486831] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-06T19:14:36.512110] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T19:14:36.625498] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-06T19:14:36.712870] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-06T19:14:37.132789] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T19:14:37.133614] [INFO ] [REMOTE ] GPJA: Full fetch complete (7307 records). [2025-10-06T19:14:37.133738] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-06T19:14:37.430765] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-06T19:14:37.515870] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-06T19:14:37.515963] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-06T19:14:37.516171] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-06T19:14:37.516209] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-06T19:14:37.516596] [DEBUG] [LOCAL ] GPJA: Trimmed 7307 records to 4264 (keeping 200 days of data) [2025-10-06T19:14:37.542464] [DEBUG] [LOCAL ] GPJA: Primary data saved (4264 records). [2025-10-06T19:14:37.542562] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-06T19:14:37.542662] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GPJA took 17.5s. Estimated remaining: 3h 18m 49s. Rate: 7.1 symbols/min [2025-10-06T19:14:38.225486] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-06T19:14:38.351455] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T19:14:39.025552] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-06T19:14:39.825528] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-06T19:14:39.945213] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T19:14:39.969361] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T19:14:40.625573] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-06T19:14:41.433572] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-06T19:14:41.436154] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T19:14:41.616862] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T19:14:42.225562] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-06T19:14:43.025611] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-06T19:14:43.608920] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-06T19:14:43.644765] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T19:14:43.825530] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-06T19:14:43.862846] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T19:14:44.625546] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-06T19:14:45.276802] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T19:14:45.425529] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-06T19:14:46.225567] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-06T19:14:46.358195] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T19:14:46.460194] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-06T19:14:47.025542] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-06T19:14:47.348292] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T19:14:47.825538] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-06T19:14:48.604362] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T19:14:48.625475] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-06T19:14:49.293842] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-06T19:14:49.425542] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-06T19:14:50.237024] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-06T19:14:50.265568] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T19:14:50.270443] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T19:14:50.283344] [INFO ] [REMOTE ] GPI: Full fetch complete (21117 records). [2025-10-06T19:14:50.283849] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-06T19:14:50.650541] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-06T19:14:50.650898] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-06T19:14:50.651456] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-06T19:14:50.651499] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-06T19:14:50.652131] [DEBUG] [LOCAL ] GPI: Trimmed 21117 records to 14633 (keeping 200 days of data) [2025-10-06T19:14:50.746998] [DEBUG] [LOCAL ] GPI: Primary data saved (14633 records). [2025-10-06T19:14:50.747177] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-06T19:14:50.747261] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GPI took 31.7s. Estimated remaining: 3h 18m 47s. Rate: 7.1 symbols/min [2025-10-06T19:14:51.025569] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-06T19:14:51.504667] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T19:14:51.506816] [INFO ] [REMOTE ] GOTU: Full fetch complete (58899 records). [2025-10-06T19:14:51.506919] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-06T19:14:51.884126] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-06T19:14:51.884223] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-06T19:14:51.885162] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-06T19:14:51.885228] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-06T19:14:51.886484] [DEBUG] [LOCAL ] GOTU: Trimmed 58899 records to 38020 (keeping 200 days of data) [2025-10-06T19:14:52.120068] [DEBUG] [LOCAL ] GOTU: Primary data saved (38020 records). [2025-10-06T19:14:52.120264] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-06T19:14:52.121463] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GOTU took 39.9s. Estimated remaining: 3h 18m 29s. Rate: 7.1 symbols/min [2025-10-06T19:14:52.535355] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T19:14:52.538799] [INFO ] [REMOTE ] GPC: Full fetch complete (68872 records). [2025-10-06T19:14:52.538978] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-06T19:14:53.010674] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-06T19:14:53.010807] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-06T19:14:53.012270] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-06T19:14:53.012346] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-06T19:14:53.014738] [DEBUG] [LOCAL ] GPC: Trimmed 68872 records to 46272 (keeping 200 days of data) [2025-10-06T19:14:53.306953] [DEBUG] [LOCAL ] GPC: Primary data saved (46272 records). [2025-10-06T19:14:53.307132] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-06T19:14:53.307208] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPC took 39.5s. Estimated remaining: 3h 18m 9s. Rate: 7.1 symbols/min [2025-10-06T19:14:53.857376] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:14:53.975276] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:14:53.981839] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:14:54.030219] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:14:54.060693] [DEBUG] [LOCAL ] GPOR: Loaded 23529 existing records from primary storage. [2025-10-06T19:14:54.061193] [INFO ] [MAIN ] GPOR: Loaded 23529 existing records. [2025-10-06T19:14:54.196683] [DEBUG] [LOCAL ] GPMT: Loaded 26308 existing records from primary storage. [2025-10-06T19:14:54.211211] [INFO ] [MAIN ] GPMT: Loaded 26308 existing records. [2025-10-06T19:14:54.348275] [DEBUG] [LOCAL ] GPN: Loaded 52797 existing records from primary storage. [2025-10-06T19:14:54.372156] [DEBUG] [LOCAL ] GPK: Loaded 53416 existing records from primary storage. [2025-10-06T19:14:54.370386] [INFO ] [MAIN ] GPN: Loaded 52797 existing records. [2025-10-06T19:14:54.435358] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:14:54.440868] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-06T19:14:54.423062] [INFO ] [MAIN ] GPK: Loaded 53416 existing records. [2025-10-06T19:14:54.451407] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-06T19:14:54.481509] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-06T19:14:54.517853] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-06T19:14:55.039896] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:14:55.116358] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-06T19:14:55.126144] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:14:55.137061] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-06T19:14:55.136760] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:14:55.141848] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-06T19:14:55.149480] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-06T19:14:55.149552] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-06T19:14:55.176809] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-06T19:14:55.177038] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-06T19:14:55.169781] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-06T19:14:55.184809] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-06T19:14:55.194773] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-06T19:14:55.311127] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-06T19:14:55.379440] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-06T19:14:56.126309] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:14:56.194552] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-06T19:14:56.478759] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:14:56.545699] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-06T19:14:56.601227] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:14:56.629617] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:14:56.631396] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-06T19:14:56.631636] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-06T19:14:57.618310] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T19:14:57.624265] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-06T19:14:57.925538] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T19:14:57.932114] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-06T19:14:58.252860] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T19:14:58.263400] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-06T19:14:58.293603] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T19:14:58.305747] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-06T19:14:58.540277] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-06T19:14:58.546545] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-06T19:14:58.614839] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-06T19:14:59.025629] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-06T19:14:59.712864] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T19:14:59.825564] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-06T19:15:00.003472] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T19:15:00.086943] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T19:15:00.467630] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-06T19:15:00.625550] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-06T19:15:00.659683] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-06T19:15:01.425553] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-06T19:15:02.225526] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-06T19:15:02.270677] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T19:15:02.555896] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T19:15:03.025574] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-06T19:15:03.825503] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-06T19:15:03.860143] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T19:15:04.300896] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-06T19:15:04.625560] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-06T19:15:05.425563] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-06T19:15:05.479728] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T19:15:05.503221] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T19:15:06.225608] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-06T19:15:06.785280] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-06T19:15:07.025564] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-06T19:15:07.335094] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T19:15:07.825539] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-06T19:15:08.625512] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-06T19:15:08.856900] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T19:15:09.425507] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-06T19:15:10.011127] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T19:15:10.225581] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-06T19:15:10.498387] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-06T19:15:11.025536] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-06T19:15:11.615587] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-06T19:15:11.825527] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-06T19:15:12.187773] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-06T19:15:12.625574] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-06T19:15:12.740829] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T19:15:13.425505] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-06T19:15:13.517803] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (3.29 seconds). [2025-10-06T19:15:14.225626] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-06T19:15:14.348720] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T19:15:15.025598] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-06T19:15:15.246056] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T19:15:15.793074] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T19:15:15.825477] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-06T19:15:16.126119] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T19:15:16.128535] [INFO ] [REMOTE ] GPOR: Full fetch complete (35044 records). [2025-10-06T19:15:16.128739] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-06T19:15:16.570073] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-06T19:15:16.570183] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-06T19:15:16.571170] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-06T19:15:16.571239] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-06T19:15:16.572253] [DEBUG] [LOCAL ] GPOR: Trimmed 35044 records to 23195 (keeping 200 days of data) [2025-10-06T19:15:16.629594] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-06T19:15:16.741812] [DEBUG] [LOCAL ] GPOR: Primary data saved (23195 records). [2025-10-06T19:15:16.742026] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-06T19:15:16.742164] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPOR took 23.4s. Estimated remaining: 3h 18m 23s. Rate: 7.1 symbols/min [2025-10-06T19:15:16.961448] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:15:16.961814] [DEBUG] [LOCAL ] GPRK: No existing data file found in primary storage. [2025-10-06T19:15:16.961952] [WARN ] [MAIN ] GPRK: No existing data found, performing full refresh instead. [2025-10-06T19:15:16.975379] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-06T19:15:16.976134] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-06T19:15:16.976585] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T19:15:16.976770] [DEBUG] [LOCAL ] GPRK: No primary data file found to delete. [2025-10-06T19:15:16.976954] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-06T19:15:17.426255] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-06T19:15:17.430226] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:15:18.225586] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-06T19:15:18.455914] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T19:15:18.482877] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-06T19:15:19.025564] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-06T19:15:19.659119] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T19:15:19.825567] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-06T19:15:20.625500] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-06T19:15:20.729404] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T19:15:20.754924] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T19:15:21.425510] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-06T19:15:22.214296] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T19:15:22.215990] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T19:15:22.228289] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-06T19:15:22.228421] [INFO ] [REMOTE ] GPMT: Full fetch complete (37215 records). [2025-10-06T19:15:22.229836] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-06T19:15:22.620488] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-06T19:15:22.620584] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-06T19:15:22.621308] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-06T19:15:22.621371] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-06T19:15:22.622330] [DEBUG] [LOCAL ] GPMT: Trimmed 37215 records to 25788 (keeping 200 days of data) [2025-10-06T19:15:22.772122] [DEBUG] [LOCAL ] GPMT: Primary data saved (25788 records). [2025-10-06T19:15:22.772280] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-06T19:15:22.772366] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPMT took 29.5s. Estimated remaining: 3h 18m 11s. Rate: 7.1 symbols/min [2025-10-06T19:15:22.945592] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:15:22.975423] [DEBUG] [LOCAL ] GRBK: Loaded 27305 existing records from primary storage. [2025-10-06T19:15:22.975788] [INFO ] [MAIN ] GRBK: Loaded 27305 existing records. [2025-10-06T19:15:23.033902] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-06T19:15:23.169055] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:15:23.169341] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-06T19:15:23.169393] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-06T19:15:23.169606] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-06T19:15:23.169703] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-06T19:15:23.546059] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:15:23.825533] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-06T19:15:24.039257] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T19:15:24.625487] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-06T19:15:24.816118] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T19:15:24.903867] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T19:15:25.425559] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-06T19:15:26.225607] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-06T19:15:26.333044] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T19:15:26.484888] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T19:15:27.025549] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-06T19:15:27.825556] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-06T19:15:28.018713] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T19:15:28.344171] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T19:15:28.625601] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-06T19:15:29.425492] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-06T19:15:30.025878] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T19:15:30.225631] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-06T19:15:30.418331] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-06T19:15:31.025506] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-06T19:15:31.189493] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-06T19:15:31.192579] [INFO ] [REMOTE ] GPN: Full fetch complete (74938 records). [2025-10-06T19:15:31.192733] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-06T19:15:31.594270] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-06T19:15:31.594503] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-06T19:15:31.595618] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-06T19:15:31.595820] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-06T19:15:31.597468] [DEBUG] [LOCAL ] GPN: Trimmed 74938 records to 52052 (keeping 200 days of data) [2025-10-06T19:15:31.724612] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T19:15:31.846857] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-06T19:15:31.960272] [DEBUG] [LOCAL ] GPN: Primary data saved (52052 records). [2025-10-06T19:15:31.960451] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-06T19:15:31.960543] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPN took 38.6s. Estimated remaining: 3h 18m 4s. Rate: 7.1 symbols/min [2025-10-06T19:15:32.134303] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:15:32.146767] [DEBUG] [LOCAL ] GRC: Loaded 9165 existing records from primary storage. [2025-10-06T19:15:32.147003] [INFO ] [MAIN ] GRC: Loaded 9165 existing records. [2025-10-06T19:15:32.323134] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:15:32.323330] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-06T19:15:32.323377] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-06T19:15:32.323591] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-06T19:15:32.323677] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-06T19:15:32.617539] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T19:15:32.632932] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-06T19:15:32.689213] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:15:32.690362] [INFO ] [REMOTE ] GPK: Full fetch complete (75601 records). [2025-10-06T19:15:32.690748] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-06T19:15:33.081780] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-06T19:15:33.081949] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-06T19:15:33.083032] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-06T19:15:33.083098] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-06T19:15:33.084734] [DEBUG] [LOCAL ] GPK: Trimmed 75601 records to 52659 (keeping 200 days of data) [2025-10-06T19:15:33.420011] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T19:15:33.429266] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-06T19:15:33.455540] [DEBUG] [LOCAL ] GPK: Primary data saved (52659 records). [2025-10-06T19:15:33.455758] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-06T19:15:33.456714] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPK took 40.1s. Estimated remaining: 3h 17m 45s. Rate: 7.1 symbols/min [2025-10-06T19:15:33.630936] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:15:33.655507] [DEBUG] [LOCAL ] GRDN: Loaded 20872 existing records from primary storage. [2025-10-06T19:15:33.655853] [INFO ] [MAIN ] GRDN: Loaded 20872 existing records. [2025-10-06T19:15:33.843119] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:15:33.843505] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-06T19:15:33.843563] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-06T19:15:33.843905] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-06T19:15:33.843965] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-06T19:15:34.036341] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T19:15:34.226377] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:15:34.226485] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-06T19:15:34.235941] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T19:15:35.025584] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-06T19:15:35.825489] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-06T19:15:35.876588] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T19:15:36.273417] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-06T19:15:36.289486] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-06T19:15:36.625534] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-06T19:15:37.425541] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-06T19:15:37.542186] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T19:15:38.225526] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-06T19:15:38.815371] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T19:15:38.989557] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T19:15:39.025538] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-06T19:15:39.825501] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-06T19:15:40.183544] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T19:15:40.625555] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-06T19:15:40.637964] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T19:15:41.417776] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T19:15:41.425468] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-06T19:15:42.162203] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-06T19:15:42.225612] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-06T19:15:43.025533] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-06T19:15:43.136906] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T19:15:43.825502] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-06T19:15:44.506888] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T19:15:44.625514] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-06T19:15:45.067607] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T19:15:45.425516] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-06T19:15:46.225557] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-06T19:15:46.359083] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T19:15:46.372998] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T19:15:47.025554] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-06T19:15:47.046160] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-06T19:15:47.825498] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-06T19:15:48.097611] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T19:15:48.498544] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T19:15:48.625545] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-06T19:15:49.425556] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-06T19:15:49.668066] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T19:15:50.225552] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-06T19:15:50.905675] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T19:15:51.025539] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-06T19:15:51.185859] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T19:15:51.825545] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-06T19:15:52.101689] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-06T19:15:52.625503] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-06T19:15:52.990378] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T19:15:53.425514] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-06T19:15:54.022054] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T19:15:54.025828] [INFO ] [REMOTE ] GPRK: Full fetch complete (57547 records). [2025-10-06T19:15:54.025983] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-06T19:15:54.230711] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-06T19:15:54.423616] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-06T19:15:54.423797] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-06T19:15:54.424858] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-06T19:15:54.424923] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-06T19:15:54.426272] [DEBUG] [LOCAL ] GPRK: Trimmed 57547 records to 39398 (keeping 200 days of data) [2025-10-06T19:15:54.527976] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T19:15:54.675745] [DEBUG] [LOCAL ] GPRK: Primary data saved (39398 records). [2025-10-06T19:15:54.675939] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-06T19:15:54.676018] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPRK took 37.9s. Estimated remaining: 3h 17m 55s. Rate: 7.1 symbols/min [2025-10-06T19:15:54.847840] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:15:54.901380] [DEBUG] [LOCAL ] GRMN: Loaded 41621 existing records from primary storage. [2025-10-06T19:15:54.901769] [INFO ] [MAIN ] GRMN: Loaded 41621 existing records. [2025-10-06T19:15:55.030707] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-06T19:15:55.094521] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:15:55.095139] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-06T19:15:55.095311] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-06T19:15:55.096873] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-06T19:15:55.096945] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-06T19:15:55.408284] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-06T19:15:55.505803] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:15:55.825592] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-06T19:15:56.329604] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-06T19:15:56.625528] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-06T19:15:57.072817] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-06T19:15:57.214232] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T19:15:57.425567] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-06T19:15:58.225490] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-06T19:15:58.617593] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T19:15:59.025689] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-06T19:15:59.367377] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T19:15:59.369213] [INFO ] [REMOTE ] GRDN: Full fetch complete (26304 records). [2025-10-06T19:15:59.369312] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-06T19:15:59.735745] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-06T19:15:59.735859] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-06T19:15:59.736487] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-06T19:15:59.736549] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-06T19:15:59.737286] [DEBUG] [LOCAL ] GRDN: Trimmed 26304 records to 20751 (keeping 200 days of data) [2025-10-06T19:15:59.827679] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-06T19:15:59.851315] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-06T19:15:59.874240] [DEBUG] [LOCAL ] GRDN: Primary data saved (20751 records). [2025-10-06T19:15:59.874389] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-06T19:15:59.874469] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GRDN took 26.4s. Estimated remaining: 3h 17m 42s. Rate: 7.1 symbols/min [2025-10-06T19:16:00.046563] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:16:00.100000] [DEBUG] [LOCAL ] GRND: Loaded 50674 existing records from primary storage. [2025-10-06T19:16:00.100344] [INFO ] [MAIN ] GRND: Loaded 50674 existing records. [2025-10-06T19:16:00.294550] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:16:00.294856] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-06T19:16:00.294910] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-06T19:16:00.295277] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-06T19:16:00.295339] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-06T19:16:00.630737] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-06T19:16:00.662260] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:16:01.425503] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-06T19:16:01.495193] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-06T19:16:01.616895] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T19:16:02.225550] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-06T19:16:03.025603] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-06T19:16:03.100676] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-06T19:16:03.100492] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T19:16:03.110298] [INFO ] [REMOTE ] GRC: Full fetch complete (13275 records). [2025-10-06T19:16:03.110885] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-06T19:16:03.468275] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-06T19:16:03.468393] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-06T19:16:03.468794] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-06T19:16:03.468855] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-06T19:16:03.469333] [DEBUG] [LOCAL ] GRC: Trimmed 13275 records to 9136 (keeping 200 days of data) [2025-10-06T19:16:03.524950] [DEBUG] [LOCAL ] GRC: Primary data saved (9136 records). [2025-10-06T19:16:03.525111] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-06T19:16:03.525214] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRC took 31.6s. Estimated remaining: 3h 17m 27s. Rate: 7.1 symbols/min [2025-10-06T19:16:03.691540] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:16:03.731694] [DEBUG] [LOCAL ] GRNT: Loaded 34272 existing records from primary storage. [2025-10-06T19:16:03.732019] [INFO ] [MAIN ] GRNT: Loaded 34272 existing records. [2025-10-06T19:16:03.830093] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-06T19:16:03.908637] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:16:03.908911] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-06T19:16:03.908958] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-06T19:16:03.910167] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-06T19:16:03.910228] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-06T19:16:04.180551] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-06T19:16:04.198736] [INFO ] [REMOTE ] GRBK: Full fetch complete (40634 records). [2025-10-06T19:16:04.209141] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-06T19:16:04.359966] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:16:04.630769] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-06T19:16:04.653065] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-06T19:16:04.653160] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-06T19:16:04.653952] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-06T19:16:04.654030] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-06T19:16:04.655031] [DEBUG] [LOCAL ] GRBK: Trimmed 40634 records to 27003 (keeping 200 days of data) [2025-10-06T19:16:04.813481] [DEBUG] [LOCAL ] GRBK: Primary data saved (27003 records). [2025-10-06T19:16:04.813660] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-06T19:16:04.813768] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRBK took 42.0s. Estimated remaining: 3h 17m 8s. Rate: 7.1 symbols/min [2025-10-06T19:16:04.985406] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:16:04.996080] [DEBUG] [LOCAL ] GROV: Loaded 8965 existing records from primary storage. [2025-10-06T19:16:04.996376] [INFO ] [MAIN ] GROV: Loaded 8965 existing records. [2025-10-06T19:16:05.190705] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:16:05.190931] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-06T19:16:05.190978] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-06T19:16:05.191381] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-06T19:16:05.191443] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-06T19:16:05.430048] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-06T19:16:05.583371] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:16:05.609041] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T19:16:06.052865] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T19:16:06.225563] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-06T19:16:07.025568] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-06T19:16:07.120385] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T19:16:07.609040] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T19:16:07.825550] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-06T19:16:08.579956] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T19:16:08.625482] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-06T19:16:09.011133] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T19:16:09.425519] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-06T19:16:10.225510] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-06T19:16:10.304823] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T19:16:10.346164] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T19:16:11.025495] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-06T19:16:11.802738] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T19:16:11.825467] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-06T19:16:12.393401] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T19:16:12.625547] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-06T19:16:13.425566] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-06T19:16:13.504483] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T19:16:14.225492] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-06T19:16:14.261073] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T19:16:14.373013] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T19:16:15.025546] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-06T19:16:15.799761] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T19:16:15.825482] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-06T19:16:16.578580] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T19:16:16.625472] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-06T19:16:17.425630] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-06T19:16:17.468732] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T19:16:18.225598] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-06T19:16:18.297375] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T19:16:18.813069] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T19:16:18.984984] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T19:16:19.025530] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-06T19:16:19.825557] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-06T19:16:20.294926] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-06T19:16:20.625537] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-06T19:16:21.337950] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T19:16:21.425489] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-06T19:16:22.118213] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T19:16:22.225484] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-06T19:16:23.006630] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T19:16:23.025468] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-06T19:16:23.543966] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T19:16:23.825531] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-06T19:16:24.488174] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T19:16:24.625536] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-06T19:16:24.639001] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T19:16:25.425531] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-06T19:16:25.964445] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T19:16:26.225517] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-06T19:16:26.952459] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T19:16:27.025562] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-06T19:16:27.585420] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-06T19:16:27.825560] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-06T19:16:28.625547] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-06T19:16:28.747714] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T19:16:29.070762] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-06T19:16:29.214915] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-06T19:16:29.217508] [INFO ] [REMOTE ] GRMN: Full fetch complete (59986 records). [2025-10-06T19:16:29.217638] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-06T19:16:29.435990] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-06T19:16:29.599811] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-06T19:16:29.599903] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-06T19:16:29.600961] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-06T19:16:29.601026] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-06T19:16:29.602228] [DEBUG] [LOCAL ] GRMN: Trimmed 59986 records to 40885 (keeping 200 days of data) [2025-10-06T19:16:29.865315] [DEBUG] [LOCAL ] GRMN: Primary data saved (40885 records). [2025-10-06T19:16:29.865468] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-06T19:16:29.865548] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRMN took 35.2s. Estimated remaining: 3h 17m 24s. Rate: 7.1 symbols/min [2025-10-06T19:16:30.056903] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:16:30.063755] [DEBUG] [LOCAL ] GRX: Loaded 4787 existing records from primary storage. [2025-10-06T19:16:30.064047] [INFO ] [MAIN ] GRX: Loaded 4787 existing records. [2025-10-06T19:16:30.228338] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-06T19:16:30.241837] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:16:30.243352] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-06T19:16:30.243406] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-06T19:16:30.243749] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-06T19:16:30.243825] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-06T19:16:30.594255] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:16:31.025553] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-06T19:16:31.082201] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T19:16:31.334638] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T19:16:31.610599] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T19:16:31.825547] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-06T19:16:32.625530] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-06T19:16:33.176577] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-06T19:16:33.425585] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-06T19:16:33.590254] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T19:16:34.225578] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-06T19:16:34.581840] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T19:16:34.584842] [INFO ] [REMOTE ] GRNT: Full fetch complete (48474 records). [2025-10-06T19:16:34.585023] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-06T19:16:34.776155] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-06T19:16:35.030627] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-06T19:16:35.143906] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-06T19:16:35.144002] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-06T19:16:35.145329] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-06T19:16:35.145394] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-06T19:16:35.146602] [DEBUG] [LOCAL ] GRNT: Trimmed 48474 records to 33784 (keeping 200 days of data) [2025-10-06T19:16:35.365119] [DEBUG] [LOCAL ] GRNT: Primary data saved (33784 records). [2025-10-06T19:16:35.365316] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-06T19:16:35.365429] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRNT took 31.8s. Estimated remaining: 3h 17m 11s. Rate: 7.1 symbols/min [2025-10-06T19:16:35.535955] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:16:35.593209] [DEBUG] [LOCAL ] GS: Loaded 52615 existing records from primary storage. [2025-10-06T19:16:35.593568] [INFO ] [MAIN ] GS: Loaded 52615 existing records. [2025-10-06T19:16:35.696783] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-06T19:16:35.777272] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:16:35.777521] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-06T19:16:35.777594] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-06T19:16:35.778037] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-06T19:16:35.778095] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-06T19:16:35.831532] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-06T19:16:36.136858] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:16:36.625540] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-06T19:16:37.425566] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-06T19:16:37.516804] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-06T19:16:37.519838] [INFO ] [REMOTE ] GRND: Full fetch complete (71038 records). [2025-10-06T19:16:37.520100] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-06T19:16:37.676703] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-06T19:16:37.922619] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-06T19:16:37.922748] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-06T19:16:37.923819] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-06T19:16:37.923886] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-06T19:16:37.925369] [DEBUG] [LOCAL ] GRND: Trimmed 71038 records to 49982 (keeping 200 days of data) [2025-10-06T19:16:38.225553] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-06T19:16:38.237115] [DEBUG] [LOCAL ] GRND: Primary data saved (49982 records). [2025-10-06T19:16:38.237232] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-06T19:16:38.237319] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRND took 38.4s. Estimated remaining: 3h 16m 54s. Rate: 7.1 symbols/min [2025-10-06T19:16:38.414624] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:16:38.453248] [DEBUG] [LOCAL ] GSBD: Loaded 39772 existing records from primary storage. [2025-10-06T19:16:38.453587] [INFO ] [MAIN ] GSBD: Loaded 39772 existing records. [2025-10-06T19:16:38.632176] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:16:38.632416] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-06T19:16:38.632463] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-06T19:16:38.633844] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-06T19:16:38.633905] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-06T19:16:39.042836] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-06T19:16:39.055882] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:16:39.067946] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T19:16:39.321319] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T19:16:39.632468] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-06T19:16:39.825475] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-06T19:16:40.625567] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-06T19:16:41.324938] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T19:16:41.425520] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-06T19:16:41.993492] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-06T19:16:42.085384] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-06T19:16:42.225514] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-06T19:16:43.025529] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-06T19:16:43.597745] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T19:16:43.599456] [INFO ] [REMOTE ] GROV: Full fetch complete (14312 records). [2025-10-06T19:16:43.599853] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-06T19:16:43.832997] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-06T19:16:43.998387] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-06T19:16:43.998606] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-06T19:16:43.999202] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-06T19:16:43.999328] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-06T19:16:44.009106] [DEBUG] [LOCAL ] GROV: Trimmed 14312 records to 8836 (keeping 200 days of data) [2025-10-06T19:16:44.045711] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T19:16:44.085528] [DEBUG] [LOCAL ] GROV: Primary data saved (8836 records). [2025-10-06T19:16:44.085637] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-06T19:16:44.085761] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GROV took 39.3s. Estimated remaining: 3h 16m 42s. Rate: 7.1 symbols/min [2025-10-06T19:16:44.253163] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:16:44.307940] [DEBUG] [LOCAL ] GSK: Loaded 54272 existing records from primary storage. [2025-10-06T19:16:44.308276] [INFO ] [MAIN ] GSK: Loaded 54272 existing records. [2025-10-06T19:16:44.484246] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:16:44.484501] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-06T19:16:44.484606] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-06T19:16:44.486396] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-06T19:16:44.486456] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-06T19:16:44.631999] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-06T19:16:44.834383] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:16:45.311412] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-06T19:16:45.425478] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-06T19:16:45.961689] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-06T19:16:46.225560] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-06T19:16:47.025562] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-06T19:16:47.114049] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T19:16:47.626383] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T19:16:47.825523] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-06T19:16:48.420805] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T19:16:48.474274] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-06T19:16:48.625468] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-06T19:16:49.425516] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-06T19:16:50.007442] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-06T19:16:50.225699] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-06T19:16:51.025573] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-06T19:16:51.391999] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-06T19:16:51.825508] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-06T19:16:52.070050] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T19:16:52.248822] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-06T19:16:52.625531] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-06T19:16:53.425530] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-06T19:16:53.846662] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-06T19:16:54.100196] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T19:16:54.134237] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T19:16:54.225510] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-06T19:16:54.878329] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T19:16:54.879477] [INFO ] [REMOTE ] GRX: Full fetch complete (6692 records). [2025-10-06T19:16:54.879554] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-06T19:16:55.032052] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-06T19:16:55.267545] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-06T19:16:55.267703] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-06T19:16:55.268099] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-06T19:16:55.268159] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-06T19:16:55.268758] [DEBUG] [LOCAL ] GRX: Trimmed 6692 records to 4771 (keeping 200 days of data) [2025-10-06T19:16:55.300098] [DEBUG] [LOCAL ] GRX: Primary data saved (4771 records). [2025-10-06T19:16:55.300313] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-06T19:16:55.300445] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRX took 25.4s. Estimated remaining: 3h 16m 38s. Rate: 7.1 symbols/min [2025-10-06T19:16:55.481758] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:16:55.522213] [DEBUG] [LOCAL ] GSL: Loaded 33701 existing records from primary storage. [2025-10-06T19:16:55.522747] [INFO ] [MAIN ] GSL: Loaded 33701 existing records. [2025-10-06T19:16:55.706893] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:16:55.707294] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-06T19:16:55.707345] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-06T19:16:55.709284] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-06T19:16:55.709352] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-06T19:16:55.830749] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-06T19:16:56.103549] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:16:56.625548] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-06T19:16:56.948321] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T19:16:57.425536] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-06T19:16:57.963166] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-06T19:16:58.225617] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-06T19:16:58.266162] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T19:16:59.025578] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-06T19:16:59.177718] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T19:16:59.825554] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-06T19:17:00.280969] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T19:17:00.495615] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-06T19:17:00.625531] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-06T19:17:01.425549] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-06T19:17:01.887679] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-06T19:17:01.937944] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T19:17:02.225578] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-06T19:17:03.025499] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-06T19:17:03.470678] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-06T19:17:03.625536] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T19:17:03.825526] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-06T19:17:04.625489] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-06T19:17:04.729360] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T19:17:05.425499] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-06T19:17:05.612014] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T19:17:05.894917] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-06T19:17:06.225552] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-06T19:17:06.908315] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T19:17:07.025575] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-06T19:17:07.825573] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-06T19:17:08.194423] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-06T19:17:08.229800] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-06T19:17:08.625590] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-06T19:17:09.425571] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-06T19:17:09.687197] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-06T19:17:09.690398] [INFO ] [REMOTE ] GS: Full fetch complete (75670 records). [2025-10-06T19:17:09.690561] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-06T19:17:10.088105] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-06T19:17:10.088265] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-06T19:17:10.089428] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-06T19:17:10.089494] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-06T19:17:10.090997] [DEBUG] [LOCAL ] GS: Trimmed 75670 records to 51804 (keeping 200 days of data) [2025-10-06T19:17:10.276796] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-06T19:17:10.429297] [DEBUG] [LOCAL ] GS: Primary data saved (51804 records). [2025-10-06T19:17:10.429907] [INFO ] [MAIN ] GS: Full history saved. [2025-10-06T19:17:10.431332] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GS took 35.1s. Estimated remaining: 3h 16m 39s. Rate: 7.1 symbols/min [2025-10-06T19:17:10.604026] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:17:10.655745] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-06T19:17:10.683366] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T19:17:10.731993] [DEBUG] [LOCAL ] GTES: Loaded 51249 existing records from primary storage. [2025-10-06T19:17:10.732386] [INFO ] [MAIN ] GTES: Loaded 51249 existing records. [2025-10-06T19:17:10.909710] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:17:10.909984] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-06T19:17:10.910049] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-06T19:17:10.910382] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-06T19:17:10.910439] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-06T19:17:11.030746] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-06T19:17:11.284390] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:17:11.727554] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T19:17:11.825564] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-06T19:17:12.547803] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-06T19:17:12.550595] [INFO ] [REMOTE ] GSBD: Full fetch complete (58495 records). [2025-10-06T19:17:12.550732] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-06T19:17:12.630623] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-06T19:17:12.930678] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-06T19:17:12.930780] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-06T19:17:12.931689] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-06T19:17:12.931752] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-06T19:17:12.932964] [DEBUG] [LOCAL ] GSBD: Trimmed 58495 records to 39199 (keeping 200 days of data) [2025-10-06T19:17:13.180529] [DEBUG] [LOCAL ] GSBD: Primary data saved (39199 records). [2025-10-06T19:17:13.180862] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-06T19:17:13.180992] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GSBD took 34.9s. Estimated remaining: 3h 16m 22s. Rate: 7.1 symbols/min [2025-10-06T19:17:13.397795] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:17:13.401851] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T19:17:13.425516] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-06T19:17:13.463029] [DEBUG] [LOCAL ] GTLS: Loaded 43398 existing records from primary storage. [2025-10-06T19:17:13.463439] [INFO ] [MAIN ] GTLS: Loaded 43398 existing records. [2025-10-06T19:17:13.646821] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:17:13.647147] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-06T19:17:13.647199] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-06T19:17:13.647835] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-06T19:17:13.647908] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-06T19:17:14.009332] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:17:14.225599] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-06T19:17:14.631773] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-06T19:17:14.899117] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-06T19:17:15.025513] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-06T19:17:15.825522] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-06T19:17:15.962298] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T19:17:16.625559] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-06T19:17:16.739009] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T19:17:17.424164] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T19:17:17.433056] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-06T19:17:18.225497] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-06T19:17:18.344679] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T19:17:18.928101] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T19:17:19.025595] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-06T19:17:19.542596] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T19:17:19.825561] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-06T19:17:20.363882] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T19:17:20.625543] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-06T19:17:21.425536] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-06T19:17:21.809293] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-06T19:17:22.066668] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T19:17:22.225546] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-06T19:17:22.736085] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T19:17:23.025575] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-06T19:17:23.741623] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T19:17:23.825515] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-06T19:17:24.625569] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-06T19:17:24.699412] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T19:17:25.301192] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T19:17:25.425511] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-06T19:17:26.225509] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-06T19:17:26.337220] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T19:17:26.340887] [INFO ] [REMOTE ] GSK: Full fetch complete (77475 records). [2025-10-06T19:17:26.341076] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-06T19:17:26.825694] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-06T19:17:26.825838] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-06T19:17:26.827020] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-06T19:17:26.827119] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-06T19:17:26.829299] [DEBUG] [LOCAL ] GSK: Trimmed 77475 records to 53496 (keeping 200 days of data) [2025-10-06T19:17:26.982045] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T19:17:27.029589] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-06T19:17:27.295090] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T19:17:27.329611] [DEBUG] [LOCAL ] GSK: Primary data saved (53496 records). [2025-10-06T19:17:27.329856] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-06T19:17:27.331245] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GSK took 43.2s. Estimated remaining: 3h 16m 22s. Rate: 7.1 symbols/min [2025-10-06T19:17:27.585113] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:17:27.639109] [DEBUG] [LOCAL ] GTN: Loaded 46115 existing records from primary storage. [2025-10-06T19:17:27.639483] [INFO ] [MAIN ] GTN: Loaded 46115 existing records. [2025-10-06T19:17:27.848895] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-06T19:17:27.856845] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:17:27.857889] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-06T19:17:27.857949] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-06T19:17:27.858307] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-06T19:17:27.858366] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-06T19:17:28.263019] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:17:28.625531] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-06T19:17:28.783576] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T19:17:29.269213] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T19:17:29.425582] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-06T19:17:30.225511] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-06T19:17:30.290700] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T19:17:30.799997] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T19:17:31.025549] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-06T19:17:31.825519] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-06T19:17:31.968348] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T19:17:32.083705] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T19:17:32.085844] [INFO ] [REMOTE ] GSL: Full fetch complete (47899 records). [2025-10-06T19:17:32.085927] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-06T19:17:32.541475] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-06T19:17:32.541578] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-06T19:17:32.542582] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-06T19:17:32.542672] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-06T19:17:32.543993] [DEBUG] [LOCAL ] GSL: Trimmed 47899 records to 33204 (keeping 200 days of data) [2025-10-06T19:17:32.648458] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-06T19:17:32.774044] [DEBUG] [LOCAL ] GSL: Primary data saved (33204 records). [2025-10-06T19:17:32.774239] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-06T19:17:32.774340] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSL took 37.5s. Estimated remaining: 3h 16m 9s. Rate: 7.1 symbols/min [2025-10-06T19:17:32.958375] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:17:32.993678] [DEBUG] [LOCAL ] GTY: Loaded 30751 existing records from primary storage. [2025-10-06T19:17:32.994023] [INFO ] [MAIN ] GTY: Loaded 30751 existing records. [2025-10-06T19:17:33.186610] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:17:33.186995] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-06T19:17:33.187052] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-06T19:17:33.187455] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-06T19:17:33.187516] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-06T19:17:33.427325] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-06T19:17:33.597018] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-06T19:17:33.601153] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:17:33.730662] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T19:17:34.225531] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-06T19:17:35.009567] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T19:17:35.025470] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-06T19:17:35.794162] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T19:17:35.825483] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-06T19:17:36.625542] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-06T19:17:36.677498] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T19:17:37.425551] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-06T19:17:37.552203] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T19:17:38.201547] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T19:17:38.225481] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-06T19:17:38.832004] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T19:17:39.025566] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-06T19:17:39.825589] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-06T19:17:39.968365] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T19:17:40.526423] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T19:17:40.625495] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-06T19:17:40.649135] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T19:17:41.425534] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-06T19:17:42.225509] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-06T19:17:42.443307] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T19:17:42.990058] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T19:17:43.025507] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-06T19:17:43.578376] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T19:17:43.581626] [INFO ] [REMOTE ] GTLS: Full fetch complete (61408 records). [2025-10-06T19:17:43.581817] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-06T19:17:43.830833] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-06T19:17:43.981234] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-06T19:17:43.981327] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-06T19:17:43.982339] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-06T19:17:43.982446] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-06T19:17:43.983829] [DEBUG] [LOCAL ] GTLS: Trimmed 61408 records to 42958 (keeping 200 days of data) [2025-10-06T19:17:44.245636] [DEBUG] [LOCAL ] GTLS: Primary data saved (42958 records). [2025-10-06T19:17:44.245836] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-06T19:17:44.245981] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GTLS took 31.1s. Estimated remaining: 3h 16m 5s. Rate: 7.1 symbols/min [2025-10-06T19:17:44.421407] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:17:44.435693] [DEBUG] [LOCAL ] GUG: Loaded 12272 existing records from primary storage. [2025-10-06T19:17:44.435954] [INFO ] [MAIN ] GUG: Loaded 12272 existing records. [2025-10-06T19:17:44.546400] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-06T19:17:44.566235] [INFO ] [REMOTE ] GTES: Full fetch complete (73848 records). [2025-10-06T19:17:44.595243] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-06T19:17:44.649513] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-06T19:17:44.670898] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:17:44.691712] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-06T19:17:44.708233] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-06T19:17:44.734419] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-06T19:17:44.746306] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-06T19:17:45.384629] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-06T19:17:45.379155] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T19:17:45.397736] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-06T19:17:45.414981] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-06T19:17:45.425322] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-06T19:17:45.431146] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-06T19:17:45.494015] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:17:45.494219] [DEBUG] [LOCAL ] GTES: Trimmed 73848 records to 50481 (keeping 200 days of data) [2025-10-06T19:17:45.788564] [DEBUG] [LOCAL ] GTES: Primary data saved (50481 records). [2025-10-06T19:17:45.788755] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-06T19:17:45.789464] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTES took 35.4s. Estimated remaining: 3h 15m 47s. Rate: 7.1 symbols/min [2025-10-06T19:17:45.963006] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:17:45.981898] [DEBUG] [LOCAL ] GUT: Loaded 15460 existing records from primary storage. [2025-10-06T19:17:45.982201] [INFO ] [MAIN ] GUT: Loaded 15460 existing records. [2025-10-06T19:17:46.168053] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:17:46.168445] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-06T19:17:46.168504] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-06T19:17:46.168752] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-06T19:17:46.168810] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-06T19:17:46.227741] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-06T19:17:46.533079] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-06T19:17:46.610731] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:17:46.739919] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T19:17:46.986349] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-06T19:17:47.025517] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-06T19:17:47.825558] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-06T19:17:48.394016] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T19:17:48.625571] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-06T19:17:48.819607] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T19:17:49.425587] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-06T19:17:50.095953] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-06T19:17:50.225532] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-06T19:17:50.417288] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T19:17:51.025553] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-06T19:17:51.825496] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-06T19:17:51.921570] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T19:17:52.288798] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T19:17:52.580182] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-06T19:17:52.625505] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-06T19:17:53.425521] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-06T19:17:53.582574] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T19:17:54.225496] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-06T19:17:54.628255] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T19:17:55.025543] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-06T19:17:55.768797] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T19:17:55.825485] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-06T19:17:56.419214] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T19:17:56.625537] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-06T19:17:57.390574] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T19:17:57.406699] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T19:17:57.425478] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-06T19:17:58.225572] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-06T19:17:58.747811] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T19:17:58.750850] [INFO ] [REMOTE ] GTN: Full fetch complete (66357 records). [2025-10-06T19:17:58.751017] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-06T19:17:59.030723] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-06T19:17:59.152222] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-06T19:17:59.161171] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-06T19:17:59.162838] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-06T19:17:59.163585] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-06T19:17:59.164045] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T19:17:59.171442] [DEBUG] [LOCAL ] GTN: Trimmed 66357 records to 45354 (keeping 200 days of data) [2025-10-06T19:17:59.458678] [DEBUG] [LOCAL ] GTN: Primary data saved (45354 records). [2025-10-06T19:17:59.458867] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-06T19:17:59.458970] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTN took 32.1s. Estimated remaining: 3h 15m 46s. Rate: 7.1 symbols/min [2025-10-06T19:17:59.658856] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:17:59.704935] [DEBUG] [LOCAL ] GVA: Loaded 33604 existing records from primary storage. [2025-10-06T19:17:59.705465] [INFO ] [MAIN ] GVA: Loaded 33604 existing records. [2025-10-06T19:17:59.830682] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-06T19:17:59.946378] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:17:59.946729] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-06T19:17:59.946799] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-06T19:17:59.947094] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-06T19:17:59.947157] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-06T19:18:00.298340] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-06T19:18:00.373196] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:18:00.625496] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-06T19:18:00.978914] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-06T19:18:01.425627] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-06T19:18:01.631017] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T19:18:01.998014] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T19:18:02.225591] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-06T19:18:03.025500] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-06T19:18:03.150594] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T19:18:03.825547] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-06T19:18:04.450198] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T19:18:04.452336] [INFO ] [REMOTE ] GTY: Full fetch complete (43659 records). [2025-10-06T19:18:04.452427] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-06T19:18:04.635235] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-06T19:18:04.781989] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-06T19:18:04.888563] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-06T19:18:04.888792] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-06T19:18:04.889822] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-06T19:18:04.889889] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-06T19:18:04.891294] [DEBUG] [LOCAL ] GTY: Trimmed 43659 records to 30203 (keeping 200 days of data) [2025-10-06T19:18:05.076503] [DEBUG] [LOCAL ] GTY: Primary data saved (30203 records). [2025-10-06T19:18:05.076703] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-06T19:18:05.076846] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTY took 32.3s. Estimated remaining: 3h 15m 33s. Rate: 7.1 symbols/min [2025-10-06T19:18:05.264821] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:18:05.286372] [DEBUG] [LOCAL ] GWH: Loaded 16446 existing records from primary storage. [2025-10-06T19:18:05.286722] [INFO ] [MAIN ] GWH: Loaded 16446 existing records. [2025-10-06T19:18:05.430707] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-06T19:18:05.490928] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:18:05.491550] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-06T19:18:05.491627] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-06T19:18:05.491888] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-06T19:18:05.491951] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-06T19:18:05.866728] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T19:18:05.870956] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:18:06.225554] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-06T19:18:06.963951] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T19:18:07.025581] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-06T19:18:07.147516] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T19:18:07.825551] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-06T19:18:07.928806] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T19:18:08.625552] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-06T19:18:09.186566] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T19:18:09.399906] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T19:18:09.425489] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-06T19:18:10.225539] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-06T19:18:10.263254] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T19:18:11.025567] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-06T19:18:11.575264] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T19:18:11.825570] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-06T19:18:12.008676] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T19:18:12.625615] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-06T19:18:13.415229] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T19:18:13.425461] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-06T19:18:13.479426] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-06T19:18:14.225636] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-06T19:18:14.951899] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T19:18:14.980626] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T19:18:15.025530] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-06T19:18:15.825502] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-06T19:18:15.892058] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-06T19:18:16.625536] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-06T19:18:17.296079] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T19:18:17.425476] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-06T19:18:17.453951] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-06T19:18:18.225588] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-06T19:18:18.710785] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T19:18:19.025557] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-06T19:18:19.289316] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-06T19:18:19.454949] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-06T19:18:19.825592] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-06T19:18:20.379862] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-06T19:18:20.625540] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-06T19:18:21.425544] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-06T19:18:22.012899] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T19:18:22.225514] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-06T19:18:22.407112] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T19:18:23.025546] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-06T19:18:23.696530] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T19:18:23.825523] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-06T19:18:24.169890] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T19:18:24.625552] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-06T19:18:24.718300] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-06T19:18:25.404571] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T19:18:25.405910] [INFO ] [REMOTE ] GUG: Full fetch complete (19728 records). [2025-10-06T19:18:25.405981] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-06T19:18:25.434789] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-06T19:18:25.778756] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-06T19:18:25.778900] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-06T19:18:25.779385] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-06T19:18:25.779447] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-06T19:18:25.780024] [DEBUG] [LOCAL ] GUG: Trimmed 19728 records to 12145 (keeping 200 days of data) [2025-10-06T19:18:25.855479] [DEBUG] [LOCAL ] GUG: Primary data saved (12145 records). [2025-10-06T19:18:25.855680] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-06T19:18:25.855796] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GUG took 41.6s. Estimated remaining: 3h 15m 42s. Rate: 7.1 symbols/min [2025-10-06T19:18:26.035714] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:18:26.086735] [DEBUG] [LOCAL ] GWRE: Loaded 41111 existing records from primary storage. [2025-10-06T19:18:26.087199] [INFO ] [MAIN ] GWRE: Loaded 41111 existing records. [2025-10-06T19:18:26.234785] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-06T19:18:26.278613] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:18:26.279053] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-06T19:18:26.279102] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-06T19:18:26.279388] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-06T19:18:26.279445] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-06T19:18:26.637239] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-06T19:18:26.713872] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:18:27.025555] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-06T19:18:27.592794] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-06T19:18:27.825538] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-06T19:18:28.225151] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T19:18:28.227424] [INFO ] [REMOTE ] GVA: Full fetch complete (48561 records). [2025-10-06T19:18:28.227522] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-06T19:18:28.604476] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-06T19:18:28.604568] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-06T19:18:28.605403] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-06T19:18:28.605465] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-06T19:18:28.607155] [DEBUG] [LOCAL ] GVA: Trimmed 48561 records to 33051 (keeping 200 days of data) [2025-10-06T19:18:28.663082] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-06T19:18:28.819295] [DEBUG] [LOCAL ] GVA: Primary data saved (33051 records). [2025-10-06T19:18:28.819467] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-06T19:18:28.819552] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GVA took 29.4s. Estimated remaining: 3h 15m 26s. Rate: 7.1 symbols/min [2025-10-06T19:18:28.961520] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T19:18:29.022877] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:18:29.047210] [DEBUG] [LOCAL ] GWW: Loaded 19715 existing records from primary storage. [2025-10-06T19:18:29.047556] [INFO ] [MAIN ] GWW: Loaded 19715 existing records. [2025-10-06T19:18:29.268719] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:18:29.269054] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-06T19:18:29.269113] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-06T19:18:29.269361] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-06T19:18:29.269419] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-06T19:18:29.427624] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-06T19:18:29.634193] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:18:29.745407] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-06T19:18:30.225579] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-06T19:18:31.025513] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-06T19:18:31.269807] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T19:18:31.315886] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T19:18:31.808969] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T19:18:31.810519] [INFO ] [REMOTE ] GUT: Full fetch complete (22736 records). [2025-10-06T19:18:31.810627] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-06T19:18:31.833485] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-06T19:18:32.212822] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-06T19:18:32.212992] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-06T19:18:32.213599] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-06T19:18:32.213694] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-06T19:18:32.214413] [DEBUG] [LOCAL ] GUT: Trimmed 22736 records to 15409 (keeping 200 days of data) [2025-10-06T19:18:32.305504] [DEBUG] [LOCAL ] GUT: Primary data saved (15409 records). [2025-10-06T19:18:32.305709] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-06T19:18:32.305813] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GUT took 46.5s. Estimated remaining: 3h 15m 11s. Rate: 7.1 symbols/min [2025-10-06T19:18:32.477037] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:18:32.527353] [DEBUG] [LOCAL ] GXO: Loaded 48019 existing records from primary storage. [2025-10-06T19:18:32.527758] [INFO ] [MAIN ] GXO: Loaded 48019 existing records. [2025-10-06T19:18:32.626842] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-06T19:18:32.710802] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:18:32.711489] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-06T19:18:32.711687] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-06T19:18:32.712029] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-06T19:18:32.712086] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-06T19:18:33.034340] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-06T19:18:33.099856] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:18:33.425535] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-06T19:18:34.225504] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-06T19:18:34.375063] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T19:18:35.025546] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-06T19:18:35.102434] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T19:18:35.369548] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T19:18:35.825562] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-06T19:18:36.513199] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T19:18:36.625550] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-06T19:18:36.870025] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T19:18:37.425541] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-06T19:18:37.689787] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T19:18:37.692147] [INFO ] [REMOTE ] GWH: Full fetch complete (21646 records). [2025-10-06T19:18:37.692230] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-06T19:18:38.079014] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-06T19:18:38.079111] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-06T19:18:38.079722] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-06T19:18:38.079787] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-06T19:18:38.080525] [DEBUG] [LOCAL ] GWH: Trimmed 21646 records to 16637 (keeping 200 days of data) [2025-10-06T19:18:38.185561] [DEBUG] [LOCAL ] GWH: Primary data saved (16637 records). [2025-10-06T19:18:38.185796] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-06T19:18:38.185918] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GWH took 33.1s. Estimated remaining: 3h 14m 59s. Rate: 7.1 symbols/min [2025-10-06T19:18:38.233946] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-06T19:18:38.379633] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:18:38.384233] [DEBUG] [LOCAL ] GYLD: Loaded 1558 existing records from primary storage. [2025-10-06T19:18:38.384391] [INFO ] [MAIN ] GYLD: Loaded 1558 existing records. [2025-10-06T19:18:38.595494] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:18:38.596187] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-06T19:18:38.596519] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-06T19:18:38.596821] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-06T19:18:38.612180] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-06T19:18:38.654395] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T19:18:39.024003] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:18:39.025484] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-06T19:18:39.406247] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-06T19:18:39.825493] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-06T19:18:39.978844] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T19:18:40.625524] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-06T19:18:41.382420] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T19:18:41.425481] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-06T19:18:42.231196] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-06T19:18:42.236544] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T19:18:42.678214] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T19:18:43.025694] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-06T19:18:43.411343] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T19:18:43.825540] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-06T19:18:44.173087] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-06T19:18:44.214343] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T19:18:44.625555] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-06T19:18:45.425590] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-06T19:18:46.225527] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-06T19:18:46.300256] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T19:18:46.512086] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T19:18:47.025570] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-06T19:18:47.747628] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T19:18:47.775419] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T19:18:47.825541] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-06T19:18:48.625552] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-06T19:18:48.921544] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T19:18:49.425543] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-06T19:18:50.225498] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-06T19:18:50.320532] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T19:18:50.540401] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-06T19:18:50.586055] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-06T19:18:51.025562] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-06T19:18:51.457035] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-06T19:18:51.825604] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-06T19:18:52.625552] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-06T19:18:53.435913] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-06T19:18:53.441138] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T19:18:53.872070] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-06T19:18:54.094693] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T19:18:54.225506] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-06T19:18:55.025615] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-06T19:18:55.796957] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T19:18:55.825487] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-06T19:18:56.462952] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T19:18:56.625525] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-06T19:18:57.005373] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-06T19:18:57.051296] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-06T19:18:57.425555] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-06T19:18:58.225587] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-06T19:18:58.865800] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-06T19:18:58.903285] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T19:18:59.025583] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-06T19:18:59.825556] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-06T19:19:00.404520] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T19:19:00.407381] [INFO ] [REMOTE ] GWRE: Full fetch complete (60862 records). [2025-10-06T19:19:00.407686] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-06T19:19:00.631264] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-06T19:19:00.827480] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-06T19:19:00.827681] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-06T19:19:00.828921] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-06T19:19:00.828989] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-06T19:19:00.830813] [DEBUG] [LOCAL ] GWRE: Trimmed 60862 records to 40309 (keeping 200 days of data) [2025-10-06T19:19:01.098115] [DEBUG] [LOCAL ] GWRE: Primary data saved (40309 records). [2025-10-06T19:19:01.098302] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-06T19:19:01.098407] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWRE took 35.2s. Estimated remaining: 3h 15m 11s. Rate: 7.1 symbols/min [2025-10-06T19:19:01.209127] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-06T19:19:01.288978] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:19:01.343427] [DEBUG] [LOCAL ] H: Loaded 45308 existing records from primary storage. [2025-10-06T19:19:01.343930] [INFO ] [MAIN ] H: Loaded 45308 existing records. [2025-10-06T19:19:01.428567] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-06T19:19:01.587258] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T19:19:01.592125] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:19:01.602629] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-06T19:19:01.602769] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-06T19:19:01.604178] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-06T19:19:01.604253] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-06T19:19:02.020515] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:19:02.225535] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-06T19:19:02.662520] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-06T19:19:03.025606] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-06T19:19:03.530926] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-06T19:19:03.665152] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T19:19:03.825555] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-06T19:19:04.625615] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-06T19:19:04.863635] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-06T19:19:04.865236] [INFO ] [REMOTE ] GWW: Full fetch complete (29284 records). [2025-10-06T19:19:04.865310] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-06T19:19:05.239298] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-06T19:19:05.239392] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-06T19:19:05.240243] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-06T19:19:05.240308] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-06T19:19:05.241128] [DEBUG] [LOCAL ] GWW: Trimmed 29284 records to 19489 (keeping 200 days of data) [2025-10-06T19:19:05.366715] [DEBUG] [LOCAL ] GWW: Primary data saved (19489 records). [2025-10-06T19:19:05.366901] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-06T19:19:05.366994] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWW took 36.5s. Estimated remaining: 3h 14m 56s. Rate: 7.1 symbols/min [2025-10-06T19:19:05.430854] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-06T19:19:05.541019] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:19:05.584692] [DEBUG] [LOCAL ] HAE: Loaded 40132 existing records from primary storage. [2025-10-06T19:19:05.585092] [INFO ] [MAIN ] HAE: Loaded 40132 existing records. [2025-10-06T19:19:05.769118] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:19:05.769376] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-06T19:19:05.769424] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-06T19:19:05.769717] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-06T19:19:05.769788] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-06T19:19:06.141180] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:19:06.161612] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T19:19:06.225519] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-06T19:19:07.025593] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-06T19:19:07.141237] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T19:19:07.326073] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-06T19:19:07.598917] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T19:19:07.825530] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-06T19:19:08.625606] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-06T19:19:09.260431] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T19:19:09.425599] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-06T19:19:09.808303] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T19:19:09.809142] [INFO ] [REMOTE ] GYLD: Full fetch complete (2074 records). [2025-10-06T19:19:09.809220] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-06T19:19:10.146587] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T19:19:10.230251] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-06T19:19:10.256739] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-06T19:19:10.256847] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-06T19:19:10.256973] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-06T19:19:10.257015] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-06T19:19:10.257403] [DEBUG] [LOCAL ] GYLD: Trimmed 2074 records to 1533 (keeping 200 days of data) [2025-10-06T19:19:10.268257] [DEBUG] [LOCAL ] GYLD: Primary data saved (1533 records). [2025-10-06T19:19:10.268334] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-06T19:19:10.268446] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GYLD took 32.1s. Estimated remaining: 3h 14m 43s. Rate: 7.1 symbols/min [2025-10-06T19:19:10.454705] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:19:10.502863] [DEBUG] [LOCAL ] HAFN: Loaded 43932 existing records from primary storage. [2025-10-06T19:19:10.503263] [INFO ] [MAIN ] HAFN: Loaded 43932 existing records. [2025-10-06T19:19:10.689030] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:19:10.689326] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-06T19:19:10.689374] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-06T19:19:10.689900] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-06T19:19:10.689968] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-06T19:19:11.030806] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-06T19:19:11.108397] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:19:11.740995] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T19:19:11.744116] [INFO ] [REMOTE ] GXO: Full fetch complete (69889 records). [2025-10-06T19:19:11.744256] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-06T19:19:11.830735] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-06T19:19:12.174688] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-06T19:19:12.174916] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-06T19:19:12.176329] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-06T19:19:12.176401] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-06T19:19:12.178359] [DEBUG] [LOCAL ] GXO: Trimmed 69889 records to 47204 (keeping 200 days of data) [2025-10-06T19:19:12.483257] [DEBUG] [LOCAL ] GXO: Primary data saved (47204 records). [2025-10-06T19:19:12.483489] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-06T19:19:12.483624] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GXO took 40.2s. Estimated remaining: 3h 14m 26s. Rate: 7.1 symbols/min [2025-10-06T19:19:12.629056] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-06T19:19:12.693069] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:19:12.757809] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T19:19:12.788483] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-10-06T19:19:12.789005] [INFO ] [MAIN ] HAL: Loaded 54498 existing records. [2025-10-06T19:19:12.981551] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:19:12.981900] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-06T19:19:12.981976] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-06T19:19:12.982282] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-06T19:19:12.982341] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-06T19:19:13.362096] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:19:13.425517] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-06T19:19:13.527523] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T19:19:14.225621] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-06T19:19:14.487743] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T19:19:15.036859] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-06T19:19:15.044140] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T19:19:15.489605] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T19:19:15.825542] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-06T19:19:16.625523] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-06T19:19:16.778756] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T19:19:17.289878] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T19:19:17.425538] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-06T19:19:17.873349] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T19:19:18.225536] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-06T19:19:18.827920] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T19:19:19.025564] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-06T19:19:19.736412] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T19:19:19.825475] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-06T19:19:20.450805] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T19:19:20.625542] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-06T19:19:21.388974] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T19:19:21.425518] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-06T19:19:22.080894] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T19:19:22.225556] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-06T19:19:22.978366] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T19:19:23.025548] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-06T19:19:23.781250] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T19:19:23.825495] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-06T19:19:24.551333] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T19:19:24.625512] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-06T19:19:25.425568] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-06T19:19:25.742182] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T19:19:25.759885] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T19:19:25.762697] [INFO ] [REMOTE ] H: Full fetch complete (62334 records). [2025-10-06T19:19:25.762857] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-06T19:19:26.191377] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-06T19:19:26.191481] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-06T19:19:26.192430] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-06T19:19:26.192497] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-06T19:19:26.194062] [DEBUG] [LOCAL ] H: Trimmed 62334 records to 44555 (keeping 200 days of data) [2025-10-06T19:19:26.250715] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-06T19:19:26.476217] [DEBUG] [LOCAL ] H: Primary data saved (44555 records). [2025-10-06T19:19:26.476389] [INFO ] [MAIN ] H: Full history saved. [2025-10-06T19:19:26.476479] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. H took 25.4s. Estimated remaining: 3h 14m 25s. Rate: 7.1 symbols/min [2025-10-06T19:19:26.646193] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:19:26.692468] [DEBUG] [LOCAL ] HASI: Loaded 47850 existing records from primary storage. [2025-10-06T19:19:26.692884] [INFO ] [MAIN ] HASI: Loaded 47850 existing records. [2025-10-06T19:19:26.875972] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:19:26.876305] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-06T19:19:26.876362] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-06T19:19:26.876734] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-06T19:19:26.876793] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-06T19:19:27.027414] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-06T19:19:27.267080] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:19:27.292599] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-06T19:19:27.825612] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-06T19:19:28.112361] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-06T19:19:28.625555] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-06T19:19:28.688544] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T19:19:29.425600] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-06T19:19:29.589348] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T19:19:30.184327] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T19:19:30.225570] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-06T19:19:31.025526] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-06T19:19:31.455869] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-06T19:19:31.825512] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-06T19:19:32.077314] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T19:19:32.215375] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T19:19:32.625548] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-06T19:19:33.425551] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-06T19:19:33.632633] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T19:19:33.906427] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-06T19:19:34.225537] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-06T19:19:34.974386] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T19:19:35.025486] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-06T19:19:35.767384] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T19:19:35.825518] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-06T19:19:36.490578] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T19:19:36.493190] [INFO ] [REMOTE ] HAE: Full fetch complete (58434 records). [2025-10-06T19:19:36.493275] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-06T19:19:36.632686] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-06T19:19:36.875075] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-06T19:19:36.875160] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-06T19:19:36.876060] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-06T19:19:36.876122] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-06T19:19:36.877356] [DEBUG] [LOCAL ] HAE: Trimmed 58434 records to 39450 (keeping 200 days of data) [2025-10-06T19:19:37.112037] [DEBUG] [LOCAL ] HAE: Primary data saved (39450 records). [2025-10-06T19:19:37.112213] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-06T19:19:37.112371] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. HAE took 31.7s. Estimated remaining: 3h 14m 20s. Rate: 7.1 symbols/min [2025-10-06T19:19:37.306529] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:19:37.310840] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T19:19:37.375459] [DEBUG] [LOCAL ] HAYW: Loaded 49424 existing records from primary storage. [2025-10-06T19:19:37.375852] [INFO ] [MAIN ] HAYW: Loaded 49424 existing records. [2025-10-06T19:19:37.430622] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-06T19:19:37.556684] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:19:37.556914] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-06T19:19:37.556963] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-06T19:19:37.557701] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-06T19:19:37.557792] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-06T19:19:37.911811] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:19:38.225585] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-06T19:19:38.799290] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-06T19:19:38.851336] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T19:19:39.025558] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-06T19:19:39.825572] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-06T19:19:39.888059] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T19:19:40.625551] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-06T19:19:40.912553] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-06T19:19:41.425502] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-06T19:19:41.468857] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T19:19:42.138595] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T19:19:42.225519] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-06T19:19:42.596298] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T19:19:43.025711] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-06T19:19:43.697075] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T19:19:43.825528] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-06T19:19:44.430693] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T19:19:44.625583] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-06T19:19:45.367939] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T19:19:45.425511] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-06T19:19:46.150279] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T19:19:46.225532] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-06T19:19:46.774430] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T19:19:47.025590] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-06T19:19:47.830724] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-06T19:19:47.845991] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T19:19:48.610197] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T19:19:48.625466] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-06T19:19:49.355979] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T19:19:49.425558] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-06T19:19:50.225540] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-06T19:19:50.255665] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T19:19:51.001830] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T19:19:51.025549] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-06T19:19:51.825557] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-06T19:19:52.244328] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-06T19:19:52.625552] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-06T19:19:52.686251] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T19:19:53.297681] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T19:19:53.300392] [INFO ] [REMOTE ] HAFN: Full fetch complete (65356 records). [2025-10-06T19:19:53.300529] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-06T19:19:53.430746] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-06T19:19:53.703589] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-06T19:19:53.703745] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-06T19:19:53.704738] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-06T19:19:53.704823] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-06T19:19:53.706292] [DEBUG] [LOCAL ] HAFN: Trimmed 65356 records to 43169 (keeping 200 days of data) [2025-10-06T19:19:53.965002] [DEBUG] [LOCAL ] HAFN: Primary data saved (43169 records). [2025-10-06T19:19:53.965174] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-06T19:19:53.965304] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAFN took 43.7s. Estimated remaining: 3h 14m 23s. Rate: 7.1 symbols/min [2025-10-06T19:19:54.138381] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:19:54.148628] [DEBUG] [LOCAL ] HBB: Loaded 6659 existing records from primary storage. [2025-10-06T19:19:54.148893] [INFO ] [MAIN ] HBB: Loaded 6659 existing records. [2025-10-06T19:19:54.228964] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-06T19:19:54.331065] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:19:54.331395] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-06T19:19:54.331466] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-06T19:19:54.331769] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-06T19:19:54.331844] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-06T19:19:54.470218] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T19:19:54.726516] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:19:55.025481] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-06T19:19:55.521309] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-06T19:19:55.805201] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-06T19:19:55.825486] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-06T19:19:55.965485] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T19:19:56.441441] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T19:19:56.625602] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-06T19:19:57.257087] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-06T19:19:57.425549] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-06T19:19:58.225617] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-06T19:19:59.025612] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-06T19:19:59.246047] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T19:19:59.825546] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-06T19:19:59.923209] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T19:20:00.620317] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T19:20:00.630301] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-06T19:20:01.371197] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T19:20:01.425578] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-06T19:20:01.665631] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-06T19:20:01.669446] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-10-06T19:20:01.669623] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-06T19:20:02.156012] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-06T19:20:02.156163] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-06T19:20:02.157833] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-06T19:20:02.157917] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-06T19:20:02.160243] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-10-06T19:20:02.229232] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-06T19:20:02.408872] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T19:20:02.581215] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-06T19:20:02.581448] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-06T19:20:02.581813] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAL took 50.1s. Estimated remaining: 3h 14m 15s. Rate: 7.1 symbols/min [2025-10-06T19:20:02.848437] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:20:02.908912] [DEBUG] [LOCAL ] HBI: Loaded 53763 existing records from primary storage. [2025-10-06T19:20:02.909418] [INFO ] [MAIN ] HBI: Loaded 53763 existing records. [2025-10-06T19:20:03.030757] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-06T19:20:03.108866] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:20:03.109160] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-06T19:20:03.109211] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-06T19:20:03.109500] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-06T19:20:03.109560] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-06T19:20:03.479391] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:20:03.716310] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T19:20:03.719639] [INFO ] [REMOTE ] HAYW: Full fetch complete (70860 records). [2025-10-06T19:20:03.720083] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-06T19:20:03.828001] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-06T19:20:03.932452] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T19:20:04.173407] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-06T19:20:04.173511] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-06T19:20:04.174876] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-06T19:20:04.174946] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-06T19:20:04.176693] [DEBUG] [LOCAL ] HAYW: Trimmed 70860 records to 48771 (keeping 200 days of data) [2025-10-06T19:20:04.485559] [DEBUG] [LOCAL ] HAYW: Primary data saved (48771 records). [2025-10-06T19:20:04.486059] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-06T19:20:04.486293] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAYW took 27.4s. Estimated remaining: 3h 13m 57s. Rate: 7.1 symbols/min [2025-10-06T19:20:04.627211] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-06T19:20:04.658687] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:20:04.714895] [DEBUG] [LOCAL ] HBM: Loaded 53680 existing records from primary storage. [2025-10-06T19:20:04.715317] [INFO ] [MAIN ] HBM: Loaded 53680 existing records. [2025-10-06T19:20:04.897966] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:20:04.898220] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-06T19:20:04.898268] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-06T19:20:04.898628] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-06T19:20:04.898726] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-06T19:20:05.257847] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:20:05.263060] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-06T19:20:05.381701] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T19:20:05.385935] [INFO ] [REMOTE ] HASI: Full fetch complete (68107 records). [2025-10-06T19:20:05.386164] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-06T19:20:05.430758] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-06T19:20:05.791064] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-06T19:20:05.791175] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-06T19:20:05.792364] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-06T19:20:05.792433] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-06T19:20:05.793957] [DEBUG] [LOCAL ] HASI: Trimmed 68107 records to 47215 (keeping 200 days of data) [2025-10-06T19:20:06.091176] [DEBUG] [LOCAL ] HASI: Primary data saved (47215 records). [2025-10-06T19:20:06.091336] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-06T19:20:06.091424] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HASI took 39.6s. Estimated remaining: 3h 13m 39s. Rate: 7.1 symbols/min [2025-10-06T19:20:06.234843] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-06T19:20:06.260331] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:20:06.304458] [DEBUG] [LOCAL ] HCA: Loaded 47538 existing records from primary storage. [2025-10-06T19:20:06.304835] [INFO ] [MAIN ] HCA: Loaded 47538 existing records. [2025-10-06T19:20:06.480562] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:20:06.480785] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-06T19:20:06.480836] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-06T19:20:06.481094] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-06T19:20:06.481151] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-06T19:20:06.830511] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:20:06.902598] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-06T19:20:07.025594] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-06T19:20:07.252272] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T19:20:07.744675] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T19:20:07.825552] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-06T19:20:08.625540] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-06T19:20:09.273806] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-06T19:20:09.425559] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-06T19:20:09.644525] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T19:20:10.225543] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-06T19:20:11.001037] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T19:20:11.025480] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-06T19:20:11.825532] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-06T19:20:12.043936] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T19:20:12.625591] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-06T19:20:12.717421] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T19:20:13.121399] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-06T19:20:13.122786] [INFO ] [REMOTE ] HBB: Full fetch complete (9503 records). [2025-10-06T19:20:13.122865] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-06T19:20:13.432228] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-06T19:20:13.531809] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-06T19:20:13.531979] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-06T19:20:13.532477] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-06T19:20:13.532609] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-06T19:20:13.533715] [DEBUG] [LOCAL ] HBB: Trimmed 9503 records to 6528 (keeping 200 days of data) [2025-10-06T19:20:13.600804] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T19:20:13.624224] [DEBUG] [LOCAL ] HBB: Primary data saved (6528 records). [2025-10-06T19:20:13.624424] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-06T19:20:13.624538] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HBB took 19.7s. Estimated remaining: 3h 13m 30s. Rate: 7.1 symbols/min [2025-10-06T19:20:13.799539] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:20:13.854440] [DEBUG] [LOCAL ] HCC: Loaded 46016 existing records from primary storage. [2025-10-06T19:20:13.854889] [INFO ] [MAIN ] HCC: Loaded 46016 existing records. [2025-10-06T19:20:14.047887] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:20:14.048134] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-06T19:20:14.048183] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-06T19:20:14.048768] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-06T19:20:14.048833] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-06T19:20:14.226149] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-06T19:20:14.429498] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:20:15.025499] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-06T19:20:15.199376] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T19:20:15.825483] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-06T19:20:15.944744] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T19:20:16.540663] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T19:20:16.625522] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-06T19:20:17.425537] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-06T19:20:17.867916] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-06T19:20:18.225614] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-06T19:20:19.025557] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-06T19:20:19.158328] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T19:20:19.682885] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T19:20:19.825497] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-06T19:20:20.315391] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (3.69 seconds). [2025-10-06T19:20:20.625516] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-06T19:20:20.631477] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T19:20:21.425596] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-06T19:20:21.564412] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T19:20:22.225508] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-06T19:20:22.448249] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T19:20:23.025574] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-06T19:20:23.265807] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T19:20:23.454295] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T19:20:23.825558] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-06T19:20:24.625569] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-06T19:20:24.773224] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T19:20:25.391054] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T19:20:25.425477] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-06T19:20:26.225557] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-06T19:20:26.303199] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T19:20:27.030619] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-06T19:20:27.046372] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T19:20:27.620729] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T19:20:27.825526] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-06T19:20:28.625493] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-06T19:20:28.832285] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T19:20:29.425486] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-06T19:20:29.536440] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T19:20:30.182789] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T19:20:30.225471] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-06T19:20:30.678174] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-06T19:20:31.025532] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-06T19:20:31.825518] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-06T19:20:31.996117] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T19:20:32.555572] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T19:20:32.625484] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-06T19:20:33.425573] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-06T19:20:33.542869] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T19:20:34.083889] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T19:20:34.087307] [INFO ] [REMOTE ] HCA: Full fetch complete (68771 records). [2025-10-06T19:20:34.087464] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-06T19:20:34.227292] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-06T19:20:34.516235] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-06T19:20:34.516336] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-06T19:20:34.517476] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-06T19:20:34.517542] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-06T19:20:34.519013] [DEBUG] [LOCAL ] HCA: Trimmed 68771 records to 46826 (keeping 200 days of data) [2025-10-06T19:20:34.828726] [DEBUG] [LOCAL ] HCA: Primary data saved (46826 records). [2025-10-06T19:20:34.828895] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-06T19:20:34.829528] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HCA took 28.7s. Estimated remaining: 3h 13m 39s. Rate: 7.1 symbols/min [2025-10-06T19:20:35.030731] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-06T19:20:35.055815] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T19:20:35.338919] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-06T19:20:35.825531] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-06T19:20:36.625515] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-06T19:20:36.741040] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T19:20:37.425508] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-06T19:20:37.495605] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T19:20:38.056608] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T19:20:38.225574] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-06T19:20:39.025569] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-06T19:20:39.180291] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T19:20:39.825494] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-06T19:20:40.019946] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T19:20:40.326507] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T19:20:40.330497] [INFO ] [REMOTE ] HCC: Full fetch complete (64682 records). [2025-10-06T19:20:40.330732] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-06T19:20:40.630695] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-06T19:20:40.819120] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-06T19:20:40.819244] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-06T19:20:40.820715] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-06T19:20:40.820783] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-06T19:20:40.822336] [DEBUG] [LOCAL ] HCC: Trimmed 64682 records to 45347 (keeping 200 days of data) [2025-10-06T19:20:41.145179] [DEBUG] [LOCAL ] HCC: Primary data saved (45347 records). [2025-10-06T19:20:41.145394] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-06T19:20:41.145519] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HCC took 27.5s. Estimated remaining: 3h 13m 27s. Rate: 7.1 symbols/min [2025-10-06T19:20:41.706077] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T19:20:41.717934] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-06T19:20:42.085240] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T19:20:42.225513] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-06T19:20:43.521017] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T19:20:43.533042] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-06T19:20:43.809941] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T19:20:43.813043] [INFO ] [REMOTE ] HBM: Full fetch complete (76273 records). [2025-10-06T19:20:43.813149] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-06T19:20:44.204547] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-06T19:20:44.204640] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-06T19:20:44.205704] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-06T19:20:44.205822] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-06T19:20:44.207352] [DEBUG] [LOCAL ] HBM: Trimmed 76273 records to 52914 (keeping 200 days of data) [2025-10-06T19:20:44.528962] [DEBUG] [LOCAL ] HBM: Primary data saved (52914 records). [2025-10-06T19:20:44.529119] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-06T19:20:44.530593] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HBM took 40.0s. Estimated remaining: 3h 13m 12s. Rate: 7.1 symbols/min [2025-10-06T19:20:45.003108] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T19:20:45.006304] [INFO ] [REMOTE ] HBI: Full fetch complete (76885 records). [2025-10-06T19:20:45.006485] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-06T19:20:45.402393] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-06T19:20:45.402492] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-06T19:20:45.403557] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-06T19:20:45.403627] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-06T19:20:45.405297] [DEBUG] [LOCAL ] HBI: Trimmed 76885 records to 52991 (keeping 200 days of data) [2025-10-06T19:20:45.723957] [DEBUG] [LOCAL ] HBI: Primary data saved (52991 records). [2025-10-06T19:20:45.724180] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-06T19:20:45.724327] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HBI took 43.1s. Estimated remaining: 3h 12m 53s. Rate: 7.1 symbols/min [2025-10-06T19:20:46.408163] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:20:46.376054] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:20:46.462859] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:20:46.465769] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-06T19:20:46.489724] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:20:46.487661] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-06T19:20:46.490071] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-06T19:20:46.490248] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-06T19:20:46.490734] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-06T19:20:46.490815] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-06T19:20:46.619692] [DEBUG] [LOCAL ] HCI: Loaded 14103 existing records from primary storage. [2025-10-06T19:20:46.635827] [INFO ] [MAIN ] HCI: Loaded 14103 existing records. [2025-10-06T19:20:47.029204] [DEBUG] [LOCAL ] HD: Loaded 54268 existing records from primary storage. [2025-10-06T19:20:47.047817] [DEBUG] [LOCAL ] HDB: Loaded 52716 existing records from primary storage. [2025-10-06T19:20:47.068953] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:20:47.069367] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-06T19:20:47.069967] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-06T19:20:47.070195] [INFO ] [MAIN ] HD: Loaded 54268 existing records. [2025-10-06T19:20:47.070587] [INFO ] [MAIN ] HDB: Loaded 52716 existing records. [2025-10-06T19:20:47.117259] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-06T19:20:47.172033] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:20:47.228889] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-06T19:20:47.234392] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-06T19:20:47.590764] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:20:47.643635] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-06T19:20:47.725555] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:20:47.710900] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-06T19:20:47.726466] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-06T19:20:47.741797] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-06T19:20:47.770135] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-06T19:20:47.770073] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-06T19:20:47.782537] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-06T19:20:47.782467] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-06T19:20:47.919372] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-06T19:20:48.014894] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-06T19:20:48.292179] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:20:48.386268] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-06T19:20:48.664480] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:20:48.694156] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:20:48.694781] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-06T19:20:48.694535] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-06T19:20:48.704625] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-06T19:20:48.705512] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-06T19:20:49.162316] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-06T19:20:49.163214] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-06T19:20:49.391927] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-06T19:20:49.425467] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-06T19:20:49.468820] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-06T19:20:50.216630] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T19:20:50.225457] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-06T19:20:50.467593] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T19:20:50.808086] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-06T19:20:50.830557] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-06T19:20:51.025527] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-06T19:20:51.291888] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-06T19:20:51.825530] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-06T19:20:52.055811] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-06T19:20:52.625545] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-06T19:20:52.869829] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-06T19:20:53.425587] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-06T19:20:53.992177] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T19:20:54.225541] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-06T19:20:54.474288] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-06T19:20:55.025545] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-06T19:20:55.825547] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-06T19:20:55.983966] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T19:20:56.625626] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-06T19:20:56.902771] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-06T19:20:57.425551] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-06T19:20:57.866915] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-06T19:20:57.926339] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-06T19:20:58.225494] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-06T19:20:58.533364] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-06T19:20:58.534023] [INFO ] [REMOTE ] HCXY: Full fetch complete (561 records). [2025-10-06T19:20:58.534091] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-06T19:20:58.709824] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-06T19:20:58.710056] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-06T19:20:58.710126] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-06T19:20:58.710198] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-06T19:20:58.710266] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-06T19:20:58.710301] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-06T19:20:58.710367] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-06T19:20:58.710446] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 13.0s. Estimated remaining: 3h 12m 51s. Rate: 7.1 symbols/min [2025-10-06T19:20:58.877298] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:20:58.923443] [DEBUG] [LOCAL ] HE: Loaded 49729 existing records from primary storage. [2025-10-06T19:20:58.923880] [INFO ] [MAIN ] HE: Loaded 49729 existing records. [2025-10-06T19:20:59.025636] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-06T19:20:59.105557] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:20:59.105840] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-06T19:20:59.105887] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-06T19:20:59.106119] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-06T19:20:59.106175] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-06T19:20:59.458824] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:20:59.825539] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-06T19:21:00.625582] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-06T19:21:01.158212] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-06T19:21:01.285937] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T19:21:01.425493] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-06T19:21:01.476371] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T19:21:02.225565] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-06T19:21:03.025544] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-06T19:21:03.223443] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T19:21:03.268306] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T19:21:03.825548] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-06T19:21:04.625624] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-06T19:21:04.706022] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T19:21:04.800668] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T19:21:05.425541] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-06T19:21:06.225547] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-06T19:21:06.325462] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-06T19:21:06.784777] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-06T19:21:07.025634] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-06T19:21:07.825591] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-06T19:21:08.043469] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-06T19:21:08.625535] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-06T19:21:09.220365] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-06T19:21:09.299333] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T19:21:09.425524] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-06T19:21:09.537438] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T19:21:10.225546] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-06T19:21:11.025504] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-06T19:21:11.034285] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T19:21:11.035589] [INFO ] [REMOTE ] HCI: Full fetch complete (19504 records). [2025-10-06T19:21:11.035708] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-06T19:21:11.423764] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-06T19:21:11.434308] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-06T19:21:11.454345] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-06T19:21:11.454574] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-06T19:21:11.457918] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-06T19:21:11.458243] [DEBUG] [LOCAL ] HCI: Trimmed 19504 records to 13998 (keeping 200 days of data) [2025-10-06T19:21:11.572805] [DEBUG] [LOCAL ] HCI: Primary data saved (13998 records). [2025-10-06T19:21:11.572985] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-06T19:21:11.573087] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCI took 25.8s. Estimated remaining: 3h 12m 49s. Rate: 7.1 symbols/min [2025-10-06T19:21:11.789306] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:21:11.832518] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-06T19:21:11.835226] [DEBUG] [LOCAL ] HEI: Loaded 32420 existing records from primary storage. [2025-10-06T19:21:11.835522] [INFO ] [MAIN ] HEI: Loaded 32420 existing records. [2025-10-06T19:21:12.023337] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:21:12.023621] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-06T19:21:12.023715] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-06T19:21:12.024067] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-06T19:21:12.024129] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-06T19:21:12.370049] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:21:12.625480] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-06T19:21:13.192954] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-06T19:21:13.425522] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-06T19:21:13.665965] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T19:21:14.225626] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-06T19:21:14.510521] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T19:21:15.025517] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-06T19:21:15.198635] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T19:21:15.825564] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-06T19:21:16.536021] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-06T19:21:16.625607] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-06T19:21:16.781418] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T19:21:17.317142] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T19:21:17.425530] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-06T19:21:18.225567] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-06T19:21:18.485837] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T19:21:18.740236] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T19:21:19.025563] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-06T19:21:19.625350] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T19:21:19.825542] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-06T19:21:20.625524] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-06T19:21:21.003509] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-06T19:21:21.425545] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-06T19:21:21.964213] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-06T19:21:22.105427] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T19:21:22.225537] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-06T19:21:22.680819] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T19:21:23.025538] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-06T19:21:23.825546] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-06T19:21:24.280376] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-06T19:21:24.625492] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-06T19:21:24.851440] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-06T19:21:25.425524] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-06T19:21:25.540529] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T19:21:26.225549] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-06T19:21:26.562501] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-06T19:21:26.566942] [INFO ] [REMOTE ] HD: Full fetch complete (77447 records). [2025-10-06T19:21:26.567141] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-06T19:21:26.964964] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-06T19:21:26.965134] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-06T19:21:26.966251] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-06T19:21:26.966332] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-06T19:21:26.988117] [DEBUG] [LOCAL ] HD: Trimmed 77447 records to 53493 (keeping 200 days of data) [2025-10-06T19:21:26.989339] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T19:21:27.065935] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-06T19:21:27.358679] [DEBUG] [LOCAL ] HD: Primary data saved (53493 records). [2025-10-06T19:21:27.358843] [INFO ] [MAIN ] HD: Full history saved. [2025-10-06T19:21:27.358926] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HD took 41.6s. Estimated remaining: 3h 12m 50s. Rate: 7.1 symbols/min [2025-10-06T19:21:27.527586] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:21:27.537374] [DEBUG] [LOCAL ] HEQ: Loaded 6450 existing records from primary storage. [2025-10-06T19:21:27.537749] [INFO ] [MAIN ] HEQ: Loaded 6450 existing records. [2025-10-06T19:21:27.743605] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-06T19:21:27.749264] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:21:27.760113] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-06T19:21:27.760171] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-06T19:21:27.760682] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-06T19:21:27.760750] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-06T19:21:27.832934] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-06T19:21:28.116471] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:21:28.496089] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T19:21:28.625585] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-06T19:21:29.227760] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-06T19:21:29.425540] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-06T19:21:29.627603] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T19:21:30.031798] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T19:21:30.225588] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-06T19:21:30.809636] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T19:21:31.025634] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-06T19:21:31.825512] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-06T19:21:32.625569] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-06T19:21:32.816963] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T19:21:33.425500] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-06T19:21:33.475226] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T19:21:34.027068] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-06T19:21:34.026910] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T19:21:34.225563] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-06T19:21:34.734253] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-06T19:21:35.025589] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-06T19:21:35.825586] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-06T19:21:36.292981] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T19:21:36.625523] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-06T19:21:37.290433] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T19:21:37.293351] [INFO ] [REMOTE ] HE: Full fetch complete (72274 records). [2025-10-06T19:21:37.293448] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-06T19:21:37.432331] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-06T19:21:37.697394] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-06T19:21:37.697516] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-06T19:21:37.698551] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-06T19:21:37.698636] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-06T19:21:37.700040] [DEBUG] [LOCAL ] HE: Trimmed 72274 records to 48994 (keeping 200 days of data) [2025-10-06T19:21:37.994377] [DEBUG] [LOCAL ] HE: Primary data saved (48994 records). [2025-10-06T19:21:37.994526] [INFO ] [MAIN ] HE: Full history saved. [2025-10-06T19:21:37.994611] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HE took 39.3s. Estimated remaining: 3h 12m 45s. Rate: 7.1 symbols/min [2025-10-06T19:21:38.171110] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:21:38.217114] [DEBUG] [LOCAL ] HESM: Loaded 48942 existing records from primary storage. [2025-10-06T19:21:38.233074] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-06T19:21:38.232979] [INFO ] [MAIN ] HESM: Loaded 48942 existing records. [2025-10-06T19:21:38.276899] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T19:21:38.431592] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:21:38.431924] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-06T19:21:38.432003] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-06T19:21:38.432330] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-06T19:21:38.432391] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-06T19:21:38.783373] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:21:39.025481] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-06T19:21:39.148042] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T19:21:39.176604] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T19:21:39.825532] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-06T19:21:40.538773] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T19:21:40.625563] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-06T19:21:41.311413] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T19:21:41.314467] [INFO ] [REMOTE ] HDB: Full fetch complete (75304 records). [2025-10-06T19:21:41.314603] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-06T19:21:41.430756] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-06T19:21:41.734350] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-06T19:21:41.734463] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-06T19:21:41.735671] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-06T19:21:41.735747] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-06T19:21:41.737462] [DEBUG] [LOCAL ] HDB: Trimmed 75304 records to 51935 (keeping 200 days of data) [2025-10-06T19:21:42.082499] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-06T19:21:42.111373] [DEBUG] [LOCAL ] HDB: Primary data saved (51935 records). [2025-10-06T19:21:42.111628] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-06T19:21:42.112769] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HDB took 56.3s. Estimated remaining: 3h 12m 31s. Rate: 7.1 symbols/min [2025-10-06T19:21:42.230093] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-06T19:21:42.321126] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:21:42.321418] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-06T19:21:42.321610] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-06T19:21:42.321878] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-06T19:21:42.321981] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-06T19:21:42.322070] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-06T19:21:42.322291] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-06T19:21:42.466370] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-06T19:21:42.752812] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:21:42.923591] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-06T19:21:43.025688] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-06T19:21:43.595033] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-06T19:21:43.825531] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-06T19:21:44.153611] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-06T19:21:44.625616] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-06T19:21:45.326847] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T19:21:45.425534] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-06T19:21:45.749554] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-06T19:21:46.225555] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-06T19:21:46.883848] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T19:21:46.884960] [INFO ] [REMOTE ] HEQ: Full fetch complete (9354 records). [2025-10-06T19:21:46.885032] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-06T19:21:47.032414] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-06T19:21:47.260818] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-06T19:21:47.260906] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-06T19:21:47.261151] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-06T19:21:47.261188] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-06T19:21:47.261833] [DEBUG] [LOCAL ] HEQ: Trimmed 9354 records to 6477 (keeping 200 days of data) [2025-10-06T19:21:47.301363] [DEBUG] [LOCAL ] HEQ: Primary data saved (6477 records). [2025-10-06T19:21:47.301470] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-06T19:21:47.301547] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEQ took 19.9s. Estimated remaining: 3h 12m 18s. Rate: 7.1 symbols/min [2025-10-06T19:21:47.470276] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:21:47.470508] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-06T19:21:47.470547] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-06T19:21:47.470703] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-06T19:21:47.470806] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-06T19:21:47.470873] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-06T19:21:47.470907] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-06T19:21:47.831876] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:21:47.828208] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-06T19:21:48.039923] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T19:21:48.625539] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-06T19:21:49.053536] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-06T19:21:49.380875] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T19:21:49.425580] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-06T19:21:49.763313] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-06T19:21:50.225542] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-06T19:21:51.025614] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-06T19:21:51.350819] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-06T19:21:51.816557] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T19:21:51.826211] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-06T19:21:52.080290] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-06T19:21:52.625562] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-06T19:21:52.867941] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-06T19:21:53.425541] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-06T19:21:53.865148] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T19:21:54.225591] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-06T19:21:54.633063] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-06T19:21:55.025634] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-06T19:21:55.825546] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-06T19:21:56.069637] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-06T19:21:56.359249] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T19:21:56.625556] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-06T19:21:56.998043] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-06T19:21:57.425541] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-06T19:21:57.658157] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-06T19:21:58.225545] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-06T19:21:58.452558] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-06T19:21:59.025562] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-06T19:21:59.297220] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-06T19:21:59.825529] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-06T19:22:00.175780] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-06T19:22:00.625549] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-06T19:22:01.186317] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T19:22:01.425581] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-06T19:22:02.225550] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-06T19:22:02.461685] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-06T19:22:03.025501] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-06T19:22:03.169810] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T19:22:03.368557] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-06T19:22:03.369236] [INFO ] [REMOTE ] HF: Full fetch complete (464 records). [2025-10-06T19:22:03.369305] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-06T19:22:03.544969] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-06T19:22:03.545200] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-06T19:22:03.545282] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-06T19:22:03.545355] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-06T19:22:03.545422] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-06T19:22:03.545458] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-06T19:22:03.545513] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-06T19:22:03.545600] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HF took 21.4s. Estimated remaining: 3h 12m 20s. Rate: 7.1 symbols/min [2025-10-06T19:22:03.712435] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:22:03.742231] [DEBUG] [LOCAL ] HFRO: Loaded 17887 existing records from primary storage. [2025-10-06T19:22:03.742575] [INFO ] [MAIN ] HFRO: Loaded 17887 existing records. [2025-10-06T19:22:03.830767] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-06T19:22:03.920718] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:22:03.920986] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-06T19:22:03.921057] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-06T19:22:03.921350] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-06T19:22:03.921409] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-06T19:22:04.266603] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:22:04.625512] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-06T19:22:04.945035] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T19:22:04.947456] [INFO ] [REMOTE ] HEI: Full fetch complete (48507 records). [2025-10-06T19:22:04.947623] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-06T19:22:05.337930] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-06T19:22:05.338028] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-06T19:22:05.339014] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-06T19:22:05.339082] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-06T19:22:05.340429] [DEBUG] [LOCAL ] HEI: Trimmed 48507 records to 31769 (keeping 200 days of data) [2025-10-06T19:22:05.434605] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-06T19:22:05.554324] [DEBUG] [LOCAL ] HEI: Primary data saved (31769 records). [2025-10-06T19:22:05.554496] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-06T19:22:05.554590] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HEI took 54.0s. Estimated remaining: 3h 12m 3s. Rate: 7.1 symbols/min [2025-10-06T19:22:05.734683] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:22:05.752260] [DEBUG] [LOCAL ] HGER: Loaded 13988 existing records from primary storage. [2025-10-06T19:22:05.752664] [INFO ] [MAIN ] HGER: Loaded 13988 existing records. [2025-10-06T19:22:05.975274] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:22:05.977034] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T19:22:05.977282] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-06T19:22:05.984190] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-06T19:22:05.984516] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-06T19:22:05.984576] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-06T19:22:06.230765] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-06T19:22:06.343161] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:22:06.718565] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-06T19:22:07.025500] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-06T19:22:07.064819] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T19:22:07.438955] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-06T19:22:07.825510] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-06T19:22:08.625511] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-06T19:22:08.903601] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T19:22:09.046401] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-06T19:22:09.425537] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-06T19:22:09.848639] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-06T19:22:09.849408] [INFO ] [REMOTE ] HFND: Full fetch complete (1781 records). [2025-10-06T19:22:09.849479] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-06T19:22:10.024145] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-06T19:22:10.024392] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-06T19:22:10.024462] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-06T19:22:10.024534] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-06T19:22:10.024625] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-06T19:22:10.024713] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-06T19:22:10.024780] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-06T19:22:10.024860] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HFND took 22.7s. Estimated remaining: 3h 11m 49s. Rate: 7.1 symbols/min [2025-10-06T19:22:10.190733] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:22:10.203854] [DEBUG] [LOCAL ] HGLB: Loaded 9821 existing records from primary storage. [2025-10-06T19:22:10.204108] [INFO ] [MAIN ] HGLB: Loaded 9821 existing records. [2025-10-06T19:22:10.232568] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-06T19:22:10.383322] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:22:10.383569] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-06T19:22:10.383619] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-06T19:22:10.383952] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-06T19:22:10.384065] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-06T19:22:10.744050] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:22:11.025568] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-06T19:22:11.781864] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-06T19:22:11.825500] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-06T19:22:12.082444] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-06T19:22:12.625498] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-06T19:22:12.815346] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T19:22:13.425546] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-06T19:22:14.092146] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T19:22:14.110806] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-06T19:22:14.225531] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-06T19:22:14.992895] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-06T19:22:15.025528] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-06T19:22:15.758639] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T19:22:15.825554] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-06T19:22:16.625532] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-06T19:22:16.846872] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T19:22:17.425542] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-06T19:22:18.081896] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T19:22:18.225529] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-06T19:22:18.309755] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-06T19:22:19.025552] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-06T19:22:19.825496] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-06T19:22:19.908522] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-06T19:22:19.913017] [INFO ] [REMOTE ] HESM: Full fetch complete (69371 records). [2025-10-06T19:22:19.913241] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-06T19:22:20.263878] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-06T19:22:20.378825] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-06T19:22:20.378916] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-06T19:22:20.379985] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-06T19:22:20.380051] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-06T19:22:20.381403] [DEBUG] [LOCAL ] HESM: Trimmed 69371 records to 48236 (keeping 200 days of data) [2025-10-06T19:22:20.603573] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T19:22:20.631699] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-06T19:22:20.696232] [DEBUG] [LOCAL ] HESM: Primary data saved (48236 records). [2025-10-06T19:22:20.696549] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-06T19:22:20.696756] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HESM took 42.7s. Estimated remaining: 3h 11m 43s. Rate: 7.1 symbols/min [2025-10-06T19:22:20.867601] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:22:20.883541] [DEBUG] [LOCAL ] HGTY: Loaded 13362 existing records from primary storage. [2025-10-06T19:22:20.883867] [INFO ] [MAIN ] HGTY: Loaded 13362 existing records. [2025-10-06T19:22:21.059063] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:22:21.059329] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-06T19:22:21.059377] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-06T19:22:21.059621] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-06T19:22:21.059707] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-06T19:22:21.403004] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:22:21.425476] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-06T19:22:21.799294] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T19:22:22.174752] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-06T19:22:22.225544] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-06T19:22:22.958041] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T19:22:23.025591] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-06T19:22:23.825551] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-06T19:22:23.836582] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T19:22:24.523724] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-06T19:22:24.625561] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-06T19:22:25.403560] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T19:22:25.425472] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-06T19:22:26.225701] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-06T19:22:26.433875] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T19:22:27.022856] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-06T19:22:27.026274] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-06T19:22:27.829721] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-06T19:22:27.832973] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T19:22:28.625494] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-06T19:22:28.651397] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-06T19:22:29.410057] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T19:22:29.425471] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-06T19:22:30.225589] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-06T19:22:30.252047] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-06T19:22:31.008432] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-06T19:22:31.025457] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-06T19:22:31.805546] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T19:22:31.825544] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-06T19:22:32.625555] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-06T19:22:32.777744] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T19:22:33.344196] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T19:22:33.425576] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-06T19:22:34.225543] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-06T19:22:34.383246] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T19:22:35.025577] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-06T19:22:35.175503] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T19:22:35.825553] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-06T19:22:36.041174] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T19:22:36.614460] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-06T19:22:36.625465] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-06T19:22:37.354135] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T19:22:37.425565] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-06T19:22:38.225509] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-06T19:22:38.359561] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T19:22:38.361382] [INFO ] [REMOTE ] HGER: Full fetch complete (17327 records). [2025-10-06T19:22:38.361464] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-06T19:22:38.723349] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-06T19:22:38.723445] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-06T19:22:38.723942] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-06T19:22:38.724007] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-06T19:22:38.724587] [DEBUG] [LOCAL ] HGER: Trimmed 17327 records to 13996 (keeping 200 days of data) [2025-10-06T19:22:38.813834] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T19:22:38.825396] [DEBUG] [LOCAL ] HGER: Primary data saved (13996 records). [2025-10-06T19:22:38.826163] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-06T19:22:38.826692] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HGER took 33.3s. Estimated remaining: 3h 11m 48s. Rate: 7.1 symbols/min [2025-10-06T19:22:38.996326] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:22:39.025588] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-06T19:22:39.041273] [DEBUG] [LOCAL ] HGV: Loaded 47226 existing records from primary storage. [2025-10-06T19:22:39.041855] [INFO ] [MAIN ] HGV: Loaded 47226 existing records. [2025-10-06T19:22:39.215294] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:22:39.215568] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-06T19:22:39.215618] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-06T19:22:39.216046] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-06T19:22:39.216103] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-06T19:22:39.560178] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:22:39.825543] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-06T19:22:39.925531] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-06T19:22:40.625535] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-06T19:22:41.226776] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T19:22:41.321954] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T19:22:41.425548] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-06T19:22:42.184275] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-06T19:22:42.225474] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-06T19:22:43.025695] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-06T19:22:43.725954] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T19:22:43.825513] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-06T19:22:44.073947] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T19:22:44.625611] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-06T19:22:45.346068] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T19:22:45.425479] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-06T19:22:45.679686] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T19:22:46.225527] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-06T19:22:46.925057] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T19:22:46.926500] [INFO ] [REMOTE ] HFRO: Full fetch complete (28820 records). [2025-10-06T19:22:46.926579] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-06T19:22:47.030777] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-06T19:22:47.133751] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T19:22:47.349981] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-06T19:22:47.350073] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-06T19:22:47.350884] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-06T19:22:47.350946] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-06T19:22:47.351827] [DEBUG] [LOCAL ] HFRO: Trimmed 28820 records to 17511 (keeping 200 days of data) [2025-10-06T19:22:47.457307] [DEBUG] [LOCAL ] HFRO: Primary data saved (17511 records). [2025-10-06T19:22:47.457469] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-06T19:22:47.457552] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HFRO took 43.9s. Estimated remaining: 3h 11m 40s. Rate: 7.1 symbols/min [2025-10-06T19:22:47.627787] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:22:47.666535] [DEBUG] [LOCAL ] HHH: Loaded 33147 existing records from primary storage. [2025-10-06T19:22:47.666923] [INFO ] [MAIN ] HHH: Loaded 33147 existing records. [2025-10-06T19:22:47.845139] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-06T19:22:47.850919] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:22:47.851220] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-06T19:22:47.852318] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-06T19:22:47.852600] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-06T19:22:47.852711] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-06T19:22:48.222445] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T19:22:48.244397] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:22:48.625521] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-06T19:22:48.703603] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T19:22:48.708023] [INFO ] [REMOTE ] HGLB: Full fetch complete (14891 records). [2025-10-06T19:22:48.708108] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-06T19:22:49.095127] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-06T19:22:49.095248] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-06T19:22:49.095792] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-06T19:22:49.095942] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-06T19:22:49.096992] [DEBUG] [LOCAL ] HGLB: Trimmed 14891 records to 9702 (keeping 200 days of data) [2025-10-06T19:22:49.163477] [DEBUG] [LOCAL ] HGLB: Primary data saved (9702 records). [2025-10-06T19:22:49.163708] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-06T19:22:49.163829] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HGLB took 39.1s. Estimated remaining: 3h 11m 22s. Rate: 7.1 symbols/min [2025-10-06T19:22:49.349992] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:22:49.393552] [DEBUG] [LOCAL ] HI: Loaded 35823 existing records from primary storage. [2025-10-06T19:22:49.394018] [INFO ] [MAIN ] HI: Loaded 35823 existing records. [2025-10-06T19:22:49.430771] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-06T19:22:49.610346] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:22:49.610755] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-06T19:22:49.610842] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-06T19:22:49.611445] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-06T19:22:49.611508] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-06T19:22:50.083587] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:22:50.234779] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-06T19:22:50.259872] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T19:22:50.601490] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T19:22:51.025525] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-06T19:22:51.404388] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T19:22:51.825542] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-06T19:22:52.625533] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-06T19:22:53.425628] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-06T19:23:06.065755] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (15.04 seconds). [2025-10-06T19:23:06.066967] [INFO ] [REMOTE ] HGTY: Full fetch complete (17278 records). [2025-10-06T19:23:06.067039] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-06T19:23:06.195558] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (13.57 seconds). [2025-10-06T19:23:06.248430] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-06T19:23:06.472418] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-06T19:23:06.472588] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-06T19:23:06.473222] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-06T19:23:06.473282] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-06T19:23:06.473890] [DEBUG] [LOCAL ] HGTY: Trimmed 17278 records to 13227 (keeping 200 days of data) [2025-10-06T19:23:06.553856] [DEBUG] [LOCAL ] HGTY: Primary data saved (13227 records). [2025-10-06T19:23:06.554106] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-06T19:23:06.554293] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGTY took 45.9s. Estimated remaining: 3h 11m 26s. Rate: 7.1 symbols/min [2025-10-06T19:23:06.724555] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:23:06.778220] [DEBUG] [LOCAL ] HIG: Loaded 51948 existing records from primary storage. [2025-10-06T19:23:06.778701] [INFO ] [MAIN ] HIG: Loaded 51948 existing records. [2025-10-06T19:23:06.993347] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (15.17 seconds). [2025-10-06T19:23:06.991596] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:23:07.002919] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-06T19:23:07.003119] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-06T19:23:07.003623] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-06T19:23:07.003719] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-06T19:23:07.035579] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-06T19:23:07.375905] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:23:07.376695] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-06T19:23:07.400497] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (13.97 seconds). [2025-10-06T19:23:07.408983] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-06T19:23:07.430183] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T19:23:07.437296] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-06T19:23:08.638979] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T19:23:08.648811] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-06T19:23:08.701677] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T19:23:08.708432] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-06T19:23:08.742781] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T19:23:08.754859] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-06T19:23:09.125812] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T19:23:09.136025] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-06T19:23:09.948454] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T19:23:09.954610] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-06T19:23:10.073384] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T19:23:10.080949] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-06T19:23:10.120507] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T19:23:10.132981] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-06T19:23:10.525895] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T19:23:10.536559] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-06T19:23:11.314800] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T19:23:11.324978] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-06T19:23:11.348994] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T19:23:11.357439] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-06T19:23:11.735701] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T19:23:11.747206] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-06T19:23:11.818352] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-06T19:23:11.828252] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-06T19:23:12.734692] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T19:23:12.742523] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-06T19:23:12.885676] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T19:23:12.894604] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-06T19:23:13.230320] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T19:23:13.240100] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-06T19:23:13.686325] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T19:23:13.696946] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-06T19:23:14.234963] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T19:23:14.243839] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-06T19:23:14.325270] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T19:23:14.335240] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-06T19:23:14.831989] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T19:23:14.836812] [INFO ] [REMOTE ] HGV: Full fetch complete (66006 records). [2025-10-06T19:23:14.837123] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-06T19:23:15.479346] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T19:23:15.541087] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-06T19:23:15.542836] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-06T19:23:15.542999] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-06T19:23:15.544418] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-06T19:23:15.544611] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-06T19:23:15.587905] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T19:23:15.585632] [DEBUG] [LOCAL ] HGV: Trimmed 66006 records to 46518 (keeping 200 days of data) [2025-10-06T19:23:15.602372] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-06T19:23:15.727278] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-06T19:23:15.764898] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-06T19:23:15.914040] [DEBUG] [LOCAL ] HGV: Primary data saved (46518 records). [2025-10-06T19:23:15.914201] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-06T19:23:15.914285] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HGV took 37.1s. Estimated remaining: 3h 11m 18s. Rate: 7.1 symbols/min [2025-10-06T19:23:16.082197] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:23:16.117351] [DEBUG] [LOCAL ] HII: Loaded 35064 existing records from primary storage. [2025-10-06T19:23:16.117696] [INFO ] [MAIN ] HII: Loaded 35064 existing records. [2025-10-06T19:23:16.290503] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:23:16.290812] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-06T19:23:16.290858] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-06T19:23:16.291169] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-06T19:23:16.291225] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-06T19:23:16.635973] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:23:16.636270] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-06T19:23:16.945815] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T19:23:16.952867] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-06T19:23:17.310791] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T19:23:17.318277] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-06T19:23:17.661935] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-06T19:23:17.673699] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-06T19:23:18.164680] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T19:23:18.166949] [INFO ] [REMOTE ] HHH: Full fetch complete (45731 records). [2025-10-06T19:23:18.167050] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-06T19:23:18.349387] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T19:23:18.399847] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-06T19:23:18.594756] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-06T19:23:18.594959] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-06T19:23:18.595889] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-06T19:23:18.616598] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-06T19:23:18.618718] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T19:23:18.629480] [DEBUG] [LOCAL ] HHH: Trimmed 45731 records to 32909 (keeping 200 days of data) [2025-10-06T19:23:18.826818] [DEBUG] [LOCAL ] HHH: Primary data saved (32909 records). [2025-10-06T19:23:18.826988] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-06T19:23:18.827072] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HHH took 31.4s. Estimated remaining: 3h 11m 2s. Rate: 7.1 symbols/min [2025-10-06T19:23:19.005472] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:23:19.035232] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-06T19:23:19.060106] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-10-06T19:23:19.060514] [INFO ] [MAIN ] HIMS: Loaded 54597 existing records. [2025-10-06T19:23:19.251159] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:23:19.251575] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-06T19:23:19.251733] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-06T19:23:19.252353] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-06T19:23:19.252418] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-06T19:23:19.621018] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-06T19:23:19.679084] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:23:19.825568] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-06T19:23:19.907939] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T19:23:20.427835] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T19:23:20.625546] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-06T19:23:21.418720] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T19:23:21.429980] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-06T19:23:22.167483] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T19:23:22.225482] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-06T19:23:22.640143] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T19:23:22.643049] [INFO ] [REMOTE ] HI: Full fetch complete (50073 records). [2025-10-06T19:23:22.643193] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-06T19:23:23.029496] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-06T19:23:23.030123] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-06T19:23:23.030547] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-06T19:23:23.032265] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-06T19:23:23.032334] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-06T19:23:23.033456] [DEBUG] [LOCAL ] HI: Trimmed 50073 records to 35378 (keeping 200 days of data) [2025-10-06T19:23:23.258931] [DEBUG] [LOCAL ] HI: Primary data saved (35378 records). [2025-10-06T19:23:23.259158] [INFO ] [MAIN ] HI: Full history saved. [2025-10-06T19:23:23.259272] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HI took 34.1s. Estimated remaining: 3h 10m 49s. Rate: 7.1 symbols/min [2025-10-06T19:23:23.452584] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:23:23.477069] [DEBUG] [LOCAL ] HIO: Loaded 24380 existing records from primary storage. [2025-10-06T19:23:23.477332] [INFO ] [MAIN ] HIO: Loaded 24380 existing records. [2025-10-06T19:23:23.654605] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:23:23.655038] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-06T19:23:23.655185] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-06T19:23:23.656105] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-06T19:23:23.656166] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-06T19:23:23.826456] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-06T19:23:24.011979] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:23:24.056987] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T19:23:24.625598] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-06T19:23:25.425573] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-06T19:23:25.543972] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T19:23:25.655275] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-06T19:23:25.863518] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T19:23:26.225840] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-06T19:23:26.961919] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-06T19:23:27.025524] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-06T19:23:27.825504] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-06T19:23:27.966023] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T19:23:28.028598] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T19:23:28.625493] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-06T19:23:29.082925] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T19:23:29.425530] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-06T19:23:29.717164] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T19:23:30.225554] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-06T19:23:30.574228] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T19:23:31.025532] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-06T19:23:31.825532] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-06T19:23:32.176587] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-06T19:23:32.570899] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T19:23:32.573767] [INFO ] [REMOTE ] HIG: Full fetch complete (73234 records). [2025-10-06T19:23:32.573868] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-06T19:23:32.637942] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-06T19:23:32.975053] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-06T19:23:32.975139] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-06T19:23:32.976157] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-06T19:23:32.976221] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-06T19:23:32.977742] [DEBUG] [LOCAL ] HIG: Trimmed 73234 records to 51186 (keeping 200 days of data) [2025-10-06T19:23:33.099220] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T19:23:33.360379] [DEBUG] [LOCAL ] HIG: Primary data saved (51186 records). [2025-10-06T19:23:33.360627] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-06T19:23:33.360809] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HIG took 26.8s. Estimated remaining: 3h 10m 42s. Rate: 7.1 symbols/min [2025-10-06T19:23:33.430855] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-06T19:23:33.539821] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:23:33.564275] [DEBUG] [LOCAL ] HIPO: Loaded 22331 existing records from primary storage. [2025-10-06T19:23:33.564619] [INFO ] [MAIN ] HIPO: Loaded 22331 existing records. [2025-10-06T19:23:33.746003] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:23:33.746283] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-06T19:23:33.746333] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-06T19:23:33.746702] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-06T19:23:33.746763] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-06T19:23:34.151345] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:23:34.225596] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-06T19:23:34.924038] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T19:23:35.025495] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-06T19:23:35.099355] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-06T19:23:35.452031] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T19:23:35.825559] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-06T19:23:36.438570] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T19:23:36.625487] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-06T19:23:36.854171] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-06T19:23:37.425535] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-06T19:23:37.994055] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T19:23:38.225560] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-06T19:23:38.568559] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T19:23:39.025553] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-06T19:23:39.825578] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-06T19:23:40.020288] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T19:23:40.625511] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-06T19:23:40.780197] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-06T19:23:40.962434] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T19:23:40.965459] [INFO ] [REMOTE ] HII: Full fetch complete (52842 records). [2025-10-06T19:23:40.965699] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-06T19:23:41.404797] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-06T19:23:41.404902] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-06T19:23:41.406111] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-06T19:23:41.406182] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-06T19:23:41.407770] [DEBUG] [LOCAL ] HII: Trimmed 52842 records to 34309 (keeping 200 days of data) [2025-10-06T19:23:41.472882] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-06T19:23:41.650892] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T19:23:41.686695] [DEBUG] [LOCAL ] HII: Primary data saved (34309 records). [2025-10-06T19:23:41.686907] [INFO ] [MAIN ] HII: Full history saved. [2025-10-06T19:23:41.687020] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HII took 25.8s. Estimated remaining: 3h 10m 34s. Rate: 7.1 symbols/min [2025-10-06T19:23:41.882563] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:23:41.933710] [DEBUG] [LOCAL ] HIW: Loaded 45164 existing records from primary storage. [2025-10-06T19:23:41.934087] [INFO ] [MAIN ] HIW: Loaded 45164 existing records. [2025-10-06T19:23:42.133165] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:23:42.134016] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-06T19:23:42.134075] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-06T19:23:42.134365] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-06T19:23:42.134424] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-06T19:23:42.229368] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-06T19:23:42.501754] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:23:42.519764] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T19:23:43.026007] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-06T19:23:43.035678] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T19:23:43.825591] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-06T19:23:44.162603] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T19:23:44.625516] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-06T19:23:44.925041] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T19:23:45.425534] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-06T19:23:46.225619] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-06T19:23:46.674849] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-06T19:23:47.025512] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-06T19:23:47.284505] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-06T19:23:47.346572] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T19:23:47.721002] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T19:23:47.825512] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-06T19:23:48.625545] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-06T19:23:48.882939] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T19:23:49.425575] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-06T19:23:50.225540] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-06T19:23:51.025481] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-06T19:23:51.054248] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T19:23:51.120613] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T19:23:51.123075] [INFO ] [REMOTE ] HIO: Full fetch complete (37723 records). [2025-10-06T19:23:51.123206] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-06T19:23:51.504720] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-06T19:23:51.504905] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-06T19:23:51.505758] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-06T19:23:51.505852] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-06T19:23:51.506904] [DEBUG] [LOCAL ] HIO: Trimmed 37723 records to 23975 (keeping 200 days of data) [2025-10-06T19:23:51.621042] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-10-06T19:23:51.687569] [DEBUG] [LOCAL ] HIO: Primary data saved (23975 records). [2025-10-06T19:23:51.687762] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-06T19:23:51.687852] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIO took 28.4s. Estimated remaining: 3h 10m 27s. Rate: 7.1 symbols/min [2025-10-06T19:23:51.832255] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-06T19:23:51.871466] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:23:51.895571] [DEBUG] [LOCAL ] HIX: Loaded 20931 existing records from primary storage. [2025-10-06T19:23:51.895953] [INFO ] [MAIN ] HIX: Loaded 20931 existing records. [2025-10-06T19:23:52.088554] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:23:52.088913] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-06T19:23:52.088968] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-06T19:23:52.089834] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-06T19:23:52.089897] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-06T19:23:52.279808] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-06T19:23:52.497468] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:23:52.625597] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-06T19:23:53.322841] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T19:23:53.425560] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-06T19:23:54.225574] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-06T19:23:54.687623] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T19:23:54.838475] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-06T19:23:55.025538] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-06T19:23:55.251335] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-06T19:23:55.825538] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-06T19:23:56.077776] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T19:23:56.625557] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-06T19:23:57.425582] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-06T19:23:57.548168] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T19:23:58.225569] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-06T19:23:58.554885] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-06T19:23:58.975240] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T19:23:59.025553] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-06T19:23:59.272019] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T19:23:59.825574] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-06T19:24:00.625499] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-06T19:24:00.637062] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T19:24:00.638719] [INFO ] [REMOTE ] HIPO: Full fetch complete (31531 records). [2025-10-06T19:24:00.638803] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-06T19:24:01.106939] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-06T19:24:01.107050] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-06T19:24:01.108049] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-06T19:24:01.108116] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-06T19:24:01.108948] [DEBUG] [LOCAL ] HIPO: Trimmed 31531 records to 22020 (keeping 200 days of data) [2025-10-06T19:24:01.260057] [DEBUG] [LOCAL ] HIPO: Primary data saved (22020 records). [2025-10-06T19:24:01.260231] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-06T19:24:01.260330] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIPO took 27.9s. Estimated remaining: 3h 10m 20s. Rate: 7.1 symbols/min [2025-10-06T19:24:01.437186] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-06T19:24:01.440689] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:24:01.461816] [DEBUG] [LOCAL ] HKD: Loaded 18629 existing records from primary storage. [2025-10-06T19:24:01.462112] [INFO ] [MAIN ] HKD: Loaded 18629 existing records. [2025-10-06T19:24:01.649615] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:24:01.650003] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-06T19:24:01.650094] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-06T19:24:01.651139] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-06T19:24:01.651225] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-06T19:24:01.795587] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-06T19:24:02.072996] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:24:02.104028] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T19:24:02.225477] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-06T19:24:02.596558] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T19:24:03.025539] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-06T19:24:03.470919] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T19:24:03.825530] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-06T19:24:04.625601] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-06T19:24:04.803884] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T19:24:05.366809] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-06T19:24:05.425501] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-06T19:24:05.727300] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T19:24:06.152262] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T19:24:06.225490] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-06T19:24:07.025524] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-06T19:24:07.382741] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T19:24:07.825581] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-06T19:24:08.625510] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-06T19:24:09.035242] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-06T19:24:09.187509] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-06T19:24:09.190889] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-10-06T19:24:09.191037] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-06T19:24:09.430971] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-06T19:24:09.611871] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-06T19:24:09.612040] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-06T19:24:09.613277] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-06T19:24:09.613357] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-06T19:24:09.615253] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-10-06T19:24:09.841247] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-06T19:24:09.975198] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-06T19:24:09.975460] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-06T19:24:09.975587] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIMS took 51.1s. Estimated remaining: 3h 10m 12s. Rate: 7.1 symbols/min [2025-10-06T19:24:10.157068] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:24:10.214389] [DEBUG] [LOCAL ] HL: Loaded 54451 existing records from primary storage. [2025-10-06T19:24:10.214829] [INFO ] [MAIN ] HL: Loaded 54451 existing records. [2025-10-06T19:24:10.235801] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-06T19:24:10.415848] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:24:10.416163] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-06T19:24:10.416217] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-06T19:24:10.417817] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-06T19:24:10.417881] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-06T19:24:10.834593] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:24:10.859294] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T19:24:11.025490] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-06T19:24:11.349918] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T19:24:11.825547] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-06T19:24:12.348170] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T19:24:12.625528] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-06T19:24:13.050995] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T19:24:13.425564] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-06T19:24:14.232042] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-06T19:24:14.234825] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T19:24:14.416783] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T19:24:15.025614] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-06T19:24:15.825555] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-06T19:24:16.012285] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T19:24:16.045084] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T19:24:16.625554] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-06T19:24:16.899296] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T19:24:17.425559] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-06T19:24:17.676009] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T19:24:18.225696] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-06T19:24:18.421579] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T19:24:19.025561] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-06T19:24:19.825493] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-06T19:24:20.082567] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T19:24:20.086346] [INFO ] [REMOTE ] HIX: Full fetch complete (30767 records). [2025-10-06T19:24:20.086763] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-06T19:24:20.218362] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-06T19:24:20.560907] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-06T19:24:20.561063] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-06T19:24:20.562029] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-06T19:24:20.562140] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-06T19:24:20.563635] [DEBUG] [LOCAL ] HIX: Trimmed 30767 records to 20616 (keeping 200 days of data) [2025-10-06T19:24:20.627805] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-06T19:24:20.704787] [DEBUG] [LOCAL ] HIX: Primary data saved (20616 records). [2025-10-06T19:24:20.704974] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-06T19:24:20.705072] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIX took 29.0s. Estimated remaining: 3h 10m 7s. Rate: 7.1 symbols/min [2025-10-06T19:24:20.901883] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:24:20.958804] [DEBUG] [LOCAL ] HLF: Loaded 49195 existing records from primary storage. [2025-10-06T19:24:20.959222] [INFO ] [MAIN ] HLF: Loaded 49195 existing records. [2025-10-06T19:24:21.169609] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:24:21.170070] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-06T19:24:21.170183] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-06T19:24:21.176699] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-06T19:24:21.184957] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-06T19:24:21.248839] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T19:24:21.430778] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-06T19:24:21.638428] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:24:22.225563] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-06T19:24:22.559966] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-06T19:24:22.651058] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-06T19:24:23.025576] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-06T19:24:23.817321] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T19:24:23.828151] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-06T19:24:24.430150] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T19:24:24.433064] [INFO ] [REMOTE ] HIW: Full fetch complete (64844 records). [2025-10-06T19:24:24.433205] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-06T19:24:24.632255] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-06T19:24:24.837014] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-06T19:24:24.837118] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-06T19:24:24.838200] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-06T19:24:24.838274] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-06T19:24:24.840032] [DEBUG] [LOCAL ] HIW: Trimmed 64844 records to 44532 (keeping 200 days of data) [2025-10-06T19:24:25.112318] [DEBUG] [LOCAL ] HIW: Primary data saved (44532 records). [2025-10-06T19:24:25.112475] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-06T19:24:25.112568] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIW took 43.4s. Estimated remaining: 3h 9m 53s. Rate: 7.1 symbols/min [2025-10-06T19:24:25.294402] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:24:25.329618] [DEBUG] [LOCAL ] HLI: Loaded 31274 existing records from primary storage. [2025-10-06T19:24:25.329961] [INFO ] [MAIN ] HLI: Loaded 31274 existing records. [2025-10-06T19:24:25.432804] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-06T19:24:25.517807] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:24:25.518065] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-06T19:24:25.518125] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-06T19:24:25.519311] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-06T19:24:25.519373] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-06T19:24:25.930004] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:24:25.933216] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-06T19:24:26.225507] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-06T19:24:26.347159] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T19:24:26.569153] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T19:24:27.025548] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-06T19:24:27.622290] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T19:24:27.825539] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-06T19:24:28.625574] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-06T19:24:28.826192] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T19:24:28.859862] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T19:24:29.425590] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-06T19:24:30.225537] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-06T19:24:30.609736] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-06T19:24:30.833020] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T19:24:31.025555] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-06T19:24:31.825513] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-06T19:24:31.855499] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T19:24:32.625585] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-06T19:24:32.992714] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-06T19:24:33.069795] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T19:24:33.425534] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-06T19:24:33.875627] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-06T19:24:34.225549] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-06T19:24:35.025513] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-06T19:24:35.180617] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T19:24:35.825508] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-06T19:24:36.136751] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T19:24:36.138909] [INFO ] [REMOTE ] HKD: Full fetch complete (28365 records). [2025-10-06T19:24:36.139003] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-06T19:24:36.428060] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-06T19:24:36.556268] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-06T19:24:36.556371] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-06T19:24:36.557243] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-06T19:24:36.557308] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-06T19:24:36.558082] [DEBUG] [LOCAL ] HKD: Trimmed 28365 records to 18473 (keeping 200 days of data) [2025-10-06T19:24:36.632786] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-06T19:24:36.667694] [DEBUG] [LOCAL ] HKD: Primary data saved (18473 records). [2025-10-06T19:24:36.667863] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-06T19:24:36.667968] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HKD took 35.4s. Estimated remaining: 3h 9m 49s. Rate: 7.1 symbols/min [2025-10-06T19:24:36.832812] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:24:36.863563] [DEBUG] [LOCAL ] HLIO: Loaded 28237 existing records from primary storage. [2025-10-06T19:24:36.863902] [INFO ] [MAIN ] HLIO: Loaded 28237 existing records. [2025-10-06T19:24:37.055218] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:24:37.055515] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-06T19:24:37.055590] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-06T19:24:37.056587] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-06T19:24:37.056699] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-06T19:24:37.441616] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-06T19:24:37.489982] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:24:37.531314] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T19:24:37.779410] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-06T19:24:38.225582] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-06T19:24:39.025505] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-06T19:24:39.452976] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-06T19:24:39.711363] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T19:24:39.825540] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-06T19:24:40.421682] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T19:24:40.625535] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-06T19:24:41.425510] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-06T19:24:41.591820] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T19:24:41.842916] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-06T19:24:42.225611] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-06T19:24:43.026984] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-06T19:24:43.031148] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T19:24:43.248078] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T19:24:43.825545] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-06T19:24:44.625496] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-06T19:24:45.181986] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-06T19:24:45.416157] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T19:24:45.426006] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-06T19:24:45.600905] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T19:24:46.225583] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-06T19:24:47.025564] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-06T19:24:47.330476] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-06T19:24:47.333548] [INFO ] [REMOTE ] HL: Full fetch complete (77663 records). [2025-10-06T19:24:47.333681] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-06T19:24:47.757765] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-06T19:24:47.757944] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-06T19:24:47.759805] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-06T19:24:47.759988] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-06T19:24:47.762279] [DEBUG] [LOCAL ] HL: Trimmed 77663 records to 53671 (keeping 200 days of data) [2025-10-06T19:24:47.826081] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-06T19:24:47.902816] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T19:24:47.935672] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T19:24:48.172807] [DEBUG] [LOCAL ] HL: Primary data saved (53671 records). [2025-10-06T19:24:48.172984] [INFO ] [MAIN ] HL: Full history saved. [2025-10-06T19:24:48.173087] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HL took 38.2s. Estimated remaining: 3h 9m 44s. Rate: 7.1 symbols/min [2025-10-06T19:24:48.345677] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:24:48.376870] [DEBUG] [LOCAL ] HLLY: Loaded 33661 existing records from primary storage. [2025-10-06T19:24:48.377159] [INFO ] [MAIN ] HLLY: Loaded 33661 existing records. [2025-10-06T19:24:48.549888] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:24:48.550121] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-06T19:24:48.550178] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-06T19:24:48.551376] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-06T19:24:48.551438] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-06T19:24:48.630750] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-06T19:24:48.899008] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:24:49.351564] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T19:24:49.425474] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-06T19:24:50.136359] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T19:24:50.140077] [INFO ] [REMOTE ] HLF: Full fetch complete (71118 records). [2025-10-06T19:24:50.140186] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-06T19:24:50.230735] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-06T19:24:50.529206] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-06T19:24:50.529358] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-06T19:24:50.530511] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-06T19:24:50.530589] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-06T19:24:50.532448] [DEBUG] [LOCAL ] HLF: Trimmed 71118 records to 48493 (keeping 200 days of data) [2025-10-06T19:24:50.634964] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T19:24:50.828364] [DEBUG] [LOCAL ] HLF: Primary data saved (48493 records). [2025-10-06T19:24:50.828516] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-06T19:24:50.828600] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLF took 30.1s. Estimated remaining: 3h 9m 28s. Rate: 7.1 symbols/min [2025-10-06T19:24:50.996140] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:24:51.026961] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-06T19:24:51.056607] [DEBUG] [LOCAL ] HLN: Loaded 53863 existing records from primary storage. [2025-10-06T19:24:51.057155] [INFO ] [MAIN ] HLN: Loaded 53863 existing records. [2025-10-06T19:24:51.262242] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:24:51.262588] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-06T19:24:51.262676] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-06T19:24:51.264639] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-06T19:24:51.264934] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-06T19:24:51.698824] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:24:51.702731] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T19:24:51.825482] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-06T19:24:52.315862] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-06T19:24:52.625555] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-06T19:24:53.425485] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-06T19:24:53.464050] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T19:24:53.877222] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T19:24:54.225543] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-06T19:24:54.689477] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T19:24:55.025614] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-06T19:24:55.825516] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-06T19:24:55.946323] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T19:24:56.385046] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T19:24:56.625490] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-06T19:24:57.034015] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-06T19:24:57.425534] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-06T19:24:58.151227] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T19:24:58.225476] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-06T19:24:58.689158] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T19:24:59.025559] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-06T19:24:59.160593] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T19:24:59.825496] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-06T19:25:00.000955] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T19:25:00.625604] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-06T19:25:01.005171] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T19:25:01.008233] [INFO ] [REMOTE ] HLI: Full fetch complete (45244 records). [2025-10-06T19:25:01.008440] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-06T19:25:01.422097] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-06T19:25:01.422178] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-06T19:25:01.422972] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-06T19:25:01.423034] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-06T19:25:01.424058] [DEBUG] [LOCAL ] HLI: Trimmed 45244 records to 30859 (keeping 200 days of data) [2025-10-06T19:25:01.425509] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-06T19:25:01.633534] [DEBUG] [LOCAL ] HLI: Primary data saved (30859 records). [2025-10-06T19:25:01.633739] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-06T19:25:01.633872] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HLI took 36.5s. Estimated remaining: 3h 9m 23s. Rate: 7.1 symbols/min [2025-10-06T19:25:01.815401] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:25:01.876133] [DEBUG] [LOCAL ] HLT: Loaded 51359 existing records from primary storage. [2025-10-06T19:25:01.876580] [INFO ] [MAIN ] HLT: Loaded 51359 existing records. [2025-10-06T19:25:02.102027] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:25:02.102615] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-06T19:25:02.102728] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-06T19:25:02.104285] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-06T19:25:02.104376] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-06T19:25:02.235367] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-06T19:25:02.251110] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T19:25:02.528270] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:25:03.030622] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-06T19:25:03.043039] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T19:25:03.825494] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-06T19:25:04.201267] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-06T19:25:04.625528] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-06T19:25:04.836406] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T19:25:04.896048] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T19:25:05.425536] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-06T19:25:06.225516] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-06T19:25:06.594515] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T19:25:07.025527] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-06T19:25:07.225695] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T19:25:07.248868] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T19:25:07.825548] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-06T19:25:08.625569] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-06T19:25:08.783721] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T19:25:09.147294] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-06T19:25:09.425565] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-06T19:25:09.550049] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T19:25:09.551865] [INFO ] [REMOTE ] HLIO: Full fetch complete (36324 records). [2025-10-06T19:25:09.551961] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-06T19:25:09.929578] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-06T19:25:09.929747] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-06T19:25:09.930503] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-06T19:25:09.930545] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-06T19:25:09.931462] [DEBUG] [LOCAL ] HLIO: Trimmed 36324 records to 27953 (keeping 200 days of data) [2025-10-06T19:25:10.105750] [DEBUG] [LOCAL ] HLIO: Primary data saved (27953 records). [2025-10-06T19:25:10.105905] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-06T19:25:10.105987] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLIO took 33.4s. Estimated remaining: 3h 9m 14s. Rate: 7.1 symbols/min [2025-10-06T19:25:10.230670] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-06T19:25:10.278741] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:25:10.321500] [DEBUG] [LOCAL ] HLX: Loaded 48451 existing records from primary storage. [2025-10-06T19:25:10.321888] [INFO ] [MAIN ] HLX: Loaded 48451 existing records. [2025-10-06T19:25:10.504206] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:25:10.504563] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-06T19:25:10.504615] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-06T19:25:10.506058] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-06T19:25:10.506122] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-06T19:25:10.872224] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:25:11.025485] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-06T19:25:11.349724] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-06T19:25:11.614573] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T19:25:11.825533] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-06T19:25:12.625527] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-06T19:25:12.850931] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T19:25:12.895925] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T19:25:13.425604] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-06T19:25:14.225547] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-06T19:25:14.512021] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T19:25:14.747362] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T19:25:15.025575] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-06T19:25:15.825539] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-06T19:25:15.936395] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T19:25:16.583229] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T19:25:16.625567] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-06T19:25:17.427710] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-06T19:25:17.427534] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T19:25:18.085973] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T19:25:18.225522] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-06T19:25:18.975634] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T19:25:19.025474] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-06T19:25:19.569683] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T19:25:19.825534] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-06T19:25:20.600309] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T19:25:20.625519] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-06T19:25:21.425506] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-06T19:25:21.620465] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T19:25:22.225526] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-06T19:25:22.353054] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T19:25:22.546550] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-06T19:25:22.548869] [INFO ] [REMOTE ] HLLY: Full fetch complete (46293 records). [2025-10-06T19:25:22.549030] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-06T19:25:22.955183] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-06T19:25:22.955311] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-06T19:25:22.956165] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-06T19:25:22.956228] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-06T19:25:22.957326] [DEBUG] [LOCAL ] HLLY: Trimmed 46293 records to 33352 (keeping 200 days of data) [2025-10-06T19:25:23.037680] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-06T19:25:23.149146] [DEBUG] [LOCAL ] HLLY: Primary data saved (33352 records). [2025-10-06T19:25:23.149317] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-06T19:25:23.149405] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLLY took 35.0s. Estimated remaining: 3h 9m 12s. Rate: 7.1 symbols/min [2025-10-06T19:25:23.318534] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:25:23.369391] [DEBUG] [LOCAL ] HMC: Loaded 47350 existing records from primary storage. [2025-10-06T19:25:23.370618] [INFO ] [MAIN ] HMC: Loaded 47350 existing records. [2025-10-06T19:25:23.558267] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:25:23.558574] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-06T19:25:23.558634] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-06T19:25:23.560348] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-06T19:25:23.560422] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-06T19:25:23.838203] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-06T19:25:23.962302] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:25:23.967326] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T19:25:24.625541] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-06T19:25:24.750543] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T19:25:25.425608] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-06T19:25:25.546938] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T19:25:26.225602] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-06T19:25:26.625499] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-06T19:25:27.025524] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-06T19:25:27.154820] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T19:25:27.777667] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T19:25:27.825482] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-06T19:25:28.625505] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-06T19:25:28.734627] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T19:25:29.425560] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-06T19:25:29.536918] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T19:25:30.152561] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T19:25:30.156093] [INFO ] [REMOTE ] HLN: Full fetch complete (76810 records). [2025-10-06T19:25:30.156242] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-06T19:25:30.230778] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-06T19:25:30.598277] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-06T19:25:30.598419] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-06T19:25:30.599732] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-06T19:25:30.599826] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-06T19:25:30.601840] [DEBUG] [LOCAL ] HLN: Trimmed 76810 records to 53099 (keeping 200 days of data) [2025-10-06T19:25:30.933046] [DEBUG] [LOCAL ] HLN: Primary data saved (53099 records). [2025-10-06T19:25:30.933250] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-06T19:25:30.934258] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLN took 40.1s. Estimated remaining: 3h 9m 2s. Rate: 7.1 symbols/min [2025-10-06T19:25:31.030742] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-06T19:25:31.118810] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T19:25:31.147960] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:25:31.176292] [DEBUG] [LOCAL ] HMN: Loaded 23661 existing records from primary storage. [2025-10-06T19:25:31.176664] [INFO ] [MAIN ] HMN: Loaded 23661 existing records. [2025-10-06T19:25:31.350487] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:25:31.350783] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-06T19:25:31.350836] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-06T19:25:31.351737] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-06T19:25:31.351798] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-06T19:25:31.704817] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:25:31.825521] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-06T19:25:31.891176] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T19:25:32.481138] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T19:25:32.625551] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-06T19:25:32.926239] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T19:25:33.425636] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-06T19:25:34.182530] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T19:25:34.225480] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-06T19:25:34.369872] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-06T19:25:35.025545] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-06T19:25:35.814090] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T19:25:35.825505] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-06T19:25:36.051709] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T19:25:36.625579] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-06T19:25:37.256622] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T19:25:37.259735] [INFO ] [REMOTE ] HLT: Full fetch complete (73465 records). [2025-10-06T19:25:37.259847] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-06T19:25:37.433372] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-06T19:25:37.662839] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-06T19:25:37.662968] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-06T19:25:37.664065] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-06T19:25:37.664132] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-06T19:25:37.665842] [DEBUG] [LOCAL ] HLT: Trimmed 73465 records to 50609 (keeping 200 days of data) [2025-10-06T19:25:37.982730] [DEBUG] [LOCAL ] HLT: Primary data saved (50609 records). [2025-10-06T19:25:37.982876] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-06T19:25:37.983408] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLT took 36.3s. Estimated remaining: 3h 8m 52s. Rate: 7.1 symbols/min [2025-10-06T19:25:38.152449] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:25:38.211600] [DEBUG] [LOCAL ] HMY: Loaded 53914 existing records from primary storage. [2025-10-06T19:25:38.211975] [INFO ] [MAIN ] HMY: Loaded 53914 existing records. [2025-10-06T19:25:38.236682] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-06T19:25:38.400340] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:25:38.400842] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-06T19:25:38.400953] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-06T19:25:38.401405] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-06T19:25:38.401479] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-06T19:25:38.536491] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T19:25:38.794623] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:25:39.025483] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-06T19:25:39.244339] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-06T19:25:39.435031] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T19:25:39.825606] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-06T19:25:40.625551] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-06T19:25:40.788116] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T19:25:41.425638] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-06T19:25:41.630101] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T19:25:41.813520] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-06T19:25:42.225597] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-06T19:25:43.025496] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-06T19:25:43.364002] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-06T19:25:43.757196] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T19:25:43.825494] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-06T19:25:44.625605] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-06T19:25:44.772348] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T19:25:45.286167] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T19:25:45.288993] [INFO ] [REMOTE ] HLX: Full fetch complete (69195 records). [2025-10-06T19:25:45.289113] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-06T19:25:45.433887] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-06T19:25:45.686766] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-06T19:25:45.686864] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-06T19:25:45.688362] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-06T19:25:45.688427] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-06T19:25:45.689860] [DEBUG] [LOCAL ] HLX: Trimmed 69195 records to 47698 (keeping 200 days of data) [2025-10-06T19:25:45.954472] [DEBUG] [LOCAL ] HLX: Primary data saved (47698 records). [2025-10-06T19:25:45.954633] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-06T19:25:45.954770] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLX took 35.8s. Estimated remaining: 3h 8m 43s. Rate: 7.1 symbols/min [2025-10-06T19:25:46.127835] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:25:46.128067] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-06T19:25:46.128113] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-06T19:25:46.128225] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-06T19:25:46.128267] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-06T19:25:46.128308] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-06T19:25:46.128339] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-06T19:25:46.225679] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-06T19:25:46.483842] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:25:46.511069] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T19:25:47.025501] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-06T19:25:47.085435] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T19:25:47.583186] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T19:25:47.825551] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-06T19:25:48.625552] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-06T19:25:49.069396] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-06T19:25:49.275232] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T19:25:49.425533] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-06T19:25:49.662206] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T19:25:50.225594] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-06T19:25:51.025569] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-06T19:25:51.162181] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T19:25:51.361359] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T19:25:51.825531] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-06T19:25:52.625580] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-06T19:25:52.811997] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T19:25:52.812326] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-06T19:25:52.812426] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:25:52.812476] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-06T19:25:52.812510] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:25:52.812584] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-06T19:25:52.812693] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-06T19:25:52.812748] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-06T19:25:52.812805] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-06T19:25:52.812874] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HNGE took 6.9s. Estimated remaining: 3h 8m 32s. Rate: 7.1 symbols/min [2025-10-06T19:25:52.989067] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:25:53.022901] [DEBUG] [LOCAL ] HNI: Loaded 29796 existing records from primary storage. [2025-10-06T19:25:53.023392] [INFO ] [MAIN ] HNI: Loaded 29796 existing records. [2025-10-06T19:25:53.205842] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:25:53.206941] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-06T19:25:53.207003] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-06T19:25:53.220399] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-06T19:25:53.239370] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-06T19:25:53.280084] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-06T19:25:53.437230] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-06T19:25:53.627461] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:25:53.663781] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T19:25:54.225565] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-06T19:25:55.025608] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-06T19:25:55.543470] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T19:25:55.573172] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-06T19:25:55.825544] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-06T19:25:56.557282] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T19:25:56.560408] [INFO ] [REMOTE ] HMC: Full fetch complete (69335 records). [2025-10-06T19:25:56.560564] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-06T19:25:56.635401] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-06T19:25:56.980060] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-06T19:25:56.980183] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-06T19:25:56.981510] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-06T19:25:56.981603] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-06T19:25:56.983491] [DEBUG] [LOCAL ] HMC: Trimmed 69335 records to 46633 (keeping 200 days of data) [2025-10-06T19:25:57.279587] [DEBUG] [LOCAL ] HMC: Primary data saved (46633 records). [2025-10-06T19:25:57.279806] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-06T19:25:57.279937] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMC took 34.1s. Estimated remaining: 3h 8m 19s. Rate: 7.1 symbols/min [2025-10-06T19:25:57.436065] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-06T19:25:57.472405] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:25:57.529252] [DEBUG] [LOCAL ] HOG: Loaded 51853 existing records from primary storage. [2025-10-06T19:25:57.529720] [INFO ] [MAIN ] HOG: Loaded 51853 existing records. [2025-10-06T19:25:57.739118] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:25:57.739584] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-06T19:25:57.739757] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-06T19:25:57.740247] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-06T19:25:57.740311] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-06T19:25:57.904473] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-06T19:25:58.025020] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T19:25:58.219795] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:25:58.225550] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-06T19:25:58.497825] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T19:25:59.025577] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-06T19:25:59.351355] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T19:25:59.825550] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-06T19:26:00.625551] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-06T19:26:01.238270] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T19:26:01.361296] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-06T19:26:01.425549] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-06T19:26:01.685284] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T19:26:02.225538] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-06T19:26:02.637882] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T19:26:03.025532] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-06T19:26:03.224759] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T19:26:03.226468] [INFO ] [REMOTE ] HMN: Full fetch complete (31547 records). [2025-10-06T19:26:03.226608] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-06T19:26:03.641267] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-06T19:26:03.641377] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-06T19:26:03.642324] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-06T19:26:03.642390] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-06T19:26:03.643450] [DEBUG] [LOCAL ] HMN: Trimmed 31547 records to 23470 (keeping 200 days of data) [2025-10-06T19:26:03.796570] [DEBUG] [LOCAL ] HMN: Primary data saved (23470 records). [2025-10-06T19:26:03.796764] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-06T19:26:03.796870] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMN took 32.9s. Estimated remaining: 3h 8m 8s. Rate: 7.1 symbols/min [2025-10-06T19:26:03.828972] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-06T19:26:03.976072] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:26:04.024164] [DEBUG] [LOCAL ] HOMB: Loaded 44129 existing records from primary storage. [2025-10-06T19:26:04.024560] [INFO ] [MAIN ] HOMB: Loaded 44129 existing records. [2025-10-06T19:26:04.206012] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:26:04.206366] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-06T19:26:04.206428] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-06T19:26:04.206791] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-06T19:26:04.206852] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-06T19:26:04.594934] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:26:04.625500] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-06T19:26:04.735308] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T19:26:05.425545] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-06T19:26:05.619300] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-06T19:26:06.058304] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-06T19:26:06.225544] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-06T19:26:07.025556] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-06T19:26:07.169611] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T19:26:07.825556] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-06T19:26:08.246239] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T19:26:08.520777] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-06T19:26:08.625557] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-06T19:26:09.338537] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T19:26:09.425562] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-06T19:26:09.971464] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T19:26:10.150373] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-06T19:26:10.225617] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-06T19:26:11.025612] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-06T19:26:11.799856] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T19:26:11.825486] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-06T19:26:12.625502] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-06T19:26:12.740505] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T19:26:13.329013] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T19:26:13.425578] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-06T19:26:14.225534] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-06T19:26:14.420127] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T19:26:15.035553] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-06T19:26:15.042770] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T19:26:15.354782] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T19:26:15.357741] [INFO ] [REMOTE ] HNI: Full fetch complete (42043 records). [2025-10-06T19:26:15.357841] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-06T19:26:15.738256] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-06T19:26:15.738362] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-06T19:26:15.739563] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-06T19:26:15.739671] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-06T19:26:15.741035] [DEBUG] [LOCAL ] HNI: Trimmed 42043 records to 29391 (keeping 200 days of data) [2025-10-06T19:26:15.839640] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-06T19:26:15.944321] [DEBUG] [LOCAL ] HNI: Primary data saved (29391 records). [2025-10-06T19:26:15.944555] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-06T19:26:15.944740] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HNI took 23.1s. Estimated remaining: 3h 8m 4s. Rate: 7.1 symbols/min [2025-10-06T19:26:16.625571] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-06T19:26:17.004233] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-06T19:26:17.008466] [INFO ] [REMOTE ] HMY: Full fetch complete (76760 records). [2025-10-06T19:26:17.008633] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-06T19:26:17.433332] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-06T19:26:17.433483] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-06T19:26:17.435113] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-06T19:26:17.435348] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-06T19:26:17.473046] [DEBUG] [LOCAL ] HMY: Trimmed 76760 records to 53139 (keeping 200 days of data) [2025-10-06T19:26:17.472855] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T19:26:17.485688] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-06T19:26:17.837562] [DEBUG] [LOCAL ] HMY: Primary data saved (53139 records). [2025-10-06T19:26:17.837830] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-06T19:26:17.837945] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HMY took 39.9s. Estimated remaining: 3h 7m 47s. Rate: 7.1 symbols/min [2025-10-06T19:26:18.235577] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T19:26:18.246490] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-06T19:26:19.175604] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T19:26:19.186513] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-06T19:26:19.968818] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T19:26:19.979872] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-06T19:26:20.580041] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T19:26:20.625511] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-06T19:26:20.727298] [DEBUG] [REMOTE ] HOMB: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-06T19:26:20.727761] [WARN ] [REMOTE ] HOMB: No data returned for month 2025-06 [2025-10-06T19:26:20.727859] [FATAL] [REMOTE ] HOMB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:26:20.727946] [FATAL] [MAIN ] HOMB: Failed to fetch primary data. [2025-10-06T19:26:20.728011] [WARN ] [MAIN ] HOMB: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:26:20.728083] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-06T19:26:20.728152] [DEBUG] [LOCAL ] HOMB: No primary data file found to delete. [2025-10-06T19:26:20.728189] [INFO ] [LOCAL ] HOMB: Starting deletion of derivative data. [2025-10-06T19:26:20.728444] [DEBUG] [LOCAL ] HOMB: Deleted derivative data file. [2025-10-06T19:26:20.728535] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HOMB took 16.9s. Estimated remaining: 3h 7m 32s. Rate: 7.1 symbols/min [2025-10-06T19:26:21.593224] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T19:26:21.604321] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-06T19:26:23.277713] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T19:26:23.288724] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-06T19:26:25.106458] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T19:26:25.117713] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-06T19:26:26.831710] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T19:26:26.844265] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-06T19:26:28.471379] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T19:26:28.474347] [INFO ] [REMOTE ] HOG: Full fetch complete (74162 records). [2025-10-06T19:26:28.474503] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-06T19:26:28.855617] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-06T19:26:28.855739] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-06T19:26:28.857077] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-06T19:26:28.857148] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-06T19:26:28.858721] [DEBUG] [LOCAL ] HOG: Trimmed 74162 records to 51071 (keeping 200 days of data) [2025-10-06T19:26:29.201881] [DEBUG] [LOCAL ] HOG: Primary data saved (51071 records). [2025-10-06T19:26:29.202120] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-06T19:26:29.202221] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HOG took 31.9s. Estimated remaining: 3h 7m 23s. Rate: 7.1 symbols/min [2025-10-06T19:26:29.862309] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:26:29.881390] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:26:29.920292] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:26:29.939237] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:26:29.966257] [DEBUG] [LOCAL ] HOV: Loaded 13893 existing records from primary storage. [2025-10-06T19:26:29.966715] [INFO ] [MAIN ] HOV: Loaded 13893 existing records. [2025-10-06T19:26:30.107569] [DEBUG] [LOCAL ] HOUS: Loaded 45288 existing records from primary storage. [2025-10-06T19:26:30.119266] [INFO ] [MAIN ] HOUS: Loaded 45288 existing records. [2025-10-06T19:26:30.329841] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:26:30.316187] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-10-06T19:26:30.339771] [INFO ] [MAIN ] HPE: Loaded 54477 existing records. [2025-10-06T19:26:30.339687] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-06T19:26:30.339912] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-06T19:26:30.369326] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-06T19:26:30.411145] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-06T19:26:30.501745] [DEBUG] [LOCAL ] HP: Loaded 52346 existing records from primary storage. [2025-10-06T19:26:30.549352] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:26:30.591189] [INFO ] [MAIN ] HP: Loaded 52346 existing records. [2025-10-06T19:26:30.605932] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-06T19:26:30.636310] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-06T19:26:30.770899] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-06T19:26:30.808198] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:26:30.868364] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-06T19:26:30.854887] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-06T19:26:30.955553] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-06T19:26:31.153032] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-06T19:26:31.152940] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:26:31.163697] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-06T19:26:31.163787] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-06T19:26:31.199596] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-06T19:26:31.286615] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-06T19:26:31.363003] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-06T19:26:31.599493] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:26:31.730591] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-06T19:26:32.042141] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:26:32.079590] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-06T19:26:32.246534] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:26:32.262230] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-06T19:26:32.314219] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:26:32.314468] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-06T19:26:32.740234] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-06T19:26:32.743872] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-06T19:26:33.351920] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T19:26:33.360104] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-06T19:26:33.640193] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T19:26:33.643734] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-06T19:26:33.960603] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T19:26:33.970447] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-06T19:26:34.287081] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-06T19:26:34.298001] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-06T19:26:34.442630] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T19:26:34.445337] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-06T19:26:34.780604] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T19:26:34.789392] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-06T19:26:35.317888] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-06T19:26:35.327469] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-06T19:26:35.403278] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T19:26:35.406264] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-06T19:26:36.059249] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T19:26:36.070125] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-06T19:26:36.156894] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T19:26:36.166117] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-06T19:26:36.251593] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-06T19:26:36.625559] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-06T19:26:36.844677] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T19:26:37.114711] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-06T19:26:37.425515] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-06T19:26:37.653485] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T19:26:37.761131] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T19:26:38.225498] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-06T19:26:38.378060] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T19:26:39.025584] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-06T19:26:39.825504] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-06T19:26:40.265883] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-06T19:26:40.337908] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-06T19:26:40.625515] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-06T19:26:40.820747] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-06T19:26:41.425551] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-06T19:26:42.225598] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-06T19:26:42.446816] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T19:26:42.471103] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T19:26:43.025548] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-06T19:26:43.819966] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T19:26:43.830171] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-06T19:26:43.948151] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T19:26:44.625521] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-06T19:26:45.272630] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T19:26:45.425528] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-06T19:26:46.225511] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-06T19:26:46.450762] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T19:26:46.795434] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T19:26:46.810539] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T19:26:46.811732] [INFO ] [REMOTE ] HOV: Full fetch complete (19187 records). [2025-10-06T19:26:46.811807] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-06T19:26:47.030799] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-06T19:26:47.214506] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-06T19:26:47.214623] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-06T19:26:47.215376] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-06T19:26:47.215437] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-06T19:26:47.216128] [DEBUG] [LOCAL ] HOV: Trimmed 19187 records to 13870 (keeping 200 days of data) [2025-10-06T19:26:47.313885] [DEBUG] [LOCAL ] HOV: Primary data saved (13870 records). [2025-10-06T19:26:47.314107] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-06T19:26:47.314233] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 18.1s. Estimated remaining: 3h 7m 27s. Rate: 7.1 symbols/min [2025-10-06T19:26:47.499396] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:26:47.512122] [DEBUG] [LOCAL ] HPF: Loaded 7503 existing records from primary storage. [2025-10-06T19:26:47.512459] [INFO ] [MAIN ] HPF: Loaded 7503 existing records. [2025-10-06T19:26:47.701826] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:26:47.702157] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-06T19:26:47.702207] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-06T19:26:47.702477] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-06T19:26:47.702536] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-06T19:26:47.830703] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-06T19:26:48.082239] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:26:48.625485] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-06T19:26:49.110516] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-06T19:26:49.425562] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-06T19:26:49.578945] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T19:26:50.225584] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-06T19:26:50.370601] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T19:26:50.410111] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T19:26:51.025539] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-06T19:26:51.825510] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-06T19:26:52.148846] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-06T19:26:52.263427] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-06T19:26:52.608833] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T19:26:52.625484] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-06T19:26:53.425539] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-06T19:26:54.026920] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T19:26:54.225490] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-06T19:26:54.350367] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T19:26:55.025560] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-06T19:26:55.671211] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-06T19:26:55.836497] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-06T19:26:55.856034] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T19:26:56.625577] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-06T19:26:57.405498] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-06T19:26:57.425504] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-06T19:26:57.988859] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-06T19:26:58.116816] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-06T19:26:58.225544] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-06T19:26:59.025579] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-06T19:26:59.825501] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-06T19:26:59.909991] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T19:27:00.201385] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T19:27:00.625481] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-06T19:27:01.425544] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-06T19:27:01.689629] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T19:27:02.225721] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-06T19:27:02.773314] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T19:27:02.777802] [INFO ] [REMOTE ] HOUS: Full fetch complete (63819 records). [2025-10-06T19:27:02.778114] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-06T19:27:03.038006] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-06T19:27:03.289197] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-06T19:27:03.289353] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-06T19:27:03.291438] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-06T19:27:03.291616] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-06T19:27:03.348807] [DEBUG] [LOCAL ] HOUS: Trimmed 63819 records to 44769 (keeping 200 days of data) [2025-10-06T19:27:03.355541] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-06T19:27:03.747417] [DEBUG] [LOCAL ] HOUS: Primary data saved (44769 records). [2025-10-06T19:27:03.747718] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-06T19:27:03.747881] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOUS took 34.5s. Estimated remaining: 3h 7m 29s. Rate: 7.1 symbols/min [2025-10-06T19:27:03.830711] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-06T19:27:04.017195] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T19:27:04.061505] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:27:04.110356] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T19:27:04.126601] [DEBUG] [LOCAL ] HPI: Loaded 10537 existing records from primary storage. [2025-10-06T19:27:04.127579] [INFO ] [MAIN ] HPI: Loaded 10537 existing records. [2025-10-06T19:27:04.318846] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:27:04.319130] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-06T19:27:04.319185] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-06T19:27:04.319426] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-06T19:27:04.319489] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-06T19:27:04.630816] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-06T19:27:04.672633] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:27:05.402972] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-06T19:27:05.425493] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-06T19:27:05.732420] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-06T19:27:05.735843] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-10-06T19:27:05.735980] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-06T19:27:06.131215] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-06T19:27:06.131309] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-06T19:27:06.132387] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-06T19:27:06.132452] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-06T19:27:06.134070] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-10-06T19:27:06.228088] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-06T19:27:06.230461] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-06T19:27:06.480927] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-06T19:27:06.481104] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-06T19:27:06.481215] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HPE took 37.3s. Estimated remaining: 3h 7m 13s. Rate: 7.1 symbols/min [2025-10-06T19:27:06.650373] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:27:06.701173] [DEBUG] [LOCAL ] HPP: Loaded 51658 existing records from primary storage. [2025-10-06T19:27:06.701522] [INFO ] [MAIN ] HPP: Loaded 51658 existing records. [2025-10-06T19:27:06.877306] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:27:06.877568] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-06T19:27:06.877666] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-06T19:27:06.878057] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-06T19:27:06.878167] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-06T19:27:07.034455] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-06T19:27:07.163794] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T19:27:07.277669] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:27:07.825538] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-06T19:27:08.625509] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-06T19:27:08.812803] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T19:27:09.262394] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T19:27:09.263508] [INFO ] [REMOTE ] HPF: Full fetch complete (10839 records). [2025-10-06T19:27:09.263583] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-06T19:27:09.442427] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-06T19:27:09.683303] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-06T19:27:09.698860] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-06T19:27:09.712038] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-06T19:27:09.712791] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-06T19:27:09.714033] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-06T19:27:09.725529] [DEBUG] [LOCAL ] HPF: Trimmed 10839 records to 7465 (keeping 200 days of data) [2025-10-06T19:27:09.771787] [DEBUG] [LOCAL ] HPF: Primary data saved (7465 records). [2025-10-06T19:27:09.771937] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-06T19:27:09.772053] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HPF took 22.5s. Estimated remaining: 3h 6m 58s. Rate: 7.1 symbols/min [2025-10-06T19:27:09.950893] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:27:10.005631] [DEBUG] [LOCAL ] HPQ: Loaded 54447 existing records from primary storage. [2025-10-06T19:27:10.006049] [INFO ] [MAIN ] HPQ: Loaded 54447 existing records. [2025-10-06T19:27:10.180183] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:27:10.180462] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-06T19:27:10.180525] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-06T19:27:10.181073] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-06T19:27:10.181134] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-06T19:27:10.234338] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-06T19:27:10.537018] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:27:11.025536] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-06T19:27:11.111461] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-06T19:27:11.115920] [INFO ] [REMOTE ] HP: Full fetch complete (74014 records). [2025-10-06T19:27:11.116034] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-06T19:27:11.517251] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-06T19:27:11.517405] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-06T19:27:11.518680] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-06T19:27:11.518748] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-06T19:27:11.522538] [DEBUG] [LOCAL ] HP: Trimmed 74014 records to 51643 (keeping 200 days of data) [2025-10-06T19:27:11.827564] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-06T19:27:11.866498] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T19:27:11.891669] [DEBUG] [LOCAL ] HP: Primary data saved (51643 records). [2025-10-06T19:27:11.891823] [INFO ] [MAIN ] HP: Full history saved. [2025-10-06T19:27:11.891913] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HP took 42.7s. Estimated remaining: 3h 6m 42s. Rate: 7.1 symbols/min [2025-10-06T19:27:12.071868] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:27:12.084879] [DEBUG] [LOCAL ] HPS: Loaded 10340 existing records from primary storage. [2025-10-06T19:27:12.085133] [INFO ] [MAIN ] HPS: Loaded 10340 existing records. [2025-10-06T19:27:12.264567] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:27:12.264845] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-06T19:27:12.264893] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-06T19:27:12.265149] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-06T19:27:12.265209] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-06T19:27:12.584413] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-06T19:27:12.631229] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-06T19:27:12.677020] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:27:12.792244] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T19:27:13.425558] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-06T19:27:14.038322] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T19:27:14.225535] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-06T19:27:14.238004] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T19:27:15.025569] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-06T19:27:15.819716] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T19:27:15.829450] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-06T19:27:16.447666] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T19:27:16.625504] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-06T19:27:16.720998] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T19:27:17.296736] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-06T19:27:17.425503] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-06T19:27:18.170221] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T19:27:18.225494] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-06T19:27:18.931460] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-06T19:27:19.025500] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-06T19:27:19.734743] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T19:27:19.825542] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-06T19:27:20.599818] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T19:27:20.625552] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-06T19:27:21.425550] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-06T19:27:22.186361] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-06T19:27:22.225519] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-06T19:27:22.315850] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T19:27:23.025574] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-06T19:27:23.061774] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T19:27:23.825547] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-06T19:27:24.625610] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-06T19:27:24.673058] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T19:27:25.425584] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-06T19:27:25.475486] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T19:27:25.575007] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T19:27:26.225570] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-06T19:27:26.389696] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T19:27:26.981266] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T19:27:27.025536] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-06T19:27:27.788685] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T19:27:27.825476] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-06T19:27:28.533535] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-06T19:27:28.625532] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-06T19:27:29.390816] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T19:27:29.425469] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-06T19:27:30.225506] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-06T19:27:30.423926] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-06T19:27:31.025546] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-06T19:27:31.825551] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-06T19:27:31.948840] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T19:27:31.950497] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T19:27:31.962287] [INFO ] [REMOTE ] HPI: Full fetch complete (13974 records). [2025-10-06T19:27:31.962680] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-06T19:27:32.366547] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-06T19:27:32.366917] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-06T19:27:32.367783] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-06T19:27:32.367858] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-06T19:27:32.368543] [DEBUG] [LOCAL ] HPI: Trimmed 13974 records to 10524 (keeping 200 days of data) [2025-10-06T19:27:32.426495] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T19:27:32.455112] [DEBUG] [LOCAL ] HPI: Primary data saved (10524 records). [2025-10-06T19:27:32.455340] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-06T19:27:32.455456] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPI took 28.7s. Estimated remaining: 3h 6m 48s. Rate: 7.1 symbols/min [2025-10-06T19:27:32.641422] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:27:32.637401] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-06T19:27:32.674598] [DEBUG] [LOCAL ] HQH: Loaded 25615 existing records from primary storage. [2025-10-06T19:27:32.674982] [INFO ] [MAIN ] HQH: Loaded 25615 existing records. [2025-10-06T19:27:32.864670] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:27:32.865012] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-06T19:27:32.865075] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-06T19:27:32.865714] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-06T19:27:32.865778] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-06T19:27:33.265128] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:27:33.425602] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-06T19:27:34.225528] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-06T19:27:34.650333] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T19:27:35.017728] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T19:27:35.027704] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-06T19:27:35.057736] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-06T19:27:35.825560] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-06T19:27:36.198748] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T19:27:36.625573] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-06T19:27:37.425548] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-06T19:27:37.527986] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T19:27:37.811204] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T19:27:38.225557] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-06T19:27:39.025567] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-06T19:27:39.372712] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T19:27:39.463291] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-06T19:27:39.702677] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-06T19:27:39.704116] [INFO ] [REMOTE ] HPS: Full fetch complete (15270 records). [2025-10-06T19:27:39.704191] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-06T19:27:39.830617] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-06T19:27:40.127110] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-06T19:27:40.127238] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-06T19:27:40.128110] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-06T19:27:40.128175] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-06T19:27:40.128915] [DEBUG] [LOCAL ] HPS: Trimmed 15270 records to 10238 (keeping 200 days of data) [2025-10-06T19:27:40.194610] [DEBUG] [LOCAL ] HPS: Primary data saved (10238 records). [2025-10-06T19:27:40.194826] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-06T19:27:40.194934] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPS took 28.3s. Estimated remaining: 3h 6m 39s. Rate: 7.1 symbols/min [2025-10-06T19:27:40.372172] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:27:40.393867] [DEBUG] [LOCAL ] HQL: Loaded 16628 existing records from primary storage. [2025-10-06T19:27:40.394222] [INFO ] [MAIN ] HQL: Loaded 16628 existing records. [2025-10-06T19:27:40.583142] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:27:40.583436] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-06T19:27:40.583485] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-06T19:27:40.583817] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-06T19:27:40.583878] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-06T19:27:40.630822] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-06T19:27:40.961722] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:27:41.425498] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-06T19:27:41.535244] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T19:27:41.750693] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T19:27:42.225506] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-06T19:27:42.282080] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-06T19:27:43.025538] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-06T19:27:43.825562] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-06T19:27:43.862446] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T19:27:44.001950] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T19:27:44.625506] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-06T19:27:45.009084] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T19:27:45.425532] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-06T19:27:46.225507] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-06T19:27:46.334552] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T19:27:46.390430] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-06T19:27:47.025497] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-06T19:27:47.268310] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T19:27:47.769756] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T19:27:47.825477] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-06T19:27:48.625616] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-06T19:27:49.105549] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-06T19:27:49.425583] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-06T19:27:50.225557] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-06T19:27:50.372390] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T19:27:50.616344] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T19:27:51.025566] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-06T19:27:51.159962] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T19:27:51.825763] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-06T19:27:52.194732] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T19:27:52.625538] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-06T19:27:53.425512] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-06T19:27:53.504181] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-06T19:27:53.679802] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T19:27:54.225597] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-06T19:27:54.236121] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T19:27:54.238761] [INFO ] [REMOTE ] HQH: Full fetch complete (37407 records). [2025-10-06T19:27:54.238850] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-06T19:27:54.627446] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-06T19:27:54.627631] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-06T19:27:54.628528] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-06T19:27:54.628591] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-06T19:27:54.629483] [DEBUG] [LOCAL ] HQH: Trimmed 37407 records to 25404 (keeping 200 days of data) [2025-10-06T19:27:54.802258] [DEBUG] [LOCAL ] HQH: Primary data saved (25404 records). [2025-10-06T19:27:54.802428] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-06T19:27:54.802518] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HQH took 22.3s. Estimated remaining: 3h 6m 38s. Rate: 7.1 symbols/min [2025-10-06T19:27:54.950106] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T19:27:55.005002] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:27:55.033813] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-06T19:27:55.062955] [DEBUG] [LOCAL ] HR: Loaded 52706 existing records from primary storage. [2025-10-06T19:27:55.063485] [INFO ] [MAIN ] HR: Loaded 52706 existing records. [2025-10-06T19:27:55.275541] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:27:55.275867] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-06T19:27:55.275918] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-06T19:27:55.276334] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-06T19:27:55.276396] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-06T19:27:55.698680] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:27:55.830721] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-06T19:27:55.836158] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T19:27:56.625543] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-06T19:27:57.414361] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T19:27:57.417579] [INFO ] [REMOTE ] HPP: Full fetch complete (73340 records). [2025-10-06T19:27:57.417767] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-06T19:27:57.430743] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-06T19:27:57.757098] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T19:27:57.831974] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-06T19:27:57.832056] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-06T19:27:57.833119] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-06T19:27:57.833183] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-06T19:27:57.834545] [DEBUG] [LOCAL ] HPP: Trimmed 73340 records to 51012 (keeping 200 days of data) [2025-10-06T19:27:58.117221] [DEBUG] [LOCAL ] HPP: Primary data saved (51012 records). [2025-10-06T19:27:58.117455] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-06T19:27:58.117562] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPP took 51.6s. Estimated remaining: 3h 6m 23s. Rate: 7.1 symbols/min [2025-10-06T19:27:58.230757] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-06T19:27:58.290748] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:27:58.336137] [DEBUG] [LOCAL ] HRB: Loaded 49183 existing records from primary storage. [2025-10-06T19:27:58.336473] [INFO ] [MAIN ] HRB: Loaded 49183 existing records. [2025-10-06T19:27:58.511685] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:27:58.511883] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-06T19:27:58.511929] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-06T19:27:58.512207] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-06T19:27:58.512263] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-06T19:27:58.864088] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:27:59.025477] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-06T19:27:59.194324] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T19:27:59.604181] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-06T19:27:59.825566] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-06T19:28:00.625533] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-06T19:28:00.662177] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T19:28:01.425495] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-06T19:28:01.617116] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-06T19:28:01.620259] [INFO ] [REMOTE ] HPQ: Full fetch complete (77669 records). [2025-10-06T19:28:01.620409] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-06T19:28:02.009834] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-06T19:28:02.009965] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-06T19:28:02.011068] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-06T19:28:02.011138] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-06T19:28:02.013630] [DEBUG] [LOCAL ] HPQ: Trimmed 77669 records to 53668 (keeping 200 days of data) [2025-10-06T19:28:02.227234] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-06T19:28:02.365843] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-10-06T19:28:02.366053] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-06T19:28:02.367409] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HPQ took 52.6s. Estimated remaining: 3h 6m 10s. Rate: 7.1 symbols/min [2025-10-06T19:28:02.534205] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T19:28:02.592838] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:28:02.644752] [DEBUG] [LOCAL ] HRI: Loaded 33230 existing records from primary storage. [2025-10-06T19:28:02.645094] [INFO ] [MAIN ] HRI: Loaded 33230 existing records. [2025-10-06T19:28:02.822388] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:28:02.822790] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-06T19:28:02.822917] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-06T19:28:02.823555] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-06T19:28:02.823614] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-06T19:28:03.031701] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-06T19:28:03.180775] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:28:03.208098] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-06T19:28:03.411579] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T19:28:03.805099] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T19:28:03.806970] [INFO ] [REMOTE ] HQL: Full fetch complete (25017 records). [2025-10-06T19:28:03.807043] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-06T19:28:03.832363] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-06T19:28:04.180194] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-06T19:28:04.180286] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-06T19:28:04.180881] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-06T19:28:04.180943] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-06T19:28:04.181628] [DEBUG] [LOCAL ] HQL: Trimmed 25017 records to 16481 (keeping 200 days of data) [2025-10-06T19:28:04.281680] [DEBUG] [LOCAL ] HQL: Primary data saved (16481 records). [2025-10-06T19:28:04.281844] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-06T19:28:04.281928] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQL took 24.1s. Estimated remaining: 3h 5m 53s. Rate: 7.1 symbols/min [2025-10-06T19:28:04.480118] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:28:04.536376] [DEBUG] [LOCAL ] HRL: Loaded 53847 existing records from primary storage. [2025-10-06T19:28:04.536921] [INFO ] [MAIN ] HRL: Loaded 53847 existing records. [2025-10-06T19:28:04.630700] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-06T19:28:04.718445] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:28:04.718738] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-06T19:28:04.718792] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-06T19:28:04.719127] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-06T19:28:04.719186] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-06T19:28:05.078908] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:28:05.425487] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-06T19:28:05.507440] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T19:28:06.225583] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-06T19:28:06.286963] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T19:28:06.831600] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-06T19:28:07.025560] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-06T19:28:07.728981] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T19:28:07.825521] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-06T19:28:08.625496] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-06T19:28:08.774428] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T19:28:09.425523] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-06T19:28:09.671968] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T19:28:09.877762] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T19:28:10.225585] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-06T19:28:10.859427] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T19:28:11.025546] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-06T19:28:11.825547] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-06T19:28:12.057303] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-06T19:28:12.162849] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T19:28:12.625538] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-06T19:28:13.289162] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T19:28:13.425548] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-06T19:28:14.026079] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T19:28:14.225540] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-06T19:28:15.025564] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-06T19:28:15.088406] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T19:28:15.825557] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-06T19:28:16.166813] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-06T19:28:16.385581] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T19:28:16.625567] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-06T19:28:17.425503] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-06T19:28:17.687094] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T19:28:18.225525] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-06T19:28:18.260825] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T19:28:18.769589] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T19:28:19.025608] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-06T19:28:19.792507] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T19:28:19.825494] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-06T19:28:20.065277] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T19:28:20.625614] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-06T19:28:21.299899] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T19:28:21.425512] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-06T19:28:21.880518] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-06T19:28:22.225536] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-06T19:28:23.025566] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-06T19:28:23.103636] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T19:28:23.826568] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-06T19:28:23.832318] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T19:28:24.493554] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T19:28:24.625566] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-06T19:28:24.937162] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T19:28:25.425608] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-06T19:28:25.675694] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T19:28:26.225553] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-06T19:28:26.985901] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T19:28:27.025477] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-06T19:28:27.492405] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-06T19:28:27.825526] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-06T19:28:28.625599] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-06T19:28:28.862961] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T19:28:28.909936] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T19:28:29.425528] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-06T19:28:30.111310] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T19:28:30.114388] [INFO ] [REMOTE ] HR: Full fetch complete (74829 records). [2025-10-06T19:28:30.114506] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-06T19:28:30.228458] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-06T19:28:30.517631] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-06T19:28:30.517940] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-06T19:28:30.519184] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-06T19:28:30.519277] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-06T19:28:30.542455] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T19:28:30.550024] [DEBUG] [LOCAL ] HR: Trimmed 74829 records to 51938 (keeping 200 days of data) [2025-10-06T19:28:30.877776] [DEBUG] [LOCAL ] HR: Primary data saved (51938 records). [2025-10-06T19:28:30.877962] [INFO ] [MAIN ] HR: Full history saved. [2025-10-06T19:28:30.878097] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HR took 36.1s. Estimated remaining: 3h 6m 7s. Rate: 7.1 symbols/min [2025-10-06T19:28:31.028615] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-06T19:28:31.051448] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:28:31.089189] [DEBUG] [LOCAL ] HRTG: Loaded 33921 existing records from primary storage. [2025-10-06T19:28:31.089521] [INFO ] [MAIN ] HRTG: Loaded 33921 existing records. [2025-10-06T19:28:31.264972] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:28:31.265283] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-06T19:28:31.265344] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-06T19:28:31.265927] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-06T19:28:31.265988] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-06T19:28:31.640069] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:28:31.825554] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-06T19:28:31.983181] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T19:28:32.384784] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-06T19:28:32.625502] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-06T19:28:32.992376] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T19:28:33.425532] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-06T19:28:33.902900] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T19:28:33.905786] [INFO ] [REMOTE ] HRB: Full fetch complete (69908 records). [2025-10-06T19:28:33.905897] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-06T19:28:34.229682] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-06T19:28:34.331782] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-06T19:28:34.331921] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-06T19:28:34.333189] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-06T19:28:34.333268] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-06T19:28:34.335322] [DEBUG] [LOCAL ] HRB: Trimmed 69908 records to 48434 (keeping 200 days of data) [2025-10-06T19:28:34.656575] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T19:28:34.664146] [INFO ] [REMOTE ] HRI: Full fetch complete (46329 records). [2025-10-06T19:28:34.665694] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-06T19:28:34.953309] [DEBUG] [LOCAL ] HRB: Primary data saved (48434 records). [2025-10-06T19:28:34.974942] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-06T19:28:34.999686] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HRB took 36.9s. Estimated remaining: 3h 5m 53s. Rate: 7.1 symbols/min [2025-10-06T19:28:35.030224] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-06T19:28:35.209160] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-06T19:28:35.217690] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-06T19:28:35.232408] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-06T19:28:35.232853] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-06T19:28:35.311518] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:28:35.318504] [DEBUG] [LOCAL ] HRI: Trimmed 46329 records to 32701 (keeping 200 days of data) [2025-10-06T19:28:35.328875] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T19:28:35.480312] [DEBUG] [LOCAL ] HSBC: Loaded 51774 existing records from primary storage. [2025-10-06T19:28:35.481468] [INFO ] [MAIN ] HSBC: Loaded 51774 existing records. [2025-10-06T19:28:35.675882] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:28:35.678870] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-06T19:28:35.679220] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-06T19:28:35.680120] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-06T19:28:35.680192] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-06T19:28:35.827684] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-06T19:28:36.086087] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:28:36.182330] [DEBUG] [LOCAL ] HRI: Primary data saved (32701 records). [2025-10-06T19:28:36.182554] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-06T19:28:36.182682] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRI took 33.8s. Estimated remaining: 3h 5m 36s. Rate: 7.1 symbols/min [2025-10-06T19:28:36.373051] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:28:36.392880] [DEBUG] [LOCAL ] HSHP: Loaded 15437 existing records from primary storage. [2025-10-06T19:28:36.393267] [INFO ] [MAIN ] HSHP: Loaded 15437 existing records. [2025-10-06T19:28:36.593273] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:28:36.593676] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-06T19:28:36.593769] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-06T19:28:36.594061] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-06T19:28:36.594120] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-06T19:28:36.632903] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-06T19:28:36.914253] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-06T19:28:37.017324] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:28:37.052825] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-06T19:28:37.425537] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-06T19:28:38.233185] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-06T19:28:38.260596] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T19:28:38.523351] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T19:28:39.025536] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-06T19:28:39.825516] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-06T19:28:40.127510] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T19:28:40.625512] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-06T19:28:40.837421] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-06T19:28:41.295122] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T19:28:41.425559] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-06T19:28:42.225498] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-06T19:28:42.443275] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-06T19:28:42.535904] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-06T19:28:43.025581] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-06T19:28:43.635103] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T19:28:43.825518] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-06T19:28:44.625550] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-06T19:28:44.811367] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-06T19:28:44.814475] [INFO ] [REMOTE ] HRL: Full fetch complete (76685 records). [2025-10-06T19:28:44.814593] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-06T19:28:44.927726] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T19:28:45.270558] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-06T19:28:45.270676] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-06T19:28:45.271869] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-06T19:28:45.271935] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-06T19:28:45.273621] [DEBUG] [LOCAL ] HRL: Trimmed 76685 records to 53083 (keeping 200 days of data) [2025-10-06T19:28:45.468508] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-06T19:28:45.639870] [DEBUG] [LOCAL ] HRL: Primary data saved (53083 records). [2025-10-06T19:28:45.640088] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-06T19:28:45.641075] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRL took 41.4s. Estimated remaining: 3h 5m 29s. Rate: 7.1 symbols/min [2025-10-06T19:28:45.824023] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:28:45.901296] [DEBUG] [LOCAL ] HSY: Loaded 51044 existing records from primary storage. [2025-10-06T19:28:45.902201] [INFO ] [MAIN ] HSY: Loaded 51044 existing records. [2025-10-06T19:28:46.098633] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:28:46.099074] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-06T19:28:46.099138] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-06T19:28:46.099832] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-06T19:28:46.099893] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-06T19:28:46.228626] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-06T19:28:46.482433] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:28:46.495585] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T19:28:46.526268] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-06T19:28:47.025604] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-06T19:28:47.798630] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T19:28:47.825509] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-06T19:28:48.094135] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T19:28:48.625595] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-06T19:28:49.199150] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T19:28:49.425505] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-06T19:28:49.632901] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-06T19:28:50.225584] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-06T19:28:51.000805] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T19:28:51.025487] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-06T19:28:51.490738] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-06T19:28:51.825574] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-06T19:28:51.994749] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T19:28:52.625553] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-06T19:28:53.425531] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-06T19:28:53.655985] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T19:28:53.829680] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-06T19:28:54.225522] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-06T19:28:54.749530] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T19:28:55.025535] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-06T19:28:55.825491] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-06T19:28:56.184196] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-06T19:28:56.539252] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T19:28:56.625480] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-06T19:28:56.655278] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-06T19:28:57.425597] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-06T19:28:57.711907] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T19:28:57.714187] [INFO ] [REMOTE ] HRTG: Full fetch complete (43185 records). [2025-10-06T19:28:57.714291] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-06T19:28:58.081038] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-06T19:28:58.081129] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-06T19:28:58.081886] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-06T19:28:58.081949] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-06T19:28:58.082868] [DEBUG] [LOCAL ] HRTG: Trimmed 43185 records to 33628 (keeping 200 days of data) [2025-10-06T19:28:58.229603] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-06T19:28:58.280550] [DEBUG] [LOCAL ] HRTG: Primary data saved (33628 records). [2025-10-06T19:28:58.280705] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-06T19:28:58.280810] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRTG took 27.4s. Estimated remaining: 3h 5m 25s. Rate: 7.1 symbols/min [2025-10-06T19:28:58.452966] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:28:58.453176] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-06T19:28:58.453214] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-06T19:28:58.453334] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-06T19:28:58.453376] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-06T19:28:58.453418] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-06T19:28:58.453450] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-06T19:28:58.815291] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:28:59.025493] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-06T19:28:59.200572] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T19:28:59.226350] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T19:28:59.226591] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-06T19:28:59.226702] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:28:59.226758] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-06T19:28:59.226880] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:28:59.226954] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-06T19:28:59.227025] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-06T19:28:59.227058] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-06T19:28:59.227111] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-06T19:28:59.227202] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HTB took 0.9s. Estimated remaining: 3h 5m 8s. Rate: 7.1 symbols/min [2025-10-06T19:28:59.451769] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:28:59.471339] [DEBUG] [LOCAL ] HTD: Loaded 14020 existing records from primary storage. [2025-10-06T19:28:59.471631] [INFO ] [MAIN ] HTD: Loaded 14020 existing records. [2025-10-06T19:28:59.654498] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:28:59.654767] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-06T19:28:59.654819] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-06T19:28:59.655121] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-06T19:28:59.655179] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-06T19:28:59.836532] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-06T19:29:00.015444] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:29:00.395145] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-06T19:29:00.625481] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-06T19:29:01.210285] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T19:29:01.425583] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-06T19:29:02.225555] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-06T19:29:02.240127] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T19:29:02.241309] [INFO ] [REMOTE ] HSHP: Full fetch complete (23305 records). [2025-10-06T19:29:02.241382] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-06T19:29:02.639726] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-06T19:29:02.639816] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-06T19:29:02.640307] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-06T19:29:02.640346] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-06T19:29:02.640991] [DEBUG] [LOCAL ] HSHP: Trimmed 23305 records to 15249 (keeping 200 days of data) [2025-10-06T19:29:02.729456] [DEBUG] [LOCAL ] HSHP: Primary data saved (15249 records). [2025-10-06T19:29:02.729634] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-06T19:29:02.729758] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HSHP took 26.5s. Estimated remaining: 3h 4m 53s. Rate: 7.1 symbols/min [2025-10-06T19:29:02.915677] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:29:02.915937] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-06T19:29:02.915996] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-06T19:29:02.916113] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-06T19:29:02.916157] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-06T19:29:02.916200] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-06T19:29:02.916233] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-06T19:29:03.026961] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-06T19:29:03.296969] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-06T19:29:03.327112] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:29:03.825532] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-06T19:29:03.900855] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T19:29:04.053808] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T19:29:04.150557] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-06T19:29:04.625494] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-06T19:29:05.425543] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-06T19:29:05.457134] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T19:29:05.799137] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-06T19:29:06.225538] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-06T19:29:07.025558] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-06T19:29:07.349458] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-06T19:29:07.825510] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-06T19:29:08.059745] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-06T19:29:08.103914] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-06T19:29:08.625537] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-06T19:29:09.041946] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-06T19:29:09.425562] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-06T19:29:10.164935] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-06T19:29:10.225516] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-06T19:29:11.025502] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-06T19:29:11.106058] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-06T19:29:11.825539] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-06T19:29:12.167472] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-06T19:29:12.625545] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-06T19:29:12.737711] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T19:29:13.205129] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-06T19:29:13.425542] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-06T19:29:14.225551] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-06T19:29:14.331549] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-06T19:29:15.025567] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-06T19:29:15.825503] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-06T19:29:16.078928] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-06T19:29:16.616742] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-06T19:29:16.625459] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-06T19:29:16.973171] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-06T19:29:17.425515] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-06T19:29:17.571898] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T19:29:18.225553] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-06T19:29:18.541406] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-06T19:29:19.025508] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-06T19:29:19.085307] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T19:29:19.825518] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-06T19:29:19.878337] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T19:29:20.625582] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-06T19:29:20.846766] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-10-06T19:29:21.425507] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-06T19:29:21.686186] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T19:29:22.225602] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-06T19:29:22.393158] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T19:29:23.025546] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-06T19:29:23.255313] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-06T19:29:23.825547] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-06T19:29:24.171686] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-06T19:29:24.304120] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-06T19:29:24.625557] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-06T19:29:25.425550] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-06T19:29:25.799627] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-06T19:29:25.800366] [INFO ] [REMOTE ] HTFC: Full fetch complete (845 records). [2025-10-06T19:29:25.800437] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-06T19:29:25.977875] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-06T19:29:25.978027] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T19:29:25.978095] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T19:29:25.978168] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-06T19:29:25.978248] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-06T19:29:25.978306] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-06T19:29:25.978375] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-06T19:29:25.978457] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HTFC took 23.2s. Estimated remaining: 3h 5m 3s. Rate: 7.1 symbols/min [2025-10-06T19:29:26.144992] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:29:26.191262] [DEBUG] [LOCAL ] HTGC: Loaded 48078 existing records from primary storage. [2025-10-06T19:29:26.191621] [INFO ] [MAIN ] HTGC: Loaded 48078 existing records. [2025-10-06T19:29:26.236142] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-06T19:29:26.374243] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:29:26.374612] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-06T19:29:26.374774] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-06T19:29:26.375239] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-06T19:29:26.375312] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-06T19:29:26.581022] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T19:29:26.770979] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:29:27.025549] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-06T19:29:27.825526] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-06T19:29:27.909813] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T19:29:28.568867] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T19:29:28.625487] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-06T19:29:28.655468] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T19:29:28.656939] [INFO ] [REMOTE ] HTD: Full fetch complete (19119 records). [2025-10-06T19:29:28.657019] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-06T19:29:29.035988] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-06T19:29:29.036099] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-06T19:29:29.036514] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-06T19:29:29.036557] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-06T19:29:29.037133] [DEBUG] [LOCAL ] HTD: Trimmed 19119 records to 13905 (keeping 200 days of data) [2025-10-06T19:29:29.119913] [DEBUG] [LOCAL ] HTD: Primary data saved (13905 records). [2025-10-06T19:29:29.120070] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-06T19:29:29.120152] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HTD took 29.9s. Estimated remaining: 3h 4m 48s. Rate: 7.1 symbols/min [2025-10-06T19:29:29.289263] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:29:29.321110] [DEBUG] [LOCAL ] HTH: Loaded 32613 existing records from primary storage. [2025-10-06T19:29:29.321408] [INFO ] [MAIN ] HTH: Loaded 32613 existing records. [2025-10-06T19:29:29.430819] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-06T19:29:29.502227] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:29:29.502523] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-06T19:29:29.502570] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-06T19:29:29.502889] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-06T19:29:29.502947] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-06T19:29:29.866557] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:29:30.234760] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-06T19:29:30.252940] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T19:29:30.875725] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T19:29:30.879293] [INFO ] [REMOTE ] HSBC: Full fetch complete (73782 records). [2025-10-06T19:29:30.879436] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-06T19:29:31.030635] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-06T19:29:31.374783] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-06T19:29:31.374937] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-06T19:29:31.376212] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-06T19:29:31.376310] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-06T19:29:31.378273] [DEBUG] [LOCAL ] HSBC: Trimmed 73782 records to 50991 (keeping 200 days of data) [2025-10-06T19:29:31.524580] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T19:29:31.724358] [DEBUG] [LOCAL ] HSBC: Primary data saved (50991 records). [2025-10-06T19:29:31.724554] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-06T19:29:31.724691] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HSBC took 56.7s. Estimated remaining: 3h 4m 32s. Rate: 7.1 symbols/min [2025-10-06T19:29:31.834170] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-06T19:29:31.915588] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:29:31.951842] [DEBUG] [LOCAL ] HUBB: Loaded 37114 existing records from primary storage. [2025-10-06T19:29:31.952180] [INFO ] [MAIN ] HUBB: Loaded 37114 existing records. [2025-10-06T19:29:32.141799] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:29:32.142128] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-06T19:29:32.142181] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-06T19:29:32.142548] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-06T19:29:32.142607] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-06T19:29:32.529959] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:29:32.625545] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-06T19:29:32.701988] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T19:29:33.332271] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T19:29:33.425493] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-06T19:29:33.586374] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T19:29:34.225556] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-06T19:29:34.739426] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T19:29:34.742371] [INFO ] [REMOTE ] HSY: Full fetch complete (73584 records). [2025-10-06T19:29:34.742496] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-06T19:29:35.031831] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-06T19:29:35.129702] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-06T19:29:35.129823] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-06T19:29:35.130986] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-06T19:29:35.131054] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-06T19:29:35.132943] [DEBUG] [LOCAL ] HSY: Trimmed 73584 records to 50371 (keeping 200 days of data) [2025-10-06T19:29:35.471783] [DEBUG] [LOCAL ] HSY: Primary data saved (50371 records). [2025-10-06T19:29:35.471972] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-06T19:29:35.472078] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HSY took 49.8s. Estimated remaining: 3h 4m 18s. Rate: 7.1 symbols/min [2025-10-06T19:29:35.642381] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:29:35.686385] [DEBUG] [LOCAL ] HUBS: Loaded 39955 existing records from primary storage. [2025-10-06T19:29:35.686877] [INFO ] [MAIN ] HUBS: Loaded 39955 existing records. [2025-10-06T19:29:35.827271] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-06T19:29:35.876425] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:29:35.894935] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-06T19:29:35.897395] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-06T19:29:35.898186] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-06T19:29:35.899255] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-06T19:29:35.899161] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T19:29:36.292588] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:29:36.310231] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T19:29:36.625578] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-06T19:29:37.425537] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-06T19:29:37.717536] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-06T19:29:37.771714] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-06T19:29:38.225544] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-06T19:29:38.766458] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T19:29:39.025522] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-06T19:29:39.825550] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-06T19:29:39.990605] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T19:29:40.502268] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-06T19:29:40.625544] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-06T19:29:41.421848] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T19:29:41.430234] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-06T19:29:42.225508] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-06T19:29:42.315519] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T19:29:43.025544] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-06T19:29:43.268490] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T19:29:43.825528] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-06T19:29:43.908087] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T19:29:44.625573] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-06T19:29:44.812682] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T19:29:45.425490] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-06T19:29:45.641151] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T19:29:46.230604] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-06T19:29:46.246308] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T19:29:46.960001] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T19:29:47.025532] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-06T19:29:47.693699] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T19:29:47.825516] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-06T19:29:48.625516] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-06T19:29:48.694148] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T19:29:49.399849] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T19:29:49.425478] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-06T19:29:49.924444] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-06T19:29:50.225537] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-06T19:29:50.996843] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T19:29:51.025474] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-06T19:29:51.547814] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T19:29:51.825550] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-06T19:29:52.609271] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T19:29:52.612755] [INFO ] [REMOTE ] HTGC: Full fetch complete (68289 records). [2025-10-06T19:29:52.612887] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-06T19:29:52.631624] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-06T19:29:53.015396] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T19:29:53.101995] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-06T19:29:53.102129] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-06T19:29:53.103598] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-06T19:29:53.103699] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-06T19:29:53.105951] [DEBUG] [LOCAL ] HTGC: Trimmed 68289 records to 47393 (keeping 200 days of data) [2025-10-06T19:29:53.400325] [DEBUG] [LOCAL ] HTGC: Primary data saved (47393 records). [2025-10-06T19:29:53.400484] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-06T19:29:53.400568] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTGC took 27.4s. Estimated remaining: 3h 4m 21s. Rate: 7.1 symbols/min [2025-10-06T19:29:53.430767] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-06T19:29:53.578509] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:29:53.627202] [DEBUG] [LOCAL ] HUM: Loaded 49601 existing records from primary storage. [2025-10-06T19:29:53.627568] [INFO ] [MAIN ] HUM: Loaded 49601 existing records. [2025-10-06T19:29:53.824229] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:29:53.824706] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-06T19:29:53.824791] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-06T19:29:53.825301] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-06T19:29:53.825404] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-06T19:29:54.002399] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T19:29:54.238534] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-06T19:29:54.244442] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:29:54.458565] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T19:29:55.025542] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-06T19:29:55.621018] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T19:29:55.825502] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-06T19:29:56.489809] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T19:29:56.625487] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-06T19:29:57.310731] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T19:29:57.425619] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-06T19:29:57.861510] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-06T19:29:58.225565] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-06T19:29:59.025579] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-06T19:29:59.238025] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T19:29:59.611161] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T19:29:59.825548] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-06T19:30:00.199797] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-06T19:30:00.625535] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-06T19:30:01.425532] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-06T19:30:01.686522] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T19:30:02.181732] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T19:30:02.184517] [INFO ] [REMOTE ] HTH: Full fetch complete (46770 records). [2025-10-06T19:30:02.184735] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-06T19:30:02.231014] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-06T19:30:02.604323] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-06T19:30:02.604468] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-06T19:30:02.605741] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-06T19:30:02.605816] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-06T19:30:02.607128] [DEBUG] [LOCAL ] HTH: Trimmed 46770 records to 32268 (keeping 200 days of data) [2025-10-06T19:30:02.833949] [DEBUG] [LOCAL ] HTH: Primary data saved (32268 records). [2025-10-06T19:30:02.834351] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-06T19:30:02.834512] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTH took 33.7s. Estimated remaining: 3h 4m 14s. Rate: 7.1 symbols/min [2025-10-06T19:30:03.025494] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:30:03.025613] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-06T19:30:03.051303] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T19:30:03.113624] [DEBUG] [LOCAL ] HUN: Loaded 53977 existing records from primary storage. [2025-10-06T19:30:03.114054] [INFO ] [MAIN ] HUN: Loaded 53977 existing records. [2025-10-06T19:30:03.330778] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:30:03.331443] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-06T19:30:03.331524] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-06T19:30:03.331874] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-06T19:30:03.331947] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-06T19:30:03.713166] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:30:03.833793] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-06T19:30:03.836894] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T19:30:04.635543] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-06T19:30:04.656741] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T19:30:05.425532] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-06T19:30:05.748817] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-06T19:30:06.114466] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T19:30:06.116877] [INFO ] [REMOTE ] HUBB: Full fetch complete (53848 records). [2025-10-06T19:30:06.116969] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-06T19:30:06.230869] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-06T19:30:06.514035] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-06T19:30:06.514133] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-06T19:30:06.515066] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-06T19:30:06.515149] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-06T19:30:06.516433] [DEBUG] [LOCAL ] HUBB: Trimmed 53848 records to 36613 (keeping 200 days of data) [2025-10-06T19:30:06.752678] [DEBUG] [LOCAL ] HUBB: Primary data saved (36613 records). [2025-10-06T19:30:06.752846] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-06T19:30:06.753638] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 35.0s. Estimated remaining: 3h 3m 60s. Rate: 7.1 symbols/min [2025-10-06T19:30:06.921898] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:30:06.968391] [DEBUG] [LOCAL ] HUYA: Loaded 44793 existing records from primary storage. [2025-10-06T19:30:06.968763] [INFO ] [MAIN ] HUYA: Loaded 44793 existing records. [2025-10-06T19:30:07.036073] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-06T19:30:07.183680] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:30:07.184118] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-06T19:30:07.184316] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-06T19:30:07.184876] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-06T19:30:07.184956] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-06T19:30:07.448476] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-06T19:30:07.658273] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:30:07.825491] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-06T19:30:07.862064] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T19:30:08.625565] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-06T19:30:08.761583] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T19:30:09.365092] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T19:30:09.425564] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-06T19:30:10.225565] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-06T19:30:10.292228] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T19:30:11.025562] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-06T19:30:11.259124] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T19:30:11.344024] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T19:30:11.825603] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-06T19:30:12.625547] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-06T19:30:12.954041] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T19:30:13.160378] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-06T19:30:13.425552] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-06T19:30:14.225509] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-06T19:30:14.389135] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T19:30:15.025594] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-06T19:30:15.067145] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T19:30:15.825550] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-06T19:30:15.969416] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T19:30:16.625541] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-06T19:30:16.742513] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T19:30:17.425576] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-06T19:30:17.833544] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T19:30:17.880021] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-06T19:30:18.225573] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-06T19:30:18.863064] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T19:30:18.866281] [INFO ] [REMOTE ] HUBS: Full fetch complete (55863 records). [2025-10-06T19:30:18.866405] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-06T19:30:19.028680] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-06T19:30:19.287130] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-06T19:30:19.287238] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-06T19:30:19.288789] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-06T19:30:19.288870] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-06T19:30:19.290831] [DEBUG] [LOCAL ] HUBS: Trimmed 55863 records to 39538 (keeping 200 days of data) [2025-10-06T19:30:19.560209] [DEBUG] [LOCAL ] HUBS: Primary data saved (39538 records). [2025-10-06T19:30:19.560417] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-06T19:30:19.560527] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HUBS took 44.1s. Estimated remaining: 3h 3m 57s. Rate: 7.1 symbols/min [2025-10-06T19:30:19.752200] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:30:19.773978] [DEBUG] [LOCAL ] HVT: Loaded 15649 existing records from primary storage. [2025-10-06T19:30:19.774350] [INFO ] [MAIN ] HVT: Loaded 15649 existing records. [2025-10-06T19:30:19.833566] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-06T19:30:19.967253] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:30:19.967706] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-06T19:30:19.967853] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-06T19:30:19.968115] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-06T19:30:19.968227] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-06T19:30:20.269310] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-06T19:30:20.369527] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:30:20.625562] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-06T19:30:20.727011] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T19:30:21.425511] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-06T19:30:21.487436] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T19:30:22.225578] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-06T19:30:22.464104] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T19:30:23.025583] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-06T19:30:23.074424] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T19:30:23.133972] [DEBUG] [REMOTE ] HUM: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-06T19:30:23.134391] [WARN ] [REMOTE ] HUM: No data returned for month 2025-08 [2025-10-06T19:30:23.134509] [FATAL] [REMOTE ] HUM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:30:23.134729] [FATAL] [MAIN ] HUM: Failed to fetch primary data. [2025-10-06T19:30:23.134818] [WARN ] [MAIN ] HUM: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:30:23.134909] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-06T19:30:23.134998] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-06T19:30:23.135047] [INFO ] [LOCAL ] HUM: Starting deletion of derivative data. [2025-10-06T19:30:23.135394] [DEBUG] [LOCAL ] HUM: Deleted derivative data file. [2025-10-06T19:30:23.136293] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUM took 29.7s. Estimated remaining: 3h 3m 42s. Rate: 7.1 symbols/min [2025-10-06T19:30:23.324476] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:30:23.352666] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T19:30:23.415255] [DEBUG] [LOCAL ] HWM: Loaded 53700 existing records from primary storage. [2025-10-06T19:30:23.415690] [INFO ] [MAIN ] HWM: Loaded 53700 existing records. [2025-10-06T19:30:23.596327] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:30:23.596622] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-06T19:30:23.596718] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-06T19:30:23.597072] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-06T19:30:23.597146] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-06T19:30:23.830675] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-06T19:30:23.980413] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:30:24.625581] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-06T19:30:25.425577] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-06T19:30:25.623746] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T19:30:26.225496] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-06T19:30:26.381920] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T19:30:27.025540] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-06T19:30:27.161823] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T19:30:27.322098] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T19:30:27.825591] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-06T19:30:28.580517] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T19:30:28.625480] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-06T19:30:29.425570] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-06T19:30:29.503992] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T19:30:30.173844] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T19:30:30.225490] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-06T19:30:31.025496] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-06T19:30:31.185109] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T19:30:31.191913] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T19:30:31.825512] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-06T19:30:32.411480] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-06T19:30:32.415399] [INFO ] [REMOTE ] HUYA: Full fetch complete (63651 records). [2025-10-06T19:30:32.415588] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-06T19:30:32.632859] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-06T19:30:32.848295] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T19:30:32.868299] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-06T19:30:32.868536] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-06T19:30:32.869749] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-06T19:30:32.869818] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-06T19:30:32.871427] [DEBUG] [LOCAL ] HUYA: Trimmed 63651 records to 43951 (keeping 200 days of data) [2025-10-06T19:30:33.126310] [DEBUG] [LOCAL ] HUYA: Primary data saved (43951 records). [2025-10-06T19:30:33.126484] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-06T19:30:33.126576] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUYA took 26.4s. Estimated remaining: 3h 3m 36s. Rate: 7.1 symbols/min [2025-10-06T19:30:33.293899] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:30:33.335741] [DEBUG] [LOCAL ] HXL: Loaded 46561 existing records from primary storage. [2025-10-06T19:30:33.336088] [INFO ] [MAIN ] HXL: Loaded 46561 existing records. [2025-10-06T19:30:33.430785] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-06T19:30:33.526220] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:30:33.526499] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-06T19:30:33.526544] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-06T19:30:33.526833] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-06T19:30:33.526895] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-06T19:30:33.900175] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:30:34.225504] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-06T19:30:34.530000] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T19:30:34.563321] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T19:30:35.025540] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-06T19:30:35.825570] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-06T19:30:36.045300] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-06T19:30:36.104764] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-06T19:30:36.625560] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-06T19:30:37.006969] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T19:30:37.425554] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-06T19:30:37.584039] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-06T19:30:38.225542] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-06T19:30:39.025501] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-06T19:30:39.067282] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T19:30:39.825558] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-06T19:30:39.885980] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T19:30:39.889729] [INFO ] [REMOTE ] HUN: Full fetch complete (76727 records). [2025-10-06T19:30:39.889868] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-06T19:30:40.291583] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-06T19:30:40.291765] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-06T19:30:40.292900] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-06T19:30:40.292964] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-06T19:30:40.294551] [DEBUG] [LOCAL ] HUN: Trimmed 76727 records to 53203 (keeping 200 days of data) [2025-10-06T19:30:40.626284] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-06T19:30:40.654434] [DEBUG] [LOCAL ] HUN: Primary data saved (53203 records). [2025-10-06T19:30:40.654687] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-06T19:30:40.654853] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HUN took 37.8s. Estimated remaining: 3h 3m 26s. Rate: 7.1 symbols/min [2025-10-06T19:30:40.881872] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:30:40.896160] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T19:30:40.898139] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T19:30:40.925162] [DEBUG] [LOCAL ] HY: Loaded 10055 existing records from primary storage. [2025-10-06T19:30:40.925461] [INFO ] [MAIN ] HY: Loaded 10055 existing records. [2025-10-06T19:30:41.114202] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:30:41.114583] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-06T19:30:41.114678] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-06T19:30:41.115004] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-06T19:30:41.115065] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-06T19:30:41.439569] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-06T19:30:41.481626] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:30:41.945964] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T19:30:42.225501] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-06T19:30:42.391942] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T19:30:43.025550] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-06T19:30:43.824944] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T19:30:43.834577] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-06T19:30:43.848271] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T19:30:44.625508] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-06T19:30:45.425568] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-06T19:30:45.816233] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-06T19:30:46.225485] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-06T19:30:46.239991] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-06T19:30:46.312775] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T19:30:47.025538] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-06T19:30:47.825537] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-06T19:30:47.858231] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T19:30:47.859538] [INFO ] [REMOTE ] HVT: Full fetch complete (23355 records). [2025-10-06T19:30:47.859675] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-06T19:30:48.231113] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-06T19:30:48.231330] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-06T19:30:48.232085] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-06T19:30:48.232215] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-06T19:30:48.233147] [DEBUG] [LOCAL ] HVT: Trimmed 23355 records to 15312 (keeping 200 days of data) [2025-10-06T19:30:48.329759] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-06T19:30:48.373226] [DEBUG] [LOCAL ] HVT: Primary data saved (15312 records). [2025-10-06T19:30:48.373426] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-06T19:30:48.373548] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HVT took 28.8s. Estimated remaining: 3h 3m 17s. Rate: 7.1 symbols/min [2025-10-06T19:30:48.542446] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:30:48.542697] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-06T19:30:48.542752] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-06T19:30:48.542864] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-06T19:30:48.542905] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-06T19:30:48.542945] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-06T19:30:48.542979] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-06T19:30:48.632449] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-06T19:30:48.918917] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:30:49.392212] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T19:30:49.425474] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-06T19:30:50.225515] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-06T19:30:50.340608] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T19:30:50.552973] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-06T19:30:50.972451] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T19:30:51.025615] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-06T19:30:51.806504] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-06T19:30:51.825542] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-06T19:30:52.625227] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-06T19:30:52.628798] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-06T19:30:53.425548] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-06T19:30:53.492219] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T19:30:53.751311] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-06T19:30:54.225528] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-06T19:30:54.562512] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-06T19:30:55.025542] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-06T19:30:55.825536] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-06T19:30:56.056997] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-06T19:30:56.625487] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-06T19:30:56.943519] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-06T19:30:57.134788] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-06T19:30:57.425548] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-06T19:30:57.739490] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-06T19:30:58.225551] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-06T19:30:59.025537] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-06T19:30:59.618061] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-06T19:30:59.825509] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-06T19:31:00.142372] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-06T19:31:00.155682] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-06T19:31:00.625553] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-06T19:31:01.425543] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-06T19:31:02.225548] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-06T19:31:02.330492] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T19:31:02.819053] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-06T19:31:03.025601] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-06T19:31:03.306871] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-06T19:31:03.825541] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-06T19:31:03.886761] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T19:31:04.625508] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-06T19:31:05.346695] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T19:31:05.425522] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-06T19:31:06.177841] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T19:31:06.181347] [INFO ] [REMOTE ] HWM: Full fetch complete (76602 records). [2025-10-06T19:31:06.181480] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-06T19:31:06.230666] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-06T19:31:06.572456] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-06T19:31:06.596527] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-06T19:31:06.598082] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-06T19:31:06.599377] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-06T19:31:06.599546] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-06T19:31:06.601493] [DEBUG] [LOCAL ] HWM: Trimmed 76602 records to 52914 (keeping 200 days of data) [2025-10-06T19:31:06.733091] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T19:31:06.988699] [DEBUG] [LOCAL ] HWM: Primary data saved (52914 records). [2025-10-06T19:31:06.988872] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-06T19:31:06.989615] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HWM took 43.9s. Estimated remaining: 3h 3m 21s. Rate: 7.1 symbols/min [2025-10-06T19:31:07.030728] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-06T19:31:07.165029] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:31:07.165254] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-06T19:31:07.165309] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-06T19:31:07.165421] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-06T19:31:07.165464] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-06T19:31:07.165505] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-06T19:31:07.165561] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-06T19:31:07.528967] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:31:07.825536] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-06T19:31:08.049383] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-06T19:31:08.514829] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T19:31:08.518024] [INFO ] [REMOTE ] HXL: Full fetch complete (66275 records). [2025-10-06T19:31:08.518154] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-06T19:31:08.630734] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-06T19:31:08.970516] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-06T19:31:08.970608] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-06T19:31:08.971590] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-06T19:31:08.971675] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-06T19:31:08.973120] [DEBUG] [LOCAL ] HXL: Trimmed 66275 records to 45883 (keeping 200 days of data) [2025-10-06T19:31:09.040586] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-06T19:31:09.068076] [INFO ] [REMOTE ] HYAC: Full fetch complete (885 records). [2025-10-06T19:31:09.068666] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-06T19:31:09.069203] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T19:31:09.077618] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T19:31:09.079557] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T19:31:09.081696] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-06T19:31:09.085858] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-06T19:31:09.088351] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-06T19:31:09.090066] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-06T19:31:09.092183] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HYAC took 20.7s. Estimated remaining: 3h 3m 5s. Rate: 7.1 symbols/min [2025-10-06T19:31:09.396224] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:31:09.426856] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-06T19:31:09.452406] [DEBUG] [LOCAL ] HXL: Primary data saved (45883 records). [2025-10-06T19:31:09.457021] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-06T19:31:09.457425] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HXL took 36.3s. Estimated remaining: 3h 2m 46s. Rate: 7.1 symbols/min [2025-10-06T19:31:09.457305] [DEBUG] [LOCAL ] HYI: Loaded 9955 existing records from primary storage. [2025-10-06T19:31:09.489284] [INFO ] [MAIN ] HYI: Loaded 9955 existing records. [2025-10-06T19:31:09.824987] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:31:09.825153] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-06T19:31:09.829703] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:31:09.831848] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-06T19:31:09.832037] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-06T19:31:09.832329] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-06T19:31:09.832416] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-06T19:31:10.148398] [DEBUG] [LOCAL ] HYT: Loaded 34152 existing records from primary storage. [2025-10-06T19:31:10.159743] [INFO ] [MAIN ] HYT: Loaded 34152 existing records. [2025-10-06T19:31:10.242141] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-06T19:31:10.307098] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:31:10.419779] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:31:10.420137] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-06T19:31:10.420190] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-06T19:31:10.420476] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-06T19:31:10.420534] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-06T19:31:10.764482] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-06T19:31:10.791026] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:31:11.025539] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-06T19:31:11.825505] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-06T19:31:11.852100] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T19:31:12.625564] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-06T19:31:12.843823] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-06T19:31:13.107071] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-06T19:31:13.425553] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-06T19:31:14.225565] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-06T19:31:14.678418] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T19:31:14.691677] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-06T19:31:15.025568] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-06T19:31:15.772019] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T19:31:15.825471] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-06T19:31:16.625551] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-06T19:31:16.654107] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-06T19:31:17.425541] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-06T19:31:17.928828] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T19:31:17.946785] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-06T19:31:18.225587] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-06T19:31:18.934309] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-06T19:31:19.025504] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-06T19:31:19.243526] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-06T19:31:19.825515] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-06T19:31:20.312255] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-06T19:31:20.625519] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-06T19:31:21.425502] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-06T19:31:21.863390] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T19:31:21.862112] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-06T19:31:22.225542] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-06T19:31:23.025555] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-06T19:31:23.334502] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-06T19:31:23.408171] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T19:31:23.825549] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-06T19:31:24.512563] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T19:31:24.625544] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-06T19:31:25.425568] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-06T19:31:25.445609] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-06T19:31:26.225538] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-06T19:31:26.545634] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-06T19:31:27.005859] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T19:31:27.025474] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-06T19:31:27.825539] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-06T19:31:28.386385] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T19:31:28.559440] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T19:31:28.625551] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-06T19:31:29.389155] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-06T19:31:29.425546] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-06T19:31:29.733725] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-06T19:31:30.225607] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-06T19:31:30.547806] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-06T19:31:31.025575] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-06T19:31:31.810487] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T19:31:31.825475] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-06T19:31:32.625572] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-06T19:31:32.693883] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-06T19:31:33.425578] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-06T19:31:33.445277] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-06T19:31:34.225558] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-06T19:31:34.606137] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-06T19:31:34.744104] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T19:31:35.025533] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-06T19:31:35.813735] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T19:31:35.816475] [INFO ] [REMOTE ] HYI: Full fetch complete (13909 records). [2025-10-06T19:31:35.816568] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-06T19:31:35.830587] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-06T19:31:36.268664] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-06T19:31:36.268766] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-06T19:31:36.269146] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-06T19:31:36.269233] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-06T19:31:36.269860] [DEBUG] [LOCAL ] HYI: Trimmed 13909 records to 9840 (keeping 200 days of data) [2025-10-06T19:31:36.340445] [DEBUG] [LOCAL ] HYI: Primary data saved (9840 records). [2025-10-06T19:31:36.340665] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-06T19:31:36.340793] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HYI took 27.2s. Estimated remaining: 3h 3m 0s. Rate: 7.1 symbols/min [2025-10-06T19:31:36.587110] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:31:36.594758] [DEBUG] [LOCAL ] HYTR: Loaded 3216 existing records from primary storage. [2025-10-06T19:31:36.595037] [INFO ] [MAIN ] HYTR: Loaded 3216 existing records. [2025-10-06T19:31:36.637799] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-06T19:31:36.792771] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:31:36.793051] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-06T19:31:36.793099] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-06T19:31:36.793297] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-06T19:31:36.793355] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-06T19:31:37.165301] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:31:37.313915] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T19:31:37.425486] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-06T19:31:37.508737] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T19:31:37.509865] [INFO ] [REMOTE ] HY: Full fetch complete (15131 records). [2025-10-06T19:31:37.509938] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-06T19:31:37.877698] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-06T19:31:37.877796] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-06T19:31:37.878195] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-06T19:31:37.878233] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-06T19:31:37.878774] [DEBUG] [LOCAL ] HY: Trimmed 15131 records to 9953 (keeping 200 days of data) [2025-10-06T19:31:37.946318] [DEBUG] [LOCAL ] HY: Primary data saved (9953 records). [2025-10-06T19:31:37.946482] [INFO ] [MAIN ] HY: Full history saved. [2025-10-06T19:31:37.946590] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HY took 57.3s. Estimated remaining: 3h 2m 43s. Rate: 7.1 symbols/min [2025-10-06T19:31:38.115115] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:31:38.145952] [DEBUG] [LOCAL ] HZO: Loaded 29526 existing records from primary storage. [2025-10-06T19:31:38.146254] [INFO ] [MAIN ] HZO: Loaded 29526 existing records. [2025-10-06T19:31:38.234035] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-06T19:31:38.322611] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:31:38.322849] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-06T19:31:38.322896] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-06T19:31:38.323120] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-06T19:31:38.323176] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-06T19:31:38.679180] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:31:38.673416] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-06T19:31:38.680080] [INFO ] [REMOTE ] HYBX: Full fetch complete (735 records). [2025-10-06T19:31:38.680413] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-06T19:31:38.865991] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-06T19:31:38.866565] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-06T19:31:38.866771] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-06T19:31:38.867001] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-06T19:31:38.867154] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-06T19:31:38.867383] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-06T19:31:38.867457] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-06T19:31:38.867678] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HYBX took 31.9s. Estimated remaining: 3h 2m 26s. Rate: 7.1 symbols/min [2025-10-06T19:31:39.025522] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-06T19:31:39.065981] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:31:39.069284] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T19:31:39.087519] [DEBUG] [LOCAL ] IAE: Loaded 6116 existing records from primary storage. [2025-10-06T19:31:39.087902] [INFO ] [MAIN ] IAE: Loaded 6116 existing records. [2025-10-06T19:31:39.264695] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:31:39.264960] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-06T19:31:39.265044] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-06T19:31:39.265211] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-06T19:31:39.265250] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-06T19:31:39.627913] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:31:39.825505] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-06T19:31:40.197527] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T19:31:40.279455] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-06T19:31:40.625539] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-06T19:31:41.210697] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-06T19:31:41.425533] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-06T19:31:41.863983] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-06T19:31:42.225537] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-06T19:31:42.877020] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-06T19:31:43.025529] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-06T19:31:43.639362] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T19:31:43.825547] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-06T19:31:44.625536] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-06T19:31:45.097448] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-06T19:31:45.160376] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T19:31:45.425619] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-06T19:31:45.983997] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-06T19:31:46.225569] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-06T19:31:46.798746] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-06T19:31:47.025533] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-06T19:31:47.825578] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-06T19:31:48.221914] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T19:31:48.224290] [INFO ] [REMOTE ] HYT: Full fetch complete (47750 records). [2025-10-06T19:31:48.224388] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-06T19:31:48.612705] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-06T19:31:48.612801] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-06T19:31:48.613599] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-06T19:31:48.613639] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-06T19:31:48.614721] [DEBUG] [LOCAL ] HYT: Trimmed 47750 records to 33640 (keeping 200 days of data) [2025-10-06T19:31:48.663958] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-06T19:31:48.825715] [DEBUG] [LOCAL ] HYT: Primary data saved (33640 records). [2025-10-06T19:31:48.825921] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-06T19:31:48.826034] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYT took 39.4s. Estimated remaining: 3h 2m 19s. Rate: 7.1 symbols/min [2025-10-06T19:31:48.914955] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T19:31:49.320429] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-06T19:31:49.425510] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-06T19:31:49.991795] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T19:31:50.225533] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-06T19:31:50.794222] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-06T19:31:51.025564] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-06T19:31:51.678581] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-06T19:31:51.825491] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-06T19:31:52.625541] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-06T19:31:52.966041] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-06T19:31:53.181043] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T19:31:53.425551] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-06T19:31:54.041081] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-06T19:31:54.225537] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-06T19:31:54.699056] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-06T19:31:55.025537] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-06T19:31:55.621149] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T19:31:55.825571] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-06T19:31:56.604231] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-06T19:31:56.625502] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-06T19:31:57.265302] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T19:31:57.266404] [INFO ] [REMOTE ] IAE: Full fetch complete (8718 records). [2025-10-06T19:31:57.266477] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-06T19:31:57.433818] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-06T19:31:57.655369] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-06T19:31:57.655556] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-06T19:31:57.655862] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-06T19:31:57.655926] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-06T19:31:57.656389] [DEBUG] [LOCAL ] IAE: Trimmed 8718 records to 6005 (keeping 200 days of data) [2025-10-06T19:31:57.695071] [DEBUG] [LOCAL ] IAE: Primary data saved (6005 records). [2025-10-06T19:31:57.695306] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-06T19:31:57.695457] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. IAE took 18.8s. Estimated remaining: 3h 2m 11s. Rate: 7.1 symbols/min [2025-10-06T19:31:58.084768] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-06T19:31:58.225530] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-06T19:31:58.752063] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-06T19:31:59.025557] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-06T19:31:59.509040] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-06T19:31:59.825539] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-06T19:32:00.625584] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-06T19:32:01.151183] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T19:32:01.152015] [INFO ] [REMOTE ] HYTR: Full fetch complete (4571 records). [2025-10-06T19:32:01.152085] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-06T19:32:01.274065] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T19:32:01.431178] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-06T19:32:01.535330] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-06T19:32:01.535423] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-06T19:32:01.535608] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-06T19:32:01.535668] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-06T19:32:01.536047] [DEBUG] [LOCAL ] HYTR: Trimmed 4571 records to 3133 (keeping 200 days of data) [2025-10-06T19:32:01.556636] [DEBUG] [LOCAL ] HYTR: Primary data saved (3133 records). [2025-10-06T19:32:01.556752] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-06T19:32:01.556832] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYTR took 25.2s. Estimated remaining: 3h 1m 57s. Rate: 7.1 symbols/min [2025-10-06T19:32:02.962315] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T19:32:02.970700] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-06T19:32:04.134915] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T19:32:04.142147] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-06T19:32:05.353160] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T19:32:05.360947] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-06T19:32:06.636191] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-06T19:32:06.644400] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-06T19:32:07.788385] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T19:32:07.798851] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-06T19:32:09.013220] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T19:32:09.020433] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-06T19:32:10.212409] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T19:32:10.215912] [INFO ] [REMOTE ] HZO: Full fetch complete (41109 records). [2025-10-06T19:32:10.216101] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-06T19:32:10.605722] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-06T19:32:10.605819] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-06T19:32:10.606736] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-06T19:32:10.606797] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-06T19:32:10.607797] [DEBUG] [LOCAL ] HZO: Trimmed 41109 records to 29152 (keeping 200 days of data) [2025-10-06T19:32:10.802987] [DEBUG] [LOCAL ] HZO: Primary data saved (29152 records). [2025-10-06T19:32:10.803182] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-06T19:32:10.803280] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HZO took 32.9s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-06T19:32:11.458166] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:32:11.479130] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:32:11.497471] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:32:11.503772] [DEBUG] [LOCAL ] IBP: No existing data file found in primary storage. [2025-10-06T19:32:11.547379] [WARN ] [MAIN ] IBP: No existing data found, performing full refresh instead. [2025-10-06T19:32:11.557995] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-06T19:32:11.577140] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:32:11.577564] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-06T19:32:11.577779] [DEBUG] [LOCAL ] IBP: No primary data file found to delete. [2025-10-06T19:32:11.578155] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-06T19:32:11.975883] [DEBUG] [LOCAL ] IAG: Loaded 54232 existing records from primary storage. [2025-10-06T19:32:11.976618] [DEBUG] [LOCAL ] IBN: Loaded 53644 existing records from primary storage. [2025-10-06T19:32:12.007343] [INFO ] [MAIN ] IBN: Loaded 53644 existing records. [2025-10-06T19:32:12.008338] [DEBUG] [LOCAL ] IBM: Loaded 54412 existing records from primary storage. [2025-10-06T19:32:12.007111] [INFO ] [MAIN ] IAG: Loaded 54232 existing records. [2025-10-06T19:32:12.085192] [INFO ] [MAIN ] IBM: Loaded 54412 existing records. [2025-10-06T19:32:12.261126] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:32:12.302999] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-06T19:32:12.562430] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:32:12.635424] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-06T19:32:12.680927] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-06T19:32:12.697619] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-06T19:32:12.665001] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:32:12.705036] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-06T19:32:12.704798] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:32:12.739610] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-06T19:32:12.759106] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-06T19:32:12.770241] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-06T19:32:12.797921] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-06T19:32:12.809296] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-06T19:32:12.809211] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-06T19:32:12.819901] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-06T19:32:12.839978] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-06T19:32:13.816829] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:32:13.889185] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-06T19:32:13.888017] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:32:13.895962] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-06T19:32:13.994408] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:32:14.001857] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-06T19:32:14.004760] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T19:32:14.010888] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-06T19:32:15.407120] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T19:32:15.412478] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-06T19:32:15.591865] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T19:32:15.603105] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-06T19:32:15.687537] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T19:32:15.698980] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-06T19:32:16.088403] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-06T19:32:16.099328] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-06T19:32:16.735348] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T19:32:16.741132] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-06T19:32:17.234933] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T19:32:17.245906] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-06T19:32:17.309300] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T19:32:17.319605] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-06T19:32:17.719472] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T19:32:17.726535] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-06T19:32:18.326539] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-06T19:32:18.337289] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-06T19:32:18.912827] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T19:32:18.923012] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-06T19:32:19.142678] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-06T19:32:19.154267] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-06T19:32:19.182926] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-06T19:32:19.825548] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-06T19:32:20.385746] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-06T19:32:20.451148] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T19:32:20.625490] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-06T19:32:20.682631] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T19:32:21.276282] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T19:32:21.425581] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-06T19:32:22.225495] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-06T19:32:22.491844] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T19:32:22.647626] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T19:32:23.025506] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-06T19:32:23.825529] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-06T19:32:24.132847] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T19:32:24.625592] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-06T19:32:25.115411] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-06T19:32:25.425560] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-06T19:32:25.730085] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-06T19:32:26.225499] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-06T19:32:26.454254] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T19:32:27.025547] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-06T19:32:27.494440] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-06T19:32:27.531252] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T19:32:27.825535] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-06T19:32:28.625546] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-06T19:32:28.894453] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-06T19:32:29.173036] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-06T19:32:29.425595] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-06T19:32:30.185586] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-06T19:32:30.225479] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-06T19:32:30.613898] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T19:32:31.025601] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-06T19:32:31.825492] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-06T19:32:32.016117] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T19:32:32.625504] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-06T19:32:32.871103] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T19:32:32.872850] [INFO ] [REMOTE ] IBP: Full fetch complete (41140 records). [2025-10-06T19:32:32.872948] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-06T19:32:33.198578] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-06T19:32:33.293728] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-06T19:32:33.293821] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-06T19:32:33.294524] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-06T19:32:33.294576] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-06T19:32:33.295428] [DEBUG] [LOCAL ] IBP: Trimmed 41140 records to 28785 (keeping 200 days of data) [2025-10-06T19:32:33.425490] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-06T19:32:33.481906] [DEBUG] [LOCAL ] IBP: Primary data saved (28785 records). [2025-10-06T19:32:33.482047] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-06T19:32:33.482119] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IBP took 22.7s. Estimated remaining: 3h 1m 58s. Rate: 7.1 symbols/min [2025-10-06T19:32:33.646539] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:32:33.684439] [DEBUG] [LOCAL ] IBTA: Loaded 38108 existing records from primary storage. [2025-10-06T19:32:33.684827] [INFO ] [MAIN ] IBTA: Loaded 38108 existing records. [2025-10-06T19:32:33.859470] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:32:33.859879] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-06T19:32:33.859935] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-06T19:32:33.860207] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-06T19:32:33.860263] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-06T19:32:34.210171] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:32:34.225465] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-06T19:32:34.752301] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-06T19:32:35.025480] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-06T19:32:35.299892] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-06T19:32:35.501520] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T19:32:35.825610] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-06T19:32:36.556777] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T19:32:36.625517] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-06T19:32:37.425544] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-06T19:32:38.225491] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-06T19:32:38.309175] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-06T19:32:38.521545] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T19:32:38.542803] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-06T19:32:39.025538] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-06T19:32:39.825498] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-06T19:32:40.234389] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-06T19:32:40.267565] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-06T19:32:40.625533] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-06T19:32:41.425566] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-06T19:32:42.208032] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-06T19:32:42.225463] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-06T19:32:42.394066] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T19:32:42.582984] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-06T19:32:43.025618] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-06T19:32:43.825553] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-06T19:32:44.634470] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-06T19:32:44.654854] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T19:32:44.738805] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-06T19:32:45.425554] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-06T19:32:45.461194] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T19:32:45.464335] [INFO ] [REMOTE ] IBN: Full fetch complete (76319 records). [2025-10-06T19:32:45.464469] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-06T19:32:45.858204] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-06T19:32:45.858301] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-06T19:32:45.859211] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-06T19:32:45.859376] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-06T19:32:45.860859] [DEBUG] [LOCAL ] IBN: Trimmed 76319 records to 52865 (keeping 200 days of data) [2025-10-06T19:32:46.189386] [DEBUG] [LOCAL ] IBN: Primary data saved (52865 records). [2025-10-06T19:32:46.189563] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-06T19:32:46.189688] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBN took 35.4s. Estimated remaining: 3h 1m 55s. Rate: 7.1 symbols/min [2025-10-06T19:32:46.232994] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-06T19:32:46.362285] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:32:46.424438] [DEBUG] [LOCAL ] ICE: Loaded 53782 existing records from primary storage. [2025-10-06T19:32:46.424831] [INFO ] [MAIN ] ICE: Loaded 53782 existing records. [2025-10-06T19:32:46.601190] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:32:46.611009] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-06T19:32:46.611083] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-06T19:32:46.611564] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-06T19:32:46.614404] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-06T19:32:46.615006] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-06T19:32:46.677870] [INFO ] [REMOTE ] IAG: Full fetch complete (77269 records). [2025-10-06T19:32:46.689143] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-06T19:32:47.302627] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:32:47.323358] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-06T19:32:47.433389] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-06T19:32:47.433593] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-06T19:32:47.435705] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-06T19:32:47.435800] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-06T19:32:47.438389] [DEBUG] [LOCAL ] IAG: Trimmed 77269 records to 53456 (keeping 200 days of data) [2025-10-06T19:32:47.556898] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T19:32:47.791109] [DEBUG] [LOCAL ] IAG: Primary data saved (53456 records). [2025-10-06T19:32:47.791267] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-06T19:32:47.792207] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IAG took 37.0s. Estimated remaining: 3h 1m 38s. Rate: 7.1 symbols/min [2025-10-06T19:32:47.836225] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-06T19:32:47.904867] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-06T19:32:47.920508] [INFO ] [REMOTE ] IBM: Full fetch complete (77620 records). [2025-10-06T19:32:47.936201] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-06T19:32:48.064257] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:32:48.360936] [DEBUG] [LOCAL ] ICL: Loaded 38938 existing records from primary storage. [2025-10-06T19:32:48.393256] [INFO ] [MAIN ] ICL: Loaded 38938 existing records. [2025-10-06T19:32:48.524712] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-06T19:32:48.543499] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-06T19:32:48.547004] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-06T19:32:48.547119] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-06T19:32:48.603187] [DEBUG] [LOCAL ] IBM: Trimmed 77620 records to 53631 (keeping 200 days of data) [2025-10-06T19:32:48.630119] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:32:48.685817] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-06T19:32:48.696104] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-06T19:32:48.722859] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-06T19:32:48.723873] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-06T19:32:49.150170] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:32:49.229591] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-06T19:32:49.295307] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-06T19:32:49.317335] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T19:32:49.427097] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-06T19:32:49.438897] [DEBUG] [LOCAL ] IBM: Primary data saved (53631 records). [2025-10-06T19:32:49.439001] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-06T19:32:49.439811] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBM took 38.6s. Estimated remaining: 3h 1m 22s. Rate: 7.1 symbols/min [2025-10-06T19:32:49.610461] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:32:49.649035] [DEBUG] [LOCAL ] IDA: Loaded 32618 existing records from primary storage. [2025-10-06T19:32:49.649368] [INFO ] [MAIN ] IDA: Loaded 32618 existing records. [2025-10-06T19:32:49.828343] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:32:49.828597] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-06T19:32:49.828682] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-06T19:32:49.829112] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-06T19:32:49.829168] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-06T19:32:50.181385] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:32:50.225531] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-06T19:32:50.740756] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T19:32:51.025571] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-06T19:32:51.085756] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T19:32:51.386215] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T19:32:51.825524] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-06T19:32:52.088022] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-06T19:32:52.625532] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-06T19:32:53.425552] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-06T19:32:53.512391] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T19:32:53.944532] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T19:32:54.225550] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-06T19:32:54.512492] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-06T19:32:55.025518] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-06T19:32:55.364182] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-06T19:32:55.825564] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-06T19:32:56.549537] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T19:32:56.625511] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-06T19:32:57.425505] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-06T19:32:57.655104] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T19:32:58.204511] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T19:32:58.225494] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-06T19:32:58.655528] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T19:32:59.025544] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-06T19:32:59.426251] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T19:32:59.825550] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-06T19:33:00.625515] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-06T19:33:01.114187] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-06T19:33:01.272462] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T19:33:01.425607] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-06T19:33:02.145009] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T19:33:02.225526] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-06T19:33:03.025538] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-06T19:33:03.344053] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-06T19:33:03.748582] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T19:33:03.825541] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-06T19:33:04.127028] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T19:33:04.625572] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-06T19:33:05.425495] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-06T19:33:05.639333] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-06T19:33:06.088564] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-06T19:33:06.225543] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-06T19:33:06.706260] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T19:33:06.708969] [INFO ] [REMOTE ] IBTA: Full fetch complete (50890 records). [2025-10-06T19:33:06.709104] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-06T19:33:07.030756] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-06T19:33:07.121431] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-06T19:33:07.121584] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-06T19:33:07.123078] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-06T19:33:07.123150] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-06T19:33:07.124850] [DEBUG] [LOCAL ] IBTA: Trimmed 50890 records to 37411 (keeping 200 days of data) [2025-10-06T19:33:07.377243] [DEBUG] [LOCAL ] IBTA: Primary data saved (37411 records). [2025-10-06T19:33:07.377473] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-06T19:33:07.377675] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBTA took 33.9s. Estimated remaining: 3h 1m 24s. Rate: 7.1 symbols/min [2025-10-06T19:33:07.593426] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:33:07.605743] [DEBUG] [LOCAL ] IDE: Loaded 8867 existing records from primary storage. [2025-10-06T19:33:07.606032] [INFO ] [MAIN ] IDE: Loaded 8867 existing records. [2025-10-06T19:33:07.836493] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:33:07.837096] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-06T19:33:07.837205] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-06T19:33:07.829054] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-06T19:33:07.839073] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-06T19:33:07.839157] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-06T19:33:08.296545] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:33:08.303953] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-06T19:33:08.338051] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T19:33:08.625577] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-06T19:33:09.292873] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-06T19:33:09.425496] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-06T19:33:09.472198] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T19:33:10.225517] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-06T19:33:10.954527] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-06T19:33:11.016943] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T19:33:11.025455] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-06T19:33:11.724132] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-06T19:33:11.825521] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-06T19:33:12.498372] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-06T19:33:12.625546] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-06T19:33:13.425524] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-06T19:33:14.225556] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-06T19:33:14.385870] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T19:33:14.838637] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T19:33:15.025505] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-06T19:33:15.726213] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T19:33:15.825501] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-06T19:33:16.317156] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T19:33:16.625560] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-06T19:33:17.138616] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T19:33:17.317714] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-06T19:33:17.425558] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-06T19:33:18.225554] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-06T19:33:18.613888] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T19:33:18.616296] [INFO ] [REMOTE ] ICL: Full fetch complete (55901 records). [2025-10-06T19:33:18.616402] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-06T19:33:19.002127] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-06T19:33:19.008869] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T19:33:19.008936] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-06T19:33:19.012355] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-06T19:33:19.012740] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-06T19:33:19.013810] [DEBUG] [LOCAL ] ICL: Trimmed 55901 records to 38331 (keeping 200 days of data) [2025-10-06T19:33:19.060614] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-06T19:33:19.228338] [DEBUG] [LOCAL ] ICL: Primary data saved (38331 records). [2025-10-06T19:33:19.228500] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-06T19:33:19.228596] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. ICL took 31.4s. Estimated remaining: 3h 1m 20s. Rate: 7.1 symbols/min [2025-10-06T19:33:19.395092] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:33:19.413349] [DEBUG] [LOCAL ] IDT: Loaded 18332 existing records from primary storage. [2025-10-06T19:33:19.413624] [INFO ] [MAIN ] IDT: Loaded 18332 existing records. [2025-10-06T19:33:19.597072] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:33:19.597318] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-06T19:33:19.597367] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-06T19:33:19.598175] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-06T19:33:19.598236] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-06T19:33:19.843955] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-06T19:33:19.881769] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-06T19:33:19.964158] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:33:20.625532] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-06T19:33:21.425503] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-06T19:33:21.509460] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-06T19:33:21.721317] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T19:33:22.225529] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-06T19:33:22.593289] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T19:33:23.002038] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T19:33:23.025485] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-06T19:33:23.759288] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T19:33:23.825492] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-06T19:33:24.625567] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-06T19:33:25.425504] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-06T19:33:25.445728] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-06T19:33:25.449447] [INFO ] [REMOTE ] ICE: Full fetch complete (76756 records). [2025-10-06T19:33:25.449703] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-06T19:33:25.586014] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T19:33:25.637962] [INFO ] [REMOTE ] IDA: Full fetch complete (44932 records). [2025-10-06T19:33:25.671523] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-06T19:33:26.171301] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-06T19:33:26.177713] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-06T19:33:26.202561] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-06T19:33:26.214285] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-06T19:33:26.235820] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-06T19:33:26.242515] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-06T19:33:26.320765] [DEBUG] [LOCAL ] ICE: Trimmed 76756 records to 53010 (keeping 200 days of data) [2025-10-06T19:33:26.334251] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-06T19:33:26.334743] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-06T19:33:26.335350] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-06T19:33:26.335426] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-06T19:33:26.400068] [DEBUG] [LOCAL ] IDA: Trimmed 44932 records to 32463 (keeping 200 days of data) [2025-10-06T19:33:26.801314] [DEBUG] [LOCAL ] IDA: Primary data saved (32463 records). [2025-10-06T19:33:26.805390] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-06T19:33:26.805827] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. IDA took 37.4s. Estimated remaining: 3h 1m 11s. Rate: 7.1 symbols/min [2025-10-06T19:33:27.037417] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-06T19:33:27.041281] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:33:27.114415] [DEBUG] [LOCAL ] ICE: Primary data saved (53010 records). [2025-10-06T19:33:27.114619] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-06T19:33:27.116255] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. ICE took 40.9s. Estimated remaining: 3h 0m 52s. Rate: 7.1 symbols/min [2025-10-06T19:33:27.246622] [DEBUG] [LOCAL ] IEX: Loaded 38871 existing records from primary storage. [2025-10-06T19:33:27.289717] [INFO ] [MAIN ] IEX: Loaded 38871 existing records. [2025-10-06T19:33:27.318524] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:33:27.436368] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T19:33:27.524604] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:33:27.524949] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-06T19:33:27.525002] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-06T19:33:27.526220] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-06T19:33:27.526284] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-06T19:33:27.832865] [DEBUG] [LOCAL ] IFF: Loaded 51736 existing records from primary storage. [2025-10-06T19:33:27.831210] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-06T19:33:27.850525] [INFO ] [MAIN ] IFF: Loaded 51736 existing records. [2025-10-06T19:33:28.082989] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:33:28.028727] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-06T19:33:28.202827] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:33:28.203164] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-06T19:33:28.203226] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-06T19:33:28.203511] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-06T19:33:28.203572] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-06T19:33:28.629706] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-06T19:33:28.659915] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:33:28.936182] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-06T19:33:29.343329] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-06T19:33:29.425531] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-06T19:33:30.225524] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-06T19:33:30.748896] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T19:33:31.025518] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-06T19:33:31.621761] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T19:33:31.825526] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-06T19:33:32.625493] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-06T19:33:32.731238] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T19:33:33.253732] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T19:33:33.374128] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-06T19:33:33.375085] [INFO ] [REMOTE ] IDE: Full fetch complete (12552 records). [2025-10-06T19:33:33.375156] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-06T19:33:33.435861] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-06T19:33:33.738332] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-06T19:33:33.738432] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-06T19:33:33.738787] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-06T19:33:33.738851] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-06T19:33:33.739507] [DEBUG] [LOCAL ] IDE: Trimmed 12552 records to 8817 (keeping 200 days of data) [2025-10-06T19:33:33.792889] [DEBUG] [LOCAL ] IDE: Primary data saved (8817 records). [2025-10-06T19:33:33.793032] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-06T19:33:33.793123] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDE took 26.4s. Estimated remaining: 3h 0m 42s. Rate: 7.1 symbols/min [2025-10-06T19:33:33.962480] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:33:33.983119] [DEBUG] [LOCAL ] IFN: Loaded 18598 existing records from primary storage. [2025-10-06T19:33:33.983404] [INFO ] [MAIN ] IFN: Loaded 18598 existing records. [2025-10-06T19:33:34.170163] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:33:34.170442] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-06T19:33:34.170493] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-06T19:33:34.171249] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-06T19:33:34.171310] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-06T19:33:34.234791] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-06T19:33:34.538604] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:33:34.880424] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T19:33:35.025477] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-06T19:33:35.825503] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-06T19:33:35.873341] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T19:33:36.099152] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T19:33:36.625542] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-06T19:33:37.021597] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T19:33:37.425528] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-06T19:33:38.225531] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-06T19:33:38.417341] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T19:33:38.972858] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T19:33:39.025478] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-06T19:33:39.406427] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T19:33:39.825529] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-06T19:33:40.625604] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-06T19:33:40.742294] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T19:33:40.839086] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-06T19:33:41.425487] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-06T19:33:41.671388] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T19:33:41.997869] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-06T19:33:42.225565] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-06T19:33:43.025556] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-06T19:33:43.825505] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-06T19:33:44.026816] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T19:33:44.430205] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T19:33:44.625565] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-06T19:33:45.041265] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T19:33:45.425576] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-06T19:33:46.225630] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-06T19:33:46.609771] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-06T19:33:46.804628] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T19:33:47.025564] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-06T19:33:47.669974] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T19:33:47.825565] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-06T19:33:48.625553] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-06T19:33:48.719778] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-06T19:33:48.779046] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T19:33:49.425489] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-06T19:33:49.625836] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T19:33:49.627806] [INFO ] [REMOTE ] IDT: Full fetch complete (23219 records). [2025-10-06T19:33:49.627900] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-06T19:33:50.000020] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-06T19:33:50.000105] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-06T19:33:50.000567] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-06T19:33:50.000604] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-06T19:33:50.001273] [DEBUG] [LOCAL ] IDT: Trimmed 23219 records to 18050 (keeping 200 days of data) [2025-10-06T19:33:50.110969] [DEBUG] [LOCAL ] IDT: Primary data saved (18050 records). [2025-10-06T19:33:50.111125] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-06T19:33:50.111208] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDT took 30.9s. Estimated remaining: 3h 0m 43s. Rate: 7.1 symbols/min [2025-10-06T19:33:50.230877] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-06T19:33:50.291026] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:33:50.317988] [DEBUG] [LOCAL ] IFS: Loaded 23414 existing records from primary storage. [2025-10-06T19:33:50.318323] [INFO ] [MAIN ] IFS: Loaded 23414 existing records. [2025-10-06T19:33:50.514175] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:33:50.514725] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-06T19:33:50.514815] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-06T19:33:50.515148] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-06T19:33:50.515208] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-06T19:33:50.929480] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:33:50.923401] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T19:33:50.951995] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-06T19:33:51.025540] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-06T19:33:51.825582] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-06T19:33:52.100195] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T19:33:52.625565] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-06T19:33:53.423946] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T19:33:53.433443] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-06T19:33:53.557453] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-06T19:33:54.178868] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T19:33:54.225552] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-06T19:33:55.025576] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-06T19:33:55.315533] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T19:33:55.825499] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-06T19:33:55.911776] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-06T19:33:56.625548] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-06T19:33:57.425521] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-06T19:33:57.571001] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T19:33:57.913239] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T19:33:57.915900] [INFO ] [REMOTE ] IEX: Full fetch complete (53448 records). [2025-10-06T19:33:57.916057] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-06T19:33:58.230755] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-06T19:33:58.311559] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-06T19:33:58.311679] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-06T19:33:58.312579] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-06T19:33:58.312623] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-06T19:33:58.313929] [DEBUG] [LOCAL ] IEX: Trimmed 53448 records to 38346 (keeping 200 days of data) [2025-10-06T19:33:58.555773] [DEBUG] [LOCAL ] IEX: Primary data saved (38346 records). [2025-10-06T19:33:58.556147] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-06T19:33:58.556274] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IEX took 31.8s. Estimated remaining: 3h 0m 34s. Rate: 7.1 symbols/min [2025-10-06T19:33:58.699015] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-06T19:33:58.751608] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:33:58.764439] [DEBUG] [LOCAL ] IGA: Loaded 10018 existing records from primary storage. [2025-10-06T19:33:58.764743] [INFO ] [MAIN ] IGA: Loaded 10018 existing records. [2025-10-06T19:33:58.955395] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:33:58.955749] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-06T19:33:58.955814] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-06T19:33:58.955992] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-06T19:33:58.956033] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-06T19:33:59.030672] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-06T19:33:59.348839] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:33:59.396939] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T19:33:59.825552] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-06T19:34:00.151053] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T19:34:00.625600] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-06T19:34:01.406606] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T19:34:01.425476] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-06T19:34:01.801499] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T19:34:02.225554] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-06T19:34:03.027248] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-06T19:34:03.028610] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T19:34:03.102001] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T19:34:03.825565] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-06T19:34:04.021376] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T19:34:04.625555] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-06T19:34:05.314161] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T19:34:05.317603] [INFO ] [REMOTE ] IFF: Full fetch complete (73084 records). [2025-10-06T19:34:05.317837] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-06T19:34:05.427497] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-06T19:34:05.503171] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T19:34:05.746176] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-06T19:34:05.746292] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-06T19:34:05.747586] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-06T19:34:05.747703] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-06T19:34:05.750172] [DEBUG] [LOCAL ] IFF: Trimmed 73084 records to 51017 (keeping 200 days of data) [2025-10-06T19:34:06.101706] [DEBUG] [LOCAL ] IFF: Primary data saved (51017 records). [2025-10-06T19:34:06.101978] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-06T19:34:06.102152] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IFF took 39.0s. Estimated remaining: 3h 0m 25s. Rate: 7.1 symbols/min [2025-10-06T19:34:06.230691] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-06T19:34:06.295129] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:34:06.319112] [DEBUG] [LOCAL ] IGD: Loaded 19385 existing records from primary storage. [2025-10-06T19:34:06.319453] [INFO ] [MAIN ] IGD: Loaded 19385 existing records. [2025-10-06T19:34:06.518221] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:34:06.518546] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-06T19:34:06.518599] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-06T19:34:06.518951] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-06T19:34:06.519013] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-06T19:34:06.736298] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T19:34:06.922053] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:34:07.025556] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-06T19:34:07.427809] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T19:34:07.825556] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-06T19:34:08.401471] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T19:34:08.625688] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-06T19:34:08.955476] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T19:34:09.425544] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-06T19:34:09.436668] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-06T19:34:10.225556] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-06T19:34:10.424022] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-06T19:34:10.985917] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T19:34:11.025571] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-06T19:34:11.825566] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-06T19:34:12.014163] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T19:34:12.625541] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-06T19:34:12.643429] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T19:34:12.645341] [INFO ] [REMOTE ] IFN: Full fetch complete (29099 records). [2025-10-06T19:34:12.645448] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-06T19:34:13.052378] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-06T19:34:13.052485] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-06T19:34:13.053591] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-06T19:34:13.053681] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-06T19:34:13.054617] [DEBUG] [LOCAL ] IFN: Trimmed 29099 records to 18369 (keeping 200 days of data) [2025-10-06T19:34:13.184102] [DEBUG] [LOCAL ] IFN: Primary data saved (18369 records). [2025-10-06T19:34:13.184315] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-06T19:34:13.184464] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFN took 39.4s. Estimated remaining: 3h 0m 15s. Rate: 7.1 symbols/min [2025-10-06T19:34:13.369836] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:34:13.378137] [DEBUG] [LOCAL ] IGI: Loaded 3706 existing records from primary storage. [2025-10-06T19:34:13.378373] [INFO ] [MAIN ] IGI: Loaded 3706 existing records. [2025-10-06T19:34:13.433359] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-06T19:34:13.571681] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:34:13.572032] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-06T19:34:13.572139] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-06T19:34:13.572618] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-06T19:34:13.572716] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-06T19:34:13.863883] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T19:34:13.996034] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:34:14.225563] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-06T19:34:14.843504] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T19:34:15.025554] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-06T19:34:15.332523] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T19:34:15.825516] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-06T19:34:16.041298] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T19:34:16.571211] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-06T19:34:16.573154] [INFO ] [REMOTE ] IFS: Full fetch complete (31686 records). [2025-10-06T19:34:16.573264] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-06T19:34:16.630731] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-06T19:34:16.989807] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-06T19:34:16.989917] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-06T19:34:16.990616] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-06T19:34:16.990684] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-06T19:34:16.991418] [DEBUG] [LOCAL ] IFS: Trimmed 31686 records to 22985 (keeping 200 days of data) [2025-10-06T19:34:17.125555] [DEBUG] [LOCAL ] IFS: Primary data saved (22985 records). [2025-10-06T19:34:17.125738] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-06T19:34:17.125860] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFS took 27.0s. Estimated remaining: 3h 0m 1s. Rate: 7.1 symbols/min [2025-10-06T19:34:17.291264] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:34:17.322270] [DEBUG] [LOCAL ] IGR: Loaded 30882 existing records from primary storage. [2025-10-06T19:34:17.322599] [INFO ] [MAIN ] IGR: Loaded 30882 existing records. [2025-10-06T19:34:17.430756] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-06T19:34:17.508868] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:34:17.510249] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-06T19:34:17.510421] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-06T19:34:17.510877] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-06T19:34:17.510941] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-06T19:34:17.865681] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T19:34:17.917411] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:34:18.100984] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-06T19:34:18.225563] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-06T19:34:19.025554] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-06T19:34:19.743395] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-06T19:34:19.825493] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-06T19:34:19.861739] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T19:34:20.578909] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T19:34:20.625505] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-06T19:34:21.425542] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-06T19:34:21.441926] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T19:34:22.225517] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-06T19:34:22.365930] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T19:34:23.025514] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-06T19:34:23.243469] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T19:34:23.559237] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-06T19:34:23.825540] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-06T19:34:24.625592] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-06T19:34:25.191520] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T19:34:25.425536] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-06T19:34:25.601847] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T19:34:26.225499] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-06T19:34:26.649151] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T19:34:26.864618] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-06T19:34:27.025604] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-06T19:34:27.825546] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-06T19:34:28.092311] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-06T19:34:28.249297] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-06T19:34:28.625564] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-06T19:34:29.213418] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-06T19:34:29.425547] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-06T19:34:29.882355] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-06T19:34:30.225543] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-06T19:34:30.669673] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-06T19:34:31.025562] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-06T19:34:31.796041] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-06T19:34:31.825552] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-06T19:34:32.485415] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T19:34:32.486577] [INFO ] [REMOTE ] IGA: Full fetch complete (13773 records). [2025-10-06T19:34:32.486668] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-06T19:34:32.630778] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-06T19:34:32.853113] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-06T19:34:32.853207] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-06T19:34:32.853511] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-06T19:34:32.853551] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-06T19:34:32.854043] [DEBUG] [LOCAL ] IGA: Trimmed 13773 records to 9908 (keeping 200 days of data) [2025-10-06T19:34:32.912666] [DEBUG] [LOCAL ] IGA: Primary data saved (9908 records). [2025-10-06T19:34:32.912819] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-06T19:34:32.912901] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IGA took 34.4s. Estimated remaining: 3h 0m 1s. Rate: 7.1 symbols/min [2025-10-06T19:34:33.077572] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:34:33.083068] [DEBUG] [LOCAL ] IH: Loaded 3145 existing records from primary storage. [2025-10-06T19:34:33.083229] [INFO ] [MAIN ] IH: Loaded 3145 existing records. [2025-10-06T19:34:33.260776] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:34:33.261083] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-06T19:34:33.261179] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-06T19:34:33.261453] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-06T19:34:33.261510] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-06T19:34:33.435914] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-06T19:34:33.708586] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T19:34:33.711777] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:34:34.225550] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-06T19:34:34.683763] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-06T19:34:34.814714] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T19:34:35.025540] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-06T19:34:35.825574] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-06T19:34:36.390359] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-06T19:34:36.538684] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T19:34:36.625575] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-06T19:34:37.244507] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T19:34:37.425512] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-06T19:34:38.005957] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T19:34:38.225623] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-06T19:34:38.887141] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-06T19:34:39.025639] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-06T19:34:39.622057] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T19:34:39.825545] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-06T19:34:40.625513] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-06T19:34:40.765689] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T19:34:41.425551] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-06T19:34:41.446464] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-06T19:34:42.005493] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-06T19:34:42.225586] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-06T19:34:43.025541] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-06T19:34:43.389814] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T19:34:43.809115] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T19:34:43.811014] [INFO ] [REMOTE ] IGD: Full fetch complete (29823 records). [2025-10-06T19:34:43.811126] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-06T19:34:43.834098] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-06T19:34:44.198199] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-06T19:34:44.198301] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-06T19:34:44.198995] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-06T19:34:44.199070] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-06T19:34:44.200006] [DEBUG] [LOCAL ] IGD: Trimmed 29823 records to 19180 (keeping 200 days of data) [2025-10-06T19:34:44.325338] [DEBUG] [LOCAL ] IGD: Primary data saved (19180 records). [2025-10-06T19:34:44.325522] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-06T19:34:44.325615] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGD took 38.2s. Estimated remaining: 2h 59m 56s. Rate: 7.1 symbols/min [2025-10-06T19:34:44.418955] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-06T19:34:44.527571] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:34:44.537724] [DEBUG] [LOCAL ] IHD: Loaded 7057 existing records from primary storage. [2025-10-06T19:34:44.537999] [INFO ] [MAIN ] IHD: Loaded 7057 existing records. [2025-10-06T19:34:44.630797] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-06T19:34:44.721348] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:34:44.721665] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-06T19:34:44.721730] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-06T19:34:44.721942] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-06T19:34:44.721999] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-06T19:34:45.080145] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:34:45.425531] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-06T19:34:45.689374] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T19:34:46.225495] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-06T19:34:46.380104] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-06T19:34:46.488178] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-06T19:34:47.025535] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-06T19:34:47.545828] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T19:34:47.546782] [INFO ] [REMOTE ] IGI: Full fetch complete (5283 records). [2025-10-06T19:34:47.546854] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-06T19:34:47.830793] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-06T19:34:47.921262] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-06T19:34:47.921377] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-06T19:34:47.921579] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-06T19:34:47.921666] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-06T19:34:47.922133] [DEBUG] [LOCAL ] IGI: Trimmed 5283 records to 3684 (keeping 200 days of data) [2025-10-06T19:34:47.944574] [DEBUG] [LOCAL ] IGI: Primary data saved (3684 records). [2025-10-06T19:34:47.944725] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-06T19:34:47.944818] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IGI took 34.8s. Estimated remaining: 2h 59m 42s. Rate: 7.1 symbols/min [2025-10-06T19:34:48.128329] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:34:48.156017] [DEBUG] [LOCAL ] IHG: Loaded 24747 existing records from primary storage. [2025-10-06T19:34:48.156312] [INFO ] [MAIN ] IHG: Loaded 24747 existing records. [2025-10-06T19:34:48.304890] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-06T19:34:48.350408] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:34:48.350707] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-06T19:34:48.350802] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-06T19:34:48.351401] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-06T19:34:48.351592] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-06T19:34:48.630693] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-06T19:34:48.765132] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:34:49.425533] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-06T19:34:49.452811] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T19:34:50.225492] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-06T19:34:50.615845] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-06T19:34:51.025533] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-06T19:34:51.729383] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T19:34:51.745578] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-06T19:34:51.825565] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-06T19:34:52.625560] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-06T19:34:53.200930] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T19:34:53.306101] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-06T19:34:53.425530] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-06T19:34:53.976544] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T19:34:54.225542] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-06T19:34:54.944344] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T19:34:55.025536] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-06T19:34:55.496432] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-06T19:34:55.825524] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-06T19:34:56.331069] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T19:34:56.331867] [INFO ] [REMOTE ] IH: Full fetch complete (4961 records). [2025-10-06T19:34:56.331939] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-06T19:34:56.630723] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-06T19:34:56.694724] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-06T19:34:56.694829] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-06T19:34:56.695001] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-06T19:34:56.695041] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-06T19:34:56.695403] [DEBUG] [LOCAL ] IH: Trimmed 4961 records to 2883 (keeping 200 days of data) [2025-10-06T19:34:56.711603] [DEBUG] [LOCAL ] IH: Primary data saved (2883 records). [2025-10-06T19:34:56.711711] [INFO ] [MAIN ] IH: Full history saved. [2025-10-06T19:34:56.711797] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IH took 23.8s. Estimated remaining: 2h 59m 34s. Rate: 7.1 symbols/min [2025-10-06T19:34:56.885157] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:34:56.885412] [DEBUG] [LOCAL ] IHS: No existing data file found in primary storage. [2025-10-06T19:34:56.885497] [WARN ] [MAIN ] IHS: No existing data found, performing full refresh instead. [2025-10-06T19:34:56.885614] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-06T19:34:56.885685] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-06T19:34:56.885747] [DEBUG] [LOCAL ] IHS: No primary data file found to delete. [2025-10-06T19:34:56.885781] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-06T19:34:57.243509] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:34:57.284358] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-06T19:34:57.425528] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-06T19:34:58.225620] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-06T19:34:58.899207] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T19:34:59.025510] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-06T19:34:59.475037] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-06T19:34:59.825575] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-06T19:34:59.877587] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T19:35:00.625584] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-06T19:35:00.750038] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T19:35:00.752167] [INFO ] [REMOTE ] IGR: Full fetch complete (45566 records). [2025-10-06T19:35:00.752312] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-06T19:35:01.136424] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-06T19:35:01.136523] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-06T19:35:01.137415] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-06T19:35:01.137478] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-06T19:35:01.138467] [DEBUG] [LOCAL ] IGR: Trimmed 45566 records to 30365 (keeping 200 days of data) [2025-10-06T19:35:01.314418] [DEBUG] [LOCAL ] IGR: Primary data saved (30365 records). [2025-10-06T19:35:01.314588] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-06T19:35:01.314705] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGR took 44.2s. Estimated remaining: 2h 59m 21s. Rate: 7.1 symbols/min [2025-10-06T19:35:01.430875] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-06T19:35:01.495316] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:35:01.505604] [DEBUG] [LOCAL ] IIF: Loaded 5751 existing records from primary storage. [2025-10-06T19:35:01.505927] [INFO ] [MAIN ] IIF: Loaded 5751 existing records. [2025-10-06T19:35:01.709193] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:35:01.709705] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-06T19:35:01.709796] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-06T19:35:01.710060] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-06T19:35:01.710175] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-06T19:35:01.858629] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T19:35:02.139933] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:35:02.225518] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-06T19:35:02.456835] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-06T19:35:03.025592] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-06T19:35:03.451167] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-06T19:35:03.745789] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-06T19:35:03.825550] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-06T19:35:04.625548] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-06T19:35:04.645694] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-06T19:35:05.425579] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-06T19:35:05.657700] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-06T19:35:06.225548] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-06T19:35:06.910525] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T19:35:07.025633] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-06T19:35:07.549007] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T19:35:07.825544] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-06T19:35:07.922720] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T19:35:08.625542] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-06T19:35:09.102455] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-06T19:35:09.289618] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-06T19:35:09.425543] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-06T19:35:10.096312] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-06T19:35:10.225501] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-06T19:35:10.931355] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-06T19:35:11.025557] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-06T19:35:11.649815] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T19:35:11.825555] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-06T19:35:12.588504] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-06T19:35:12.625567] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-06T19:35:13.425552] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-06T19:35:13.454756] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-06T19:35:14.225592] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-06T19:35:14.740242] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T19:35:14.741409] [INFO ] [REMOTE ] IHD: Full fetch complete (11803 records). [2025-10-06T19:35:14.741480] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-06T19:35:15.030737] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-06T19:35:15.031804] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T19:35:15.135508] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-06T19:35:15.135594] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-06T19:35:15.135889] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-06T19:35:15.135964] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-06T19:35:15.136442] [DEBUG] [LOCAL ] IHD: Trimmed 11803 records to 6945 (keeping 200 days of data) [2025-10-06T19:35:15.176866] [DEBUG] [LOCAL ] IHD: Primary data saved (6945 records). [2025-10-06T19:35:15.176990] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-06T19:35:15.177073] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IHD took 30.9s. Estimated remaining: 2h 59m 19s. Rate: 7.1 symbols/min [2025-10-06T19:35:15.342680] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:35:15.362277] [DEBUG] [LOCAL ] IIIN: Loaded 16544 existing records from primary storage. [2025-10-06T19:35:15.362544] [INFO ] [MAIN ] IIIN: Loaded 16544 existing records. [2025-10-06T19:35:15.536230] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:35:15.536467] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-06T19:35:15.536512] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-06T19:35:15.536878] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-06T19:35:15.536936] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-06T19:35:15.724173] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-06T19:35:15.830631] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-06T19:35:15.898806] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:35:16.625495] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-06T19:35:17.060937] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T19:35:17.425492] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-06T19:35:17.494189] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T19:35:18.208536] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-06T19:35:18.225457] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-06T19:35:18.856400] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-06T19:35:19.025536] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-06T19:35:19.825507] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-06T19:35:20.048599] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T19:35:20.625497] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-06T19:35:21.015721] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T19:35:21.425527] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-06T19:35:21.591753] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T19:35:22.013255] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T19:35:22.225541] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-06T19:35:23.025572] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-06T19:35:23.266146] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T19:35:23.825490] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-06T19:35:24.218348] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T19:35:24.625570] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-06T19:35:25.376740] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T19:35:25.425479] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-06T19:35:25.808237] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-06T19:35:26.225599] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-06T19:35:26.563376] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T19:35:26.642216] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-06T19:35:27.025545] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-06T19:35:27.825553] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-06T19:35:28.490967] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T19:35:28.625480] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-06T19:35:28.882548] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-06T19:35:29.425522] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-06T19:35:30.071146] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T19:35:30.225521] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-06T19:35:30.650414] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-06T19:35:30.785056] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T19:35:30.787016] [INFO ] [REMOTE ] IIF: Full fetch complete (9259 records). [2025-10-06T19:35:30.787504] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-06T19:35:31.031931] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-06T19:35:31.316715] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-06T19:35:31.316820] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-06T19:35:31.317084] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-06T19:35:31.317131] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-06T19:35:31.317820] [DEBUG] [LOCAL ] IIF: Trimmed 9259 records to 5697 (keeping 200 days of data) [2025-10-06T19:35:31.358681] [DEBUG] [LOCAL ] IIF: Primary data saved (5697 records). [2025-10-06T19:35:31.359427] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-06T19:35:31.359688] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IIF took 30.0s. Estimated remaining: 2h 59m 19s. Rate: 7.1 symbols/min [2025-10-06T19:35:31.544908] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:35:31.564989] [DEBUG] [LOCAL ] IIM: Loaded 16408 existing records from primary storage. [2025-10-06T19:35:31.565303] [INFO ] [MAIN ] IIM: Loaded 16408 existing records. [2025-10-06T19:35:31.748511] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:35:31.748853] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-06T19:35:31.748911] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-06T19:35:31.749190] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-06T19:35:31.749250] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-06T19:35:31.830776] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-06T19:35:32.115150] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:35:32.219921] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T19:35:32.625518] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-06T19:35:33.021253] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T19:35:33.425615] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-06T19:35:33.657963] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T19:35:33.659997] [INFO ] [REMOTE ] IHS: Full fetch complete (51620 records). [2025-10-06T19:35:33.660095] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-06T19:35:34.039607] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-06T19:35:34.039735] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-06T19:35:34.040587] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-06T19:35:34.040629] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-06T19:35:34.041836] [DEBUG] [LOCAL ] IHS: Trimmed 51620 records to 38705 (keeping 200 days of data) [2025-10-06T19:35:34.226821] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-06T19:35:34.260091] [DEBUG] [LOCAL ] IHS: Primary data saved (38705 records). [2025-10-06T19:35:34.260272] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-06T19:35:34.260352] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHS took 37.5s. Estimated remaining: 2h 59m 4s. Rate: 7.1 symbols/min [2025-10-06T19:35:34.430805] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:35:34.434793] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T19:35:34.436502] [INFO ] [REMOTE ] IHG: Full fetch complete (33856 records). [2025-10-06T19:35:34.436580] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-06T19:35:34.739233] [DEBUG] [LOCAL ] IIPR: Loaded 30310 existing records from primary storage. [2025-10-06T19:35:34.763691] [INFO ] [MAIN ] IIPR: Loaded 30310 existing records. [2025-10-06T19:35:34.990572] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-06T19:35:35.001185] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-06T19:35:35.029766] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-06T19:35:35.034099] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-06T19:35:35.065663] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-06T19:35:35.065390] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:35:35.066582] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-06T19:35:35.066764] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-06T19:35:35.067052] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-06T19:35:35.067114] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-06T19:35:35.067202] [DEBUG] [LOCAL ] IHG: Trimmed 33856 records to 24338 (keeping 200 days of data) [2025-10-06T19:35:35.545318] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:35:35.603398] [DEBUG] [LOCAL ] IHG: Primary data saved (24338 records). [2025-10-06T19:35:35.614886] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T19:35:35.614484] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-06T19:35:35.619670] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IHG took 47.7s. Estimated remaining: 2h 58m 47s. Rate: 7.1 symbols/min [2025-10-06T19:35:35.810847] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:35:35.836332] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-06T19:35:35.856856] [DEBUG] [LOCAL ] IMAX: Loaded 43420 existing records from primary storage. [2025-10-06T19:35:35.857294] [INFO ] [MAIN ] IMAX: Loaded 43420 existing records. [2025-10-06T19:35:36.053363] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:35:36.053813] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-06T19:35:36.053873] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-06T19:35:36.054131] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-06T19:35:36.054188] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-06T19:35:36.171773] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T19:35:36.463503] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:35:36.625549] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-06T19:35:37.374068] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T19:35:37.425541] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-06T19:35:38.225544] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-06T19:35:38.291522] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T19:35:38.310287] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T19:35:39.025549] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-06T19:35:39.231703] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T19:35:39.825543] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-06T19:35:40.117044] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T19:35:40.625569] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-06T19:35:41.192717] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T19:35:41.425550] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-06T19:35:41.929434] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T19:35:42.225507] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-06T19:35:42.300153] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T19:35:43.025535] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-06T19:35:43.643833] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T19:35:43.663895] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T19:35:43.825506] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-06T19:35:44.625602] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-06T19:35:45.335578] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T19:35:45.425498] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-06T19:35:45.470448] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T19:35:45.472121] [INFO ] [REMOTE ] IIIN: Full fetch complete (24830 records). [2025-10-06T19:35:45.472210] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-06T19:35:45.848925] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-06T19:35:45.849034] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-06T19:35:45.849571] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-06T19:35:45.849612] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-06T19:35:45.850571] [DEBUG] [LOCAL ] IIIN: Trimmed 24830 records to 16204 (keeping 200 days of data) [2025-10-06T19:35:45.950234] [DEBUG] [LOCAL ] IIIN: Primary data saved (16204 records). [2025-10-06T19:35:45.950395] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-06T19:35:45.950479] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IIIN took 30.8s. Estimated remaining: 2h 58m 41s. Rate: 7.1 symbols/min [2025-10-06T19:35:46.137913] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:35:46.195259] [DEBUG] [LOCAL ] INFA: Loaded 50218 existing records from primary storage. [2025-10-06T19:35:46.195710] [INFO ] [MAIN ] INFA: Loaded 50218 existing records. [2025-10-06T19:35:46.230684] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-06T19:35:46.395796] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:35:46.396090] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-06T19:35:46.396142] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-06T19:35:46.396475] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-06T19:35:46.396536] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-06T19:35:46.792113] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:35:46.919504] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T19:35:47.025541] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-06T19:35:47.386217] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T19:35:47.825594] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-06T19:35:48.301402] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-06T19:35:48.625537] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-06T19:35:49.196908] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T19:35:49.425580] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-06T19:35:50.225525] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-06T19:35:50.332927] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T19:35:50.603777] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T19:35:51.025515] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-06T19:35:51.266516] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T19:35:51.825527] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-06T19:35:52.465063] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T19:35:52.506844] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-06T19:35:52.625506] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-06T19:35:53.425537] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-06T19:35:53.981795] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-06T19:35:54.225519] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-06T19:35:54.944934] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T19:35:54.992340] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-06T19:35:55.025485] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-06T19:35:55.825490] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-06T19:35:55.998557] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T19:35:56.625551] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-06T19:35:57.428411] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-06T19:35:57.430836] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T19:35:57.654129] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T19:35:58.225579] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-06T19:35:58.863788] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T19:35:59.025504] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-06T19:35:59.569216] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T19:35:59.825535] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-06T19:36:00.489366] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-06T19:36:00.625521] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-06T19:36:00.960288] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T19:36:01.425535] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-06T19:36:02.230717] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-06T19:36:02.244772] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T19:36:02.802721] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T19:36:02.804925] [INFO ] [REMOTE ] IIPR: Full fetch complete (44833 records). [2025-10-06T19:36:02.805028] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-06T19:36:03.029494] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-06T19:36:03.196608] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-06T19:36:03.197177] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-06T19:36:03.197484] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T19:36:03.198356] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-06T19:36:03.201665] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-06T19:36:03.203026] [DEBUG] [LOCAL ] IIPR: Trimmed 44833 records to 29626 (keeping 200 days of data) [2025-10-06T19:36:03.379883] [DEBUG] [LOCAL ] IIPR: Primary data saved (29626 records). [2025-10-06T19:36:03.380033] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-06T19:36:03.380114] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIPR took 29.1s. Estimated remaining: 2h 58m 43s. Rate: 7.1 symbols/min [2025-10-06T19:36:03.553762] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:36:03.607787] [DEBUG] [LOCAL ] INFY: Loaded 54375 existing records from primary storage. [2025-10-06T19:36:03.608130] [INFO ] [MAIN ] INFY: Loaded 54375 existing records. [2025-10-06T19:36:03.784247] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:36:03.784509] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-06T19:36:03.784568] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-06T19:36:03.785088] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-06T19:36:03.785147] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-06T19:36:03.830785] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-06T19:36:04.137744] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:36:04.607089] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T19:36:04.625484] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-06T19:36:04.828683] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T19:36:05.425525] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-06T19:36:06.225570] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-06T19:36:06.633383] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T19:36:06.742206] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-06T19:36:07.025527] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-06T19:36:07.825493] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-06T19:36:07.978265] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T19:36:08.625507] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-06T19:36:08.655752] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T19:36:08.657344] [INFO ] [REMOTE ] IIM: Full fetch complete (25524 records). [2025-10-06T19:36:08.657419] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-06T19:36:09.028812] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-06T19:36:09.080871] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-06T19:36:09.080979] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-06T19:36:09.081611] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-06T19:36:09.081733] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-06T19:36:09.082754] [DEBUG] [LOCAL ] IIM: Trimmed 25524 records to 15908 (keeping 200 days of data) [2025-10-06T19:36:09.182781] [DEBUG] [LOCAL ] IIM: Primary data saved (15908 records). [2025-10-06T19:36:09.182973] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-06T19:36:09.183063] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIM took 37.8s. Estimated remaining: 2h 58m 31s. Rate: 7.1 symbols/min [2025-10-06T19:36:09.358368] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:36:09.416222] [DEBUG] [LOCAL ] ING: Loaded 51453 existing records from primary storage. [2025-10-06T19:36:09.416756] [INFO ] [MAIN ] ING: Loaded 51453 existing records. [2025-10-06T19:36:09.430712] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-06T19:36:09.614149] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:36:09.614401] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-06T19:36:09.614448] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-06T19:36:09.614773] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-06T19:36:09.614832] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-06T19:36:09.981529] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:36:10.083553] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T19:36:10.225524] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-06T19:36:10.750477] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T19:36:11.025523] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-06T19:36:11.513409] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T19:36:11.516057] [INFO ] [REMOTE ] IMAX: Full fetch complete (60022 records). [2025-10-06T19:36:11.516153] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-06T19:36:11.830732] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-06T19:36:11.900446] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-06T19:36:11.900547] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-06T19:36:11.901536] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-06T19:36:11.901635] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-06T19:36:11.902998] [DEBUG] [LOCAL ] IMAX: Trimmed 60022 records to 42878 (keeping 200 days of data) [2025-10-06T19:36:12.151693] [DEBUG] [LOCAL ] IMAX: Primary data saved (42878 records). [2025-10-06T19:36:12.151850] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-06T19:36:12.151932] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IMAX took 36.5s. Estimated remaining: 2h 58m 17s. Rate: 7.1 symbols/min [2025-10-06T19:36:12.319065] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:36:12.349971] [DEBUG] [LOCAL ] INGM: Loaded 29093 existing records from primary storage. [2025-10-06T19:36:12.350293] [INFO ] [MAIN ] INGM: Loaded 29093 existing records. [2025-10-06T19:36:12.544755] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:36:12.545149] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-06T19:36:12.545370] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-06T19:36:12.545857] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-06T19:36:12.545920] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-06T19:36:12.626790] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-06T19:36:12.950041] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:36:12.944276] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-06T19:36:13.425557] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-06T19:36:14.015394] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T19:36:14.052566] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-06T19:36:14.225499] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-06T19:36:15.025533] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-06T19:36:15.333361] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T19:36:15.825486] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-06T19:36:16.011025] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T19:36:16.194306] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T19:36:16.625542] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-06T19:36:17.254556] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T19:36:17.425500] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-06T19:36:18.205501] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T19:36:18.225501] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-06T19:36:19.025563] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-06T19:36:19.188114] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T19:36:19.831268] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-06T19:36:19.845220] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T19:36:20.386217] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T19:36:20.625569] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-06T19:36:21.433281] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-06T19:36:21.452324] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T19:36:22.225497] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-06T19:36:22.295721] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T19:36:22.685758] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T19:36:23.025609] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-06T19:36:23.825559] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-06T19:36:24.202101] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-06T19:36:24.439857] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T19:36:24.442692] [INFO ] [REMOTE ] INFA: Full fetch complete (71220 records). [2025-10-06T19:36:24.442854] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-06T19:36:24.631982] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-06T19:36:24.956815] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-06T19:36:24.957539] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T19:36:24.958030] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-06T19:36:24.965730] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-06T19:36:24.965843] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-06T19:36:24.968117] [DEBUG] [LOCAL ] INFA: Trimmed 71220 records to 49450 (keeping 200 days of data) [2025-10-06T19:36:25.291785] [DEBUG] [LOCAL ] INFA: Primary data saved (49450 records). [2025-10-06T19:36:25.291954] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-06T19:36:25.292041] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. INFA took 39.3s. Estimated remaining: 2h 58m 14s. Rate: 7.1 symbols/min [2025-10-06T19:36:25.432016] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-06T19:36:25.465401] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:36:25.507513] [DEBUG] [LOCAL ] INGR: Loaded 33949 existing records from primary storage. [2025-10-06T19:36:25.507894] [INFO ] [MAIN ] INGR: Loaded 33949 existing records. [2025-10-06T19:36:25.691714] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:36:25.692226] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-06T19:36:25.692285] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-06T19:36:25.692506] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-06T19:36:25.692579] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-06T19:36:26.052144] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:36:26.225501] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-06T19:36:26.385435] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T19:36:27.025528] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-06T19:36:27.448463] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-06T19:36:27.580984] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T19:36:27.825519] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-06T19:36:28.625561] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-06T19:36:28.842876] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T19:36:29.425523] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-06T19:36:29.481867] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T19:36:30.118937] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T19:36:30.225541] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-06T19:36:30.708535] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-06T19:36:31.025548] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-06T19:36:31.730239] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T19:36:31.825566] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-06T19:36:32.625568] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-06T19:36:32.711231] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T19:36:33.425560] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-06T19:36:33.477410] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-06T19:36:33.480888] [INFO ] [REMOTE ] INFY: Full fetch complete (77542 records). [2025-10-06T19:36:33.481073] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-06T19:36:33.885265] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-06T19:36:33.885361] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-06T19:36:33.886413] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-06T19:36:33.886475] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-06T19:36:33.887938] [DEBUG] [LOCAL ] INFY: Trimmed 77542 records to 53596 (keeping 200 days of data) [2025-10-06T19:36:34.150818] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T19:36:34.228766] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-06T19:36:34.253924] [DEBUG] [LOCAL ] INFY: Primary data saved (53596 records). [2025-10-06T19:36:34.254016] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-06T19:36:34.254103] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFY took 30.9s. Estimated remaining: 2h 58m 6s. Rate: 7.1 symbols/min [2025-10-06T19:36:34.423831] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:36:34.461857] [DEBUG] [LOCAL ] INN: Loaded 42281 existing records from primary storage. [2025-10-06T19:36:34.462185] [INFO ] [MAIN ] INN: Loaded 42281 existing records. [2025-10-06T19:36:34.643507] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:36:34.643816] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-06T19:36:34.643868] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-06T19:36:34.644142] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-06T19:36:34.644201] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-06T19:36:34.969696] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T19:36:35.044576] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-06T19:36:35.050524] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:36:35.670374] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T19:36:35.825500] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-06T19:36:36.625501] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-06T19:36:36.921285] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-06T19:36:37.280128] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T19:36:37.425594] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-06T19:36:37.676442] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T19:36:38.225500] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-06T19:36:39.025716] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-06T19:36:39.141501] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T19:36:39.475995] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T19:36:39.825524] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-06T19:36:39.955143] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T19:36:40.625606] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-06T19:36:41.425546] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-06T19:36:41.483146] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T19:36:41.700856] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T19:36:42.225543] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-06T19:36:42.705041] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T19:36:43.025557] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-06T19:36:43.403463] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T19:36:43.825534] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-06T19:36:44.547107] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-06T19:36:44.549999] [INFO ] [REMOTE ] ING: Full fetch complete (73604 records). [2025-10-06T19:36:44.550124] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-06T19:36:44.626324] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-06T19:36:44.950111] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-06T19:36:44.950297] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-06T19:36:44.951338] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-06T19:36:44.951413] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-06T19:36:44.953079] [DEBUG] [LOCAL ] ING: Trimmed 73604 records to 50693 (keeping 200 days of data) [2025-10-06T19:36:45.075797] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-06T19:36:45.319433] [DEBUG] [LOCAL ] ING: Primary data saved (50693 records). [2025-10-06T19:36:45.319626] [INFO ] [MAIN ] ING: Full history saved. [2025-10-06T19:36:45.319757] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. ING took 36.1s. Estimated remaining: 2h 58m 0s. Rate: 7.1 symbols/min [2025-10-06T19:36:45.428220] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-06T19:36:45.505896] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:36:45.506177] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-06T19:36:45.506233] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-06T19:36:45.506360] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-06T19:36:45.506402] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-06T19:36:45.506445] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-06T19:36:45.506478] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-06T19:36:45.876262] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:36:46.140992] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T19:36:46.225534] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-06T19:36:46.766740] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-06T19:36:47.025560] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-06T19:36:47.264503] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-06T19:36:47.825545] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-06T19:36:48.367065] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T19:36:48.625498] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-06T19:36:49.086628] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T19:36:49.425555] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-06T19:36:50.061260] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T19:36:50.225488] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-06T19:36:50.685550] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T19:36:51.025534] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-06T19:36:51.587417] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T19:36:51.590282] [INFO ] [REMOTE ] INGR: Full fetch complete (50410 records). [2025-10-06T19:36:51.590382] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-06T19:36:51.831919] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-06T19:36:51.987849] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-06T19:36:51.987954] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-06T19:36:51.989222] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-06T19:36:51.989292] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-06T19:36:51.990752] [DEBUG] [LOCAL ] INGR: Trimmed 50410 records to 33586 (keeping 200 days of data) [2025-10-06T19:36:52.110556] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T19:36:52.112232] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-06T19:36:52.112890] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:36:52.114364] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-06T19:36:52.114452] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:36:52.118703] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-06T19:36:52.121446] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-06T19:36:52.121870] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-06T19:36:52.122213] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-06T19:36:52.123236] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INR took 6.8s. Estimated remaining: 2h 57m 50s. Rate: 7.1 symbols/min [2025-10-06T19:36:52.310956] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:36:52.432104] [DEBUG] [LOCAL ] INSP: Loaded 37804 existing records from primary storage. [2025-10-06T19:36:52.433339] [INFO ] [MAIN ] INSP: Loaded 37804 existing records. [2025-10-06T19:36:52.628265] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:36:52.629023] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-06T19:36:52.632905] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-06T19:36:52.634141] [DEBUG] [LOCAL ] INGR: Primary data saved (33586 records). [2025-10-06T19:36:52.634479] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-06T19:36:52.634621] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INGR took 27.3s. Estimated remaining: 2h 57m 32s. Rate: 7.1 symbols/min [2025-10-06T19:36:52.646930] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-06T19:36:52.678186] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-06T19:36:52.742713] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-06T19:36:52.859483] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T19:36:53.028679] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:36:53.344452] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:36:53.347162] [DEBUG] [LOCAL ] INSW: Loaded 40456 existing records from primary storage. [2025-10-06T19:36:53.347535] [INFO ] [MAIN ] INSW: Loaded 40456 existing records. [2025-10-06T19:36:53.430879] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-06T19:36:53.530377] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:36:53.530733] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-06T19:36:53.530792] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-06T19:36:53.531034] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-06T19:36:53.531093] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-06T19:36:53.710559] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T19:36:53.790786] [INFO ] [REMOTE ] INGM: Full fetch complete (42462 records). [2025-10-06T19:36:53.807251] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-06T19:36:54.031480] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:36:54.240507] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-06T19:36:54.292868] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-06T19:36:54.292978] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-06T19:36:54.293932] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-06T19:36:54.293996] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-06T19:36:54.295076] [DEBUG] [LOCAL ] INGM: Trimmed 42462 records to 28691 (keeping 200 days of data) [2025-10-06T19:36:54.476956] [DEBUG] [LOCAL ] INGM: Primary data saved (28691 records). [2025-10-06T19:36:54.477206] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-06T19:36:54.477379] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INGM took 42.3s. Estimated remaining: 2h 57m 16s. Rate: 7.1 symbols/min [2025-10-06T19:36:54.674757] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T19:36:54.692942] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:36:54.757983] [DEBUG] [LOCAL ] INVH: Loaded 53907 existing records from primary storage. [2025-10-06T19:36:54.758459] [INFO ] [MAIN ] INVH: Loaded 53907 existing records. [2025-10-06T19:36:54.952450] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:36:54.952768] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-06T19:36:54.952824] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-06T19:36:54.953063] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-06T19:36:54.953123] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-06T19:36:55.030839] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-06T19:36:55.311807] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:36:55.814013] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T19:36:55.825484] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-06T19:36:56.494959] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T19:36:56.625565] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-06T19:36:57.367777] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T19:36:57.425529] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-06T19:36:58.111597] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T19:36:58.225525] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-06T19:36:58.838370] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T19:36:59.025574] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-06T19:36:59.825493] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-06T19:36:59.947049] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T19:37:00.625505] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-06T19:37:00.749667] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T19:37:01.177382] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-06T19:37:01.425575] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-06T19:37:01.657860] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T19:37:02.225587] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-06T19:37:03.025525] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-06T19:37:03.120066] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T19:37:03.586964] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-06T19:37:03.825544] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-06T19:37:04.370335] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T19:37:04.625621] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-06T19:37:04.990354] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T19:37:05.425515] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-06T19:37:05.993261] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T19:37:05.995606] [INFO ] [REMOTE ] INN: Full fetch complete (57855 records). [2025-10-06T19:37:05.995727] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-06T19:37:06.226680] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-06T19:37:06.410827] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-06T19:37:06.410917] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-06T19:37:06.411824] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-06T19:37:06.411888] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-06T19:37:06.413026] [DEBUG] [LOCAL ] INN: Trimmed 57855 records to 41760 (keeping 200 days of data) [2025-10-06T19:37:06.656066] [DEBUG] [LOCAL ] INN: Primary data saved (41760 records). [2025-10-06T19:37:06.656227] [INFO ] [MAIN ] INN: Full history saved. [2025-10-06T19:37:06.656319] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INN took 32.4s. Estimated remaining: 2h 57m 12s. Rate: 7.1 symbols/min [2025-10-06T19:37:06.836167] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:37:06.866338] [DEBUG] [LOCAL ] INVX: Loaded 29430 existing records from primary storage. [2025-10-06T19:37:06.866674] [INFO ] [MAIN ] INVX: Loaded 29430 existing records. [2025-10-06T19:37:07.026147] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-06T19:37:07.049412] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:37:07.050281] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-06T19:37:07.050538] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-06T19:37:07.060204] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-06T19:37:07.066081] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-06T19:37:07.154148] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T19:37:07.444889] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:37:07.769771] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T19:37:07.825512] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-06T19:37:08.625603] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-06T19:37:08.795972] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T19:37:08.861183] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T19:37:09.425542] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-06T19:37:10.225513] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-06T19:37:10.278546] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T19:37:10.816553] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T19:37:11.025523] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-06T19:37:11.825547] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-06T19:37:11.878508] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T19:37:12.557531] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T19:37:12.625519] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-06T19:37:13.318822] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T19:37:13.425533] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-06T19:37:14.001762] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T19:37:14.225505] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-06T19:37:14.997371] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T19:37:15.025541] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-06T19:37:15.380309] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T19:37:15.825527] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-06T19:37:16.625545] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-06T19:37:16.874679] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T19:37:17.364242] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T19:37:17.425488] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-06T19:37:18.017121] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T19:37:18.225540] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-06T19:37:18.862235] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T19:37:18.865157] [INFO ] [REMOTE ] INSP: Full fetch complete (53177 records). [2025-10-06T19:37:18.865273] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-06T19:37:19.030333] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-06T19:37:19.286078] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-06T19:37:19.286223] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-06T19:37:19.287956] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-06T19:37:19.288127] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-06T19:37:19.289833] [DEBUG] [LOCAL ] INSP: Trimmed 53177 records to 37461 (keeping 200 days of data) [2025-10-06T19:37:19.546889] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T19:37:19.566355] [DEBUG] [LOCAL ] INSP: Primary data saved (37461 records). [2025-10-06T19:37:19.566582] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-06T19:37:19.566719] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INSP took 27.4s. Estimated remaining: 2h 57m 9s. Rate: 7.1 symbols/min [2025-10-06T19:37:19.759685] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:37:19.821252] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-10-06T19:37:19.821784] [INFO ] [MAIN ] IONQ: Loaded 54568 existing records. [2025-10-06T19:37:19.833495] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-06T19:37:20.011442] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:37:20.011776] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-06T19:37:20.011833] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-06T19:37:20.012208] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-06T19:37:20.012267] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-06T19:37:20.413032] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:37:20.625553] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-06T19:37:20.692723] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T19:37:20.955185] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T19:37:21.425573] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-06T19:37:22.094775] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-06T19:37:22.225536] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-06T19:37:22.663924] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-06T19:37:23.025535] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-06T19:37:23.556518] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T19:37:23.559183] [INFO ] [REMOTE ] INSW: Full fetch complete (60346 records). [2025-10-06T19:37:23.559317] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-06T19:37:23.832051] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-06T19:37:23.979552] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-06T19:37:23.979680] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-06T19:37:23.980751] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-06T19:37:23.980819] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-06T19:37:23.982109] [DEBUG] [LOCAL ] INSW: Trimmed 60346 records to 39789 (keeping 200 days of data) [2025-10-06T19:37:24.232521] [DEBUG] [LOCAL ] INSW: Primary data saved (39789 records). [2025-10-06T19:37:24.232716] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-06T19:37:24.232825] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSW took 31.6s. Estimated remaining: 2h 56m 56s. Rate: 7.1 symbols/min [2025-10-06T19:37:24.403516] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:37:24.457453] [DEBUG] [LOCAL ] IOT: Loaded 54251 existing records from primary storage. [2025-10-06T19:37:24.457867] [INFO ] [MAIN ] IOT: Loaded 54251 existing records. [2025-10-06T19:37:24.634492] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-06T19:37:24.639520] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:37:24.641015] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-06T19:37:24.641089] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-06T19:37:24.641330] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-06T19:37:24.641390] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-06T19:37:25.002354] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:37:25.425507] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-06T19:37:25.603363] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T19:37:25.736612] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-10-06T19:37:26.137236] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T19:37:26.225581] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-06T19:37:26.972992] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T19:37:27.025493] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-06T19:37:27.489525] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T19:37:27.825540] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-06T19:37:28.625529] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-06T19:37:29.022453] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T19:37:29.186335] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-06T19:37:29.425570] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-06T19:37:30.225546] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-06T19:37:30.342441] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T19:37:30.759696] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-06T19:37:31.025547] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-06T19:37:31.485290] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T19:37:31.825601] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-06T19:37:32.625565] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-06T19:37:32.714254] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T19:37:33.086003] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T19:37:33.425609] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-06T19:37:34.225559] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-06T19:37:34.443167] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T19:37:34.960876] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-06T19:37:35.025488] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-06T19:37:35.825529] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-06T19:37:36.024536] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T19:37:36.625600] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-06T19:37:37.425513] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-06T19:37:37.569575] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T19:37:37.687296] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T19:37:37.690553] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-06T19:37:37.706387] [INFO ] [REMOTE ] INVX: Full fetch complete (43926 records). [2025-10-06T19:37:37.706600] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-06T19:37:38.096992] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-06T19:37:38.097092] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-06T19:37:38.098525] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-06T19:37:38.098606] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-06T19:37:38.099941] [DEBUG] [LOCAL ] INVX: Trimmed 43926 records to 29134 (keeping 200 days of data) [2025-10-06T19:37:38.243392] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-06T19:37:38.282866] [DEBUG] [LOCAL ] INVX: Primary data saved (29134 records). [2025-10-06T19:37:38.283039] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-06T19:37:38.283159] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INVX took 31.6s. Estimated remaining: 2h 56m 54s. Rate: 7.1 symbols/min [2025-10-06T19:37:39.025595] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-06T19:37:39.114556] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T19:37:39.825550] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-06T19:37:40.450813] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T19:37:40.625611] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-06T19:37:40.671834] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-06T19:37:41.425559] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-06T19:37:41.613299] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T19:37:42.050331] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T19:37:42.225631] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-06T19:37:43.025602] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-06T19:37:43.664734] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T19:37:43.825488] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-06T19:37:43.946987] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-06T19:37:44.537876] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T19:37:44.541421] [INFO ] [REMOTE ] INVH: Full fetch complete (76739 records). [2025-10-06T19:37:44.541686] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-06T19:37:44.632541] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-06T19:37:44.934154] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-06T19:37:44.934246] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-06T19:37:44.935327] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-06T19:37:44.935391] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-06T19:37:44.936885] [DEBUG] [LOCAL ] INVH: Trimmed 76739 records to 53152 (keeping 200 days of data) [2025-10-06T19:37:45.266598] [DEBUG] [LOCAL ] INVH: Primary data saved (53152 records). [2025-10-06T19:37:45.266819] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-06T19:37:45.266927] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVH took 50.8s. Estimated remaining: 2h 56m 44s. Rate: 7.1 symbols/min [2025-10-06T19:37:45.815982] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T19:37:45.828469] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-06T19:37:47.194003] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-06T19:37:47.205594] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-06T19:37:47.734127] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-06T19:37:47.750424] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-06T19:37:49.553061] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T19:37:49.565740] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-06T19:37:49.868681] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-06T19:37:49.880693] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-06T19:37:50.901796] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T19:37:50.904930] [INFO ] [REMOTE ] IOT: Full fetch complete (77385 records). [2025-10-06T19:37:50.905084] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-06T19:37:51.292302] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-06T19:37:51.292389] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-06T19:37:51.293434] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-06T19:37:51.293499] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-06T19:37:51.295165] [DEBUG] [LOCAL ] IOT: Trimmed 77385 records to 53471 (keeping 200 days of data) [2025-10-06T19:37:51.611586] [DEBUG] [LOCAL ] IOT: Primary data saved (53471 records). [2025-10-06T19:37:51.611764] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-06T19:37:51.612635] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. IOT took 27.4s. Estimated remaining: 2h 56m 33s. Rate: 7.1 symbols/min [2025-10-06T19:37:52.317731] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-06T19:37:52.329190] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-06T19:37:54.750393] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-06T19:37:54.762143] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-06T19:37:57.309288] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-06T19:37:57.312352] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-06T19:37:57.312467] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-06T19:37:57.705873] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-06T19:37:57.705973] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-06T19:37:57.707163] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-06T19:37:57.707228] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-06T19:37:57.708900] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-06T19:37:58.032384] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-06T19:37:58.032549] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-06T19:37:58.032633] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 38.5s. Estimated remaining: 2h 56m 22s. Rate: 7.1 symbols/min [2025-10-06T19:37:58.633046] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:37:58.647048] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:37:58.746292] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:37:58.775106] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:37:58.795616] [DEBUG] [LOCAL ] IQI: Loaded 18347 existing records from primary storage. [2025-10-06T19:37:58.796130] [INFO ] [MAIN ] IQI: Loaded 18347 existing records. [2025-10-06T19:37:58.971060] [DEBUG] [LOCAL ] IPG: Loaded 54109 existing records from primary storage. [2025-10-06T19:37:59.010539] [INFO ] [MAIN ] IPG: Loaded 54109 existing records. [2025-10-06T19:37:59.064448] [DEBUG] [LOCAL ] IPI: Loaded 21849 existing records from primary storage. [2025-10-06T19:37:59.104533] [INFO ] [MAIN ] IPI: Loaded 21849 existing records. [2025-10-06T19:37:59.120890] [DEBUG] [LOCAL ] IP: Loaded 54091 existing records from primary storage. [2025-10-06T19:37:59.093984] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:37:59.155146] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-06T19:37:59.154929] [INFO ] [MAIN ] IP: Loaded 54091 existing records. [2025-10-06T19:37:59.195351] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-06T19:37:59.304592] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-06T19:37:59.411969] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-06T19:37:59.528480] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:37:59.597062] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-06T19:37:59.681872] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-06T19:37:59.686098] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:37:59.743450] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-06T19:37:59.743782] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-06T19:37:59.769600] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-06T19:37:59.794808] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:37:59.795067] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-06T19:37:59.795118] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-06T19:37:59.790568] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-06T19:37:59.811169] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-06T19:37:59.811349] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-06T19:37:59.854634] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-06T19:37:59.903051] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-06T19:38:00.910700] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:38:00.991484] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-06T19:38:01.067140] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:38:01.101632] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-06T19:38:01.216879] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:38:01.259715] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:38:01.260681] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-06T19:38:01.260904] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-06T19:38:02.428176] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T19:38:02.432180] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-06T19:38:02.612542] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T19:38:02.617533] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-06T19:38:02.862510] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T19:38:02.873522] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-06T19:38:03.303406] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T19:38:03.307719] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-06T19:38:03.351182] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-06T19:38:03.364225] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-06T19:38:03.598844] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T19:38:03.604189] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-06T19:38:04.239380] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T19:38:04.244890] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-06T19:38:04.450106] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T19:38:04.460673] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-06T19:38:04.706550] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T19:38:04.714301] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-06T19:38:04.949074] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T19:38:04.959842] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-06T19:38:05.125995] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-06T19:38:05.131223] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-06T19:38:05.712748] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T19:38:05.716968] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-06T19:38:06.142823] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-06T19:38:06.148345] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-06T19:38:06.309667] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-06T19:38:06.321593] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-06T19:38:06.650741] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T19:38:06.661299] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-06T19:38:06.707122] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T19:38:06.712466] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-06T19:38:07.318632] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-06T19:38:07.325324] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-06T19:38:07.641434] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-06T19:38:07.825570] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-06T19:38:08.006915] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T19:38:08.279238] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T19:38:08.419319] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T19:38:08.436562] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-06T19:38:08.625547] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-06T19:38:09.425691] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-06T19:38:09.712801] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T19:38:10.225572] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-06T19:38:10.326785] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-06T19:38:11.025552] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-06T19:38:11.046390] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T19:38:11.825563] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-06T19:38:12.625518] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-06T19:38:12.938563] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T19:38:12.950731] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-06T19:38:13.425545] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-06T19:38:14.215487] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T19:38:14.218088] [INFO ] [REMOTE ] IQI: Full fetch complete (26947 records). [2025-10-06T19:38:14.218181] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-06T19:38:14.247726] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-06T19:38:14.455065] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T19:38:14.662546] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-06T19:38:14.662673] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-06T19:38:14.663627] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-06T19:38:14.663718] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-06T19:38:14.664590] [DEBUG] [LOCAL ] IQI: Trimmed 26947 records to 18004 (keeping 200 days of data) [2025-10-06T19:38:14.780803] [DEBUG] [LOCAL ] IQI: Primary data saved (18004 records). [2025-10-06T19:38:14.781017] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-06T19:38:14.781129] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IQI took 16.7s. Estimated remaining: 2h 56m 23s. Rate: 7.1 symbols/min [2025-10-06T19:38:14.969161] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:38:15.028183] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-06T19:38:15.030867] [DEBUG] [LOCAL ] IQV: Loaded 50838 existing records from primary storage. [2025-10-06T19:38:15.031337] [INFO ] [MAIN ] IQV: Loaded 50838 existing records. [2025-10-06T19:38:15.235062] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:38:15.235468] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-06T19:38:15.235533] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-06T19:38:15.236212] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-06T19:38:15.236273] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-06T19:38:15.433072] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T19:38:15.715901] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:38:15.825554] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-06T19:38:16.625580] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-06T19:38:16.843483] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T19:38:16.889913] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T19:38:17.425546] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-06T19:38:18.210662] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T19:38:18.226824] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-06T19:38:18.228960] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T19:38:18.231494] [INFO ] [REMOTE ] IPI: Full fetch complete (29517 records). [2025-10-06T19:38:18.231602] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-06T19:38:18.603183] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-06T19:38:18.603278] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-06T19:38:18.603984] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-06T19:38:18.604048] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-06T19:38:18.604864] [DEBUG] [LOCAL ] IPI: Trimmed 29517 records to 21499 (keeping 200 days of data) [2025-10-06T19:38:18.734393] [DEBUG] [LOCAL ] IPI: Primary data saved (21499 records). [2025-10-06T19:38:18.734545] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-06T19:38:18.734659] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IPI took 20.7s. Estimated remaining: 2h 56m 9s. Rate: 7.1 symbols/min [2025-10-06T19:38:18.908998] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:38:18.970835] [DEBUG] [LOCAL ] IR: Loaded 53466 existing records from primary storage. [2025-10-06T19:38:18.971283] [INFO ] [MAIN ] IR: Loaded 53466 existing records. [2025-10-06T19:38:19.030741] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-06T19:38:19.201840] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:38:19.202122] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-06T19:38:19.202173] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-06T19:38:19.202471] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-06T19:38:19.202530] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-06T19:38:19.580398] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:38:19.827873] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-06T19:38:19.835174] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T19:38:20.625605] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-06T19:38:20.743739] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T19:38:21.425527] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-06T19:38:21.507094] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T19:38:22.225538] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-06T19:38:22.272830] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T19:38:23.006379] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T19:38:23.025474] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-06T19:38:23.310087] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T19:38:23.825547] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-06T19:38:24.557693] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-06T19:38:24.625603] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-06T19:38:25.263978] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T19:38:25.425616] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-06T19:38:26.225594] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-06T19:38:26.455684] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T19:38:26.891546] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-06T19:38:27.025502] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-06T19:38:27.616257] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T19:38:27.825520] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-06T19:38:28.424662] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T19:38:28.625597] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-06T19:38:29.425555] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-06T19:38:29.532174] [DEBUG] [REMOTE ] IQV: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-06T19:38:29.532537] [WARN ] [REMOTE ] IQV: No data returned for month 2025-05 [2025-10-06T19:38:29.532631] [FATAL] [REMOTE ] IQV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:38:29.532752] [FATAL] [MAIN ] IQV: Failed to fetch primary data. [2025-10-06T19:38:29.532794] [WARN ] [MAIN ] IQV: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:38:29.532879] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-06T19:38:29.532993] [DEBUG] [LOCAL ] IQV: No primary data file found to delete. [2025-10-06T19:38:29.533049] [INFO ] [LOCAL ] IQV: Starting deletion of derivative data. [2025-10-06T19:38:29.533368] [DEBUG] [LOCAL ] IQV: Deleted derivative data file. [2025-10-06T19:38:29.533466] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IQV took 14.8s. Estimated remaining: 2h 56m 3s. Rate: 7.1 symbols/min [2025-10-06T19:38:29.719975] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:38:29.767303] [DEBUG] [LOCAL ] IRM: Loaded 50029 existing records from primary storage. [2025-10-06T19:38:29.767991] [INFO ] [MAIN ] IRM: Loaded 50029 existing records. [2025-10-06T19:38:29.953792] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:38:29.954174] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-06T19:38:29.954338] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-06T19:38:29.954597] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-06T19:38:29.954692] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-06T19:38:30.230825] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-06T19:38:30.336033] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:38:30.376566] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-06T19:38:30.447606] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T19:38:31.025558] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-06T19:38:31.825550] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-06T19:38:32.036505] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T19:38:32.625550] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-06T19:38:32.928665] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T19:38:33.432844] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-06T19:38:33.459004] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T19:38:33.919777] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T19:38:33.923519] [INFO ] [REMOTE ] IP: Full fetch complete (77130 records). [2025-10-06T19:38:33.923772] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-06T19:38:34.230745] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-06T19:38:34.331125] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-06T19:38:34.331231] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-06T19:38:34.332304] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-06T19:38:34.332411] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-06T19:38:34.334050] [DEBUG] [LOCAL ] IP: Trimmed 77130 records to 53313 (keeping 200 days of data) [2025-10-06T19:38:34.668882] [DEBUG] [LOCAL ] IP: Primary data saved (53313 records). [2025-10-06T19:38:34.669068] [INFO ] [MAIN ] IP: Full history saved. [2025-10-06T19:38:34.669161] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IP took 36.6s. Estimated remaining: 2h 55m 51s. Rate: 7.1 symbols/min [2025-10-06T19:38:34.854084] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:38:34.876682] [DEBUG] [LOCAL ] IRS: Loaded 22375 existing records from primary storage. [2025-10-06T19:38:34.876989] [INFO ] [MAIN ] IRS: Loaded 22375 existing records. [2025-10-06T19:38:35.028825] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-06T19:38:35.072516] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:38:35.073390] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-06T19:38:35.073564] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-06T19:38:35.073925] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-06T19:38:35.073988] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-06T19:38:35.387837] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-06T19:38:35.498933] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:38:35.837098] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-06T19:38:35.843625] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-06T19:38:36.222799] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T19:38:36.560291] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-06T19:38:36.625588] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-06T19:38:37.425558] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-06T19:38:38.225579] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-06T19:38:38.266294] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T19:38:38.499970] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T19:38:39.025610] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-06T19:38:39.825511] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-06T19:38:39.951636] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T19:38:40.590031] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T19:38:40.625489] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-06T19:38:40.684233] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T19:38:41.425570] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-06T19:38:42.225541] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-06T19:38:42.292510] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T19:38:42.476277] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T19:38:43.025552] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-06T19:38:43.436149] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T19:38:43.439962] [INFO ] [REMOTE ] IPG: Full fetch complete (77253 records). [2025-10-06T19:38:43.440197] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-06T19:38:43.864202] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-06T19:38:43.839165] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-06T19:38:43.864512] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-06T19:38:43.879251] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-06T19:38:43.881834] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-06T19:38:43.883928] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T19:38:43.891059] [DEBUG] [LOCAL ] IPG: Trimmed 77253 records to 53329 (keeping 200 days of data) [2025-10-06T19:38:44.259633] [DEBUG] [LOCAL ] IPG: Primary data saved (53329 records). [2025-10-06T19:38:44.259920] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-06T19:38:44.260099] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IPG took 46.2s. Estimated remaining: 2h 55m 44s. Rate: 7.1 symbols/min [2025-10-06T19:38:44.445294] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:38:44.500754] [DEBUG] [LOCAL ] IRT: Loaded 51140 existing records from primary storage. [2025-10-06T19:38:44.501222] [INFO ] [MAIN ] IRT: Loaded 51140 existing records. [2025-10-06T19:38:44.630755] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-06T19:38:44.695189] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:38:44.695457] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-06T19:38:44.695509] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-06T19:38:44.695796] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-06T19:38:44.695857] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-06T19:38:45.070805] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:38:45.425509] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-06T19:38:45.620367] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T19:38:45.736173] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T19:38:46.225554] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-06T19:38:46.584754] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T19:38:47.025586] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-06T19:38:47.677750] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T19:38:47.825513] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-06T19:38:48.604179] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T19:38:48.625498] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-06T19:38:49.281586] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T19:38:49.286408] [INFO ] [REMOTE ] IR: Full fetch complete (76223 records). [2025-10-06T19:38:49.286607] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-06T19:38:49.430702] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-06T19:38:49.718588] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-06T19:38:49.718741] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-06T19:38:49.720272] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-06T19:38:49.720358] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-06T19:38:49.722088] [DEBUG] [LOCAL ] IR: Trimmed 76223 records to 52726 (keeping 200 days of data) [2025-10-06T19:38:49.842539] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T19:38:50.095841] [DEBUG] [LOCAL ] IR: Primary data saved (52726 records). [2025-10-06T19:38:50.096021] [INFO ] [MAIN ] IR: Full history saved. [2025-10-06T19:38:50.097029] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IR took 31.4s. Estimated remaining: 2h 55m 33s. Rate: 7.1 symbols/min [2025-10-06T19:38:50.230705] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-06T19:38:50.277764] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:38:50.301015] [DEBUG] [LOCAL ] ISD: Loaded 15880 existing records from primary storage. [2025-10-06T19:38:50.301297] [INFO ] [MAIN ] ISD: Loaded 15880 existing records. [2025-10-06T19:38:50.485729] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:38:50.486014] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-06T19:38:50.486062] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-06T19:38:50.486388] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-06T19:38:50.486445] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-06T19:38:50.851210] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:38:51.025540] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-06T19:38:51.143382] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T19:38:51.825571] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-06T19:38:51.939150] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T19:38:52.162774] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T19:38:52.602412] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-06T19:38:52.625531] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-06T19:38:53.425549] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-06T19:38:53.667190] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T19:38:54.153132] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T19:38:54.225566] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-06T19:38:55.025534] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-06T19:38:55.825490] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-06T19:38:56.023255] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T19:38:56.632413] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-06T19:38:56.639672] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T19:38:56.934970] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-06T19:38:57.425558] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-06T19:38:57.539925] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-06T19:38:58.225591] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-06T19:38:58.714582] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-06T19:38:59.025592] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-06T19:38:59.792959] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T19:38:59.825479] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-06T19:39:00.324819] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T19:39:00.625530] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-06T19:39:00.757106] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T19:39:00.758974] [INFO ] [REMOTE ] IRS: Full fetch complete (32233 records). [2025-10-06T19:39:00.759045] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-06T19:39:01.130890] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-06T19:39:01.130976] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-06T19:39:01.131638] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-06T19:39:01.131739] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-06T19:39:01.132463] [DEBUG] [LOCAL ] IRS: Trimmed 32233 records to 22173 (keeping 200 days of data) [2025-10-06T19:39:01.265518] [DEBUG] [LOCAL ] IRS: Primary data saved (22173 records). [2025-10-06T19:39:01.265728] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-06T19:39:01.265850] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IRS took 26.6s. Estimated remaining: 2h 55m 27s. Rate: 7.1 symbols/min [2025-10-06T19:39:01.432456] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-06T19:39:01.453538] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:39:01.496093] [DEBUG] [LOCAL ] IT: Loaded 42648 existing records from primary storage. [2025-10-06T19:39:01.496446] [INFO ] [MAIN ] IT: Loaded 42648 existing records. [2025-10-06T19:39:01.674416] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:39:01.674735] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-06T19:39:01.674794] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-06T19:39:01.675093] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-06T19:39:01.675152] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-06T19:39:02.052176] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:39:02.227684] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-06T19:39:02.231093] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T19:39:03.025549] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-06T19:39:03.079481] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T19:39:03.366703] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T19:39:03.825513] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-06T19:39:04.356733] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-06T19:39:04.625696] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-06T19:39:04.755929] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T19:39:05.425556] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-06T19:39:06.225546] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-06T19:39:06.264855] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T19:39:06.448469] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T19:39:07.025586] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-06T19:39:07.364489] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T19:39:07.825530] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-06T19:39:08.625546] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-06T19:39:08.705815] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T19:39:08.805664] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T19:39:09.425570] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-06T19:39:09.566456] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T19:39:10.225558] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-06T19:39:10.871742] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T19:39:11.025544] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-06T19:39:11.825541] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-06T19:39:11.975770] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T19:39:12.137331] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T19:39:12.140322] [INFO ] [REMOTE ] IRT: Full fetch complete (72700 records). [2025-10-06T19:39:12.140444] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-06T19:39:12.543524] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-06T19:39:12.543639] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-06T19:39:12.544815] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-06T19:39:12.544882] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-06T19:39:12.546383] [DEBUG] [LOCAL ] IRT: Trimmed 72700 records to 50382 (keeping 200 days of data) [2025-10-06T19:39:12.635618] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-06T19:39:12.858061] [DEBUG] [LOCAL ] IRT: Primary data saved (50382 records). [2025-10-06T19:39:12.858226] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-06T19:39:12.858314] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IRT took 28.6s. Estimated remaining: 2h 55m 22s. Rate: 7.1 symbols/min [2025-10-06T19:39:13.037826] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:39:13.072185] [DEBUG] [LOCAL ] ITGR: Loaded 31755 existing records from primary storage. [2025-10-06T19:39:13.072547] [INFO ] [MAIN ] ITGR: Loaded 31755 existing records. [2025-10-06T19:39:13.254520] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:39:13.255027] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-06T19:39:13.255174] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-06T19:39:13.255541] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-06T19:39:13.255601] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-06T19:39:13.425969] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-06T19:39:13.444430] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T19:39:13.688001] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:39:14.225494] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-06T19:39:14.330399] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-06T19:39:14.410573] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T19:39:15.025566] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-06T19:39:15.266089] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T19:39:15.815964] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-06T19:39:15.825576] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-06T19:39:16.625544] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-06T19:39:16.881324] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-06T19:39:17.425772] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-06T19:39:18.089345] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T19:39:18.225529] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-06T19:39:18.542388] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T19:39:19.025626] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-06T19:39:19.110426] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T19:39:19.825559] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-06T19:39:20.625511] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-06T19:39:20.650087] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T19:39:20.652278] [INFO ] [REMOTE ] ISD: Full fetch complete (24114 records). [2025-10-06T19:39:20.652418] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-06T19:39:20.982907] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T19:39:21.129448] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-06T19:39:21.129670] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-06T19:39:21.131021] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-06T19:39:21.131129] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-06T19:39:21.132406] [DEBUG] [LOCAL ] ISD: Trimmed 24114 records to 15726 (keeping 200 days of data) [2025-10-06T19:39:21.240935] [DEBUG] [LOCAL ] ISD: Primary data saved (15726 records). [2025-10-06T19:39:21.241130] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-06T19:39:21.241250] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. ISD took 31.1s. Estimated remaining: 2h 55m 14s. Rate: 7.1 symbols/min [2025-10-06T19:39:21.428814] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:39:21.428953] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-06T19:39:21.480952] [DEBUG] [LOCAL ] ITT: Loaded 33181 existing records from primary storage. [2025-10-06T19:39:21.481335] [INFO ] [MAIN ] ITT: Loaded 33181 existing records. [2025-10-06T19:39:21.677369] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:39:21.677840] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-06T19:39:21.677906] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-06T19:39:21.678273] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-06T19:39:21.678332] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-06T19:39:22.025268] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T19:39:22.090693] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:39:22.225493] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-06T19:39:22.755557] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T19:39:22.758819] [INFO ] [REMOTE ] IRM: Full fetch complete (72322 records). [2025-10-06T19:39:22.758965] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-06T19:39:23.032131] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-06T19:39:23.205883] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-06T19:39:23.206024] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-06T19:39:23.207289] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-06T19:39:23.207431] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-06T19:39:23.214739] [DEBUG] [LOCAL ] IRM: Trimmed 72322 records to 49285 (keeping 200 days of data) [2025-10-06T19:39:23.224789] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-06T19:39:23.565313] [DEBUG] [LOCAL ] IRM: Primary data saved (49285 records). [2025-10-06T19:39:23.565484] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-06T19:39:23.565575] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IRM took 54.0s. Estimated remaining: 2h 54m 58s. Rate: 7.1 symbols/min [2025-10-06T19:39:23.740888] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:39:23.741142] [DEBUG] [LOCAL ] ITUB: No existing data file found in primary storage. [2025-10-06T19:39:23.741186] [WARN ] [MAIN ] ITUB: No existing data found, performing full refresh instead. [2025-10-06T19:39:23.741301] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-06T19:39:23.741343] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-06T19:39:23.741416] [DEBUG] [LOCAL ] ITUB: No primary data file found to delete. [2025-10-06T19:39:23.741491] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-06T19:39:23.834082] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-06T19:39:24.163755] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:39:24.582688] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T19:39:24.625551] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-06T19:39:24.753893] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-06T19:39:25.425586] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-06T19:39:25.756331] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-06T19:39:26.225540] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-06T19:39:26.966118] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T19:39:27.025491] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-06T19:39:27.184162] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-06T19:39:27.825528] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-06T19:39:28.625508] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-06T19:39:28.659519] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T19:39:28.746061] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T19:39:29.425591] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-06T19:39:29.959134] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T19:39:30.225728] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-06T19:39:30.985444] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T19:39:31.025479] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-06T19:39:31.625906] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-06T19:39:31.825539] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-06T19:39:32.625519] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-06T19:39:32.856768] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T19:39:32.895014] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T19:39:33.425546] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-06T19:39:33.974085] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-06T19:39:34.225541] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-06T19:39:35.025522] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-06T19:39:35.348297] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T19:39:35.825558] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-06T19:39:35.884507] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T19:39:36.512335] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T19:39:36.625560] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-06T19:39:37.067704] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-06T19:39:37.425624] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-06T19:39:38.136864] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T19:39:38.225510] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-06T19:39:38.945748] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-06T19:39:39.025610] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-06T19:39:39.465488] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-06T19:39:39.825487] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-06T19:39:40.051089] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T19:39:40.053165] [INFO ] [REMOTE ] ITGR: Full fetch complete (42105 records). [2025-10-06T19:39:40.053252] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-06T19:39:40.428487] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-06T19:39:40.428583] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-06T19:39:40.429446] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-06T19:39:40.429509] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-06T19:39:40.430515] [DEBUG] [LOCAL ] ITGR: Trimmed 42105 records to 31364 (keeping 200 days of data) [2025-10-06T19:39:40.616681] [DEBUG] [LOCAL ] ITGR: Primary data saved (31364 records). [2025-10-06T19:39:40.616843] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-06T19:39:40.616931] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. ITGR took 27.8s. Estimated remaining: 2h 54m 59s. Rate: 7.1 symbols/min [2025-10-06T19:39:40.630760] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-06T19:39:40.786502] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:39:40.829976] [DEBUG] [LOCAL ] ITW: Loaded 46423 existing records from primary storage. [2025-10-06T19:39:40.830384] [INFO ] [MAIN ] ITW: Loaded 46423 existing records. [2025-10-06T19:39:41.005779] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:39:41.006044] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-06T19:39:41.006089] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-06T19:39:41.006296] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-06T19:39:41.006352] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-06T19:39:41.362607] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:39:41.425479] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-06T19:39:41.541403] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T19:39:42.225506] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-06T19:39:42.479884] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T19:39:43.025610] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-06T19:39:43.454249] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-06T19:39:43.825509] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-06T19:39:43.901421] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T19:39:44.360182] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-06T19:39:44.625534] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-06T19:39:45.414042] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T19:39:45.425462] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-06T19:39:45.564119] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-06T19:39:46.225561] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-06T19:39:47.030790] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-06T19:39:47.048863] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T19:39:47.825565] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-06T19:39:48.018758] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T19:39:48.311963] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T19:39:48.625569] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-06T19:39:49.231008] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T19:39:49.425488] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-06T19:39:50.225520] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-06T19:39:50.372137] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T19:39:51.025527] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-06T19:39:51.223591] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T19:39:51.593908] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-06T19:39:51.825568] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-06T19:39:52.302841] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T19:39:52.305541] [INFO ] [REMOTE ] IT: Full fetch complete (56525 records). [2025-10-06T19:39:52.305630] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-06T19:39:52.630739] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-06T19:39:52.683204] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-06T19:39:52.683288] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-06T19:39:52.684168] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-06T19:39:52.684229] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-06T19:39:52.685435] [DEBUG] [LOCAL ] IT: Trimmed 56525 records to 42187 (keeping 200 days of data) [2025-10-06T19:39:52.909638] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T19:39:52.921692] [INFO ] [REMOTE ] ITT: Full fetch complete (47022 records). [2025-10-06T19:39:52.930488] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-06T19:39:53.075829] [DEBUG] [LOCAL ] IT: Primary data saved (42187 records). [2025-10-06T19:39:53.086988] [INFO ] [MAIN ] IT: Full history saved. [2025-10-06T19:39:53.092293] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. IT took 51.8s. Estimated remaining: 2h 54m 55s. Rate: 7.1 symbols/min [2025-10-06T19:39:53.444380] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-06T19:39:53.475307] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:39:53.573141] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-06T19:39:53.573249] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-06T19:39:53.574465] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-06T19:39:53.574610] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-06T19:39:53.578276] [DEBUG] [LOCAL ] ITT: Trimmed 47022 records to 32662 (keeping 200 days of data) [2025-10-06T19:39:53.712292] [DEBUG] [LOCAL ] IVR: Loaded 48643 existing records from primary storage. [2025-10-06T19:39:53.714376] [INFO ] [MAIN ] IVR: Loaded 48643 existing records. [2025-10-06T19:39:53.916874] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:39:53.918954] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-06T19:39:53.919589] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-06T19:39:53.920554] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-06T19:39:53.920903] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-06T19:39:54.326858] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:39:54.328307] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-06T19:39:54.428473] [DEBUG] [LOCAL ] ITT: Primary data saved (32662 records). [2025-10-06T19:39:54.428717] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-06T19:39:54.428845] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ITT took 33.2s. Estimated remaining: 2h 54m 39s. Rate: 7.1 symbols/min [2025-10-06T19:39:54.630802] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:39:54.643245] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-06T19:39:54.689909] [DEBUG] [LOCAL ] IVT: Loaded 31154 existing records from primary storage. [2025-10-06T19:39:54.690236] [INFO ] [MAIN ] IVT: Loaded 31154 existing records. [2025-10-06T19:39:54.882155] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:39:54.882412] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-06T19:39:54.882470] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-06T19:39:54.882716] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-06T19:39:54.882774] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-06T19:39:55.027961] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-06T19:39:55.292737] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:39:55.333205] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T19:39:55.825497] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-06T19:39:56.021934] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T19:39:56.532855] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T19:39:56.536077] [INFO ] [REMOTE ] ITUB: Full fetch complete (77164 records). [2025-10-06T19:39:56.536229] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-06T19:39:56.634093] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-06T19:39:56.933042] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-06T19:39:56.933142] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-06T19:39:56.934226] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-06T19:39:56.934297] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-06T19:39:56.935909] [DEBUG] [LOCAL ] ITUB: Trimmed 77164 records to 53317 (keeping 200 days of data) [2025-10-06T19:39:57.217440] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-06T19:39:57.318055] [DEBUG] [LOCAL ] ITUB: Primary data saved (53317 records). [2025-10-06T19:39:57.318264] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-06T19:39:57.318360] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITUB took 33.8s. Estimated remaining: 2h 54m 25s. Rate: 7.1 symbols/min [2025-10-06T19:39:57.430758] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-06T19:39:57.499228] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:39:57.555740] [DEBUG] [LOCAL ] IVZ: Loaded 53906 existing records from primary storage. [2025-10-06T19:39:57.556155] [INFO ] [MAIN ] IVZ: Loaded 53906 existing records. [2025-10-06T19:39:57.741010] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:39:57.741338] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-06T19:39:57.741391] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-06T19:39:57.741896] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-06T19:39:57.742019] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-06T19:39:58.122481] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:39:58.149555] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T19:39:58.225499] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-06T19:39:58.863394] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T19:39:59.025538] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-06T19:39:59.825513] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-06T19:39:59.907444] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T19:39:59.989819] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T19:40:00.625535] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-06T19:40:01.425557] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-06T19:40:01.653202] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T19:40:01.987525] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-06T19:40:02.225553] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-06T19:40:02.970359] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T19:40:03.025569] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-06T19:40:03.085838] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-06T19:40:03.825549] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-06T19:40:04.625556] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-06T19:40:04.709565] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T19:40:05.432976] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-06T19:40:05.435787] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T19:40:06.225533] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-06T19:40:06.376970] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T19:40:06.675956] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-06T19:40:07.025508] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-06T19:40:07.596589] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T19:40:07.825532] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-06T19:40:08.487228] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T19:40:08.490773] [INFO ] [REMOTE ] ITW: Full fetch complete (66419 records). [2025-10-06T19:40:08.490957] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-06T19:40:08.640334] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-06T19:40:08.951894] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-06T19:40:08.952288] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-06T19:40:08.953852] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-06T19:40:08.953944] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-06T19:40:08.955822] [DEBUG] [LOCAL ] ITW: Trimmed 66419 records to 45700 (keeping 200 days of data) [2025-10-06T19:40:09.268202] [DEBUG] [LOCAL ] ITW: Primary data saved (45700 records). [2025-10-06T19:40:09.268376] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-06T19:40:09.268469] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITW took 28.7s. Estimated remaining: 2h 54m 20s. Rate: 7.1 symbols/min [2025-10-06T19:40:09.438469] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-06T19:40:09.440122] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:40:09.476377] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T19:40:09.511632] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T19:40:09.533128] [DEBUG] [LOCAL ] IX: Loaded 22726 existing records from primary storage. [2025-10-06T19:40:09.533438] [INFO ] [MAIN ] IX: Loaded 22726 existing records. [2025-10-06T19:40:09.716899] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:40:09.717218] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-06T19:40:09.717266] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-06T19:40:09.717696] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-06T19:40:09.717759] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-06T19:40:10.139372] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:40:10.225614] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-06T19:40:11.025619] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-06T19:40:11.295959] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T19:40:11.825493] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-06T19:40:12.103854] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T19:40:12.244792] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T19:40:12.625540] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-06T19:40:13.110710] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-06T19:40:13.425535] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-06T19:40:13.560205] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T19:40:14.225532] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-06T19:40:14.899297] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T19:40:14.934796] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-06T19:40:15.025554] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-06T19:40:15.825555] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-06T19:40:16.288950] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T19:40:16.625618] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-06T19:40:17.425546] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-06T19:40:17.531257] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T19:40:18.225501] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-06T19:40:18.264219] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T19:40:18.476778] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T19:40:19.025533] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-06T19:40:19.533314] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T19:40:19.825559] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-06T19:40:20.625520] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-06T19:40:20.855302] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T19:40:20.941986] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-06T19:40:20.944797] [INFO ] [REMOTE ] IVT: Full fetch complete (45511 records). [2025-10-06T19:40:20.945318] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-06T19:40:21.323832] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-06T19:40:21.323927] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-06T19:40:21.324819] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-06T19:40:21.324886] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-06T19:40:21.325943] [DEBUG] [LOCAL ] IVT: Trimmed 45511 records to 30780 (keeping 200 days of data) [2025-10-06T19:40:21.425720] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-06T19:40:21.517468] [DEBUG] [LOCAL ] IVT: Primary data saved (30780 records). [2025-10-06T19:40:21.517675] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-06T19:40:21.517787] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. IVT took 27.1s. Estimated remaining: 2h 54m 16s. Rate: 7.1 symbols/min [2025-10-06T19:40:21.691983] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:40:21.735188] [DEBUG] [LOCAL ] J: Loaded 40756 existing records from primary storage. [2025-10-06T19:40:21.735551] [INFO ] [MAIN ] J: Loaded 40756 existing records. [2025-10-06T19:40:21.910796] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:40:21.911037] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-06T19:40:21.911082] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-06T19:40:21.911300] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-06T19:40:21.911356] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-06T19:40:22.237110] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-06T19:40:22.269280] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:40:22.304884] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T19:40:22.680873] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T19:40:23.025506] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-06T19:40:23.377750] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T19:40:23.825533] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-06T19:40:24.625540] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-06T19:40:24.786526] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T19:40:25.053095] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T19:40:25.425537] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-06T19:40:26.179734] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T19:40:26.225473] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-06T19:40:26.411417] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-06T19:40:27.025598] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-06T19:40:27.695577] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T19:40:27.825501] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-06T19:40:28.070957] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T19:40:28.625533] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-06T19:40:29.060815] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T19:40:29.425533] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-06T19:40:30.225538] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-06T19:40:30.452170] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-06T19:40:30.581828] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T19:40:31.025602] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-06T19:40:31.785047] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-06T19:40:31.825539] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-06T19:40:32.017141] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T19:40:32.625600] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-06T19:40:33.425512] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-06T19:40:33.887990] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-06T19:40:34.182859] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T19:40:34.225499] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-06T19:40:34.383496] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T19:40:35.025590] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-06T19:40:35.825544] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-06T19:40:35.977714] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T19:40:35.996709] [INFO ] [REMOTE ] IX: Full fetch complete (27468 records). [2025-10-06T19:40:35.996895] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-06T19:40:35.998884] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T19:40:36.379419] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-06T19:40:36.379549] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-06T19:40:36.380153] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-06T19:40:36.380228] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-06T19:40:36.380958] [DEBUG] [LOCAL ] IX: Trimmed 27468 records to 22330 (keeping 200 days of data) [2025-10-06T19:40:36.529702] [DEBUG] [LOCAL ] IX: Primary data saved (22330 records). [2025-10-06T19:40:36.529933] [INFO ] [MAIN ] IX: Full history saved. [2025-10-06T19:40:36.530075] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IX took 27.3s. Estimated remaining: 2h 54m 14s. Rate: 7.1 symbols/min [2025-10-06T19:40:36.635189] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-06T19:40:36.713895] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:40:36.765161] [DEBUG] [LOCAL ] JBGS: Loaded 42986 existing records from primary storage. [2025-10-06T19:40:36.765580] [INFO ] [MAIN ] JBGS: Loaded 42986 existing records. [2025-10-06T19:40:36.955955] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:40:36.956319] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-06T19:40:36.956377] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-06T19:40:36.956872] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-06T19:40:36.956934] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-06T19:40:37.380784] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:40:37.425523] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-06T19:40:37.457367] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T19:40:38.225634] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-06T19:40:38.245810] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-06T19:40:38.248839] [INFO ] [REMOTE ] IVR: Full fetch complete (69221 records). [2025-10-06T19:40:38.249009] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-06T19:40:38.627007] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-06T19:40:38.627124] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-06T19:40:38.628164] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-06T19:40:38.628227] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-06T19:40:38.629624] [DEBUG] [LOCAL ] IVR: Trimmed 69221 records to 47998 (keeping 200 days of data) [2025-10-06T19:40:38.896483] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T19:40:38.918136] [INFO ] [REMOTE ] IVZ: Full fetch complete (76805 records). [2025-10-06T19:40:38.918712] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-06T19:40:39.027305] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-06T19:40:39.305289] [DEBUG] [LOCAL ] IVR: Primary data saved (47998 records). [2025-10-06T19:40:39.344472] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-06T19:40:39.344836] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-06T19:40:39.345051] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IVR took 46.2s. Estimated remaining: 2h 53m 60s. Rate: 7.1 symbols/min [2025-10-06T19:40:39.345169] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-06T19:40:39.384044] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-06T19:40:39.398234] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-06T19:40:39.494116] [DEBUG] [LOCAL ] IVZ: Trimmed 76805 records to 53132 (keeping 200 days of data) [2025-10-06T19:40:39.660736] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:40:39.726596] [DEBUG] [LOCAL ] JBI: Loaded 44153 existing records from primary storage. [2025-10-06T19:40:39.731804] [INFO ] [MAIN ] JBI: Loaded 44153 existing records. [2025-10-06T19:40:39.975427] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T19:40:40.033187] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-06T19:40:40.083888] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:40:40.087737] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-06T19:40:40.088448] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-06T19:40:40.089299] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-06T19:40:40.089627] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-06T19:40:40.493509] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:40:40.531631] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T19:40:40.622411] [DEBUG] [LOCAL ] IVZ: Primary data saved (53132 records). [2025-10-06T19:40:40.622607] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-06T19:40:40.622736] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IVZ took 43.3s. Estimated remaining: 2h 53m 43s. Rate: 7.1 symbols/min [2025-10-06T19:40:40.634837] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-06T19:40:40.804029] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:40:40.856051] [DEBUG] [LOCAL ] JBL: Loaded 49138 existing records from primary storage. [2025-10-06T19:40:40.856447] [INFO ] [MAIN ] JBL: Loaded 49138 existing records. [2025-10-06T19:40:41.049887] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:40:41.050168] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-06T19:40:41.050267] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-06T19:40:41.050503] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-06T19:40:41.050563] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-06T19:40:41.407407] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:40:41.425471] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-06T19:40:41.480815] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T19:40:42.225584] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-06T19:40:42.406935] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T19:40:42.725725] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T19:40:43.025584] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-06T19:40:43.695855] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T19:40:43.825563] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-06T19:40:44.392378] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T19:40:44.625569] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-06T19:40:45.186637] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T19:40:45.425578] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-06T19:40:46.141241] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T19:40:46.225549] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-06T19:40:46.796071] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T19:40:47.025576] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-06T19:40:47.476570] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T19:40:47.825549] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-06T19:40:48.236406] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-06T19:40:48.625566] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-06T19:40:49.187466] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T19:40:49.425522] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-06T19:40:50.225523] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-06T19:40:50.553453] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-06T19:40:50.650260] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-06T19:40:51.025625] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-06T19:40:51.771702] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T19:40:51.825544] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-06T19:40:52.430613] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T19:40:52.625536] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-06T19:40:53.371905] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T19:40:53.425489] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-06T19:40:53.786738] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T19:40:53.789814] [INFO ] [REMOTE ] J: Full fetch complete (59171 records). [2025-10-06T19:40:53.789954] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-06T19:40:54.232700] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-06T19:40:54.256370] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-06T19:40:54.256501] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-06T19:40:54.257685] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-06T19:40:54.257768] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-06T19:40:54.259105] [DEBUG] [LOCAL ] J: Trimmed 59171 records to 40186 (keeping 200 days of data) [2025-10-06T19:40:54.526611] [DEBUG] [LOCAL ] J: Primary data saved (40186 records). [2025-10-06T19:40:54.526808] [INFO ] [MAIN ] J: Full history saved. [2025-10-06T19:40:54.526902] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. J took 33.0s. Estimated remaining: 2h 53m 41s. Rate: 7.1 symbols/min [2025-10-06T19:40:54.694266] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:40:54.720778] [DEBUG] [LOCAL ] JBND: Loaded 26559 existing records from primary storage. [2025-10-06T19:40:54.721078] [INFO ] [MAIN ] JBND: Loaded 26559 existing records. [2025-10-06T19:40:54.896892] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:40:54.897218] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-06T19:40:54.897264] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-06T19:40:54.897495] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-06T19:40:54.897552] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-06T19:40:55.038872] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-06T19:40:55.284314] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T19:40:55.288110] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:40:55.825675] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-06T19:40:55.828696] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T19:40:56.299948] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T19:40:56.625526] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-06T19:40:57.425570] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-06T19:40:57.679867] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T19:40:58.230775] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-06T19:40:58.242818] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T19:40:58.629143] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T19:40:59.025531] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-06T19:40:59.828776] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-06T19:40:59.834716] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T19:41:00.466914] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T19:41:00.625497] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-06T19:41:00.993533] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T19:41:01.425532] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-06T19:41:02.008572] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-06T19:41:02.103821] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T19:41:02.225484] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-06T19:41:03.025620] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-06T19:41:03.783423] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T19:41:03.825482] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-06T19:41:04.312718] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T19:41:04.625570] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-06T19:41:04.834877] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T19:41:05.425541] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-06T19:41:06.217204] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-06T19:41:06.225460] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-06T19:41:06.378547] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T19:41:07.025523] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-06T19:41:07.209907] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T19:41:07.825549] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-06T19:41:08.379458] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T19:41:08.625552] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-06T19:41:09.425489] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-06T19:41:09.566354] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-06T19:41:09.569274] [INFO ] [REMOTE ] JBL: Full fetch complete (70437 records). [2025-10-06T19:41:09.569378] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-06T19:41:09.921477] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T19:41:09.969394] [INFO ] [REMOTE ] JBI: Full fetch complete (64276 records). [2025-10-06T19:41:09.969624] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-06T19:41:09.969745] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-06T19:41:09.969824] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-06T19:41:09.970975] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-06T19:41:09.971058] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-06T19:41:10.072565] [DEBUG] [LOCAL ] JBL: Trimmed 70437 records to 48400 (keeping 200 days of data) [2025-10-06T19:41:10.238805] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-06T19:41:10.478254] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-06T19:41:10.478955] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-06T19:41:10.480844] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-06T19:41:10.481214] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-06T19:41:10.484795] [DEBUG] [LOCAL ] JBI: Trimmed 64276 records to 43384 (keeping 200 days of data) [2025-10-06T19:41:10.602557] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T19:41:10.916202] [DEBUG] [LOCAL ] JBI: Primary data saved (43384 records). [2025-10-06T19:41:10.918774] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-06T19:41:10.918958] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. JBI took 31.6s. Estimated remaining: 2h 53m 41s. Rate: 7.1 symbols/min [2025-10-06T19:41:11.027604] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-06T19:41:11.143962] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:41:11.145419] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-06T19:41:11.146120] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-06T19:41:11.147794] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-06T19:41:11.148532] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-06T19:41:11.149557] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-06T19:41:11.149955] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-06T19:41:11.259451] [DEBUG] [LOCAL ] JBL: Primary data saved (48400 records). [2025-10-06T19:41:11.270401] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-06T19:41:11.276539] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBL took 30.7s. Estimated remaining: 2h 53m 24s. Rate: 7.1 symbols/min [2025-10-06T19:41:11.643026] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:41:11.664309] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-06T19:41:11.669599] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-06T19:41:11.733816] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-06T19:41:11.733460] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:41:11.733963] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-06T19:41:11.734616] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-06T19:41:11.734796] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-06T19:41:11.830611] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-06T19:41:12.028475] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T19:41:12.080295] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T19:41:12.117173] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T19:41:12.145615] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-06T19:41:12.145854] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:41:12.146310] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-06T19:41:12.152218] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:41:12.157455] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-06T19:41:12.162728] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-06T19:41:12.167949] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-06T19:41:12.191711] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-06T19:41:12.206302] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBS took 1.3s. Estimated remaining: 2h 53m 7s. Rate: 7.1 symbols/min [2025-10-06T19:41:12.285710] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:41:12.429466] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:41:12.440340] [DEBUG] [LOCAL ] JCE: Loaded 6994 existing records from primary storage. [2025-10-06T19:41:12.440568] [INFO ] [MAIN ] JCE: Loaded 6994 existing records. [2025-10-06T19:41:12.612871] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:41:12.613071] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-06T19:41:12.613118] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-06T19:41:12.613338] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-06T19:41:12.613404] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-06T19:41:12.633055] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-06T19:41:12.931941] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T19:41:12.966117] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-06T19:41:12.969470] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:41:12.969782] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:41:12.970113] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-06T19:41:12.970197] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:41:12.970289] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-06T19:41:12.970376] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-06T19:41:12.970414] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-06T19:41:12.970451] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-06T19:41:12.970500] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBTM took 1.7s. Estimated remaining: 2h 52m 50s. Rate: 7.1 symbols/min [2025-10-06T19:41:13.137203] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:41:13.201096] [DEBUG] [LOCAL ] JCI: Loaded 54318 existing records from primary storage. [2025-10-06T19:41:13.201457] [INFO ] [MAIN ] JCI: Loaded 54318 existing records. [2025-10-06T19:41:13.376386] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:41:13.376613] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-06T19:41:13.376692] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-06T19:41:13.377892] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-06T19:41:13.377951] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-06T19:41:13.430799] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-06T19:41:13.768799] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:41:14.225491] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-06T19:41:14.478064] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T19:41:15.025529] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-06T19:41:15.632525] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T19:41:15.664278] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-06T19:41:15.825508] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-06T19:41:16.625569] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-06T19:41:17.265310] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T19:41:17.425587] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-06T19:41:18.026688] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T19:41:18.117246] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T19:41:18.225501] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-06T19:41:19.025559] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-06T19:41:19.593001] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T19:41:19.603621] [INFO ] [REMOTE ] JBGS: Full fetch complete (59441 records). [2025-10-06T19:41:19.604940] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-06T19:41:19.605106] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-06T19:41:19.830696] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-06T19:41:20.218177] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-06T19:41:20.218331] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-06T19:41:20.219380] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-06T19:41:20.219449] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-06T19:41:20.220939] [DEBUG] [LOCAL ] JBGS: Trimmed 59441 records to 42393 (keeping 200 days of data) [2025-10-06T19:41:20.499205] [DEBUG] [LOCAL ] JBGS: Primary data saved (42393 records). [2025-10-06T19:41:20.499367] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-06T19:41:20.499460] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBGS took 44.0s. Estimated remaining: 2h 52m 41s. Rate: 7.1 symbols/min [2025-10-06T19:41:20.630686] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-06T19:41:20.675638] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:41:20.683606] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-06T19:41:20.732690] [DEBUG] [LOCAL ] JEF: Loaded 50784 existing records from primary storage. [2025-10-06T19:41:20.733080] [INFO ] [MAIN ] JEF: Loaded 50784 existing records. [2025-10-06T19:41:20.914880] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:41:20.915145] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-06T19:41:20.915192] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-06T19:41:20.915451] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-06T19:41:20.915510] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-06T19:41:21.312296] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:41:21.425538] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-06T19:41:21.690771] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T19:41:22.225611] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-06T19:41:22.817307] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-06T19:41:23.025505] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-06T19:41:23.087925] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T19:41:23.825524] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-06T19:41:24.442595] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-06T19:41:24.560363] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T19:41:24.625556] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-06T19:41:25.425546] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-06T19:41:25.796064] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T19:41:26.225586] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-06T19:41:27.025607] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-06T19:41:27.104628] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T19:41:27.141034] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-06T19:41:27.825562] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-06T19:41:28.251862] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T19:41:28.422908] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T19:41:28.625555] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-06T19:41:29.080050] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-06T19:41:29.425569] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-06T19:41:30.225585] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-06T19:41:31.022824] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T19:41:31.026535] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-06T19:41:31.580176] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T19:41:31.825551] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-06T19:41:32.625546] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-06T19:41:32.757378] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T19:41:33.234972] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T19:41:33.237175] [INFO ] [REMOTE ] JBND: Full fetch complete (34518 records). [2025-10-06T19:41:33.237252] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-06T19:41:33.430698] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-06T19:41:33.620186] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-06T19:41:33.620307] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-06T19:41:33.621062] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-06T19:41:33.621125] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-06T19:41:33.621987] [DEBUG] [LOCAL ] JBND: Trimmed 34518 records to 26300 (keeping 200 days of data) [2025-10-06T19:41:33.787779] [DEBUG] [LOCAL ] JBND: Primary data saved (26300 records). [2025-10-06T19:41:33.787941] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-06T19:41:33.788029] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JBND took 39.3s. Estimated remaining: 2h 52m 38s. Rate: 7.1 symbols/min [2025-10-06T19:41:33.978676] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:41:34.032687] [DEBUG] [LOCAL ] JELD: Loaded 46721 existing records from primary storage. [2025-10-06T19:41:34.033097] [INFO ] [MAIN ] JELD: Loaded 46721 existing records. [2025-10-06T19:41:34.150294] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-06T19:41:34.179798] [INFO ] [REMOTE ] JCE: Full fetch complete (9525 records). [2025-10-06T19:41:34.199928] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-06T19:41:34.240173] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-06T19:41:34.286871] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:41:34.333777] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-06T19:41:34.339524] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-06T19:41:34.368302] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-06T19:41:34.378944] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-06T19:41:34.709551] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-06T19:41:34.968941] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-06T19:41:34.974794] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-06T19:41:34.980296] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-06T19:41:34.990877] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-06T19:41:35.018276] [DEBUG] [LOCAL ] JCE: Trimmed 9525 records to 6968 (keeping 200 days of data) [2025-10-06T19:41:35.028694] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-06T19:41:35.085151] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:41:35.135567] [DEBUG] [LOCAL ] JCE: Primary data saved (6968 records). [2025-10-06T19:41:35.135865] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-06T19:41:35.136069] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JCE took 22.9s. Estimated remaining: 2h 52m 22s. Rate: 7.1 symbols/min [2025-10-06T19:41:35.329073] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:41:35.341951] [DEBUG] [LOCAL ] JEQ: Loaded 8975 existing records from primary storage. [2025-10-06T19:41:35.342261] [INFO ] [MAIN ] JEQ: Loaded 8975 existing records. [2025-10-06T19:41:35.543272] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:41:35.543603] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-06T19:41:35.543681] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-06T19:41:35.543927] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-06T19:41:35.543986] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-06T19:41:35.845039] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-06T19:41:35.951622] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:41:36.024786] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-06T19:41:36.563618] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T19:41:36.625478] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-06T19:41:37.238431] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T19:41:37.425570] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-06T19:41:38.225533] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-06T19:41:38.332008] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T19:41:38.911214] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T19:41:39.025533] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-06T19:41:39.825512] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-06T19:41:39.899052] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T19:41:40.423235] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T19:41:40.625496] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-06T19:41:40.693204] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T19:41:41.425605] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-06T19:41:42.034038] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T19:41:42.225610] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-06T19:41:43.025564] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-06T19:41:43.108910] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T19:41:43.572009] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-06T19:41:43.830731] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-06T19:41:43.843109] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T19:41:44.625591] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-06T19:41:45.301380] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-06T19:41:45.425501] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-06T19:41:45.533595] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T19:41:46.225544] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-06T19:41:46.800386] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T19:41:47.025555] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-06T19:41:47.788809] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T19:41:47.825497] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-06T19:41:47.894472] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T19:41:48.625544] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-06T19:41:49.426870] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-06T19:41:49.429766] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T19:41:50.225527] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-06T19:41:50.472845] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T19:41:51.025590] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-06T19:41:51.086495] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T19:41:51.825534] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-06T19:41:51.946983] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T19:41:52.354123] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T19:41:52.625540] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-06T19:41:53.330708] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T19:41:53.425545] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-06T19:41:54.057548] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T19:41:54.060781] [INFO ] [REMOTE ] JCI: Full fetch complete (77408 records). [2025-10-06T19:41:54.061095] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-06T19:41:54.231141] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-06T19:41:54.459775] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-06T19:41:54.460004] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-06T19:41:54.461237] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-06T19:41:54.461308] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-06T19:41:54.463089] [DEBUG] [LOCAL ] JCI: Trimmed 77408 records to 53538 (keeping 200 days of data) [2025-10-06T19:41:54.822944] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-06T19:41:54.856499] [DEBUG] [LOCAL ] JCI: Primary data saved (53538 records). [2025-10-06T19:41:54.856710] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-06T19:41:54.856822] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JCI took 41.9s. Estimated remaining: 2h 52m 25s. Rate: 7.1 symbols/min [2025-10-06T19:41:55.027244] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-06T19:41:55.028935] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:41:55.066817] [DEBUG] [LOCAL ] JFR: Loaded 31302 existing records from primary storage. [2025-10-06T19:41:55.067215] [INFO ] [MAIN ] JFR: Loaded 31302 existing records. [2025-10-06T19:41:55.188412] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T19:41:55.277489] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:41:55.277842] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-06T19:41:55.277894] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-06T19:41:55.278901] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-06T19:41:55.278962] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-06T19:41:55.661087] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:41:55.825509] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-06T19:41:56.625578] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-06T19:41:56.740348] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T19:41:57.246948] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T19:41:57.419513] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T19:41:57.425472] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-06T19:41:58.041743] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-06T19:41:58.225555] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-06T19:41:59.025553] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-06T19:41:59.643733] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-06T19:41:59.758999] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T19:41:59.825474] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-06T19:42:00.625539] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-06T19:42:01.425515] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-06T19:42:01.549381] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T19:42:01.960577] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T19:42:02.111085] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T19:42:02.225540] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-06T19:42:03.025531] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-06T19:42:03.582196] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T19:42:03.585211] [INFO ] [REMOTE ] JELD: Full fetch complete (64181 records). [2025-10-06T19:42:03.585348] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-06T19:42:03.832891] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-06T19:42:03.997688] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-06T19:42:03.997817] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-06T19:42:03.998805] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-06T19:42:03.998868] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-06T19:42:04.000164] [DEBUG] [LOCAL ] JELD: Trimmed 64181 records to 46068 (keeping 200 days of data) [2025-10-06T19:42:04.273339] [DEBUG] [LOCAL ] JELD: Primary data saved (46068 records). [2025-10-06T19:42:04.273509] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-06T19:42:04.273610] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JELD took 30.5s. Estimated remaining: 2h 52m 18s. Rate: 7.1 symbols/min [2025-10-06T19:42:04.448389] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:42:04.461043] [DEBUG] [LOCAL ] JGH: Loaded 11242 existing records from primary storage. [2025-10-06T19:42:04.461315] [INFO ] [MAIN ] JGH: Loaded 11242 existing records. [2025-10-06T19:42:04.607976] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T19:42:04.630427] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-06T19:42:04.654334] [INFO ] [REMOTE ] JEF: Full fetch complete (72994 records). [2025-10-06T19:42:04.653680] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:42:04.655294] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-06T19:42:04.655722] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-06T19:42:04.655804] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-06T19:42:04.661575] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-06T19:42:04.669405] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-06T19:42:05.425403] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:42:05.472346] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-06T19:42:05.472697] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-06T19:42:05.472236] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-06T19:42:05.473939] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-06T19:42:05.475006] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-06T19:42:05.500527] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T19:42:05.510153] [DEBUG] [LOCAL ] JEF: Trimmed 72994 records to 50035 (keeping 200 days of data) [2025-10-06T19:42:05.607983] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T19:42:05.840366] [DEBUG] [LOCAL ] JEF: Primary data saved (50035 records). [2025-10-06T19:42:05.840826] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-06T19:42:05.840940] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JEF took 45.3s. Estimated remaining: 2h 52m 2s. Rate: 7.1 symbols/min [2025-10-06T19:42:06.011614] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:42:06.056395] [DEBUG] [LOCAL ] JHG: Loaded 48335 existing records from primary storage. [2025-10-06T19:42:06.056837] [INFO ] [MAIN ] JHG: Loaded 48335 existing records. [2025-10-06T19:42:06.226527] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-06T19:42:06.232065] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:42:06.233374] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-06T19:42:06.233426] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-06T19:42:06.234052] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-06T19:42:06.234113] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-06T19:42:06.597614] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-06T19:42:06.602245] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:42:07.025517] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-06T19:42:07.079514] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-06T19:42:07.080769] [INFO ] [REMOTE ] JEQ: Full fetch complete (11867 records). [2025-10-06T19:42:07.080931] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-06T19:42:07.441479] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-06T19:42:07.441574] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-06T19:42:07.441877] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-06T19:42:07.441938] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-06T19:42:07.442456] [DEBUG] [LOCAL ] JEQ: Trimmed 11867 records to 8651 (keeping 200 days of data) [2025-10-06T19:42:07.497554] [DEBUG] [LOCAL ] JEQ: Primary data saved (8651 records). [2025-10-06T19:42:07.497783] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-06T19:42:07.497887] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JEQ took 32.4s. Estimated remaining: 2h 51m 46s. Rate: 7.1 symbols/min [2025-10-06T19:42:07.678951] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:42:07.685333] [DEBUG] [LOCAL ] JHI: Loaded 3638 existing records from primary storage. [2025-10-06T19:42:07.685613] [INFO ] [MAIN ] JHI: Loaded 3638 existing records. [2025-10-06T19:42:07.838754] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-06T19:42:07.878737] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:42:07.879187] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-06T19:42:07.879234] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-06T19:42:07.879500] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-06T19:42:07.879559] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-06T19:42:08.233943] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:42:08.427904] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T19:42:08.625499] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-06T19:42:08.691809] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T19:42:09.425575] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-06T19:42:10.161089] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T19:42:10.225516] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-06T19:42:10.268536] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T19:42:10.771203] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-06T19:42:11.025553] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-06T19:42:11.506302] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-06T19:42:11.825575] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-06T19:42:12.625616] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-06T19:42:13.281292] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-06T19:42:13.352018] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T19:42:13.425483] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-06T19:42:14.225595] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-06T19:42:14.820304] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-06T19:42:14.978951] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T19:42:15.025497] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-06T19:42:15.825527] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-06T19:42:16.628008] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-06T19:42:16.633413] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T19:42:17.152463] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-06T19:42:17.242376] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-06T19:42:17.425571] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-06T19:42:18.225555] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-06T19:42:18.947779] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T19:42:19.025494] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-06T19:42:19.126582] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T19:42:19.825511] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-06T19:42:20.135312] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T19:42:20.625511] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-06T19:42:20.960246] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-06T19:42:21.015579] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-06T19:42:21.425599] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-06T19:42:21.911713] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-06T19:42:22.225534] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-06T19:42:22.705141] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-06T19:42:23.025493] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-06T19:42:23.758877] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-06T19:42:23.825545] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-06T19:42:24.625546] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-06T19:42:25.425511] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-06T19:42:25.506767] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T19:42:25.617838] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T19:42:25.762622] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-06T19:42:26.225548] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-06T19:42:27.025600] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-06T19:42:27.055076] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-06T19:42:27.825567] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-06T19:42:28.096792] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-06T19:42:28.625518] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-06T19:42:29.305806] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T19:42:29.425553] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-06T19:42:29.919588] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T19:42:30.225599] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-06T19:42:30.775804] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-06T19:42:31.025505] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-06T19:42:31.126507] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T19:42:31.556630] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T19:42:31.557739] [INFO ] [REMOTE ] JHI: Full fetch complete (5281 records). [2025-10-06T19:42:31.557815] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-06T19:42:31.830824] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-06T19:42:32.012627] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-06T19:42:32.012772] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-06T19:42:32.013055] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-06T19:42:32.013118] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-06T19:42:32.013687] [DEBUG] [LOCAL ] JHI: Trimmed 5281 records to 3628 (keeping 200 days of data) [2025-10-06T19:42:32.039020] [DEBUG] [LOCAL ] JHI: Primary data saved (3628 records). [2025-10-06T19:42:32.039183] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-06T19:42:32.039300] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JHI took 24.5s. Estimated remaining: 2h 51m 55s. Rate: 7.1 symbols/min [2025-10-06T19:42:32.252800] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:42:32.259418] [DEBUG] [LOCAL ] JHS: Loaded 2882 existing records from primary storage. [2025-10-06T19:42:32.259613] [INFO ] [MAIN ] JHS: Loaded 2882 existing records. [2025-10-06T19:42:32.485723] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:42:32.486027] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-06T19:42:32.486086] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-06T19:42:32.486254] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-06T19:42:32.486325] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-06T19:42:32.630798] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-06T19:42:32.917288] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:42:33.352745] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T19:42:33.425485] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-06T19:42:34.087106] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T19:42:34.225545] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-06T19:42:34.681246] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-06T19:42:34.917976] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T19:42:35.025502] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-06T19:42:35.825521] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-06T19:42:36.299396] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T19:42:36.301845] [INFO ] [REMOTE ] JFR: Full fetch complete (48402 records). [2025-10-06T19:42:36.301969] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-06T19:42:36.560158] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T19:42:36.632217] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-06T19:42:36.685887] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-06T19:42:36.685990] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-06T19:42:36.686938] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-06T19:42:36.687029] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-06T19:42:36.688211] [DEBUG] [LOCAL ] JFR: Trimmed 48402 records to 30926 (keeping 200 days of data) [2025-10-06T19:42:36.882633] [DEBUG] [LOCAL ] JFR: Primary data saved (30926 records). [2025-10-06T19:42:36.882836] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-06T19:42:36.882945] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JFR took 42.0s. Estimated remaining: 2h 51m 43s. Rate: 7.1 symbols/min [2025-10-06T19:42:37.052141] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:42:37.106588] [DEBUG] [LOCAL ] JHX: Loaded 52661 existing records from primary storage. [2025-10-06T19:42:37.106981] [INFO ] [MAIN ] JHX: Loaded 52661 existing records. [2025-10-06T19:42:37.280219] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:42:37.280497] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-06T19:42:37.280548] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-06T19:42:37.281535] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-06T19:42:37.281594] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-06T19:42:37.452127] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-06T19:42:37.637623] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:42:37.898371] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T19:42:37.901262] [INFO ] [REMOTE ] JHG: Full fetch complete (68245 records). [2025-10-06T19:42:37.901383] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-06T19:42:38.225953] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-06T19:42:38.333124] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-06T19:42:38.333346] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-06T19:42:38.334595] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-06T19:42:38.334684] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-06T19:42:38.336594] [DEBUG] [LOCAL ] JHG: Trimmed 68245 records to 47585 (keeping 200 days of data) [2025-10-06T19:42:38.437559] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T19:42:38.650729] [DEBUG] [LOCAL ] JHG: Primary data saved (47585 records). [2025-10-06T19:42:38.650920] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-06T19:42:38.651033] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JHG took 32.8s. Estimated remaining: 2h 51m 27s. Rate: 7.1 symbols/min [2025-10-06T19:42:38.820179] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:42:38.839664] [DEBUG] [LOCAL ] JILL: Loaded 16861 existing records from primary storage. [2025-10-06T19:42:38.839949] [INFO ] [MAIN ] JILL: Loaded 16861 existing records. [2025-10-06T19:42:39.014484] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:42:39.014701] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-06T19:42:39.014758] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-06T19:42:39.014986] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-06T19:42:39.015042] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-06T19:42:39.035209] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-06T19:42:39.307517] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-06T19:42:39.385633] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:42:39.598846] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T19:42:39.825494] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-06T19:42:40.625551] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-06T19:42:40.805329] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T19:42:41.413605] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-06T19:42:41.425457] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-06T19:42:42.116387] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T19:42:42.117718] [INFO ] [REMOTE ] JGH: Full fetch complete (15122 records). [2025-10-06T19:42:42.117790] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-06T19:42:42.230753] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-06T19:42:42.474138] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-06T19:42:42.474230] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-06T19:42:42.474553] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-06T19:42:42.474592] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-06T19:42:42.475103] [DEBUG] [LOCAL ] JGH: Trimmed 15122 records to 11239 (keeping 200 days of data) [2025-10-06T19:42:42.544937] [DEBUG] [LOCAL ] JGH: Primary data saved (11239 records). [2025-10-06T19:42:42.545092] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-06T19:42:42.545176] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JGH took 38.3s. Estimated remaining: 2h 51m 14s. Rate: 7.1 symbols/min [2025-10-06T19:42:42.719543] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:42:42.769567] [DEBUG] [LOCAL ] JKS: Loaded 40657 existing records from primary storage. [2025-10-06T19:42:42.769925] [INFO ] [MAIN ] JKS: Loaded 40657 existing records. [2025-10-06T19:42:42.944811] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:42:42.945092] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-06T19:42:42.945170] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-06T19:42:42.946416] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-06T19:42:42.946476] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-06T19:42:43.034240] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-06T19:42:43.300769] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:42:43.492817] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T19:42:43.651834] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T19:42:43.825475] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-06T19:42:44.625527] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-06T19:42:45.402465] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T19:42:45.425470] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-06T19:42:45.434568] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T19:42:45.852273] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-06T19:42:46.225536] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-06T19:42:47.025537] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-06T19:42:47.734536] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-06T19:42:47.774291] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T19:42:47.825529] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-06T19:42:48.625621] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-06T19:42:49.323903] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-06T19:42:49.328463] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T19:42:49.425537] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-06T19:42:50.225542] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-06T19:42:50.666808] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-06T19:42:51.025553] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-06T19:42:51.246862] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T19:42:51.825537] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-06T19:42:52.450504] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-06T19:42:52.474620] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-06T19:42:52.625544] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-06T19:42:53.425537] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-06T19:42:53.464017] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T19:42:53.881367] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-06T19:42:54.225559] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-06T19:42:55.025567] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-06T19:42:55.636256] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T19:42:55.825542] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-06T19:42:56.057314] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T19:42:56.369266] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-06T19:42:56.625590] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-06T19:42:57.425619] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-06T19:42:58.225498] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-06T19:42:58.340867] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T19:42:58.821013] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T19:42:59.025487] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-06T19:42:59.120911] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T19:42:59.825525] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-06T19:43:00.625489] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-06T19:43:00.970949] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T19:43:01.013524] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-06T19:43:01.425559] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-06T19:43:02.026546] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-06T19:43:02.225553] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-06T19:43:02.772344] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-06T19:43:02.958305] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T19:43:03.025481] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-06T19:43:03.825534] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-06T19:43:04.266992] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-06T19:43:04.625514] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-06T19:43:04.764772] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-06T19:43:05.425602] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-06T19:43:05.794998] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-06T19:43:06.184296] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T19:43:06.225513] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-06T19:43:07.025619] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-06T19:43:07.211538] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-06T19:43:07.825543] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-06T19:43:08.244995] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-06T19:43:08.625498] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-06T19:43:08.930590] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T19:43:09.178617] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T19:43:09.179452] [INFO ] [REMOTE ] JHS: Full fetch complete (4460 records). [2025-10-06T19:43:09.179562] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-06T19:43:09.430672] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-06T19:43:09.534993] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-06T19:43:09.535084] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-06T19:43:09.535247] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-06T19:43:09.535321] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-06T19:43:09.535708] [DEBUG] [LOCAL ] JHS: Trimmed 4460 records to 2874 (keeping 200 days of data) [2025-10-06T19:43:09.553888] [DEBUG] [LOCAL ] JHS: Primary data saved (2874 records). [2025-10-06T19:43:09.553962] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-06T19:43:09.554049] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHS took 37.5s. Estimated remaining: 2h 51m 25s. Rate: 7.1 symbols/min [2025-10-06T19:43:09.725088] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:43:09.759585] [DEBUG] [LOCAL ] JLL: Loaded 31853 existing records from primary storage. [2025-10-06T19:43:09.759942] [INFO ] [MAIN ] JLL: Loaded 31853 existing records. [2025-10-06T19:43:09.935462] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:43:09.935774] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-06T19:43:09.935826] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-06T19:43:09.936866] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-06T19:43:09.936926] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-06T19:43:10.232756] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-06T19:43:10.338725] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:43:10.997834] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T19:43:11.025485] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-06T19:43:11.206981] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T19:43:11.825579] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-06T19:43:12.431963] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T19:43:12.434389] [INFO ] [REMOTE ] JKS: Full fetch complete (58842 records). [2025-10-06T19:43:12.434479] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-06T19:43:12.628087] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-06T19:43:12.828522] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-06T19:43:12.828612] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-06T19:43:12.829525] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-06T19:43:12.829586] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-06T19:43:12.830793] [DEBUG] [LOCAL ] JKS: Trimmed 58842 records to 40026 (keeping 200 days of data) [2025-10-06T19:43:12.953842] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-06T19:43:13.095051] [DEBUG] [LOCAL ] JKS: Primary data saved (40026 records). [2025-10-06T19:43:13.095207] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-06T19:43:13.095291] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JKS took 30.6s. Estimated remaining: 2h 51m 11s. Rate: 7.1 symbols/min [2025-10-06T19:43:13.425570] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-06T19:43:14.225571] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-06T19:43:14.268089] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T19:43:14.533821] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T19:43:14.877076] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T19:43:14.883062] [INFO ] [REMOTE ] JILL: Full fetch complete (22714 records). [2025-10-06T19:43:14.883183] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-06T19:43:15.032481] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-06T19:43:15.248812] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-06T19:43:15.248894] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-06T19:43:15.249286] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-06T19:43:15.249324] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-06T19:43:15.249915] [DEBUG] [LOCAL ] JILL: Trimmed 22714 records to 16449 (keeping 200 days of data) [2025-10-06T19:43:15.349617] [DEBUG] [LOCAL ] JILL: Primary data saved (16449 records). [2025-10-06T19:43:15.349804] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-06T19:43:15.349898] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JILL took 36.7s. Estimated remaining: 2h 50m 56s. Rate: 7.1 symbols/min [2025-10-06T19:43:15.825569] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-06T19:43:16.462163] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-06T19:43:16.625535] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-06T19:43:17.084409] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T19:43:17.087425] [INFO ] [REMOTE ] JHX: Full fetch complete (59331 records). [2025-10-06T19:43:17.087529] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-06T19:43:17.493595] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-06T19:43:17.493851] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-06T19:43:17.495556] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-06T19:43:17.495670] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-06T19:43:17.497582] [DEBUG] [LOCAL ] JHX: Trimmed 59331 records to 52726 (keeping 200 days of data) [2025-10-06T19:43:17.643969] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T19:43:17.737699] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-06T19:43:17.851158] [DEBUG] [LOCAL ] JHX: Primary data saved (52726 records). [2025-10-06T19:43:17.851345] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-06T19:43:17.851471] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JHX took 41.0s. Estimated remaining: 2h 50m 42s. Rate: 7.1 symbols/min [2025-10-06T19:43:19.064279] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T19:43:19.071865] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-06T19:43:20.545864] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T19:43:20.553018] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-06T19:43:21.757714] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T19:43:21.765074] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-06T19:43:23.109392] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-06T19:43:23.117020] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-06T19:43:24.623741] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T19:43:24.631837] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-06T19:43:25.886686] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-06T19:43:25.894020] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-06T19:43:27.077754] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T19:43:27.079736] [INFO ] [REMOTE ] JLL: Full fetch complete (44730 records). [2025-10-06T19:43:27.079863] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-06T19:43:27.463466] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-06T19:43:27.463574] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-06T19:43:27.464877] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-06T19:43:27.464943] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-06T19:43:27.466246] [DEBUG] [LOCAL ] JLL: Trimmed 44730 records to 31429 (keeping 200 days of data) [2025-10-06T19:43:27.678345] [DEBUG] [LOCAL ] JLL: Primary data saved (31429 records). [2025-10-06T19:43:27.678583] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-06T19:43:27.678730] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JLL took 18.1s. Estimated remaining: 2h 50m 35s. Rate: 7.1 symbols/min [2025-10-06T19:43:28.299927] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:43:28.409609] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:43:28.429749] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:43:28.433813] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-06T19:43:28.451011] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-06T19:43:28.459055] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-06T19:43:28.459313] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-06T19:43:28.459424] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-06T19:43:28.458667] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:43:28.459865] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-06T19:43:28.478360] [DEBUG] [LOCAL ] JLS: Loaded 4193 existing records from primary storage. [2025-10-06T19:43:28.503772] [INFO ] [MAIN ] JLS: Loaded 4193 existing records. [2025-10-06T19:43:28.940051] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:43:28.970480] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-06T19:43:28.970668] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-06T19:43:28.970329] [DEBUG] [LOCAL ] JMIA: Loaded 51428 existing records from primary storage. [2025-10-06T19:43:28.987015] [INFO ] [MAIN ] JMIA: Loaded 51428 existing records. [2025-10-06T19:43:28.992315] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-06T19:43:28.992484] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-06T19:43:29.084315] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-10-06T19:43:29.170318] [INFO ] [MAIN ] JNJ: Loaded 54533 existing records. [2025-10-06T19:43:29.590741] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:43:29.679319] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-06T19:43:29.765695] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:43:29.846779] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-06T19:43:29.847340] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-06T19:43:29.857911] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-06T19:43:29.871923] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-06T19:43:29.875417] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:43:29.892843] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-06T19:43:29.950042] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-06T19:43:30.030768] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-06T19:43:30.014636] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:43:30.038603] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-06T19:43:30.030925] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-06T19:43:30.416802] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T19:43:30.431584] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-06T19:43:30.651342] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:43:30.662060] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-06T19:43:30.730895] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-06T19:43:30.738180] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:43:30.740405] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-06T19:43:30.740155] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-06T19:43:30.836542] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-06T19:43:30.837715] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-06T19:43:31.295588] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T19:43:31.295801] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-06T19:43:31.298875] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-06T19:43:31.299742] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-06T19:43:31.624212] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-06T19:43:31.625415] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-06T19:43:31.810028] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-06T19:43:31.811748] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-06T19:43:32.061610] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-06T19:43:32.062923] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-06T19:43:32.349982] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-06T19:43:32.464568] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-06T19:43:32.625544] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-06T19:43:32.750393] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-06T19:43:32.848761] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-06T19:43:33.296605] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-06T19:43:33.425544] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-06T19:43:33.842530] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-06T19:43:34.225536] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-06T19:43:34.522501] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-06T19:43:35.025553] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-06T19:43:35.825561] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-06T19:43:36.379866] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-06T19:43:36.625534] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-06T19:43:37.036314] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-06T19:43:37.425570] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-06T19:43:38.016271] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T19:43:38.225513] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-06T19:43:38.605403] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-06T19:43:38.798794] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-06T19:43:39.025554] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-06T19:43:39.697494] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T19:43:39.825549] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-06T19:43:40.625538] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-06T19:43:41.425562] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-06T19:43:41.558310] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T19:43:41.931269] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T19:43:41.932311] [INFO ] [REMOTE ] JLS: Full fetch complete (5843 records). [2025-10-06T19:43:41.932392] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-06T19:43:42.236760] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-06T19:43:42.312119] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-06T19:43:42.312295] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-06T19:43:42.312561] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-06T19:43:42.312608] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-06T19:43:42.313144] [DEBUG] [LOCAL ] JLS: Trimmed 5843 records to 4143 (keeping 200 days of data) [2025-10-06T19:43:42.342167] [DEBUG] [LOCAL ] JLS: Primary data saved (4143 records). [2025-10-06T19:43:42.342324] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-06T19:43:42.342441] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JLS took 14.7s. Estimated remaining: 2h 50m 33s. Rate: 7.1 symbols/min [2025-10-06T19:43:42.522146] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:43:42.593950] [DEBUG] [LOCAL ] JOBY: Loaded 54579 existing records from primary storage. [2025-10-06T19:43:42.594408] [INFO ] [MAIN ] JOBY: Loaded 54579 existing records. [2025-10-06T19:43:42.789137] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:43:42.789629] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-06T19:43:42.789808] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-06T19:43:42.802214] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-06T19:43:42.807488] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-06T19:43:42.916085] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-06T19:43:43.030773] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-06T19:43:43.227925] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:43:43.588512] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-06T19:43:43.825531] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-06T19:43:43.988885] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T19:43:44.320013] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-06T19:43:44.625544] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-06T19:43:45.047780] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-06T19:43:45.425558] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-06T19:43:46.225538] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-06T19:43:47.025524] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-06T19:43:47.188672] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T19:43:47.825533] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-06T19:43:48.523566] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-06T19:43:48.625481] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-06T19:43:49.425495] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-06T19:43:49.559633] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T19:43:49.708822] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-06T19:43:49.818565] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-06T19:43:49.819468] [INFO ] [REMOTE ] JMM: Full fetch complete (2329 records). [2025-10-06T19:43:49.819541] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-06T19:43:50.008356] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-06T19:43:50.008638] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-06T19:43:50.008734] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-06T19:43:50.008789] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-06T19:43:50.008861] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-06T19:43:50.008900] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-06T19:43:50.009158] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-06T19:43:50.009532] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JMM took 22.3s. Estimated remaining: 2h 50m 23s. Rate: 7.1 symbols/min [2025-10-06T19:43:50.181060] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:43:50.207414] [DEBUG] [LOCAL ] JOE: Loaded 24485 existing records from primary storage. [2025-10-06T19:43:50.207768] [INFO ] [MAIN ] JOE: Loaded 24485 existing records. [2025-10-06T19:43:50.230753] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-06T19:43:50.393760] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:43:50.394040] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-06T19:43:50.394088] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-06T19:43:50.395494] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-06T19:43:50.395555] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-06T19:43:50.753900] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:43:50.893036] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-06T19:43:51.025478] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-06T19:43:51.825548] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-06T19:43:52.625552] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-06T19:43:52.798452] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-06T19:43:53.000235] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T19:43:53.174901] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-06T19:43:53.425517] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-06T19:43:54.225528] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-06T19:43:54.445270] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T19:43:54.683825] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T19:43:55.025592] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-06T19:43:55.825553] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-06T19:43:56.048332] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T19:43:56.597182] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-06T19:43:56.625473] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-06T19:43:57.425544] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-06T19:43:57.642385] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-06T19:43:58.225587] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-06T19:43:58.795026] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-06T19:43:59.025583] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-06T19:43:59.349575] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-06T19:43:59.825484] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-06T19:44:00.094508] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-06T19:44:00.139886] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T19:44:00.625520] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-06T19:44:01.425528] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-06T19:44:02.031002] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-06T19:44:02.225565] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-06T19:44:02.505529] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-06T19:44:02.766198] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-06T19:44:03.025548] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-06T19:44:03.825532] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-06T19:44:04.319920] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-06T19:44:04.625562] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-06T19:44:05.177953] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-06T19:44:05.425609] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-06T19:44:06.119765] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-06T19:44:06.225509] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-06T19:44:06.879812] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-06T19:44:06.902583] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T19:44:06.906971] [INFO ] [REMOTE ] JMIA: Full fetch complete (73276 records). [2025-10-06T19:44:06.907171] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-06T19:44:07.030756] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-06T19:44:07.342860] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-06T19:44:07.342984] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-06T19:44:07.344271] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-06T19:44:07.344388] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-06T19:44:07.346203] [DEBUG] [LOCAL ] JMIA: Trimmed 73276 records to 50758 (keeping 200 days of data) [2025-10-06T19:44:07.647034] [DEBUG] [LOCAL ] JMIA: Primary data saved (50758 records). [2025-10-06T19:44:07.647335] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-06T19:44:07.647438] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JMIA took 40.0s. Estimated remaining: 2h 50m 24s. Rate: 7.1 symbols/min [2025-10-06T19:44:07.813622] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:44:07.822157] [DEBUG] [LOCAL ] JOF: Loaded 7072 existing records from primary storage. [2025-10-06T19:44:07.822361] [INFO ] [MAIN ] JOF: Loaded 7072 existing records. [2025-10-06T19:44:07.853402] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-06T19:44:08.002156] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:44:08.002429] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-06T19:44:08.002475] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-06T19:44:08.003169] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-06T19:44:08.003264] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-06T19:44:08.332246] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T19:44:08.377718] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:44:08.625566] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-06T19:44:08.710839] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-06T19:44:09.425495] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-06T19:44:09.747446] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-06T19:44:10.025309] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-06T19:44:10.028477] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-06T19:44:10.028633] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-06T19:44:10.234060] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-06T19:44:10.426564] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-06T19:44:10.426718] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-06T19:44:10.427980] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-06T19:44:10.428059] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-06T19:44:10.429667] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-10-06T19:44:10.761142] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-06T19:44:10.761306] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-06T19:44:10.761396] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JNJ took 43.1s. Estimated remaining: 2h 50m 10s. Rate: 7.1 symbols/min [2025-10-06T19:44:10.952675] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:44:10.987736] [DEBUG] [LOCAL ] JPC: Loaded 37668 existing records from primary storage. [2025-10-06T19:44:10.988075] [INFO ] [MAIN ] JPC: Loaded 37668 existing records. [2025-10-06T19:44:11.050433] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-06T19:44:11.170761] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:44:11.171084] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-06T19:44:11.171195] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-06T19:44:11.173043] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-06T19:44:11.173104] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-06T19:44:11.527814] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:44:11.545259] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T19:44:11.766292] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-06T19:44:11.825720] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-06T19:44:12.257316] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-06T19:44:12.625589] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-06T19:44:13.213037] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-06T19:44:13.295895] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T19:44:13.425547] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-06T19:44:14.225627] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-06T19:44:14.636311] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-06T19:44:14.735778] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T19:44:15.025580] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-06T19:44:15.630291] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-06T19:44:15.825542] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-06T19:44:16.514899] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-06T19:44:16.625487] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-06T19:44:17.227993] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T19:44:17.425564] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-06T19:44:18.225528] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-06T19:44:18.444874] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T19:44:18.905985] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-06T19:44:19.025561] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-06T19:44:19.825544] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-06T19:44:20.414801] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T19:44:20.625559] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-06T19:44:21.425536] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-06T19:44:21.635041] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T19:44:22.225510] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-06T19:44:22.617278] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-06T19:44:22.652377] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T19:44:23.025556] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-06T19:44:23.172236] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T19:44:23.174158] [INFO ] [REMOTE ] JOE: Full fetch complete (35940 records). [2025-10-06T19:44:23.174251] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-06T19:44:23.614479] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-06T19:44:23.614908] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-06T19:44:23.616052] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-06T19:44:23.616138] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-06T19:44:23.618212] [DEBUG] [LOCAL ] JOE: Trimmed 35940 records to 24003 (keeping 200 days of data) [2025-10-06T19:44:23.764696] [DEBUG] [LOCAL ] JOE: Primary data saved (24003 records). [2025-10-06T19:44:23.764863] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-06T19:44:23.764968] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOE took 33.8s. Estimated remaining: 2h 50m 7s. Rate: 7.1 symbols/min [2025-10-06T19:44:23.830885] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-06T19:44:23.941085] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:44:23.993874] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-10-06T19:44:23.994340] [INFO ] [MAIN ] JPM: Loaded 54574 existing records. [2025-10-06T19:44:24.170618] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:44:24.170897] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-06T19:44:24.170983] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-06T19:44:24.173622] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-06T19:44:24.173708] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-06T19:44:24.462042] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-06T19:44:24.541907] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:44:24.625576] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-06T19:44:25.354078] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-06T19:44:25.425573] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-06T19:44:25.661814] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-06T19:44:26.097458] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T19:44:26.225591] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-06T19:44:26.885990] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T19:44:26.888349] [INFO ] [REMOTE ] JOF: Full fetch complete (9529 records). [2025-10-06T19:44:26.888595] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-06T19:44:27.030718] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-06T19:44:27.260419] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-06T19:44:27.260531] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-06T19:44:27.260832] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-06T19:44:27.260894] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-06T19:44:27.261323] [DEBUG] [LOCAL ] JOF: Trimmed 9529 records to 6919 (keeping 200 days of data) [2025-10-06T19:44:27.302614] [DEBUG] [LOCAL ] JOF: Primary data saved (6919 records). [2025-10-06T19:44:27.302770] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-06T19:44:27.302874] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOF took 19.7s. Estimated remaining: 2h 49m 53s. Rate: 7.1 symbols/min [2025-10-06T19:44:27.472026] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:44:27.507268] [DEBUG] [LOCAL ] JQC: Loaded 34960 existing records from primary storage. [2025-10-06T19:44:27.507616] [INFO ] [MAIN ] JQC: Loaded 34960 existing records. [2025-10-06T19:44:27.687242] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:44:27.687509] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-06T19:44:27.687583] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-06T19:44:27.689796] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-06T19:44:27.689858] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-06T19:44:27.839136] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-06T19:44:28.079032] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:44:28.625585] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-06T19:44:28.848442] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T19:44:29.294670] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T19:44:29.425474] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-06T19:44:30.225615] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-06T19:44:30.789429] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T19:44:30.891417] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-06T19:44:30.895081] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-06T19:44:30.895253] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-06T19:44:31.037862] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-06T19:44:31.293972] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-06T19:44:31.294065] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-06T19:44:31.295113] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-06T19:44:31.295176] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-06T19:44:31.296761] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53799 (keeping 200 days of data) [2025-10-06T19:44:31.617551] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T19:44:31.651838] [DEBUG] [LOCAL ] JOBY: Primary data saved (53799 records). [2025-10-06T19:44:31.652037] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-06T19:44:31.653429] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOBY took 49.3s. Estimated remaining: 2h 49m 40s. Rate: 7.1 symbols/min [2025-10-06T19:44:31.823987] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:44:31.825607] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-06T19:44:31.844796] [DEBUG] [LOCAL ] JRI: Loaded 15135 existing records from primary storage. [2025-10-06T19:44:31.845097] [INFO ] [MAIN ] JRI: Loaded 15135 existing records. [2025-10-06T19:44:32.026586] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:44:32.026917] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-06T19:44:32.026965] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-06T19:44:32.028006] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-06T19:44:32.028066] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-06T19:44:32.395569] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:44:32.555940] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T19:44:32.625588] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-06T19:44:33.393516] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-06T19:44:33.425495] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-06T19:44:34.078071] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-06T19:44:34.225549] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-06T19:44:34.500687] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T19:44:35.025538] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-06T19:44:35.640574] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T19:44:35.825548] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-06T19:44:36.404794] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T19:44:36.421684] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T19:44:36.625524] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-06T19:44:37.425577] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-06T19:44:37.865006] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T19:44:38.225551] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-06T19:44:38.351190] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T19:44:39.025507] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-06T19:44:39.429326] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T19:44:39.825546] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-06T19:44:40.008918] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T19:44:40.625557] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-06T19:44:41.283861] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T19:44:41.425572] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-06T19:44:42.225556] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-06T19:44:42.600574] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T19:44:42.603324] [INFO ] [REMOTE ] JPC: Full fetch complete (55586 records). [2025-10-06T19:44:42.603447] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-06T19:44:43.030952] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-06T19:44:43.069101] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-06T19:44:43.088289] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-06T19:44:43.097878] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-06T19:44:43.100457] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-06T19:44:43.097703] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-06T19:44:43.100791] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-06T19:44:43.113714] [DEBUG] [LOCAL ] JPC: Trimmed 55586 records to 37181 (keeping 200 days of data) [2025-10-06T19:44:43.330892] [DEBUG] [LOCAL ] JPC: Primary data saved (37181 records). [2025-10-06T19:44:43.331073] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-06T19:44:43.331161] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JPC took 32.6s. Estimated remaining: 2h 49m 35s. Rate: 7.1 symbols/min [2025-10-06T19:44:43.497923] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:44:43.510156] [DEBUG] [LOCAL ] JRS: Loaded 11561 existing records from primary storage. [2025-10-06T19:44:43.510412] [INFO ] [MAIN ] JRS: Loaded 11561 existing records. [2025-10-06T19:44:43.686056] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:44:43.686338] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-06T19:44:43.686387] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-06T19:44:43.687283] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-06T19:44:43.687343] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-06T19:44:43.834028] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-06T19:44:44.053223] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:44:44.425841] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T19:44:44.625562] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-06T19:44:45.283101] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-06T19:44:45.425538] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-06T19:44:46.225507] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-06T19:44:46.338749] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-06T19:44:46.774105] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T19:44:47.025537] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-06T19:44:47.210955] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T19:44:47.825557] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-06T19:44:48.334628] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T19:44:48.625506] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-06T19:44:48.703304] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T19:44:49.425534] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-06T19:44:49.684403] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T19:44:50.225535] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-06T19:44:50.348055] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T19:44:51.025603] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-06T19:44:51.670711] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T19:44:51.825535] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-06T19:44:52.625549] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-06T19:44:52.771509] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T19:44:52.773170] [INFO ] [REMOTE ] JRI: Full fetch complete (23323 records). [2025-10-06T19:44:52.773254] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-06T19:44:53.170669] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-06T19:44:53.170845] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-06T19:44:53.171729] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-06T19:44:53.171816] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-06T19:44:53.172897] [DEBUG] [LOCAL ] JRI: Trimmed 23323 records to 15023 (keeping 200 days of data) [2025-10-06T19:44:53.293238] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-06T19:44:53.317415] [DEBUG] [LOCAL ] JRI: Primary data saved (15023 records). [2025-10-06T19:44:53.317620] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-06T19:44:53.317787] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JRI took 21.7s. Estimated remaining: 2h 49m 28s. Rate: 7.1 symbols/min [2025-10-06T19:44:53.430715] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-06T19:44:53.500131] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:44:53.554460] [DEBUG] [LOCAL ] JXN: Loaded 46137 existing records from primary storage. [2025-10-06T19:44:53.554893] [INFO ] [MAIN ] JXN: Loaded 46137 existing records. [2025-10-06T19:44:53.813847] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:44:53.814507] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-06T19:44:53.814804] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-06T19:44:53.815352] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-06T19:44:53.815417] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-06T19:44:54.002595] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T19:44:54.232929] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-06T19:44:54.270824] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:44:54.281939] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T19:44:55.025534] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-06T19:44:55.487542] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-06T19:44:55.825513] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-06T19:44:56.432917] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-06T19:44:56.620145] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T19:44:56.625467] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-06T19:44:57.403248] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T19:44:57.425513] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-06T19:44:58.225542] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-06T19:44:58.636707] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T19:44:58.640764] [INFO ] [REMOTE ] JQC: Full fetch complete (49485 records). [2025-10-06T19:44:58.640979] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-06T19:44:59.032104] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-06T19:44:59.062230] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-06T19:44:59.062100] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T19:44:59.062601] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-06T19:44:59.067982] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-06T19:44:59.068156] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-06T19:44:59.069759] [DEBUG] [LOCAL ] JQC: Trimmed 49485 records to 34608 (keeping 200 days of data) [2025-10-06T19:44:59.285207] [DEBUG] [LOCAL ] JQC: Primary data saved (34608 records). [2025-10-06T19:44:59.285411] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-06T19:44:59.285571] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JQC took 32.0s. Estimated remaining: 2h 49m 17s. Rate: 7.1 symbols/min [2025-10-06T19:44:59.458729] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:44:59.514755] [DEBUG] [LOCAL ] K: Loaded 50735 existing records from primary storage. [2025-10-06T19:44:59.515184] [INFO ] [MAIN ] K: Loaded 50735 existing records. [2025-10-06T19:44:59.694370] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:44:59.694604] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-06T19:44:59.694681] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-06T19:44:59.696072] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-06T19:44:59.696133] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-06T19:44:59.840916] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-06T19:45:00.071198] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:45:00.600961] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T19:45:00.625486] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-06T19:45:01.425589] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-06T19:45:01.858312] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-06T19:45:02.225525] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-06T19:45:02.242953] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T19:45:02.344369] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T19:45:03.025605] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-06T19:45:03.808607] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T19:45:03.825462] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-06T19:45:04.481320] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-06T19:45:04.625515] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-06T19:45:04.658196] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-06T19:45:05.425551] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-06T19:45:06.225574] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-06T19:45:06.289786] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T19:45:07.025679] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-06T19:45:07.242620] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T19:45:07.825634] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-06T19:45:07.994146] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T19:45:08.625533] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-06T19:45:08.792043] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-06T19:45:09.359457] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T19:45:09.425582] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-06T19:45:10.041139] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T19:45:10.225576] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-06T19:45:11.022229] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T19:45:11.025728] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-06T19:45:11.590779] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-06T19:45:11.825502] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-06T19:45:11.888797] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-06T19:45:12.625570] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-06T19:45:13.335100] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T19:45:13.425558] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-06T19:45:14.090288] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-06T19:45:14.225599] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-06T19:45:15.025508] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-06T19:45:15.641089] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-06T19:45:15.825502] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-06T19:45:16.016021] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T19:45:16.625569] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-06T19:45:16.693454] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T19:45:16.695358] [INFO ] [REMOTE ] JRS: Full fetch complete (16412 records). [2025-10-06T19:45:16.695464] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-06T19:45:17.099054] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-06T19:45:17.099233] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-06T19:45:17.099767] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-06T19:45:17.099845] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-06T19:45:17.100550] [DEBUG] [LOCAL ] JRS: Trimmed 16412 records to 11438 (keeping 200 days of data) [2025-10-06T19:45:17.168022] [DEBUG] [LOCAL ] JRS: Primary data saved (11438 records). [2025-10-06T19:45:17.168189] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-06T19:45:17.168277] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JRS took 33.8s. Estimated remaining: 2h 49m 19s. Rate: 7.1 symbols/min [2025-10-06T19:45:17.345916] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:45:17.361624] [DEBUG] [LOCAL ] KAI: Loaded 13475 existing records from primary storage. [2025-10-06T19:45:17.361935] [INFO ] [MAIN ] KAI: Loaded 13475 existing records. [2025-10-06T19:45:17.427462] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-06T19:45:17.554273] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:45:17.554706] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-06T19:45:17.554789] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-06T19:45:17.555548] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-06T19:45:17.555615] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-06T19:45:17.754294] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-06T19:45:18.000586] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:45:18.032047] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T19:45:18.225573] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-06T19:45:19.025732] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-06T19:45:19.165385] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T19:45:19.825560] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-06T19:45:20.548993] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-06T19:45:20.552488] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-06T19:45:20.552679] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-06T19:45:20.630761] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-06T19:45:20.981913] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-06T19:45:20.982136] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-06T19:45:20.983258] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-06T19:45:20.983346] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-06T19:45:21.010251] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-10-06T19:45:21.016943] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-06T19:45:21.412210] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-06T19:45:21.412418] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-06T19:45:21.413366] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JPM took 57.6s. Estimated remaining: 2h 49m 6s. Rate: 7.1 symbols/min [2025-10-06T19:45:21.430845] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-06T19:45:21.565391] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T19:45:21.636445] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:45:21.672023] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-06T19:45:21.723269] [DEBUG] [LOCAL ] KAR: Loaded 40570 existing records from primary storage. [2025-10-06T19:45:21.723706] [INFO ] [MAIN ] KAR: Loaded 40570 existing records. [2025-10-06T19:45:21.916987] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:45:21.917294] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-06T19:45:21.917347] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-06T19:45:21.918596] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-06T19:45:21.918700] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-06T19:45:22.230743] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-06T19:45:22.311902] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:45:23.001078] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T19:45:23.025499] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-06T19:45:23.825538] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-06T19:45:23.967804] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T19:45:24.026507] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T19:45:24.029309] [INFO ] [REMOTE ] JXN: Full fetch complete (65238 records). [2025-10-06T19:45:24.029448] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-06T19:45:24.440428] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-06T19:45:24.440550] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-06T19:45:24.441561] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-06T19:45:24.441686] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-06T19:45:24.443198] [DEBUG] [LOCAL ] JXN: Trimmed 65238 records to 45324 (keeping 200 days of data) [2025-10-06T19:45:24.633033] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-06T19:45:24.646489] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T19:45:24.747374] [DEBUG] [LOCAL ] JXN: Primary data saved (45324 records). [2025-10-06T19:45:24.747553] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-06T19:45:24.747679] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JXN took 31.4s. Estimated remaining: 2h 48m 52s. Rate: 7.1 symbols/min [2025-10-06T19:45:24.915405] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:45:24.945102] [DEBUG] [LOCAL ] KB: Loaded 24181 existing records from primary storage. [2025-10-06T19:45:24.945522] [INFO ] [MAIN ] KB: Loaded 24181 existing records. [2025-10-06T19:45:25.152519] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:45:25.153181] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-06T19:45:25.153248] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-06T19:45:25.153956] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-06T19:45:25.154031] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-06T19:45:25.433834] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-06T19:45:25.556588] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:45:26.225582] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-06T19:45:26.341008] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T19:45:26.411120] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T19:45:27.025502] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-06T19:45:27.174084] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T19:45:27.825523] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-06T19:45:28.362946] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T19:45:28.625539] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-06T19:45:28.756778] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T19:45:29.425603] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-06T19:45:30.123910] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T19:45:30.225501] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-06T19:45:31.025492] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-06T19:45:31.100340] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T19:45:31.248419] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T19:45:31.825520] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-06T19:45:32.156728] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T19:45:32.625621] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-06T19:45:32.985489] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T19:45:33.425541] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-06T19:45:33.777885] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T19:45:34.225582] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-06T19:45:34.854757] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-06T19:45:35.025482] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-06T19:45:35.420633] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T19:45:35.825536] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-06T19:45:36.453383] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T19:45:36.625598] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-06T19:45:36.956444] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T19:45:37.425540] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-06T19:45:38.020515] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T19:45:38.225585] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-06T19:45:39.025566] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-06T19:45:39.174111] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T19:45:39.565921] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T19:45:39.825502] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-06T19:45:40.170360] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T19:45:40.625581] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-06T19:45:41.300470] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T19:45:41.425545] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-06T19:45:41.750129] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-06T19:45:41.753305] [INFO ] [REMOTE ] K: Full fetch complete (72123 records). [2025-10-06T19:45:41.753512] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-06T19:45:42.146664] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-06T19:45:42.146787] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-06T19:45:42.147808] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-06T19:45:42.147873] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-06T19:45:42.149371] [DEBUG] [LOCAL ] K: Trimmed 72123 records to 50092 (keeping 200 days of data) [2025-10-06T19:45:42.241402] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-06T19:45:42.478416] [DEBUG] [LOCAL ] K: Primary data saved (50092 records). [2025-10-06T19:45:42.478602] [INFO ] [MAIN ] K: Full history saved. [2025-10-06T19:45:42.478743] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. K took 43.2s. Estimated remaining: 2h 48m 53s. Rate: 7.1 symbols/min [2025-10-06T19:45:42.653965] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:45:42.680831] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T19:45:42.707364] [DEBUG] [LOCAL ] KBDC: Loaded 21640 existing records from primary storage. [2025-10-06T19:45:42.707700] [INFO ] [MAIN ] KBDC: Loaded 21640 existing records. [2025-10-06T19:45:42.886479] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:45:42.886786] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-06T19:45:42.886835] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-06T19:45:42.887304] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-06T19:45:42.887363] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-06T19:45:43.025610] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-06T19:45:43.263333] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:45:43.264565] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T19:45:43.825513] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-06T19:45:44.525947] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T19:45:44.623492] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T19:45:44.626976] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-06T19:45:45.425557] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-06T19:45:45.795333] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T19:45:45.797893] [INFO ] [REMOTE ] KAR: Full fetch complete (56863 records). [2025-10-06T19:45:45.797985] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-06T19:45:46.181713] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-06T19:45:46.181857] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-06T19:45:46.182846] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-06T19:45:46.182911] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-06T19:45:46.184174] [DEBUG] [LOCAL ] KAR: Trimmed 56863 records to 40093 (keeping 200 days of data) [2025-10-06T19:45:46.234938] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-06T19:45:46.441525] [DEBUG] [LOCAL ] KAR: Primary data saved (40093 records). [2025-10-06T19:45:46.441710] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-06T19:45:46.441841] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. KAR took 25.0s. Estimated remaining: 2h 48m 40s. Rate: 7.1 symbols/min [2025-10-06T19:45:46.629983] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:45:46.631299] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T19:45:46.690187] [DEBUG] [LOCAL ] KBH: Loaded 49576 existing records from primary storage. [2025-10-06T19:45:46.690624] [INFO ] [MAIN ] KBH: Loaded 49576 existing records. [2025-10-06T19:45:46.868784] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:45:46.869047] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-06T19:45:46.869095] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-06T19:45:46.870479] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-06T19:45:46.870539] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-06T19:45:47.030683] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-06T19:45:47.243663] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:45:47.253158] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-06T19:45:47.825527] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-06T19:45:47.950913] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-06T19:45:48.625530] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-06T19:45:49.425524] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-06T19:45:49.537290] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T19:45:49.917431] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-06T19:45:50.225480] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T19:45:50.225610] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-06T19:45:51.025530] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-06T19:45:51.719353] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T19:45:51.825496] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-06T19:45:51.972541] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T19:45:52.625542] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-06T19:45:53.410355] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T19:45:53.425473] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-06T19:45:53.535150] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-06T19:45:54.225536] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-06T19:45:55.025496] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-06T19:45:55.146934] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T19:45:55.262012] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T19:45:55.813990] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-06T19:45:55.825480] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-06T19:45:56.570268] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T19:45:56.571450] [INFO ] [REMOTE ] KAI: Full fetch complete (18839 records). [2025-10-06T19:45:56.571523] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-06T19:45:56.631143] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-06T19:45:56.934437] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-06T19:45:56.934525] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-06T19:45:56.934956] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-06T19:45:56.935016] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-06T19:45:56.935555] [DEBUG] [LOCAL ] KAI: Trimmed 18839 records to 13299 (keeping 200 days of data) [2025-10-06T19:45:57.017126] [DEBUG] [LOCAL ] KAI: Primary data saved (13299 records). [2025-10-06T19:45:57.017285] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-06T19:45:57.017370] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. KAI took 39.8s. Estimated remaining: 2h 48m 34s. Rate: 7.1 symbols/min [2025-10-06T19:45:57.182986] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:45:57.227914] [DEBUG] [LOCAL ] KBR: Loaded 48697 existing records from primary storage. [2025-10-06T19:45:57.228247] [INFO ] [MAIN ] KBR: Loaded 48697 existing records. [2025-10-06T19:45:57.405251] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:45:57.405898] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-06T19:45:57.405950] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-06T19:45:57.407328] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-06T19:45:57.407388] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-06T19:45:57.430673] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-06T19:45:57.769349] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:45:57.805463] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-06T19:45:58.225508] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-06T19:45:58.307575] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-06T19:45:59.025557] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-06T19:45:59.841847] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-06T19:45:59.847265] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T19:46:00.178011] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T19:46:00.625614] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-06T19:46:01.425526] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-06T19:46:01.592916] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T19:46:01.865189] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-06T19:46:02.225531] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-06T19:46:02.629487] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T19:46:03.025611] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-06T19:46:03.827453] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-06T19:46:03.830933] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T19:46:03.983224] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T19:46:04.625531] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-06T19:46:05.125684] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T19:46:05.425719] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-06T19:46:05.667990] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-06T19:46:06.146001] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-06T19:46:06.147533] [INFO ] [REMOTE ] KB: Full fetch complete (33910 records). [2025-10-06T19:46:06.147695] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-06T19:46:06.230753] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-06T19:46:06.534756] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-06T19:46:06.534850] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-06T19:46:06.535571] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-06T19:46:06.535633] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-06T19:46:06.536511] [DEBUG] [LOCAL ] KB: Trimmed 33910 records to 23697 (keeping 200 days of data) [2025-10-06T19:46:06.680958] [DEBUG] [LOCAL ] KB: Primary data saved (23697 records). [2025-10-06T19:46:06.681111] [INFO ] [MAIN ] KB: Full history saved. [2025-10-06T19:46:06.681196] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KB took 41.9s. Estimated remaining: 2h 48m 26s. Rate: 7.1 symbols/min [2025-10-06T19:46:06.847285] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:46:06.905001] [DEBUG] [LOCAL ] KD: Loaded 53067 existing records from primary storage. [2025-10-06T19:46:06.905420] [INFO ] [MAIN ] KD: Loaded 53067 existing records. [2025-10-06T19:46:07.030589] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-06T19:46:07.093273] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:46:07.093502] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-06T19:46:07.093555] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-06T19:46:07.094303] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-06T19:46:07.094363] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-06T19:46:07.475107] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:46:07.524457] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-06T19:46:07.825550] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-06T19:46:08.327916] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-06T19:46:08.625623] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-06T19:46:09.384148] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T19:46:09.425476] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-06T19:46:10.107175] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T19:46:10.225597] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-06T19:46:11.025500] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-06T19:46:11.238521] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T19:46:11.825564] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-06T19:46:11.959532] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T19:46:12.625490] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-06T19:46:12.699638] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T19:46:13.403387] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T19:46:13.425484] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-06T19:46:14.225532] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-06T19:46:14.271766] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T19:46:15.032974] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-06T19:46:15.039046] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T19:46:15.401317] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T19:46:15.403596] [INFO ] [REMOTE ] KBDC: Full fetch complete (29235 records). [2025-10-06T19:46:15.403719] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-06T19:46:15.793603] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-06T19:46:15.793746] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-06T19:46:15.794489] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-06T19:46:15.794555] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-06T19:46:15.795361] [DEBUG] [LOCAL ] KBDC: Trimmed 29235 records to 21396 (keeping 200 days of data) [2025-10-06T19:46:15.848266] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-06T19:46:15.932355] [DEBUG] [LOCAL ] KBDC: Primary data saved (21396 records). [2025-10-06T19:46:15.932509] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-06T19:46:15.932593] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 33.5s. Estimated remaining: 2h 48m 19s. Rate: 7.1 symbols/min [2025-10-06T19:46:16.109933] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:46:16.118132] [DEBUG] [LOCAL ] KEN: Loaded 4758 existing records from primary storage. [2025-10-06T19:46:16.118352] [INFO ] [MAIN ] KEN: Loaded 4758 existing records. [2025-10-06T19:46:16.291341] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:46:16.291693] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-06T19:46:16.291762] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-06T19:46:16.292017] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-06T19:46:16.292094] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-06T19:46:16.636738] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-06T19:46:16.658818] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:46:16.860856] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T19:46:17.426083] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-06T19:46:17.431725] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T19:46:18.225515] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-06T19:46:18.656923] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-06T19:46:19.005047] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T19:46:19.025499] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-06T19:46:19.825523] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-06T19:46:20.109637] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-06T19:46:20.625571] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-06T19:46:20.776675] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T19:46:21.410233] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T19:46:21.413351] [INFO ] [REMOTE ] KBH: Full fetch complete (70756 records). [2025-10-06T19:46:21.413509] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-06T19:46:21.436137] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-06T19:46:21.832008] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-06T19:46:21.832209] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-06T19:46:21.833549] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-06T19:46:21.833613] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-06T19:46:21.835413] [DEBUG] [LOCAL ] KBH: Trimmed 70756 records to 48885 (keeping 200 days of data) [2025-10-06T19:46:22.135164] [DEBUG] [LOCAL ] KBH: Primary data saved (48885 records). [2025-10-06T19:46:22.135357] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-06T19:46:22.135452] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KBH took 35.7s. Estimated remaining: 2h 48m 8s. Rate: 7.1 symbols/min [2025-10-06T19:46:22.227520] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-06T19:46:22.336521] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T19:46:22.339123] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:46:22.381236] [DEBUG] [LOCAL ] KEP: Loaded 31512 existing records from primary storage. [2025-10-06T19:46:22.381562] [INFO ] [MAIN ] KEP: Loaded 31512 existing records. [2025-10-06T19:46:22.556710] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:46:22.556981] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-06T19:46:22.557027] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-06T19:46:22.557418] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-06T19:46:22.557476] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-06T19:46:22.662407] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-06T19:46:22.926186] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:46:22.958487] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T19:46:23.025485] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-06T19:46:23.598378] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-06T19:46:23.825542] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-06T19:46:24.625533] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-06T19:46:25.217575] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T19:46:25.425543] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-06T19:46:26.225507] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-06T19:46:26.701329] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-06T19:46:26.704895] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-06T19:46:27.025533] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-06T19:46:27.083799] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T19:46:27.825541] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-06T19:46:28.411566] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-06T19:46:28.625517] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-06T19:46:28.784729] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T19:46:29.365420] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T19:46:29.425501] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-06T19:46:29.774573] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-06T19:46:30.225548] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-06T19:46:31.025509] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-06T19:46:31.279420] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T19:46:31.825531] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-06T19:46:32.099280] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T19:46:32.102407] [INFO ] [REMOTE ] KBR: Full fetch complete (69845 records). [2025-10-06T19:46:32.102543] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-06T19:46:32.258870] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-06T19:46:32.522335] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-06T19:46:32.522425] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-06T19:46:32.523429] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-06T19:46:32.523493] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-06T19:46:32.524823] [DEBUG] [LOCAL ] KBR: Trimmed 69845 records to 47939 (keeping 200 days of data) [2025-10-06T19:46:32.627731] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-06T19:46:32.819638] [DEBUG] [LOCAL ] KBR: Primary data saved (47939 records). [2025-10-06T19:46:32.819982] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-06T19:46:32.820154] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KBR took 35.8s. Estimated remaining: 2h 48m 2s. Rate: 7.1 symbols/min [2025-10-06T19:46:32.996851] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:46:33.038505] [DEBUG] [LOCAL ] KEX: Loaded 38713 existing records from primary storage. [2025-10-06T19:46:33.039036] [INFO ] [MAIN ] KEX: Loaded 38713 existing records. [2025-10-06T19:46:33.215231] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:46:33.215470] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-06T19:46:33.215517] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-06T19:46:33.216554] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-06T19:46:33.216615] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-06T19:46:33.430824] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-06T19:46:33.572962] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:46:33.719903] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-06T19:46:34.225539] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-06T19:46:34.851394] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-06T19:46:35.025509] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-06T19:46:35.183751] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T19:46:35.825549] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-06T19:46:36.476454] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T19:46:36.625505] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-06T19:46:36.817490] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T19:46:37.425545] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-06T19:46:38.225505] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-06T19:46:38.332537] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T19:46:38.657578] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T19:46:39.025542] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-06T19:46:39.388983] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T19:46:39.825539] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-06T19:46:40.625547] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-06T19:46:40.662958] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T19:46:40.666012] [INFO ] [REMOTE ] KD: Full fetch complete (75687 records). [2025-10-06T19:46:40.666122] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-06T19:46:41.072693] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-06T19:46:41.072813] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-06T19:46:41.074001] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-06T19:46:41.074089] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-06T19:46:41.076026] [DEBUG] [LOCAL ] KD: Trimmed 75687 records to 52335 (keeping 200 days of data) [2025-10-06T19:46:41.187187] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T19:46:41.425612] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-06T19:46:41.425898] [DEBUG] [LOCAL ] KD: Primary data saved (52335 records). [2025-10-06T19:46:41.426109] [INFO ] [MAIN ] KD: Full history saved. [2025-10-06T19:46:41.427132] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KD took 34.7s. Estimated remaining: 2h 47m 53s. Rate: 7.1 symbols/min [2025-10-06T19:46:41.633177] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:46:41.635898] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-06T19:46:41.636148] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-06T19:46:41.637614] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T19:46:41.636780] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-06T19:46:41.637854] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-06T19:46:41.645200] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-06T19:46:41.645604] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-06T19:46:42.011385] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:46:42.117479] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-06T19:46:42.225532] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-06T19:46:43.022161] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-06T19:46:43.025461] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-06T19:46:43.567472] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T19:46:43.568279] [INFO ] [REMOTE ] KEN: Full fetch complete (5938 records). [2025-10-06T19:46:43.568367] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-06T19:46:43.830598] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-06T19:46:43.921030] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-06T19:46:43.921113] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-06T19:46:43.921269] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-06T19:46:43.921306] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-06T19:46:43.921701] [DEBUG] [LOCAL ] KEN: Trimmed 5938 records to 4690 (keeping 200 days of data) [2025-10-06T19:46:43.948439] [DEBUG] [LOCAL ] KEN: Primary data saved (4690 records). [2025-10-06T19:46:43.948517] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-06T19:46:43.948591] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KEN took 28.0s. Estimated remaining: 2h 47m 39s. Rate: 7.1 symbols/min [2025-10-06T19:46:44.117997] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:46:44.165156] [DEBUG] [LOCAL ] KEYS: Loaded 43769 existing records from primary storage. [2025-10-06T19:46:44.165550] [INFO ] [MAIN ] KEYS: Loaded 43769 existing records. [2025-10-06T19:46:44.357856] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:46:44.358155] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-06T19:46:44.358207] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-06T19:46:44.358511] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-06T19:46:44.358569] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-06T19:46:44.630734] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-06T19:46:44.738850] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:46:45.368059] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T19:46:45.425479] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-06T19:46:46.225507] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-06T19:46:46.500177] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-06T19:46:46.771606] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T19:46:47.025558] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-06T19:46:47.362459] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T19:46:47.825550] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-06T19:46:48.406615] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T19:46:48.625516] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-06T19:46:49.257756] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T19:46:49.425484] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-06T19:46:49.881584] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T19:46:50.225535] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-06T19:46:50.451382] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T19:46:51.025538] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-06T19:46:51.600509] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T19:46:51.825523] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-06T19:46:52.483508] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T19:46:52.625542] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-06T19:46:53.425494] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-06T19:46:53.640554] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T19:46:53.689957] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T19:46:54.225529] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-06T19:46:55.025078] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T19:46:55.033409] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-06T19:46:55.831358] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-06T19:46:55.837121] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T19:46:56.398951] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T19:46:56.400955] [INFO ] [REMOTE ] KEP: Full fetch complete (41847 records). [2025-10-06T19:46:56.401065] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-06T19:46:56.630755] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-06T19:46:56.775117] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-06T19:46:56.775212] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-06T19:46:56.776011] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-06T19:46:56.776073] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-06T19:46:56.776971] [DEBUG] [LOCAL ] KEP: Trimmed 41847 records to 31302 (keeping 200 days of data) [2025-10-06T19:46:56.957296] [DEBUG] [LOCAL ] KEP: Primary data saved (31302 records). [2025-10-06T19:46:56.957464] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-06T19:46:56.957554] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KEP took 34.8s. Estimated remaining: 2h 47m 35s. Rate: 7.1 symbols/min [2025-10-06T19:46:57.135698] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:46:57.140957] [DEBUG] [LOCAL ] KF: Loaded 2509 existing records from primary storage. [2025-10-06T19:46:57.141155] [INFO ] [MAIN ] KF: Loaded 2509 existing records. [2025-10-06T19:46:57.320573] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:46:57.320920] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-06T19:46:57.321069] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-06T19:46:57.321369] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-06T19:46:57.321493] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-06T19:46:57.435191] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-06T19:46:57.462700] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T19:46:57.712109] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:46:58.149483] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T19:46:58.225485] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-06T19:46:59.025564] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-06T19:46:59.295227] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T19:46:59.429016] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T19:46:59.825520] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-06T19:47:00.585200] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T19:47:00.625477] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-06T19:47:01.425537] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-06T19:47:01.630047] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T19:47:02.028991] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T19:47:02.031572] [INFO ] [REMOTE ] KEX: Full fetch complete (55892 records). [2025-10-06T19:47:02.031688] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-06T19:47:02.235677] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-06T19:47:02.427127] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-06T19:47:02.427235] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-06T19:47:02.428193] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-06T19:47:02.428262] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-06T19:47:02.429680] [DEBUG] [LOCAL ] KEX: Trimmed 55892 records to 38317 (keeping 200 days of data) [2025-10-06T19:47:02.665439] [DEBUG] [LOCAL ] KEX: Primary data saved (38317 records). [2025-10-06T19:47:02.665679] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-06T19:47:02.665844] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEX took 29.8s. Estimated remaining: 2h 47m 24s. Rate: 7.1 symbols/min [2025-10-06T19:47:02.849927] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:47:02.874120] [DEBUG] [LOCAL ] KFRC: Loaded 19888 existing records from primary storage. [2025-10-06T19:47:02.874519] [INFO ] [MAIN ] KFRC: Loaded 19888 existing records. [2025-10-06T19:47:03.033528] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-06T19:47:03.075906] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:47:03.076196] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-06T19:47:03.076251] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-06T19:47:03.076508] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-06T19:47:03.076569] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-06T19:47:03.476455] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:47:03.513825] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-06T19:47:03.804157] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-06T19:47:03.825548] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-06T19:47:04.001889] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T19:47:04.625540] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-06T19:47:05.161820] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-06T19:47:05.425536] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-06T19:47:05.621799] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T19:47:06.225571] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-06T19:47:06.393192] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T19:47:07.025548] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-06T19:47:07.423687] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T19:47:07.481981] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-06T19:47:07.825523] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-06T19:47:08.301031] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-06T19:47:08.625568] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-06T19:47:09.061705] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-06T19:47:09.425565] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-06T19:47:10.225593] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-06T19:47:10.858519] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T19:47:11.025614] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-06T19:47:11.592559] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-06T19:47:11.825522] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-06T19:47:11.923839] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T19:47:12.457006] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-06T19:47:12.625546] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-06T19:47:13.133314] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-06T19:47:13.425498] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-06T19:47:14.225533] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-06T19:47:14.658272] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T19:47:15.025494] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-06T19:47:15.380199] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-06T19:47:15.412976] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T19:47:15.825559] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-06T19:47:16.361960] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T19:47:16.362966] [INFO ] [REMOTE ] KF: Full fetch complete (3591 records). [2025-10-06T19:47:16.363072] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-06T19:47:16.630918] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-06T19:47:16.745130] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-06T19:47:16.745227] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-06T19:47:16.745398] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-06T19:47:16.745490] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-06T19:47:16.745939] [DEBUG] [LOCAL ] KF: Trimmed 3591 records to 2381 (keeping 200 days of data) [2025-10-06T19:47:16.761200] [DEBUG] [LOCAL ] KF: Primary data saved (2381 records). [2025-10-06T19:47:16.761293] [INFO ] [MAIN ] KF: Full history saved. [2025-10-06T19:47:16.761384] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KF took 19.8s. Estimated remaining: 2h 47m 21s. Rate: 7.1 symbols/min [2025-10-06T19:47:16.943003] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:47:16.956468] [DEBUG] [LOCAL ] KFS: Loaded 8567 existing records from primary storage. [2025-10-06T19:47:16.956816] [INFO ] [MAIN ] KFS: Loaded 8567 existing records. [2025-10-06T19:47:17.150808] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:47:17.151134] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-06T19:47:17.151186] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-06T19:47:17.151410] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-06T19:47:17.151471] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-06T19:47:17.432626] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-06T19:47:17.530170] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:47:18.225515] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-06T19:47:18.260324] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T19:47:18.791701] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-06T19:47:19.025595] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-06T19:47:19.703526] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T19:47:19.787739] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T19:47:19.825468] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-06T19:47:20.625614] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-06T19:47:20.801597] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T19:47:21.425600] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-06T19:47:22.025624] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-06T19:47:22.225503] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-06T19:47:22.359718] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T19:47:22.893219] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-06T19:47:23.025484] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-06T19:47:23.825542] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-06T19:47:24.431471] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T19:47:24.536582] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T19:47:24.625544] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-06T19:47:25.216063] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-06T19:47:25.425524] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-06T19:47:26.225502] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-06T19:47:26.316202] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T19:47:27.025599] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-06T19:47:27.825520] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-06T19:47:27.888676] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T19:47:27.891896] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-06T19:47:27.892017] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-06T19:47:28.100005] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T19:47:28.104836] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-06T19:47:28.104972] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-06T19:47:28.105054] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-06T19:47:28.105164] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-06T19:47:28.105223] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-06T19:47:28.105281] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-06T19:47:28.105386] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KEY took 46.7s. Estimated remaining: 2h 47m 16s. Rate: 7.1 symbols/min [2025-10-06T19:47:28.299202] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:47:28.339236] [DEBUG] [LOCAL ] KFY: Loaded 30424 existing records from primary storage. [2025-10-06T19:47:28.339706] [INFO ] [MAIN ] KFY: Loaded 30424 existing records. [2025-10-06T19:47:28.463495] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T19:47:28.492964] [INFO ] [REMOTE ] KEYS: Full fetch complete (62806 records). [2025-10-06T19:47:28.514434] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-06T19:47:28.597571] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:47:28.598171] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-06T19:47:28.627432] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-06T19:47:28.633865] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-06T19:47:28.670406] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-06T19:47:28.681161] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-06T19:47:28.987950] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T19:47:29.274730] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-06T19:47:29.282678] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-06T19:47:29.290139] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-06T19:47:29.290386] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-06T19:47:29.300827] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-06T19:47:29.369210] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:47:29.369878] [DEBUG] [LOCAL ] KEYS: Trimmed 62806 records to 43173 (keeping 200 days of data) [2025-10-06T19:47:29.430172] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-06T19:47:29.635527] [DEBUG] [LOCAL ] KEYS: Primary data saved (43173 records). [2025-10-06T19:47:29.635709] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-06T19:47:29.635821] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KEYS took 45.7s. Estimated remaining: 2h 47m 0s. Rate: 7.1 symbols/min [2025-10-06T19:47:29.803046] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:47:29.860872] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-10-06T19:47:29.861379] [INFO ] [MAIN ] KGC: Loaded 54479 existing records. [2025-10-06T19:47:30.058837] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:47:30.059116] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-06T19:47:30.059168] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-06T19:47:30.059634] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-06T19:47:30.059732] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-06T19:47:30.248731] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-06T19:47:30.299188] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-06T19:47:30.456009] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:47:31.025514] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-06T19:47:31.401590] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T19:47:31.825554] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-06T19:47:32.404105] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T19:47:32.625541] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-06T19:47:32.668397] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T19:47:33.425592] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-06T19:47:33.768564] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T19:47:34.225501] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-06T19:47:34.532420] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T19:47:35.025596] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-06T19:47:35.281412] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T19:47:35.767275] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T19:47:35.769188] [INFO ] [REMOTE ] KFRC: Full fetch complete (25825 records). [2025-10-06T19:47:35.769273] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-06T19:47:35.833754] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-06T19:47:36.164119] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-06T19:47:36.164218] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-06T19:47:36.165287] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-06T19:47:36.165354] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-06T19:47:36.166382] [DEBUG] [LOCAL ] KFRC: Trimmed 25825 records to 19767 (keeping 200 days of data) [2025-10-06T19:47:36.294921] [DEBUG] [LOCAL ] KFRC: Primary data saved (19767 records). [2025-10-06T19:47:36.295111] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-06T19:47:36.295264] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KFRC took 33.6s. Estimated remaining: 2h 46m 50s. Rate: 7.1 symbols/min [2025-10-06T19:47:36.473363] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:47:36.521689] [DEBUG] [LOCAL ] KGS: Loaded 46368 existing records from primary storage. [2025-10-06T19:47:36.522070] [INFO ] [MAIN ] KGS: Loaded 46368 existing records. [2025-10-06T19:47:36.630587] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-06T19:47:36.687840] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T19:47:36.729191] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:47:36.729462] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-06T19:47:36.729514] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-06T19:47:36.729870] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-06T19:47:36.729937] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-06T19:47:37.095130] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:47:37.425547] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-06T19:47:38.225525] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-06T19:47:38.583423] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-06T19:47:38.911211] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T19:47:39.025544] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-06T19:47:39.220219] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T19:47:39.825576] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-06T19:47:40.575185] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T19:47:40.625515] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-06T19:47:41.133313] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-06T19:47:41.363410] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-06T19:47:41.425483] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-06T19:47:42.020279] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T19:47:42.225544] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-06T19:47:43.025578] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-06T19:47:43.825516] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-06T19:47:43.965598] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T19:47:44.174486] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T19:47:44.556611] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T19:47:44.625522] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-06T19:47:45.270845] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T19:47:45.272587] [INFO ] [REMOTE ] KFS: Full fetch complete (10638 records). [2025-10-06T19:47:45.272948] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-06T19:47:45.433040] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-06T19:47:45.699367] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-06T19:47:45.699472] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-06T19:47:45.699846] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-06T19:47:45.699913] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-06T19:47:45.700844] [DEBUG] [LOCAL ] KFS: Trimmed 10638 records to 8470 (keeping 200 days of data) [2025-10-06T19:47:45.759408] [DEBUG] [LOCAL ] KFS: Primary data saved (8470 records). [2025-10-06T19:47:45.759600] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-06T19:47:45.759756] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 29.0s. Estimated remaining: 2h 46m 42s. Rate: 7.1 symbols/min [2025-10-06T19:47:46.006440] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:47:46.072161] [DEBUG] [LOCAL ] KIM: Loaded 53806 existing records from primary storage. [2025-10-06T19:47:46.072713] [INFO ] [MAIN ] KIM: Loaded 53806 existing records. [2025-10-06T19:47:46.230740] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-06T19:47:46.349341] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:47:46.349914] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-06T19:47:46.349987] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-06T19:47:46.350345] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-06T19:47:46.350421] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-06T19:47:46.762836] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:47:47.025533] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-06T19:47:47.085106] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-06T19:47:47.423480] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T19:47:47.825512] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-06T19:47:48.625490] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-06T19:47:48.831267] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T19:47:49.262398] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T19:47:49.425493] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-06T19:47:49.665268] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T19:47:50.225560] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-06T19:47:51.025525] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-06T19:47:51.681469] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-06T19:47:51.735475] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T19:47:51.825514] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-06T19:47:52.332847] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T19:47:52.625533] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-06T19:47:53.289804] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T19:47:53.425509] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-06T19:47:54.225562] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-06T19:47:54.877715] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-06T19:47:54.930352] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T19:47:55.025577] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-06T19:47:55.825514] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-06T19:47:55.888395] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T19:47:55.956309] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T19:47:56.625565] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-06T19:47:57.425598] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-06T19:47:57.849487] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-06T19:47:58.039789] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-06T19:47:58.225557] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-06T19:47:58.452511] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T19:47:59.025536] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-06T19:47:59.825566] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-06T19:48:00.161028] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-06T19:48:00.625524] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-06T19:48:00.664095] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T19:48:00.872274] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T19:48:00.874462] [INFO ] [REMOTE ] KFY: Full fetch complete (43364 records). [2025-10-06T19:48:00.874589] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-06T19:48:01.286883] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-06T19:48:01.286979] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-06T19:48:01.291339] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-06T19:48:01.291441] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-06T19:48:01.292616] [DEBUG] [LOCAL ] KFY: Trimmed 43364 records to 30008 (keeping 200 days of data) [2025-10-06T19:48:01.443273] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-06T19:48:01.481339] [DEBUG] [LOCAL ] KFY: Primary data saved (30008 records). [2025-10-06T19:48:01.481507] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-06T19:48:01.481594] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFY took 33.4s. Estimated remaining: 2h 46m 41s. Rate: 7.1 symbols/min [2025-10-06T19:48:01.688718] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:48:01.719005] [DEBUG] [LOCAL ] KIO: Loaded 21612 existing records from primary storage. [2025-10-06T19:48:01.719319] [INFO ] [MAIN ] KIO: Loaded 21612 existing records. [2025-10-06T19:48:01.915404] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:48:01.915855] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-06T19:48:01.915982] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-06T19:48:01.916341] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-06T19:48:01.916454] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-06T19:48:02.172440] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T19:48:02.237046] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-06T19:48:02.322991] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:48:03.025551] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-06T19:48:03.188608] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T19:48:03.825563] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-06T19:48:03.943911] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T19:48:04.376145] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-06T19:48:04.625617] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-06T19:48:05.260413] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-06T19:48:05.425555] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-06T19:48:06.225609] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-06T19:48:06.551507] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-06T19:48:07.025548] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-06T19:48:07.243163] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T19:48:07.328872] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T19:48:07.825540] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-06T19:48:08.625488] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-06T19:48:09.170128] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-06T19:48:09.425509] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-06T19:48:09.480134] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T19:48:09.845536] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T19:48:09.848299] [INFO ] [REMOTE ] KGS: Full fetch complete (66358 records). [2025-10-06T19:48:09.848410] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-06T19:48:10.256615] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-06T19:48:10.279759] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-06T19:48:10.279919] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-06T19:48:10.280959] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-06T19:48:10.281024] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-06T19:48:10.282397] [DEBUG] [LOCAL ] KGS: Trimmed 66358 records to 45788 (keeping 200 days of data) [2025-10-06T19:48:10.562248] [DEBUG] [LOCAL ] KGS: Primary data saved (45788 records). [2025-10-06T19:48:10.562447] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-06T19:48:10.562555] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KGS took 34.3s. Estimated remaining: 2h 46m 33s. Rate: 7.1 symbols/min [2025-10-06T19:48:10.734864] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:48:10.788172] [DEBUG] [LOCAL ] KKR: Loaded 54280 existing records from primary storage. [2025-10-06T19:48:10.788618] [INFO ] [MAIN ] KKR: Loaded 54280 existing records. [2025-10-06T19:48:10.966857] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:48:10.967136] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-06T19:48:10.967183] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-06T19:48:10.967491] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-06T19:48:10.967548] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-06T19:48:11.031796] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-06T19:48:11.323732] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:48:11.701485] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-06T19:48:11.706530] [INFO ] [REMOTE ] KGC: Full fetch complete (77699 records). [2025-10-06T19:48:11.706779] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-06T19:48:11.834401] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-06T19:48:12.160057] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-06T19:48:12.159903] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T19:48:12.160412] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-06T19:48:12.166567] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-06T19:48:12.167221] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-06T19:48:12.179437] [DEBUG] [LOCAL ] KGC: Trimmed 77699 records to 53699 (keeping 200 days of data) [2025-10-06T19:48:12.199109] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-06T19:48:12.547310] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-10-06T19:48:12.547825] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-06T19:48:12.547937] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGC took 42.9s. Estimated remaining: 2h 46m 18s. Rate: 7.1 symbols/min [2025-10-06T19:48:12.632545] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-06T19:48:12.735893] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:48:12.744887] [DEBUG] [LOCAL ] KKRS: Loaded 5753 existing records from primary storage. [2025-10-06T19:48:12.745175] [INFO ] [MAIN ] KKRS: Loaded 5753 existing records. [2025-10-06T19:48:12.928943] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:48:12.929250] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-06T19:48:12.929298] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-06T19:48:12.929872] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-06T19:48:12.929933] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-06T19:48:13.288813] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:48:13.425556] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-06T19:48:13.842188] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-06T19:48:14.073251] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-06T19:48:14.225501] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-06T19:48:14.447759] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T19:48:15.025590] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-06T19:48:15.825549] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-06T19:48:15.857340] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T19:48:16.625494] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-06T19:48:16.824061] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T19:48:16.950017] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T19:48:17.425524] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-06T19:48:18.225582] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-06T19:48:18.277916] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T19:48:18.740863] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T19:48:18.883305] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-06T19:48:19.025543] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-06T19:48:19.825528] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-06T19:48:20.223873] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T19:48:20.625563] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-06T19:48:21.425549] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-06T19:48:21.763067] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T19:48:21.975507] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-06T19:48:22.225493] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-06T19:48:22.585577] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-06T19:48:22.819775] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-06T19:48:23.025575] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-06T19:48:23.825522] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-06T19:48:24.369352] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-06T19:48:24.625518] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-06T19:48:25.013824] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-06T19:48:25.042754] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-06T19:48:25.425607] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-06T19:48:26.225513] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-06T19:48:26.346598] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T19:48:27.025538] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-06T19:48:27.506829] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T19:48:27.510144] [INFO ] [REMOTE ] KIM: Full fetch complete (76834 records). [2025-10-06T19:48:27.510270] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-06T19:48:27.623598] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T19:48:27.830671] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-06T19:48:27.919982] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-06T19:48:27.920080] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-06T19:48:27.921172] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-06T19:48:27.921241] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-06T19:48:27.923470] [DEBUG] [LOCAL ] KIM: Trimmed 76834 records to 53032 (keeping 200 days of data) [2025-10-06T19:48:28.253033] [DEBUG] [LOCAL ] KIM: Primary data saved (53032 records). [2025-10-06T19:48:28.253209] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-06T19:48:28.253332] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIM took 42.5s. Estimated remaining: 2h 46m 17s. Rate: 7.1 symbols/min [2025-10-06T19:48:28.429328] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:48:28.429532] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-06T19:48:28.429569] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-06T19:48:28.429709] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-06T19:48:28.429760] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-06T19:48:28.429802] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-06T19:48:28.429833] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-06T19:48:28.637811] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-06T19:48:28.789876] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:48:29.425501] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-06T19:48:29.664008] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T19:48:29.664348] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-06T19:48:29.664456] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:48:29.664564] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-06T19:48:29.664671] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:48:29.664765] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-06T19:48:29.664853] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-06T19:48:29.664890] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-06T19:48:29.664948] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-06T19:48:29.665020] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KKRT took 1.4s. Estimated remaining: 2h 46m 2s. Rate: 7.1 symbols/min [2025-10-06T19:48:29.882115] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:48:29.913958] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-06T19:48:29.913810] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-06T19:48:29.919639] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-06T19:48:29.920582] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-06T19:48:29.920749] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-06T19:48:29.921226] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-06T19:48:29.922887] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-06T19:48:29.922946] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-06T19:48:30.230611] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-06T19:48:30.316321] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:48:31.025561] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-06T19:48:31.215035] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T19:48:31.215916] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-06T19:48:31.216023] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:48:31.216080] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-06T19:48:31.216146] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:48:31.216232] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-06T19:48:31.216321] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-06T19:48:31.216364] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-06T19:48:31.216430] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-06T19:48:31.216518] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KLAR took 1.6s. Estimated remaining: 2h 45m 46s. Rate: 7.1 symbols/min [2025-10-06T19:48:31.387289] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:48:31.403464] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-06T19:48:31.441130] [DEBUG] [LOCAL ] KLC: Loaded 37278 existing records from primary storage. [2025-10-06T19:48:31.441478] [INFO ] [MAIN ] KLC: Loaded 37278 existing records. [2025-10-06T19:48:31.617327] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:48:31.617581] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-06T19:48:31.617629] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-06T19:48:31.617960] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-06T19:48:31.618017] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-06T19:48:31.830915] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-06T19:48:31.981432] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:48:32.403549] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-06T19:48:32.625537] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-06T19:48:33.425531] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-06T19:48:34.128682] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-06T19:48:34.225563] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-06T19:48:34.812738] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T19:48:35.025505] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-06T19:48:35.825493] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-06T19:48:36.220369] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T19:48:36.249169] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-06T19:48:36.272151] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T19:48:36.625537] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-06T19:48:37.425501] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-06T19:48:37.647301] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T19:48:38.225546] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-06T19:48:38.587361] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T19:48:39.025537] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-06T19:48:39.173996] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T19:48:39.175847] [INFO ] [REMOTE ] KIO: Full fetch complete (31433 records). [2025-10-06T19:48:39.175936] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-06T19:48:39.557669] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-06T19:48:39.557771] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-06T19:48:39.558605] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-06T19:48:39.558795] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-06T19:48:39.563430] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T19:48:39.565940] [DEBUG] [LOCAL ] KIO: Trimmed 31433 records to 21360 (keeping 200 days of data) [2025-10-06T19:48:39.693098] [DEBUG] [LOCAL ] KIO: Primary data saved (21360 records). [2025-10-06T19:48:39.693252] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-06T19:48:39.693334] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KIO took 38.2s. Estimated remaining: 2h 45m 38s. Rate: 7.1 symbols/min [2025-10-06T19:48:39.833547] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-06T19:48:39.866427] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:48:39.866639] [DEBUG] [LOCAL ] KMI: No existing data file found in primary storage. [2025-10-06T19:48:39.866726] [WARN ] [MAIN ] KMI: No existing data found, performing full refresh instead. [2025-10-06T19:48:39.866861] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-06T19:48:39.866910] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-06T19:48:39.866978] [DEBUG] [LOCAL ] KMI: No primary data file found to delete. [2025-10-06T19:48:39.867012] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-06T19:48:40.214521] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:48:40.266613] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-06T19:48:40.625600] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-06T19:48:41.425590] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-06T19:48:41.950587] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T19:48:41.951422] [INFO ] [REMOTE ] KKRS: Full fetch complete (7816 records). [2025-10-06T19:48:41.951492] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-06T19:48:42.230529] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-06T19:48:42.325783] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-06T19:48:42.325941] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-06T19:48:42.326194] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-06T19:48:42.326269] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-06T19:48:42.326980] [DEBUG] [LOCAL ] KKRS: Trimmed 7816 records to 5713 (keeping 200 days of data) [2025-10-06T19:48:42.399050] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T19:48:42.402962] [DEBUG] [LOCAL ] KKRS: Primary data saved (5713 records). [2025-10-06T19:48:42.415102] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-06T19:48:42.415418] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KKRS took 29.9s. Estimated remaining: 2h 45m 24s. Rate: 7.1 symbols/min [2025-10-06T19:48:43.025576] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-06T19:48:43.825498] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-06T19:48:44.288608] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T19:48:44.345360] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-06T19:48:44.625487] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-06T19:48:45.425571] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-06T19:48:45.847498] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-06T19:48:46.225713] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-06T19:48:46.732538] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-06T19:48:46.788767] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-06T19:48:47.025551] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-06T19:48:47.825506] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-06T19:48:47.966064] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-06T19:48:47.970938] [INFO ] [REMOTE ] KKR: Full fetch complete (77450 records). [2025-10-06T19:48:47.971219] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-06T19:48:48.384421] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-06T19:48:48.384551] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-06T19:48:48.386103] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-06T19:48:48.386194] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-06T19:48:48.388520] [DEBUG] [LOCAL ] KKR: Trimmed 77450 records to 53502 (keeping 200 days of data) [2025-10-06T19:48:48.760716] [DEBUG] [LOCAL ] KKR: Primary data saved (53502 records). [2025-10-06T19:48:48.760961] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-06T19:48:48.762164] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKR took 38.2s. Estimated remaining: 2h 45m 13s. Rate: 7.1 symbols/min [2025-10-06T19:48:48.983320] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-06T19:48:48.995291] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-06T19:48:49.114408] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-06T19:48:49.425589] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-06T19:48:50.624532] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T19:48:50.632138] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-06T19:48:50.943921] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-06T19:48:51.025495] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-06T19:48:51.952227] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T19:48:51.959956] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-06T19:48:53.105799] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-06T19:48:53.117323] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-06T19:48:53.356100] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-06T19:48:53.425513] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-06T19:48:54.762865] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T19:48:54.771863] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-06T19:48:55.079468] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-06T19:48:55.094923] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-06T19:48:55.989265] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T19:48:55.993830] [INFO ] [REMOTE ] KLC: Full fetch complete (50757 records). [2025-10-06T19:48:55.994092] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-06T19:48:56.424816] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-06T19:48:56.425005] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-06T19:48:56.427142] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-06T19:48:56.427222] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-06T19:48:56.428970] [DEBUG] [LOCAL ] KLC: Trimmed 50757 records to 36821 (keeping 200 days of data) [2025-10-06T19:48:56.664194] [DEBUG] [LOCAL ] KLC: Primary data saved (36821 records). [2025-10-06T19:48:56.664351] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-06T19:48:56.664440] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KLC took 25.4s. Estimated remaining: 2h 45m 4s. Rate: 7.1 symbols/min [2025-10-06T19:48:56.916190] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T19:48:56.927368] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-06T19:48:58.994946] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-06T19:48:59.006738] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-06T19:49:00.606133] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T19:49:00.618120] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-06T19:49:02.506896] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T19:49:02.518568] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-06T19:49:04.339190] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-06T19:49:04.342244] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-06T19:49:04.342377] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-06T19:49:04.744562] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-06T19:49:04.744736] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-06T19:49:04.746093] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-06T19:49:04.746200] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-06T19:49:04.748295] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-10-06T19:49:05.100544] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-06T19:49:05.100787] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-06T19:49:05.100890] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KMI took 25.4s. Estimated remaining: 2h 44m 56s. Rate: 7.1 symbols/min [2025-10-06T19:49:05.744363] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:49:05.785304] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:49:05.810515] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:49:05.813018] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:49:05.824576] [DEBUG] [LOCAL ] KMPB: Loaded 3810 existing records from primary storage. [2025-10-06T19:49:05.825145] [INFO ] [MAIN ] KMPB: Loaded 3810 existing records. [2025-10-06T19:49:06.063619] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:49:06.076400] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-06T19:49:06.078445] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-06T19:49:06.103944] [DEBUG] [LOCAL ] KMT: Loaded 43553 existing records from primary storage. [2025-10-06T19:49:06.105061] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-06T19:49:06.105950] [DEBUG] [LOCAL ] KMPR: Loaded 39497 existing records from primary storage. [2025-10-06T19:49:06.105379] [INFO ] [MAIN ] KMT: Loaded 43553 existing records. [2025-10-06T19:49:06.106082] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-06T19:49:06.112232] [INFO ] [MAIN ] KMPR: Loaded 39497 existing records. [2025-10-06T19:49:06.106741] [DEBUG] [LOCAL ] KMX: Loaded 53938 existing records from primary storage. [2025-10-06T19:49:06.200108] [INFO ] [MAIN ] KMX: Loaded 53938 existing records. [2025-10-06T19:49:06.668792] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:49:06.760674] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-06T19:49:06.702972] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:49:06.761548] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-06T19:49:06.805212] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:49:06.808545] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-06T19:49:06.833498] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-06T19:49:06.834388] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-06T19:49:06.848320] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-06T19:49:06.834505] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-06T19:49:06.858123] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-06T19:49:06.892945] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-06T19:49:06.912568] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-06T19:49:06.954914] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-06T19:49:06.902239] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-06T19:49:07.509689] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:49:07.678604] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-06T19:49:08.049285] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:49:08.099141] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-06T19:49:08.143802] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:49:08.138309] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:49:08.145020] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-06T19:49:08.145257] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-06T19:49:08.494284] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T19:49:08.495787] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-06T19:49:08.931753] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-06T19:49:08.932989] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-06T19:49:09.321570] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T19:49:09.327136] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-06T19:49:09.382793] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-06T19:49:09.384031] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-06T19:49:09.468977] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T19:49:09.477549] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-06T19:49:09.854822] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T19:49:09.865242] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-06T19:49:09.946718] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-06T19:49:09.948378] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-06T19:49:10.506833] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T19:49:10.507013] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-06T19:49:10.508745] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-06T19:49:10.535564] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-06T19:49:10.537771] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-06T19:49:10.546509] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-06T19:49:11.016363] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-06T19:49:11.017792] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-06T19:49:11.365622] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T19:49:11.375922] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-06T19:49:11.545257] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T19:49:11.555169] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-06T19:49:11.825473] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-06T19:49:11.948566] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T19:49:12.625604] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-06T19:49:12.899668] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T19:49:13.072575] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-06T19:49:13.143367] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T19:49:13.425523] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-06T19:49:14.225527] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-06T19:49:14.841466] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-06T19:49:15.025532] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-06T19:49:15.624933] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T19:49:15.800561] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T19:49:15.825540] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-06T19:49:16.625524] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-06T19:49:17.046162] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-06T19:49:17.161138] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T19:49:17.425604] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-06T19:49:18.225558] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-06T19:49:19.025544] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-06T19:49:19.235955] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T19:49:19.658004] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T19:49:19.825516] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-06T19:49:20.338264] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T19:49:20.339130] [INFO ] [REMOTE ] KMPB: Full fetch complete (5142 records). [2025-10-06T19:49:20.339201] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-06T19:49:20.626149] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-06T19:49:20.736162] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-06T19:49:20.736296] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-06T19:49:20.736475] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-06T19:49:20.736565] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-06T19:49:20.737164] [DEBUG] [LOCAL ] KMPB: Trimmed 5142 records to 3809 (keeping 200 days of data) [2025-10-06T19:49:20.783110] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T19:49:20.794853] [DEBUG] [LOCAL ] KMPB: Primary data saved (3809 records). [2025-10-06T19:49:20.795095] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-06T19:49:20.795414] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 15.7s. Estimated remaining: 2h 44m 55s. Rate: 7.1 symbols/min [2025-10-06T19:49:20.965266] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:49:21.005296] [DEBUG] [LOCAL ] KN: Loaded 39160 existing records from primary storage. [2025-10-06T19:49:21.005621] [INFO ] [MAIN ] KN: Loaded 39160 existing records. [2025-10-06T19:49:21.178990] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:49:21.179221] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-06T19:49:21.179269] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-06T19:49:21.179500] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-06T19:49:21.179557] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-06T19:49:21.430727] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-06T19:49:21.535420] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:49:22.104072] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T19:49:22.225483] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-06T19:49:22.707275] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-06T19:49:23.025593] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-06T19:49:23.761780] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T19:49:23.825542] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-06T19:49:24.431054] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T19:49:24.625524] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-06T19:49:25.338097] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T19:49:25.425490] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-06T19:49:26.152208] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-06T19:49:26.225485] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-06T19:49:26.648748] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T19:49:26.651313] [INFO ] [REMOTE ] KMPR: Full fetch complete (51793 records). [2025-10-06T19:49:26.651406] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-06T19:49:27.035572] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-06T19:49:27.040842] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-06T19:49:27.040911] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-06T19:49:27.041879] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-06T19:49:27.042040] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-06T19:49:27.043560] [DEBUG] [LOCAL ] KMPR: Trimmed 51793 records to 39148 (keeping 200 days of data) [2025-10-06T19:49:27.302225] [DEBUG] [LOCAL ] KMPR: Primary data saved (39148 records). [2025-10-06T19:49:27.302678] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-06T19:49:27.302848] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMPR took 22.2s. Estimated remaining: 2h 44m 44s. Rate: 7.1 symbols/min [2025-10-06T19:49:27.476313] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:49:27.504829] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T19:49:27.545307] [DEBUG] [LOCAL ] KNF: Loaded 36421 existing records from primary storage. [2025-10-06T19:49:27.545688] [INFO ] [MAIN ] KNF: Loaded 36421 existing records. [2025-10-06T19:49:27.721338] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:49:27.721560] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-06T19:49:27.721606] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-06T19:49:27.721866] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-06T19:49:27.721923] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-06T19:49:27.830590] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-06T19:49:28.077101] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:49:28.607210] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T19:49:28.625471] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-06T19:49:29.383539] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T19:49:29.425528] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-06T19:49:30.001328] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T19:49:30.225569] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-06T19:49:30.880438] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T19:49:30.882955] [INFO ] [REMOTE ] KMT: Full fetch complete (62124 records). [2025-10-06T19:49:30.883088] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-06T19:49:31.030784] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-06T19:49:31.290919] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-06T19:49:31.291052] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-06T19:49:31.292345] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-06T19:49:31.292410] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-06T19:49:31.294136] [DEBUG] [LOCAL ] KMT: Trimmed 62124 records to 43054 (keeping 200 days of data) [2025-10-06T19:49:31.579884] [DEBUG] [LOCAL ] KMT: Primary data saved (43054 records). [2025-10-06T19:49:31.608851] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-06T19:49:31.609203] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 26.5s. Estimated remaining: 2h 44m 32s. Rate: 7.1 symbols/min [2025-10-06T19:49:31.617957] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T19:49:31.829730] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-06T19:49:31.831130] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:49:31.848929] [DEBUG] [LOCAL ] KNOP: Loaded 10576 existing records from primary storage. [2025-10-06T19:49:31.849455] [INFO ] [MAIN ] KNOP: Loaded 10576 existing records. [2025-10-06T19:49:32.046387] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:49:32.046728] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-06T19:49:32.046812] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-06T19:49:32.047237] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-06T19:49:32.047297] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-06T19:49:32.405089] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T19:49:32.450285] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:49:32.625537] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-06T19:49:33.425534] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-06T19:49:33.595739] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T19:49:33.720248] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T19:49:34.225552] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-06T19:49:34.773126] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-06T19:49:35.025586] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-06T19:49:35.825489] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-06T19:49:35.984704] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T19:49:36.034463] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-06T19:49:36.625496] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-06T19:49:36.694703] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-06T19:49:37.425534] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-06T19:49:38.225557] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-06T19:49:38.247752] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T19:49:38.310372] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T19:49:39.025536] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-06T19:49:39.567722] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T19:49:39.662255] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-06T19:49:39.825549] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-06T19:49:40.625530] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-06T19:49:41.375347] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T19:49:41.425504] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-06T19:49:41.743630] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-06T19:49:42.225554] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-06T19:49:42.943013] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T19:49:43.025486] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-06T19:49:43.600793] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T19:49:43.825572] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-06T19:49:44.625490] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-06T19:49:44.680534] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T19:49:45.425488] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-06T19:49:45.661444] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T19:49:45.849217] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-06T19:49:46.025077] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-06T19:49:46.225543] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-06T19:49:47.011767] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T19:49:47.025483] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-06T19:49:47.737746] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T19:49:47.825578] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-06T19:49:48.625534] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-06T19:49:49.115840] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T19:49:49.425500] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-06T19:49:49.475405] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-06T19:49:50.225590] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-06T19:49:51.025507] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-06T19:49:51.417505] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-06T19:49:51.625513] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-06T19:49:51.734182] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-06T19:49:51.825733] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-06T19:49:52.625591] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-06T19:49:53.425543] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-06T19:49:53.543763] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-06T19:49:53.547185] [INFO ] [REMOTE ] KMX: Full fetch complete (76098 records). [2025-10-06T19:49:53.547324] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-06T19:49:53.919385] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T19:49:53.976735] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-06T19:49:53.976830] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-06T19:49:53.977959] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-06T19:49:53.978025] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-06T19:49:53.979558] [DEBUG] [LOCAL ] KMX: Trimmed 76098 records to 53182 (keeping 200 days of data) [2025-10-06T19:49:54.225625] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-06T19:49:54.307160] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T19:49:54.334184] [DEBUG] [LOCAL ] KMX: Primary data saved (53182 records). [2025-10-06T19:49:54.334368] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-06T19:49:54.335689] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMX took 49.2s. Estimated remaining: 2h 44m 37s. Rate: 7.1 symbols/min [2025-10-06T19:49:54.500100] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:49:54.521208] [DEBUG] [LOCAL ] KNSL: Loaded 18503 existing records from primary storage. [2025-10-06T19:49:54.521474] [INFO ] [MAIN ] KNSL: Loaded 18503 existing records. [2025-10-06T19:49:54.693053] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:49:54.693263] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-06T19:49:54.693308] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-06T19:49:54.693518] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-06T19:49:54.693574] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-06T19:49:55.032525] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-06T19:49:55.038861] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:49:55.708003] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T19:49:55.825476] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-06T19:49:56.425021] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T19:49:56.625518] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-06T19:49:56.878523] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T19:49:57.425588] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-06T19:49:57.891980] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T19:49:58.225584] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-06T19:49:58.854773] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-06T19:49:59.025559] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-06T19:49:59.523974] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T19:49:59.825528] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-06T19:50:00.341039] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T19:50:00.343483] [INFO ] [REMOTE ] KN: Full fetch complete (56668 records). [2025-10-06T19:50:00.343561] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-06T19:50:00.630711] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-06T19:50:00.757109] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-06T19:50:00.757368] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-06T19:50:00.758692] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-06T19:50:00.758762] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-06T19:50:00.760170] [DEBUG] [LOCAL ] KN: Trimmed 56668 records to 38615 (keeping 200 days of data) [2025-10-06T19:50:01.007914] [DEBUG] [LOCAL ] KN: Primary data saved (38615 records). [2025-10-06T19:50:01.008480] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T19:50:01.008719] [INFO ] [MAIN ] KN: Full history saved. [2025-10-06T19:50:01.014317] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KN took 40.2s. Estimated remaining: 2h 44m 27s. Rate: 7.1 symbols/min [2025-10-06T19:50:01.183260] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:50:01.229537] [DEBUG] [LOCAL ] KNTK: Loaded 46914 existing records from primary storage. [2025-10-06T19:50:01.230014] [INFO ] [MAIN ] KNTK: Loaded 46914 existing records. [2025-10-06T19:50:01.412740] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:50:01.413000] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-06T19:50:01.413049] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-06T19:50:01.413290] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-06T19:50:01.413347] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-06T19:50:01.434461] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-06T19:50:01.771608] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:50:02.106443] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T19:50:02.225492] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-06T19:50:02.542686] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T19:50:02.965776] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T19:50:02.967353] [INFO ] [REMOTE ] KNOP: Full fetch complete (14736 records). [2025-10-06T19:50:02.967423] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-06T19:50:03.032734] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-06T19:50:03.346066] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-06T19:50:03.346146] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-06T19:50:03.346403] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-06T19:50:03.346463] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-06T19:50:03.347188] [DEBUG] [LOCAL ] KNOP: Trimmed 14736 records to 10558 (keeping 200 days of data) [2025-10-06T19:50:03.405351] [DEBUG] [LOCAL ] KNOP: Primary data saved (10558 records). [2025-10-06T19:50:03.405465] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-06T19:50:03.405559] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KNOP took 31.8s. Estimated remaining: 2h 44m 13s. Rate: 7.1 symbols/min [2025-10-06T19:50:03.570310] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:50:03.622475] [DEBUG] [LOCAL ] KNX: Loaded 53368 existing records from primary storage. [2025-10-06T19:50:03.622862] [INFO ] [MAIN ] KNX: Loaded 53368 existing records. [2025-10-06T19:50:03.796763] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:50:03.796950] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-06T19:50:03.796995] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-06T19:50:03.797240] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-06T19:50:03.797296] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-06T19:50:03.830747] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-06T19:50:04.218187] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:50:04.415163] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T19:50:04.417750] [INFO ] [REMOTE ] KNF: Full fetch complete (50949 records). [2025-10-06T19:50:04.417841] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-06T19:50:04.630729] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-06T19:50:04.801621] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-06T19:50:04.801734] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-06T19:50:04.802547] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-06T19:50:04.802587] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-06T19:50:04.803632] [DEBUG] [LOCAL ] KNF: Trimmed 50949 records to 36090 (keeping 200 days of data) [2025-10-06T19:50:05.018334] [DEBUG] [LOCAL ] KNF: Primary data saved (36090 records). [2025-10-06T19:50:05.018494] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-06T19:50:05.018597] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNF took 37.7s. Estimated remaining: 2h 43m 57s. Rate: 7.1 symbols/min [2025-10-06T19:50:05.194742] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:50:05.194935] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-06T19:50:05.194973] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-06T19:50:05.195082] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-06T19:50:05.195122] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-06T19:50:05.195163] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-06T19:50:05.195194] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-06T19:50:05.434438] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-06T19:50:05.523836] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T19:50:05.619907] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:50:05.734022] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-06T19:50:06.225588] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-06T19:50:07.025558] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-06T19:50:07.166528] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T19:50:07.825565] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-06T19:50:07.981339] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T19:50:08.625473] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-06T19:50:08.709703] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-06T19:50:08.730550] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T19:50:09.425613] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-06T19:50:09.931425] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T19:50:10.225606] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-06T19:50:10.688704] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T19:50:11.025551] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-06T19:50:11.086522] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-06T19:50:11.825536] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-06T19:50:12.625580] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-06T19:50:12.765634] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T19:50:13.052581] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T19:50:13.425580] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-06T19:50:14.209158] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T19:50:14.225460] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-06T19:50:15.025593] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-06T19:50:15.825525] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-06T19:50:15.875166] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T19:50:15.955775] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-06T19:50:16.434018] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T19:50:16.455691] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-06T19:50:16.625536] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-06T19:50:17.425559] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-06T19:50:18.225501] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-06T19:50:18.323927] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T19:50:19.025605] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-06T19:50:19.825537] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-06T19:50:19.938333] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T19:50:19.961570] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T19:50:20.031537] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-06T19:50:20.625582] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-06T19:50:21.180065] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T19:50:21.425540] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-06T19:50:21.569456] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T19:50:21.571189] [INFO ] [REMOTE ] KNSL: Full fetch complete (26817 records). [2025-10-06T19:50:21.571269] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-06T19:50:21.997099] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-06T19:50:21.997195] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-06T19:50:21.997781] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-06T19:50:21.997845] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-06T19:50:21.998768] [DEBUG] [LOCAL ] KNSL: Trimmed 26817 records to 18380 (keeping 200 days of data) [2025-10-06T19:50:22.120940] [DEBUG] [LOCAL ] KNSL: Primary data saved (18380 records). [2025-10-06T19:50:22.121115] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-06T19:50:22.121204] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNSL took 27.8s. Estimated remaining: 2h 43m 57s. Rate: 7.1 symbols/min [2025-10-06T19:50:22.229760] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-06T19:50:22.303283] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:50:22.349301] [DEBUG] [LOCAL ] KODK: Loaded 44096 existing records from primary storage. [2025-10-06T19:50:22.349689] [INFO ] [MAIN ] KODK: Loaded 44096 existing records. [2025-10-06T19:50:22.528511] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:50:22.528897] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-06T19:50:22.529005] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-06T19:50:22.529338] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-06T19:50:22.529428] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-06T19:50:22.928107] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:50:22.966895] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T19:50:23.025484] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-06T19:50:23.825556] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-06T19:50:24.625579] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-06T19:50:24.681194] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T19:50:24.923811] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-06T19:50:25.093981] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T19:50:25.425541] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-06T19:50:26.236324] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-06T19:50:26.262446] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T19:50:27.025556] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-06T19:50:27.780586] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T19:50:27.825506] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-06T19:50:28.063139] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-06T19:50:28.626045] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-06T19:50:28.627415] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T19:50:29.426631] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-06T19:50:29.428936] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T19:50:30.225547] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-06T19:50:30.633856] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-06T19:50:31.025541] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-06T19:50:31.577195] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T19:50:31.581925] [INFO ] [REMOTE ] KNTK: Full fetch complete (64880 records). [2025-10-06T19:50:31.582104] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-06T19:50:31.833261] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-06T19:50:32.038339] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-06T19:50:32.038514] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-06T19:50:32.040166] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-06T19:50:32.040322] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-06T19:50:32.042557] [DEBUG] [LOCAL ] KNTK: Trimmed 64880 records to 46402 (keeping 200 days of data) [2025-10-06T19:50:32.173173] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-06T19:50:32.397593] [DEBUG] [LOCAL ] KNTK: Primary data saved (46402 records). [2025-10-06T19:50:32.397844] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-06T19:50:32.397962] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNTK took 31.4s. Estimated remaining: 2h 43m 51s. Rate: 7.1 symbols/min [2025-10-06T19:50:32.584503] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:50:32.616859] [DEBUG] [LOCAL ] KOF: Loaded 26587 existing records from primary storage. [2025-10-06T19:50:32.617238] [INFO ] [MAIN ] KOF: Loaded 26587 existing records. [2025-10-06T19:50:32.653598] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-06T19:50:32.815748] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:50:32.816587] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-06T19:50:32.816741] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-06T19:50:32.832146] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-06T19:50:32.853587] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-06T19:50:32.927473] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T19:50:33.227406] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:50:33.425490] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-06T19:50:33.467042] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T19:50:34.225556] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-06T19:50:34.490795] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T19:50:35.025500] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-06T19:50:35.080149] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-06T19:50:35.806457] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-06T19:50:35.825480] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-06T19:50:36.121796] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T19:50:36.625530] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-06T19:50:37.227114] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T19:50:37.230153] [INFO ] [REMOTE ] KNX: Full fetch complete (75889 records). [2025-10-06T19:50:37.230259] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-06T19:50:37.435136] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-06T19:50:37.627760] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-06T19:50:37.627853] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-06T19:50:37.628974] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-06T19:50:37.629040] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-06T19:50:37.630576] [DEBUG] [LOCAL ] KNX: Trimmed 75889 records to 52594 (keeping 200 days of data) [2025-10-06T19:50:37.956346] [DEBUG] [LOCAL ] KNX: Primary data saved (52594 records). [2025-10-06T19:50:37.956501] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-06T19:50:37.956586] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNX took 34.6s. Estimated remaining: 2h 43m 39s. Rate: 7.1 symbols/min [2025-10-06T19:50:38.138966] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:50:38.159137] [DEBUG] [LOCAL ] KOP: Loaded 17879 existing records from primary storage. [2025-10-06T19:50:38.159441] [INFO ] [MAIN ] KOP: Loaded 17879 existing records. [2025-10-06T19:50:38.232266] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-06T19:50:38.367280] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:50:38.367546] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-06T19:50:38.367595] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-06T19:50:38.367880] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-06T19:50:38.367970] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-06T19:50:38.727309] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:50:39.025531] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-06T19:50:39.057827] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T19:50:39.396671] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-06T19:50:39.397833] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T19:50:39.825566] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-06T19:50:40.285358] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T19:50:40.625628] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-06T19:50:41.425521] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-06T19:50:41.485405] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T19:50:42.225572] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-06T19:50:42.378856] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T19:50:42.963376] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-06T19:50:43.025543] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-06T19:50:43.286131] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T19:50:43.825545] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-06T19:50:44.625560] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-06T19:50:45.247096] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T19:50:45.286086] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-06T19:50:45.425544] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-06T19:50:45.536450] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-06T19:50:46.225578] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-06T19:50:47.025575] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-06T19:50:47.393434] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-06T19:50:47.825549] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-06T19:50:47.862020] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-06T19:50:47.865801] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-06T19:50:47.865974] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-06T19:50:48.030766] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T19:50:48.095420] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T19:50:48.096238] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T19:50:48.096312] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T19:50:48.096387] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-06T19:50:48.096502] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-06T19:50:48.096560] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-06T19:50:48.096621] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-06T19:50:48.096739] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KO took 43.1s. Estimated remaining: 2h 43m 33s. Rate: 7.1 symbols/min [2025-10-06T19:50:48.262735] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:50:48.267474] [DEBUG] [LOCAL ] KORE: Loaded 2043 existing records from primary storage. [2025-10-06T19:50:48.271390] [INFO ] [MAIN ] KORE: Loaded 2043 existing records. [2025-10-06T19:50:48.446123] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:50:48.446359] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-06T19:50:48.446417] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-06T19:50:48.446610] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-06T19:50:48.446704] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-06T19:50:48.632317] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-06T19:50:48.802442] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:50:48.894357] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T19:50:49.425621] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-06T19:50:49.968375] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T19:50:50.225526] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-06T19:50:50.338899] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T19:50:51.025527] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-06T19:50:51.073357] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-06T19:50:51.825566] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-06T19:50:52.042524] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T19:50:52.625568] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-06T19:50:53.425522] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-06T19:50:53.482024] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T19:50:53.875637] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-06T19:50:54.225539] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-06T19:50:54.461320] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T19:50:55.025558] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-06T19:50:55.778526] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T19:50:55.825508] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-06T19:50:56.081572] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T19:50:56.625507] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-06T19:50:56.920704] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T19:50:57.425545] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-06T19:50:57.591725] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T19:50:58.225546] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-06T19:50:58.895063] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-06T19:50:59.025557] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-06T19:50:59.085587] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T19:50:59.825544] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-06T19:51:00.396604] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T19:51:00.399380] [INFO ] [REMOTE ] KODK: Full fetch complete (63347 records). [2025-10-06T19:51:00.399550] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-06T19:51:00.639627] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-06T19:51:00.808049] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-06T19:51:00.808252] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-06T19:51:00.809213] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-06T19:51:00.809314] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-06T19:51:00.810948] [DEBUG] [LOCAL ] KODK: Trimmed 63347 records to 43356 (keeping 200 days of data) [2025-10-06T19:51:00.918526] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T19:51:01.089436] [DEBUG] [LOCAL ] KODK: Primary data saved (43356 records). [2025-10-06T19:51:01.089590] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-06T19:51:01.089701] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 39.0s. Estimated remaining: 2h 43m 28s. Rate: 7.1 symbols/min [2025-10-06T19:51:01.263031] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T19:51:01.282270] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:51:01.340235] [DEBUG] [LOCAL ] KOS: Loaded 53828 existing records from primary storage. [2025-10-06T19:51:01.340762] [INFO ] [MAIN ] KOS: Loaded 53828 existing records. [2025-10-06T19:51:01.430770] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-06T19:51:01.528382] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:51:01.528638] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-06T19:51:01.528723] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-06T19:51:01.528982] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-06T19:51:01.529040] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-06T19:51:01.913321] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:51:02.225579] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-06T19:51:02.571491] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T19:51:02.573847] [INFO ] [REMOTE ] KOF: Full fetch complete (37527 records). [2025-10-06T19:51:02.573972] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-06T19:51:02.681815] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-06T19:51:02.985312] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-06T19:51:02.985405] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-06T19:51:02.986239] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-06T19:51:02.986305] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-06T19:51:02.987323] [DEBUG] [LOCAL ] KOF: Trimmed 37527 records to 26489 (keeping 200 days of data) [2025-10-06T19:51:03.042944] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-06T19:51:03.161605] [DEBUG] [LOCAL ] KOF: Primary data saved (26489 records). [2025-10-06T19:51:03.161826] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-06T19:51:03.161953] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KOF took 30.8s. Estimated remaining: 2h 43m 14s. Rate: 7.1 symbols/min [2025-10-06T19:51:03.343013] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:51:03.401857] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-10-06T19:51:03.402503] [INFO ] [MAIN ] KR: Loaded 54461 existing records. [2025-10-06T19:51:03.610535] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:51:03.610907] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-06T19:51:03.611030] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-06T19:51:03.611369] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-06T19:51:03.611433] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-06T19:51:03.830793] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-06T19:51:04.019529] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:51:04.382306] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-06T19:51:04.625501] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-06T19:51:04.955178] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T19:51:05.425540] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-06T19:51:06.225501] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-06T19:51:06.508462] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T19:51:06.532801] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-06T19:51:06.671868] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-06T19:51:07.025543] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-06T19:51:07.492500] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-06T19:51:07.825510] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-06T19:51:08.312345] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-06T19:51:08.625544] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-06T19:51:09.068949] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-06T19:51:09.425595] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-06T19:51:09.851456] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-06T19:51:10.225574] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-06T19:51:10.811307] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T19:51:10.812169] [INFO ] [REMOTE ] KORE: Full fetch complete (5753 records). [2025-10-06T19:51:10.812240] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-06T19:51:11.030745] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-06T19:51:11.176365] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-06T19:51:11.176450] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-06T19:51:11.176604] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-06T19:51:11.176661] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-06T19:51:11.177036] [DEBUG] [LOCAL ] KORE: Trimmed 5753 records to 2056 (keeping 200 days of data) [2025-10-06T19:51:11.188588] [DEBUG] [LOCAL ] KORE: Primary data saved (2056 records). [2025-10-06T19:51:11.188669] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-06T19:51:11.188756] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KORE took 23.1s. Estimated remaining: 2h 43m 5s. Rate: 7.1 symbols/min [2025-10-06T19:51:11.355305] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:51:11.402674] [DEBUG] [LOCAL ] KRC: Loaded 48988 existing records from primary storage. [2025-10-06T19:51:11.403054] [INFO ] [MAIN ] KRC: Loaded 48988 existing records. [2025-10-06T19:51:11.580036] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:51:11.580261] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-06T19:51:11.580306] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-06T19:51:11.580559] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-06T19:51:11.580615] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-06T19:51:11.834246] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-06T19:51:11.939533] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:51:12.552842] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T19:51:12.625552] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-06T19:51:12.919588] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T19:51:13.425550] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-06T19:51:14.225498] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-06T19:51:14.384345] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-06T19:51:14.509197] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-06T19:51:15.025550] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-06T19:51:15.086615] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T19:51:15.088085] [INFO ] [REMOTE ] KOP: Full fetch complete (25562 records). [2025-10-06T19:51:15.088170] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-06T19:51:15.469104] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-06T19:51:15.469228] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-06T19:51:15.470132] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-06T19:51:15.470203] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-06T19:51:15.471527] [DEBUG] [LOCAL ] KOP: Trimmed 25562 records to 17533 (keeping 200 days of data) [2025-10-06T19:51:15.600446] [DEBUG] [LOCAL ] KOP: Primary data saved (17533 records). [2025-10-06T19:51:15.600718] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-06T19:51:15.600857] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOP took 37.6s. Estimated remaining: 2h 42m 53s. Rate: 7.1 symbols/min [2025-10-06T19:51:15.789096] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:51:15.826480] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-06T19:51:15.828878] [DEBUG] [LOCAL ] KREF: Loaded 38174 existing records from primary storage. [2025-10-06T19:51:15.829259] [INFO ] [MAIN ] KREF: Loaded 38174 existing records. [2025-10-06T19:51:16.012897] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:51:16.013231] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-06T19:51:16.013307] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-06T19:51:16.013815] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-06T19:51:16.013891] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-06T19:51:16.380705] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:51:16.625539] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-06T19:51:17.108996] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-06T19:51:17.425553] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-06T19:51:17.662852] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-06T19:51:17.832148] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-06T19:51:18.225532] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-06T19:51:19.025592] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-06T19:51:19.439181] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T19:51:19.825504] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-06T19:51:19.968358] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T19:51:20.365707] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T19:51:20.625631] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-06T19:51:21.425542] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-06T19:51:21.559109] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T19:51:21.935388] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T19:51:22.225581] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-06T19:51:22.618111] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T19:51:23.025541] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-06T19:51:23.676055] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T19:51:23.825487] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-06T19:51:24.565449] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T19:51:24.625530] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-06T19:51:25.425554] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-06T19:51:25.650812] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T19:51:26.154047] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T19:51:26.225516] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-06T19:51:27.025536] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-06T19:51:27.225106] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T19:51:27.724680] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T19:51:27.825485] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-06T19:51:28.625506] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-06T19:51:28.711584] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T19:51:29.191257] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T19:51:29.425513] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-06T19:51:30.137128] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T19:51:30.225474] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-06T19:51:31.025554] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-06T19:51:31.152704] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T19:51:31.825532] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-06T19:51:32.109270] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T19:51:32.143783] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-06T19:51:32.625538] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-06T19:51:33.425549] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-06T19:51:33.944949] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T19:51:34.026628] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-06T19:51:34.225469] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-06T19:51:35.025523] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-06T19:51:35.412679] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-06T19:51:35.825530] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-06T19:51:36.085537] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T19:51:36.470592] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T19:51:36.625558] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-06T19:51:37.425591] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-06T19:51:37.668388] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-06T19:51:37.671503] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-10-06T19:51:37.671613] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-06T19:51:38.099535] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-06T19:51:38.099775] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-06T19:51:38.101201] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-06T19:51:38.101329] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-06T19:51:38.103439] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 53681 (keeping 200 days of data) [2025-10-06T19:51:38.231751] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-06T19:51:38.235818] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T19:51:38.493524] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-06T19:51:38.493728] [INFO ] [MAIN ] KR: Full history saved. [2025-10-06T19:51:38.493833] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KR took 35.3s. Estimated remaining: 2h 42m 58s. Rate: 7.1 symbols/min [2025-10-06T19:51:38.667228] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:51:38.713815] [DEBUG] [LOCAL ] KRG: Loaded 49885 existing records from primary storage. [2025-10-06T19:51:38.714200] [INFO ] [MAIN ] KRG: Loaded 49885 existing records. [2025-10-06T19:51:38.896572] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:51:38.896926] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-06T19:51:38.896977] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-06T19:51:38.897226] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-06T19:51:38.897288] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-06T19:51:39.028695] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-06T19:51:39.284798] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:51:39.316057] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T19:51:39.464596] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T19:51:39.467288] [INFO ] [REMOTE ] KREF: Full fetch complete (52677 records). [2025-10-06T19:51:39.467420] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-06T19:51:39.830253] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-06T19:51:39.844379] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-06T19:51:39.844463] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-06T19:51:39.845332] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-06T19:51:39.845513] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-06T19:51:39.846680] [DEBUG] [LOCAL ] KREF: Trimmed 52677 records to 37672 (keeping 200 days of data) [2025-10-06T19:51:40.073921] [DEBUG] [LOCAL ] KREF: Primary data saved (37672 records). [2025-10-06T19:51:40.074114] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-06T19:51:40.074231] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KREF took 24.5s. Estimated remaining: 2h 42m 43s. Rate: 7.1 symbols/min [2025-10-06T19:51:40.243993] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:51:40.244196] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-06T19:51:40.244250] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-06T19:51:40.244358] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-06T19:51:40.244399] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-06T19:51:40.244439] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-06T19:51:40.244469] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-06T19:51:40.616718] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:51:40.625480] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-06T19:51:40.848438] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T19:51:40.848874] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-06T19:51:40.848967] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:51:40.849014] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-06T19:51:40.849047] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:51:40.849113] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-06T19:51:40.849181] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-06T19:51:40.849216] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-06T19:51:40.849269] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-06T19:51:40.849339] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KRMN took 0.8s. Estimated remaining: 2h 42m 27s. Rate: 7.1 symbols/min [2025-10-06T19:51:41.037899] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:51:41.071489] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-06T19:51:41.102214] [DEBUG] [LOCAL ] KRO: Loaded 26399 existing records from primary storage. [2025-10-06T19:51:41.102504] [INFO ] [MAIN ] KRO: Loaded 26399 existing records. [2025-10-06T19:51:41.282961] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:51:41.283241] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-06T19:51:41.283304] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-06T19:51:41.283563] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-06T19:51:41.283619] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-06T19:51:41.432063] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-06T19:51:41.669010] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:51:41.671035] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T19:51:42.225535] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-06T19:51:43.025532] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-06T19:51:43.252716] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-06T19:51:43.335326] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T19:51:43.825543] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-06T19:51:44.555136] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T19:51:44.625576] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-06T19:51:44.734571] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T19:51:45.425496] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-06T19:51:46.227521] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-06T19:51:46.233757] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T19:51:46.385834] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-06T19:51:47.025542] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-06T19:51:47.825501] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-06T19:51:47.852289] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T19:51:48.625502] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-06T19:51:48.890514] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-06T19:51:48.915747] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-06T19:51:49.425558] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-06T19:51:50.237795] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-06T19:51:50.243854] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T19:51:50.987250] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T19:51:50.990408] [INFO ] [REMOTE ] KOS: Full fetch complete (76879 records). [2025-10-06T19:51:50.990566] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-06T19:51:51.033527] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-06T19:51:51.384691] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-06T19:51:51.384793] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-06T19:51:51.385852] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-06T19:51:51.385918] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-06T19:51:51.387570] [DEBUG] [LOCAL ] KOS: Trimmed 76879 records to 53056 (keeping 200 days of data) [2025-10-06T19:51:51.700119] [DEBUG] [LOCAL ] KOS: Primary data saved (53056 records). [2025-10-06T19:51:51.700274] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-06T19:51:51.701319] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KOS took 50.6s. Estimated remaining: 2h 42m 21s. Rate: 7.1 symbols/min [2025-10-06T19:51:51.828249] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-06T19:51:51.882103] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:51:51.915488] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T19:51:51.960170] [DEBUG] [LOCAL ] KRP: Loaded 37479 existing records from primary storage. [2025-10-06T19:51:51.960523] [INFO ] [MAIN ] KRP: Loaded 37479 existing records. [2025-10-06T19:51:52.134529] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:51:52.134781] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-06T19:51:52.134851] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-06T19:51:52.135098] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-06T19:51:52.135173] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-06T19:51:52.490473] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:51:52.627339] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-06T19:51:52.635871] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T19:51:52.714488] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T19:51:53.425552] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-06T19:51:54.225514] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-06T19:51:54.278976] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T19:51:54.742991] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T19:51:55.025536] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-06T19:51:55.825492] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-06T19:51:55.923199] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T19:51:56.529260] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T19:51:56.625524] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-06T19:51:56.834348] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-06T19:51:57.425582] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-06T19:51:57.942632] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T19:51:58.225600] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-06T19:51:59.024082] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T19:51:59.027933] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-06T19:51:59.305369] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T19:51:59.825552] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-06T19:52:00.589491] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T19:52:00.625488] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-06T19:52:00.918575] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T19:52:01.425556] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-06T19:52:02.216026] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T19:52:02.225555] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-06T19:52:02.753450] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T19:52:03.025607] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-06T19:52:03.825546] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-06T19:52:04.206104] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-06T19:52:04.209093] [INFO ] [REMOTE ] KRC: Full fetch complete (69920 records). [2025-10-06T19:52:04.209260] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-06T19:52:04.582578] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T19:52:04.650377] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-06T19:52:04.669814] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-06T19:52:04.669904] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-06T19:52:04.671134] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-06T19:52:04.671222] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-06T19:52:04.672735] [DEBUG] [LOCAL ] KRC: Trimmed 69920 records to 48309 (keeping 200 days of data) [2025-10-06T19:52:04.996282] [DEBUG] [LOCAL ] KRC: Primary data saved (48309 records). [2025-10-06T19:52:04.996467] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-06T19:52:04.996572] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KRC took 53.8s. Estimated remaining: 2h 42m 17s. Rate: 7.1 symbols/min [2025-10-06T19:52:05.185455] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:52:05.217519] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T19:52:05.278099] [DEBUG] [LOCAL ] KSS: Loaded 54381 existing records from primary storage. [2025-10-06T19:52:05.278546] [INFO ] [MAIN ] KSS: Loaded 54381 existing records. [2025-10-06T19:52:05.434781] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-06T19:52:05.469558] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:52:05.469960] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-06T19:52:05.470017] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-06T19:52:05.470360] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-06T19:52:05.470429] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-06T19:52:05.927572] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:52:05.991207] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T19:52:06.225556] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-06T19:52:07.025536] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-06T19:52:07.130546] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T19:52:07.825500] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-06T19:52:08.030466] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T19:52:08.032282] [INFO ] [REMOTE ] KRO: Full fetch complete (34972 records). [2025-10-06T19:52:08.032361] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-06T19:52:08.490100] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-06T19:52:08.519868] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-06T19:52:08.520617] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-06T19:52:08.521819] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-06T19:52:08.521890] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-06T19:52:08.522940] [DEBUG] [LOCAL ] KRO: Trimmed 34972 records to 26092 (keeping 200 days of data) [2025-10-06T19:52:08.626280] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-06T19:52:08.698775] [DEBUG] [LOCAL ] KRO: Primary data saved (26092 records). [2025-10-06T19:52:08.698946] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-06T19:52:08.699039] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRO took 27.8s. Estimated remaining: 2h 42m 4s. Rate: 7.1 symbols/min [2025-10-06T19:52:08.902594] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:52:08.949801] [DEBUG] [LOCAL ] KT: Loaded 46344 existing records from primary storage. [2025-10-06T19:52:08.950151] [INFO ] [MAIN ] KT: Loaded 46344 existing records. [2025-10-06T19:52:09.174197] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:52:09.174770] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-06T19:52:09.174867] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-06T19:52:09.175309] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-06T19:52:09.175372] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-06T19:52:09.434886] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-06T19:52:09.600812] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:52:09.619427] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T19:52:10.225562] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-06T19:52:10.407749] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T19:52:10.778900] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T19:52:11.025581] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-06T19:52:11.472969] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T19:52:11.475884] [INFO ] [REMOTE ] KRG: Full fetch complete (71161 records). [2025-10-06T19:52:11.475993] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-06T19:52:11.826673] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-06T19:52:11.865526] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-06T19:52:11.865717] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-06T19:52:11.866834] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-06T19:52:11.866898] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-06T19:52:11.868357] [DEBUG] [LOCAL ] KRG: Trimmed 71161 records to 49220 (keeping 200 days of data) [2025-10-06T19:52:12.178478] [DEBUG] [LOCAL ] KRG: Primary data saved (49220 records). [2025-10-06T19:52:12.178674] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-06T19:52:12.178789] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRG took 33.7s. Estimated remaining: 2h 41m 51s. Rate: 7.1 symbols/min [2025-10-06T19:52:12.344887] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:52:12.386959] [DEBUG] [LOCAL ] KTB: Loaded 41546 existing records from primary storage. [2025-10-06T19:52:12.387302] [INFO ] [MAIN ] KTB: Loaded 41546 existing records. [2025-10-06T19:52:12.564321] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:52:12.564560] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-06T19:52:12.564607] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-06T19:52:12.564841] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-06T19:52:12.564898] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-06T19:52:12.632902] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-06T19:52:12.938139] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:52:12.967116] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-06T19:52:13.425501] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-06T19:52:13.511395] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T19:52:13.628621] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T19:52:14.225584] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-06T19:52:14.367798] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T19:52:15.025555] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-06T19:52:15.601387] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-06T19:52:15.825578] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-06T19:52:16.625532] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-06T19:52:16.897999] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T19:52:17.255280] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T19:52:17.425513] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-06T19:52:18.006081] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T19:52:18.225557] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-06T19:52:18.856712] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-06T19:52:19.025543] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-06T19:52:19.492029] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-06T19:52:19.825552] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-06T19:52:20.510111] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T19:52:20.625475] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-06T19:52:21.355791] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T19:52:21.425524] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-06T19:52:22.225499] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-06T19:52:22.333483] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T19:52:22.781207] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-06T19:52:23.025603] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-06T19:52:23.825544] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-06T19:52:24.300600] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-06T19:52:24.363812] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T19:52:24.625600] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-06T19:52:25.333713] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T19:52:25.425536] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-06T19:52:25.750330] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-06T19:52:25.752440] [INFO ] [REMOTE ] KRP: Full fetch complete (54866 records). [2025-10-06T19:52:25.752523] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-06T19:52:26.134448] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-06T19:52:26.134535] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-06T19:52:26.135397] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-06T19:52:26.135464] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-06T19:52:26.136577] [DEBUG] [LOCAL ] KRP: Trimmed 54866 records to 36809 (keeping 200 days of data) [2025-10-06T19:52:26.228457] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-06T19:52:26.368612] [DEBUG] [LOCAL ] KRP: Primary data saved (36809 records). [2025-10-06T19:52:26.368821] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-06T19:52:26.368911] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRP took 34.7s. Estimated remaining: 2h 41m 48s. Rate: 7.1 symbols/min [2025-10-06T19:52:26.577723] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:52:26.594826] [DEBUG] [LOCAL ] KTF: Loaded 12698 existing records from primary storage. [2025-10-06T19:52:26.595162] [INFO ] [MAIN ] KTF: Loaded 12698 existing records. [2025-10-06T19:52:26.818775] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:52:26.819211] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-06T19:52:26.819268] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-06T19:52:26.819562] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-06T19:52:26.819620] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-06T19:52:27.030723] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-06T19:52:27.207576] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T19:52:27.206342] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:52:27.825533] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-06T19:52:28.251938] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-06T19:52:28.633787] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-06T19:52:28.637111] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T19:52:28.787099] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T19:52:29.425555] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-06T19:52:30.225510] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-06T19:52:30.558121] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-06T19:52:30.782446] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T19:52:31.025504] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-06T19:52:31.272784] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T19:52:31.480978] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-06T19:52:31.825529] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-06T19:52:32.301665] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-06T19:52:32.625590] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-06T19:52:33.425586] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-06T19:52:34.188145] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T19:52:34.225519] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-06T19:52:35.025593] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-06T19:52:35.648590] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-06T19:52:35.724682] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T19:52:35.825539] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-06T19:52:36.005825] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T19:52:36.625588] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-06T19:52:37.196995] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T19:52:37.425569] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-06T19:52:38.198963] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T19:52:38.225537] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-06T19:52:39.025531] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-06T19:52:39.302914] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T19:52:39.832154] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-06T19:52:39.837818] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T19:52:40.065350] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T19:52:40.625580] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-06T19:52:40.994586] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T19:52:40.996985] [INFO ] [REMOTE ] KTB: Full fetch complete (57964 records). [2025-10-06T19:52:40.997100] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-06T19:52:41.405171] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-06T19:52:41.405286] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-06T19:52:41.407075] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-06T19:52:41.407147] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-06T19:52:41.408928] [DEBUG] [LOCAL ] KTB: Trimmed 57964 records to 40814 (keeping 200 days of data) [2025-10-06T19:52:41.465170] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-06T19:52:41.696863] [DEBUG] [LOCAL ] KTB: Primary data saved (40814 records). [2025-10-06T19:52:41.697067] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-06T19:52:41.697191] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KTB took 29.5s. Estimated remaining: 2h 41m 46s. Rate: 7.1 symbols/min [2025-10-06T19:52:41.880001] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:52:41.880228] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-06T19:52:41.880270] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-06T19:52:41.880399] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-06T19:52:41.880445] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-06T19:52:41.880487] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-06T19:52:41.880520] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-06T19:52:42.232333] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-06T19:52:42.255450] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:52:42.653863] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-06T19:52:43.004072] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-06T19:52:43.025470] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-06T19:52:43.146282] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T19:52:43.825495] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-06T19:52:43.855706] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-06T19:52:44.625707] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-06T19:52:45.181441] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T19:52:45.185432] [INFO ] [REMOTE ] KT: Full fetch complete (66551 records). [2025-10-06T19:52:45.185599] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-06T19:52:45.430734] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-06T19:52:45.519673] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-06T19:52:45.625178] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-06T19:52:45.625351] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-06T19:52:45.627122] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-06T19:52:45.627198] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-06T19:52:45.629274] [DEBUG] [LOCAL ] KT: Trimmed 66551 records to 45572 (keeping 200 days of data) [2025-10-06T19:52:45.936012] [DEBUG] [LOCAL ] KT: Primary data saved (45572 records). [2025-10-06T19:52:45.936212] [INFO ] [MAIN ] KT: Full history saved. [2025-10-06T19:52:45.936315] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KT took 37.2s. Estimated remaining: 2h 41m 34s. Rate: 7.1 symbols/min [2025-10-06T19:52:46.118038] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:52:46.177355] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-10-06T19:52:46.177860] [INFO ] [MAIN ] KVUE: Loaded 54447 existing records. [2025-10-06T19:52:46.233682] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-06T19:52:46.379386] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:52:46.380092] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-06T19:52:46.380180] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-06T19:52:46.380507] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-06T19:52:46.380570] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-06T19:52:46.735190] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:52:46.915361] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-06T19:52:47.025578] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-06T19:52:47.132346] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-06T19:52:47.135551] [INFO ] [REMOTE ] KSS: Full fetch complete (77632 records). [2025-10-06T19:52:47.135706] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-06T19:52:47.526556] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-06T19:52:47.526687] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-06T19:52:47.527937] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-06T19:52:47.528012] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-06T19:52:47.530014] [DEBUG] [LOCAL ] KSS: Trimmed 77632 records to 53600 (keeping 200 days of data) [2025-10-06T19:52:47.846392] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-06T19:52:47.876417] [DEBUG] [LOCAL ] KSS: Primary data saved (53600 records). [2025-10-06T19:52:47.876613] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-06T19:52:47.876749] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KSS took 42.9s. Estimated remaining: 2h 41m 19s. Rate: 7.1 symbols/min [2025-10-06T19:52:48.019164] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T19:52:48.070539] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:52:48.122251] [DEBUG] [LOCAL ] KVYO: Loaded 50847 existing records from primary storage. [2025-10-06T19:52:48.122636] [INFO ] [MAIN ] KVYO: Loaded 50847 existing records. [2025-10-06T19:52:48.294722] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:52:48.294919] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-06T19:52:48.294965] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-06T19:52:48.295245] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-06T19:52:48.295303] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-06T19:52:48.636010] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-06T19:52:48.669527] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:52:49.425506] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-06T19:52:49.492318] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T19:52:49.490592] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T19:52:49.923361] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-06T19:52:50.225528] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-06T19:52:51.025524] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-06T19:52:51.765447] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T19:52:51.779044] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T19:52:51.825470] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-06T19:52:52.625543] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-06T19:52:53.387423] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T19:52:53.425504] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-06T19:52:53.822339] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-06T19:52:54.225585] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-06T19:52:55.014020] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-06T19:52:55.030630] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-06T19:52:55.049483] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T19:52:55.825543] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-06T19:52:56.466818] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T19:52:56.468130] [INFO ] [REMOTE ] KTF: Full fetch complete (17733 records). [2025-10-06T19:52:56.468248] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-06T19:52:56.630711] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-06T19:52:56.867987] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-06T19:52:56.868144] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-06T19:52:56.868694] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-06T19:52:56.868786] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-06T19:52:56.869802] [DEBUG] [LOCAL ] KTF: Trimmed 17733 records to 12211 (keeping 200 days of data) [2025-10-06T19:52:56.963827] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-06T19:52:56.983956] [DEBUG] [LOCAL ] KTF: Primary data saved (12211 records). [2025-10-06T19:52:56.984101] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-06T19:52:56.984182] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KTF took 30.6s. Estimated remaining: 2h 41m 11s. Rate: 7.1 symbols/min [2025-10-06T19:52:57.157304] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:52:57.197248] [DEBUG] [LOCAL ] KW: Loaded 41133 existing records from primary storage. [2025-10-06T19:52:57.197572] [INFO ] [MAIN ] KW: Loaded 41133 existing records. [2025-10-06T19:52:57.300929] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-06T19:52:57.379048] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:52:57.379275] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-06T19:52:57.379322] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-06T19:52:57.379566] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-06T19:52:57.379624] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-06T19:52:57.430926] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-06T19:52:57.729704] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:52:58.225531] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-06T19:52:59.025553] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-06T19:52:59.319069] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T19:52:59.523741] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-06T19:52:59.576895] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T19:52:59.825552] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-06T19:53:00.234780] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-06T19:53:00.625551] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-06T19:53:01.425541] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-06T19:53:01.856134] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-06T19:53:02.225525] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-06T19:53:02.443666] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T19:53:02.785716] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T19:53:03.025585] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-06T19:53:03.825910] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-06T19:53:03.925969] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T19:53:04.384304] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-06T19:53:04.625564] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-06T19:53:05.407451] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T19:53:05.412769] [INFO ] [REMOTE ] KUKE: Full fetch complete (8590 records). [2025-10-06T19:53:05.412900] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-06T19:53:05.434273] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-06T19:53:05.595566] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T19:53:05.595868] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-06T19:53:05.595949] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-06T19:53:05.595999] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-06T19:53:05.596060] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-06T19:53:05.596095] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-06T19:53:05.596136] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-06T19:53:05.596204] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KUKE took 23.9s. Estimated remaining: 2h 41m 3s. Rate: 7.1 symbols/min [2025-10-06T19:53:05.762580] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:53:05.781701] [DEBUG] [LOCAL ] KWR: Loaded 16741 existing records from primary storage. [2025-10-06T19:53:05.781975] [INFO ] [MAIN ] KWR: Loaded 16741 existing records. [2025-10-06T19:53:05.973150] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:53:05.973454] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-06T19:53:05.973504] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-06T19:53:05.973788] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-06T19:53:05.973847] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-06T19:53:06.232163] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-06T19:53:06.342371] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:53:06.801304] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T19:53:07.025555] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-06T19:53:07.685174] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T19:53:07.825499] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-06T19:53:08.381904] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-06T19:53:08.625541] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-06T19:53:09.415449] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T19:53:09.425771] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-06T19:53:10.163707] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-06T19:53:10.225476] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-06T19:53:10.470024] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T19:53:11.025531] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-06T19:53:11.784468] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-06T19:53:11.825480] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-06T19:53:12.625511] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-06T19:53:12.774133] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T19:53:13.314352] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T19:53:13.371566] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T19:53:13.425546] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-06T19:53:14.170052] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-06T19:53:14.225489] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-06T19:53:15.025554] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-06T19:53:15.825537] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-06T19:53:16.015737] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T19:53:16.625557] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-06T19:53:16.800068] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-06T19:53:16.866725] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T19:53:17.425546] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-06T19:53:17.909703] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T19:53:18.225598] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-06T19:53:18.843581] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T19:53:19.025532] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-06T19:53:19.365731] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T19:53:19.825540] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-06T19:53:20.630712] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-06T19:53:20.646189] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T19:53:20.890730] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T19:53:21.425537] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-06T19:53:22.230684] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-06T19:53:22.247000] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T19:53:23.025504] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-06T19:53:23.302878] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T19:53:23.620318] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-06T19:53:23.825529] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-06T19:53:23.951173] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T19:53:24.625529] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-06T19:53:25.425543] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-06T19:53:25.988026] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-06T19:53:25.992019] [INFO ] [REMOTE ] KVUE: Full fetch complete (77674 records). [2025-10-06T19:53:25.992269] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-06T19:53:26.235022] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-06T19:53:26.456638] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-06T19:53:26.457025] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-06T19:53:26.458387] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-06T19:53:26.468796] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-06T19:53:26.488924] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T19:53:26.500540] [DEBUG] [LOCAL ] KVUE: Trimmed 77674 records to 53667 (keeping 200 days of data) [2025-10-06T19:53:26.860554] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T19:53:26.887140] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-06T19:53:26.887361] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-06T19:53:26.887486] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KVUE took 41.0s. Estimated remaining: 2h 41m 6s. Rate: 7.1 symbols/min [2025-10-06T19:53:27.030701] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-06T19:53:27.110630] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:53:27.145734] [DEBUG] [LOCAL ] KYN: Loaded 30355 existing records from primary storage. [2025-10-06T19:53:27.146185] [INFO ] [MAIN ] KYN: Loaded 30355 existing records. [2025-10-06T19:53:27.281010] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T19:53:27.357349] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:53:27.357629] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-06T19:53:27.357734] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-06T19:53:27.357968] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-06T19:53:27.358025] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-06T19:53:27.706085] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:53:27.825499] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-06T19:53:28.625525] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-06T19:53:28.814820] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T19:53:29.018132] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-06T19:53:29.275322] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-06T19:53:29.425530] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-06T19:53:30.225580] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-06T19:53:30.494124] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T19:53:31.025576] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-06T19:53:31.324026] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T19:53:31.326894] [INFO ] [REMOTE ] KW: Full fetch complete (57110 records). [2025-10-06T19:53:31.327012] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-06T19:53:31.716853] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-06T19:53:31.716935] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-06T19:53:31.717829] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-06T19:53:31.717892] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-06T19:53:31.719062] [DEBUG] [LOCAL ] KW: Trimmed 57110 records to 40447 (keeping 200 days of data) [2025-10-06T19:53:31.825898] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-06T19:53:31.974360] [DEBUG] [LOCAL ] KW: Primary data saved (40447 records). [2025-10-06T19:53:31.974573] [INFO ] [MAIN ] KW: Full history saved. [2025-10-06T19:53:31.974693] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KW took 35.0s. Estimated remaining: 2h 40m 55s. Rate: 7.1 symbols/min [2025-10-06T19:53:32.141341] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:53:32.182769] [DEBUG] [LOCAL ] L: Loaded 41625 existing records from primary storage. [2025-10-06T19:53:32.183082] [INFO ] [MAIN ] L: Loaded 41625 existing records. [2025-10-06T19:53:32.362775] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:53:32.363153] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-06T19:53:32.363203] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-06T19:53:32.363437] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-06T19:53:32.363495] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-06T19:53:32.626882] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-06T19:53:32.626148] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-06T19:53:32.658532] [INFO ] [REMOTE ] KVYO: Full fetch complete (71739 records). [2025-10-06T19:53:32.664109] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-06T19:53:32.789382] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:53:33.261515] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T19:53:33.261919] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-06T19:53:33.268725] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-06T19:53:33.270839] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-06T19:53:33.270932] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-06T19:53:33.272624] [DEBUG] [LOCAL ] KVYO: Trimmed 71739 records to 50220 (keeping 200 days of data) [2025-10-06T19:53:33.444527] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-06T19:53:33.568475] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T19:53:33.591753] [DEBUG] [LOCAL ] KVYO: Primary data saved (50220 records). [2025-10-06T19:53:33.591906] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-06T19:53:33.591990] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KVYO took 45.7s. Estimated remaining: 2h 40m 40s. Rate: 7.1 symbols/min [2025-10-06T19:53:33.761661] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:53:33.810957] [DEBUG] [LOCAL ] LAC: Loaded 53142 existing records from primary storage. [2025-10-06T19:53:33.811337] [INFO ] [MAIN ] LAC: Loaded 53142 existing records. [2025-10-06T19:53:33.996894] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:53:33.997141] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-06T19:53:33.997191] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-06T19:53:33.997447] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-06T19:53:33.997504] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-06T19:53:34.236285] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-06T19:53:34.354724] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:53:34.603405] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T19:53:35.025599] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-06T19:53:35.776530] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-06T19:53:35.777869] [INFO ] [REMOTE ] KWR: Full fetch complete (23921 records). [2025-10-06T19:53:35.777943] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-06T19:53:35.840773] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-06T19:53:35.963482] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T19:53:36.194577] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-06T19:53:36.194689] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-06T19:53:36.195198] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-06T19:53:36.195238] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-06T19:53:36.195930] [DEBUG] [LOCAL ] KWR: Trimmed 23921 records to 16322 (keeping 200 days of data) [2025-10-06T19:53:36.299002] [DEBUG] [LOCAL ] KWR: Primary data saved (16322 records). [2025-10-06T19:53:36.299167] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-06T19:53:36.299252] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KWR took 30.7s. Estimated remaining: 2h 40m 26s. Rate: 7.1 symbols/min [2025-10-06T19:53:36.465122] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:53:36.489104] [DEBUG] [LOCAL ] LAD: Loaded 23804 existing records from primary storage. [2025-10-06T19:53:36.489422] [INFO ] [MAIN ] LAD: Loaded 23804 existing records. [2025-10-06T19:53:36.630638] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-06T19:53:36.691212] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:53:36.691440] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-06T19:53:36.691489] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-06T19:53:36.691743] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-06T19:53:36.691801] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-06T19:53:37.167136] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:53:37.217746] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T19:53:37.425598] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-06T19:53:38.226119] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-06T19:53:38.569526] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-06T19:53:38.932739] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T19:53:39.025541] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-06T19:53:39.634246] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T19:53:39.825525] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-06T19:53:40.492275] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T19:53:40.625489] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-06T19:53:40.982261] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T19:53:41.425542] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-06T19:53:42.225482] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-06T19:53:42.264033] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T19:53:42.655182] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T19:53:43.025628] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-06T19:53:43.492067] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-06T19:53:43.825546] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-06T19:53:44.536346] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T19:53:44.625540] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-06T19:53:45.110540] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T19:53:45.425561] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-06T19:53:46.225589] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-06T19:53:46.377609] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T19:53:47.030500] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-06T19:53:47.047174] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T19:53:47.267249] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T19:53:47.825557] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-06T19:53:48.261833] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T19:53:48.625511] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-06T19:53:48.997174] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-06T19:53:49.425531] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-06T19:53:50.136612] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T19:53:50.225539] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-06T19:53:50.750226] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T19:53:51.025538] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-06T19:53:51.218305] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T19:53:51.825553] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-06T19:53:52.039316] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T19:53:52.625511] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-06T19:53:52.695696] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T19:53:53.425579] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-06T19:53:53.765355] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T19:53:54.225584] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-06T19:53:54.438717] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T19:53:55.025608] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-06T19:53:55.454057] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T19:53:55.825550] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-06T19:53:56.609362] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T19:53:56.625476] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-06T19:53:56.982487] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T19:53:57.425589] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-06T19:53:58.225494] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-06T19:53:58.502971] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T19:53:58.628727] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-06T19:53:59.025556] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-06T19:53:59.441284] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-06T19:53:59.825519] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-06T19:54:00.005143] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T19:54:00.625524] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-06T19:54:01.164050] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T19:54:01.165855] [INFO ] [REMOTE ] KYN: Full fetch complete (44491 records). [2025-10-06T19:54:01.165944] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-06T19:54:01.430600] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-06T19:54:01.552125] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-06T19:54:01.552250] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-06T19:54:01.553138] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-06T19:54:01.553207] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-06T19:54:01.554171] [DEBUG] [LOCAL ] KYN: Trimmed 44491 records to 29937 (keeping 200 days of data) [2025-10-06T19:54:01.740042] [DEBUG] [LOCAL ] KYN: Primary data saved (29937 records). [2025-10-06T19:54:01.740237] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-06T19:54:01.740339] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. KYN took 34.9s. Estimated remaining: 2h 40m 33s. Rate: 7.1 symbols/min [2025-10-06T19:54:01.915957] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:54:01.954821] [DEBUG] [LOCAL ] LADR: Loaded 39456 existing records from primary storage. [2025-10-06T19:54:01.955175] [INFO ] [MAIN ] LADR: Loaded 39456 existing records. [2025-10-06T19:54:02.140887] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:54:02.141267] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-06T19:54:02.141422] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-06T19:54:02.141827] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-06T19:54:02.141887] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-06T19:54:02.230592] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-06T19:54:02.480422] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T19:54:02.595729] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:54:03.025578] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-06T19:54:03.061406] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T19:54:03.063249] [INFO ] [REMOTE ] LAD: Full fetch complete (35471 records). [2025-10-06T19:54:03.063320] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-06T19:54:03.442812] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-06T19:54:03.442911] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-06T19:54:03.443614] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-06T19:54:03.443804] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-06T19:54:03.444608] [DEBUG] [LOCAL ] LAD: Trimmed 35471 records to 23599 (keeping 200 days of data) [2025-10-06T19:54:03.568059] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-06T19:54:03.635664] [DEBUG] [LOCAL ] LAD: Primary data saved (23599 records). [2025-10-06T19:54:03.635814] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-06T19:54:03.635913] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. LAD took 27.3s. Estimated remaining: 2h 40m 19s. Rate: 7.1 symbols/min [2025-10-06T19:54:03.807457] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:54:03.825496] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-06T19:54:03.847489] [DEBUG] [LOCAL ] LANV: Loaded 2868 existing records from primary storage. [2025-10-06T19:54:03.847786] [INFO ] [MAIN ] LANV: Loaded 2868 existing records. [2025-10-06T19:54:04.045152] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:54:04.045614] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-06T19:54:04.045767] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-06T19:54:04.046096] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-06T19:54:04.046170] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-06T19:54:04.384229] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T19:54:04.477889] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:54:04.625581] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-06T19:54:05.425551] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-06T19:54:05.752006] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-06T19:54:06.084247] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T19:54:06.225541] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-06T19:54:06.791319] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T19:54:06.793964] [INFO ] [REMOTE ] L: Full fetch complete (59475 records). [2025-10-06T19:54:06.794098] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-06T19:54:07.030815] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-06T19:54:07.180944] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-06T19:54:07.181025] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-06T19:54:07.181951] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-06T19:54:07.182016] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-06T19:54:07.184213] [DEBUG] [LOCAL ] L: Trimmed 59475 records to 41113 (keeping 200 days of data) [2025-10-06T19:54:07.441789] [DEBUG] [LOCAL ] L: Primary data saved (41113 records). [2025-10-06T19:54:07.442125] [INFO ] [MAIN ] L: Full history saved. [2025-10-06T19:54:07.442335] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. L took 35.5s. Estimated remaining: 2h 40m 6s. Rate: 7.1 symbols/min [2025-10-06T19:54:07.616894] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T19:54:07.656223] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:54:07.656412] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-06T19:54:07.656469] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-06T19:54:07.656610] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-06T19:54:07.656834] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-06T19:54:07.656894] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-06T19:54:07.656928] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-06T19:54:07.829115] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-06T19:54:08.029249] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:54:08.379828] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-06T19:54:08.625590] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-06T19:54:08.818578] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T19:54:08.819011] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-06T19:54:08.819122] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T19:54:08.819173] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-06T19:54:08.819214] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T19:54:08.819260] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-06T19:54:08.819331] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-06T19:54:08.819374] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-06T19:54:08.819413] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-06T19:54:08.819459] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LAR took 1.4s. Estimated remaining: 2h 39m 51s. Rate: 7.1 symbols/min [2025-10-06T19:54:09.040149] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:54:09.059311] [DEBUG] [LOCAL ] LAW: Loaded 14355 existing records from primary storage. [2025-10-06T19:54:09.059621] [INFO ] [MAIN ] LAW: Loaded 14355 existing records. [2025-10-06T19:54:09.294218] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:54:09.294595] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-06T19:54:09.294762] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-06T19:54:09.295033] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-06T19:54:09.295184] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-06T19:54:09.426000] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-06T19:54:09.433859] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-06T19:54:09.695484] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:54:10.225531] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-06T19:54:10.785068] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T19:54:10.808008] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T19:54:11.025495] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-06T19:54:11.825517] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-06T19:54:12.625574] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-06T19:54:12.792045] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T19:54:12.920341] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-06T19:54:13.425484] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-06T19:54:13.690085] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T19:54:14.225544] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-06T19:54:15.025548] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-06T19:54:15.630370] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-06T19:54:15.671399] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T19:54:15.825505] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-06T19:54:16.066117] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T19:54:16.625515] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-06T19:54:17.025555] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T19:54:17.060351] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-06T19:54:17.425537] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-06T19:54:17.833008] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-06T19:54:18.225546] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-06T19:54:18.565964] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-06T19:54:19.025545] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-06T19:54:19.825559] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-06T19:54:20.270353] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-06T19:54:20.598129] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T19:54:20.625501] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-06T19:54:21.425554] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-06T19:54:21.885285] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-06T19:54:22.087851] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T19:54:22.225478] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-06T19:54:23.025530] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-06T19:54:23.612285] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T19:54:23.808932] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T19:54:23.825479] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-06T19:54:24.625485] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-06T19:54:24.697198] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-06T19:54:25.425522] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-06T19:54:25.959205] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T19:54:25.961895] [INFO ] [REMOTE ] LADR: Full fetch complete (55523 records). [2025-10-06T19:54:25.962026] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-06T19:54:26.037409] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T19:54:26.235088] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-06T19:54:26.373955] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-06T19:54:26.374038] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-06T19:54:26.375001] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-06T19:54:26.375070] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-06T19:54:26.376275] [DEBUG] [LOCAL ] LADR: Trimmed 55523 records to 39037 (keeping 200 days of data) [2025-10-06T19:54:26.615287] [DEBUG] [LOCAL ] LADR: Primary data saved (39037 records). [2025-10-06T19:54:26.615437] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-06T19:54:26.615521] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LADR took 24.9s. Estimated remaining: 2h 39m 51s. Rate: 7.1 symbols/min [2025-10-06T19:54:27.025584] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-06T19:54:27.599167] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-06T19:54:27.825540] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-06T19:54:28.409294] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-06T19:54:28.410298] [INFO ] [REMOTE ] LANV: Full fetch complete (4440 records). [2025-10-06T19:54:28.410544] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-06T19:54:28.499109] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-06T19:54:28.524856] [INFO ] [REMOTE ] LAC: Full fetch complete (75995 records). [2025-10-06T19:54:28.535577] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-06T19:54:28.647744] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-06T19:54:29.128340] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-06T19:54:29.134143] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-06T19:54:29.144625] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-06T19:54:29.149841] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-06T19:54:29.171303] [DEBUG] [LOCAL ] LANV: Trimmed 4440 records to 2796 (keeping 200 days of data) [2025-10-06T19:54:29.245290] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-06T19:54:29.245730] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-06T19:54:29.247632] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-06T19:54:29.248185] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-06T19:54:29.253047] [DEBUG] [LOCAL ] LANV: Primary data saved (2796 records). [2025-10-06T19:54:29.253249] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-06T19:54:29.253539] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LANV took 25.6s. Estimated remaining: 2h 39m 38s. Rate: 7.1 symbols/min [2025-10-06T19:54:29.253838] [DEBUG] [LOCAL ] LAC: Trimmed 75995 records to 52414 (keeping 200 days of data) [2025-10-06T19:54:29.615712] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T19:54:29.623030] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-06T19:54:29.656331] [DEBUG] [LOCAL ] LAC: Primary data saved (52414 records). [2025-10-06T19:54:29.656557] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-06T19:54:29.656704] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LAC took 56.1s. Estimated remaining: 2h 39m 22s. Rate: 7.1 symbols/min [2025-10-06T19:54:30.425177] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-06T19:54:30.428762] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-06T19:54:31.369485] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T19:54:31.373262] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-06T19:54:32.172432] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T19:54:32.176605] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-06T19:54:33.062758] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-06T19:54:33.066396] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-06T19:54:33.951884] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T19:54:33.955694] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-06T19:54:34.865685] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T19:54:34.869550] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-06T19:54:35.699457] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T19:54:35.700991] [INFO ] [REMOTE ] LAW: Full fetch complete (20713 records). [2025-10-06T19:54:35.701064] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-06T19:54:36.072624] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-06T19:54:36.072751] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-06T19:54:36.073248] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-06T19:54:36.073349] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-06T19:54:36.074175] [DEBUG] [LOCAL ] LAW: Trimmed 20713 records to 14213 (keeping 200 days of data) [2025-10-06T19:54:36.155218] [DEBUG] [LOCAL ] LAW: Primary data saved (14213 records). [2025-10-06T19:54:36.155386] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-06T19:54:36.155493] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LAW took 27.3s. Estimated remaining: 2h 39m 12s. Rate: 7.1 symbols/min [2025-10-06T19:54:36.854713] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:54:36.852976] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:54:36.849009] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:54:36.877917] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:54:36.969519] [DEBUG] [LOCAL ] LB: Loaded 38337 existing records from primary storage. [2025-10-06T19:54:36.970024] [INFO ] [MAIN ] LB: Loaded 38337 existing records. [2025-10-06T19:54:37.072377] [DEBUG] [LOCAL ] LBRT: Loaded 53687 existing records from primary storage. [2025-10-06T19:54:37.121846] [INFO ] [MAIN ] LBRT: Loaded 53687 existing records. [2025-10-06T19:54:37.132403] [DEBUG] [LOCAL ] LAZ: Loaded 45487 existing records from primary storage. [2025-10-06T19:54:37.122767] [DEBUG] [LOCAL ] LC: Loaded 48516 existing records from primary storage. [2025-10-06T19:54:37.203489] [INFO ] [MAIN ] LC: Loaded 48516 existing records. [2025-10-06T19:54:37.184317] [INFO ] [MAIN ] LAZ: Loaded 45487 existing records. [2025-10-06T19:54:37.423636] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:54:37.491596] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-06T19:54:37.542744] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-06T19:54:37.607231] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-06T19:54:37.630286] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-06T19:54:37.713834] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:54:37.789585] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-06T19:54:37.759789] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:54:37.853901] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-06T19:54:37.853759] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-06T19:54:37.844901] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:54:37.869682] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-06T19:54:37.885716] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-06T19:54:37.885635] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-06T19:54:37.880404] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-06T19:54:37.894421] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-06T19:54:37.894557] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-06T19:54:37.930763] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-06T19:54:37.930983] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-06T19:54:37.930905] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-06T19:54:39.189869] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:54:39.229145] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-06T19:54:39.302373] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:54:39.367018] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:54:39.361838] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-06T19:54:39.377526] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-06T19:54:39.408994] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:54:39.410134] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-06T19:54:40.637492] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T19:54:40.652073] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-06T19:54:40.709865] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T19:54:40.720392] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-06T19:54:40.746673] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T19:54:40.755529] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-06T19:54:41.107072] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T19:54:41.117507] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-06T19:54:41.875191] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T19:54:41.884916] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-06T19:54:42.292516] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T19:54:42.303228] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-06T19:54:42.326814] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T19:54:42.533237] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T19:54:43.025568] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-06T19:54:43.332805] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T19:54:43.704100] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T19:54:43.825546] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-06T19:54:44.213205] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T19:54:44.625552] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-06T19:54:45.107969] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-06T19:54:45.425587] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-06T19:54:46.077918] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T19:54:46.225568] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-06T19:54:47.025560] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-06T19:54:47.154909] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T19:54:47.263223] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T19:54:47.825540] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-06T19:54:48.493873] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T19:54:48.625511] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-06T19:54:49.094995] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T19:54:49.425581] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-06T19:54:49.993229] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T19:54:50.225586] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-06T19:54:51.025508] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-06T19:54:51.239173] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T19:54:51.768424] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T19:54:51.825514] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-06T19:54:52.429847] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T19:54:52.625535] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-06T19:54:53.204503] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T19:54:53.425540] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-06T19:54:54.193986] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T19:54:54.225477] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-06T19:54:55.025546] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-06T19:54:55.063148] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T19:54:55.495623] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-06T19:54:55.825499] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-06T19:54:56.254607] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T19:54:56.625530] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-06T19:54:57.360513] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T19:54:57.425503] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-06T19:54:58.084618] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T19:54:58.225540] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-06T19:54:59.025544] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-06T19:54:59.246142] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-06T19:54:59.664124] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T19:54:59.825527] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-06T19:55:00.244420] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T19:55:00.625703] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-06T19:55:01.178682] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T19:55:01.425595] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-06T19:55:01.873535] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-06T19:55:02.225529] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-06T19:55:03.025493] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-06T19:55:03.090591] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T19:55:03.829588] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-06T19:55:03.834871] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T19:55:04.236364] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T19:55:04.625589] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-06T19:55:05.425564] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-06T19:55:05.468371] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T19:55:06.230631] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-06T19:55:06.249801] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T19:55:06.728193] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T19:55:06.730759] [INFO ] [REMOTE ] LB: Full fetch complete (55940 records). [2025-10-06T19:55:06.730856] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-06T19:55:07.030744] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-06T19:55:07.165729] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-06T19:55:07.165819] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-06T19:55:07.166746] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-06T19:55:07.166808] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-06T19:55:07.168083] [DEBUG] [LOCAL ] LB: Trimmed 55940 records to 37793 (keeping 200 days of data) [2025-10-06T19:55:07.414793] [DEBUG] [LOCAL ] LB: Primary data saved (37793 records). [2025-10-06T19:55:07.414962] [INFO ] [MAIN ] LB: Full history saved. [2025-10-06T19:55:07.415359] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LB took 31.3s. Estimated remaining: 2h 39m 24s. Rate: 7.1 symbols/min [2025-10-06T19:55:07.605070] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T19:55:07.606888] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:55:07.609894] [INFO ] [REMOTE ] LAZ: Full fetch complete (65827 records). [2025-10-06T19:55:07.610009] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-06T19:55:07.846973] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-06T19:55:07.891711] [DEBUG] [LOCAL ] LCII: Loaded 28309 existing records from primary storage. [2025-10-06T19:55:07.931219] [INFO ] [MAIN ] LCII: Loaded 28309 existing records. [2025-10-06T19:55:08.196111] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-06T19:55:08.208879] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-06T19:55:08.230944] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-06T19:55:08.246360] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-06T19:55:08.250200] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:55:08.251350] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-06T19:55:08.251628] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-06T19:55:08.252127] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-06T19:55:08.252189] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-06T19:55:08.282722] [DEBUG] [LOCAL ] LAZ: Trimmed 65827 records to 44824 (keeping 200 days of data) [2025-10-06T19:55:08.721119] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:55:08.722271] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-06T19:55:08.902306] [DEBUG] [LOCAL ] LAZ: Primary data saved (44824 records). [2025-10-06T19:55:08.902482] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-06T19:55:08.902614] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LAZ took 32.7s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-06T19:55:09.010436] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-06T19:55:09.035482] [INFO ] [REMOTE ] LBRT: Full fetch complete (76564 records). [2025-10-06T19:55:09.063989] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-06T19:55:09.121766] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:55:09.533089] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-06T19:55:09.534275] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-06T19:55:09.534062] [DEBUG] [LOCAL ] LDI: Loaded 44902 existing records from primary storage. [2025-10-06T19:55:09.535470] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-06T19:55:09.535842] [INFO ] [MAIN ] LDI: Loaded 44902 existing records. [2025-10-06T19:55:09.535907] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-06T19:55:09.647539] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T19:55:09.645221] [DEBUG] [LOCAL ] LBRT: Trimmed 76564 records to 52930 (keeping 200 days of data) [2025-10-06T19:55:09.756423] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-06T19:55:09.828587] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:55:09.856037] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-06T19:55:09.869357] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-06T19:55:09.871314] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T19:55:09.871447] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-06T19:55:09.871931] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-06T19:55:10.229413] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-06T19:55:10.275874] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:55:10.494953] [DEBUG] [LOCAL ] LBRT: Primary data saved (52930 records). [2025-10-06T19:55:10.495106] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-06T19:55:10.495202] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LBRT took 34.3s. Estimated remaining: 2h 38m 54s. Rate: 7.1 symbols/min [2025-10-06T19:55:10.662054] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:55:10.707180] [DEBUG] [LOCAL ] LDOS: Loaded 46250 existing records from primary storage. [2025-10-06T19:55:10.707504] [INFO ] [MAIN ] LDOS: Loaded 46250 existing records. [2025-10-06T19:55:10.895951] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:55:10.896311] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-06T19:55:10.896363] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-06T19:55:10.898599] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-06T19:55:10.898704] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-06T19:55:11.030609] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-06T19:55:11.304946] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:55:11.393835] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T19:55:11.430205] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T19:55:11.825537] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-06T19:55:12.555341] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T19:55:12.625493] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-06T19:55:13.189428] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T19:55:13.430559] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-06T19:55:13.442098] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T19:55:14.225538] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-06T19:55:14.968773] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T19:55:14.971568] [INFO ] [REMOTE ] LC: Full fetch complete (70536 records). [2025-10-06T19:55:14.971717] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-06T19:55:15.038212] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-06T19:55:15.371681] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-06T19:55:15.371857] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-06T19:55:15.373051] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-06T19:55:15.373159] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-06T19:55:15.375151] [DEBUG] [LOCAL ] LC: Trimmed 70536 records to 47861 (keeping 200 days of data) [2025-10-06T19:55:15.605718] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T19:55:15.689002] [DEBUG] [LOCAL ] LC: Primary data saved (47861 records). [2025-10-06T19:55:15.689150] [INFO ] [MAIN ] LC: Full history saved. [2025-10-06T19:55:15.689235] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LC took 39.5s. Estimated remaining: 2h 38m 43s. Rate: 7.1 symbols/min [2025-10-06T19:55:15.834396] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-06T19:55:15.890784] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:55:15.910037] [DEBUG] [LOCAL ] LDP: Loaded 13110 existing records from primary storage. [2025-10-06T19:55:15.910438] [INFO ] [MAIN ] LDP: Loaded 13110 existing records. [2025-10-06T19:55:16.102153] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:55:16.102385] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-06T19:55:16.102435] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-06T19:55:16.103077] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-06T19:55:16.103139] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-06T19:55:16.462872] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:55:16.494142] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T19:55:16.625501] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-06T19:55:17.425570] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-06T19:55:17.488583] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T19:55:18.215080] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T19:55:18.225478] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-06T19:55:18.351515] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T19:55:19.025520] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-06T19:55:19.443062] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T19:55:19.825545] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-06T19:55:20.625546] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-06T19:55:20.737128] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T19:55:20.798720] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T19:55:21.425532] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-06T19:55:21.570629] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-06T19:55:22.225546] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-06T19:55:22.974345] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T19:55:23.025511] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-06T19:55:23.825527] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-06T19:55:23.996958] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T19:55:24.292398] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-06T19:55:24.371116] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-06T19:55:24.625528] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-06T19:55:25.425580] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-06T19:55:26.074192] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T19:55:26.225517] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-06T19:55:26.576547] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T19:55:27.025578] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-06T19:55:27.481938] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T19:55:27.553927] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-06T19:55:27.825533] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-06T19:55:28.625587] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-06T19:55:29.425535] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-06T19:55:29.582081] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T19:55:29.852108] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T19:55:30.225518] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-06T19:55:30.365045] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-06T19:55:31.025530] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-06T19:55:31.825488] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-06T19:55:31.865235] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T19:55:31.930960] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-06T19:55:32.625551] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-06T19:55:33.397740] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T19:55:33.425480] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-06T19:55:34.225624] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-06T19:55:34.263552] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T19:55:34.921829] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T19:55:35.025517] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-06T19:55:35.174459] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-06T19:55:35.825538] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-06T19:55:36.625603] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-06T19:55:37.252440] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-06T19:55:37.359126] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T19:55:37.428169] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-06T19:55:37.431135] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T19:55:38.225587] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-06T19:55:39.025559] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-06T19:55:39.505159] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-06T19:55:39.504298] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T19:55:39.514708] [INFO ] [REMOTE ] LDI: Full fetch complete (60806 records). [2025-10-06T19:55:39.514900] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-06T19:55:39.711226] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-06T19:55:39.830714] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-06T19:55:39.941444] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-06T19:55:39.941552] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-06T19:55:39.942495] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-06T19:55:39.942565] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-06T19:55:39.944009] [DEBUG] [LOCAL ] LDI: Trimmed 60806 records to 44307 (keeping 200 days of data) [2025-10-06T19:55:40.195744] [DEBUG] [LOCAL ] LDI: Primary data saved (44307 records). [2025-10-06T19:55:40.195921] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-06T19:55:40.196062] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LDI took 31.3s. Estimated remaining: 2h 38m 49s. Rate: 7.1 symbols/min [2025-10-06T19:55:40.369082] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:55:40.411612] [DEBUG] [LOCAL ] LEA: Loaded 42367 existing records from primary storage. [2025-10-06T19:55:40.411978] [INFO ] [MAIN ] LEA: Loaded 42367 existing records. [2025-10-06T19:55:40.593873] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:55:40.594110] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-06T19:55:40.594157] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-06T19:55:40.594672] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-06T19:55:40.594733] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-06T19:55:40.627589] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-06T19:55:40.966992] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:55:40.985993] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-06T19:55:41.425515] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-06T19:55:41.521550] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T19:55:42.225578] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-06T19:55:42.931807] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T19:55:43.026041] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-06T19:55:43.032194] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-06T19:55:43.825551] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-06T19:55:44.578541] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T19:55:44.625517] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-06T19:55:45.333803] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T19:55:45.359123] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T19:55:45.360399] [INFO ] [REMOTE ] LDP: Full fetch complete (19322 records). [2025-10-06T19:55:45.360478] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-06T19:55:45.430781] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-06T19:55:45.743886] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-06T19:55:45.743967] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-06T19:55:45.744377] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-06T19:55:45.744503] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-06T19:55:45.745085] [DEBUG] [LOCAL ] LDP: Trimmed 19322 records to 12935 (keeping 200 days of data) [2025-10-06T19:55:45.825002] [DEBUG] [LOCAL ] LDP: Primary data saved (12935 records). [2025-10-06T19:55:45.825156] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-06T19:55:45.825247] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LDP took 30.1s. Estimated remaining: 2h 38m 38s. Rate: 7.1 symbols/min [2025-10-06T19:55:45.988761] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:55:46.037750] [DEBUG] [LOCAL ] LEG: Loaded 50956 existing records from primary storage. [2025-10-06T19:55:46.038075] [INFO ] [MAIN ] LEG: Loaded 50956 existing records. [2025-10-06T19:55:46.212303] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:55:46.212500] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-06T19:55:46.212546] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-06T19:55:46.212770] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-06T19:55:46.212835] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-06T19:55:46.233035] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-06T19:55:46.566418] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:55:46.897843] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T19:55:46.900429] [INFO ] [REMOTE ] LDOS: Full fetch complete (67579 records). [2025-10-06T19:55:46.900524] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-06T19:55:47.038399] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-06T19:55:47.271423] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-06T19:55:47.294169] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-06T19:55:47.294313] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-06T19:55:47.295331] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-06T19:55:47.295414] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-06T19:55:47.294272] [INFO ] [REMOTE ] LCII: Full fetch complete (39161 records). [2025-10-06T19:55:47.295629] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-06T19:55:47.402460] [DEBUG] [LOCAL ] LDOS: Trimmed 67579 records to 45514 (keeping 200 days of data) [2025-10-06T19:55:47.825746] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-06T19:55:48.001898] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-06T19:55:48.002435] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-06T19:55:48.003685] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-06T19:55:48.003999] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-06T19:55:48.006987] [DEBUG] [LOCAL ] LCII: Trimmed 39161 records to 27789 (keeping 200 days of data) [2025-10-06T19:55:48.221916] [DEBUG] [LOCAL ] LCII: Primary data saved (27789 records). [2025-10-06T19:55:48.226267] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-06T19:55:48.226475] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LCII took 40.8s. Estimated remaining: 2h 38m 24s. Rate: 7.1 symbols/min [2025-10-06T19:55:48.406733] [DEBUG] [LOCAL ] LDOS: Primary data saved (45514 records). [2025-10-06T19:55:48.441796] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-06T19:55:48.457884] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 38.0s. Estimated remaining: 2h 38m 8s. Rate: 7.1 symbols/min [2025-10-06T19:55:48.460425] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:55:48.646070] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:55:48.681334] [DEBUG] [LOCAL ] LEO: Loaded 17457 existing records from primary storage. [2025-10-06T19:55:48.681738] [INFO ] [MAIN ] LEO: Loaded 17457 existing records. [2025-10-06T19:55:48.809945] [DEBUG] [LOCAL ] LEN: Loaded 53950 existing records from primary storage. [2025-10-06T19:55:48.814967] [INFO ] [MAIN ] LEN: Loaded 53950 existing records. [2025-10-06T19:55:49.036084] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:55:49.057221] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-06T19:55:49.078032] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-06T19:55:49.111558] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-06T19:55:49.159296] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:55:49.160791] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-06T19:55:49.176706] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-06T19:55:49.160151] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-06T19:55:49.194813] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-06T19:55:49.195216] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-06T19:55:49.254590] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-06T19:55:49.316726] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-06T19:55:49.678399] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-06T19:55:49.841580] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-06T19:55:49.969369] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:55:50.009639] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:55:50.225526] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-06T19:55:51.025546] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-06T19:55:51.139270] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T19:55:51.294353] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T19:55:51.448976] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T19:55:51.825521] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-06T19:55:52.625554] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-06T19:55:52.927461] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T19:55:52.956210] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T19:55:53.425577] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-06T19:55:54.193098] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T19:55:54.225482] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-06T19:55:54.973137] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T19:55:55.025511] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-06T19:55:55.268034] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-06T19:55:55.825568] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-06T19:55:56.625493] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-06T19:55:56.666394] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T19:55:56.935236] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T19:55:57.425528] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-06T19:55:58.225573] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-06T19:55:58.516406] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T19:55:58.609332] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T19:55:59.025593] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-06T19:55:59.585528] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-06T19:55:59.825539] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-06T19:56:00.527824] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T19:56:00.625571] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-06T19:56:01.425487] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-06T19:56:01.541552] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T19:56:02.091158] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T19:56:02.225527] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-06T19:56:03.025573] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-06T19:56:03.232700] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T19:56:03.738039] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T19:56:03.825539] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-06T19:56:04.279131] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-06T19:56:04.625533] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-06T19:56:05.425538] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-06T19:56:05.677113] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-06T19:56:06.225506] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-06T19:56:06.405346] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T19:56:06.605558] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T19:56:06.608323] [INFO ] [REMOTE ] LEA: Full fetch complete (60840 records). [2025-10-06T19:56:06.608482] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-06T19:56:07.022588] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-06T19:56:07.027296] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-06T19:56:07.027604] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-06T19:56:07.029812] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-06T19:56:07.030932] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-06T19:56:07.031183] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-06T19:56:07.032945] [DEBUG] [LOCAL ] LEA: Trimmed 60840 records to 41699 (keeping 200 days of data) [2025-10-06T19:56:07.290131] [DEBUG] [LOCAL ] LEA: Primary data saved (41699 records). [2025-10-06T19:56:07.290267] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-06T19:56:07.290364] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LEA took 27.1s. Estimated remaining: 2h 38m 9s. Rate: 7.1 symbols/min [2025-10-06T19:56:07.455385] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:56:07.506413] [DEBUG] [LOCAL ] LEVI: Loaded 52330 existing records from primary storage. [2025-10-06T19:56:07.506854] [INFO ] [MAIN ] LEVI: Loaded 52330 existing records. [2025-10-06T19:56:07.689169] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:56:07.689424] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-06T19:56:07.689480] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-06T19:56:07.691509] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-06T19:56:07.691585] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-06T19:56:07.835059] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-06T19:56:08.054710] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:56:08.625537] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-06T19:56:08.828105] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T19:56:08.986076] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T19:56:09.425612] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-06T19:56:09.726788] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T19:56:10.225544] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-06T19:56:10.319707] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T19:56:11.025580] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-06T19:56:11.825494] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-06T19:56:11.861232] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T19:56:12.073414] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T19:56:12.625532] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-06T19:56:13.425543] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-06T19:56:13.609781] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T19:56:13.736504] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T19:56:14.225526] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-06T19:56:14.577231] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T19:56:15.025528] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-06T19:56:15.677124] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T19:56:15.825551] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-06T19:56:15.913839] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T19:56:16.625547] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-06T19:56:17.262079] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T19:56:17.266741] [INFO ] [REMOTE ] LEG: Full fetch complete (73045 records). [2025-10-06T19:56:17.266996] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-06T19:56:17.432946] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-06T19:56:17.460518] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-06T19:56:17.699167] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-06T19:56:17.699253] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-06T19:56:17.700302] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-06T19:56:17.700367] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-06T19:56:17.702190] [DEBUG] [LOCAL ] LEG: Trimmed 73045 records to 50198 (keeping 200 days of data) [2025-10-06T19:56:17.998791] [DEBUG] [LOCAL ] LEG: Primary data saved (50198 records). [2025-10-06T19:56:17.998952] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-06T19:56:17.999056] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEG took 32.2s. Estimated remaining: 2h 38m 3s. Rate: 7.1 symbols/min [2025-10-06T19:56:18.176167] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:56:18.201490] [DEBUG] [LOCAL ] LFT: Loaded 18523 existing records from primary storage. [2025-10-06T19:56:18.201907] [INFO ] [MAIN ] LFT: Loaded 18523 existing records. [2025-10-06T19:56:18.230743] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-06T19:56:18.418153] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:56:18.418457] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-06T19:56:18.418522] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-06T19:56:18.418828] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-06T19:56:18.418888] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-06T19:56:18.798421] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:56:19.025582] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-06T19:56:19.201532] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T19:56:19.621699] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T19:56:19.622954] [INFO ] [REMOTE ] LEO: Full fetch complete (26830 records). [2025-10-06T19:56:19.623026] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-06T19:56:19.830731] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-06T19:56:20.021505] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-06T19:56:20.021717] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-06T19:56:20.022574] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-06T19:56:20.022714] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-06T19:56:20.023881] [DEBUG] [LOCAL ] LEO: Trimmed 26830 records to 16913 (keeping 200 days of data) [2025-10-06T19:56:20.147240] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-06T19:56:20.184695] [DEBUG] [LOCAL ] LEO: Primary data saved (16913 records). [2025-10-06T19:56:20.184881] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-06T19:56:20.184978] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEO took 31.7s. Estimated remaining: 2h 37m 49s. Rate: 7.1 symbols/min [2025-10-06T19:56:20.362589] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:56:20.376634] [DEBUG] [LOCAL ] LGI: Loaded 9934 existing records from primary storage. [2025-10-06T19:56:20.376914] [INFO ] [MAIN ] LGI: Loaded 9934 existing records. [2025-10-06T19:56:20.552519] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:56:20.552771] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-06T19:56:20.552826] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-06T19:56:20.553068] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-06T19:56:20.553126] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-06T19:56:20.630792] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-06T19:56:20.931948] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:56:20.934168] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T19:56:21.425592] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-06T19:56:22.160727] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T19:56:22.225523] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-06T19:56:22.641089] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-06T19:56:22.661506] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-06T19:56:23.025512] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-06T19:56:23.825504] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-06T19:56:23.869601] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T19:56:24.625602] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-06T19:56:25.343629] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-06T19:56:25.425531] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-06T19:56:25.836741] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-06T19:56:26.089014] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-06T19:56:26.225533] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-06T19:56:27.019096] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-06T19:56:27.025454] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-06T19:56:27.825498] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-06T19:56:27.836720] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T19:56:28.625529] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-06T19:56:29.377800] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T19:56:29.425577] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-06T19:56:29.561476] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T19:56:30.118575] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-06T19:56:30.225509] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-06T19:56:31.025563] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-06T19:56:31.825625] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-06T19:56:32.007280] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T19:56:32.625542] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-06T19:56:32.747998] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-06T19:56:32.751366] [INFO ] [REMOTE ] LEN: Full fetch complete (77043 records). [2025-10-06T19:56:32.751516] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-06T19:56:32.884690] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T19:56:33.177851] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-06T19:56:33.177938] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-06T19:56:33.179000] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-06T19:56:33.179067] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-06T19:56:33.180530] [DEBUG] [LOCAL ] LEN: Trimmed 77043 records to 53172 (keeping 200 days of data) [2025-10-06T19:56:33.427899] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-06T19:56:33.536393] [DEBUG] [LOCAL ] LEN: Primary data saved (53172 records). [2025-10-06T19:56:33.536679] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-06T19:56:33.536820] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEN took 45.3s. Estimated remaining: 2h 37m 45s. Rate: 7.1 symbols/min [2025-10-06T19:56:33.725965] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:56:33.768004] [DEBUG] [LOCAL ] LH: Loaded 38370 existing records from primary storage. [2025-10-06T19:56:33.768526] [INFO ] [MAIN ] LH: Loaded 38370 existing records. [2025-10-06T19:56:33.960552] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:56:33.960931] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-06T19:56:33.960995] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-06T19:56:33.961274] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-06T19:56:33.961335] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-06T19:56:34.230822] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-06T19:56:34.376486] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:56:34.431978] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T19:56:34.500578] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T19:56:34.947956] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-06T19:56:35.025535] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-06T19:56:35.825534] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-06T19:56:36.341638] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T19:56:36.625541] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-06T19:56:36.683840] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-06T19:56:37.425539] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-06T19:56:38.050800] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T19:56:38.052028] [INFO ] [REMOTE ] LGI: Full fetch complete (14322 records). [2025-10-06T19:56:38.052113] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-06T19:56:38.232512] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-06T19:56:38.524066] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-06T19:56:38.524240] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-06T19:56:38.524790] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-06T19:56:38.524896] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-06T19:56:38.541599] [DEBUG] [LOCAL ] LGI: Trimmed 14322 records to 9902 (keeping 200 days of data) [2025-10-06T19:56:38.586247] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-06T19:56:38.640764] [DEBUG] [LOCAL ] LGI: Primary data saved (9902 records). [2025-10-06T19:56:38.640935] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-06T19:56:38.641062] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LGI took 18.5s. Estimated remaining: 2h 37m 33s. Rate: 7.1 symbols/min [2025-10-06T19:56:38.823464] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:56:38.875372] [DEBUG] [LOCAL ] LHX: Loaded 49316 existing records from primary storage. [2025-10-06T19:56:38.875825] [INFO ] [MAIN ] LHX: Loaded 49316 existing records. [2025-10-06T19:56:39.030622] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-06T19:56:39.097163] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:56:39.097377] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-06T19:56:39.097426] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-06T19:56:39.099600] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-06T19:56:39.099697] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-06T19:56:39.540923] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:56:39.542419] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-06T19:56:39.825539] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-06T19:56:40.525143] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T19:56:40.625589] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-06T19:56:41.425990] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-06T19:56:41.431749] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T19:56:41.603174] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T19:56:42.225579] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-06T19:56:42.858075] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T19:56:43.025536] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-06T19:56:43.825517] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-06T19:56:43.974549] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T19:56:44.096868] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T19:56:44.625632] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-06T19:56:44.967923] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-06T19:56:45.425543] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-06T19:56:46.072163] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T19:56:46.225549] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-06T19:56:46.467479] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T19:56:47.025535] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-06T19:56:47.825503] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-06T19:56:48.014169] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T19:56:48.037580] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-06T19:56:48.625676] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-06T19:56:49.314316] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T19:56:49.425486] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-06T19:56:49.655631] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-06T19:56:50.225540] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-06T19:56:51.025549] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-06T19:56:51.173176] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T19:56:51.743477] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-06T19:56:51.825564] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-06T19:56:52.625502] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-06T19:56:52.769947] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T19:56:53.413049] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T19:56:53.414816] [INFO ] [REMOTE ] LFT: Full fetch complete (24051 records). [2025-10-06T19:56:53.416675] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T19:56:53.416757] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-06T19:56:53.426945] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-06T19:56:53.884763] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-06T19:56:53.884931] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-06T19:56:53.885499] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-06T19:56:53.885542] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-06T19:56:53.886525] [DEBUG] [LOCAL ] LFT: Trimmed 24051 records to 18421 (keeping 200 days of data) [2025-10-06T19:56:53.994921] [DEBUG] [LOCAL ] LFT: Primary data saved (18421 records). [2025-10-06T19:56:53.995085] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-06T19:56:53.995173] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LFT took 36.0s. Estimated remaining: 2h 37m 31s. Rate: 7.1 symbols/min [2025-10-06T19:56:54.199202] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:56:54.230757] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-06T19:56:54.233224] [DEBUG] [LOCAL ] LII: Loaded 28404 existing records from primary storage. [2025-10-06T19:56:54.233583] [INFO ] [MAIN ] LII: Loaded 28404 existing records. [2025-10-06T19:56:54.465366] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:56:54.467158] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-06T19:56:54.467223] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-06T19:56:54.468495] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-06T19:56:54.468556] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-06T19:56:54.831420] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:56:55.025507] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-06T19:56:55.386789] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-06T19:56:55.465993] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T19:56:55.825528] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-06T19:56:56.591886] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T19:56:56.625480] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-06T19:56:57.425527] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-06T19:56:57.730729] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-06T19:56:57.844412] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T19:56:57.847400] [INFO ] [REMOTE ] LEVI: Full fetch complete (74521 records). [2025-10-06T19:56:57.847502] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-06T19:56:58.236796] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-06T19:56:58.241562] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-06T19:56:58.241626] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-06T19:56:58.242883] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-06T19:56:58.242948] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-06T19:56:58.244604] [DEBUG] [LOCAL ] LEVI: Trimmed 74521 records to 51645 (keeping 200 days of data) [2025-10-06T19:56:58.567064] [DEBUG] [LOCAL ] LEVI: Primary data saved (51645 records). [2025-10-06T19:56:58.567219] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-06T19:56:58.567311] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LEVI took 51.3s. Estimated remaining: 2h 37m 19s. Rate: 7.1 symbols/min [2025-10-06T19:56:58.744985] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T19:56:58.771283] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:56:58.814439] [DEBUG] [LOCAL ] LION: Loaded 45007 existing records from primary storage. [2025-10-06T19:56:58.814873] [INFO ] [MAIN ] LION: Loaded 45007 existing records. [2025-10-06T19:56:58.992612] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:56:58.992888] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-06T19:56:58.992935] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-06T19:56:58.994462] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-06T19:56:58.994522] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-06T19:56:59.030843] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-06T19:56:59.353677] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:56:59.825533] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-06T19:57:00.039890] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T19:57:00.439806] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T19:57:00.476687] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-06T19:57:00.625517] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-06T19:57:01.425540] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-06T19:57:02.019522] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T19:57:02.225529] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-06T19:57:02.546570] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T19:57:03.025536] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-06T19:57:03.632879] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T19:57:03.825504] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-06T19:57:04.458560] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T19:57:04.625530] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-06T19:57:04.944626] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T19:57:05.425552] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-06T19:57:06.226877] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-06T19:57:06.230138] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T19:57:06.272754] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T19:57:07.025570] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-06T19:57:07.475034] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T19:57:07.825496] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-06T19:57:08.045124] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T19:57:08.625535] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-06T19:57:08.949541] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-06T19:57:09.425545] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-06T19:57:09.754226] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-06T19:57:10.225535] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-06T19:57:11.025568] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-06T19:57:11.162032] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T19:57:11.561423] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T19:57:11.825555] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-06T19:57:12.348983] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T19:57:12.625525] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-06T19:57:13.425489] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-06T19:57:13.543169] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T19:57:13.604083] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-06T19:57:14.225527] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-06T19:57:14.720451] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T19:57:14.722754] [INFO ] [REMOTE ] LH: Full fetch complete (55007 records). [2025-10-06T19:57:14.722835] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-06T19:57:15.030604] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-06T19:57:15.141469] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-06T19:57:15.141556] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-06T19:57:15.142482] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-06T19:57:15.142544] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-06T19:57:15.143674] [DEBUG] [LOCAL ] LH: Trimmed 55007 records to 37790 (keeping 200 days of data) [2025-10-06T19:57:15.402501] [DEBUG] [LOCAL ] LH: Primary data saved (37790 records). [2025-10-06T19:57:15.402689] [INFO ] [MAIN ] LH: Full history saved. [2025-10-06T19:57:15.402794] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LH took 41.9s. Estimated remaining: 2h 37m 18s. Rate: 7.1 symbols/min [2025-10-06T19:57:15.584317] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:57:15.591073] [DEBUG] [LOCAL ] LITB: Loaded 4388 existing records from primary storage. [2025-10-06T19:57:15.591291] [INFO ] [MAIN ] LITB: Loaded 4388 existing records. [2025-10-06T19:57:15.767246] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:57:15.767465] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-06T19:57:15.767522] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-06T19:57:15.767848] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-06T19:57:15.767906] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-06T19:57:15.830363] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-06T19:57:15.866148] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T19:57:15.886038] [INFO ] [REMOTE ] LHX: Full fetch complete (70691 records). [2025-10-06T19:57:15.897010] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-06T19:57:16.343833] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:57:16.544002] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-06T19:57:16.544142] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-06T19:57:16.545214] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-06T19:57:16.545337] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-06T19:57:16.561787] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T19:57:16.567745] [DEBUG] [LOCAL ] LHX: Trimmed 70691 records to 48609 (keeping 200 days of data) [2025-10-06T19:57:16.632849] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-06T19:57:16.873336] [DEBUG] [LOCAL ] LHX: Primary data saved (48609 records). [2025-10-06T19:57:16.873473] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-06T19:57:16.874324] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LHX took 38.2s. Estimated remaining: 2h 37m 3s. Rate: 7.1 symbols/min [2025-10-06T19:57:17.059450] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:57:17.114580] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-06T19:57:17.137822] [DEBUG] [LOCAL ] LLY: Loaded 54064 existing records from primary storage. [2025-10-06T19:57:17.138150] [INFO ] [MAIN ] LLY: Loaded 54064 existing records. [2025-10-06T19:57:17.317579] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:57:17.317865] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-06T19:57:17.317922] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-06T19:57:17.318436] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-06T19:57:17.318495] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-06T19:57:17.430729] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-06T19:57:17.687965] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:57:17.747719] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T19:57:17.749614] [INFO ] [REMOTE ] LII: Full fetch complete (41457 records). [2025-10-06T19:57:17.749736] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-06T19:57:18.015757] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T19:57:18.134329] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-06T19:57:18.134423] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-06T19:57:18.135229] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-06T19:57:18.135306] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-06T19:57:18.136435] [DEBUG] [LOCAL ] LII: Trimmed 41457 records to 28022 (keeping 200 days of data) [2025-10-06T19:57:18.228105] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-06T19:57:18.335021] [DEBUG] [LOCAL ] LII: Primary data saved (28022 records). [2025-10-06T19:57:18.335208] [INFO ] [MAIN ] LII: Full history saved. [2025-10-06T19:57:18.335303] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LII took 24.3s. Estimated remaining: 2h 36m 48s. Rate: 7.1 symbols/min [2025-10-06T19:57:18.511759] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:57:18.563504] [DEBUG] [LOCAL ] LMND: Loaded 52640 existing records from primary storage. [2025-10-06T19:57:18.563902] [INFO ] [MAIN ] LMND: Loaded 52640 existing records. [2025-10-06T19:57:18.748291] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:57:18.748563] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-06T19:57:18.748612] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-06T19:57:18.750509] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-06T19:57:18.750588] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-06T19:57:19.030750] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-06T19:57:19.106104] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:57:19.825535] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-06T19:57:19.881366] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T19:57:20.625543] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-06T19:57:21.085046] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-06T19:57:21.425508] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-06T19:57:21.673620] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-06T19:57:21.732100] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T19:57:22.225725] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-06T19:57:22.759997] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-06T19:57:22.948634] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T19:57:23.025490] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-06T19:57:23.825562] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-06T19:57:24.625522] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-06T19:57:24.908484] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T19:57:25.305018] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-06T19:57:25.385215] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T19:57:25.425532] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-06T19:57:26.225569] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-06T19:57:27.025608] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-06T19:57:27.110788] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T19:57:27.825538] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-06T19:57:28.358856] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-06T19:57:28.625576] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-06T19:57:29.414535] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T19:57:29.425475] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-06T19:57:29.525893] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-06T19:57:30.225584] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-06T19:57:30.446591] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T19:57:30.607492] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T19:57:30.610412] [INFO ] [REMOTE ] LION: Full fetch complete (55616 records). [2025-10-06T19:57:30.610538] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-06T19:57:31.000819] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-06T19:57:31.001012] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-06T19:57:31.002509] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-06T19:57:31.002734] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-06T19:57:31.010348] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-06T19:57:31.013926] [DEBUG] [LOCAL ] LION: Trimmed 55616 records to 44843 (keeping 200 days of data) [2025-10-06T19:57:31.056951] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-06T19:57:31.261576] [DEBUG] [LOCAL ] LION: Primary data saved (44843 records). [2025-10-06T19:57:31.261743] [INFO ] [MAIN ] LION: Full history saved. [2025-10-06T19:57:31.261832] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LION took 32.7s. Estimated remaining: 2h 36m 44s. Rate: 7.1 symbols/min [2025-10-06T19:57:31.434094] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:57:31.489432] [DEBUG] [LOCAL ] LMT: Loaded 50509 existing records from primary storage. [2025-10-06T19:57:31.489791] [INFO ] [MAIN ] LMT: Loaded 50509 existing records. [2025-10-06T19:57:31.664257] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:57:31.664470] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-06T19:57:31.664516] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-06T19:57:31.666088] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-06T19:57:31.666146] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-06T19:57:31.829527] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-06T19:57:32.020007] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:57:32.625586] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-06T19:57:33.017755] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-06T19:57:33.017563] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-06T19:57:33.425558] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-06T19:57:34.174922] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-06T19:57:34.225509] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-06T19:57:35.025545] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-06T19:57:35.534597] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-06T19:57:35.825520] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-06T19:57:36.580538] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T19:57:36.640080] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-06T19:57:36.670802] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-06T19:57:37.103042] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-06T19:57:37.425589] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-06T19:57:37.928192] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-06T19:57:38.225613] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-06T19:57:39.025486] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-06T19:57:39.296328] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-06T19:57:39.825584] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-06T19:57:40.625504] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-06T19:57:40.693033] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-06T19:57:40.988096] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-06T19:57:41.072828] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-06T19:57:41.425472] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-06T19:57:41.823356] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-06T19:57:41.859590] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T19:57:42.225522] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-06T19:57:43.025589] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-06T19:57:43.825556] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-06T19:57:44.417393] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-06T19:57:44.625533] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-06T19:57:44.839890] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-06T19:57:45.179547] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-06T19:57:45.203096] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-06T19:57:45.203836] [INFO ] [REMOTE ] LITB: Full fetch complete (5638 records). [2025-10-06T19:57:45.203941] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-06T19:57:45.430801] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-06T19:57:45.574460] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-06T19:57:45.574550] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-06T19:57:45.574742] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-06T19:57:45.574802] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-06T19:57:45.575310] [DEBUG] [LOCAL ] LITB: Trimmed 5638 records to 4278 (keeping 200 days of data) [2025-10-06T19:57:45.598310] [DEBUG] [LOCAL ] LITB: Primary data saved (4278 records). [2025-10-06T19:57:45.598380] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-06T19:57:45.598489] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LITB took 30.2s. Estimated remaining: 2h 36m 41s. Rate: 7.1 symbols/min [2025-10-06T19:57:45.764130] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:57:45.816258] [DEBUG] [LOCAL ] LNC: Loaded 52378 existing records from primary storage. [2025-10-06T19:57:45.816627] [INFO ] [MAIN ] LNC: Loaded 52378 existing records. [2025-10-06T19:57:45.994895] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:57:45.995139] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-06T19:57:45.995188] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-06T19:57:45.996522] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-06T19:57:45.996583] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-06T19:57:46.234806] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-06T19:57:46.357949] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:57:47.025632] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-06T19:57:47.445004] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T19:57:47.825531] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-06T19:57:48.386387] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-06T19:57:48.625534] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-06T19:57:49.333060] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-06T19:57:49.425485] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-06T19:57:49.916035] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-06T19:57:50.225530] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-06T19:57:50.788387] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-06T19:57:51.025543] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-06T19:57:51.825601] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-06T19:57:51.968252] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-06T19:57:52.075555] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T19:57:52.614234] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T19:57:52.625500] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-06T19:57:53.425586] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-06T19:57:53.777724] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-06T19:57:53.781134] [INFO ] [REMOTE ] LMND: Full fetch complete (75321 records). [2025-10-06T19:57:53.781310] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-06T19:57:54.206195] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-06T19:57:54.206378] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-06T19:57:54.208193] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-06T19:57:54.208456] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-06T19:57:54.210916] [DEBUG] [LOCAL ] LMND: Trimmed 75321 records to 51936 (keeping 200 days of data) [2025-10-06T19:57:54.289037] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-06T19:57:54.336462] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T19:57:54.587175] [DEBUG] [LOCAL ] LMND: Primary data saved (51936 records). [2025-10-06T19:57:54.587346] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-06T19:57:54.588243] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LMND took 36.3s. Estimated remaining: 2h 36m 33s. Rate: 7.1 symbols/min [2025-10-06T19:57:54.757562] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:57:54.764725] [DEBUG] [LOCAL ] LND: Loaded 4994 existing records from primary storage. [2025-10-06T19:57:54.764937] [INFO ] [MAIN ] LND: Loaded 4994 existing records. [2025-10-06T19:57:54.946366] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:57:54.946607] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-06T19:57:54.946684] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-06T19:57:54.947064] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-06T19:57:54.947123] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-06T19:57:55.035331] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-06T19:57:55.310157] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:57:55.825532] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-06T19:57:56.157857] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-10-06T19:57:56.365552] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-06T19:57:56.625573] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-06T19:57:56.643704] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T19:57:56.677833] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T19:57:57.425556] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-06T19:57:58.006826] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-06T19:57:58.225535] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-06T19:57:58.948368] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-06T19:57:59.025503] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-06T19:57:59.219849] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-06T19:57:59.703679] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-06T19:57:59.825539] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-06T19:58:00.396762] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T19:58:00.399798] [INFO ] [REMOTE ] LLY: Full fetch complete (77278 records). [2025-10-06T19:58:00.399921] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-06T19:58:00.630749] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-06T19:58:00.789060] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-06T19:58:00.789139] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-06T19:58:00.790203] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-06T19:58:00.790268] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-06T19:58:00.791770] [DEBUG] [LOCAL ] LLY: Trimmed 77278 records to 53304 (keeping 200 days of data) [2025-10-06T19:58:01.162201] [DEBUG] [LOCAL ] LLY: Primary data saved (53304 records). [2025-10-06T19:58:01.162442] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-06T19:58:01.163297] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LLY took 44.3s. Estimated remaining: 2h 36m 23s. Rate: 7.1 symbols/min [2025-10-06T19:58:01.347472] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:58:01.411322] [DEBUG] [LOCAL ] LNG: Loaded 52089 existing records from primary storage. [2025-10-06T19:58:01.411910] [INFO ] [MAIN ] LNG: Loaded 52089 existing records. [2025-10-06T19:58:01.434729] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-06T19:58:01.642127] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:58:01.642506] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-06T19:58:01.642582] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-06T19:58:01.644216] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-06T19:58:01.644279] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-06T19:58:02.036484] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:58:02.225551] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-06T19:58:02.869745] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-06T19:58:03.025562] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-06T19:58:03.250120] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T19:58:03.787049] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T19:58:03.825578] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-06T19:58:04.074591] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T19:58:04.625559] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-06T19:58:05.425594] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-06T19:58:05.672747] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T19:58:06.225573] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-06T19:58:06.603018] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-06T19:58:06.884439] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-06T19:58:07.025549] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-06T19:58:07.196860] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T19:58:07.618723] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-06T19:58:07.825537] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-06T19:58:08.625542] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-06T19:58:09.425531] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-06T19:58:09.572970] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T19:58:10.225529] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-06T19:58:10.689378] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-06T19:58:10.692268] [INFO ] [REMOTE ] LMT: Full fetch complete (72433 records). [2025-10-06T19:58:10.692394] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-06T19:58:11.030770] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-06T19:58:11.086705] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-06T19:58:11.087023] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-06T19:58:11.088355] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-06T19:58:11.088426] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-06T19:58:11.089993] [DEBUG] [LOCAL ] LMT: Trimmed 72433 records to 49826 (keeping 200 days of data) [2025-10-06T19:58:11.426288] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-06T19:58:11.453411] [DEBUG] [LOCAL ] LMT: Primary data saved (49826 records). [2025-10-06T19:58:11.453557] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-06T19:58:11.454575] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LMT took 40.2s. Estimated remaining: 2h 36m 16s. Rate: 7.1 symbols/min [2025-10-06T19:58:11.625306] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:58:11.640904] [DEBUG] [LOCAL ] LNN: Loaded 11340 existing records from primary storage. [2025-10-06T19:58:11.641466] [INFO ] [MAIN ] LNN: Loaded 11340 existing records. [2025-10-06T19:58:11.808421] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T19:58:11.832928] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-06T19:58:11.832820] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:58:11.836708] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-06T19:58:11.836976] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-06T19:58:11.837768] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-06T19:58:11.837832] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-06T19:58:11.995851] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-06T19:58:12.288101] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:58:12.625522] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-06T19:58:13.234628] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T19:58:13.425564] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-06T19:58:13.778158] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-06T19:58:14.225534] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-06T19:58:15.025616] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-06T19:58:15.059791] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T19:58:15.627981] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T19:58:15.825548] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-06T19:58:16.122106] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-06T19:58:16.402957] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-06T19:58:16.403877] [INFO ] [REMOTE ] LND: Full fetch complete (8298 records). [2025-10-06T19:58:16.403946] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-06T19:58:16.630783] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-06T19:58:16.849140] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-06T19:58:16.849232] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-06T19:58:16.849516] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-06T19:58:16.849587] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-06T19:58:16.850139] [DEBUG] [LOCAL ] LND: Trimmed 8298 records to 4946 (keeping 200 days of data) [2025-10-06T19:58:16.884027] [DEBUG] [LOCAL ] LND: Primary data saved (4946 records). [2025-10-06T19:58:16.884213] [INFO ] [MAIN ] LND: Full history saved. [2025-10-06T19:58:16.884345] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LND took 22.3s. Estimated remaining: 2h 36m 5s. Rate: 7.1 symbols/min [2025-10-06T19:58:17.109536] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:58:17.164492] [DEBUG] [LOCAL ] LOAR: Loaded 42186 existing records from primary storage. [2025-10-06T19:58:17.164918] [INFO ] [MAIN ] LOAR: Loaded 42186 existing records. [2025-10-06T19:58:17.397136] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:58:17.397452] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-06T19:58:17.397532] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-06T19:58:17.398097] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-06T19:58:17.398177] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-06T19:58:17.430798] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-06T19:58:17.856493] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:58:18.225489] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-06T19:58:18.294832] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-06T19:58:18.491681] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T19:58:19.025535] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-06T19:58:19.667594] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T19:58:19.825507] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-06T19:58:19.897526] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T19:58:20.625551] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-06T19:58:20.909013] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T19:58:21.425584] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-06T19:58:22.225553] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-06T19:58:22.306225] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T19:58:22.668418] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T19:58:23.025519] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-06T19:58:23.081538] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T19:58:23.825527] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-06T19:58:24.625606] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-06T19:58:24.848955] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T19:58:24.919921] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-06T19:58:25.380060] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T19:58:25.425475] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-06T19:58:26.225511] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-06T19:58:26.462772] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T19:58:27.025596] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-06T19:58:27.774665] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T19:58:27.778864] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T19:58:27.825554] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-06T19:58:28.625530] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-06T19:58:28.799805] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T19:58:29.425603] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-06T19:58:30.225495] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-06T19:58:30.352865] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T19:58:30.358020] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T19:58:31.025561] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-06T19:58:31.780105] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-06T19:58:31.825488] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-06T19:58:32.018228] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T19:58:32.625594] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-06T19:58:33.425474] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-06T19:58:33.460998] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T19:58:33.501503] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T19:58:34.225565] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-06T19:58:35.025506] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-06T19:58:35.308847] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T19:58:35.688284] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-06T19:58:35.825495] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-06T19:58:36.611060] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T19:58:36.614621] [INFO ] [REMOTE ] LNC: Full fetch complete (74338 records). [2025-10-06T19:58:36.614795] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-06T19:58:36.630707] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-06T19:58:37.022227] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-06T19:58:37.022394] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-06T19:58:37.023684] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-06T19:58:37.023751] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-06T19:58:37.025311] [DEBUG] [LOCAL ] LNC: Trimmed 74338 records to 51637 (keeping 200 days of data) [2025-10-06T19:58:37.295136] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T19:58:37.409111] [DEBUG] [LOCAL ] LNC: Primary data saved (51637 records). [2025-10-06T19:58:37.409328] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-06T19:58:37.409441] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNC took 51.8s. Estimated remaining: 2h 36m 7s. Rate: 7.1 symbols/min [2025-10-06T19:58:37.431933] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-06T19:58:37.592258] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:58:37.625287] [DEBUG] [LOCAL ] LOB: Loaded 27738 existing records from primary storage. [2025-10-06T19:58:37.625708] [INFO ] [MAIN ] LOB: Loaded 27738 existing records. [2025-10-06T19:58:37.811916] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:58:37.812262] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-06T19:58:37.812312] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-06T19:58:37.812560] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-06T19:58:37.812621] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-06T19:58:38.237015] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-06T19:58:38.244120] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:58:38.248449] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T19:58:38.250730] [INFO ] [REMOTE ] LNN: Full fetch complete (15614 records). [2025-10-06T19:58:38.250874] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-06T19:58:38.650779] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-06T19:58:38.651061] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-06T19:58:38.651684] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-06T19:58:38.651808] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-06T19:58:38.687750] [DEBUG] [LOCAL ] LNN: Trimmed 15614 records to 11248 (keeping 200 days of data) [2025-10-06T19:58:38.691769] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-06T19:58:38.789327] [DEBUG] [LOCAL ] LNN: Primary data saved (11248 records). [2025-10-06T19:58:38.789519] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-06T19:58:38.789635] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LNN took 27.3s. Estimated remaining: 2h 35m 52s. Rate: 7.1 symbols/min [2025-10-06T19:58:39.007891] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:58:39.014819] [DEBUG] [LOCAL ] LOCL: Loaded 3659 existing records from primary storage. [2025-10-06T19:58:39.015069] [INFO ] [MAIN ] LOCL: Loaded 3659 existing records. [2025-10-06T19:58:39.030816] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-06T19:58:39.216395] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:58:39.216694] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-06T19:58:39.216770] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-06T19:58:39.216996] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-06T19:58:39.217054] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-06T19:58:39.569044] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:58:39.773422] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T19:58:39.825483] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-06T19:58:40.625576] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-06T19:58:40.649097] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-06T19:58:40.651986] [INFO ] [REMOTE ] LNG: Full fetch complete (74657 records). [2025-10-06T19:58:40.652095] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-06T19:58:41.045235] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-06T19:58:41.045393] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-06T19:58:41.046578] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-06T19:58:41.046662] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-06T19:58:41.048169] [DEBUG] [LOCAL ] LNG: Trimmed 74657 records to 51321 (keeping 200 days of data) [2025-10-06T19:58:41.400856] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-06T19:58:41.419545] [DEBUG] [LOCAL ] LNG: Primary data saved (51321 records). [2025-10-06T19:58:41.419849] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-06T19:58:41.420697] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNG took 40.3s. Estimated remaining: 2h 35m 39s. Rate: 7.1 symbols/min [2025-10-06T19:58:41.432970] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-06T19:58:41.536154] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-06T19:58:41.607703] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:58:41.643030] [DEBUG] [LOCAL ] LOMA: Loaded 32578 existing records from primary storage. [2025-10-06T19:58:41.643415] [INFO ] [MAIN ] LOMA: Loaded 32578 existing records. [2025-10-06T19:58:41.820318] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:58:41.820580] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-06T19:58:41.820626] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-06T19:58:41.821901] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-06T19:58:41.821960] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-06T19:58:42.165054] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:58:42.225478] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-06T19:58:42.743505] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T19:58:42.746446] [INFO ] [REMOTE ] LOAR: Full fetch complete (56221 records). [2025-10-06T19:58:42.746609] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-06T19:58:43.034516] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-06T19:58:43.158450] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-06T19:58:43.158583] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-06T19:58:43.159575] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-06T19:58:43.159640] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-06T19:58:43.161084] [DEBUG] [LOCAL ] LOAR: Trimmed 56221 records to 42004 (keeping 200 days of data) [2025-10-06T19:58:43.405846] [DEBUG] [LOCAL ] LOAR: Primary data saved (42004 records). [2025-10-06T19:58:43.406050] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-06T19:58:43.406149] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOAR took 26.5s. Estimated remaining: 2h 35m 24s. Rate: 7.1 symbols/min [2025-10-06T19:58:43.511105] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-06T19:58:43.583802] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:58:43.635072] [DEBUG] [LOCAL ] LOW: Loaded 53704 existing records from primary storage. [2025-10-06T19:58:43.635485] [INFO ] [MAIN ] LOW: Loaded 53704 existing records. [2025-10-06T19:58:43.771693] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T19:58:43.832765] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-06T19:58:43.883607] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:58:43.883909] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-06T19:58:43.883957] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-06T19:58:43.884253] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-06T19:58:43.884313] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-06T19:58:44.298959] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:58:44.625600] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-06T19:58:45.278413] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-06T19:58:45.302030] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T19:58:45.425520] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-06T19:58:46.225599] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-06T19:58:46.444581] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T19:58:47.025600] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-06T19:58:47.825498] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-06T19:58:47.899736] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T19:58:48.012590] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T19:58:48.093612] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-06T19:58:48.625551] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-06T19:58:49.425599] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-06T19:58:50.201173] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-06T19:58:50.225514] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-06T19:58:50.455967] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-06T19:58:50.682464] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-06T19:58:51.025567] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-06T19:58:51.825526] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-06T19:58:52.271209] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-06T19:58:52.578623] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T19:58:52.625496] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-06T19:58:53.425583] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-06T19:58:54.225554] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-06T19:58:54.516305] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T19:58:54.681910] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T19:58:54.844920] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-06T19:58:55.025506] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-06T19:58:55.825492] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-06T19:58:56.133751] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T19:58:56.625496] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-06T19:58:57.056392] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T19:58:57.075590] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-06T19:58:57.425528] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-06T19:58:58.225591] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-06T19:58:58.530095] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T19:58:59.025577] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-06T19:58:59.825527] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-06T19:59:00.135922] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T19:59:00.258702] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T19:59:00.625542] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-06T19:59:01.174299] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-06T19:59:01.425563] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-06T19:59:02.225486] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-06T19:59:02.531233] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T19:59:02.799448] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-06T19:59:03.025523] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-06T19:59:03.604611] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T19:59:03.825504] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-06T19:59:04.436537] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-06T19:59:04.625500] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-06T19:59:04.768164] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T19:59:05.425487] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-06T19:59:05.812012] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T19:59:05.962220] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T19:59:05.963002] [INFO ] [REMOTE ] LOCL: Full fetch complete (4601 records). [2025-10-06T19:59:05.963074] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-06T19:59:06.230783] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-06T19:59:06.337659] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-06T19:59:06.337781] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-06T19:59:06.337982] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-06T19:59:06.338028] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-06T19:59:06.338443] [DEBUG] [LOCAL ] LOCL: Trimmed 4601 records to 3628 (keeping 200 days of data) [2025-10-06T19:59:06.358770] [DEBUG] [LOCAL ] LOCL: Primary data saved (3628 records). [2025-10-06T19:59:06.358856] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-06T19:59:06.358945] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LOCL took 27.6s. Estimated remaining: 2h 35m 29s. Rate: 7.1 symbols/min [2025-10-06T19:59:06.533824] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:59:06.577095] [DEBUG] [LOCAL ] LPG: Loaded 40441 existing records from primary storage. [2025-10-06T19:59:06.577400] [INFO ] [MAIN ] LPG: Loaded 40441 existing records. [2025-10-06T19:59:06.758785] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:59:06.759056] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-06T19:59:06.759110] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-06T19:59:06.759452] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-06T19:59:06.759512] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-06T19:59:07.034826] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-06T19:59:07.127709] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:59:07.485603] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T19:59:07.825528] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-06T19:59:08.117762] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T19:59:08.625553] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-06T19:59:09.425530] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-06T19:59:10.225595] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-06T19:59:10.271568] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-06T19:59:10.330302] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T19:59:10.397678] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-06T19:59:11.025574] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-06T19:59:11.065175] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T19:59:11.825529] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-06T19:59:12.625501] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-06T19:59:12.995446] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-06T19:59:13.023208] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-06T19:59:13.425564] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-06T19:59:14.225528] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-06T19:59:14.295040] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T19:59:15.025531] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-06T19:59:15.280003] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T19:59:15.782206] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T19:59:15.825487] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-06T19:59:16.198710] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T19:59:16.625580] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-06T19:59:17.031108] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T19:59:17.033322] [INFO ] [REMOTE ] LOMA: Full fetch complete (47785 records). [2025-10-06T19:59:17.033401] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-06T19:59:17.410848] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-06T19:59:17.410959] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-06T19:59:17.411854] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-06T19:59:17.411917] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-06T19:59:17.412959] [DEBUG] [LOCAL ] LOMA: Trimmed 47785 records to 32055 (keeping 200 days of data) [2025-10-06T19:59:17.463288] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-06T19:59:17.598215] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T19:59:17.601289] [INFO ] [REMOTE ] LOB: Full fetch complete (37983 records). [2025-10-06T19:59:17.601619] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-06T19:59:17.761678] [DEBUG] [LOCAL ] LOMA: Primary data saved (32055 records). [2025-10-06T19:59:17.770680] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-06T19:59:17.786453] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOMA took 36.4s. Estimated remaining: 2h 35m 23s. Rate: 7.1 symbols/min [2025-10-06T19:59:18.142611] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:59:18.172981] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-06T19:59:18.173069] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-06T19:59:18.173872] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-06T19:59:18.174024] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-06T19:59:18.175182] [DEBUG] [LOCAL ] LOB: Trimmed 37983 records to 27291 (keeping 200 days of data) [2025-10-06T19:59:18.237217] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-06T19:59:18.286538] [DEBUG] [LOCAL ] LPL: Loaded 27029 existing records from primary storage. [2025-10-06T19:59:18.287631] [INFO ] [MAIN ] LPL: Loaded 27029 existing records. [2025-10-06T19:59:18.480786] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:59:18.481634] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-06T19:59:18.482037] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-06T19:59:18.483621] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-06T19:59:18.485422] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-06T19:59:18.815855] [DEBUG] [LOCAL ] LOB: Primary data saved (27291 records). [2025-10-06T19:59:18.837061] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-06T19:59:18.837300] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOB took 41.4s. Estimated remaining: 2h 35m 8s. Rate: 7.1 symbols/min [2025-10-06T19:59:19.045832] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:59:19.050372] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-06T19:59:19.134635] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:59:19.174746] [DEBUG] [LOCAL ] LPX: Loaded 40238 existing records from primary storage. [2025-10-06T19:59:19.175092] [INFO ] [MAIN ] LPX: Loaded 40238 existing records. [2025-10-06T19:59:19.303735] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-06T19:59:19.336443] [INFO ] [REMOTE ] LOW: Full fetch complete (76515 records). [2025-10-06T19:59:19.340217] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-06T19:59:19.425743] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:59:19.458690] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-06T19:59:19.476742] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-06T19:59:19.488762] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-06T19:59:19.522997] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-06T19:59:20.131695] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-06T19:59:20.131903] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-06T19:59:20.133180] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-06T19:59:20.146463] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-06T19:59:20.205483] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T19:59:20.215331] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-06T19:59:20.221306] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-06T19:59:20.261069] [DEBUG] [LOCAL ] LOW: Trimmed 76515 records to 52956 (keeping 200 days of data) [2025-10-06T19:59:20.269084] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:59:20.611028] [DEBUG] [LOCAL ] LOW: Primary data saved (52956 records). [2025-10-06T19:59:20.611194] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-06T19:59:20.611280] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LOW took 37.2s. Estimated remaining: 2h 34m 54s. Rate: 7.1 symbols/min [2025-10-06T19:59:20.632528] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-06T19:59:20.788323] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:59:20.832512] [DEBUG] [LOCAL ] LRN: Loaded 40253 existing records from primary storage. [2025-10-06T19:59:20.832898] [INFO ] [MAIN ] LRN: Loaded 40253 existing records. [2025-10-06T19:59:21.007545] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:59:21.007823] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-06T19:59:21.007874] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-06T19:59:21.009219] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-06T19:59:21.009280] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-06T19:59:21.368295] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:59:21.379674] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T19:59:21.425480] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-06T19:59:22.225555] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-06T19:59:22.277711] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T19:59:22.815433] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T19:59:23.025516] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-06T19:59:23.271806] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T19:59:23.825522] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-06T19:59:24.427925] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T19:59:24.625533] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-06T19:59:25.425533] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-06T19:59:25.497716] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T19:59:26.150379] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T19:59:26.225474] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-06T19:59:26.861715] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T19:59:27.025483] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-06T19:59:27.395478] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-06T19:59:27.825560] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-06T19:59:28.624752] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T19:59:28.633326] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-06T19:59:28.807389] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T19:59:29.425553] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-06T19:59:30.118296] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T19:59:30.225501] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-06T19:59:30.596494] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T19:59:31.025538] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-06T19:59:31.671853] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T19:59:31.825546] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-06T19:59:32.302775] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-06T19:59:32.625524] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-06T19:59:32.886887] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T19:59:33.425536] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-06T19:59:33.834058] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-06T19:59:34.225537] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-06T19:59:35.010503] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T19:59:35.025475] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-06T19:59:35.483302] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T19:59:35.825554] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-06T19:59:36.453632] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T19:59:36.625623] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-06T19:59:37.309252] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T19:59:37.330741] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-06T19:59:37.425489] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-06T19:59:38.225569] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-06T19:59:38.616981] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T19:59:39.025510] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-06T19:59:39.289979] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T19:59:39.825525] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-06T19:59:40.568719] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T19:59:40.625497] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-06T19:59:41.343329] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T19:59:41.425524] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-06T19:59:42.145110] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T19:59:42.225556] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-06T19:59:42.830513] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T19:59:43.025504] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-06T19:59:43.690398] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T19:59:43.825479] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-06T19:59:44.060345] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T19:59:44.062777] [INFO ] [REMOTE ] LPX: Full fetch complete (58805 records). [2025-10-06T19:59:44.062865] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-06T19:59:44.456329] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-06T19:59:44.456432] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-06T19:59:44.457380] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-06T19:59:44.457448] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-06T19:59:44.458920] [DEBUG] [LOCAL ] LPX: Trimmed 58805 records to 39722 (keeping 200 days of data) [2025-10-06T19:59:44.631942] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-06T19:59:44.702870] [DEBUG] [LOCAL ] LPX: Primary data saved (39722 records). [2025-10-06T19:59:44.703005] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-06T19:59:44.703091] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LPX took 25.9s. Estimated remaining: 2h 34m 59s. Rate: 7.1 symbols/min [2025-10-06T19:59:44.908737] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:59:44.952321] [DEBUG] [LOCAL ] LSPD: Loaded 43487 existing records from primary storage. [2025-10-06T19:59:44.952681] [INFO ] [MAIN ] LSPD: Loaded 43487 existing records. [2025-10-06T19:59:45.107717] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T19:59:45.152933] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:59:45.153112] [INFO ] [REMOTE ] LPG: Full fetch complete (59478 records). [2025-10-06T19:59:45.153479] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-06T19:59:45.153631] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-06T19:59:45.153989] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-06T19:59:45.159832] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-06T19:59:45.198707] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-06T19:59:45.450308] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-06T19:59:45.937374] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-06T19:59:45.934230] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:59:45.937636] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-06T19:59:45.939074] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-06T19:59:45.939239] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-06T19:59:45.940430] [DEBUG] [LOCAL ] LPG: Trimmed 59478 records to 39788 (keeping 200 days of data) [2025-10-06T19:59:46.185841] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T19:59:46.225077] [DEBUG] [LOCAL ] LPG: Primary data saved (39788 records). [2025-10-06T19:59:46.225224] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-06T19:59:46.225307] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LPG took 39.9s. Estimated remaining: 2h 34m 44s. Rate: 7.1 symbols/min [2025-10-06T19:59:46.225493] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-06T19:59:46.402731] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:59:46.434997] [DEBUG] [LOCAL ] LTC: Loaded 30653 existing records from primary storage. [2025-10-06T19:59:46.435315] [INFO ] [MAIN ] LTC: Loaded 30653 existing records. [2025-10-06T19:59:46.625303] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:59:46.625554] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-06T19:59:46.625624] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-06T19:59:46.625962] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-06T19:59:46.626038] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-06T19:59:46.944064] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T19:59:47.006507] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:59:47.025494] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-06T19:59:47.825490] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-06T19:59:47.854933] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T19:59:47.923562] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T19:59:48.625582] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-06T19:59:49.289702] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T19:59:49.425506] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-06T19:59:49.838480] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T19:59:50.225572] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-06T19:59:50.997821] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T19:59:51.025507] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-06T19:59:51.762266] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T19:59:51.825474] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-06T19:59:52.633281] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-06T19:59:52.635907] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-06T19:59:53.327570] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T19:59:53.425510] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-06T19:59:54.018985] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T19:59:54.225533] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-06T19:59:54.955710] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T19:59:54.957987] [INFO ] [REMOTE ] LPL: Full fetch complete (35817 records). [2025-10-06T19:59:54.958067] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-06T19:59:55.032418] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-06T19:59:55.341264] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-06T19:59:55.341469] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-06T19:59:55.342240] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-06T19:59:55.342301] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-06T19:59:55.343222] [DEBUG] [LOCAL ] LPL: Trimmed 35817 records to 26953 (keeping 200 days of data) [2025-10-06T19:59:55.459790] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-06T19:59:55.513889] [DEBUG] [LOCAL ] LPL: Primary data saved (26953 records). [2025-10-06T19:59:55.514030] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-06T19:59:55.514114] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LPL took 37.7s. Estimated remaining: 2h 34m 36s. Rate: 7.1 symbols/min [2025-10-06T19:59:55.684592] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:59:55.733528] [DEBUG] [LOCAL ] LTH: Loaded 52466 existing records from primary storage. [2025-10-06T19:59:55.733878] [INFO ] [MAIN ] LTH: Loaded 52466 existing records. [2025-10-06T19:59:55.830630] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-06T19:59:55.911939] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:59:55.912149] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-06T19:59:55.912195] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-06T19:59:55.912419] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-06T19:59:55.912477] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-06T19:59:56.268966] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:59:56.571841] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T19:59:56.625479] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-06T19:59:57.253671] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T19:59:57.256595] [INFO ] [REMOTE ] LRN: Full fetch complete (58487 records). [2025-10-06T19:59:57.256752] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-06T19:59:57.431681] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-06T19:59:57.648228] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-06T19:59:57.648320] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-06T19:59:57.649355] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-06T19:59:57.649461] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-06T19:59:57.651215] [DEBUG] [LOCAL ] LRN: Trimmed 58487 records to 39757 (keeping 200 days of data) [2025-10-06T19:59:57.892999] [DEBUG] [LOCAL ] LRN: Primary data saved (39757 records). [2025-10-06T19:59:57.893152] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-06T19:59:57.893237] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LRN took 37.3s. Estimated remaining: 2h 34m 23s. Rate: 7.1 symbols/min [2025-10-06T19:59:58.064212] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T19:59:58.104558] [DEBUG] [LOCAL ] LTM: Loaded 37673 existing records from primary storage. [2025-10-06T19:59:58.104871] [INFO ] [MAIN ] LTM: Loaded 37673 existing records. [2025-10-06T19:59:58.228529] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-06T19:59:58.290393] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T19:59:58.290789] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-06T19:59:58.290850] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-06T19:59:58.291203] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-06T19:59:58.291265] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-06T19:59:58.422833] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T19:59:58.708583] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T19:59:58.736394] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T19:59:59.025556] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-06T19:59:59.569732] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T19:59:59.825505] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-06T20:00:00.587302] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T20:00:00.625558] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-06T20:00:01.048008] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T20:00:01.425571] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-06T20:00:02.225545] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-06T20:00:02.435171] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T20:00:02.564132] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T20:00:03.025548] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-06T20:00:03.701743] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T20:00:03.825527] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-06T20:00:04.494777] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T20:00:04.625529] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-06T20:00:05.425491] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-06T20:00:05.451004] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T20:00:05.803267] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T20:00:06.225520] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-06T20:00:06.814347] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T20:00:07.025534] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-06T20:00:07.825503] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-06T20:00:08.232470] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-06T20:00:08.625517] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-06T20:00:08.672606] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T20:00:09.163338] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T20:00:09.425504] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-06T20:00:10.187507] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T20:00:10.225520] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-06T20:00:10.923980] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T20:00:11.025514] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-06T20:00:11.801470] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T20:00:11.825533] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-06T20:00:12.294418] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T20:00:12.625536] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-06T20:00:13.425491] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-06T20:00:13.643317] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T20:00:13.896078] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-06T20:00:14.225549] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-06T20:00:14.552075] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-06T20:00:15.025543] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-06T20:00:15.512730] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-06T20:00:15.825570] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-06T20:00:16.523201] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T20:00:16.625543] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-06T20:00:17.224049] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T20:00:17.425589] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-06T20:00:17.962937] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T20:00:18.225694] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-06T20:00:19.025582] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-06T20:00:19.142865] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T20:00:19.358063] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T20:00:19.361278] [INFO ] [REMOTE ] LTC: Full fetch complete (43526 records). [2025-10-06T20:00:19.361479] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-06T20:00:19.830702] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-06T20:00:19.943590] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-06T20:00:19.943752] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-06T20:00:19.945087] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-06T20:00:19.945175] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-06T20:00:19.946729] [DEBUG] [LOCAL ] LTC: Trimmed 43526 records to 30240 (keeping 200 days of data) [2025-10-06T20:00:20.192814] [DEBUG] [LOCAL ] LTC: Primary data saved (30240 records). [2025-10-06T20:00:20.193006] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-06T20:00:20.193121] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LTC took 34.0s. Estimated remaining: 2h 34m 26s. Rate: 7.1 symbols/min [2025-10-06T20:00:20.409091] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-06T20:00:20.625493] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-06T20:00:21.425524] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-06T20:00:21.684285] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T20:00:22.167309] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T20:00:22.225476] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-06T20:00:22.863569] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T20:00:22.866338] [INFO ] [REMOTE ] LSPD: Full fetch complete (61710 records). [2025-10-06T20:00:22.866474] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-06T20:00:23.030686] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-06T20:00:23.286569] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-06T20:00:23.286692] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-06T20:00:23.287909] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-06T20:00:23.287979] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-06T20:00:23.289316] [DEBUG] [LOCAL ] LSPD: Trimmed 61710 records to 42804 (keeping 200 days of data) [2025-10-06T20:00:23.564486] [DEBUG] [LOCAL ] LSPD: Primary data saved (42804 records). [2025-10-06T20:00:23.564677] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-06T20:00:23.564790] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LSPD took 38.9s. Estimated remaining: 2h 34m 13s. Rate: 7.1 symbols/min [2025-10-06T20:00:23.720768] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T20:00:23.825562] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-06T20:00:24.749270] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T20:00:24.761119] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-06T20:00:25.093899] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T20:00:25.097195] [INFO ] [REMOTE ] LTM: Full fetch complete (48558 records). [2025-10-06T20:00:25.097327] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-06T20:00:25.519547] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-06T20:00:25.519683] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-06T20:00:25.520619] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-06T20:00:25.520700] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-06T20:00:25.522025] [DEBUG] [LOCAL ] LTM: Trimmed 48558 records to 37442 (keeping 200 days of data) [2025-10-06T20:00:25.754037] [DEBUG] [LOCAL ] LTM: Primary data saved (37442 records). [2025-10-06T20:00:25.754209] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-06T20:00:25.754328] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LTM took 27.9s. Estimated remaining: 2h 33m 59s. Rate: 7.1 symbols/min [2025-10-06T20:00:26.327198] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T20:00:26.339891] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-06T20:00:28.059936] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T20:00:28.071217] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-06T20:00:29.486170] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T20:00:29.489748] [INFO ] [REMOTE ] LTH: Full fetch complete (74258 records). [2025-10-06T20:00:29.489902] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-06T20:00:29.916709] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-06T20:00:29.916851] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-06T20:00:29.918165] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-06T20:00:29.918246] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-06T20:00:29.919896] [DEBUG] [LOCAL ] LTH: Trimmed 74258 records to 51720 (keeping 200 days of data) [2025-10-06T20:00:30.244304] [DEBUG] [LOCAL ] LTH: Primary data saved (51720 records). [2025-10-06T20:00:30.244460] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-06T20:00:30.244543] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 34.7s. Estimated remaining: 2h 33m 48s. Rate: 7.1 symbols/min [2025-10-06T20:00:30.914570] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:00:30.961232] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:00:30.962209] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:00:30.966545] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:00:31.032766] [DEBUG] [LOCAL ] LUCK: Loaded 24969 existing records from primary storage. [2025-10-06T20:00:31.046902] [INFO ] [MAIN ] LUCK: Loaded 24969 existing records. [2025-10-06T20:00:31.110704] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-10-06T20:00:31.146794] [INFO ] [MAIN ] LUV: Loaded 54469 existing records. [2025-10-06T20:00:31.235866] [DEBUG] [LOCAL ] LU: Loaded 49698 existing records from primary storage. [2025-10-06T20:00:31.275137] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-10-06T20:00:31.274297] [INFO ] [MAIN ] LU: Loaded 49698 existing records. [2025-10-06T20:00:31.295914] [INFO ] [MAIN ] LUMN: Loaded 54414 existing records. [2025-10-06T20:00:31.469161] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:00:31.474628] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-06T20:00:31.483857] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-06T20:00:31.599791] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-06T20:00:31.641428] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-06T20:00:31.669561] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:00:31.719161] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-06T20:00:31.757620] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-06T20:00:31.820632] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-06T20:00:31.862900] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-06T20:00:31.916464] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:00:31.967587] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-06T20:00:32.025182] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:00:32.039492] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-06T20:00:32.048938] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-06T20:00:32.068719] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-06T20:00:32.085247] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-06T20:00:32.076706] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-06T20:00:32.138572] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-06T20:00:32.143925] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-06T20:00:32.958973] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:00:33.065077] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:00:33.096023] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-06T20:00:33.090610] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-06T20:00:33.315124] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:00:33.339328] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-06T20:00:33.372101] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:00:33.372713] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-06T20:00:34.237606] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T20:00:34.242808] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-06T20:00:34.981928] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T20:00:34.992435] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-06T20:00:35.111946] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T20:00:35.123704] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-06T20:00:35.158784] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-06T20:00:35.170700] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-06T20:00:35.680490] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T20:00:35.688531] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-06T20:00:36.296560] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T20:00:36.306399] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-06T20:00:36.972373] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T20:00:36.984233] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-06T20:00:37.012917] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T20:00:37.020843] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-06T20:00:37.141818] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-06T20:00:37.153030] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-06T20:00:38.023473] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T20:00:38.033250] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-06T20:00:38.090228] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T20:00:38.225513] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-06T20:00:38.350454] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T20:00:39.025482] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-06T20:00:39.069509] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-06T20:00:39.128006] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T20:00:39.499889] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-06T20:00:39.825528] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-06T20:00:40.625524] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-06T20:00:41.038127] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-06T20:00:41.089853] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T20:00:41.425534] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-06T20:00:42.225497] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-06T20:00:42.494195] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T20:00:43.025490] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-06T20:00:43.125383] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T20:00:43.825540] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-06T20:00:44.292859] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-06T20:00:44.625542] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-06T20:00:45.035543] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T20:00:45.084294] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T20:00:45.425551] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-06T20:00:46.225511] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-06T20:00:46.536059] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-06T20:00:46.564143] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T20:00:47.025527] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-06T20:00:47.825483] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-06T20:00:48.169639] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-06T20:00:48.229509] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-06T20:00:48.625542] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-06T20:00:49.385772] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T20:00:49.425521] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-06T20:00:49.589485] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T20:00:50.225543] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-06T20:00:51.025524] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-06T20:00:51.110998] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T20:00:51.710227] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T20:00:51.825502] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-06T20:00:52.625514] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-06T20:00:52.868977] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T20:00:53.425606] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-06T20:00:53.863785] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-06T20:00:53.942605] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T20:00:54.225594] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-06T20:00:55.025569] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-06T20:00:55.134420] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T20:00:55.291084] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T20:00:55.825596] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-06T20:00:56.625497] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-06T20:00:56.738839] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T20:00:56.822993] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T20:00:56.824627] [INFO ] [REMOTE ] LUCK: Full fetch complete (40926 records). [2025-10-06T20:00:56.824774] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-06T20:00:57.197766] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-06T20:00:57.197867] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-06T20:00:57.198678] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-06T20:00:57.198765] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-06T20:00:57.199939] [DEBUG] [LOCAL ] LUCK: Trimmed 40926 records to 24535 (keeping 200 days of data) [2025-10-06T20:00:57.360341] [DEBUG] [LOCAL ] LUCK: Primary data saved (24535 records). [2025-10-06T20:00:57.360482] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-06T20:00:57.360569] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LUCK took 27.1s. Estimated remaining: 2h 33m 55s. Rate: 7.1 symbols/min [2025-10-06T20:00:57.433681] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-06T20:00:57.529158] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:00:57.529355] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-06T20:00:57.529409] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-06T20:00:57.529522] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-06T20:00:57.529563] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-06T20:00:57.529604] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-06T20:00:57.529635] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-06T20:00:57.884306] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:00:58.225525] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-06T20:00:58.413853] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:00:58.414175] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-06T20:00:58.414285] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:00:58.414336] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-06T20:00:58.414395] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:00:58.414466] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-06T20:00:58.414571] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-06T20:00:58.414630] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-06T20:00:58.414725] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-06T20:00:58.414796] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LUXE took 1.1s. Estimated remaining: 2h 33m 40s. Rate: 7.1 symbols/min [2025-10-06T20:00:58.587805] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:00:58.638378] [DEBUG] [LOCAL ] LVS: Loaded 54343 existing records from primary storage. [2025-10-06T20:00:58.638881] [INFO ] [MAIN ] LVS: Loaded 54343 existing records. [2025-10-06T20:00:58.881504] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:00:58.896590] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-06T20:00:58.896889] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-06T20:00:58.907496] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T20:00:58.910215] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-06T20:00:58.907072] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-06T20:00:58.910570] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-06T20:00:58.963792] [INFO ] [REMOTE ] LU: Full fetch complete (70347 records). [2025-10-06T20:00:58.969171] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-06T20:00:59.033264] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-06T20:00:59.642073] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:00:59.695560] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-06T20:00:59.695636] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-06T20:00:59.696637] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-06T20:00:59.696718] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-06T20:00:59.698087] [DEBUG] [LOCAL ] LU: Trimmed 70347 records to 48948 (keeping 200 days of data) [2025-10-06T20:00:59.853477] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-06T20:00:59.972009] [DEBUG] [LOCAL ] LU: Primary data saved (48948 records). [2025-10-06T20:00:59.972157] [INFO ] [MAIN ] LU: Full history saved. [2025-10-06T20:00:59.972246] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LU took 29.7s. Estimated remaining: 2h 33m 26s. Rate: 7.1 symbols/min [2025-10-06T20:01:00.144104] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:01:00.166826] [DEBUG] [LOCAL ] LVWR: Loaded 18043 existing records from primary storage. [2025-10-06T20:01:00.167149] [INFO ] [MAIN ] LVWR: Loaded 18043 existing records. [2025-10-06T20:01:00.346029] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:01:00.346245] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-06T20:01:00.346292] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-06T20:01:00.346506] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-06T20:01:00.346564] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-06T20:01:00.631349] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-06T20:01:00.722708] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:01:01.290079] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-06T20:01:01.425533] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-06T20:01:01.735963] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T20:01:02.225535] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-06T20:01:02.782366] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-06T20:01:03.025574] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-06T20:01:03.322130] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T20:01:03.583165] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T20:01:03.613090] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T20:01:03.825521] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-06T20:01:04.409054] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-06T20:01:04.625537] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-06T20:01:05.425614] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-06T20:01:06.225543] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-06T20:01:06.336587] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T20:01:06.340534] [INFO ] [REMOTE ] LUV: Full fetch complete (77729 records). [2025-10-06T20:01:06.340737] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-06T20:01:06.745068] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-06T20:01:06.745186] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-06T20:01:06.746303] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-06T20:01:06.746375] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-06T20:01:06.748156] [DEBUG] [LOCAL ] LUV: Trimmed 77729 records to 53689 (keeping 200 days of data) [2025-10-06T20:01:06.883459] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-06T20:01:07.051362] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-06T20:01:07.105935] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-06T20:01:07.106079] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-06T20:01:07.106172] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUV took 36.9s. Estimated remaining: 2h 33m 16s. Rate: 7.1 symbols/min [2025-10-06T20:01:07.284610] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:01:07.326583] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-06T20:01:07.384028] [DEBUG] [LOCAL ] LW: Loaded 51931 existing records from primary storage. [2025-10-06T20:01:07.384429] [INFO ] [MAIN ] LW: Loaded 51931 existing records. [2025-10-06T20:01:07.564078] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:01:07.564404] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-06T20:01:07.564477] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-06T20:01:07.564852] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-06T20:01:07.564933] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-06T20:01:07.678073] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-06T20:01:07.830721] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-06T20:01:07.950117] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:01:08.561296] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T20:01:08.625629] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-06T20:01:09.425535] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-06T20:01:10.225513] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-06T20:01:10.396419] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T20:01:11.025528] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-06T20:01:11.345493] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-06T20:01:11.348850] [INFO ] [REMOTE ] LUMN: Full fetch complete (77636 records). [2025-10-06T20:01:11.348990] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-06T20:01:11.742843] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-06T20:01:11.742972] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-06T20:01:11.744207] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-06T20:01:11.744286] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-06T20:01:11.746132] [DEBUG] [LOCAL ] LUMN: Trimmed 77636 records to 53638 (keeping 200 days of data) [2025-10-06T20:01:11.839743] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-06T20:01:12.103397] [DEBUG] [LOCAL ] LUMN: Primary data saved (53638 records). [2025-10-06T20:01:12.103580] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-06T20:01:12.103730] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LUMN took 41.9s. Estimated remaining: 2h 33m 5s. Rate: 7.1 symbols/min [2025-10-06T20:01:12.391492] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:01:12.426688] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-06T20:01:12.502190] [DEBUG] [LOCAL ] LXFR: Loaded 17050 existing records from primary storage. [2025-10-06T20:01:12.503126] [INFO ] [MAIN ] LXFR: Loaded 17050 existing records. [2025-10-06T20:01:12.532566] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T20:01:12.642833] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-06T20:01:12.685819] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T20:01:12.821597] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:01:12.821950] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-06T20:01:12.822020] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-06T20:01:12.822257] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-06T20:01:12.822328] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-06T20:01:13.208556] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:01:13.425540] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-06T20:01:14.230619] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-06T20:01:14.260153] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T20:01:14.417836] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T20:01:15.025530] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-06T20:01:15.825523] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-06T20:01:15.952571] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T20:01:16.317997] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T20:01:16.625738] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-06T20:01:17.425488] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-06T20:01:17.727022] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T20:01:17.770026] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-06T20:01:18.225556] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-06T20:01:18.416408] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T20:01:19.025544] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-06T20:01:19.825492] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-06T20:01:20.066241] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T20:01:20.152718] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-06T20:01:20.625584] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-06T20:01:21.241296] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T20:01:21.259551] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-06T20:01:21.425529] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-06T20:01:22.225498] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-06T20:01:22.471312] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T20:01:23.025514] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-06T20:01:23.288159] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T20:01:23.825557] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-06T20:01:24.625562] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-06T20:01:24.781754] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T20:01:25.425592] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-06T20:01:25.664456] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T20:01:25.725064] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-06T20:01:26.225522] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-06T20:01:26.346611] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T20:01:26.348121] [INFO ] [REMOTE ] LVWR: Full fetch complete (20190 records). [2025-10-06T20:01:26.348196] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-06T20:01:26.732020] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-06T20:01:26.732129] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-06T20:01:26.732585] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-06T20:01:26.732625] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-06T20:01:26.733362] [DEBUG] [LOCAL ] LVWR: Trimmed 20190 records to 18041 (keeping 200 days of data) [2025-10-06T20:01:26.834083] [DEBUG] [LOCAL ] LVWR: Primary data saved (18041 records). [2025-10-06T20:01:26.834242] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-06T20:01:26.834332] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LVWR took 26.9s. Estimated remaining: 2h 33m 2s. Rate: 7.1 symbols/min [2025-10-06T20:01:27.013158] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:01:27.025519] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-06T20:01:27.062956] [DEBUG] [LOCAL ] LXP: Loaded 51444 existing records from primary storage. [2025-10-06T20:01:27.063306] [INFO ] [MAIN ] LXP: Loaded 51444 existing records. [2025-10-06T20:01:27.246091] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:01:27.246436] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-06T20:01:27.246493] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-06T20:01:27.246858] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-06T20:01:27.246919] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-06T20:01:27.629055] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:01:27.825493] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-06T20:01:28.049498] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T20:01:28.049982] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T20:01:28.625597] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-06T20:01:29.425496] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-06T20:01:29.567928] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T20:01:29.601349] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T20:01:30.225556] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-06T20:01:31.027457] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-06T20:01:31.033527] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T20:01:31.388476] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T20:01:31.825553] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-06T20:01:32.591531] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T20:01:32.625499] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-06T20:01:33.425581] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-06T20:01:33.569394] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T20:01:33.739755] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T20:01:34.139518] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-06T20:01:34.225480] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-06T20:01:35.025536] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-06T20:01:35.825562] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-06T20:01:36.092730] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-06T20:01:36.625555] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-06T20:01:37.038112] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-06T20:01:37.250839] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-06T20:01:37.425509] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-06T20:01:37.559303] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T20:01:38.225543] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-06T20:01:38.937204] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T20:01:39.025533] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-06T20:01:39.825514] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-06T20:01:39.905710] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T20:01:40.496673] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-06T20:01:40.497983] [INFO ] [REMOTE ] LXFR: Full fetch complete (25023 records). [2025-10-06T20:01:40.498078] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-06T20:01:40.630383] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-06T20:01:40.768101] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-06T20:01:40.833197] [INFO ] [REMOTE ] LVS: Full fetch complete (77517 records). [2025-10-06T20:01:40.843941] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-06T20:01:41.053608] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-06T20:01:41.054153] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-06T20:01:41.054845] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-06T20:01:41.060352] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-06T20:01:41.095603] [DEBUG] [LOCAL ] LXFR: Trimmed 25023 records to 16808 (keeping 200 days of data) [2025-10-06T20:01:41.429840] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-06T20:01:41.460020] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-06T20:01:41.460807] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-06T20:01:41.462495] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-06T20:01:41.463269] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-06T20:01:41.467961] [DEBUG] [LOCAL ] LVS: Trimmed 77517 records to 53566 (keeping 200 days of data) [2025-10-06T20:01:41.549663] [DEBUG] [LOCAL ] LXFR: Primary data saved (16808 records). [2025-10-06T20:01:41.576028] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-06T20:01:41.576176] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LXFR took 29.5s. Estimated remaining: 2h 32m 59s. Rate: 7.1 symbols/min [2025-10-06T20:01:41.761391] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:01:41.803893] [DEBUG] [LOCAL ] LXU: Loaded 32152 existing records from primary storage. [2025-10-06T20:01:41.805360] [INFO ] [MAIN ] LXU: Loaded 32152 existing records. [2025-10-06T20:01:42.003487] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:01:42.004105] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-06T20:01:42.004459] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-06T20:01:42.008136] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-06T20:01:42.008257] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-06T20:01:42.510385] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:01:42.512195] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-06T20:01:42.549672] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-06T20:01:42.653410] [DEBUG] [LOCAL ] LVS: Primary data saved (53566 records). [2025-10-06T20:01:42.653575] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-06T20:01:42.653742] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LVS took 44.2s. Estimated remaining: 2h 32m 44s. Rate: 7.1 symbols/min [2025-10-06T20:01:42.830615] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:01:42.881099] [DEBUG] [LOCAL ] LYB: Loaded 54382 existing records from primary storage. [2025-10-06T20:01:42.881442] [INFO ] [MAIN ] LYB: Loaded 54382 existing records. [2025-10-06T20:01:43.035327] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-06T20:01:43.069363] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:01:43.069950] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-06T20:01:43.070032] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-06T20:01:43.070340] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-06T20:01:43.070447] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-06T20:01:43.319241] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T20:01:43.516936] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:01:43.628381] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T20:01:43.825526] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-06T20:01:44.625597] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-06T20:01:44.683367] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-06T20:01:44.686374] [INFO ] [REMOTE ] LW: Full fetch complete (74688 records). [2025-10-06T20:01:44.686486] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-06T20:01:45.079309] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-06T20:01:45.079408] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-06T20:01:45.080479] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-06T20:01:45.080554] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-06T20:01:45.082067] [DEBUG] [LOCAL ] LW: Trimmed 74688 records to 51196 (keeping 200 days of data) [2025-10-06T20:01:45.403061] [DEBUG] [LOCAL ] LW: Primary data saved (51196 records). [2025-10-06T20:01:45.403333] [INFO ] [MAIN ] LW: Full history saved. [2025-10-06T20:01:45.403443] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LW took 38.3s. Estimated remaining: 2h 32m 31s. Rate: 7.1 symbols/min [2025-10-06T20:01:45.435554] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-06T20:01:45.590633] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:01:45.628616] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T20:01:45.684455] [DEBUG] [LOCAL ] LYG: Loaded 53556 existing records from primary storage. [2025-10-06T20:01:45.684860] [INFO ] [MAIN ] LYG: Loaded 53556 existing records. [2025-10-06T20:01:45.868841] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:01:45.869076] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-06T20:01:45.869144] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-06T20:01:45.869510] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-06T20:01:45.869593] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-06T20:01:46.247492] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:01:46.241575] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-06T20:01:46.311439] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T20:01:46.895823] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T20:01:47.025498] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-06T20:01:47.825535] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-06T20:01:47.993173] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T20:01:48.625560] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-06T20:01:48.765343] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T20:01:48.813230] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T20:01:49.425592] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-06T20:01:50.225549] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-06T20:01:50.437101] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T20:01:50.819488] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T20:01:51.025533] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-06T20:01:51.654238] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T20:01:51.825522] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-06T20:01:52.110432] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-06T20:01:52.625536] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-06T20:01:53.261805] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T20:01:53.425582] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-06T20:01:54.225570] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-06T20:01:54.616930] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T20:01:54.820844] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T20:01:55.025524] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-06T20:01:55.825502] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-06T20:01:55.968564] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T20:01:56.625549] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-06T20:01:56.839363] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T20:01:57.425500] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-06T20:01:57.497958] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T20:01:57.972975] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T20:01:58.225528] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-06T20:01:59.025514] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-06T20:01:59.201311] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T20:01:59.523864] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-06T20:01:59.825494] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-06T20:02:00.475724] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T20:02:00.478663] [INFO ] [REMOTE ] LXP: Full fetch complete (72697 records). [2025-10-06T20:02:00.478767] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-06T20:02:00.630624] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-06T20:02:00.884761] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-06T20:02:00.885022] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-06T20:02:00.886222] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-06T20:02:00.886329] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-06T20:02:00.904871] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T20:02:00.911442] [DEBUG] [LOCAL ] LXP: Trimmed 72697 records to 50733 (keeping 200 days of data) [2025-10-06T20:02:01.212845] [DEBUG] [LOCAL ] LXP: Primary data saved (50733 records). [2025-10-06T20:02:01.213037] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-06T20:02:01.213153] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXP took 34.4s. Estimated remaining: 2h 32m 28s. Rate: 7.1 symbols/min [2025-10-06T20:02:01.387996] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:02:01.437360] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-06T20:02:01.440345] [DEBUG] [LOCAL ] LYV: Loaded 51873 existing records from primary storage. [2025-10-06T20:02:01.440666] [INFO ] [MAIN ] LYV: Loaded 51873 existing records. [2025-10-06T20:02:01.620009] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:02:01.620226] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-06T20:02:01.620273] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-06T20:02:01.620823] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-06T20:02:01.620881] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-06T20:02:01.986808] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:02:02.225573] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-06T20:02:02.587205] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-06T20:02:02.897034] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T20:02:03.025583] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-06T20:02:03.825483] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-06T20:02:04.044706] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T20:02:04.046705] [INFO ] [REMOTE ] LXU: Full fetch complete (45119 records). [2025-10-06T20:02:04.046799] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-06T20:02:04.433933] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-06T20:02:04.484171] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-06T20:02:04.484590] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-06T20:02:04.485580] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-06T20:02:04.485665] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-06T20:02:04.486638] [DEBUG] [LOCAL ] LXU: Trimmed 45119 records to 31804 (keeping 200 days of data) [2025-10-06T20:02:04.633205] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-06T20:02:04.679058] [DEBUG] [LOCAL ] LXU: Primary data saved (31804 records). [2025-10-06T20:02:04.679215] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-06T20:02:04.679324] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXU took 23.1s. Estimated remaining: 2h 32m 16s. Rate: 7.1 symbols/min [2025-10-06T20:02:04.887074] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:02:04.930192] [DEBUG] [LOCAL ] LZB: Loaded 35982 existing records from primary storage. [2025-10-06T20:02:04.930591] [INFO ] [MAIN ] LZB: Loaded 35982 existing records. [2025-10-06T20:02:05.140948] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:02:05.141304] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-06T20:02:05.141381] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-06T20:02:05.142324] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-06T20:02:05.142405] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-06T20:02:05.428607] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-06T20:02:05.659982] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:02:05.692950] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-06T20:02:06.225520] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-06T20:02:06.521748] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-06T20:02:07.025501] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-06T20:02:07.421013] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-06T20:02:07.825501] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-06T20:02:07.869398] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T20:02:08.519219] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T20:02:08.625542] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-06T20:02:09.425507] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-06T20:02:09.671495] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-06T20:02:10.225563] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-06T20:02:10.569018] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-06T20:02:11.025553] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-06T20:02:11.293529] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-06T20:02:11.825501] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-06T20:02:11.933554] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T20:02:12.625538] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-06T20:02:12.844824] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T20:02:13.425564] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-06T20:02:13.790997] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-06T20:02:14.225521] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-06T20:02:14.474389] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-06T20:02:14.938285] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T20:02:15.025471] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-06T20:02:15.185582] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T20:02:15.825566] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-06T20:02:16.625500] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-06T20:02:16.834599] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-06T20:02:16.837730] [INFO ] [REMOTE ] LYB: Full fetch complete (77461 records). [2025-10-06T20:02:16.837846] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-06T20:02:17.248604] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-06T20:02:17.248858] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-06T20:02:17.250217] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-06T20:02:17.250310] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-06T20:02:17.251978] [DEBUG] [LOCAL ] LYB: Trimmed 77461 records to 53609 (keeping 200 days of data) [2025-10-06T20:02:17.453808] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-06T20:02:17.512041] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T20:02:17.633936] [DEBUG] [LOCAL ] LYB: Primary data saved (53609 records). [2025-10-06T20:02:17.634093] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-06T20:02:17.634181] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LYB took 35.0s. Estimated remaining: 2h 32m 11s. Rate: 7.1 symbols/min [2025-10-06T20:02:17.804502] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:02:17.842990] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T20:02:17.859707] [DEBUG] [LOCAL ] LZM: Loaded 14413 existing records from primary storage. [2025-10-06T20:02:17.860012] [INFO ] [MAIN ] LZM: Loaded 14413 existing records. [2025-10-06T20:02:18.050894] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:02:18.051201] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-06T20:02:18.051285] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-06T20:02:18.051908] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-06T20:02:18.052201] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-06T20:02:18.233864] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-06T20:02:18.476221] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:02:19.025528] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-06T20:02:19.320923] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-06T20:02:19.825589] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-06T20:02:19.898776] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T20:02:20.518613] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T20:02:20.538397] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-06T20:02:20.625536] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-06T20:02:21.425536] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-06T20:02:21.639704] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-06T20:02:22.112489] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-06T20:02:22.225545] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-06T20:02:23.025617] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-06T20:02:23.825494] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-06T20:02:24.018675] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T20:02:24.083135] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T20:02:24.547686] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-06T20:02:24.625508] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-06T20:02:25.425516] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-06T20:02:25.690328] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T20:02:26.225588] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-06T20:02:26.806065] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T20:02:27.025532] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-06T20:02:27.230562] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-06T20:02:27.825527] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-06T20:02:28.507850] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T20:02:28.510849] [INFO ] [REMOTE ] LYG: Full fetch complete (76051 records). [2025-10-06T20:02:28.510993] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-06T20:02:28.630706] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-06T20:02:28.931852] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-06T20:02:28.931960] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-06T20:02:28.933292] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-06T20:02:28.933998] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-06T20:02:28.936470] [DEBUG] [LOCAL ] LYG: Trimmed 76051 records to 52778 (keeping 200 days of data) [2025-10-06T20:02:29.201904] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-06T20:02:29.324897] [DEBUG] [LOCAL ] LYG: Primary data saved (52778 records). [2025-10-06T20:02:29.325104] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-06T20:02:29.325212] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYG took 43.9s. Estimated remaining: 2h 32m 5s. Rate: 7.1 symbols/min [2025-10-06T20:02:29.430674] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-06T20:02:29.518870] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:02:29.571277] [DEBUG] [LOCAL ] M: Loaded 54314 existing records from primary storage. [2025-10-06T20:02:29.571632] [INFO ] [MAIN ] M: Loaded 54314 existing records. [2025-10-06T20:02:29.758368] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:02:29.758667] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-06T20:02:29.758730] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-06T20:02:29.759017] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-06T20:02:29.759075] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-06T20:02:30.147472] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:02:30.180303] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T20:02:30.225492] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-06T20:02:30.244785] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T20:02:31.025526] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-06T20:02:31.825557] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-06T20:02:32.033897] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T20:02:32.625526] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-06T20:02:32.939366] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T20:02:33.257822] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T20:02:33.425508] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-06T20:02:34.092577] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T20:02:34.225532] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-06T20:02:35.025498] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-06T20:02:35.305821] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T20:02:35.782841] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-06T20:02:35.825491] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-06T20:02:35.875179] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T20:02:36.606378] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T20:02:36.625471] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-06T20:02:37.405968] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T20:02:37.425482] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-06T20:02:38.225587] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-06T20:02:38.814070] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T20:02:39.025528] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-06T20:02:39.772823] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T20:02:39.775816] [INFO ] [REMOTE ] LYV: Full fetch complete (73761 records). [2025-10-06T20:02:39.775929] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-06T20:02:39.830603] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-06T20:02:40.162636] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-06T20:02:40.224071] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-06T20:02:40.224147] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-06T20:02:40.225172] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-06T20:02:40.225236] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-06T20:02:40.226536] [DEBUG] [LOCAL ] LYV: Trimmed 73761 records to 51102 (keeping 200 days of data) [2025-10-06T20:02:40.533018] [DEBUG] [LOCAL ] LYV: Primary data saved (51102 records). [2025-10-06T20:02:40.533167] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-06T20:02:40.533289] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYV took 39.3s. Estimated remaining: 2h 31m 59s. Rate: 7.1 symbols/min [2025-10-06T20:02:40.631114] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-06T20:02:40.703665] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:02:40.761321] [DEBUG] [LOCAL ] MA: Loaded 53281 existing records from primary storage. [2025-10-06T20:02:40.762158] [INFO ] [MAIN ] MA: Loaded 53281 existing records. [2025-10-06T20:02:40.971084] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:02:40.971409] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-06T20:02:40.971617] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-06T20:02:40.972081] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-06T20:02:40.972144] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-06T20:02:41.416180] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:02:41.426070] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-06T20:02:41.641242] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T20:02:41.657544] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T20:02:41.659748] [INFO ] [REMOTE ] LZM: Full fetch complete (18676 records). [2025-10-06T20:02:41.659824] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-06T20:02:42.056303] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-06T20:02:42.056455] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-06T20:02:42.056897] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-06T20:02:42.056960] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-06T20:02:42.057482] [DEBUG] [LOCAL ] LZM: Trimmed 18676 records to 14218 (keeping 200 days of data) [2025-10-06T20:02:42.136269] [DEBUG] [LOCAL ] LZM: Primary data saved (14218 records). [2025-10-06T20:02:42.136422] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-06T20:02:42.136506] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LZM took 24.5s. Estimated remaining: 2h 31m 45s. Rate: 7.1 symbols/min [2025-10-06T20:02:42.232591] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-06T20:02:42.308606] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:02:42.354192] [DEBUG] [LOCAL ] MAA: Loaded 43243 existing records from primary storage. [2025-10-06T20:02:42.354565] [INFO ] [MAIN ] MAA: Loaded 43243 existing records. [2025-10-06T20:02:42.529140] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:02:42.529389] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-06T20:02:42.529434] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-06T20:02:42.529784] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-06T20:02:42.529841] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-06T20:02:42.884916] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:02:43.025507] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-06T20:02:43.422703] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-06T20:02:43.825500] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-06T20:02:44.238892] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-06T20:02:44.252543] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T20:02:44.254962] [INFO ] [REMOTE ] LZB: Full fetch complete (50725 records). [2025-10-06T20:02:44.255351] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-06T20:02:44.642701] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-06T20:02:44.639948] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-06T20:02:44.643306] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-06T20:02:44.645131] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-06T20:02:44.645222] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-06T20:02:44.646607] [DEBUG] [LOCAL ] LZB: Trimmed 50725 records to 35277 (keeping 200 days of data) [2025-10-06T20:02:44.867822] [DEBUG] [LOCAL ] LZB: Primary data saved (35277 records). [2025-10-06T20:02:44.867978] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-06T20:02:44.868082] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZB took 40.2s. Estimated remaining: 2h 31m 32s. Rate: 7.1 symbols/min [2025-10-06T20:02:45.037539] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:02:45.088953] [DEBUG] [LOCAL ] MAC: Loaded 50400 existing records from primary storage. [2025-10-06T20:02:45.089329] [INFO ] [MAIN ] MAC: Loaded 50400 existing records. [2025-10-06T20:02:45.265028] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:02:45.265320] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-06T20:02:45.265379] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-06T20:02:45.265851] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-06T20:02:45.265917] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-06T20:02:45.439425] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-06T20:02:45.626229] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:02:45.824137] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-06T20:02:46.139071] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T20:02:46.225477] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-06T20:02:47.025541] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-06T20:02:47.478710] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-06T20:02:47.736108] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T20:02:47.825490] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-06T20:02:48.534920] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T20:02:48.625541] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-06T20:02:48.942460] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T20:02:49.425533] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-06T20:02:50.225547] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-06T20:02:50.638707] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-06T20:02:51.033788] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-06T20:02:51.039115] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T20:02:51.825519] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-06T20:02:52.300835] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-06T20:02:52.625485] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-06T20:02:52.752107] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T20:02:53.357592] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T20:02:53.425478] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-06T20:02:54.225557] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-06T20:02:54.821497] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-06T20:02:54.913001] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T20:02:55.025533] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-06T20:02:55.825495] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-06T20:02:55.931533] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T20:02:56.625519] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-06T20:02:57.083847] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-06T20:02:57.425521] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-06T20:02:57.462151] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T20:02:58.174617] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T20:02:58.225558] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-06T20:02:59.025499] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-06T20:02:59.514474] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-06T20:02:59.825501] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-06T20:03:00.107007] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-06T20:03:00.625504] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-06T20:03:00.784345] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T20:03:01.425509] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-06T20:03:01.539398] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T20:03:02.230844] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-06T20:03:02.253947] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T20:03:03.025496] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-06T20:03:03.134598] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T20:03:03.825538] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-06T20:03:04.200580] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-06T20:03:04.625579] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-06T20:03:04.912156] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T20:03:05.358547] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T20:03:05.425562] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-06T20:03:06.225690] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-06T20:03:06.541316] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-06T20:03:07.030639] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-06T20:03:07.049149] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T20:03:07.813817] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T20:03:07.825481] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-06T20:03:08.625546] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-06T20:03:08.792705] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-06T20:03:08.795698] [INFO ] [REMOTE ] MA: Full fetch complete (76264 records). [2025-10-06T20:03:08.795819] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-06T20:03:09.210310] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-06T20:03:09.210415] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-06T20:03:09.211832] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-06T20:03:09.211897] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-06T20:03:09.213350] [DEBUG] [LOCAL ] MA: Trimmed 76264 records to 52507 (keeping 200 days of data) [2025-10-06T20:03:09.429847] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-06T20:03:09.554986] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T20:03:09.587325] [DEBUG] [LOCAL ] MA: Primary data saved (52507 records). [2025-10-06T20:03:09.587469] [INFO ] [MAIN ] MA: Full history saved. [2025-10-06T20:03:09.588137] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. MA took 29.1s. Estimated remaining: 2h 31m 37s. Rate: 7.1 symbols/min [2025-10-06T20:03:09.754179] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:03:09.801758] [DEBUG] [LOCAL ] MAGN: Loaded 35600 existing records from primary storage. [2025-10-06T20:03:09.802061] [INFO ] [MAIN ] MAGN: Loaded 35600 existing records. [2025-10-06T20:03:09.979701] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:03:09.979937] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-06T20:03:09.979984] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-06T20:03:09.980263] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-06T20:03:09.980321] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-06T20:03:10.229007] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-06T20:03:10.335180] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:03:10.376171] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T20:03:11.029606] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-06T20:03:11.034867] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T20:03:11.825553] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-06T20:03:11.969528] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T20:03:12.625548] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-06T20:03:12.644205] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-06T20:03:12.647639] [INFO ] [REMOTE ] M: Full fetch complete (77520 records). [2025-10-06T20:03:12.647843] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-06T20:03:13.092045] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-06T20:03:13.092208] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-06T20:03:13.093445] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-06T20:03:13.093763] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-06T20:03:13.095710] [DEBUG] [LOCAL ] M: Trimmed 77520 records to 53539 (keeping 200 days of data) [2025-10-06T20:03:13.223625] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T20:03:13.460060] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-06T20:03:13.521316] [DEBUG] [LOCAL ] M: Primary data saved (53539 records). [2025-10-06T20:03:13.521496] [INFO ] [MAIN ] M: Full history saved. [2025-10-06T20:03:13.521633] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. M took 44.2s. Estimated remaining: 2h 31m 24s. Rate: 7.1 symbols/min [2025-10-06T20:03:13.733540] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:03:13.777456] [DEBUG] [LOCAL ] MAIN: Loaded 41732 existing records from primary storage. [2025-10-06T20:03:13.777875] [INFO ] [MAIN ] MAIN: Loaded 41732 existing records. [2025-10-06T20:03:13.989855] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:03:13.990200] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-06T20:03:13.990274] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-06T20:03:13.990619] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-06T20:03:13.990711] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-06T20:03:14.141987] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T20:03:14.230734] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-06T20:03:14.404967] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:03:14.843168] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T20:03:14.846216] [INFO ] [REMOTE ] MAA: Full fetch complete (61276 records). [2025-10-06T20:03:14.846349] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-06T20:03:15.033920] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-06T20:03:15.264425] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-06T20:03:15.264582] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-06T20:03:15.266105] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-06T20:03:15.266188] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-06T20:03:15.268142] [DEBUG] [LOCAL ] MAA: Trimmed 61276 records to 42633 (keeping 200 days of data) [2025-10-06T20:03:15.561263] [DEBUG] [LOCAL ] MAA: Primary data saved (42633 records). [2025-10-06T20:03:15.561451] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-06T20:03:15.561552] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. MAA took 33.4s. Estimated remaining: 2h 31m 11s. Rate: 7.1 symbols/min [2025-10-06T20:03:15.750519] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:03:15.774331] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T20:03:15.826107] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-06T20:03:15.828893] [DEBUG] [LOCAL ] MAN: Loaded 44133 existing records from primary storage. [2025-10-06T20:03:15.829383] [INFO ] [MAIN ] MAN: Loaded 44133 existing records. [2025-10-06T20:03:16.019036] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:03:16.019379] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-06T20:03:16.019433] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-06T20:03:16.019754] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-06T20:03:16.019813] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-06T20:03:16.387429] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:03:16.625523] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-06T20:03:16.722078] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-06T20:03:16.725259] [INFO ] [REMOTE ] MAC: Full fetch complete (71476 records). [2025-10-06T20:03:16.725398] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-06T20:03:17.135336] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-06T20:03:17.135474] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-06T20:03:17.136784] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-06T20:03:17.136860] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-06T20:03:17.138765] [DEBUG] [LOCAL ] MAC: Trimmed 71476 records to 49621 (keeping 200 days of data) [2025-10-06T20:03:17.264055] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T20:03:17.425695] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-06T20:03:17.491837] [DEBUG] [LOCAL ] MAC: Primary data saved (49621 records). [2025-10-06T20:03:17.492005] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-06T20:03:17.492099] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAC took 32.6s. Estimated remaining: 2h 30m 57s. Rate: 7.1 symbols/min [2025-10-06T20:03:17.671594] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:03:17.703549] [DEBUG] [LOCAL ] MANU: Loaded 27150 existing records from primary storage. [2025-10-06T20:03:17.704088] [INFO ] [MAIN ] MANU: Loaded 27150 existing records. [2025-10-06T20:03:17.893895] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:03:17.915607] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-06T20:03:17.915781] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-06T20:03:17.916464] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-06T20:03:17.917430] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T20:03:17.917507] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-06T20:03:18.230677] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-06T20:03:18.302860] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:03:18.814721] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T20:03:19.025541] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-06T20:03:19.393967] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T20:03:19.825537] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-06T20:03:20.358520] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-06T20:03:20.625600] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-06T20:03:21.193308] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T20:03:21.425516] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-06T20:03:21.725531] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T20:03:22.225511] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-06T20:03:22.940406] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T20:03:23.025552] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-06T20:03:23.318361] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T20:03:23.825557] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-06T20:03:24.459447] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T20:03:24.625539] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-06T20:03:25.089033] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T20:03:25.425619] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-06T20:03:26.225598] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-06T20:03:26.272272] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T20:03:26.854383] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T20:03:27.025487] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-06T20:03:27.262154] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T20:03:27.825534] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-06T20:03:28.482842] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T20:03:28.625557] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-06T20:03:29.425529] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-06T20:03:29.479397] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T20:03:29.805181] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T20:03:30.225555] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-06T20:03:30.558888] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T20:03:31.025532] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-06T20:03:31.674004] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T20:03:31.825582] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-06T20:03:32.625524] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-06T20:03:32.918225] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T20:03:33.425557] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-06T20:03:33.475735] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T20:03:33.532999] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T20:03:34.225573] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-06T20:03:34.746355] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T20:03:35.025552] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-06T20:03:35.769852] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T20:03:35.825545] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-06T20:03:36.324212] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T20:03:36.328026] [INFO ] [REMOTE ] MAGN: Full fetch complete (51323 records). [2025-10-06T20:03:36.328256] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-06T20:03:36.630633] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-06T20:03:36.748033] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-06T20:03:36.748161] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-06T20:03:36.749993] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-06T20:03:36.750069] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-06T20:03:36.751690] [DEBUG] [LOCAL ] MAGN: Trimmed 51323 records to 35395 (keeping 200 days of data) [2025-10-06T20:03:36.998475] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T20:03:37.012861] [DEBUG] [LOCAL ] MAGN: Primary data saved (35395 records). [2025-10-06T20:03:37.013058] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-06T20:03:37.013222] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAGN took 27.4s. Estimated remaining: 2h 30m 57s. Rate: 7.1 symbols/min [2025-10-06T20:03:37.189790] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:03:37.244907] [DEBUG] [LOCAL ] MAS: Loaded 53080 existing records from primary storage. [2025-10-06T20:03:37.245374] [INFO ] [MAIN ] MAS: Loaded 53080 existing records. [2025-10-06T20:03:37.441768] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-06T20:03:37.512386] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:03:37.513587] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-06T20:03:37.513684] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-06T20:03:37.513989] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-06T20:03:37.514047] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-06T20:03:37.926833] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:03:38.225545] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-06T20:03:38.308449] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T20:03:38.749472] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T20:03:39.025541] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-06T20:03:39.825555] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-06T20:03:40.181027] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-06T20:03:40.625597] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-06T20:03:40.692899] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T20:03:41.429086] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-06T20:03:41.435857] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T20:03:41.971429] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T20:03:42.225610] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-06T20:03:43.025519] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-06T20:03:43.144671] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T20:03:43.411281] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T20:03:43.825566] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-06T20:03:44.385555] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-06T20:03:44.625589] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-06T20:03:45.386153] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T20:03:45.425516] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-06T20:03:46.225515] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-06T20:03:46.481210] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T20:03:46.607308] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-06T20:03:47.025532] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-06T20:03:47.823509] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T20:03:47.833570] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-06T20:03:48.374245] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T20:03:48.625536] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-06T20:03:49.425527] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-06T20:03:49.607571] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T20:03:50.036261] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T20:03:50.039166] [INFO ] [REMOTE ] MAN: Full fetch complete (62189 records). [2025-10-06T20:03:50.039283] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-06T20:03:50.240091] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-06T20:03:50.452027] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-06T20:03:50.452119] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-06T20:03:50.453141] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-06T20:03:50.453207] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-06T20:03:50.454484] [DEBUG] [LOCAL ] MAN: Trimmed 62189 records to 43603 (keeping 200 days of data) [2025-10-06T20:03:50.719402] [DEBUG] [LOCAL ] MAN: Primary data saved (43603 records). [2025-10-06T20:03:50.719560] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-06T20:03:50.719676] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAN took 35.2s. Estimated remaining: 2h 30m 53s. Rate: 7.1 symbols/min [2025-10-06T20:03:50.891632] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:03:50.932420] [DEBUG] [LOCAL ] MATV: Loaded 37127 existing records from primary storage. [2025-10-06T20:03:50.932934] [INFO ] [MAIN ] MATV: Loaded 37127 existing records. [2025-10-06T20:03:51.032918] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-06T20:03:51.124014] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:03:51.124404] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-06T20:03:51.124482] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-06T20:03:51.124821] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-06T20:03:51.124881] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-06T20:03:51.312554] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T20:03:51.528717] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:03:51.546408] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T20:03:51.548765] [INFO ] [REMOTE ] MANU: Full fetch complete (38283 records). [2025-10-06T20:03:51.549070] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-06T20:03:51.830667] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-06T20:03:51.949475] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-06T20:03:51.949602] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-06T20:03:51.951078] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-06T20:03:51.951151] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-06T20:03:51.952626] [DEBUG] [LOCAL ] MANU: Trimmed 38283 records to 26710 (keeping 200 days of data) [2025-10-06T20:03:52.127634] [DEBUG] [LOCAL ] MANU: Primary data saved (26710 records). [2025-10-06T20:03:52.127911] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-06T20:03:52.128035] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MANU took 34.6s. Estimated remaining: 2h 30m 39s. Rate: 7.1 symbols/min [2025-10-06T20:03:52.327225] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:03:52.369518] [DEBUG] [LOCAL ] MATX: Loaded 31889 existing records from primary storage. [2025-10-06T20:03:52.369918] [INFO ] [MAIN ] MATX: Loaded 31889 existing records. [2025-10-06T20:03:52.577547] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:03:52.578360] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-06T20:03:52.578506] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-06T20:03:52.578969] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-06T20:03:52.579036] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-06T20:03:52.632351] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-06T20:03:52.964003] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-06T20:03:53.061809] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:03:53.198221] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T20:03:53.425570] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-06T20:03:53.969696] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T20:03:54.225571] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-06T20:03:54.577613] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T20:03:55.025543] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-06T20:03:55.573873] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-06T20:03:55.825560] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-06T20:03:56.625546] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-06T20:03:56.815345] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-06T20:03:57.023799] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-06T20:03:57.425548] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-06T20:03:58.042593] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T20:03:58.045074] [INFO ] [REMOTE ] MAIN: Full fetch complete (59913 records). [2025-10-06T20:03:58.045173] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-06T20:03:58.232589] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-06T20:03:58.443140] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-06T20:03:58.451144] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-06T20:03:58.454294] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-06T20:03:58.454997] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-06T20:03:58.456036] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T20:03:58.463456] [DEBUG] [LOCAL ] MAIN: Trimmed 59913 records to 41171 (keeping 200 days of data) [2025-10-06T20:03:58.720132] [DEBUG] [LOCAL ] MAIN: Primary data saved (41171 records). [2025-10-06T20:03:58.720262] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-06T20:03:58.720354] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MAIN took 45.2s. Estimated remaining: 2h 30m 29s. Rate: 7.1 symbols/min [2025-10-06T20:03:58.887355] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:03:58.918205] [DEBUG] [LOCAL ] MAX: Loaded 31182 existing records from primary storage. [2025-10-06T20:03:58.918498] [INFO ] [MAIN ] MAX: Loaded 31182 existing records. [2025-10-06T20:03:59.030620] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-06T20:03:59.099505] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:03:59.099773] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-06T20:03:59.099822] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-06T20:03:59.100037] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-06T20:03:59.100094] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-06T20:03:59.448436] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:03:59.825506] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-06T20:03:59.874637] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T20:04:00.625537] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-06T20:04:00.963530] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-06T20:04:01.058032] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T20:04:01.425601] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-06T20:04:02.013023] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T20:04:02.225541] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-06T20:04:02.943608] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T20:04:03.025491] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-06T20:04:03.457192] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T20:04:03.825510] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-06T20:04:04.625501] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-06T20:04:04.855451] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-06T20:04:05.328107] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T20:04:05.425480] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-06T20:04:06.225509] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-06T20:04:06.344683] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-06T20:04:06.657623] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T20:04:07.025526] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-06T20:04:07.825728] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-06T20:04:07.999845] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T20:04:08.349008] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T20:04:08.625560] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-06T20:04:09.140106] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T20:04:09.425535] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-06T20:04:10.225577] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-06T20:04:10.335101] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T20:04:10.404600] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T20:04:11.025555] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-06T20:04:11.631948] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T20:04:11.825548] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-06T20:04:12.585455] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T20:04:12.588532] [INFO ] [REMOTE ] MAS: Full fetch complete (74897 records). [2025-10-06T20:04:12.588667] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-06T20:04:12.634678] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-06T20:04:12.997853] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-06T20:04:12.998004] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-06T20:04:12.999262] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-06T20:04:12.999327] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-06T20:04:13.001113] [DEBUG] [LOCAL ] MAS: Trimmed 74897 records to 52301 (keeping 200 days of data) [2025-10-06T20:04:13.336801] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T20:04:13.362859] [DEBUG] [LOCAL ] MAS: Primary data saved (52301 records). [2025-10-06T20:04:13.363009] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-06T20:04:13.363098] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MAS took 36.3s. Estimated remaining: 2h 30m 26s. Rate: 7.1 symbols/min [2025-10-06T20:04:13.430594] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-06T20:04:13.539517] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:04:13.581194] [DEBUG] [LOCAL ] MBC: Loaded 43945 existing records from primary storage. [2025-10-06T20:04:13.581507] [INFO ] [MAIN ] MBC: Loaded 43945 existing records. [2025-10-06T20:04:13.763682] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:04:13.764030] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-06T20:04:13.764086] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-06T20:04:13.764303] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-06T20:04:13.764363] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-06T20:04:14.125955] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T20:04:14.164222] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:04:14.225519] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-06T20:04:14.769049] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T20:04:15.025553] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-06T20:04:15.290320] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T20:04:15.292167] [INFO ] [REMOTE ] MATX: Full fetch complete (42758 records). [2025-10-06T20:04:15.292263] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-06T20:04:15.659387] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-06T20:04:15.659478] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-06T20:04:15.660277] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-06T20:04:15.660339] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-06T20:04:15.661281] [DEBUG] [LOCAL ] MATX: Trimmed 42758 records to 31425 (keeping 200 days of data) [2025-10-06T20:04:15.828952] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-06T20:04:15.869039] [DEBUG] [LOCAL ] MATX: Primary data saved (31425 records). [2025-10-06T20:04:15.869164] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-06T20:04:15.869248] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MATX took 23.7s. Estimated remaining: 2h 30m 12s. Rate: 7.1 symbols/min [2025-10-06T20:04:16.053922] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:04:16.079789] [DEBUG] [LOCAL ] MBI: Loaded 24622 existing records from primary storage. [2025-10-06T20:04:16.080142] [INFO ] [MAIN ] MBI: Loaded 24622 existing records. [2025-10-06T20:04:16.259301] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T20:04:16.290097] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:04:16.297592] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-06T20:04:16.298004] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-06T20:04:16.298519] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-06T20:04:16.298581] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-06T20:04:16.630596] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-06T20:04:16.661517] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:04:17.239837] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T20:04:17.425505] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-06T20:04:18.095733] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T20:04:18.225503] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-06T20:04:18.767759] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T20:04:19.025550] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-06T20:04:19.652835] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T20:04:19.825529] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-06T20:04:20.596149] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T20:04:20.625481] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-06T20:04:20.984708] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T20:04:21.425579] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-06T20:04:22.146019] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T20:04:22.225602] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-06T20:04:22.652524] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T20:04:23.025624] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-06T20:04:23.664225] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T20:04:23.825548] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-06T20:04:24.536400] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T20:04:24.625480] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-06T20:04:24.966392] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T20:04:25.425541] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-06T20:04:26.225510] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-06T20:04:26.383936] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T20:04:26.800718] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T20:04:27.025557] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-06T20:04:27.583392] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-06T20:04:27.825546] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-06T20:04:28.082978] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-06T20:04:28.625553] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-06T20:04:28.843124] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T20:04:28.845130] [INFO ] [REMOTE ] MATV: Full fetch complete (52327 records). [2025-10-06T20:04:28.845244] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-06T20:04:29.247045] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-06T20:04:29.247132] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-06T20:04:29.248086] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-06T20:04:29.248149] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-06T20:04:29.249265] [DEBUG] [LOCAL ] MATV: Trimmed 52327 records to 36253 (keeping 200 days of data) [2025-10-06T20:04:29.439310] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-06T20:04:29.470406] [DEBUG] [LOCAL ] MATV: Primary data saved (36253 records). [2025-10-06T20:04:29.470563] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-06T20:04:29.470671] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATV took 38.8s. Estimated remaining: 2h 30m 8s. Rate: 7.1 symbols/min [2025-10-06T20:04:29.646529] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:04:29.686918] [DEBUG] [LOCAL ] MC: Loaded 44681 existing records from primary storage. [2025-10-06T20:04:29.687238] [INFO ] [MAIN ] MC: Loaded 44681 existing records. [2025-10-06T20:04:29.873487] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:04:29.873744] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-06T20:04:29.873888] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-06T20:04:29.874096] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-06T20:04:29.874152] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-06T20:04:30.177074] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T20:04:30.234981] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-06T20:04:30.275139] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:04:30.990069] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T20:04:31.025471] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-06T20:04:31.532922] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T20:04:31.535167] [INFO ] [REMOTE ] MAX: Full fetch complete (45340 records). [2025-10-06T20:04:31.535243] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-06T20:04:31.830730] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-06T20:04:31.939165] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-06T20:04:31.939253] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-06T20:04:31.940480] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-06T20:04:31.940543] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-06T20:04:31.941581] [DEBUG] [LOCAL ] MAX: Trimmed 45340 records to 30772 (keeping 200 days of data) [2025-10-06T20:04:32.128568] [DEBUG] [LOCAL ] MAX: Primary data saved (30772 records). [2025-10-06T20:04:32.129013] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-06T20:04:32.129130] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MAX took 33.4s. Estimated remaining: 2h 29m 55s. Rate: 7.1 symbols/min [2025-10-06T20:04:32.309070] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:04:32.322199] [DEBUG] [LOCAL ] MCB: Loaded 11506 existing records from primary storage. [2025-10-06T20:04:32.322452] [INFO ] [MAIN ] MCB: Loaded 11506 existing records. [2025-10-06T20:04:32.503855] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:04:32.504403] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-06T20:04:32.504459] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-06T20:04:32.504805] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-06T20:04:32.504868] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-06T20:04:32.631224] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T20:04:32.629531] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-06T20:04:32.804334] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T20:04:32.973784] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:04:33.425502] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-06T20:04:34.115952] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T20:04:34.225486] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-06T20:04:34.484843] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T20:04:35.025574] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-06T20:04:35.646696] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T20:04:35.825496] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-06T20:04:36.495137] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-06T20:04:36.519875] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T20:04:36.625482] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-06T20:04:37.425529] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-06T20:04:38.145783] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T20:04:38.225526] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-06T20:04:38.954303] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T20:04:39.025504] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-06T20:04:39.825495] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-06T20:04:39.922720] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T20:04:40.626147] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T20:04:40.626343] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-06T20:04:41.094190] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T20:04:41.425545] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-06T20:04:42.095921] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T20:04:42.098814] [INFO ] [REMOTE ] MBC: Full fetch complete (63163 records). [2025-10-06T20:04:42.098924] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-06T20:04:42.237041] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-06T20:04:42.435703] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T20:04:42.526987] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-06T20:04:42.527107] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-06T20:04:42.528268] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-06T20:04:42.528340] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-06T20:04:42.529956] [DEBUG] [LOCAL ] MBC: Trimmed 63163 records to 43410 (keeping 200 days of data) [2025-10-06T20:04:42.814975] [DEBUG] [LOCAL ] MBC: Primary data saved (43410 records). [2025-10-06T20:04:42.815154] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-06T20:04:42.815275] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MBC took 29.5s. Estimated remaining: 2h 29m 48s. Rate: 7.1 symbols/min [2025-10-06T20:04:43.021062] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:04:43.021312] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-06T20:04:43.021384] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-06T20:04:43.021527] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-06T20:04:43.021589] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-06T20:04:43.021637] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-06T20:04:43.021744] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-06T20:04:43.033753] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-06T20:04:43.440337] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:04:43.825500] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-06T20:04:43.969266] [DEBUG] [REMOTE ] MCD: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-06T20:04:43.970124] [WARN ] [REMOTE ] MCD: No data returned for month 2024-12 [2025-10-06T20:04:43.971154] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T20:04:43.981174] [FATAL] [REMOTE ] MCD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:04:43.981631] [FATAL] [MAIN ] MCD: Failed to fetch primary data. [2025-10-06T20:04:43.981830] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:04:43.982205] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-06T20:04:43.982289] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-06T20:04:43.982326] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-06T20:04:43.982382] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-06T20:04:43.982450] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MCD took 1.2s. Estimated remaining: 2h 29m 34s. Rate: 7.1 symbols/min [2025-10-06T20:04:44.170781] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:04:44.182099] [DEBUG] [LOCAL ] MCI: Loaded 6499 existing records from primary storage. [2025-10-06T20:04:44.182420] [INFO ] [MAIN ] MCI: Loaded 6499 existing records. [2025-10-06T20:04:44.373618] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:04:44.373946] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-06T20:04:44.374021] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-06T20:04:44.374359] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-06T20:04:44.374420] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-06T20:04:44.630766] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-06T20:04:44.714057] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T20:04:44.814841] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:04:45.425531] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-06T20:04:46.055148] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-06T20:04:46.225510] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-06T20:04:46.293198] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T20:04:47.020447] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-06T20:04:47.025470] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-06T20:04:47.825546] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-06T20:04:47.989708] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T20:04:48.557843] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T20:04:48.625545] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-06T20:04:49.425576] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-06T20:04:49.643512] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T20:04:50.225587] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-06T20:04:50.236727] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-06T20:04:51.025551] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-06T20:04:51.806061] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T20:04:51.831401] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-06T20:04:51.834398] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T20:04:52.461891] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-06T20:04:52.625517] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-06T20:04:53.425551] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-06T20:04:54.225497] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-06T20:04:54.260674] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T20:04:54.286000] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T20:04:54.961677] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T20:04:55.025496] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-06T20:04:55.804507] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-06T20:04:55.825466] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-06T20:04:56.625506] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-06T20:04:56.956241] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-06T20:04:57.218212] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T20:04:57.425539] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-06T20:04:58.033020] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T20:04:58.225577] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-06T20:04:59.025493] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-06T20:04:59.402151] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T20:04:59.722521] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T20:04:59.825557] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-06T20:05:00.625561] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-06T20:05:00.670232] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-06T20:05:01.425615] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-06T20:05:02.225493] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-06T20:05:02.369870] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T20:05:02.370899] [INFO ] [REMOTE ] MCI: Full fetch complete (10028 records). [2025-10-06T20:05:02.370972] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-06T20:05:02.577769] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T20:05:02.774002] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-06T20:05:02.774081] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-06T20:05:02.774362] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-06T20:05:02.774399] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-06T20:05:02.774851] [DEBUG] [LOCAL ] MCI: Trimmed 10028 records to 6457 (keeping 200 days of data) [2025-10-06T20:05:02.813565] [DEBUG] [LOCAL ] MCI: Primary data saved (6457 records). [2025-10-06T20:05:02.813672] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-06T20:05:02.813774] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MCI took 18.8s. Estimated remaining: 2h 29m 34s. Rate: 7.1 symbols/min [2025-10-06T20:05:02.981431] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:05:03.030735] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-06T20:05:03.032747] [DEBUG] [LOCAL ] MCK: Loaded 39685 existing records from primary storage. [2025-10-06T20:05:03.032993] [INFO ] [MAIN ] MCK: Loaded 39685 existing records. [2025-10-06T20:05:03.200900] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T20:05:03.222020] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:05:03.225728] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-06T20:05:03.225786] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-06T20:05:03.226047] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-06T20:05:03.226104] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-06T20:05:03.576276] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:05:03.825533] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-06T20:05:04.327065] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-06T20:05:04.625538] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-06T20:05:05.368992] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T20:05:05.425510] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-06T20:05:06.104380] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T20:05:06.225508] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-06T20:05:06.766290] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T20:05:07.025562] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-06T20:05:07.542892] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T20:05:07.546602] [INFO ] [REMOTE ] MC: Full fetch complete (62689 records). [2025-10-06T20:05:07.546798] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-06T20:05:07.669442] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T20:05:07.830704] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-06T20:05:08.011217] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-06T20:05:08.011420] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-06T20:05:08.013533] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-06T20:05:08.013611] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-06T20:05:08.015524] [DEBUG] [LOCAL ] MC: Trimmed 62689 records to 44022 (keeping 200 days of data) [2025-10-06T20:05:08.310056] [DEBUG] [LOCAL ] MC: Primary data saved (44022 records). [2025-10-06T20:05:08.310241] [INFO ] [MAIN ] MC: Full history saved. [2025-10-06T20:05:08.310343] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MC took 38.8s. Estimated remaining: 2h 29m 23s. Rate: 7.1 symbols/min [2025-10-06T20:05:08.510372] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:05:08.526346] [DEBUG] [LOCAL ] MCN: Loaded 8300 existing records from primary storage. [2025-10-06T20:05:08.526744] [INFO ] [MAIN ] MCN: Loaded 8300 existing records. [2025-10-06T20:05:08.630693] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-06T20:05:08.730330] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:05:08.730708] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-06T20:05:08.730772] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-06T20:05:08.730986] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-06T20:05:08.731047] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-06T20:05:09.088821] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T20:05:09.168143] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:05:09.425563] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-06T20:05:10.006831] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T20:05:10.225498] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-06T20:05:10.437208] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T20:05:10.439091] [INFO ] [REMOTE ] MBI: Full fetch complete (36609 records). [2025-10-06T20:05:10.439225] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-06T20:05:10.803677] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-06T20:05:10.803772] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-06T20:05:10.804512] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-06T20:05:10.804552] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-06T20:05:10.805387] [DEBUG] [LOCAL ] MBI: Trimmed 36609 records to 24233 (keeping 200 days of data) [2025-10-06T20:05:10.944332] [DEBUG] [LOCAL ] MBI: Primary data saved (24233 records). [2025-10-06T20:05:10.944614] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-06T20:05:10.944790] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MBI took 55.1s. Estimated remaining: 2h 29m 10s. Rate: 7.1 symbols/min [2025-10-06T20:05:11.025713] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-06T20:05:11.117563] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:05:11.126250] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T20:05:11.169902] [DEBUG] [LOCAL ] MCO: Loaded 39892 existing records from primary storage. [2025-10-06T20:05:11.170224] [INFO ] [MAIN ] MCO: Loaded 39892 existing records. [2025-10-06T20:05:11.348198] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:05:11.348435] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-06T20:05:11.348484] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-06T20:05:11.349501] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-06T20:05:11.349563] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-06T20:05:11.719710] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:05:11.825474] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-06T20:05:11.844345] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T20:05:12.625548] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-06T20:05:13.251921] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T20:05:13.425563] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-06T20:05:14.185947] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T20:05:14.187098] [INFO ] [REMOTE ] MCB: Full fetch complete (16354 records). [2025-10-06T20:05:14.187190] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-06T20:05:14.230669] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-06T20:05:14.363430] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T20:05:14.587285] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-06T20:05:14.587362] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-06T20:05:14.587746] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-06T20:05:14.587827] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-06T20:05:14.588410] [DEBUG] [LOCAL ] MCB: Trimmed 16354 records to 11254 (keeping 200 days of data) [2025-10-06T20:05:14.655575] [DEBUG] [LOCAL ] MCB: Primary data saved (11254 records). [2025-10-06T20:05:14.655752] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-06T20:05:14.655844] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCB took 42.5s. Estimated remaining: 2h 28m 57s. Rate: 7.1 symbols/min [2025-10-06T20:05:14.825726] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:05:14.836969] [DEBUG] [LOCAL ] MCR: Loaded 8848 existing records from primary storage. [2025-10-06T20:05:14.837203] [INFO ] [MAIN ] MCR: Loaded 8848 existing records. [2025-10-06T20:05:14.961555] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T20:05:15.026752] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-06T20:05:15.026668] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:05:15.027849] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-06T20:05:15.027921] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-06T20:05:15.028119] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-06T20:05:15.028188] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-06T20:05:15.384698] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:05:15.825517] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-06T20:05:16.622234] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T20:05:16.629472] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-06T20:05:16.639590] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T20:05:17.354559] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T20:05:17.425498] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-06T20:05:18.225534] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-06T20:05:19.003210] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T20:05:19.025807] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-06T20:05:19.030904] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T20:05:19.825524] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-06T20:05:20.625506] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-06T20:05:20.711071] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T20:05:21.342148] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T20:05:21.425491] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-06T20:05:21.582765] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T20:05:22.127823] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-06T20:05:22.225507] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-06T20:05:22.976465] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T20:05:23.025511] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-06T20:05:23.825537] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-06T20:05:24.625491] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-06T20:05:24.661560] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-06T20:05:24.751274] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T20:05:25.425540] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-06T20:05:26.165480] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T20:05:26.225494] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-06T20:05:26.295246] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T20:05:27.025489] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-06T20:05:27.071135] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-06T20:05:27.825516] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-06T20:05:28.346052] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-06T20:05:28.625550] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-06T20:05:28.657607] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T20:05:29.354802] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T20:05:29.425488] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-06T20:05:30.135416] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-06T20:05:30.225569] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-06T20:05:31.025516] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-06T20:05:31.084332] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T20:05:31.825523] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-06T20:05:32.627164] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-06T20:05:32.630000] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T20:05:33.226162] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T20:05:33.405573] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-06T20:05:33.425492] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-06T20:05:34.169571] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-06T20:05:34.225491] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-06T20:05:35.025550] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-06T20:05:35.680254] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T20:05:35.825550] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-06T20:05:36.604425] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T20:05:36.625477] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-06T20:05:36.702683] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T20:05:37.425523] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-06T20:05:38.037434] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T20:05:38.084403] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-06T20:05:38.225517] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-06T20:05:38.881119] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T20:05:38.882141] [INFO ] [REMOTE ] MCN: Full fetch complete (11691 records). [2025-10-06T20:05:38.882233] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-06T20:05:39.030613] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-06T20:05:39.269271] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-06T20:05:39.269399] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-06T20:05:39.269767] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-06T20:05:39.269830] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-06T20:05:39.270331] [DEBUG] [LOCAL ] MCN: Trimmed 11691 records to 8160 (keeping 200 days of data) [2025-10-06T20:05:39.318796] [DEBUG] [LOCAL ] MCN: Primary data saved (8160 records). [2025-10-06T20:05:39.318938] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-06T20:05:39.319025] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCN took 31.0s. Estimated remaining: 2h 29m 2s. Rate: 7.1 symbols/min [2025-10-06T20:05:39.493928] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:05:39.516248] [DEBUG] [LOCAL ] MCS: Loaded 21303 existing records from primary storage. [2025-10-06T20:05:39.516538] [INFO ] [MAIN ] MCS: Loaded 21303 existing records. [2025-10-06T20:05:39.694935] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:05:39.695133] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-06T20:05:39.695180] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-06T20:05:39.695844] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-06T20:05:39.695902] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-06T20:05:39.812469] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-06T20:05:39.832749] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-06T20:05:40.059108] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:05:40.625541] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-06T20:05:41.248133] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T20:05:41.425545] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-06T20:05:42.225501] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-06T20:05:42.506633] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T20:05:42.877328] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T20:05:42.878499] [INFO ] [REMOTE ] MCR: Full fetch complete (14127 records). [2025-10-06T20:05:42.878575] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-06T20:05:43.028589] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-06T20:05:43.282853] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-06T20:05:43.282665] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T20:05:43.285875] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-06T20:05:43.291922] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-06T20:05:43.292009] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-06T20:05:43.292969] [DEBUG] [LOCAL ] MCR: Trimmed 14127 records to 8845 (keeping 200 days of data) [2025-10-06T20:05:43.342714] [DEBUG] [LOCAL ] MCR: Primary data saved (8845 records). [2025-10-06T20:05:43.342835] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-06T20:05:43.342916] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCR took 28.7s. Estimated remaining: 2h 28m 50s. Rate: 7.1 symbols/min [2025-10-06T20:05:43.516563] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:05:43.540550] [DEBUG] [LOCAL ] MCY: Loaded 24734 existing records from primary storage. [2025-10-06T20:05:43.540876] [INFO ] [MAIN ] MCY: Loaded 24734 existing records. [2025-10-06T20:05:43.753510] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:05:43.754188] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-06T20:05:43.754250] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-06T20:05:43.754866] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-06T20:05:43.754948] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-06T20:05:43.830667] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-06T20:05:44.123227] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:05:44.151547] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T20:05:44.625527] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-06T20:05:45.391769] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T20:05:45.395383] [INFO ] [REMOTE ] MCO: Full fetch complete (57157 records). [2025-10-06T20:05:45.395491] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-06T20:05:45.430636] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-06T20:05:45.785593] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-06T20:05:45.785789] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-06T20:05:45.786776] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-06T20:05:45.786857] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-06T20:05:45.807292] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T20:05:45.806203] [DEBUG] [LOCAL ] MCO: Trimmed 57157 records to 39195 (keeping 200 days of data) [2025-10-06T20:05:46.075183] [DEBUG] [LOCAL ] MCO: Primary data saved (39195 records). [2025-10-06T20:05:46.075352] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-06T20:05:46.075471] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCO took 35.1s. Estimated remaining: 2h 28m 37s. Rate: 7.1 symbols/min [2025-10-06T20:05:46.225529] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-06T20:05:46.554982] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T20:05:47.025572] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-06T20:05:47.797232] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T20:05:47.825479] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-06T20:05:48.025865] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-06T20:05:48.625556] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-06T20:05:49.090926] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-06T20:05:49.425598] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-06T20:05:50.064610] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T20:05:50.225549] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-06T20:05:50.801481] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T20:05:51.025551] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-06T20:05:51.339071] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T20:05:51.341429] [INFO ] [REMOTE ] MCK: Full fetch complete (57221 records). [2025-10-06T20:05:51.341513] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-06T20:05:51.744129] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-06T20:05:51.744253] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-06T20:05:51.745860] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-06T20:05:51.745946] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-06T20:05:51.747907] [DEBUG] [LOCAL ] MCK: Trimmed 57221 records to 39017 (keeping 200 days of data) [2025-10-06T20:05:51.850373] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-06T20:05:52.031696] [DEBUG] [LOCAL ] MCK: Primary data saved (39017 records). [2025-10-06T20:05:52.032172] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-06T20:05:52.032565] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCK took 49.2s. Estimated remaining: 2h 28m 26s. Rate: 7.1 symbols/min [2025-10-06T20:05:52.138697] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T20:05:52.625545] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-06T20:05:53.110438] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T20:05:53.425571] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-06T20:05:53.782739] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T20:05:54.225548] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-06T20:05:54.800883] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T20:05:55.025541] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-06T20:05:55.306946] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-06T20:05:55.825562] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-06T20:05:56.095695] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T20:05:56.625625] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-06T20:05:56.800938] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T20:05:57.425511] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-06T20:05:57.826445] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-06T20:05:58.225495] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-06T20:05:58.535177] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-06T20:05:59.025570] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-06T20:05:59.323907] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T20:05:59.825506] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-06T20:05:59.920147] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T20:06:00.625563] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-06T20:06:00.880475] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T20:06:01.425551] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-06T20:06:01.680305] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T20:06:02.225571] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-06T20:06:02.444753] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T20:06:02.447141] [INFO ] [REMOTE ] MCY: Full fetch complete (41431 records). [2025-10-06T20:06:02.447231] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-06T20:06:02.848579] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-06T20:06:02.848733] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-06T20:06:02.850050] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-06T20:06:02.850122] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-06T20:06:02.851444] [DEBUG] [LOCAL ] MCY: Trimmed 41431 records to 24122 (keeping 200 days of data) [2025-10-06T20:06:03.012579] [DEBUG] [LOCAL ] MCY: Primary data saved (24122 records). [2025-10-06T20:06:03.012785] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-06T20:06:03.012897] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. MCY took 19.7s. Estimated remaining: 2h 28m 20s. Rate: 7.1 symbols/min [2025-10-06T20:06:03.305071] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T20:06:03.307077] [INFO ] [REMOTE ] MCS: Full fetch complete (30525 records). [2025-10-06T20:06:03.307163] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-06T20:06:03.721752] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-06T20:06:03.721892] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-06T20:06:03.723098] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-06T20:06:03.723170] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-06T20:06:03.724328] [DEBUG] [LOCAL ] MCS: Trimmed 30525 records to 20959 (keeping 200 days of data) [2025-10-06T20:06:03.865359] [DEBUG] [LOCAL ] MCS: Primary data saved (20959 records). [2025-10-06T20:06:03.865541] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-06T20:06:03.865636] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCS took 24.5s. Estimated remaining: 2h 28m 6s. Rate: 7.1 symbols/min [2025-10-06T20:06:04.447406] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:06:04.579150] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:06:04.626086] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:06:04.686748] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:06:04.706274] [DEBUG] [LOCAL ] MDST: Loaded 5772 existing records from primary storage. [2025-10-06T20:06:04.706603] [INFO ] [MAIN ] MDST: Loaded 5772 existing records. [2025-10-06T20:06:04.855086] [DEBUG] [LOCAL ] MD: Loaded 38895 existing records from primary storage. [2025-10-06T20:06:04.871884] [INFO ] [MAIN ] MD: Loaded 38895 existing records. [2025-10-06T20:06:05.050018] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:06:05.101138] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-06T20:06:05.142552] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-10-06T20:06:05.142700] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-06T20:06:05.179783] [INFO ] [MAIN ] MDT: Loaded 54458 existing records. [2025-10-06T20:06:05.210577] [DEBUG] [LOCAL ] MDU: Loaded 48708 existing records from primary storage. [2025-10-06T20:06:05.224402] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:06:05.243392] [INFO ] [MAIN ] MDU: Loaded 48708 existing records. [2025-10-06T20:06:05.248799] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-06T20:06:05.254290] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-06T20:06:05.224519] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-06T20:06:05.272522] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-06T20:06:05.306164] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-06T20:06:05.366445] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-06T20:06:05.782228] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:06:05.883988] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-06T20:06:05.872411] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:06:05.884711] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-06T20:06:05.892175] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-06T20:06:05.897475] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-06T20:06:05.919566] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-06T20:06:05.919491] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-06T20:06:06.018577] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-06T20:06:06.108446] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-06T20:06:06.810861] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:06:06.767076] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:06:06.811228] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-06T20:06:06.823304] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-06T20:06:07.151926] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:06:07.156718] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:06:07.157023] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-06T20:06:07.157255] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-06T20:06:07.543248] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-06T20:06:07.545299] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-06T20:06:08.152915] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T20:06:08.155175] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-06T20:06:08.430798] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T20:06:08.438811] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-06T20:06:08.542528] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-06T20:06:08.625470] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-06T20:06:08.831326] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T20:06:09.056081] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T20:06:09.234343] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T20:06:09.425509] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-06T20:06:09.624696] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T20:06:10.225544] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-06T20:06:11.030940] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-06T20:06:11.060595] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T20:06:11.616520] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T20:06:11.642122] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-06T20:06:11.825543] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-06T20:06:12.625528] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-06T20:06:13.425518] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-06T20:06:13.465749] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T20:06:13.803150] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T20:06:13.989270] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T20:06:14.225557] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-06T20:06:15.025603] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-06T20:06:15.684928] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T20:06:15.825479] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-06T20:06:16.588477] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-06T20:06:16.587868] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T20:06:16.625463] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-06T20:06:17.425561] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-06T20:06:18.058064] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-06T20:06:18.225489] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-06T20:06:18.650344] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-06T20:06:18.880090] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-06T20:06:19.025548] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-06T20:06:19.765969] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-06T20:06:19.825474] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-06T20:06:20.520334] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T20:06:20.521914] [INFO ] [REMOTE ] MDST: Full fetch complete (8570 records). [2025-10-06T20:06:20.522016] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-06T20:06:20.630612] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-06T20:06:20.889802] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-06T20:06:20.889893] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-06T20:06:20.890105] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-06T20:06:20.890144] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-06T20:06:20.890539] [DEBUG] [LOCAL ] MDST: Trimmed 8570 records to 5710 (keeping 200 days of data) [2025-10-06T20:06:20.924921] [DEBUG] [LOCAL ] MDST: Primary data saved (5710 records). [2025-10-06T20:06:20.925030] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-06T20:06:20.925122] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 17.0s. Estimated remaining: 2h 28m 4s. Rate: 7.1 symbols/min [2025-10-06T20:06:21.107837] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:06:21.108279] [DEBUG] [LOCAL ] MDV: No existing data file found in primary storage. [2025-10-06T20:06:21.108337] [WARN ] [MAIN ] MDV: No existing data found, performing full refresh instead. [2025-10-06T20:06:21.108467] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-06T20:06:21.108511] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-06T20:06:21.108553] [DEBUG] [LOCAL ] MDV: No primary data file found to delete. [2025-10-06T20:06:21.108588] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-06T20:06:21.430790] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-06T20:06:21.506066] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:06:22.225491] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-06T20:06:22.625775] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-06T20:06:22.793015] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-06T20:06:23.025575] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-06T20:06:23.805279] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T20:06:23.825475] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-06T20:06:24.625552] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-06T20:06:24.917488] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T20:06:25.107613] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T20:06:25.108311] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-06T20:06:25.425546] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-06T20:06:26.225576] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-06T20:06:27.025496] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-06T20:06:27.110364] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T20:06:27.600339] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T20:06:27.825545] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-06T20:06:28.625546] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-06T20:06:28.711333] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T20:06:29.282227] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-06T20:06:29.430693] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-06T20:06:29.443030] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T20:06:29.975472] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-06T20:06:30.225552] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-06T20:06:31.025635] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-06T20:06:31.759000] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T20:06:31.783089] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T20:06:31.825510] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-06T20:06:32.625570] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-06T20:06:32.645542] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T20:06:33.425537] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-06T20:06:34.166445] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T20:06:34.225635] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-06T20:06:34.491186] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-06T20:06:34.668343] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-06T20:06:35.025531] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-06T20:06:35.783216] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T20:06:35.825520] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-06T20:06:36.625512] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-06T20:06:36.771867] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T20:06:37.425548] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-06T20:06:38.225556] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-06T20:06:38.595599] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-06T20:06:38.872916] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T20:06:39.025545] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-06T20:06:39.656055] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-06T20:06:39.811085] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T20:06:39.825476] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-06T20:06:40.625533] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-06T20:06:41.425488] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-06T20:06:41.546541] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T20:06:42.225496] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-06T20:06:42.468301] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T20:06:42.685302] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T20:06:42.687759] [INFO ] [REMOTE ] MD: Full fetch complete (55200 records). [2025-10-06T20:06:42.687870] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-06T20:06:42.912667] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T20:06:42.956347] [INFO ] [REMOTE ] MDV: Full fetch complete (11700 records). [2025-10-06T20:06:42.971901] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-06T20:06:43.030056] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-06T20:06:43.218294] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-06T20:06:43.223576] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-06T20:06:43.231366] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-06T20:06:43.243155] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-06T20:06:43.358250] [DEBUG] [LOCAL ] MD: Trimmed 55200 records to 38383 (keeping 200 days of data) [2025-10-06T20:06:43.574514] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-06T20:06:43.578168] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-06T20:06:43.582497] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-06T20:06:43.584153] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-06T20:06:43.599719] [DEBUG] [LOCAL ] MDV: Trimmed 11700 records to 8498 (keeping 200 days of data) [2025-10-06T20:06:43.749324] [DEBUG] [LOCAL ] MDV: Primary data saved (8498 records). [2025-10-06T20:06:43.751410] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-06T20:06:43.753359] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MDV took 22.8s. Estimated remaining: 2h 28m 7s. Rate: 7.1 symbols/min [2025-10-06T20:06:43.828209] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-06T20:06:43.885428] [DEBUG] [LOCAL ] MD: Primary data saved (38383 records). [2025-10-06T20:06:43.915498] [INFO ] [MAIN ] MD: Full history saved. [2025-10-06T20:06:43.928565] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MD took 40.1s. Estimated remaining: 2h 27m 52s. Rate: 7.1 symbols/min [2025-10-06T20:06:44.004409] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:06:44.151212] [DEBUG] [LOCAL ] MEC: Loaded 16493 existing records from primary storage. [2025-10-06T20:06:44.150790] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:06:44.151805] [INFO ] [MAIN ] MEC: Loaded 16493 existing records. [2025-10-06T20:06:44.340601] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:06:44.347838] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-06T20:06:44.347942] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-06T20:06:44.348333] [DEBUG] [LOCAL ] MED: Loaded 21777 existing records from primary storage. [2025-10-06T20:06:44.348674] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-06T20:06:44.348744] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-06T20:06:44.348614] [INFO ] [MAIN ] MED: Loaded 21777 existing records. [2025-10-06T20:06:44.806009] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:06:44.828776] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-06T20:06:44.828976] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-06T20:06:44.844890] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-06T20:06:44.850092] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-06T20:06:44.984037] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:06:45.034132] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-06T20:06:45.075831] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-06T20:06:45.341328] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:06:45.425485] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-06T20:06:45.819516] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-06T20:06:46.017624] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T20:06:46.227072] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-06T20:06:46.229927] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-06T20:06:47.025581] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-06T20:06:47.825499] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-06T20:06:48.000522] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-06T20:06:48.003639] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-10-06T20:06:48.003827] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-06T20:06:48.393692] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-06T20:06:48.393876] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-06T20:06:48.394999] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-06T20:06:48.395143] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-06T20:06:48.396591] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 53678 (keeping 200 days of data) [2025-10-06T20:06:48.631304] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-06T20:06:48.658317] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T20:06:48.675572] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T20:06:48.785217] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-06T20:06:48.785363] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-06T20:06:48.785449] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 44.9s. Estimated remaining: 2h 27m 40s. Rate: 7.1 symbols/min [2025-10-06T20:06:48.951661] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:06:48.982809] [DEBUG] [LOCAL ] MEG: Loaded 32328 existing records from primary storage. [2025-10-06T20:06:48.983246] [INFO ] [MAIN ] MEG: Loaded 32328 existing records. [2025-10-06T20:06:49.161956] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:06:49.162160] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-06T20:06:49.162206] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-06T20:06:49.162913] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-06T20:06:49.162973] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-06T20:06:49.434933] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-06T20:06:49.516434] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:06:49.749409] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T20:06:50.210282] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T20:06:50.225482] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-06T20:06:51.025511] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-06T20:06:51.236005] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-06T20:06:51.825540] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-06T20:06:52.134332] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T20:06:52.625509] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-06T20:06:52.866352] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T20:06:53.425597] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-06T20:06:54.126409] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T20:06:54.225526] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-06T20:06:54.459034] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-06T20:06:55.025605] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-06T20:06:55.765939] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T20:06:55.769213] [INFO ] [REMOTE ] MDU: Full fetch complete (70413 records). [2025-10-06T20:06:55.769363] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-06T20:06:55.833048] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-06T20:06:56.034127] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T20:06:56.192121] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-06T20:06:56.192212] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-06T20:06:56.193272] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-06T20:06:56.193336] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-06T20:06:56.194755] [DEBUG] [LOCAL ] MDU: Trimmed 70413 records to 47982 (keeping 200 days of data) [2025-10-06T20:06:56.507706] [DEBUG] [LOCAL ] MDU: Primary data saved (47982 records). [2025-10-06T20:06:56.508085] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-06T20:06:56.508237] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDU took 52.6s. Estimated remaining: 2h 27m 31s. Rate: 7.1 symbols/min [2025-10-06T20:06:56.630732] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-06T20:06:56.695408] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:06:56.718358] [DEBUG] [LOCAL ] MEGI: Loaded 20332 existing records from primary storage. [2025-10-06T20:06:56.718622] [INFO ] [MAIN ] MEGI: Loaded 20332 existing records. [2025-10-06T20:06:56.896183] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:06:56.896486] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-06T20:06:56.896532] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-06T20:06:56.897297] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-06T20:06:56.897357] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-06T20:06:57.210739] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T20:06:57.288180] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:06:57.425504] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-06T20:06:58.029993] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T20:06:58.221918] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-06T20:06:58.228405] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-06T20:06:59.025568] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-06T20:06:59.136154] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-06T20:06:59.825556] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-06T20:07:00.269704] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T20:07:00.625509] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-06T20:07:00.914954] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T20:07:01.425495] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-06T20:07:01.738341] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T20:07:02.225556] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-06T20:07:02.695148] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-06T20:07:03.025496] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-06T20:07:03.298221] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T20:07:03.825558] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-06T20:07:04.405463] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T20:07:04.625579] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-06T20:07:04.878350] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T20:07:05.341874] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-06T20:07:05.425531] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-06T20:07:06.219284] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T20:07:06.220618] [INFO ] [REMOTE ] MEC: Full fetch complete (22824 records). [2025-10-06T20:07:06.220749] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-06T20:07:06.232821] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-06T20:07:06.588878] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-06T20:07:06.588959] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-06T20:07:06.589424] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-06T20:07:06.589462] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-06T20:07:06.590070] [DEBUG] [LOCAL ] MEC: Trimmed 22824 records to 16235 (keeping 200 days of data) [2025-10-06T20:07:06.684839] [DEBUG] [LOCAL ] MEC: Primary data saved (16235 records). [2025-10-06T20:07:06.685060] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-06T20:07:06.685179] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MEC took 22.9s. Estimated remaining: 2h 27m 24s. Rate: 7.1 symbols/min [2025-10-06T20:07:06.851728] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:07:06.883313] [DEBUG] [LOCAL ] MEI: Loaded 32495 existing records from primary storage. [2025-10-06T20:07:06.883610] [INFO ] [MAIN ] MEI: Loaded 32495 existing records. [2025-10-06T20:07:07.028064] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-06T20:07:07.070032] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:07:07.070258] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-06T20:07:07.070308] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-06T20:07:07.071258] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-06T20:07:07.071318] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-06T20:07:07.400775] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T20:07:07.447308] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:07:07.825545] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-06T20:07:08.496281] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T20:07:08.625473] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-06T20:07:09.247423] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T20:07:09.425521] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-06T20:07:09.796392] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-06T20:07:10.225527] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-06T20:07:10.509407] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T20:07:11.025571] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-06T20:07:11.504822] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T20:07:11.825506] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-06T20:07:12.085743] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T20:07:12.625493] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-06T20:07:12.866932] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-06T20:07:13.425573] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-06T20:07:13.600962] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T20:07:14.126612] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T20:07:14.225566] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-06T20:07:15.025539] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-06T20:07:15.338094] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-06T20:07:15.825544] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-06T20:07:16.137821] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T20:07:16.139347] [INFO ] [REMOTE ] MED: Full fetch complete (32494 records). [2025-10-06T20:07:16.139421] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-06T20:07:16.501590] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-06T20:07:16.501698] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-06T20:07:16.502320] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-06T20:07:16.502361] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-06T20:07:16.503111] [DEBUG] [LOCAL ] MED: Trimmed 32494 records to 21460 (keeping 200 days of data) [2025-10-06T20:07:16.626809] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-06T20:07:16.635392] [DEBUG] [LOCAL ] MED: Primary data saved (21460 records). [2025-10-06T20:07:16.636252] [INFO ] [MAIN ] MED: Full history saved. [2025-10-06T20:07:16.636348] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MED took 32.7s. Estimated remaining: 2h 27m 17s. Rate: 7.1 symbols/min [2025-10-06T20:07:16.829096] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:07:16.885380] [DEBUG] [LOCAL ] MET: Loaded 54091 existing records from primary storage. [2025-10-06T20:07:16.885759] [INFO ] [MAIN ] MET: Loaded 54091 existing records. [2025-10-06T20:07:17.062636] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:07:17.063064] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-06T20:07:17.063147] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-06T20:07:17.065033] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-06T20:07:17.065097] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-06T20:07:17.445076] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-06T20:07:17.449063] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:07:17.458800] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T20:07:17.966598] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T20:07:18.225488] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-06T20:07:18.460328] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T20:07:19.025585] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-06T20:07:19.805671] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T20:07:19.825489] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-06T20:07:20.501598] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T20:07:20.625535] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-06T20:07:21.425508] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-06T20:07:21.549196] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T20:07:21.827278] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T20:07:21.829501] [INFO ] [REMOTE ] MEG: Full fetch complete (47768 records). [2025-10-06T20:07:21.829597] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-06T20:07:22.217521] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-06T20:07:22.217609] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-06T20:07:22.218595] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-06T20:07:22.218686] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-06T20:07:22.219796] [DEBUG] [LOCAL ] MEG: Trimmed 47768 records to 31610 (keeping 200 days of data) [2025-10-06T20:07:22.267496] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-06T20:07:22.407376] [DEBUG] [LOCAL ] MEG: Primary data saved (31610 records). [2025-10-06T20:07:22.407634] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-06T20:07:22.411493] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MEG took 33.6s. Estimated remaining: 2h 27m 6s. Rate: 7.1 symbols/min [2025-10-06T20:07:22.614318] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T20:07:22.613172] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:07:22.666454] [DEBUG] [LOCAL ] MFA: Loaded 46145 existing records from primary storage. [2025-10-06T20:07:22.666949] [INFO ] [MAIN ] MFA: Loaded 46145 existing records. [2025-10-06T20:07:22.862148] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:07:22.862419] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-06T20:07:22.862472] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-06T20:07:22.863681] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-06T20:07:22.863747] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-06T20:07:23.030770] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-06T20:07:23.266836] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:07:23.825496] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-06T20:07:23.973631] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T20:07:24.595196] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T20:07:24.625490] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-06T20:07:25.409170] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T20:07:25.425489] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-06T20:07:25.974262] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T20:07:26.225543] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-06T20:07:26.588089] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T20:07:26.882271] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-06T20:07:27.025588] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-06T20:07:27.825550] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-06T20:07:28.186344] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T20:07:28.625508] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-06T20:07:29.283508] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T20:07:29.425590] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-06T20:07:30.225534] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-06T20:07:30.451375] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T20:07:30.646012] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-06T20:07:31.025579] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-06T20:07:31.303797] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T20:07:31.825536] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-06T20:07:32.232575] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-06T20:07:32.430806] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-06T20:07:32.625603] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-06T20:07:33.425527] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-06T20:07:33.730113] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T20:07:34.225531] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-06T20:07:35.025533] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-06T20:07:35.286938] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T20:07:35.825568] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-06T20:07:35.914597] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T20:07:36.115174] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T20:07:36.625589] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-06T20:07:37.425567] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-06T20:07:37.616259] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T20:07:38.059247] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T20:07:38.060697] [INFO ] [REMOTE ] MEGI: Full fetch complete (30164 records). [2025-10-06T20:07:38.060787] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-06T20:07:38.239805] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-06T20:07:38.444332] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-06T20:07:38.444441] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-06T20:07:38.445275] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-06T20:07:38.453815] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-06T20:07:38.471100] [DEBUG] [LOCAL ] MEGI: Trimmed 30164 records to 19965 (keeping 200 days of data) [2025-10-06T20:07:38.470992] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-06T20:07:38.599048] [DEBUG] [LOCAL ] MEGI: Primary data saved (19965 records). [2025-10-06T20:07:38.599203] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-06T20:07:38.599309] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEGI took 42.1s. Estimated remaining: 2h 27m 4s. Rate: 7.1 symbols/min [2025-10-06T20:07:38.771856] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:07:38.777917] [DEBUG] [LOCAL ] MFAN: Loaded 4303 existing records from primary storage. [2025-10-06T20:07:38.778114] [INFO ] [MAIN ] MFAN: Loaded 4303 existing records. [2025-10-06T20:07:38.955463] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:07:38.955735] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-06T20:07:38.955822] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-06T20:07:38.956088] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-06T20:07:38.956146] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-06T20:07:39.030718] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-06T20:07:39.317981] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:07:39.825499] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-06T20:07:40.004410] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T20:07:40.625608] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-06T20:07:40.673205] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T20:07:41.126126] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T20:07:41.425527] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-06T20:07:42.225512] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-06T20:07:42.523504] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T20:07:42.619102] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T20:07:43.025533] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-06T20:07:43.825762] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-06T20:07:43.930446] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T20:07:44.260452] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-06T20:07:44.278461] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T20:07:44.281118] [INFO ] [REMOTE ] MEI: Full fetch complete (45578 records). [2025-10-06T20:07:44.281274] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-06T20:07:44.631400] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-06T20:07:44.732031] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-06T20:07:44.732150] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-06T20:07:44.733388] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-06T20:07:44.733457] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-06T20:07:44.734864] [DEBUG] [LOCAL ] MEI: Trimmed 45578 records to 31914 (keeping 200 days of data) [2025-10-06T20:07:44.929933] [DEBUG] [LOCAL ] MEI: Primary data saved (31914 records). [2025-10-06T20:07:44.930152] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-06T20:07:44.930264] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEI took 38.2s. Estimated remaining: 2h 26m 54s. Rate: 7.1 symbols/min [2025-10-06T20:07:45.109746] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:07:45.117403] [DEBUG] [LOCAL ] MFAO: Loaded 3886 existing records from primary storage. [2025-10-06T20:07:45.117705] [INFO ] [MAIN ] MFAO: Loaded 3886 existing records. [2025-10-06T20:07:45.312702] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:07:45.313022] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-06T20:07:45.313088] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-06T20:07:45.313389] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-06T20:07:45.313449] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-06T20:07:45.430758] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-06T20:07:45.693619] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:07:46.056488] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T20:07:46.225628] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-06T20:07:46.417210] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T20:07:46.694006] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-06T20:07:47.025541] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-06T20:07:47.583759] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-06T20:07:47.825598] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-06T20:07:48.400616] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-06T20:07:48.625594] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-06T20:07:49.223573] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-06T20:07:49.425568] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-06T20:07:50.225569] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-06T20:07:50.820111] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-06T20:07:51.025556] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-06T20:07:51.111192] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T20:07:51.825545] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-06T20:07:52.625506] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-06T20:07:52.671293] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T20:07:53.203793] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T20:07:53.352392] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T20:07:53.355592] [INFO ] [REMOTE ] MET: Full fetch complete (77124 records). [2025-10-06T20:07:53.355766] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-06T20:07:53.430704] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-06T20:07:53.749699] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-06T20:07:53.749799] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-06T20:07:53.750863] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-06T20:07:53.750945] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-06T20:07:53.752443] [DEBUG] [LOCAL ] MET: Trimmed 77124 records to 53321 (keeping 200 days of data) [2025-10-06T20:07:54.083616] [DEBUG] [LOCAL ] MET: Primary data saved (53321 records). [2025-10-06T20:07:54.083824] [INFO ] [MAIN ] MET: Full history saved. [2025-10-06T20:07:54.084678] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MET took 37.4s. Estimated remaining: 2h 26m 46s. Rate: 7.1 symbols/min [2025-10-06T20:07:54.250291] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-06T20:07:54.253537] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:07:54.305714] [DEBUG] [LOCAL ] MFC: Loaded 51889 existing records from primary storage. [2025-10-06T20:07:54.306135] [INFO ] [MAIN ] MFC: Loaded 51889 existing records. [2025-10-06T20:07:54.482053] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:07:54.482288] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-06T20:07:54.482336] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-06T20:07:54.483453] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-06T20:07:54.483516] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-06T20:07:54.854526] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T20:07:54.861297] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:07:55.025505] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-06T20:07:55.070974] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T20:07:55.590358] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T20:07:55.825611] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-06T20:07:56.625577] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-06T20:07:57.179177] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-06T20:07:57.265961] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T20:07:57.269295] [INFO ] [REMOTE ] MFA: Full fetch complete (65235 records). [2025-10-06T20:07:57.269410] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-06T20:07:57.430773] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-06T20:07:57.676248] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-06T20:07:57.676329] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-06T20:07:57.677316] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-06T20:07:57.677379] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-06T20:07:57.678731] [DEBUG] [LOCAL ] MFA: Trimmed 65235 records to 45559 (keeping 200 days of data) [2025-10-06T20:07:57.950832] [DEBUG] [LOCAL ] MFA: Primary data saved (45559 records). [2025-10-06T20:07:57.951019] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-06T20:07:57.951132] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MFA took 35.5s. Estimated remaining: 2h 26m 34s. Rate: 7.1 symbols/min [2025-10-06T20:07:58.059471] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-06T20:07:58.130133] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:07:58.175191] [DEBUG] [LOCAL ] MFG: Loaded 49937 existing records from primary storage. [2025-10-06T20:07:58.175569] [INFO ] [MAIN ] MFG: Loaded 49937 existing records. [2025-10-06T20:07:58.230766] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-06T20:07:58.354524] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:07:58.354772] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-06T20:07:58.354821] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-06T20:07:58.355759] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-06T20:07:58.355820] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-06T20:07:58.715166] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:07:58.908505] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-06T20:07:59.025486] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-06T20:07:59.825575] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-06T20:08:00.319701] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-06T20:08:00.320568] [INFO ] [REMOTE ] MFAN: Full fetch complete (5773 records). [2025-10-06T20:08:00.320639] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-06T20:08:00.626968] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-06T20:08:00.694290] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-06T20:08:00.694616] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-06T20:08:00.695061] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-06T20:08:00.695261] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-06T20:08:00.695948] [DEBUG] [LOCAL ] MFAN: Trimmed 5773 records to 4269 (keeping 200 days of data) [2025-10-06T20:08:00.741166] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T20:08:00.756858] [DEBUG] [LOCAL ] MFAN: Primary data saved (4269 records). [2025-10-06T20:08:00.756967] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-06T20:08:00.757054] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MFAN took 22.2s. Estimated remaining: 2h 26m 21s. Rate: 7.1 symbols/min [2025-10-06T20:08:00.932118] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:08:00.947241] [DEBUG] [LOCAL ] MFM: Loaded 14967 existing records from primary storage. [2025-10-06T20:08:00.947528] [INFO ] [MAIN ] MFM: Loaded 14967 existing records. [2025-10-06T20:08:01.124519] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:08:01.124788] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-06T20:08:01.124847] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-06T20:08:01.125261] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-06T20:08:01.125320] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-06T20:08:01.430812] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-06T20:08:01.486398] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:08:01.984582] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-06T20:08:02.225613] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-06T20:08:02.447003] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T20:08:03.025553] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-06T20:08:03.484083] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T20:08:03.825530] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-06T20:08:04.003798] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T20:08:04.625529] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-06T20:08:05.212512] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-06T20:08:05.385699] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T20:08:05.425487] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-06T20:08:06.225570] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-06T20:08:06.951377] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T20:08:07.010262] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T20:08:07.025472] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-06T20:08:07.825555] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-06T20:08:08.625492] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-06T20:08:08.721481] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T20:08:08.975284] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-06T20:08:09.425507] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-06T20:08:09.515752] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T20:08:09.988755] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-06T20:08:10.225542] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-06T20:08:11.025524] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-06T20:08:11.706905] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T20:08:11.825581] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-06T20:08:11.868052] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T20:08:12.625557] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-06T20:08:13.434931] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-06T20:08:13.457260] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T20:08:13.479837] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T20:08:14.100976] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-06T20:08:14.225592] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-06T20:08:14.780530] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T20:08:15.025544] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-06T20:08:15.825536] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-06T20:08:16.625540] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-06T20:08:16.845432] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-06T20:08:16.955896] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T20:08:17.092661] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-06T20:08:17.425509] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-06T20:08:18.210588] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T20:08:18.225467] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-06T20:08:19.025528] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-06T20:08:19.049591] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-06T20:08:19.825537] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-06T20:08:20.625499] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-06T20:08:20.811733] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T20:08:20.841865] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T20:08:21.110460] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T20:08:21.111337] [INFO ] [REMOTE ] MFAO: Full fetch complete (5364 records). [2025-10-06T20:08:21.111406] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-06T20:08:21.431543] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-06T20:08:21.474158] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-06T20:08:21.474230] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-06T20:08:21.474392] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-06T20:08:21.474466] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-06T20:08:21.474914] [DEBUG] [LOCAL ] MFAO: Trimmed 5364 records to 3886 (keeping 200 days of data) [2025-10-06T20:08:21.499373] [DEBUG] [LOCAL ] MFAO: Primary data saved (3886 records). [2025-10-06T20:08:21.499464] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-06T20:08:21.499540] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFAO took 36.6s. Estimated remaining: 2h 26m 22s. Rate: 7.1 symbols/min [2025-10-06T20:08:21.669149] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:08:21.669362] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-06T20:08:21.669399] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-06T20:08:21.669518] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-06T20:08:21.669559] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-06T20:08:21.669600] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-06T20:08:21.669631] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-06T20:08:22.021975] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:08:22.225581] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-06T20:08:22.290349] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T20:08:22.498372] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-06T20:08:23.025489] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-06T20:08:23.825510] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-06T20:08:23.862468] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T20:08:24.625579] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-06T20:08:25.425555] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-06T20:08:25.466408] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T20:08:25.758387] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-06T20:08:26.225547] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-06T20:08:26.353211] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T20:08:27.025579] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-06T20:08:27.251114] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-06T20:08:27.825480] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-06T20:08:27.897389] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T20:08:28.625518] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-06T20:08:28.943531] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-06T20:08:29.276848] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T20:08:29.280867] [INFO ] [REMOTE ] MFG: Full fetch complete (69036 records). [2025-10-06T20:08:29.281005] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-06T20:08:29.430829] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-06T20:08:29.727450] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-06T20:08:29.727544] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-06T20:08:29.728545] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-06T20:08:29.728609] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-06T20:08:29.729924] [DEBUG] [LOCAL ] MFG: Trimmed 69036 records to 49260 (keeping 200 days of data) [2025-10-06T20:08:30.007901] [DEBUG] [LOCAL ] MFG: Primary data saved (49260 records). [2025-10-06T20:08:30.008094] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-06T20:08:30.008199] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFG took 32.1s. Estimated remaining: 2h 26m 14s. Rate: 7.1 symbols/min [2025-10-06T20:08:30.180752] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:08:30.189351] [DEBUG] [LOCAL ] MFSG: Loaded 5487 existing records from primary storage. [2025-10-06T20:08:30.189559] [INFO ] [MAIN ] MFSG: Loaded 5487 existing records. [2025-10-06T20:08:30.232205] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-06T20:08:30.298477] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T20:08:30.321807] [INFO ] [REMOTE ] MFM: Full fetch complete (19703 records). [2025-10-06T20:08:30.341377] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-06T20:08:30.475429] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:08:30.486064] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-06T20:08:30.486450] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-06T20:08:30.502339] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-06T20:08:30.507580] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-06T20:08:31.030485] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-06T20:08:31.092624] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-06T20:08:31.117044] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-06T20:08:31.126481] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-06T20:08:31.128452] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-06T20:08:31.132125] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:08:31.133445] [DEBUG] [LOCAL ] MFM: Trimmed 19703 records to 14802 (keeping 200 days of data) [2025-10-06T20:08:31.222984] [DEBUG] [LOCAL ] MFM: Primary data saved (14802 records). [2025-10-06T20:08:31.223161] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-06T20:08:31.223256] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFM took 30.5s. Estimated remaining: 2h 25m 60s. Rate: 7.1 symbols/min [2025-10-06T20:08:31.401606] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:08:31.416120] [DEBUG] [LOCAL ] MFSI: Loaded 11669 existing records from primary storage. [2025-10-06T20:08:31.416378] [INFO ] [MAIN ] MFSI: Loaded 11669 existing records. [2025-10-06T20:08:31.470208] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-06T20:08:31.616093] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:08:31.616379] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-06T20:08:31.616429] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-06T20:08:31.616853] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-06T20:08:31.616914] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-06T20:08:31.832683] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-06T20:08:31.999862] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:08:32.032594] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T20:08:32.256164] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-06T20:08:32.625533] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-06T20:08:33.061021] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-06T20:08:33.425542] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-06T20:08:33.854388] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-06T20:08:34.225536] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-06T20:08:34.652631] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-06T20:08:35.025556] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-06T20:08:35.422262] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-06T20:08:35.825536] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-06T20:08:36.464341] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-06T20:08:36.625600] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-06T20:08:37.231162] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-06T20:08:37.425521] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-06T20:08:38.025494] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T20:08:38.225516] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-06T20:08:38.848417] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-06T20:08:39.025551] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-06T20:08:39.602123] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-06T20:08:39.825531] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-06T20:08:40.384078] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T20:08:40.625548] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-06T20:08:40.862638] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-06T20:08:41.425587] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-06T20:08:42.225545] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-06T20:08:42.935475] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-06T20:08:43.025496] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-06T20:08:43.184976] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T20:08:43.578362] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-06T20:08:43.825508] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-06T20:08:44.625522] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-06T20:08:45.367928] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T20:08:45.399322] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T20:08:45.425471] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-06T20:08:46.225563] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-06T20:08:46.967193] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T20:08:46.968209] [INFO ] [REMOTE ] MFSG: Full fetch complete (6220 records). [2025-10-06T20:08:46.968280] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-06T20:08:47.040008] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-06T20:08:47.368024] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-06T20:08:47.368497] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-06T20:08:47.369158] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-06T20:08:47.388680] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-06T20:08:47.390042] [DEBUG] [LOCAL ] MFSG: Trimmed 6220 records to 5492 (keeping 200 days of data) [2025-10-06T20:08:47.436893] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-06T20:08:47.471166] [DEBUG] [LOCAL ] MFSG: Primary data saved (5492 records). [2025-10-06T20:08:47.471319] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-06T20:08:47.471418] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFSG took 17.5s. Estimated remaining: 2h 25m 57s. Rate: 7.1 symbols/min [2025-10-06T20:08:47.644031] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-06T20:08:47.673232] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:08:47.680060] [DEBUG] [LOCAL ] MFSV: Loaded 2639 existing records from primary storage. [2025-10-06T20:08:47.680305] [INFO ] [MAIN ] MFSV: Loaded 2639 existing records. [2025-10-06T20:08:47.830686] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-06T20:08:47.890684] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:08:47.891205] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-06T20:08:47.891279] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-06T20:08:47.891562] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-06T20:08:47.891638] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-06T20:08:48.294270] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-06T20:08:48.430893] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:08:48.625599] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-06T20:08:48.957163] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-06T20:08:49.425570] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-06T20:08:49.881965] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-06T20:08:50.225500] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-06T20:08:50.810340] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-06T20:08:51.025610] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-06T20:08:51.357677] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-06T20:08:51.825565] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-06T20:08:52.544322] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T20:08:52.625594] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-06T20:08:53.425541] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-06T20:08:53.762687] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-06T20:08:54.225556] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-06T20:08:54.372524] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T20:08:54.686420] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-06T20:08:55.025537] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-06T20:08:55.294764] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-06T20:08:55.825565] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-06T20:08:56.353142] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T20:08:56.354128] [INFO ] [REMOTE ] MFSB: Full fetch complete (1749 records). [2025-10-06T20:08:56.354204] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-06T20:08:56.529839] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-06T20:08:56.530141] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:08:56.530213] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:08:56.530286] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-06T20:08:56.530355] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-06T20:08:56.530390] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-06T20:08:56.530444] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-06T20:08:56.530523] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFSB took 35.0s. Estimated remaining: 2h 25m 49s. Rate: 7.1 symbols/min [2025-10-06T20:08:56.629866] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-06T20:08:56.706437] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:08:56.725737] [DEBUG] [LOCAL ] MG: Loaded 16608 existing records from primary storage. [2025-10-06T20:08:56.726015] [INFO ] [MAIN ] MG: Loaded 16608 existing records. [2025-10-06T20:08:56.905466] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:08:56.905741] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-06T20:08:56.905795] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-06T20:08:56.905990] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-06T20:08:56.906046] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-06T20:08:57.272397] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:08:57.425593] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-06T20:08:58.225538] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-06T20:08:58.342276] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T20:08:58.484784] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-06T20:08:58.502405] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-06T20:08:59.025568] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-06T20:08:59.825546] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-06T20:08:59.900889] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T20:09:00.238376] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-06T20:09:00.625569] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-06T20:09:01.087013] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-06T20:09:01.425597] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-06T20:09:02.225694] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-06T20:09:02.402380] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T20:09:02.855133] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-06T20:09:03.025552] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-06T20:09:03.825506] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-06T20:09:03.969604] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T20:09:04.169517] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-06T20:09:04.625543] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-06T20:09:05.425586] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-06T20:09:06.168770] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T20:09:06.171865] [INFO ] [REMOTE ] MFC: Full fetch complete (74115 records). [2025-10-06T20:09:06.171993] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-06T20:09:06.230814] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-06T20:09:06.299140] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-06T20:09:06.588410] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-06T20:09:06.588499] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-06T20:09:06.589986] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-06T20:09:06.590075] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-06T20:09:06.592270] [DEBUG] [LOCAL ] MFC: Trimmed 74115 records to 51089 (keeping 200 days of data) [2025-10-06T20:09:06.711632] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-06T20:09:06.939451] [DEBUG] [LOCAL ] MFC: Primary data saved (51089 records). [2025-10-06T20:09:06.939613] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-06T20:09:06.939742] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFC took 1m 13s. Estimated remaining: 2h 25m 42s. Rate: 7.1 symbols/min [2025-10-06T20:09:07.030750] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-06T20:09:07.109756] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:09:07.166984] [DEBUG] [LOCAL ] MGA: Loaded 51428 existing records from primary storage. [2025-10-06T20:09:07.167335] [INFO ] [MAIN ] MGA: Loaded 51428 existing records. [2025-10-06T20:09:07.347268] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:09:07.347577] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-06T20:09:07.347631] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-06T20:09:07.348101] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-06T20:09:07.348159] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-06T20:09:07.762854] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:09:07.825543] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-06T20:09:07.918385] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-06T20:09:07.919731] [INFO ] [REMOTE ] MFSI: Full fetch complete (13945 records). [2025-10-06T20:09:07.919804] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-06T20:09:08.274237] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-06T20:09:08.274317] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-06T20:09:08.274685] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-06T20:09:08.274746] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-06T20:09:08.275216] [DEBUG] [LOCAL ] MFSI: Trimmed 13945 records to 11672 (keeping 200 days of data) [2025-10-06T20:09:08.347614] [DEBUG] [LOCAL ] MFSI: Primary data saved (11672 records). [2025-10-06T20:09:08.347815] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-06T20:09:08.347911] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSI took 37.1s. Estimated remaining: 2h 25m 28s. Rate: 7.1 symbols/min [2025-10-06T20:09:08.516479] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:09:08.523072] [DEBUG] [LOCAL ] MGF: Loaded 4313 existing records from primary storage. [2025-10-06T20:09:08.523260] [INFO ] [MAIN ] MGF: Loaded 4313 existing records. [2025-10-06T20:09:08.630725] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-06T20:09:08.701677] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:09:08.701911] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-06T20:09:08.701964] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-06T20:09:08.702126] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-06T20:09:08.702181] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-06T20:09:09.067723] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-06T20:09:09.070888] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:09:09.425584] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-06T20:09:10.070295] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T20:09:10.225608] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-06T20:09:10.500442] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-06T20:09:10.578333] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-06T20:09:11.025590] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-06T20:09:11.721044] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-06T20:09:11.825549] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-06T20:09:12.625504] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-06T20:09:12.912219] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T20:09:13.425575] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-06T20:09:13.980753] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T20:09:14.225571] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-06T20:09:14.373053] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T20:09:14.786758] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-06T20:09:15.025616] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-06T20:09:15.825532] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-06T20:09:16.425782] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-06T20:09:16.625497] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-06T20:09:16.714330] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T20:09:17.143966] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T20:09:17.144822] [INFO ] [REMOTE ] MFSV: Full fetch complete (3280 records). [2025-10-06T20:09:17.144891] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-06T20:09:17.429036] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-06T20:09:17.512783] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-06T20:09:17.512860] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-06T20:09:17.512980] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-06T20:09:17.513017] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-06T20:09:17.513366] [DEBUG] [LOCAL ] MFSV: Trimmed 3280 records to 2634 (keeping 200 days of data) [2025-10-06T20:09:17.530901] [DEBUG] [LOCAL ] MFSV: Primary data saved (2634 records). [2025-10-06T20:09:17.530967] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-06T20:09:17.531035] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSV took 30.1s. Estimated remaining: 2h 25m 20s. Rate: 7.1 symbols/min [2025-10-06T20:09:17.696935] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:09:17.746934] [DEBUG] [LOCAL ] MGM: Loaded 54387 existing records from primary storage. [2025-10-06T20:09:17.747340] [INFO ] [MAIN ] MGM: Loaded 54387 existing records. [2025-10-06T20:09:17.921884] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:09:17.922120] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-06T20:09:17.922168] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-06T20:09:17.922458] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-06T20:09:17.922515] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-06T20:09:18.230275] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-06T20:09:18.284272] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:09:18.366206] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T20:09:18.624371] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-06T20:09:19.025566] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-06T20:09:19.825564] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-06T20:09:20.625554] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-06T20:09:20.882443] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T20:09:20.912754] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T20:09:20.984068] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-06T20:09:21.425526] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-06T20:09:22.225496] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-06T20:09:22.350863] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T20:09:23.025532] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-06T20:09:23.825497] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-06T20:09:24.117843] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-06T20:09:24.364144] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T20:09:24.625503] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-06T20:09:24.768846] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T20:09:25.425529] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-06T20:09:26.225505] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-06T20:09:26.505238] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T20:09:26.788977] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-06T20:09:27.025559] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-06T20:09:27.176117] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T20:09:27.825539] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-06T20:09:28.625531] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-06T20:09:28.776962] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T20:09:29.070202] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-06T20:09:29.425538] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-06T20:09:29.584106] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T20:09:29.982670] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-06T20:09:30.225534] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-06T20:09:31.025527] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-06T20:09:31.617285] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T20:09:31.825498] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-06T20:09:32.106327] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T20:09:32.625511] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-06T20:09:33.425510] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-06T20:09:33.596052] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T20:09:34.225525] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-06T20:09:34.239577] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T20:09:34.241777] [INFO ] [REMOTE ] MG: Full fetch complete (23908 records). [2025-10-06T20:09:34.241865] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-06T20:09:34.540471] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T20:09:34.710553] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-06T20:09:34.710710] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-06T20:09:34.711543] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-06T20:09:34.711632] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-06T20:09:34.713012] [DEBUG] [LOCAL ] MG: Trimmed 23908 records to 16310 (keeping 200 days of data) [2025-10-06T20:09:34.822778] [DEBUG] [LOCAL ] MG: Primary data saved (16310 records). [2025-10-06T20:09:34.822990] [INFO ] [MAIN ] MG: Full history saved. [2025-10-06T20:09:34.823099] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MG took 38.3s. Estimated remaining: 2h 25m 19s. Rate: 7.1 symbols/min [2025-10-06T20:09:34.999401] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:09:35.009159] [DEBUG] [LOCAL ] MGR: Loaded 5687 existing records from primary storage. [2025-10-06T20:09:35.009428] [INFO ] [MAIN ] MGR: Loaded 5687 existing records. [2025-10-06T20:09:35.030781] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-06T20:09:35.198735] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:09:35.199105] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-06T20:09:35.199156] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-06T20:09:35.199472] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-06T20:09:35.199529] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-06T20:09:35.577884] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:09:35.825565] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-06T20:09:35.882098] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T20:09:36.566973] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T20:09:36.630895] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-06T20:09:36.655875] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T20:09:37.425562] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-06T20:09:37.471978] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T20:09:38.225522] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-06T20:09:38.955543] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T20:09:39.025497] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-06T20:09:39.220238] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T20:09:39.541269] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T20:09:39.542288] [INFO ] [REMOTE ] MGF: Full fetch complete (5914 records). [2025-10-06T20:09:39.542361] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-06T20:09:39.830742] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-06T20:09:39.931380] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-06T20:09:39.931519] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-06T20:09:39.931820] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-06T20:09:39.931884] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-06T20:09:39.932310] [DEBUG] [LOCAL ] MGF: Trimmed 5914 records to 4270 (keeping 200 days of data) [2025-10-06T20:09:39.959585] [DEBUG] [LOCAL ] MGF: Primary data saved (4270 records). [2025-10-06T20:09:39.959805] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-06T20:09:39.959915] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MGF took 31.6s. Estimated remaining: 2h 25m 8s. Rate: 7.1 symbols/min [2025-10-06T20:09:40.148009] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:09:40.157722] [DEBUG] [LOCAL ] MGRB: Loaded 4092 existing records from primary storage. [2025-10-06T20:09:40.158113] [INFO ] [MAIN ] MGRB: Loaded 4092 existing records. [2025-10-06T20:09:40.433372] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:09:40.433682] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-06T20:09:40.433744] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-06T20:09:40.433925] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-06T20:09:40.433983] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-06T20:09:40.635706] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-06T20:09:40.914240] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:09:41.305595] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-06T20:09:41.425556] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-06T20:09:41.545840] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T20:09:42.036269] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-06T20:09:42.225504] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-06T20:09:43.025584] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-06T20:09:43.621268] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-06T20:09:43.825581] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-06T20:09:44.177584] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-06T20:09:44.625510] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-06T20:09:45.196899] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-06T20:09:45.295836] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T20:09:45.298873] [INFO ] [REMOTE ] MGA: Full fetch complete (73710 records). [2025-10-06T20:09:45.298997] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-06T20:09:45.430618] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-06T20:09:45.710802] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-06T20:09:45.710920] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-06T20:09:45.712569] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-06T20:09:45.712709] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-06T20:09:45.715070] [DEBUG] [LOCAL ] MGA: Trimmed 73710 records to 50673 (keeping 200 days of data) [2025-10-06T20:09:46.066963] [DEBUG] [LOCAL ] MGA: Primary data saved (50673 records). [2025-10-06T20:09:46.067430] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-06T20:09:46.067556] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MGA took 39.1s. Estimated remaining: 2h 24m 57s. Rate: 7.1 symbols/min [2025-10-06T20:09:46.156386] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T20:09:46.234145] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-06T20:09:46.255211] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:09:46.263064] [DEBUG] [LOCAL ] MGRD: Loaded 2257 existing records from primary storage. [2025-10-06T20:09:46.263258] [INFO ] [MAIN ] MGRD: Loaded 2257 existing records. [2025-10-06T20:09:46.448460] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:09:46.448823] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-06T20:09:46.448877] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-06T20:09:46.449458] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-06T20:09:46.449519] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-06T20:09:46.822705] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:09:46.985217] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T20:09:47.025543] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-06T20:09:47.534319] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-06T20:09:47.825550] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-06T20:09:48.591287] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-06T20:09:48.625538] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-06T20:09:49.186367] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T20:09:49.425594] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-06T20:09:50.017900] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-06T20:09:50.225592] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-06T20:09:51.025613] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-06T20:09:51.580457] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-06T20:09:51.825500] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-06T20:09:52.071990] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T20:09:52.385043] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-06T20:09:52.625536] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-06T20:09:53.217391] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T20:09:53.425579] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-06T20:09:54.054712] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-06T20:09:54.225520] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-06T20:09:54.857604] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T20:09:55.025537] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-06T20:09:55.779924] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T20:09:55.825473] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-06T20:09:56.515137] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-06T20:09:56.625541] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-06T20:09:57.425562] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-06T20:09:58.219070] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-06T20:09:58.225466] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-06T20:09:58.437104] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T20:09:58.683308] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T20:09:58.684315] [INFO ] [REMOTE ] MGR: Full fetch complete (8091 records). [2025-10-06T20:09:58.684390] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-06T20:09:59.037845] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-06T20:09:59.046411] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-06T20:09:59.046494] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-06T20:09:59.046768] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-06T20:09:59.046829] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-06T20:09:59.047244] [DEBUG] [LOCAL ] MGR: Trimmed 8091 records to 5620 (keeping 200 days of data) [2025-10-06T20:09:59.082560] [DEBUG] [LOCAL ] MGR: Primary data saved (5620 records). [2025-10-06T20:09:59.082718] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-06T20:09:59.082813] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGR took 24.3s. Estimated remaining: 2h 24m 52s. Rate: 7.1 symbols/min [2025-10-06T20:09:59.249584] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:09:59.259554] [DEBUG] [LOCAL ] MGRE: Loaded 6744 existing records from primary storage. [2025-10-06T20:09:59.259820] [INFO ] [MAIN ] MGRE: Loaded 6744 existing records. [2025-10-06T20:09:59.436830] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:09:59.437094] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-06T20:09:59.437142] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-06T20:09:59.437329] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-06T20:09:59.437387] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-06T20:09:59.803326] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:09:59.825482] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-06T20:10:00.419321] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T20:10:00.625527] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-06T20:10:00.905408] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-06T20:10:00.908624] [INFO ] [REMOTE ] MGM: Full fetch complete (77603 records). [2025-10-06T20:10:00.908790] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-06T20:10:01.259848] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-06T20:10:01.399384] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-06T20:10:01.399485] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-06T20:10:01.400673] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-06T20:10:01.400741] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-06T20:10:01.402606] [DEBUG] [LOCAL ] MGM: Trimmed 77603 records to 53607 (keeping 200 days of data) [2025-10-06T20:10:01.460752] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-06T20:10:01.746569] [DEBUG] [LOCAL ] MGM: Primary data saved (53607 records). [2025-10-06T20:10:01.746918] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-06T20:10:01.747071] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGM took 44.2s. Estimated remaining: 2h 24m 39s. Rate: 7.1 symbols/min [2025-10-06T20:10:01.923119] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:10:01.937414] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-06T20:10:01.986534] [DEBUG] [LOCAL ] MGY: Loaded 53185 existing records from primary storage. [2025-10-06T20:10:01.986973] [INFO ] [MAIN ] MGY: Loaded 53185 existing records. [2025-10-06T20:10:02.168408] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:10:02.168834] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-06T20:10:02.168893] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-06T20:10:02.169114] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-06T20:10:02.169170] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-06T20:10:02.230614] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-06T20:10:02.549100] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:10:02.850438] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-06T20:10:03.025539] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-06T20:10:03.825536] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-06T20:10:04.625562] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-06T20:10:04.664494] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T20:10:04.665384] [INFO ] [REMOTE ] MGRB: Full fetch complete (5976 records). [2025-10-06T20:10:04.665453] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-06T20:10:04.952401] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-06T20:10:05.094109] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-06T20:10:05.093858] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-06T20:10:05.094354] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-06T20:10:05.096516] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-06T20:10:05.096583] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-06T20:10:05.097126] [DEBUG] [LOCAL ] MGRB: Trimmed 5976 records to 4057 (keeping 200 days of data) [2025-10-06T20:10:05.122668] [DEBUG] [LOCAL ] MGRB: Primary data saved (4057 records). [2025-10-06T20:10:05.122760] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-06T20:10:05.122845] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGRB took 25.2s. Estimated remaining: 2h 24m 27s. Rate: 7.1 symbols/min [2025-10-06T20:10:05.295894] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:10:05.296114] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-06T20:10:05.296164] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-06T20:10:05.296286] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-06T20:10:05.296352] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-06T20:10:05.296395] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-06T20:10:05.296428] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-06T20:10:05.438358] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-06T20:10:05.702251] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:10:06.189784] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T20:10:06.225462] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-06T20:10:06.833263] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-06T20:10:07.025520] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-06T20:10:07.567302] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-06T20:10:07.825546] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-06T20:10:08.304166] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-06T20:10:08.625576] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-06T20:10:09.425574] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-06T20:10:09.642876] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:10:09.643117] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-06T20:10:09.643213] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:10:09.643265] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-06T20:10:09.643323] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:10:09.643394] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-06T20:10:09.643458] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-06T20:10:09.643494] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-06T20:10:09.643533] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-06T20:10:09.643579] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MH took 4.5s. Estimated remaining: 2h 24m 16s. Rate: 7.1 symbols/min [2025-10-06T20:10:09.816122] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:10:09.831697] [DEBUG] [LOCAL ] MHD: Loaded 12685 existing records from primary storage. [2025-10-06T20:10:09.831951] [INFO ] [MAIN ] MHD: Loaded 12685 existing records. [2025-10-06T20:10:10.012579] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:10:10.012865] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-06T20:10:10.012914] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-06T20:10:10.013103] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-06T20:10:10.013161] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-06T20:10:10.229296] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-06T20:10:10.414883] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:10:10.417350] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T20:10:10.748133] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-06T20:10:11.025609] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-06T20:10:11.825501] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-06T20:10:11.968878] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T20:10:12.273352] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-06T20:10:12.625493] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-06T20:10:13.063700] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-06T20:10:13.425572] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-06T20:10:13.991854] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T20:10:14.225595] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-06T20:10:14.921698] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T20:10:15.025509] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-06T20:10:15.825579] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-06T20:10:16.449813] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-06T20:10:16.625488] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-06T20:10:16.673820] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T20:10:17.074327] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-06T20:10:17.425544] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-06T20:10:18.225547] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-06T20:10:18.873058] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-06T20:10:18.882441] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T20:10:19.025561] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-06T20:10:19.825542] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-06T20:10:20.625493] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-06T20:10:20.768002] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-06T20:10:20.773700] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T20:10:21.019975] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-06T20:10:21.020718] [INFO ] [REMOTE ] MGRD: Full fetch complete (3475 records). [2025-10-06T20:10:21.020789] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-06T20:10:21.394755] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-06T20:10:21.394875] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-06T20:10:21.395084] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-06T20:10:21.395129] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-06T20:10:21.395733] [DEBUG] [LOCAL ] MGRD: Trimmed 3475 records to 2227 (keeping 200 days of data) [2025-10-06T20:10:21.413354] [DEBUG] [LOCAL ] MGRD: Primary data saved (2227 records). [2025-10-06T20:10:21.413560] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-06T20:10:21.413698] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MGRD took 35.3s. Estimated remaining: 2h 24m 10s. Rate: 7.1 symbols/min [2025-10-06T20:10:21.430639] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-06T20:10:21.615916] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:10:21.631291] [DEBUG] [LOCAL ] MHF: Loaded 8774 existing records from primary storage. [2025-10-06T20:10:21.631718] [INFO ] [MAIN ] MHF: Loaded 8774 existing records. [2025-10-06T20:10:21.840438] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:10:21.840842] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-06T20:10:21.840897] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-06T20:10:21.841105] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-06T20:10:21.841201] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-06T20:10:22.240302] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-06T20:10:22.246970] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:10:22.943494] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-06T20:10:23.025514] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-06T20:10:23.198364] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T20:10:23.688037] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-06T20:10:23.825528] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-06T20:10:24.625570] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-06T20:10:25.425562] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-06T20:10:25.438131] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-06T20:10:25.473812] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T20:10:26.119307] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-06T20:10:26.225490] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-06T20:10:27.025597] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-06T20:10:27.201564] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T20:10:27.825545] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-06T20:10:28.504745] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-06T20:10:28.625500] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-06T20:10:28.898193] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-06T20:10:29.418744] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T20:10:29.425464] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-06T20:10:30.172164] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T20:10:30.225522] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-06T20:10:30.937752] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-06T20:10:31.025550] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-06T20:10:31.825500] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-06T20:10:31.976053] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-06T20:10:32.359781] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T20:10:32.360777] [INFO ] [REMOTE ] MGRE: Full fetch complete (9421 records). [2025-10-06T20:10:32.360855] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-06T20:10:32.630674] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-06T20:10:32.750292] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-06T20:10:32.750397] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-06T20:10:32.750687] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-06T20:10:32.750750] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-06T20:10:32.751195] [DEBUG] [LOCAL ] MGRE: Trimmed 9421 records to 6661 (keeping 200 days of data) [2025-10-06T20:10:32.797563] [DEBUG] [LOCAL ] MGRE: Primary data saved (6661 records). [2025-10-06T20:10:32.797782] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-06T20:10:32.797913] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MGRE took 33.7s. Estimated remaining: 2h 24m 3s. Rate: 7.1 symbols/min [2025-10-06T20:10:33.000303] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:10:33.055832] [DEBUG] [LOCAL ] MHK: Loaded 42739 existing records from primary storage. [2025-10-06T20:10:33.056283] [INFO ] [MAIN ] MHK: Loaded 42739 existing records. [2025-10-06T20:10:33.352247] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:10:33.353841] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-06T20:10:33.354048] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-06T20:10:33.356235] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-06T20:10:33.357334] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-06T20:10:33.357396] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-06T20:10:33.432609] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-06T20:10:33.896748] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:10:34.124843] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-06T20:10:34.225526] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-06T20:10:35.025545] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-06T20:10:35.080619] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-06T20:10:35.825534] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-06T20:10:36.625504] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-06T20:10:36.645632] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-06T20:10:36.698744] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T20:10:37.419997] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T20:10:37.425464] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-06T20:10:38.226526] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-06T20:10:38.228723] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T20:10:39.025504] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-06T20:10:39.575698] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T20:10:39.825544] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-06T20:10:40.452484] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-06T20:10:40.625546] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-06T20:10:41.330442] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T20:10:41.425479] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-06T20:10:42.170000] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T20:10:42.173117] [INFO ] [REMOTE ] MGY: Full fetch complete (75702 records). [2025-10-06T20:10:42.173219] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-06T20:10:42.238671] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-06T20:10:42.576847] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-06T20:10:42.576956] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-06T20:10:42.578108] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-06T20:10:42.578181] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-06T20:10:42.579734] [DEBUG] [LOCAL ] MGY: Trimmed 75702 records to 52402 (keeping 200 days of data) [2025-10-06T20:10:42.939493] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T20:10:42.956097] [DEBUG] [LOCAL ] MGY: Primary data saved (52402 records). [2025-10-06T20:10:42.956213] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-06T20:10:42.956286] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MGY took 41.2s. Estimated remaining: 2h 23m 56s. Rate: 7.1 symbols/min [2025-10-06T20:10:43.031835] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-06T20:10:43.069153] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-06T20:10:43.150961] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:10:43.151180] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-06T20:10:43.151232] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-06T20:10:43.151342] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-06T20:10:43.151385] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-06T20:10:43.151426] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-06T20:10:43.151457] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-06T20:10:43.518168] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:10:43.825523] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-06T20:10:44.329684] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-06T20:10:44.585427] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T20:10:44.625522] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-06T20:10:45.425577] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-06T20:10:45.777450] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-06T20:10:46.225546] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-06T20:10:46.358975] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T20:10:46.631160] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-06T20:10:47.025596] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-06T20:10:47.604890] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-06T20:10:47.825544] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-06T20:10:48.625541] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-06T20:10:48.757792] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T20:10:49.425571] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-06T20:10:49.709980] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-06T20:10:49.967942] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T20:10:50.225581] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-06T20:10:51.025553] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-06T20:10:51.705617] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T20:10:51.825498] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-06T20:10:51.899281] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-06T20:10:52.248302] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-06T20:10:52.625533] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-06T20:10:53.157979] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-06T20:10:53.425616] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-06T20:10:54.225570] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-06T20:10:54.556258] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-06T20:10:55.025535] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-06T20:10:55.078485] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T20:10:55.673678] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T20:10:55.674738] [INFO ] [REMOTE ] MHF: Full fetch complete (12555 records). [2025-10-06T20:10:55.674819] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-06T20:10:55.830635] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-06T20:10:56.076128] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-06T20:10:56.076208] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-06T20:10:56.076473] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-06T20:10:56.076511] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-06T20:10:56.077000] [DEBUG] [LOCAL ] MHF: Trimmed 12555 records to 8740 (keeping 200 days of data) [2025-10-06T20:10:56.128126] [DEBUG] [LOCAL ] MHF: Primary data saved (8740 records). [2025-10-06T20:10:56.128263] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-06T20:10:56.128349] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MHF took 34.7s. Estimated remaining: 2h 23m 51s. Rate: 7.1 symbols/min [2025-10-06T20:10:56.301045] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:10:56.311734] [DEBUG] [LOCAL ] MHN: Loaded 7680 existing records from primary storage. [2025-10-06T20:10:56.311967] [INFO ] [MAIN ] MHN: Loaded 7680 existing records. [2025-10-06T20:10:56.487169] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:10:56.487373] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-06T20:10:56.487420] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-06T20:10:56.487596] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-06T20:10:56.487692] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-06T20:10:56.630722] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-06T20:10:56.864341] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:10:57.392667] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T20:10:57.423489] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-06T20:10:57.426815] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-06T20:10:57.663252] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-06T20:10:58.225524] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-06T20:10:59.025487] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-06T20:10:59.057299] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T20:10:59.058809] [INFO ] [REMOTE ] MHD: Full fetch complete (18868 records). [2025-10-06T20:10:59.058912] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-06T20:10:59.369992] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-06T20:10:59.429940] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-06T20:10:59.430014] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-06T20:10:59.430431] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-06T20:10:59.430469] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-06T20:10:59.431006] [DEBUG] [LOCAL ] MHD: Trimmed 18868 records to 12483 (keeping 200 days of data) [2025-10-06T20:10:59.510820] [DEBUG] [LOCAL ] MHD: Primary data saved (12483 records). [2025-10-06T20:10:59.510967] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-06T20:10:59.511050] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MHD took 49.9s. Estimated remaining: 2h 23m 39s. Rate: 7.1 symbols/min [2025-10-06T20:10:59.679723] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:10:59.710132] [DEBUG] [LOCAL ] MHO: Loaded 24193 existing records from primary storage. [2025-10-06T20:10:59.710430] [INFO ] [MAIN ] MHO: Loaded 24193 existing records. [2025-10-06T20:10:59.830632] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-06T20:10:59.895496] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:10:59.895737] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-06T20:10:59.895813] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-06T20:10:59.896110] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-06T20:10:59.896180] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-06T20:11:00.249109] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:11:00.625564] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-06T20:11:01.425549] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-06T20:11:01.517461] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T20:11:01.635223] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-06T20:11:01.704050] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-06T20:11:02.225546] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-06T20:11:03.025533] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-06T20:11:03.490573] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T20:11:03.491321] [INFO ] [REMOTE ] MHLA: Full fetch complete (1525 records). [2025-10-06T20:11:03.491392] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-06T20:11:03.491778] [FATAL] [VALIDATOR ] MHLA: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:11:03.491860] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:11:03.491903] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:11:03.491966] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-06T20:11:03.492034] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-06T20:11:03.492074] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-06T20:11:03.492115] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-06T20:11:03.492166] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MHLA took 20.5s. Estimated remaining: 2h 23m 27s. Rate: 7.1 symbols/min [2025-10-06T20:11:03.649844] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T20:11:03.704238] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:11:03.705669] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-06T20:11:03.705731] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-06T20:11:03.705851] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-06T20:11:03.705894] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-06T20:11:03.705936] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-06T20:11:03.705971] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-06T20:11:03.830633] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-06T20:11:04.076328] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:11:04.625563] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-06T20:11:04.827806] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:11:04.828153] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-06T20:11:04.828243] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:11:04.828289] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-06T20:11:04.828323] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:11:04.828361] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-06T20:11:04.828420] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-06T20:11:04.828454] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-06T20:11:04.828509] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-06T20:11:04.828578] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MIAX took 1.3s. Estimated remaining: 2h 23m 13s. Rate: 7.1 symbols/min [2025-10-06T20:11:05.001916] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:11:05.019267] [DEBUG] [LOCAL ] MIN: Loaded 13511 existing records from primary storage. [2025-10-06T20:11:05.019531] [INFO ] [MAIN ] MIN: Loaded 13511 existing records. [2025-10-06T20:11:05.205695] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:11:05.206160] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-06T20:11:05.206220] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-06T20:11:05.206493] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-06T20:11:05.206551] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-06T20:11:05.293293] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T20:11:05.321898] [INFO ] [REMOTE ] MHK: Full fetch complete (60823 records). [2025-10-06T20:11:05.332298] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-06T20:11:05.430703] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-06T20:11:05.794682] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:11:05.984105] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-06T20:11:05.984226] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-06T20:11:05.985147] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-06T20:11:05.985211] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-06T20:11:05.986518] [DEBUG] [LOCAL ] MHK: Trimmed 60823 records to 42185 (keeping 200 days of data) [2025-10-06T20:11:06.225797] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-06T20:11:06.256226] [DEBUG] [LOCAL ] MHK: Primary data saved (42185 records). [2025-10-06T20:11:06.256357] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-06T20:11:06.256451] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MHK took 33.5s. Estimated remaining: 2h 22m 60s. Rate: 7.1 symbols/min [2025-10-06T20:11:06.425248] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:11:06.480732] [DEBUG] [LOCAL ] MIR: Loaded 51798 existing records from primary storage. [2025-10-06T20:11:06.481186] [INFO ] [MAIN ] MIR: Loaded 51798 existing records. [2025-10-06T20:11:06.659261] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:11:06.659550] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-06T20:11:06.659604] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-06T20:11:06.659847] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-06T20:11:06.659904] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-06T20:11:06.983675] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T20:11:07.052263] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-06T20:11:07.052193] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:11:07.168016] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T20:11:07.825524] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-06T20:11:07.918863] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T20:11:08.570701] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T20:11:08.625560] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-06T20:11:09.351227] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T20:11:09.425486] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-06T20:11:10.122030] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-06T20:11:10.225532] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-06T20:11:10.993486] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-06T20:11:11.025504] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-06T20:11:11.660019] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-06T20:11:11.825601] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-06T20:11:12.543946] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-06T20:11:12.625497] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-06T20:11:13.425622] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-06T20:11:14.225510] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-06T20:11:14.330865] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T20:11:14.363058] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T20:11:14.854317] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-06T20:11:15.025551] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-06T20:11:15.737620] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-06T20:11:15.825558] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-06T20:11:16.582791] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T20:11:16.625541] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-06T20:11:17.162486] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T20:11:17.425540] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-06T20:11:18.225502] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-06T20:11:18.273362] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T20:11:19.025528] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-06T20:11:19.441922] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T20:11:19.575421] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-06T20:11:19.825530] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-06T20:11:20.625526] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-06T20:11:20.973292] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T20:11:21.376847] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T20:11:21.425486] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-06T20:11:22.225502] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-06T20:11:22.303445] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T20:11:22.837404] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T20:11:22.838585] [INFO ] [REMOTE ] MHN: Full fetch complete (11792 records). [2025-10-06T20:11:22.838685] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-06T20:11:23.031671] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-06T20:11:23.253069] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-06T20:11:23.253175] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-06T20:11:23.253860] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-06T20:11:23.253929] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-06T20:11:23.254493] [DEBUG] [LOCAL ] MHN: Trimmed 11792 records to 7620 (keeping 200 days of data) [2025-10-06T20:11:23.303092] [DEBUG] [LOCAL ] MHN: Primary data saved (7620 records). [2025-10-06T20:11:23.303289] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-06T20:11:23.303395] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MHN took 27.2s. Estimated remaining: 2h 22m 58s. Rate: 7.1 symbols/min [2025-10-06T20:11:23.825583] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-06T20:11:23.912694] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T20:11:24.625601] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-06T20:11:25.339723] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T20:11:25.341382] [INFO ] [REMOTE ] MIN: Full fetch complete (17884 records). [2025-10-06T20:11:25.341462] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-06T20:11:25.427309] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-06T20:11:25.661848] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-06T20:11:25.810410] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-06T20:11:25.810522] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-06T20:11:25.811501] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-06T20:11:25.811570] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-06T20:11:25.812328] [DEBUG] [LOCAL ] MIN: Trimmed 17884 records to 13381 (keeping 200 days of data) [2025-10-06T20:11:25.900322] [DEBUG] [LOCAL ] MIN: Primary data saved (13381 records). [2025-10-06T20:11:25.900576] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-06T20:11:25.900720] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MIN took 21.1s. Estimated remaining: 2h 22m 45s. Rate: 7.1 symbols/min [2025-10-06T20:11:26.225585] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-06T20:11:26.788004] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-06T20:11:27.025568] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-06T20:11:27.798034] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T20:11:27.825473] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-06T20:11:28.267367] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T20:11:28.625547] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-06T20:11:29.486258] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T20:11:29.498254] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-06T20:11:29.690467] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T20:11:30.225528] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-06T20:11:30.896475] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T20:11:31.025562] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-06T20:11:31.265709] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T20:11:31.825526] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-06T20:11:32.653035] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T20:11:32.663913] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-06T20:11:32.721628] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-06T20:11:33.425583] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-06T20:11:34.275350] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T20:11:34.286203] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-06T20:11:34.701267] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T20:11:35.025562] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-06T20:11:36.043589] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T20:11:36.056811] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-06T20:11:36.153798] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T20:11:36.625594] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-06T20:11:37.740506] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T20:11:37.742442] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T20:11:37.754088] [INFO ] [REMOTE ] MHO: Full fetch complete (37000 records). [2025-10-06T20:11:37.754389] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-06T20:11:37.755092] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-06T20:11:38.121840] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-06T20:11:38.121930] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-06T20:11:38.122747] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-06T20:11:38.122809] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-06T20:11:38.123713] [DEBUG] [LOCAL ] MHO: Trimmed 37000 records to 23801 (keeping 200 days of data) [2025-10-06T20:11:38.273153] [DEBUG] [LOCAL ] MHO: Primary data saved (23801 records). [2025-10-06T20:11:38.273299] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-06T20:11:38.273384] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MHO took 38.8s. Estimated remaining: 2h 22m 39s. Rate: 7.1 symbols/min [2025-10-06T20:11:39.629688] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-06T20:11:39.641457] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-06T20:11:41.303826] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T20:11:41.306891] [INFO ] [REMOTE ] MIR: Full fetch complete (73512 records). [2025-10-06T20:11:41.307020] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-06T20:11:41.693777] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-06T20:11:41.693869] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-06T20:11:41.694926] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-06T20:11:41.694998] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-06T20:11:41.696473] [DEBUG] [LOCAL ] MIR: Trimmed 73512 records to 51113 (keeping 200 days of data) [2025-10-06T20:11:42.001154] [DEBUG] [LOCAL ] MIR: Primary data saved (51113 records). [2025-10-06T20:11:42.001311] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-06T20:11:42.001397] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MIR took 35.7s. Estimated remaining: 2h 22m 27s. Rate: 7.1 symbols/min [2025-10-06T20:11:42.551772] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:11:42.621036] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:11:42.701960] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:11:42.728606] [DEBUG] [LOCAL ] MITP: Loaded 2419 existing records from primary storage. [2025-10-06T20:11:42.727990] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-06T20:11:42.729024] [INFO ] [MAIN ] MITP: Loaded 2419 existing records. [2025-10-06T20:11:42.778677] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-06T20:11:42.825941] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-06T20:11:42.825819] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:11:42.851564] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-06T20:11:42.865262] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-06T20:11:42.881238] [DEBUG] [LOCAL ] MIY: Loaded 6099 existing records from primary storage. [2025-10-06T20:11:42.891115] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-06T20:11:42.897026] [INFO ] [MAIN ] MIY: Loaded 6099 existing records. [2025-10-06T20:11:43.138953] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:11:43.194565] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-06T20:11:43.194855] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-06T20:11:43.296782] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-06T20:11:43.328273] [DEBUG] [LOCAL ] MITT: Loaded 23184 existing records from primary storage. [2025-10-06T20:11:43.408906] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:11:43.387679] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-06T20:11:43.467220] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-06T20:11:43.477529] [INFO ] [MAIN ] MITT: Loaded 23184 existing records. [2025-10-06T20:11:43.503942] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-06T20:11:43.620810] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-06T20:11:43.708221] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-06T20:11:43.886594] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:11:44.070479] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-06T20:11:44.217705] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:11:44.248172] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-06T20:11:44.294776] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-06T20:11:44.408834] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-06T20:11:44.468560] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:11:44.479215] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-06T20:11:44.492849] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-06T20:11:44.595953] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-06T20:11:44.613574] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-06T20:11:44.993991] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:11:45.021577] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-06T20:11:45.189124] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-06T20:11:45.232325] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-06T20:11:45.232564] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T20:11:45.244571] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-06T20:11:45.242192] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:11:45.246607] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-06T20:11:45.738968] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-06T20:11:45.740079] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-06T20:11:45.752138] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-06T20:11:45.753478] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-06T20:11:46.025388] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-06T20:11:46.225534] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-06T20:11:46.303738] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-06T20:11:46.334365] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-06T20:11:46.554270] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T20:11:46.895859] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-06T20:11:47.025528] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-06T20:11:47.467100] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-06T20:11:47.825568] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-06T20:11:48.625479] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-06T20:11:49.024602] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-06T20:11:49.075610] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-06T20:11:49.425534] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-06T20:11:50.044098] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T20:11:50.225567] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-06T20:11:50.760620] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-06T20:11:51.025735] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-06T20:11:51.761165] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T20:11:51.825576] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-06T20:11:52.430066] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T20:11:52.625566] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-06T20:11:53.153899] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-06T20:11:53.425528] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-06T20:11:54.119771] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T20:11:54.225523] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-06T20:11:55.025621] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-06T20:11:55.033119] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T20:11:55.550203] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-06T20:11:55.825529] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-06T20:11:56.162504] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-06T20:11:56.625550] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-06T20:11:57.021771] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-06T20:11:57.425577] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-06T20:11:58.017321] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T20:11:58.225566] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-06T20:11:58.702394] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-06T20:11:59.025553] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-06T20:11:59.354205] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-06T20:11:59.825525] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-06T20:12:00.498544] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T20:12:00.625565] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-06T20:12:01.425775] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-06T20:12:01.729942] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T20:12:02.013705] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T20:12:02.014721] [INFO ] [REMOTE ] MIY: Full fetch complete (8942 records). [2025-10-06T20:12:02.014792] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-06T20:12:02.230722] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-06T20:12:02.389210] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-06T20:12:02.389502] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-06T20:12:02.389833] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-06T20:12:02.389894] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-06T20:12:02.390335] [DEBUG] [LOCAL ] MIY: Trimmed 8942 records to 6044 (keeping 200 days of data) [2025-10-06T20:12:02.431221] [DEBUG] [LOCAL ] MIY: Primary data saved (6044 records). [2025-10-06T20:12:02.431409] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-06T20:12:02.431793] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MIY took 20.4s. Estimated remaining: 2h 22m 28s. Rate: 7.1 symbols/min [2025-10-06T20:12:02.601167] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:12:02.663037] [DEBUG] [LOCAL ] MKC: Loaded 53215 existing records from primary storage. [2025-10-06T20:12:02.663634] [INFO ] [MAIN ] MKC: Loaded 53215 existing records. [2025-10-06T20:12:02.788012] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T20:12:02.790116] [INFO ] [REMOTE ] MITN: Full fetch complete (2352 records). [2025-10-06T20:12:02.811569] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-06T20:12:02.923728] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:12:02.947212] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-06T20:12:02.953440] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-06T20:12:02.985886] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-06T20:12:02.989537] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-06T20:12:03.030518] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-06T20:12:03.181685] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T20:12:03.182510] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:12:03.194525] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:12:03.194704] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-06T20:12:03.205805] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-06T20:12:03.205938] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-06T20:12:03.211168] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-06T20:12:03.216475] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MITN took 21.2s. Estimated remaining: 2h 22m 14s. Rate: 7.1 symbols/min [2025-10-06T20:12:03.606081] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:12:03.664748] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:12:03.708530] [DEBUG] [LOCAL ] MKL: Loaded 34507 existing records from primary storage. [2025-10-06T20:12:03.708924] [INFO ] [MAIN ] MKL: Loaded 34507 existing records. [2025-10-06T20:12:03.830670] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-06T20:12:03.908374] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:12:03.908637] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-06T20:12:03.908729] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-06T20:12:03.909577] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-06T20:12:03.909638] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-06T20:12:04.289678] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:12:04.472267] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T20:12:04.625611] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-06T20:12:05.376847] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T20:12:05.425580] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-06T20:12:06.066305] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T20:12:06.225530] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-06T20:12:07.025516] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-06T20:12:07.197444] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T20:12:07.295936] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T20:12:07.825533] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-06T20:12:08.474559] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T20:12:08.625579] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-06T20:12:09.263041] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T20:12:09.425534] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-06T20:12:09.718601] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T20:12:10.225597] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-06T20:12:10.767394] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T20:12:11.025558] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-06T20:12:11.587194] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-06T20:12:11.638521] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-06T20:12:11.825522] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-06T20:12:12.625557] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-06T20:12:13.425514] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-06T20:12:13.626494] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T20:12:13.788495] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T20:12:14.225541] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-06T20:12:14.892456] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T20:12:15.025508] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-06T20:12:15.414112] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-06T20:12:15.825496] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-06T20:12:15.987283] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T20:12:16.625507] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-06T20:12:16.892782] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-06T20:12:17.051437] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-06T20:12:17.425542] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-06T20:12:18.225557] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-06T20:12:18.893612] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T20:12:19.025501] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-06T20:12:19.306487] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T20:12:19.370346] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-06T20:12:19.825529] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-06T20:12:20.625580] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-06T20:12:21.142833] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T20:12:21.425544] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-06T20:12:22.063786] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T20:12:22.225609] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-06T20:12:22.601581] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-06T20:12:23.025555] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-06T20:12:23.669382] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T20:12:23.825545] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-06T20:12:24.328609] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-06T20:12:24.625554] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-06T20:12:24.730393] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T20:12:24.732436] [INFO ] [REMOTE ] MITT: Full fetch complete (34706 records). [2025-10-06T20:12:24.732547] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-06T20:12:24.916959] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-06T20:12:25.166499] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-06T20:12:25.166724] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-06T20:12:25.168299] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-06T20:12:25.168371] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-06T20:12:25.169737] [DEBUG] [LOCAL ] MITT: Trimmed 34706 records to 22783 (keeping 200 days of data) [2025-10-06T20:12:25.313252] [DEBUG] [LOCAL ] MITT: Primary data saved (22783 records). [2025-10-06T20:12:25.313460] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-06T20:12:25.313579] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MITT took 43.3s. Estimated remaining: 2h 22m 15s. Rate: 7.1 symbols/min [2025-10-06T20:12:25.428103] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-06T20:12:25.505752] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:12:25.552460] [DEBUG] [LOCAL ] MLI: Loaded 44149 existing records from primary storage. [2025-10-06T20:12:25.552875] [INFO ] [MAIN ] MLI: Loaded 44149 existing records. [2025-10-06T20:12:25.750961] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:12:25.751261] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-06T20:12:25.751313] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-06T20:12:25.752350] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-06T20:12:25.752412] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-06T20:12:26.137943] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:12:26.171326] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T20:12:26.172189] [INFO ] [REMOTE ] MITP: Full fetch complete (3342 records). [2025-10-06T20:12:26.172262] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-06T20:12:26.235368] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-06T20:12:26.561035] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-06T20:12:26.561137] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-06T20:12:26.561275] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-06T20:12:26.561316] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-06T20:12:26.561761] [DEBUG] [LOCAL ] MITP: Trimmed 3342 records to 2376 (keeping 200 days of data) [2025-10-06T20:12:26.576288] [DEBUG] [LOCAL ] MITP: Primary data saved (2376 records). [2025-10-06T20:12:26.576389] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-06T20:12:26.576485] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MITP took 44.6s. Estimated remaining: 2h 22m 1s. Rate: 7.1 symbols/min [2025-10-06T20:12:26.762459] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:12:26.803785] [DEBUG] [LOCAL ] MLM: Loaded 30361 existing records from primary storage. [2025-10-06T20:12:26.804156] [INFO ] [MAIN ] MLM: Loaded 30361 existing records. [2025-10-06T20:12:26.998033] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:12:26.998351] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-06T20:12:26.998421] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-06T20:12:26.999451] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-06T20:12:26.999514] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-06T20:12:27.031802] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-06T20:12:27.391031] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:12:27.825544] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-06T20:12:28.123210] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-06T20:12:28.160907] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-06T20:12:28.625592] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-06T20:12:29.348708] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T20:12:29.425596] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-06T20:12:29.521371] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T20:12:30.225564] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-06T20:12:30.898844] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T20:12:31.025604] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-06T20:12:31.289058] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T20:12:31.292162] [INFO ] [REMOTE ] MKL: Full fetch complete (49693 records). [2025-10-06T20:12:31.292364] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-06T20:12:31.705025] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-06T20:12:31.705142] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-06T20:12:31.706120] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-06T20:12:31.706200] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-06T20:12:31.707574] [DEBUG] [LOCAL ] MKL: Trimmed 49693 records to 34057 (keeping 200 days of data) [2025-10-06T20:12:31.826054] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-06T20:12:31.945371] [DEBUG] [LOCAL ] MKL: Primary data saved (34057 records). [2025-10-06T20:12:31.945556] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-06T20:12:31.945668] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MKL took 28.7s. Estimated remaining: 2h 21m 51s. Rate: 7.1 symbols/min [2025-10-06T20:12:32.123852] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:12:32.152386] [DEBUG] [LOCAL ] MLNK: Loaded 25866 existing records from primary storage. [2025-10-06T20:12:32.152726] [INFO ] [MAIN ] MLNK: Loaded 25866 existing records. [2025-10-06T20:12:32.334992] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:12:32.335397] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-06T20:12:32.335530] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-06T20:12:32.335898] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-06T20:12:32.335959] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-06T20:12:32.466365] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T20:12:32.634893] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-06T20:12:32.727729] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:12:33.425550] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-06T20:12:33.611460] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T20:12:33.730034] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T20:12:34.144695] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-06T20:12:34.225563] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-06T20:12:35.025552] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-06T20:12:35.825517] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-06T20:12:35.891264] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T20:12:36.132147] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T20:12:36.625538] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-06T20:12:36.940485] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T20:12:37.425616] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-06T20:12:38.109068] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T20:12:38.225778] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-06T20:12:38.507172] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T20:12:39.025587] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-06T20:12:39.827957] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-06T20:12:39.830922] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T20:12:40.625547] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-06T20:12:40.700143] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T20:12:40.943323] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T20:12:41.425555] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-06T20:12:42.055365] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T20:12:42.058560] [INFO ] [REMOTE ] MKC: Full fetch complete (75624 records). [2025-10-06T20:12:42.058747] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-06T20:12:42.251611] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-06T20:12:42.520832] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-06T20:12:42.520980] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-06T20:12:42.522080] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-06T20:12:42.527337] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-06T20:12:42.537219] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T20:12:42.543519] [DEBUG] [LOCAL ] MKC: Trimmed 75624 records to 52489 (keeping 200 days of data) [2025-10-06T20:12:42.890588] [DEBUG] [LOCAL ] MKC: Primary data saved (52489 records). [2025-10-06T20:12:42.890799] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-06T20:12:42.890941] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKC took 40.5s. Estimated remaining: 2h 21m 44s. Rate: 7.1 symbols/min [2025-10-06T20:12:43.035791] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-06T20:12:43.061372] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:12:43.067025] [DEBUG] [LOCAL ] MLP: Loaded 3014 existing records from primary storage. [2025-10-06T20:12:43.067194] [INFO ] [MAIN ] MLP: Loaded 3014 existing records. [2025-10-06T20:12:43.243938] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:12:43.244195] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-06T20:12:43.244242] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-06T20:12:43.244402] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-06T20:12:43.244458] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-06T20:12:43.611005] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:12:43.633485] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T20:12:43.825499] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-06T20:12:44.133374] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T20:12:44.625576] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-06T20:12:44.821080] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T20:12:45.425546] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-06T20:12:46.021889] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T20:12:46.225499] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-06T20:12:46.704878] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T20:12:47.025555] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-06T20:12:47.489325] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T20:12:47.536302] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-06T20:12:47.825556] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-06T20:12:48.625563] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-06T20:12:49.278858] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T20:12:49.294346] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-06T20:12:49.425542] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-06T20:12:50.225561] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-06T20:12:50.719392] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-06T20:12:51.025551] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-06T20:12:51.825533] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-06T20:12:51.873788] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T20:12:52.117055] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T20:12:52.625546] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-06T20:12:53.144298] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T20:12:53.425576] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-06T20:12:54.225481] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-06T20:12:54.333035] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T20:12:54.615675] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T20:12:55.025548] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-06T20:12:55.490279] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T20:12:55.825550] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-06T20:12:56.598271] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T20:12:56.625484] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-06T20:12:56.928803] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T20:12:56.931000] [INFO ] [REMOTE ] MLM: Full fetch complete (45502 records). [2025-10-06T20:12:56.931139] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-06T20:12:57.315554] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-06T20:12:57.315659] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-06T20:12:57.316608] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-06T20:12:57.316739] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-06T20:12:57.317883] [DEBUG] [LOCAL ] MLM: Trimmed 45502 records to 29649 (keeping 200 days of data) [2025-10-06T20:12:57.426578] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-06T20:12:57.513966] [DEBUG] [LOCAL ] MLM: Primary data saved (29649 records). [2025-10-06T20:12:57.514129] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-06T20:12:57.514243] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MLM took 30.9s. Estimated remaining: 2h 21m 40s. Rate: 7.1 symbols/min [2025-10-06T20:12:57.681186] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:12:57.695373] [DEBUG] [LOCAL ] MLR: Loaded 12615 existing records from primary storage. [2025-10-06T20:12:57.695611] [INFO ] [MAIN ] MLR: Loaded 12615 existing records. [2025-10-06T20:12:57.872248] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:12:57.872539] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-06T20:12:57.872587] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-06T20:12:57.873089] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-06T20:12:57.873147] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-06T20:12:58.244514] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:12:58.239873] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-06T20:12:58.262416] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T20:12:58.429402] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T20:12:58.603699] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-06T20:12:59.025530] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-06T20:12:59.825572] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-06T20:13:00.079771] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T20:13:00.082324] [INFO ] [REMOTE ] MLI: Full fetch complete (63279 records). [2025-10-06T20:13:00.082433] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-06T20:13:00.476314] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-06T20:13:00.476411] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-06T20:13:00.477423] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-06T20:13:00.477490] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-06T20:13:00.478910] [DEBUG] [LOCAL ] MLI: Trimmed 63279 records to 43512 (keeping 200 days of data) [2025-10-06T20:13:00.659018] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-06T20:13:00.752506] [DEBUG] [LOCAL ] MLI: Primary data saved (43512 records). [2025-10-06T20:13:00.752678] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-06T20:13:00.752781] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLI took 35.4s. Estimated remaining: 2h 21m 28s. Rate: 7.1 symbols/min [2025-10-06T20:13:00.934666] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:13:00.952422] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-06T20:13:00.998271] [DEBUG] [LOCAL ] MMC: Loaded 52557 existing records from primary storage. [2025-10-06T20:13:00.998743] [INFO ] [MAIN ] MMC: Loaded 52557 existing records. [2025-10-06T20:13:01.182312] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-06T20:13:01.188223] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:13:01.190085] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-06T20:13:01.190146] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-06T20:13:01.191480] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-06T20:13:01.191543] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-06T20:13:01.430748] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-06T20:13:01.548117] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:13:02.115699] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-06T20:13:02.225578] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-06T20:13:02.956549] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T20:13:03.025534] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-06T20:13:03.825501] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-06T20:13:03.855843] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T20:13:04.625570] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-06T20:13:04.823348] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T20:13:04.825455] [INFO ] [REMOTE ] MLNK: Full fetch complete (36225 records). [2025-10-06T20:13:04.825629] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-06T20:13:05.189885] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-06T20:13:05.189969] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-06T20:13:05.190733] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-06T20:13:05.190794] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-06T20:13:05.191556] [DEBUG] [LOCAL ] MLNK: Trimmed 36225 records to 25617 (keeping 200 days of data) [2025-10-06T20:13:05.345519] [DEBUG] [LOCAL ] MLNK: Primary data saved (25617 records). [2025-10-06T20:13:05.345751] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-06T20:13:05.345880] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MLNK took 33.4s. Estimated remaining: 2h 21m 17s. Rate: 7.1 symbols/min [2025-10-06T20:13:05.435576] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-06T20:13:05.517494] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:13:05.531171] [DEBUG] [LOCAL ] MMD: Loaded 11497 existing records from primary storage. [2025-10-06T20:13:05.531451] [INFO ] [MAIN ] MMD: Loaded 11497 existing records. [2025-10-06T20:13:05.706604] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:13:05.706901] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-06T20:13:05.706947] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-06T20:13:05.707351] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-06T20:13:05.707411] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-06T20:13:06.059901] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-06T20:13:06.083094] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:13:06.225474] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-06T20:13:06.285772] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T20:13:07.025614] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-06T20:13:07.188519] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T20:13:07.827826] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-06T20:13:07.832234] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T20:13:08.625532] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-06T20:13:09.425558] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-06T20:13:09.552318] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T20:13:09.662397] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T20:13:10.225506] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-06T20:13:10.344186] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-06T20:13:11.025536] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-06T20:13:11.093476] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T20:13:11.573138] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-06T20:13:11.825557] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-06T20:13:12.625510] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-06T20:13:12.765776] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T20:13:13.425530] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-06T20:13:13.931340] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-06T20:13:14.225578] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-06T20:13:14.277556] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T20:13:14.988360] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-06T20:13:15.025501] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-06T20:13:15.825514] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-06T20:13:15.884159] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-06T20:13:16.625534] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-06T20:13:17.171111] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T20:13:17.425542] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-06T20:13:17.711357] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T20:13:18.225563] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-06T20:13:18.437542] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-06T20:13:18.791946] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-06T20:13:19.025523] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-06T20:13:19.825506] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-06T20:13:20.625534] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-06T20:13:21.427112] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-06T20:13:21.428048] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-06T20:13:21.822054] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-06T20:13:21.975446] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T20:13:21.976219] [INFO ] [REMOTE ] MLP: Full fetch complete (4573 records). [2025-10-06T20:13:21.976286] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-06T20:13:22.230630] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-06T20:13:22.332497] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (3.31 seconds). [2025-10-06T20:13:22.339376] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-06T20:13:22.339455] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-06T20:13:22.342673] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-06T20:13:22.342800] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-06T20:13:22.343819] [DEBUG] [LOCAL ] MLP: Trimmed 4573 records to 2980 (keeping 200 days of data) [2025-10-06T20:13:22.361612] [DEBUG] [LOCAL ] MLP: Primary data saved (2980 records). [2025-10-06T20:13:22.361709] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-06T20:13:22.361838] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLP took 39.5s. Estimated remaining: 2h 21m 14s. Rate: 7.1 symbols/min [2025-10-06T20:13:22.528786] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:13:22.543989] [DEBUG] [LOCAL ] MMI: Loaded 15364 existing records from primary storage. [2025-10-06T20:13:22.544249] [INFO ] [MAIN ] MMI: Loaded 15364 existing records. [2025-10-06T20:13:22.717627] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:13:22.717905] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-06T20:13:22.717957] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-06T20:13:22.718391] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-06T20:13:22.718450] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-06T20:13:23.032553] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-06T20:13:23.076244] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:13:23.189940] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T20:13:23.825536] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-06T20:13:24.625496] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-06T20:13:24.649810] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-06T20:13:24.742917] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T20:13:25.405956] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T20:13:25.407276] [INFO ] [REMOTE ] MLR: Full fetch complete (18754 records). [2025-10-06T20:13:25.407386] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-06T20:13:25.430721] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-06T20:13:25.788779] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-06T20:13:25.788888] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-06T20:13:25.789471] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-06T20:13:25.789531] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-06T20:13:25.790101] [DEBUG] [LOCAL ] MLR: Trimmed 18754 records to 12339 (keeping 200 days of data) [2025-10-06T20:13:25.866145] [DEBUG] [LOCAL ] MLR: Primary data saved (12339 records). [2025-10-06T20:13:25.866304] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-06T20:13:25.866396] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLR took 28.4s. Estimated remaining: 2h 21m 2s. Rate: 7.1 symbols/min [2025-10-06T20:13:26.033778] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:13:26.033940] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-06T20:13:26.033977] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-06T20:13:26.034086] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-06T20:13:26.034126] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-06T20:13:26.034165] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-06T20:13:26.034195] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-06T20:13:26.225603] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-06T20:13:26.303074] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-06T20:13:26.405216] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:13:27.025537] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-06T20:13:27.825602] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-06T20:13:28.021099] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:13:28.024806] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-06T20:13:28.025955] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-06T20:13:28.026139] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:13:28.036275] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-06T20:13:28.036767] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:13:28.036848] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-06T20:13:28.036925] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-06T20:13:28.037277] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-06T20:13:28.037333] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-06T20:13:28.037381] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MMID took 2.2s. Estimated remaining: 2h 20m 49s. Rate: 7.1 symbols/min [2025-10-06T20:13:28.201385] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T20:13:28.229041] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:13:28.232106] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-06T20:13:28.232206] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-06T20:13:28.232344] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-06T20:13:28.232390] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-06T20:13:28.232431] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-06T20:13:28.232464] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-06T20:13:28.586630] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:13:28.625494] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-06T20:13:29.065325] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-06T20:13:29.425593] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-06T20:13:29.886268] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-06T20:13:30.225631] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-06T20:13:30.665965] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T20:13:31.025800] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-06T20:13:31.464372] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-06T20:13:31.825504] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-06T20:13:32.312834] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-06T20:13:32.625531] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-06T20:13:33.419551] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T20:13:33.425463] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-06T20:13:34.225490] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-06T20:13:34.428246] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-06T20:13:34.641674] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-06T20:13:35.025576] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-06T20:13:35.361517] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-06T20:13:35.825567] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-06T20:13:36.163344] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-06T20:13:36.625550] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-06T20:13:37.385374] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T20:13:37.425471] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-06T20:13:38.225539] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-06T20:13:38.385427] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T20:13:38.678337] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-06T20:13:39.025546] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-06T20:13:39.419399] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-06T20:13:39.825559] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-06T20:13:40.625481] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-06T20:13:40.915956] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T20:13:41.084791] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T20:13:41.085520] [INFO ] [REMOTE ] MMKT: Full fetch complete (2115 records). [2025-10-06T20:13:41.085589] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-06T20:13:41.261245] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T20:13:41.261489] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:13:41.261561] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:13:41.261632] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-06T20:13:41.261739] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-06T20:13:41.261781] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-06T20:13:41.261871] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-06T20:13:41.261934] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMKT took 13.2s. Estimated remaining: 2h 20m 44s. Rate: 7.1 symbols/min [2025-10-06T20:13:41.425596] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-06T20:13:41.437294] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:13:41.492487] [DEBUG] [LOCAL ] MMM: Loaded 53938 existing records from primary storage. [2025-10-06T20:13:41.492891] [INFO ] [MAIN ] MMM: Loaded 53938 existing records. [2025-10-06T20:13:41.669087] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:13:41.669366] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-06T20:13:41.669416] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-06T20:13:41.669737] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-06T20:13:41.669827] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-06T20:13:42.021758] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:13:42.225491] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-06T20:13:42.351821] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T20:13:43.025582] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-06T20:13:43.825488] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-06T20:13:44.110268] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-06T20:13:44.215415] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-06T20:13:44.625519] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-06T20:13:45.425513] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-06T20:13:45.593554] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T20:13:45.777367] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-06T20:13:46.132719] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T20:13:46.135689] [INFO ] [REMOTE ] MMD: Full fetch complete (17815 records). [2025-10-06T20:13:46.135802] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-06T20:13:46.230697] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-06T20:13:46.530242] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-06T20:13:46.530353] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-06T20:13:46.531100] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-06T20:13:46.531203] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-06T20:13:46.532639] [DEBUG] [LOCAL ] MMD: Trimmed 17815 records to 11253 (keeping 200 days of data) [2025-10-06T20:13:46.609870] [DEBUG] [LOCAL ] MMD: Primary data saved (11253 records). [2025-10-06T20:13:46.610062] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-06T20:13:46.610165] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMD took 41.3s. Estimated remaining: 2h 20m 33s. Rate: 7.1 symbols/min [2025-10-06T20:13:46.790524] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:13:46.834245] [DEBUG] [LOCAL ] MMS: Loaded 34400 existing records from primary storage. [2025-10-06T20:13:46.834610] [INFO ] [MAIN ] MMS: Loaded 34400 existing records. [2025-10-06T20:13:47.032875] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-06T20:13:47.032690] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:13:47.034327] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-06T20:13:47.034394] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-06T20:13:47.034672] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-06T20:13:47.034732] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-06T20:13:47.387981] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:13:47.825494] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-06T20:13:47.984387] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T20:13:48.625492] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-06T20:13:48.815722] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T20:13:48.839043] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T20:13:49.425562] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-06T20:13:50.225504] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-06T20:13:50.281536] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-06T20:13:50.390301] [DEBUG] [REMOTE ] MMS: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-06T20:13:50.390869] [WARN ] [REMOTE ] MMS: No data returned for month 2024-12 [2025-10-06T20:13:50.391016] [FATAL] [REMOTE ] MMS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:13:50.391203] [FATAL] [MAIN ] MMS: Failed to fetch primary data. [2025-10-06T20:13:50.401157] [WARN ] [MAIN ] MMS: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:13:50.415038] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-06T20:13:50.418083] [DEBUG] [LOCAL ] MMS: No primary data file found to delete. [2025-10-06T20:13:50.418216] [INFO ] [LOCAL ] MMS: Starting deletion of derivative data. [2025-10-06T20:13:50.419829] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T20:13:50.419873] [DEBUG] [LOCAL ] MMS: Deleted derivative data file. [2025-10-06T20:13:50.420041] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMS took 3.8s. Estimated remaining: 2h 20m 22s. Rate: 7.1 symbols/min [2025-10-06T20:13:50.597717] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:13:50.610831] [DEBUG] [LOCAL ] MMT: Loaded 10895 existing records from primary storage. [2025-10-06T20:13:50.611089] [INFO ] [MAIN ] MMT: Loaded 10895 existing records. [2025-10-06T20:13:50.821056] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:13:50.821333] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-06T20:13:50.821380] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-06T20:13:50.821565] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-06T20:13:50.821627] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-06T20:13:51.030718] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-06T20:13:51.173080] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:13:51.825532] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-06T20:13:52.601829] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-06T20:13:52.625475] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-06T20:13:52.666221] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T20:13:52.669761] [INFO ] [REMOTE ] MMC: Full fetch complete (74761 records). [2025-10-06T20:13:52.669894] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-06T20:13:53.085736] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-06T20:13:53.085859] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-06T20:13:53.087779] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-06T20:13:53.087872] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-06T20:13:53.089951] [DEBUG] [LOCAL ] MMC: Trimmed 74761 records to 51842 (keeping 200 days of data) [2025-10-06T20:13:53.430901] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-06T20:13:53.436362] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T20:13:53.461098] [DEBUG] [LOCAL ] MMC: Primary data saved (51842 records). [2025-10-06T20:13:53.461256] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-06T20:13:53.461352] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMC took 52.7s. Estimated remaining: 2h 20m 9s. Rate: 7.1 symbols/min [2025-10-06T20:13:53.631845] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:13:53.650995] [DEBUG] [LOCAL ] MMU: Loaded 17040 existing records from primary storage. [2025-10-06T20:13:53.651277] [INFO ] [MAIN ] MMU: Loaded 17040 existing records. [2025-10-06T20:13:53.824587] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:13:53.824905] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-06T20:13:53.825055] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-06T20:13:53.825520] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-06T20:13:53.825607] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-06T20:13:54.178815] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:13:54.225496] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-06T20:13:54.361458] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T20:13:55.025507] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-06T20:13:55.187421] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T20:13:55.825529] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-06T20:13:55.901033] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T20:13:56.625488] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-06T20:13:56.858241] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T20:13:57.425593] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-06T20:13:57.481624] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-06T20:13:58.225544] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-06T20:13:58.422813] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T20:13:59.025613] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-06T20:13:59.075766] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-06T20:13:59.077293] [INFO ] [REMOTE ] MMI: Full fetch complete (21364 records). [2025-10-06T20:13:59.077365] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-06T20:13:59.442202] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-06T20:13:59.442283] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-06T20:13:59.442765] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-06T20:13:59.442826] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-06T20:13:59.443392] [DEBUG] [LOCAL ] MMI: Trimmed 21364 records to 15201 (keeping 200 days of data) [2025-10-06T20:13:59.534981] [DEBUG] [LOCAL ] MMI: Primary data saved (15201 records). [2025-10-06T20:13:59.535137] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-06T20:13:59.535222] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMI took 37.2s. Estimated remaining: 2h 19m 59s. Rate: 7.1 symbols/min [2025-10-06T20:13:59.702046] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:13:59.728049] [DEBUG] [LOCAL ] MNR: Loaded 24792 existing records from primary storage. [2025-10-06T20:13:59.728331] [INFO ] [MAIN ] MNR: Loaded 24792 existing records. [2025-10-06T20:13:59.830955] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-06T20:13:59.909679] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:13:59.909884] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-06T20:13:59.909930] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-06T20:13:59.910257] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-06T20:13:59.910315] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-06T20:14:00.265557] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T20:14:00.294573] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:14:00.625579] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-06T20:14:00.885816] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-06T20:14:01.425586] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-06T20:14:01.668455] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T20:14:01.876836] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-06T20:14:02.225513] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-06T20:14:03.025503] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-06T20:14:03.334687] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T20:14:03.825521] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-06T20:14:04.625568] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-06T20:14:04.757480] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-06T20:14:04.940218] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T20:14:05.156123] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-06T20:14:05.425595] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-06T20:14:06.225575] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-06T20:14:07.025506] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-06T20:14:07.178724] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T20:14:07.447573] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-06T20:14:07.825489] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-06T20:14:08.056591] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T20:14:08.625548] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-06T20:14:09.425614] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-06T20:14:09.863013] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T20:14:10.047481] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-06T20:14:10.225541] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-06T20:14:10.353232] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T20:14:11.025557] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-06T20:14:11.782618] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-06T20:14:11.825552] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-06T20:14:12.160609] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-06T20:14:12.625540] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-06T20:14:13.012542] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T20:14:13.425536] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-06T20:14:14.225544] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-06T20:14:14.502960] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-06T20:14:14.599884] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-06T20:14:14.962638] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-06T20:14:15.025555] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-06T20:14:15.825535] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-06T20:14:15.942991] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T20:14:15.944619] [INFO ] [REMOTE ] MMU: Full fetch complete (25540 records). [2025-10-06T20:14:15.944817] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-06T20:14:16.406063] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-06T20:14:16.406168] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-06T20:14:16.406978] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-06T20:14:16.407045] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-06T20:14:16.407992] [DEBUG] [LOCAL ] MMU: Trimmed 25540 records to 16750 (keeping 200 days of data) [2025-10-06T20:14:16.526632] [DEBUG] [LOCAL ] MMU: Primary data saved (16750 records). [2025-10-06T20:14:16.526828] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-06T20:14:16.526947] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMU took 23.1s. Estimated remaining: 2h 19m 57s. Rate: 7.1 symbols/min [2025-10-06T20:14:16.630748] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-06T20:14:16.747052] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:14:16.794667] [DEBUG] [LOCAL ] MNSO: Loaded 45106 existing records from primary storage. [2025-10-06T20:14:16.795014] [INFO ] [MAIN ] MNSO: Loaded 45106 existing records. [2025-10-06T20:14:17.018720] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:14:17.018988] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-06T20:14:17.019037] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-06T20:14:17.019358] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-06T20:14:17.019418] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-06T20:14:17.285461] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T20:14:17.330415] [INFO ] [REMOTE ] MMT: Full fetch complete (15991 records). [2025-10-06T20:14:17.354421] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-06T20:14:17.428223] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-06T20:14:17.519339] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:14:17.809428] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-06T20:14:17.809616] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-06T20:14:17.810087] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-06T20:14:17.810195] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-06T20:14:17.810998] [DEBUG] [LOCAL ] MMT: Trimmed 15991 records to 10528 (keeping 200 days of data) [2025-10-06T20:14:17.875634] [DEBUG] [LOCAL ] MMT: Primary data saved (10528 records). [2025-10-06T20:14:17.875819] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-06T20:14:17.875908] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MMT took 27.4s. Estimated remaining: 2h 19m 43s. Rate: 7.1 symbols/min [2025-10-06T20:14:18.054980] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:14:18.055682] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-06T20:14:18.055786] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-06T20:14:18.086078] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-06T20:14:18.086514] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-06T20:14:18.086936] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-06T20:14:18.088280] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-06T20:14:18.099207] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-06T20:14:18.237778] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-06T20:14:18.456748] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:14:18.666692] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T20:14:19.025531] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-06T20:14:19.222552] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:14:19.222938] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-06T20:14:19.223067] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:14:19.223148] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-06T20:14:19.223230] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:14:19.223310] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-06T20:14:19.223415] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-06T20:14:19.223472] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-06T20:14:19.223541] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-06T20:14:19.223635] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MNTN took 1.3s. Estimated remaining: 2h 19m 30s. Rate: 7.1 symbols/min [2025-10-06T20:14:19.430246] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:14:19.430495] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-06T20:14:19.430539] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-06T20:14:19.430688] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-06T20:14:19.430751] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-06T20:14:19.430841] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-06T20:14:19.430896] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-06T20:14:19.819878] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:14:19.825477] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-06T20:14:20.276982] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-06T20:14:20.625600] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-06T20:14:21.425612] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-06T20:14:21.766459] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-06T20:14:22.146803] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-06T20:14:22.225539] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-06T20:14:23.025548] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-06T20:14:23.072456] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T20:14:23.825579] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-06T20:14:24.497919] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-06T20:14:24.625510] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-06T20:14:24.883587] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T20:14:25.007356] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-06T20:14:25.425580] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-06T20:14:25.944103] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T20:14:26.225714] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-06T20:14:26.553848] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T20:14:27.025598] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-06T20:14:27.825480] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-06T20:14:28.334603] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-06T20:14:28.339723] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T20:14:28.625558] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-06T20:14:29.425510] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-06T20:14:29.534061] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T20:14:29.538302] [INFO ] [REMOTE ] MMM: Full fetch complete (77084 records). [2025-10-06T20:14:29.538467] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-06T20:14:29.970304] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-06T20:14:29.970475] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-06T20:14:29.972085] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-06T20:14:29.972162] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-06T20:14:29.974358] [DEBUG] [LOCAL ] MMM: Trimmed 77084 records to 53158 (keeping 200 days of data) [2025-10-06T20:14:30.227408] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-06T20:14:30.349319] [DEBUG] [LOCAL ] MMM: Primary data saved (53158 records). [2025-10-06T20:14:30.349733] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-06T20:14:30.351227] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MMM took 49.1s. Estimated remaining: 2h 19m 23s. Rate: 7.1 symbols/min [2025-10-06T20:14:30.544389] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:14:30.563772] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T20:14:30.622497] [DEBUG] [LOCAL ] MOD: Loaded 45809 existing records from primary storage. [2025-10-06T20:14:30.623041] [INFO ] [MAIN ] MOD: Loaded 45809 existing records. [2025-10-06T20:14:30.840953] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-06T20:14:30.864042] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:14:30.876161] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-06T20:14:30.876270] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-06T20:14:30.876858] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-06T20:14:30.876916] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-06T20:14:31.030614] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-06T20:14:31.248772] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:14:31.804829] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T20:14:31.825480] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-06T20:14:32.456535] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T20:14:32.625569] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-06T20:14:33.164378] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T20:14:33.425585] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-06T20:14:34.225569] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-06T20:14:34.855338] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-06T20:14:35.025486] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-06T20:14:35.056520] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T20:14:35.310987] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T20:14:35.825511] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-06T20:14:36.625580] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-06T20:14:36.931683] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T20:14:37.201732] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-06T20:14:37.425610] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-06T20:14:38.225532] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-06T20:14:38.286526] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T20:14:39.025515] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-06T20:14:39.220986] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T20:14:39.223086] [INFO ] [REMOTE ] MNR: Full fetch complete (36731 records). [2025-10-06T20:14:39.223423] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-06T20:14:39.647446] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-06T20:14:39.647721] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-06T20:14:39.648762] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-06T20:14:39.648883] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-06T20:14:39.677235] [DEBUG] [LOCAL ] MNR: Trimmed 36731 records to 24503 (keeping 200 days of data) [2025-10-06T20:14:39.679841] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-06T20:14:39.828552] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-06T20:14:39.843325] [DEBUG] [LOCAL ] MNR: Primary data saved (24503 records). [2025-10-06T20:14:39.843490] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-06T20:14:39.843598] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MNR took 40.3s. Estimated remaining: 2h 19m 15s. Rate: 7.1 symbols/min [2025-10-06T20:14:40.009833] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:14:40.060283] [DEBUG] [LOCAL ] MODG: Loaded 52282 existing records from primary storage. [2025-10-06T20:14:40.060666] [INFO ] [MAIN ] MODG: Loaded 52282 existing records. [2025-10-06T20:14:40.244584] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:14:40.245029] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-06T20:14:40.245140] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-06T20:14:40.245499] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-06T20:14:40.245613] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-06T20:14:40.631072] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:14:40.626672] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-06T20:14:40.635102] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T20:14:41.425546] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-06T20:14:42.196244] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-06T20:14:42.225502] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-06T20:14:42.340738] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T20:14:43.025526] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-06T20:14:43.218976] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T20:14:43.824413] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T20:14:43.834044] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-06T20:14:44.542123] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T20:14:44.625513] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-06T20:14:45.425513] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-06T20:14:45.565785] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T20:14:45.973711] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T20:14:46.225548] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-06T20:14:46.817062] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T20:14:47.025494] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-06T20:14:47.760867] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T20:14:47.825556] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-06T20:14:48.625488] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-06T20:14:48.745736] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T20:14:49.365376] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T20:14:49.425495] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-06T20:14:50.225525] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-06T20:14:50.830040] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-06T20:14:51.022821] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T20:14:51.032089] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-06T20:14:51.738686] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T20:14:51.825553] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-06T20:14:52.480831] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T20:14:52.625547] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-06T20:14:53.191409] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T20:14:53.194213] [INFO ] [REMOTE ] MNSO: Full fetch complete (64261 records). [2025-10-06T20:14:53.194341] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-06T20:14:53.430628] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-06T20:14:53.618991] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-06T20:14:53.619104] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-06T20:14:53.620603] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-06T20:14:53.620702] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-06T20:14:53.622265] [DEBUG] [LOCAL ] MNSO: Trimmed 64261 records to 44353 (keeping 200 days of data) [2025-10-06T20:14:53.913606] [DEBUG] [LOCAL ] MNSO: Primary data saved (44353 records). [2025-10-06T20:14:53.913833] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-06T20:14:53.914051] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MNSO took 37.4s. Estimated remaining: 2h 19m 11s. Rate: 7.1 symbols/min [2025-10-06T20:14:54.102669] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:14:54.153169] [DEBUG] [LOCAL ] MOH: Loaded 42386 existing records from primary storage. [2025-10-06T20:14:54.153603] [INFO ] [MAIN ] MOH: Loaded 42386 existing records. [2025-10-06T20:14:54.232331] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-06T20:14:54.400381] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:14:54.400844] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-06T20:14:54.400918] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-06T20:14:54.401415] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-06T20:14:54.401488] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-06T20:14:54.762379] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:14:54.797707] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-06T20:14:54.926436] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T20:14:55.025487] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-06T20:14:55.825510] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-06T20:14:55.993039] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T20:14:56.540251] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T20:14:56.625524] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-06T20:14:57.050448] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T20:14:57.425545] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-06T20:14:58.225502] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-06T20:14:58.282791] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T20:14:59.025519] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-06T20:14:59.080506] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T20:14:59.559006] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T20:14:59.825521] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-06T20:15:00.607337] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T20:15:00.610990] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-10-06T20:15:00.611115] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-06T20:15:00.632887] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-06T20:15:00.809748] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T20:15:00.810799] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:15:00.810884] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:15:00.810983] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-06T20:15:00.811091] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-06T20:15:00.811153] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-06T20:15:00.811201] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-06T20:15:00.811267] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MO took 41.6s. Estimated remaining: 2h 19m 1s. Rate: 7.1 symbols/min [2025-10-06T20:15:00.978468] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:15:01.038172] [DEBUG] [LOCAL ] MOS: Loaded 54279 existing records from primary storage. [2025-10-06T20:15:01.038562] [INFO ] [MAIN ] MOS: Loaded 54279 existing records. [2025-10-06T20:15:01.221315] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:15:01.221706] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-06T20:15:01.221785] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-06T20:15:01.222292] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-06T20:15:01.222352] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-06T20:15:01.429700] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-06T20:15:01.681399] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-06T20:15:01.686885] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:15:02.225487] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-06T20:15:02.571546] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-06T20:15:02.965978] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T20:15:02.968623] [INFO ] [REMOTE ] MOD: Full fetch complete (66308 records). [2025-10-06T20:15:02.968757] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-06T20:15:03.030993] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-06T20:15:03.354423] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-06T20:15:03.354507] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-06T20:15:03.355502] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-06T20:15:03.355565] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-06T20:15:03.357023] [DEBUG] [LOCAL ] MOD: Trimmed 66308 records to 45092 (keeping 200 days of data) [2025-10-06T20:15:03.632425] [DEBUG] [LOCAL ] MOD: Primary data saved (45092 records). [2025-10-06T20:15:03.632607] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-06T20:15:03.632792] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MOD took 33.3s. Estimated remaining: 2h 18m 49s. Rate: 7.1 symbols/min [2025-10-06T20:15:03.832506] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-06T20:15:03.837085] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T20:15:03.865875] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:15:03.893136] [DEBUG] [LOCAL ] MOV: Loaded 22246 existing records from primary storage. [2025-10-06T20:15:03.893488] [INFO ] [MAIN ] MOV: Loaded 22246 existing records. [2025-10-06T20:15:04.106168] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:15:04.106500] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-06T20:15:04.106555] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-06T20:15:04.106836] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-06T20:15:04.106898] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-06T20:15:04.504596] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:15:04.630757] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-06T20:15:04.650548] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T20:15:05.425592] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-06T20:15:05.868130] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T20:15:05.966909] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-06T20:15:06.225546] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-06T20:15:06.862973] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T20:15:07.025543] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-06T20:15:07.825604] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-06T20:15:08.005052] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T20:15:08.003554] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T20:15:08.625555] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-06T20:15:09.425496] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-06T20:15:09.532631] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T20:15:10.225490] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-06T20:15:10.418293] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T20:15:10.915818] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-06T20:15:11.025511] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-06T20:15:11.825572] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-06T20:15:12.033341] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T20:15:12.416581] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-06T20:15:12.625508] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-06T20:15:12.918538] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-06T20:15:13.425541] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-06T20:15:14.225490] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-06T20:15:14.585744] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-06T20:15:14.585836] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-06T20:15:15.025529] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-06T20:15:15.825511] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-06T20:15:15.907724] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T20:15:16.625528] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-06T20:15:16.777155] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T20:15:17.203200] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T20:15:17.425528] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-06T20:15:18.214908] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T20:15:18.217872] [INFO ] [REMOTE ] MODG: Full fetch complete (74802 records). [2025-10-06T20:15:18.218027] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-06T20:15:18.230727] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-06T20:15:18.630369] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-06T20:15:18.630586] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-06T20:15:18.632023] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-06T20:15:18.632139] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-06T20:15:18.653833] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T20:15:18.657103] [DEBUG] [LOCAL ] MODG: Trimmed 74802 records to 51533 (keeping 200 days of data) [2025-10-06T20:15:18.962513] [DEBUG] [LOCAL ] MODG: Primary data saved (51533 records). [2025-10-06T20:15:18.962699] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-06T20:15:18.962812] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MODG took 39.1s. Estimated remaining: 2h 18m 45s. Rate: 7.1 symbols/min [2025-10-06T20:15:19.030799] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-06T20:15:19.135855] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:15:19.186764] [DEBUG] [LOCAL ] MP: Loaded 54456 existing records from primary storage. [2025-10-06T20:15:19.187117] [INFO ] [MAIN ] MP: Loaded 54456 existing records. [2025-10-06T20:15:19.365086] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:15:19.365369] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-06T20:15:19.365417] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-06T20:15:19.365733] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-06T20:15:19.365791] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-06T20:15:19.720038] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:15:19.825527] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-06T20:15:20.007441] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T20:15:20.246673] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T20:15:20.625576] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-06T20:15:21.425551] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-06T20:15:21.647630] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T20:15:22.039618] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T20:15:22.042207] [INFO ] [REMOTE ] MOH: Full fetch complete (58616 records). [2025-10-06T20:15:22.042324] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-06T20:15:22.238077] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-06T20:15:22.436226] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-06T20:15:22.436356] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-06T20:15:22.437382] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-06T20:15:22.437453] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-06T20:15:22.439227] [DEBUG] [LOCAL ] MOH: Trimmed 58616 records to 41935 (keeping 200 days of data) [2025-10-06T20:15:22.699890] [DEBUG] [LOCAL ] MOH: Primary data saved (41935 records). [2025-10-06T20:15:22.700039] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-06T20:15:22.700125] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MOH took 28.8s. Estimated remaining: 2h 18m 34s. Rate: 7.1 symbols/min [2025-10-06T20:15:22.872954] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:15:22.880757] [DEBUG] [LOCAL ] MPA: Loaded 5349 existing records from primary storage. [2025-10-06T20:15:22.880999] [INFO ] [MAIN ] MPA: Loaded 5349 existing records. [2025-10-06T20:15:23.030689] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-06T20:15:23.060199] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:15:23.060756] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-06T20:15:23.060978] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-06T20:15:23.061331] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-06T20:15:23.061392] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-06T20:15:23.468249] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:15:23.470658] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-06T20:15:23.825484] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-06T20:15:24.074345] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T20:15:24.143312] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-06T20:15:24.625553] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-06T20:15:25.425547] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-06T20:15:25.627374] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T20:15:25.766241] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T20:15:26.055601] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-06T20:15:26.225592] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-06T20:15:27.025547] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-06T20:15:27.825498] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-06T20:15:28.175397] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-06T20:15:28.625496] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-06T20:15:28.948529] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T20:15:29.013193] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-06T20:15:29.425536] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-06T20:15:30.225538] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-06T20:15:30.372406] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T20:15:30.533722] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T20:15:30.535473] [INFO ] [REMOTE ] MOV: Full fetch complete (30628 records). [2025-10-06T20:15:30.535559] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-06T20:15:30.802154] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-06T20:15:30.935186] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-06T20:15:30.935418] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-06T20:15:30.936781] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-06T20:15:30.936850] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-06T20:15:30.938333] [DEBUG] [LOCAL ] MOV: Trimmed 30628 records to 21809 (keeping 200 days of data) [2025-10-06T20:15:31.030760] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-06T20:15:31.085113] [DEBUG] [LOCAL ] MOV: Primary data saved (21809 records). [2025-10-06T20:15:31.085304] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-06T20:15:31.085453] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOV took 27.5s. Estimated remaining: 2h 18m 25s. Rate: 7.1 symbols/min [2025-10-06T20:15:31.266913] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:15:31.328836] [DEBUG] [LOCAL ] MPC: Loaded 52839 existing records from primary storage. [2025-10-06T20:15:31.329282] [INFO ] [MAIN ] MPC: Loaded 52839 existing records. [2025-10-06T20:15:31.519798] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:15:31.520121] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-06T20:15:31.520172] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-06T20:15:31.520625] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-06T20:15:31.520723] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-06T20:15:31.827024] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-06T20:15:31.914899] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:15:32.625507] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-06T20:15:32.994574] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-06T20:15:33.233174] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-06T20:15:33.425625] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-06T20:15:33.593397] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T20:15:34.004324] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-06T20:15:34.225554] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-06T20:15:35.025542] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-06T20:15:35.825547] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-06T20:15:36.076767] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T20:15:36.625524] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-06T20:15:37.242175] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-06T20:15:37.425484] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-06T20:15:37.607498] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T20:15:38.225491] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-06T20:15:38.323685] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T20:15:39.025582] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-06T20:15:39.586473] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-06T20:15:39.825491] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-06T20:15:40.007539] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T20:15:40.625512] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-06T20:15:40.689188] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T20:15:41.425495] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-06T20:15:42.228833] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-06T20:15:42.231961] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-06T20:15:42.252728] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T20:15:42.256054] [INFO ] [REMOTE ] MOS: Full fetch complete (77454 records). [2025-10-06T20:15:42.256222] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-06T20:15:42.658553] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-06T20:15:42.658690] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-06T20:15:42.659938] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-06T20:15:42.660010] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-06T20:15:42.661586] [DEBUG] [LOCAL ] MOS: Trimmed 77454 records to 53499 (keeping 200 days of data) [2025-10-06T20:15:43.010944] [DEBUG] [LOCAL ] MOS: Primary data saved (53499 records). [2025-10-06T20:15:43.011103] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-06T20:15:43.011894] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MOS took 42.2s. Estimated remaining: 2h 18m 19s. Rate: 7.1 symbols/min [2025-10-06T20:15:43.044462] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-06T20:15:43.133114] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T20:15:43.216136] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:15:43.250477] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T20:15:43.311320] [DEBUG] [LOCAL ] MPLX: Loaded 51499 existing records from primary storage. [2025-10-06T20:15:43.311727] [INFO ] [MAIN ] MPLX: Loaded 51499 existing records. [2025-10-06T20:15:43.532091] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:15:43.532468] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-06T20:15:43.532530] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-06T20:15:43.532817] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-06T20:15:43.532886] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-06T20:15:43.830714] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-06T20:15:43.912047] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:15:44.625541] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-06T20:15:45.257664] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-06T20:15:45.425503] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-06T20:15:45.767905] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T20:15:45.800513] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-06T20:15:46.046709] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-06T20:15:46.225597] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-06T20:15:47.025570] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-06T20:15:47.825606] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-06T20:15:47.987393] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T20:15:48.428202] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T20:15:48.625593] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-06T20:15:49.092359] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-06T20:15:49.184848] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T20:15:49.425547] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-06T20:15:50.225548] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-06T20:15:51.025495] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-06T20:15:51.210766] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T20:15:51.825617] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-06T20:15:52.401468] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-06T20:15:52.625531] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-06T20:15:52.744729] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T20:15:52.818439] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-06T20:15:53.083759] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T20:15:53.085238] [INFO ] [REMOTE ] MPA: Full fetch complete (7256 records). [2025-10-06T20:15:53.085324] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-06T20:15:53.430751] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-06T20:15:53.494129] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-06T20:15:53.494239] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-06T20:15:53.494558] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-06T20:15:53.494628] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-06T20:15:53.495225] [DEBUG] [LOCAL ] MPA: Trimmed 7256 records to 5336 (keeping 200 days of data) [2025-10-06T20:15:53.530069] [DEBUG] [LOCAL ] MPA: Primary data saved (5336 records). [2025-10-06T20:15:53.530240] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-06T20:15:53.530360] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MPA took 30.8s. Estimated remaining: 2h 18m 12s. Rate: 7.1 symbols/min [2025-10-06T20:15:53.722436] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:15:53.731536] [DEBUG] [LOCAL ] MPV: Loaded 4992 existing records from primary storage. [2025-10-06T20:15:53.731863] [INFO ] [MAIN ] MPV: Loaded 4992 existing records. [2025-10-06T20:15:53.940885] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:15:53.941207] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-06T20:15:53.941255] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-06T20:15:53.941492] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-06T20:15:53.941549] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-06T20:15:54.229002] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-06T20:15:54.311789] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:15:55.025582] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-06T20:15:55.328533] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T20:15:55.694933] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-06T20:15:55.825508] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-06T20:15:55.940952] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T20:15:56.492789] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-06T20:15:56.625556] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-06T20:15:57.425529] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-06T20:15:58.161049] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-06T20:15:58.225485] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-06T20:15:58.302444] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T20:15:58.961383] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T20:15:59.025496] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-06T20:15:59.687754] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-06T20:15:59.825538] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-06T20:16:00.625533] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-06T20:16:01.281035] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-06T20:16:01.425554] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-06T20:16:02.079736] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-06T20:16:02.168536] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T20:16:02.225522] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-06T20:16:03.025537] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-06T20:16:03.717245] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T20:16:03.825494] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-06T20:16:04.033798] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T20:16:04.625538] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-06T20:16:05.425553] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-06T20:16:06.050874] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T20:16:06.053435] [INFO ] [REMOTE ] MPC: Full fetch complete (75454 records). [2025-10-06T20:16:06.053541] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-06T20:16:06.054379] [FATAL] [VALIDATOR ] MPC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:16:06.054470] [FATAL] [MAIN ] MPC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:16:06.054513] [WARN ] [MAIN ] MPC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:16:06.054555] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-06T20:16:06.054619] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-06T20:16:06.054691] [INFO ] [LOCAL ] MPC: Starting deletion of derivative data. [2025-10-06T20:16:06.054974] [DEBUG] [LOCAL ] MPC: Deleted derivative data file. [2025-10-06T20:16:06.055920] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MPC took 35.0s. Estimated remaining: 2h 18m 7s. Rate: 7.1 symbols/min [2025-10-06T20:16:06.228982] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:16:06.226039] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-06T20:16:06.285511] [DEBUG] [LOCAL ] MPW: Loaded 54270 existing records from primary storage. [2025-10-06T20:16:06.285907] [INFO ] [MAIN ] MPW: Loaded 54270 existing records. [2025-10-06T20:16:06.497475] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:16:06.505627] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-06T20:16:06.505928] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-06T20:16:06.507883] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-06T20:16:06.511474] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-06T20:16:06.512220] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-06T20:16:06.533278] [INFO ] [REMOTE ] MP: Full fetch complete (77360 records). [2025-10-06T20:16:06.568841] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-06T20:16:07.129284] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-06T20:16:07.128946] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-06T20:16:07.244022] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-06T20:16:07.387071] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:16:07.406190] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-06T20:16:07.406251] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-06T20:16:07.407375] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-06T20:16:07.407438] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-06T20:16:07.408839] [DEBUG] [LOCAL ] MP: Trimmed 77360 records to 53686 (keeping 200 days of data) [2025-10-06T20:16:07.742156] [DEBUG] [LOCAL ] MP: Primary data saved (53686 records). [2025-10-06T20:16:07.742321] [INFO ] [MAIN ] MP: Full history saved. [2025-10-06T20:16:07.742407] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MP took 48.8s. Estimated remaining: 2h 17m 53s. Rate: 7.1 symbols/min [2025-10-06T20:16:07.832995] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-06T20:16:07.917912] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:16:07.925173] [DEBUG] [LOCAL ] MPX: Loaded 4118 existing records from primary storage. [2025-10-06T20:16:07.925393] [INFO ] [MAIN ] MPX: Loaded 4118 existing records. [2025-10-06T20:16:08.103329] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-06T20:16:08.106881] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:16:08.108702] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-06T20:16:08.108762] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-06T20:16:08.109072] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-06T20:16:08.109130] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-06T20:16:08.507932] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:16:08.625508] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-06T20:16:09.425531] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-06T20:16:10.080300] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-06T20:16:10.147519] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T20:16:10.225495] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-06T20:16:10.420955] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-06T20:16:10.939013] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-06T20:16:11.025516] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-06T20:16:11.763484] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T20:16:11.825513] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-06T20:16:12.524537] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-06T20:16:12.625523] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-06T20:16:13.425532] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-06T20:16:14.225521] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-06T20:16:14.255874] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T20:16:14.726058] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-06T20:16:15.025525] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-06T20:16:15.825488] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-06T20:16:16.106128] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-06T20:16:16.610964] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-06T20:16:16.625478] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-06T20:16:16.946470] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-06T20:16:17.214224] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T20:16:17.215262] [INFO ] [REMOTE ] MPV: Full fetch complete (7961 records). [2025-10-06T20:16:17.215345] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-06T20:16:17.433765] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-06T20:16:17.627392] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-06T20:16:17.627475] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-06T20:16:17.627706] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-06T20:16:17.627767] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-06T20:16:17.628185] [DEBUG] [LOCAL ] MPV: Trimmed 7961 records to 4901 (keeping 200 days of data) [2025-10-06T20:16:17.658260] [DEBUG] [LOCAL ] MPV: Primary data saved (4901 records). [2025-10-06T20:16:17.658387] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-06T20:16:17.658500] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MPV took 24.1s. Estimated remaining: 2h 17m 46s. Rate: 7.1 symbols/min [2025-10-06T20:16:17.825178] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:16:17.837276] [DEBUG] [LOCAL ] MQT: Loaded 8841 existing records from primary storage. [2025-10-06T20:16:17.837560] [INFO ] [MAIN ] MQT: Loaded 8841 existing records. [2025-10-06T20:16:18.011758] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:16:18.012018] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-06T20:16:18.012067] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-06T20:16:18.012261] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-06T20:16:18.012317] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-06T20:16:18.230726] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-06T20:16:18.365884] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:16:19.026014] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-06T20:16:19.025744] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-06T20:16:19.574746] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-06T20:16:19.825532] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-06T20:16:20.532211] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-06T20:16:20.630592] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-06T20:16:20.649979] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T20:16:21.397606] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T20:16:21.425527] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-06T20:16:22.117669] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-06T20:16:22.225502] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-06T20:16:23.017638] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-06T20:16:23.025471] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-06T20:16:23.697532] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T20:16:23.825544] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-06T20:16:24.625530] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-06T20:16:25.142149] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T20:16:25.143003] [INFO ] [REMOTE ] MPX: Full fetch complete (6685 records). [2025-10-06T20:16:25.143073] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-06T20:16:25.430761] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-06T20:16:25.509169] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-06T20:16:25.509260] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-06T20:16:25.509468] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-06T20:16:25.509508] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-06T20:16:25.509935] [DEBUG] [LOCAL ] MPX: Trimmed 6685 records to 4038 (keeping 200 days of data) [2025-10-06T20:16:25.534283] [DEBUG] [LOCAL ] MPX: Primary data saved (4038 records). [2025-10-06T20:16:25.534430] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-06T20:16:25.534518] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MPX took 17.8s. Estimated remaining: 2h 17m 37s. Rate: 7.1 symbols/min [2025-10-06T20:16:25.729365] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:16:25.751035] [DEBUG] [LOCAL ] MQY: Loaded 17389 existing records from primary storage. [2025-10-06T20:16:25.751322] [INFO ] [MAIN ] MQY: Loaded 17389 existing records. [2025-10-06T20:16:25.966208] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:16:25.966694] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-06T20:16:25.966767] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-06T20:16:25.967171] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-10-06T20:16:25.967281] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-06T20:16:26.225690] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-06T20:16:26.237275] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-06T20:16:26.586286] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:16:27.025496] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-06T20:16:27.160227] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T20:16:27.406574] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-06T20:16:27.825548] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-06T20:16:28.625557] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-06T20:16:28.892138] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T20:16:29.184713] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-06T20:16:29.290126] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-06T20:16:29.425552] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-06T20:16:30.225518] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-06T20:16:31.025504] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-06T20:16:31.363004] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-06T20:16:31.687241] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T20:16:31.690633] [INFO ] [REMOTE ] MPLX: Full fetch complete (74049 records). [2025-10-06T20:16:31.690839] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-06T20:16:31.822631] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T20:16:31.827970] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-06T20:16:32.105842] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-06T20:16:32.105927] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-06T20:16:32.106991] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-06T20:16:32.107071] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-06T20:16:32.108571] [DEBUG] [LOCAL ] MPLX: Trimmed 74049 records to 50717 (keeping 200 days of data) [2025-10-06T20:16:32.432619] [DEBUG] [LOCAL ] MPLX: Primary data saved (50717 records). [2025-10-06T20:16:32.432800] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-06T20:16:32.432892] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPLX took 49.4s. Estimated remaining: 2h 17m 28s. Rate: 7.1 symbols/min [2025-10-06T20:16:32.604485] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:16:32.625517] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-06T20:16:32.643374] [DEBUG] [LOCAL ] MRC: Loaded 37897 existing records from primary storage. [2025-10-06T20:16:32.643740] [INFO ] [MAIN ] MRC: Loaded 37897 existing records. [2025-10-06T20:16:32.823563] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:16:32.823943] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-06T20:16:32.824000] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-06T20:16:32.824261] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-10-06T20:16:32.824321] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-06T20:16:33.196687] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:16:33.197283] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T20:16:33.425492] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-06T20:16:33.525225] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-06T20:16:34.225589] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-06T20:16:34.907972] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T20:16:35.025545] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-06T20:16:35.345085] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T20:16:35.825553] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-06T20:16:36.089524] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-06T20:16:36.625611] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-06T20:16:37.425599] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-06T20:16:37.877690] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-06T20:16:37.976809] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-06T20:16:38.089364] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T20:16:38.225543] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-06T20:16:39.025607] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-06T20:16:39.439103] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-06T20:16:39.825582] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-06T20:16:40.625589] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-06T20:16:41.425542] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-06T20:16:41.891965] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-10-06T20:16:42.225468] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-06T20:16:42.472860] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-06T20:16:43.025496] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-06T20:16:43.314377] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-06T20:16:43.825527] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-06T20:16:44.717704] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (4.09 seconds). [2025-10-06T20:16:44.729897] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-06T20:16:44.921497] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T20:16:45.251362] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-06T20:16:45.425548] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-06T20:16:45.665179] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (3.44 seconds). [2025-10-06T20:16:46.225507] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-06T20:16:46.296558] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-06T20:16:46.582122] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T20:16:47.025580] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-06T20:16:47.756049] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-06T20:16:47.825541] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-06T20:16:47.854085] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T20:16:47.857353] [INFO ] [REMOTE ] MPW: Full fetch complete (77512 records). [2025-10-06T20:16:47.857540] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-06T20:16:48.253134] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-06T20:16:48.253241] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-06T20:16:48.254432] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-06T20:16:48.254502] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-06T20:16:48.256131] [DEBUG] [LOCAL ] MPW: Trimmed 77512 records to 53493 (keeping 200 days of data) [2025-10-06T20:16:48.578668] [DEBUG] [LOCAL ] MPW: Primary data saved (53493 records). [2025-10-06T20:16:48.578833] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-06T20:16:48.578925] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MPW took 42.5s. Estimated remaining: 2h 17m 25s. Rate: 7.1 symbols/min [2025-10-06T20:16:48.632735] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-06T20:16:48.748670] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:16:48.748905] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-06T20:16:48.748942] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-06T20:16:48.749054] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-06T20:16:48.749099] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-06T20:16:48.749138] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-06T20:16:48.749169] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-06T20:16:49.096321] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:16:49.432733] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-06T20:16:49.437748] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T20:16:49.565932] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T20:16:50.225571] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-06T20:16:51.025574] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-06T20:16:51.681049] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-06T20:16:51.724346] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T20:16:51.725360] [INFO ] [REMOTE ] MQT: Full fetch complete (13415 records). [2025-10-06T20:16:51.725430] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-06T20:16:51.826545] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-06T20:16:52.085368] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-06T20:16:52.132155] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-06T20:16:52.132218] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-06T20:16:52.132510] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-06T20:16:52.132547] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-06T20:16:52.133008] [DEBUG] [LOCAL ] MQT: Trimmed 13415 records to 8681 (keeping 200 days of data) [2025-10-06T20:16:52.183745] [DEBUG] [LOCAL ] MQT: Primary data saved (8681 records). [2025-10-06T20:16:52.183859] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-06T20:16:52.183938] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MQT took 34.5s. Estimated remaining: 2h 17m 13s. Rate: 7.1 symbols/min [2025-10-06T20:16:52.625472] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-06T20:16:52.988063] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T20:16:53.425511] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-06T20:16:53.619571] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T20:16:54.225503] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-06T20:16:54.904209] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T20:16:55.025495] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-06T20:16:55.107793] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T20:16:55.825521] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-06T20:16:56.235685] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T20:16:56.625498] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-06T20:16:56.759549] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T20:16:57.425518] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-06T20:16:58.228080] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-06T20:16:58.242842] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T20:16:58.401636] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T20:16:59.025506] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-06T20:16:59.399890] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T20:16:59.825540] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-06T20:17:00.215491] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T20:17:00.625518] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-06T20:17:00.872195] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T20:17:01.425623] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-06T20:17:01.683550] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T20:17:01.685862] [INFO ] [REMOTE ] MQY: Full fetch complete (27178 records). [2025-10-06T20:17:01.686000] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-06T20:17:02.055209] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-06T20:17:02.055292] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-06T20:17:02.055898] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-06T20:17:02.055959] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-06T20:17:02.056557] [DEBUG] [LOCAL ] MQY: Trimmed 27178 records to 16950 (keeping 200 days of data) [2025-10-06T20:17:02.162721] [DEBUG] [LOCAL ] MQY: Primary data saved (16950 records). [2025-10-06T20:17:02.162880] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-06T20:17:02.162977] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQY took 36.6s. Estimated remaining: 2h 17m 5s. Rate: 7.1 symbols/min [2025-10-06T20:17:02.225581] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-06T20:17:02.976009] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T20:17:03.025557] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-06T20:17:03.370324] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T20:17:03.825543] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-06T20:17:04.370153] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T20:17:04.372998] [INFO ] [REMOTE ] MRC: Full fetch complete (54832 records). [2025-10-06T20:17:04.373163] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-06T20:17:04.786169] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-10-06T20:17:04.786341] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-10-06T20:17:04.787406] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-10-06T20:17:04.787507] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-10-06T20:17:04.789255] [DEBUG] [LOCAL ] MRC: Trimmed 54832 records to 37156 (keeping 200 days of data) [2025-10-06T20:17:04.911380] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T20:17:04.925819] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-06T20:17:05.061758] [DEBUG] [LOCAL ] MRC: Primary data saved (37156 records). [2025-10-06T20:17:05.061927] [INFO ] [MAIN ] MRC: Full history saved. [2025-10-06T20:17:05.062017] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MRC took 32.6s. Estimated remaining: 2h 16m 53s. Rate: 7.1 symbols/min [2025-10-06T20:17:05.914022] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-06T20:17:05.926490] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-06T20:17:07.040218] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T20:17:07.052221] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-06T20:17:07.497628] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T20:17:07.500286] [INFO ] [REMOTE ] MRK: Full fetch complete (77467 records). [2025-10-06T20:17:07.500397] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-06T20:17:07.501356] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:17:07.501447] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:17:07.501490] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:17:07.501527] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-06T20:17:07.501588] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-06T20:17:07.501623] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-06T20:17:07.501717] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-06T20:17:07.501791] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MRK took 18.9s. Estimated remaining: 2h 16m 40s. Rate: 7.1 symbols/min [2025-10-06T20:17:08.083992] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:17:08.153371] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:17:08.173027] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-06T20:17:08.217877] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-06T20:17:08.218588] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-06T20:17:08.219527] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:17:08.215253] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:17:08.219744] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-06T20:17:08.219845] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-06T20:17:08.220019] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-06T20:17:08.220198] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-06T20:17:08.220345] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-06T20:17:08.220107] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-06T20:17:08.220465] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-06T20:17:08.225763] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-06T20:17:08.226282] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-06T20:17:08.453696] [DEBUG] [LOCAL ] MSA: Loaded 19110 existing records from primary storage. [2025-10-06T20:17:08.459423] [DEBUG] [LOCAL ] MSB: Loaded 7924 existing records from primary storage. [2025-10-06T20:17:08.486384] [INFO ] [MAIN ] MSA: Loaded 19110 existing records. [2025-10-06T20:17:08.529171] [INFO ] [MAIN ] MSB: Loaded 7924 existing records. [2025-10-06T20:17:09.302773] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:17:09.332961] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:17:09.335867] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-06T20:17:09.339615] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-06T20:17:09.339736] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-06T20:17:09.339291] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:17:09.340899] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-06T20:17:09.340944] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-06T20:17:09.346560] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-10-06T20:17:09.346738] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-06T20:17:09.352011] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-06T20:17:09.388305] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-06T20:17:09.551479] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:17:09.568201] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-06T20:17:09.728448] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:17:09.800212] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-06T20:17:09.863751] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:17:09.897396] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-06T20:17:09.913371] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:17:09.918622] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-06T20:17:09.956693] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-06T20:17:09.988798] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-06T20:17:10.026285] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-06T20:17:10.030162] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MRP took 2.5s. Estimated remaining: 2h 16m 28s. Rate: 7.1 symbols/min [2025-10-06T20:17:10.260852] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:17:10.271726] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:17:10.277230] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-06T20:17:10.282819] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-06T20:17:10.376226] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:17:10.376429] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-06T20:17:10.376466] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-06T20:17:10.376608] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-06T20:17:10.376682] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-06T20:17:10.376783] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-06T20:17:10.376818] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-06T20:17:10.816610] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:17:10.817099] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-06T20:17:11.066187] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-06T20:17:11.068241] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-06T20:17:11.239984] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-06T20:17:11.469930] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-06T20:17:11.825481] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-06T20:17:11.949492] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-06T20:17:12.196867] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T20:17:12.263407] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-06T20:17:12.625531] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-06T20:17:13.425487] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-06T20:17:13.549460] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-06T20:17:14.225572] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-06T20:17:14.413330] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T20:17:15.025558] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-06T20:17:15.142353] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T20:17:15.825539] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-06T20:17:16.108781] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T20:17:16.625563] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-06T20:17:16.721377] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T20:17:17.425609] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-06T20:17:17.844613] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-06T20:17:18.084347] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-06T20:17:18.225611] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-06T20:17:18.792818] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T20:17:19.025568] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-06T20:17:19.825508] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-06T20:17:19.904718] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-06T20:17:20.625592] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-06T20:17:21.054811] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-06T20:17:21.170945] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T20:17:21.425584] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-06T20:17:21.879947] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-06T20:17:22.225541] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-06T20:17:23.025499] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-06T20:17:23.418823] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T20:17:23.514863] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-06T20:17:23.825554] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-06T20:17:24.625492] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-06T20:17:24.818790] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T20:17:25.215314] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T20:17:25.425582] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-06T20:17:26.225536] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-06T20:17:26.902290] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T20:17:27.025516] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-06T20:17:27.153141] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T20:17:27.825484] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-06T20:17:28.356863] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-06T20:17:28.625533] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-06T20:17:29.046809] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T20:17:29.425495] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-06T20:17:29.497213] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T20:17:30.225503] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-06T20:17:30.369611] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-06T20:17:31.025550] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-06T20:17:31.121870] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-06T20:17:31.686327] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-06T20:17:31.825545] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-06T20:17:32.625502] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-06T20:17:32.726157] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-06T20:17:33.162360] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T20:17:33.425556] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-06T20:17:34.225558] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-06T20:17:34.276163] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-06T20:17:35.025537] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-06T20:17:35.453488] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T20:17:35.462334] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-06T20:17:35.463105] [INFO ] [REMOTE ] MSC: Full fetch complete (2541 records). [2025-10-06T20:17:35.463174] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-06T20:17:35.641549] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-06T20:17:35.641790] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:17:35.641839] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:17:35.641879] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-06T20:17:35.641963] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-06T20:17:35.642020] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-06T20:17:35.642086] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-06T20:17:35.642262] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MSC took 25.6s. Estimated remaining: 2h 16m 31s. Rate: 7.1 symbols/min [2025-10-06T20:17:35.807248] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:17:35.833057] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-06T20:17:35.849043] [DEBUG] [LOCAL ] MSCI: Loaded 34977 existing records from primary storage. [2025-10-06T20:17:35.849335] [INFO ] [MAIN ] MSCI: Loaded 34977 existing records. [2025-10-06T20:17:36.022984] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:17:36.023254] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-06T20:17:36.023302] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-06T20:17:36.023577] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-10-06T20:17:36.023636] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-06T20:17:36.368307] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:17:36.625515] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-06T20:17:36.778961] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T20:17:37.425501] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-06T20:17:37.615563] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T20:17:38.225519] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-06T20:17:38.552088] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T20:17:39.025544] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-06T20:17:39.221465] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T20:17:39.825491] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-06T20:17:39.941186] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T20:17:40.625544] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-06T20:17:41.432680] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-06T20:17:41.436533] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T20:17:41.604519] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T20:17:42.188285] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T20:17:42.189350] [INFO ] [REMOTE ] MSB: Full fetch complete (13002 records). [2025-10-06T20:17:42.189422] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-06T20:17:42.230760] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-06T20:17:42.548443] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-06T20:17:42.548538] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-06T20:17:42.548894] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-06T20:17:42.548960] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-06T20:17:42.549681] [DEBUG] [LOCAL ] MSB: Trimmed 13002 records to 7857 (keeping 200 days of data) [2025-10-06T20:17:42.606696] [DEBUG] [LOCAL ] MSB: Primary data saved (7857 records). [2025-10-06T20:17:42.606878] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-06T20:17:42.606982] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MSB took 35.1s. Estimated remaining: 2h 16m 22s. Rate: 7.1 symbols/min [2025-10-06T20:17:42.776905] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:17:42.795852] [DEBUG] [LOCAL ] MSD: Loaded 16204 existing records from primary storage. [2025-10-06T20:17:42.796209] [INFO ] [MAIN ] MSD: Loaded 16204 existing records. [2025-10-06T20:17:42.907599] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-06T20:17:42.921524] [INFO ] [REMOTE ] MS: Full fetch complete (77329 records). [2025-10-06T20:17:42.937109] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-06T20:17:42.960950] [FATAL] [VALIDATOR ] MS: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:17:42.986761] [FATAL] [MAIN ] MS: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:17:42.991594] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:17:42.991739] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:17:42.991927] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-06T20:17:42.992048] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-06T20:17:42.992214] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-06T20:17:42.992297] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-06T20:17:42.992392] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-06T20:17:42.992550] [DEBUG] [LOCAL ] MS: No derivative data file found to delete. [2025-10-06T20:17:42.992719] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-06T20:17:42.992680] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MS took 35.5s. Estimated remaining: 2h 16m 8s. Rate: 7.1 symbols/min [2025-10-06T20:17:42.992848] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-06T20:17:43.031098] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-06T20:17:43.387727] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:17:43.554755] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:17:43.572242] [DEBUG] [LOCAL ] MSDL: Loaded 38862 existing records from primary storage. [2025-10-06T20:17:43.572552] [INFO ] [MAIN ] MSDL: Loaded 38862 existing records. [2025-10-06T20:17:43.752306] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:17:43.752558] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-06T20:17:43.752633] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-06T20:17:43.752975] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-10-06T20:17:43.753035] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-06T20:17:43.829599] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-06T20:17:44.125455] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:17:44.145246] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T20:17:44.625553] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-06T20:17:44.807005] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T20:17:45.425495] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-06T20:17:45.536856] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-06T20:17:46.225549] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-06T20:17:46.915834] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T20:17:47.025575] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-06T20:17:47.371896] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-06T20:17:47.825555] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-06T20:17:48.058977] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T20:17:48.060450] [INFO ] [REMOTE ] MSA: Full fetch complete (25911 records). [2025-10-06T20:17:48.060555] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-06T20:17:48.440793] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-10-06T20:17:48.440962] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-10-06T20:17:48.442172] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-10-06T20:17:48.442239] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-10-06T20:17:48.443193] [DEBUG] [LOCAL ] MSA: Trimmed 25911 records to 18886 (keeping 200 days of data) [2025-10-06T20:17:48.582743] [DEBUG] [LOCAL ] MSA: Primary data saved (18886 records). [2025-10-06T20:17:48.583094] [INFO ] [MAIN ] MSA: Full history saved. [2025-10-06T20:17:48.583320] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MSA took 41.1s. Estimated remaining: 2h 15m 57s. Rate: 7.1 symbols/min [2025-10-06T20:17:48.632044] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-06T20:17:48.787204] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:17:48.820937] [DEBUG] [LOCAL ] MSGE: Loaded 27381 existing records from primary storage. [2025-10-06T20:17:48.821369] [INFO ] [MAIN ] MSGE: Loaded 27381 existing records. [2025-10-06T20:17:48.964893] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T20:17:49.070323] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:17:49.070664] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-06T20:17:49.070738] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-06T20:17:49.071141] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-10-06T20:17:49.071202] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-06T20:17:49.427339] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-06T20:17:49.427234] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:17:50.157529] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T20:17:50.225497] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-06T20:17:50.263677] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-06T20:17:51.025536] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-06T20:17:51.747269] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T20:17:51.825492] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-06T20:17:51.882053] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T20:17:52.625529] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-06T20:17:53.206370] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T20:17:53.425559] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-06T20:17:54.218463] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T20:17:54.225457] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-06T20:17:54.251051] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T20:17:55.025515] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-06T20:17:55.162113] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T20:17:55.825539] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-06T20:17:56.564748] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-06T20:17:56.625468] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-06T20:17:56.821376] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-06T20:17:57.425485] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-06T20:17:57.704864] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T20:17:58.225516] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-06T20:17:59.025498] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-06T20:17:59.048093] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T20:17:59.158020] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T20:17:59.825592] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-06T20:18:00.422982] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T20:18:00.625531] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-06T20:18:01.232427] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T20:18:01.425555] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-06T20:18:01.624514] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-06T20:18:02.225543] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-06T20:18:02.960266] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T20:18:03.025540] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-06T20:18:03.318179] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-06T20:18:03.825592] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-06T20:18:04.616849] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T20:18:04.625477] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-06T20:18:05.425734] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-06T20:18:05.425543] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T20:18:06.003961] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-06T20:18:06.006374] [INFO ] [REMOTE ] MSCI: Full fetch complete (50320 records). [2025-10-06T20:18:06.006583] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-06T20:18:06.007667] [FATAL] [VALIDATOR ] MSCI: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:18:06.007785] [FATAL] [MAIN ] MSCI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:18:06.007882] [WARN ] [MAIN ] MSCI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:18:06.008024] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-06T20:18:06.008261] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-06T20:18:06.008330] [INFO ] [LOCAL ] MSCI: Starting deletion of derivative data. [2025-10-06T20:18:06.008775] [DEBUG] [LOCAL ] MSCI: Deleted derivative data file. [2025-10-06T20:18:06.008936] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSCI took 30.4s. Estimated remaining: 2h 15m 55s. Rate: 7.1 symbols/min [2025-10-06T20:18:06.206084] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:18:06.231189] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-06T20:18:06.235855] [DEBUG] [LOCAL ] MSGS: Loaded 17502 existing records from primary storage. [2025-10-06T20:18:06.236287] [INFO ] [MAIN ] MSGS: Loaded 17502 existing records. [2025-10-06T20:18:06.422996] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:18:06.423294] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-06T20:18:06.423506] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-06T20:18:06.423916] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-10-06T20:18:06.424156] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-06T20:18:06.575970] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T20:18:06.851286] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:18:07.025532] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-06T20:18:07.283419] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T20:18:07.825537] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-06T20:18:08.429682] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T20:18:08.625512] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-06T20:18:08.754711] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T20:18:09.425527] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-06T20:18:09.968815] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T20:18:09.971512] [INFO ] [REMOTE ] MSDL: Full fetch complete (55201 records). [2025-10-06T20:18:09.971664] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-06T20:18:10.230697] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-06T20:18:10.368236] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-10-06T20:18:10.368327] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-10-06T20:18:10.369296] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-10-06T20:18:10.369360] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-10-06T20:18:10.370546] [DEBUG] [LOCAL ] MSDL: Trimmed 55201 records to 38321 (keeping 200 days of data) [2025-10-06T20:18:10.624184] [DEBUG] [LOCAL ] MSDL: Primary data saved (38321 records). [2025-10-06T20:18:10.624453] [INFO ] [MAIN ] MSDL: Full history saved. [2025-10-06T20:18:10.624702] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSDL took 27.6s. Estimated remaining: 2h 15m 44s. Rate: 7.1 symbols/min [2025-10-06T20:18:10.792686] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T20:18:10.887406] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:18:10.942191] [DEBUG] [LOCAL ] MSI: Loaded 40771 existing records from primary storage. [2025-10-06T20:18:10.942762] [INFO ] [MAIN ] MSI: Loaded 40771 existing records. [2025-10-06T20:18:11.030940] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-06T20:18:11.262076] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:18:11.262436] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-06T20:18:11.262530] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-06T20:18:11.270849] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-10-06T20:18:11.271947] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-06T20:18:11.278427] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T20:18:11.809911] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:18:11.825582] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-06T20:18:12.072357] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T20:18:12.625521] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-06T20:18:12.682337] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T20:18:13.425535] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-06T20:18:14.225539] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-06T20:18:14.332101] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T20:18:14.403513] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T20:18:15.025531] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-06T20:18:15.324410] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T20:18:15.825514] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-06T20:18:16.267429] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T20:18:16.630665] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-06T20:18:16.640967] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T20:18:17.425500] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-06T20:18:17.780474] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T20:18:18.225520] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-06T20:18:18.491950] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T20:18:19.025554] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-06T20:18:19.356434] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-06T20:18:19.825572] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-06T20:18:19.910711] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-06T20:18:20.625577] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-06T20:18:20.665539] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-06T20:18:21.425510] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-06T20:18:21.651388] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-06T20:18:22.225543] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-06T20:18:22.353864] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T20:18:23.025560] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-06T20:18:23.335157] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T20:18:23.825511] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-06T20:18:23.917920] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T20:18:24.625496] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-06T20:18:24.947804] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-06T20:18:25.425609] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-06T20:18:25.466777] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T20:18:25.468958] [INFO ] [REMOTE ] MSGE: Full fetch complete (40247 records). [2025-10-06T20:18:25.469039] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-06T20:18:25.880319] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-10-06T20:18:25.880472] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-10-06T20:18:25.881364] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-10-06T20:18:25.881494] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-10-06T20:18:25.882473] [DEBUG] [LOCAL ] MSGE: Trimmed 40247 records to 26923 (keeping 200 days of data) [2025-10-06T20:18:26.054337] [DEBUG] [LOCAL ] MSGE: Primary data saved (26923 records). [2025-10-06T20:18:26.054499] [INFO ] [MAIN ] MSGE: Full history saved. [2025-10-06T20:18:26.054590] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSGE took 37.5s. Estimated remaining: 2h 15m 40s. Rate: 7.1 symbols/min [2025-10-06T20:18:26.233807] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-06T20:18:26.238472] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:18:26.238795] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-06T20:18:26.239093] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-06T20:18:26.240742] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-06T20:18:26.240879] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-06T20:18:26.240993] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-06T20:18:26.241064] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-06T20:18:26.641176] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:18:26.689614] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T20:18:27.025534] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-06T20:18:27.309305] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:18:27.309766] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-06T20:18:27.309865] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:18:27.309919] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-06T20:18:27.309954] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:18:27.309993] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-06T20:18:27.310055] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-06T20:18:27.310090] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-06T20:18:27.310130] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-06T20:18:27.310177] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSIF took 1.3s. Estimated remaining: 2h 15m 27s. Rate: 7.1 symbols/min [2025-10-06T20:18:27.452122] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T20:18:27.544245] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:18:27.581396] [DEBUG] [LOCAL ] MSM: Loaded 35994 existing records from primary storage. [2025-10-06T20:18:27.581758] [INFO ] [MAIN ] MSM: Loaded 35994 existing records. [2025-10-06T20:18:27.773228] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:18:27.773507] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-06T20:18:27.773564] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-06T20:18:27.773866] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-10-06T20:18:27.773925] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-06T20:18:27.830845] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-06T20:18:28.156705] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:18:28.625550] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-06T20:18:28.952085] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T20:18:29.425564] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-06T20:18:30.225580] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-06T20:18:30.348736] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T20:18:30.495099] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T20:18:31.025593] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-06T20:18:31.501726] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T20:18:31.825500] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-06T20:18:32.625607] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-06T20:18:32.701792] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T20:18:32.981814] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T20:18:32.984077] [INFO ] [REMOTE ] MSGS: Full fetch complete (23245 records). [2025-10-06T20:18:32.984194] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-06T20:18:33.363517] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-10-06T20:18:33.363601] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-10-06T20:18:33.364121] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-10-06T20:18:33.364183] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-10-06T20:18:33.364896] [DEBUG] [LOCAL ] MSGS: Trimmed 23245 records to 17394 (keeping 200 days of data) [2025-10-06T20:18:33.443722] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T20:18:33.438815] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-06T20:18:33.447397] [INFO ] [REMOTE ] MSD: Full fetch complete (22576 records). [2025-10-06T20:18:33.447805] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-06T20:18:33.449747] [FATAL] [VALIDATOR ] MSD: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:18:33.451148] [FATAL] [MAIN ] MSD: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:18:33.451530] [WARN ] [MAIN ] MSD: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:18:33.451861] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-06T20:18:33.452572] [DEBUG] [LOCAL ] MSD: No primary data file found to delete. [2025-10-06T20:18:33.456913] [INFO ] [LOCAL ] MSD: Starting deletion of derivative data. [2025-10-06T20:18:33.461710] [DEBUG] [LOCAL ] MSD: Deleted derivative data file. [2025-10-06T20:18:33.463474] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSD took 50.9s. Estimated remaining: 2h 15m 17s. Rate: 7.1 symbols/min [2025-10-06T20:18:33.588055] [DEBUG] [LOCAL ] MSGS: Primary data saved (17394 records). [2025-10-06T20:18:33.598444] [INFO ] [MAIN ] MSGS: Full history saved. [2025-10-06T20:18:33.603696] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSGS took 27.6s. Estimated remaining: 2h 15m 3s. Rate: 7.1 symbols/min [2025-10-06T20:18:33.741826] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:18:33.824767] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:18:33.896935] [DEBUG] [LOCAL ] MTAL: Loaded 37135 existing records from primary storage. [2025-10-06T20:18:33.898756] [INFO ] [MAIN ] MTAL: Loaded 37135 existing records. [2025-10-06T20:18:33.898269] [DEBUG] [LOCAL ] MT: Loaded 51346 existing records from primary storage. [2025-10-06T20:18:33.927010] [INFO ] [MAIN ] MT: Loaded 51346 existing records. [2025-10-06T20:18:34.195603] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:18:34.239750] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-10-06T20:18:34.234444] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-06T20:18:34.277365] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:18:34.262208] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-06T20:18:34.278014] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-06T20:18:34.278301] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-06T20:18:34.278826] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-10-06T20:18:34.278929] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-10-06T20:18:34.279136] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-06T20:18:34.279209] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-10-06T20:18:35.034401] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T20:18:35.096695] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:18:35.126227] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-06T20:18:35.157026] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:18:35.791796] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T20:18:35.825509] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-10-06T20:18:36.625510] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-06T20:18:36.897676] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T20:18:37.041527] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T20:18:37.425521] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-06T20:18:38.226046] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-10-06T20:18:38.229155] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T20:18:39.025496] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-06T20:18:39.373151] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-06T20:18:39.401103] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T20:18:39.825522] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-06T20:18:40.416784] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T20:18:40.625559] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-06T20:18:40.784277] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T20:18:41.425564] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-06T20:18:42.148489] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T20:18:42.225501] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-06T20:18:42.261774] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T20:18:43.025507] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-06T20:18:43.704910] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T20:18:43.825533] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-06T20:18:44.625497] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-06T20:18:44.903748] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-06T20:18:45.187482] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T20:18:45.425494] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-06T20:18:45.524880] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T20:18:46.225503] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-06T20:18:46.392837] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T20:18:47.025524] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-10-06T20:18:47.680201] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T20:18:47.825487] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-06T20:18:48.231479] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-06T20:18:48.398911] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T20:18:48.400900] [INFO ] [REMOTE ] MSI: Full fetch complete (57951 records). [2025-10-06T20:18:48.401003] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-06T20:18:48.401796] [FATAL] [VALIDATOR ] MSI: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:18:48.401888] [FATAL] [MAIN ] MSI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:18:48.401931] [WARN ] [MAIN ] MSI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:18:48.401976] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-06T20:18:48.402037] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-06T20:18:48.402071] [INFO ] [LOCAL ] MSI: Starting deletion of derivative data. [2025-10-06T20:18:48.402430] [DEBUG] [LOCAL ] MSI: Deleted derivative data file. [2025-10-06T20:18:48.402527] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSI took 37.8s. Estimated remaining: 2h 14m 59s. Rate: 7.1 symbols/min [2025-10-06T20:18:48.572081] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:18:48.626814] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-06T20:18:48.628917] [DEBUG] [LOCAL ] MTB: Loaded 47340 existing records from primary storage. [2025-10-06T20:18:48.629363] [INFO ] [MAIN ] MTB: Loaded 47340 existing records. [2025-10-06T20:18:48.823991] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:18:48.824261] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-06T20:18:48.824317] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-06T20:18:48.825418] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-10-06T20:18:48.825479] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-06T20:18:49.184957] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:18:49.425536] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-06T20:18:50.207051] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-06T20:18:50.225485] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-06T20:18:51.025567] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-10-06T20:18:51.389431] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-06T20:18:51.437090] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T20:18:51.439409] [INFO ] [REMOTE ] MSM: Full fetch complete (52091 records). [2025-10-06T20:18:51.439506] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-06T20:18:51.822189] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-10-06T20:18:51.822338] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-10-06T20:18:51.823744] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-10-06T20:18:51.823817] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-10-06T20:18:51.825582] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-06T20:18:51.826483] [DEBUG] [LOCAL ] MSM: Trimmed 52091 records to 35586 (keeping 200 days of data) [2025-10-06T20:18:52.083067] [DEBUG] [LOCAL ] MSM: Primary data saved (35586 records). [2025-10-06T20:18:52.083247] [INFO ] [MAIN ] MSM: Full history saved. [2025-10-06T20:18:52.083336] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MSM took 24.8s. Estimated remaining: 2h 14m 47s. Rate: 7.1 symbols/min [2025-10-06T20:18:52.255363] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:18:52.274967] [DEBUG] [LOCAL ] MTD: Loaded 15389 existing records from primary storage. [2025-10-06T20:18:52.275258] [INFO ] [MAIN ] MTD: Loaded 15389 existing records. [2025-10-06T20:18:52.468707] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:18:52.481315] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T20:18:52.481470] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-06T20:18:52.481602] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-06T20:18:52.488807] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-06T20:18:52.488868] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-06T20:18:52.630731] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-06T20:18:52.849636] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:18:53.425514] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-10-06T20:18:53.600041] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T20:18:53.966250] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-06T20:18:54.225539] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-06T20:18:54.676056] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-06T20:18:55.025500] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-10-06T20:18:55.172227] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T20:18:55.825522] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-06T20:18:56.515589] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-06T20:18:56.625490] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-10-06T20:18:57.425489] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-06T20:18:57.868336] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-06T20:18:58.122033] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-06T20:18:58.225492] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-06T20:18:58.456409] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T20:18:59.025557] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-06T20:18:59.825484] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-10-06T20:18:59.895369] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-06T20:19:00.095828] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-06T20:19:00.625527] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-06T20:19:01.398059] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T20:19:01.425478] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-06T20:19:01.509401] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T20:19:02.225526] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-06T20:19:02.326233] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T20:19:03.025537] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-06T20:19:03.825510] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-10-06T20:19:03.963333] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T20:19:04.000598] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T20:19:04.625533] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-06T20:19:05.257928] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T20:19:05.425521] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-06T20:19:05.879888] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T20:19:06.225511] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-06T20:19:06.832553] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T20:19:07.025482] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-06T20:19:07.280155] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-06T20:19:07.764772] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-06T20:19:07.825501] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-06T20:19:08.535112] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-06T20:19:08.625513] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-06T20:19:09.425499] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-10-06T20:19:09.518209] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T20:19:10.225499] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-06T20:19:10.944831] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T20:19:11.025485] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-10. [2025-10-06T20:19:11.133874] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T20:19:11.825540] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-06T20:19:12.228174] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T20:19:12.230758] [INFO ] [REMOTE ] MTAL: Full fetch complete (47977 records). [2025-10-06T20:19:12.230910] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-10-06T20:19:12.416771] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T20:19:12.502339] [INFO ] [REMOTE ] MTB: Full fetch complete (67701 records). [2025-10-06T20:19:12.519315] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-06T20:19:12.542944] [FATAL] [VALIDATOR ] MTB: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:19:12.558925] [FATAL] [MAIN ] MTB: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:19:12.564204] [WARN ] [MAIN ] MTB: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:19:12.571458] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-06T20:19:12.625566] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-06T20:19:12.623775] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-06T20:19:12.640029] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-10-06T20:19:12.641223] [INFO ] [LOCAL ] MTB: Starting deletion of derivative data. [2025-10-06T20:19:12.641361] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-10-06T20:19:12.642623] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-10-06T20:19:12.642879] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-10-06T20:19:12.643561] [DEBUG] [LOCAL ] MTB: Deleted derivative data file. [2025-10-06T20:19:12.643945] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MTB took 24.2s. Estimated remaining: 2h 14m 47s. Rate: 7.1 symbols/min [2025-10-06T20:19:12.716737] [DEBUG] [LOCAL ] MTAL: Trimmed 47977 records to 36676 (keeping 200 days of data) [2025-10-06T20:19:12.921436] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:19:13.060325] [DEBUG] [LOCAL ] MTDR: Loaded 52341 existing records from primary storage. [2025-10-06T20:19:13.062223] [INFO ] [MAIN ] MTDR: Loaded 52341 existing records. [2025-10-06T20:19:13.267373] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:19:13.279771] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-06T20:19:13.287086] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-06T20:19:13.286945] [DEBUG] [LOCAL ] MTAL: Primary data saved (36676 records). [2025-10-06T20:19:13.287356] [INFO ] [MAIN ] MTAL: Full history saved. [2025-10-06T20:19:13.287531] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-10-06T20:19:13.287712] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-06T20:19:13.287493] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MTAL took 39.7s. Estimated remaining: 2h 14m 33s. Rate: 7.1 symbols/min [2025-10-06T20:19:13.436454] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-06T20:19:13.657403] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:19:13.912680] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:19:13.950003] [DEBUG] [LOCAL ] MTG: Loaded 52017 existing records from primary storage. [2025-10-06T20:19:13.950441] [INFO ] [MAIN ] MTG: Loaded 52017 existing records. [2025-10-06T20:19:14.139199] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:19:14.139506] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-06T20:19:14.139558] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-06T20:19:14.139974] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-10-06T20:19:14.140032] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-06T20:19:14.230230] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-06T20:19:14.395667] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T20:19:14.536100] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:19:14.605711] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T20:19:15.025544] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-06T20:19:15.705920] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-06T20:19:15.825541] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-06T20:19:16.355351] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-06T20:19:16.625562] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-06T20:19:17.425514] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-06T20:19:17.603686] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T20:19:18.046524] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-06T20:19:18.153679] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T20:19:18.225477] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-06T20:19:19.025575] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-06T20:19:19.769512] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T20:19:19.772544] [INFO ] [REMOTE ] MT: Full fetch complete (73522 records). [2025-10-06T20:19:19.772719] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-06T20:19:19.833555] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-06T20:19:20.186543] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-10-06T20:19:20.186675] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-10-06T20:19:20.187877] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-10-06T20:19:20.187946] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-10-06T20:19:20.189491] [DEBUG] [LOCAL ] MT: Trimmed 73522 records to 50558 (keeping 200 days of data) [2025-10-06T20:19:20.510195] [DEBUG] [LOCAL ] MT: Primary data saved (50558 records). [2025-10-06T20:19:20.510385] [INFO ] [MAIN ] MT: Full history saved. [2025-10-06T20:19:20.511261] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MT took 47.0s. Estimated remaining: 2h 14m 24s. Rate: 7.1 symbols/min [2025-10-06T20:19:20.630619] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-06T20:19:20.684675] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:19:20.739033] [DEBUG] [LOCAL ] MTH: Loaded 44160 existing records from primary storage. [2025-10-06T20:19:20.739447] [INFO ] [MAIN ] MTH: Loaded 44160 existing records. [2025-10-06T20:19:20.989568] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:19:20.990012] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-06T20:19:20.990128] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-06T20:19:20.990696] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-10-06T20:19:20.990849] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-06T20:19:21.173172] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-06T20:19:21.429300] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-06T20:19:21.453539] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-06T20:19:21.600718] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:19:21.673818] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-06T20:19:22.225511] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-06T20:19:22.850879] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-06T20:19:22.914244] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T20:19:23.025561] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-06T20:19:23.825553] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-06T20:19:24.495075] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T20:19:24.602262] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T20:19:24.625490] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-06T20:19:25.425559] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-06T20:19:26.225534] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-06T20:19:26.336872] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T20:19:26.657624] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-06T20:19:26.659082] [INFO ] [REMOTE ] MTD: Full fetch complete (21027 records). [2025-10-06T20:19:26.659159] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-06T20:19:26.659809] [FATAL] [VALIDATOR ] MTD: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:19:26.659894] [FATAL] [MAIN ] MTD: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:19:26.659937] [WARN ] [MAIN ] MTD: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:19:26.659978] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-06T20:19:26.660042] [DEBUG] [LOCAL ] MTD: No primary data file found to delete. [2025-10-06T20:19:26.660076] [INFO ] [LOCAL ] MTD: Starting deletion of derivative data. [2025-10-06T20:19:26.660265] [DEBUG] [LOCAL ] MTD: Deleted derivative data file. [2025-10-06T20:19:26.660405] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTD took 34.6s. Estimated remaining: 2h 14m 14s. Rate: 7.1 symbols/min [2025-10-06T20:19:26.845803] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:19:26.903058] [DEBUG] [LOCAL ] MTN: Loaded 39695 existing records from primary storage. [2025-10-06T20:19:26.903484] [INFO ] [MAIN ] MTN: Loaded 39695 existing records. [2025-10-06T20:19:27.030711] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-06T20:19:27.104350] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:19:27.105561] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-06T20:19:27.105729] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-06T20:19:27.106727] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-10-06T20:19:27.106983] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-06T20:19:27.504273] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:19:27.539625] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-06T20:19:27.825543] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-06T20:19:28.625577] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-06T20:19:28.952897] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-06T20:19:29.425508] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-06T20:19:29.953115] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-06T20:19:30.123505] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T20:19:30.225513] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-06T20:19:31.031437] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-06T20:19:31.043815] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T20:19:31.825564] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-06T20:19:32.170373] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-06T20:19:32.625551] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-06T20:19:32.812329] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T20:19:33.312244] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-06T20:19:33.425503] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-06T20:19:34.225502] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-06T20:19:34.596106] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T20:19:35.025498] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-06T20:19:35.230665] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-06T20:19:35.825600] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-06T20:19:35.924585] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T20:19:36.625584] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-06T20:19:36.907733] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-06T20:19:37.425623] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-06T20:19:37.555525] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T20:19:38.225557] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-06T20:19:38.461467] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T20:19:39.025591] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-06T20:19:39.064075] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T20:19:39.825564] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-06T20:19:39.873070] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T20:19:40.316046] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T20:19:40.625584] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-06T20:19:41.061006] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-06T20:19:41.425593] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-06T20:19:42.225538] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-06T20:19:42.286245] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T20:19:43.025570] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-06T20:19:43.392634] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-06T20:19:43.825553] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-06T20:19:44.038201] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T20:19:44.625554] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-06T20:19:44.842318] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-06T20:19:45.425534] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-06T20:19:45.642362] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T20:19:46.225519] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-06T20:19:46.298212] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T20:19:47.025599] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-06T20:19:47.342510] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-06T20:19:47.516825] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T20:19:47.825525] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-06T20:19:48.625552] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-06T20:19:48.767131] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T20:19:49.425508] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-06T20:19:49.783063] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T20:19:50.215802] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T20:19:50.225469] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-06T20:19:50.737852] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T20:19:51.025519] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-06T20:19:51.588960] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T20:19:51.591372] [INFO ] [REMOTE ] MTH: Full fetch complete (63250 records). [2025-10-06T20:19:51.591467] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-06T20:19:51.830708] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-06T20:19:51.982422] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-10-06T20:19:51.982523] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-10-06T20:19:51.983564] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-10-06T20:19:51.983677] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-10-06T20:19:51.985168] [DEBUG] [LOCAL ] MTH: Trimmed 63250 records to 43591 (keeping 200 days of data) [2025-10-06T20:19:52.253391] [DEBUG] [LOCAL ] MTH: Primary data saved (43591 records). [2025-10-06T20:19:52.253568] [INFO ] [MAIN ] MTH: Full history saved. [2025-10-06T20:19:52.253752] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTH took 31.7s. Estimated remaining: 2h 14m 17s. Rate: 7.1 symbols/min [2025-10-06T20:19:52.463905] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:19:52.464106] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-06T20:19:52.464174] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-06T20:19:52.464440] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-06T20:19:52.464541] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-06T20:19:52.464686] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-06T20:19:52.464742] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-06T20:19:52.628388] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-06T20:19:52.642374] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T20:19:52.862134] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:19:53.425499] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-06T20:19:53.715538] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T20:19:53.849556] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T20:19:53.852614] [INFO ] [REMOTE ] MTDR: Full fetch complete (73639 records). [2025-10-06T20:19:53.852763] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-06T20:19:53.950935] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-06T20:19:54.230615] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-06T20:19:54.339006] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-10-06T20:19:54.339100] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-10-06T20:19:54.340313] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-10-06T20:19:54.340386] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-10-06T20:19:54.342005] [DEBUG] [LOCAL ] MTDR: Trimmed 73639 records to 51594 (keeping 200 days of data) [2025-10-06T20:19:54.703777] [DEBUG] [LOCAL ] MTDR: Primary data saved (51594 records). [2025-10-06T20:19:54.703951] [INFO ] [MAIN ] MTDR: Full history saved. [2025-10-06T20:19:54.704056] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTDR took 42.1s. Estimated remaining: 2h 14m 4s. Rate: 7.1 symbols/min [2025-10-06T20:19:54.902899] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:19:54.923173] [DEBUG] [LOCAL ] MTRN: Loaded 18300 existing records from primary storage. [2025-10-06T20:19:54.923467] [INFO ] [MAIN ] MTRN: Loaded 18300 existing records. [2025-10-06T20:19:55.030744] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-06T20:19:55.111062] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:19:55.111295] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-06T20:19:55.111361] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-06T20:19:55.111680] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-10-06T20:19:55.111742] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-06T20:19:55.493065] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:19:55.738977] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T20:19:55.742105] [INFO ] [REMOTE ] MTG: Full fetch complete (74050 records). [2025-10-06T20:19:55.742237] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-06T20:19:55.830792] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-06T20:19:56.153311] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-10-06T20:19:56.153407] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-10-06T20:19:56.154599] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-10-06T20:19:56.154692] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-10-06T20:19:56.156356] [DEBUG] [LOCAL ] MTG: Trimmed 74050 records to 51229 (keeping 200 days of data) [2025-10-06T20:19:56.485325] [DEBUG] [LOCAL ] MTG: Primary data saved (51229 records). [2025-10-06T20:19:56.485512] [INFO ] [MAIN ] MTG: Full history saved. [2025-10-06T20:19:56.485604] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTG took 43.2s. Estimated remaining: 2h 13m 52s. Rate: 7.1 symbols/min [2025-10-06T20:19:56.625595] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-06T20:19:56.656505] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:19:56.697577] [DEBUG] [LOCAL ] MTUS: Loaded 28494 existing records from primary storage. [2025-10-06T20:19:56.698080] [INFO ] [MAIN ] MTUS: Loaded 28494 existing records. [2025-10-06T20:19:56.888727] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:19:56.889530] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-06T20:19:56.889679] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-06T20:19:56.909619] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-10-06T20:19:56.909915] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-06T20:19:56.931980] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T20:19:56.944059] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-06T20:19:57.086450] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-06T20:19:57.297706] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:19:57.425516] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-06T20:19:58.225553] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-06T20:19:59.009063] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T20:19:59.025473] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-06T20:19:59.576932] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T20:19:59.579588] [INFO ] [REMOTE ] MTN: Full fetch complete (56323 records). [2025-10-06T20:19:59.579717] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-06T20:19:59.834029] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-06T20:19:59.964371] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-10-06T20:19:59.964463] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-10-06T20:19:59.965444] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-10-06T20:19:59.965599] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-10-06T20:19:59.966782] [DEBUG] [LOCAL ] MTN: Trimmed 56323 records to 39160 (keeping 200 days of data) [2025-10-06T20:20:00.221170] [DEBUG] [LOCAL ] MTN: Primary data saved (39160 records). [2025-10-06T20:20:00.221365] [INFO ] [MAIN ] MTN: Full history saved. [2025-10-06T20:20:00.221481] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTN took 33.6s. Estimated remaining: 2h 13m 40s. Rate: 7.1 symbols/min [2025-10-06T20:20:00.380989] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-06T20:20:00.417317] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:20:00.421099] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T20:20:00.455913] [DEBUG] [LOCAL ] MTW: Loaded 26848 existing records from primary storage. [2025-10-06T20:20:00.456214] [INFO ] [MAIN ] MTW: Loaded 26848 existing records. [2025-10-06T20:20:00.630898] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:20:00.631228] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-06T20:20:00.631296] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-06T20:20:00.627856] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-06T20:20:00.632824] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-10-06T20:20:00.632891] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-06T20:20:00.981110] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:20:01.312605] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-06T20:20:01.425564] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-06T20:20:02.225559] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-06T20:20:02.934059] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T20:20:03.025489] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-06T20:20:03.251980] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T20:20:03.825531] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-06T20:20:04.591018] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T20:20:04.625477] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-06T20:20:04.660790] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T20:20:05.425570] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-06T20:20:05.911006] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-06T20:20:05.946274] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-06T20:20:06.225588] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-06T20:20:07.025602] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-06T20:20:07.594738] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T20:20:07.825524] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-06T20:20:08.625577] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-06T20:20:08.661218] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T20:20:09.047880] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-06T20:20:09.079379] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-06T20:20:09.425566] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-06T20:20:10.225590] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-06T20:20:10.974197] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T20:20:11.025541] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-06T20:20:11.622486] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T20:20:11.825489] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-06T20:20:11.972246] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T20:20:12.625526] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-06T20:20:12.869548] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-06T20:20:13.425598] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-06T20:20:14.064415] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T20:20:14.225528] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-06T20:20:14.619089] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T20:20:15.025479] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-06T20:20:15.399160] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T20:20:15.825555] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-06T20:20:16.376446] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-06T20:20:16.625567] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-06T20:20:17.242101] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T20:20:17.425589] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-06T20:20:18.001992] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T20:20:18.225579] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-06T20:20:18.681698] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T20:20:19.025622] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-06T20:20:19.718256] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T20:20:19.767570] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T20:20:19.825545] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-06T20:20:20.625593] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-06T20:20:21.065326] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-06T20:20:21.176365] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-06T20:20:21.425550] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-06T20:20:22.225562] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-06T20:20:22.635934] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T20:20:23.025558] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-06T20:20:23.498636] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-06T20:20:23.717152] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T20:20:23.825521] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-06T20:20:24.625591] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-06T20:20:25.033393] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T20:20:25.425590] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-06T20:20:25.881882] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T20:20:26.159982] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T20:20:26.225500] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-06T20:20:27.025534] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-06T20:20:27.034761] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T20:20:27.036700] [INFO ] [REMOTE ] MTW: Full fetch complete (38359 records). [2025-10-06T20:20:27.036819] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-06T20:20:27.410315] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-10-06T20:20:27.410410] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-10-06T20:20:27.411266] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-10-06T20:20:27.411352] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-10-06T20:20:27.412385] [DEBUG] [LOCAL ] MTW: Trimmed 38359 records to 26466 (keeping 200 days of data) [2025-10-06T20:20:27.571545] [DEBUG] [LOCAL ] MTW: Primary data saved (26466 records). [2025-10-06T20:20:27.571737] [INFO ] [MAIN ] MTW: Full history saved. [2025-10-06T20:20:27.571841] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTW took 27.4s. Estimated remaining: 2h 13m 44s. Rate: 7.1 symbols/min [2025-10-06T20:20:27.743438] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:20:27.770559] [DEBUG] [LOCAL ] MTX: Loaded 23006 existing records from primary storage. [2025-10-06T20:20:27.770942] [INFO ] [MAIN ] MTX: Loaded 23006 existing records. [2025-10-06T20:20:27.834830] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-06T20:20:27.940567] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T20:20:27.964206] [INFO ] [REMOTE ] MTRN: Full fetch complete (23743 records). [2025-10-06T20:20:27.964037] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:20:27.964389] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-06T20:20:27.964541] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-06T20:20:27.964828] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-06T20:20:28.009122] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-10-06T20:20:28.042820] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-06T20:20:28.366282] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-06T20:20:28.630162] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-06T20:20:28.755129] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-10-06T20:20:28.760427] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-10-06T20:20:28.782390] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-10-06T20:20:28.800585] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-10-06T20:20:28.822505] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:20:28.824487] [DEBUG] [LOCAL ] MTRN: Trimmed 23743 records to 18041 (keeping 200 days of data) [2025-10-06T20:20:28.950958] [DEBUG] [LOCAL ] MTRN: Primary data saved (18041 records). [2025-10-06T20:20:28.951159] [INFO ] [MAIN ] MTRN: Full history saved. [2025-10-06T20:20:28.951271] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTRN took 34.2s. Estimated remaining: 2h 13m 31s. Rate: 7.1 symbols/min [2025-10-06T20:20:29.137751] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:20:29.189860] [DEBUG] [LOCAL ] MTZ: Loaded 43701 existing records from primary storage. [2025-10-06T20:20:29.190327] [INFO ] [MAIN ] MTZ: Loaded 43701 existing records. [2025-10-06T20:20:29.379109] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:20:29.379426] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-06T20:20:29.379479] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-06T20:20:29.379793] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-10-06T20:20:29.379855] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-06T20:20:29.435674] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-06T20:20:29.777112] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:20:30.000367] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T20:20:30.001176] [INFO ] [REMOTE ] MTR: Full fetch complete (2519 records). [2025-10-06T20:20:30.001304] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-06T20:20:30.200886] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T20:20:30.207328] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T20:20:30.213302] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:20:30.213823] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:20:30.213907] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-06T20:20:30.213989] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-06T20:20:30.214027] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-06T20:20:30.214065] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-06T20:20:30.214144] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTR took 38.0s. Estimated remaining: 2h 13m 18s. Rate: 7.1 symbols/min [2025-10-06T20:20:30.230638] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-06T20:20:30.396869] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:20:30.413594] [DEBUG] [LOCAL ] MUA: Loaded 12468 existing records from primary storage. [2025-10-06T20:20:30.413883] [INFO ] [MAIN ] MUA: Loaded 12468 existing records. [2025-10-06T20:20:30.598264] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:20:30.598518] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-06T20:20:30.598576] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-06T20:20:30.598783] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-06T20:20:30.598843] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-06T20:20:30.950082] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:20:31.025500] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-06T20:20:31.345439] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T20:20:31.347193] [INFO ] [REMOTE ] MTUS: Full fetch complete (42112 records). [2025-10-06T20:20:31.347266] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-06T20:20:31.720543] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-10-06T20:20:31.720630] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-10-06T20:20:31.721495] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-10-06T20:20:31.721546] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-10-06T20:20:31.722540] [DEBUG] [LOCAL ] MTUS: Trimmed 42112 records to 28073 (keeping 200 days of data) [2025-10-06T20:20:31.825838] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-06T20:20:31.912875] [DEBUG] [LOCAL ] MTUS: Primary data saved (28073 records). [2025-10-06T20:20:31.913051] [INFO ] [MAIN ] MTUS: Full history saved. [2025-10-06T20:20:31.913143] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MTUS took 35.4s. Estimated remaining: 2h 13m 5s. Rate: 7.1 symbols/min [2025-10-06T20:20:32.049599] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-06T20:20:32.102566] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:20:32.125700] [DEBUG] [LOCAL ] MUC: Loaded 20852 existing records from primary storage. [2025-10-06T20:20:32.126007] [INFO ] [MAIN ] MUC: Loaded 20852 existing records. [2025-10-06T20:20:32.308815] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:20:32.309075] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-06T20:20:32.309124] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-06T20:20:32.309466] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-10-06T20:20:32.309523] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-06T20:20:32.630633] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-06T20:20:32.683852] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:20:33.009511] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T20:20:33.425563] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-06T20:20:34.225512] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-06T20:20:34.302775] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T20:20:34.862788] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T20:20:34.993720] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T20:20:35.025479] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-06T20:20:35.825536] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-06T20:20:36.082554] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T20:20:36.625574] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-06T20:20:36.965793] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T20:20:37.425503] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-06T20:20:37.738470] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T20:20:38.225547] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-06T20:20:39.025514] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-06T20:20:39.156803] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T20:20:39.478000] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T20:20:39.825557] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-06T20:20:40.251782] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T20:20:40.625527] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-06T20:20:40.990378] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-06T20:20:41.425488] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-06T20:20:41.734335] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T20:20:42.225542] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-06T20:20:42.742834] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-06T20:20:43.025552] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-06T20:20:43.354132] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T20:20:43.825523] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-06T20:20:44.585400] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T20:20:44.625519] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-06T20:20:45.307891] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T20:20:45.425560] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-06T20:20:46.225510] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-06T20:20:46.433171] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T20:20:46.706084] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T20:20:46.863195] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-06T20:20:47.025513] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-06T20:20:47.825546] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-06T20:20:48.105312] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T20:20:48.625561] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-06T20:20:49.023922] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T20:20:49.425528] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-06T20:20:50.022726] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-06T20:20:50.225568] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-06T20:20:51.025499] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-06T20:20:51.115974] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T20:20:51.216380] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T20:20:51.825514] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-06T20:20:52.180010] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-06T20:20:52.625525] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-06T20:20:53.425498] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-06T20:20:53.540581] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T20:20:53.571696] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T20:20:54.225558] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-06T20:20:54.807613] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T20:20:55.025529] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-06T20:20:55.197098] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T20:20:55.740244] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T20:20:55.741748] [INFO ] [REMOTE ] MTX: Full fetch complete (31266 records). [2025-10-06T20:20:55.741883] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-06T20:20:55.830624] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-06T20:20:56.113519] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-10-06T20:20:56.113604] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-10-06T20:20:56.114304] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-10-06T20:20:56.114368] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-10-06T20:20:56.115139] [DEBUG] [LOCAL ] MTX: Trimmed 31266 records to 22651 (keeping 200 days of data) [2025-10-06T20:20:56.257178] [DEBUG] [LOCAL ] MTX: Primary data saved (22651 records). [2025-10-06T20:20:56.257329] [INFO ] [MAIN ] MTX: Full history saved. [2025-10-06T20:20:56.257426] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTX took 28.7s. Estimated remaining: 2h 13m 7s. Rate: 7.1 symbols/min [2025-10-06T20:20:56.423477] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:20:56.436603] [DEBUG] [LOCAL ] MUE: Loaded 12061 existing records from primary storage. [2025-10-06T20:20:56.436854] [INFO ] [MAIN ] MUE: Loaded 12061 existing records. [2025-10-06T20:20:56.612626] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:20:56.612917] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-06T20:20:56.612966] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-06T20:20:56.613322] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-06T20:20:56.613379] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-06T20:20:56.633559] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-06T20:20:56.672163] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T20:20:56.718435] [INFO ] [REMOTE ] MUA: Full fetch complete (18816 records). [2025-10-06T20:20:56.721763] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-06T20:20:57.274313] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:20:57.357355] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-06T20:20:57.357452] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-06T20:20:57.357895] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-06T20:20:57.357957] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-06T20:20:57.358620] [DEBUG] [LOCAL ] MUA: Trimmed 18816 records to 11964 (keeping 200 days of data) [2025-10-06T20:20:57.428700] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-06T20:20:57.436359] [DEBUG] [LOCAL ] MUA: Primary data saved (11964 records). [2025-10-06T20:20:57.436531] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-06T20:20:57.436622] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MUA took 27.2s. Estimated remaining: 2h 12m 54s. Rate: 7.1 symbols/min [2025-10-06T20:20:57.643271] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:20:57.701230] [DEBUG] [LOCAL ] MUFG: Loaded 53304 existing records from primary storage. [2025-10-06T20:20:57.701689] [INFO ] [MAIN ] MUFG: Loaded 53304 existing records. [2025-10-06T20:20:57.885085] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:20:57.897217] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-06T20:20:57.897782] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-06T20:20:57.897726] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T20:20:57.902219] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-10-06T20:20:57.902737] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-06T20:20:58.243819] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-06T20:20:58.256931] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:20:59.025502] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-06T20:20:59.057280] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T20:20:59.388698] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T20:20:59.653519] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-06T20:20:59.825518] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-06T20:21:00.625554] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-06T20:21:01.004630] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T20:21:01.425596] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-06T20:21:02.225547] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-06T20:21:02.342984] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T20:21:03.025527] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-06T20:21:03.349386] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-06T20:21:03.488096] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T20:21:03.825570] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-06T20:21:04.567504] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T20:21:04.625578] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-06T20:21:04.722240] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T20:21:05.425564] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-06T20:21:05.804685] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-06T20:21:06.225584] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-06T20:21:07.025540] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-06T20:21:07.306364] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T20:21:07.825561] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-06T20:21:07.848218] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-06T20:21:07.950492] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T20:21:08.625583] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-06T20:21:09.425498] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-06T20:21:09.605551] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T20:21:09.646595] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T20:21:10.225548] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-06T20:21:11.025535] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-06T20:21:11.119808] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T20:21:11.408393] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-06T20:21:11.825532] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-06T20:21:12.433981] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T20:21:12.436601] [INFO ] [REMOTE ] MTZ: Full fetch complete (63377 records). [2025-10-06T20:21:12.436734] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-06T20:21:12.635609] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-06T20:21:12.834809] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-10-06T20:21:12.834904] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-10-06T20:21:12.835991] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-10-06T20:21:12.836057] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-10-06T20:21:12.837441] [DEBUG] [LOCAL ] MTZ: Trimmed 63377 records to 43058 (keeping 200 days of data) [2025-10-06T20:21:13.101491] [DEBUG] [LOCAL ] MTZ: Primary data saved (43058 records). [2025-10-06T20:21:13.101803] [INFO ] [MAIN ] MTZ: Full history saved. [2025-10-06T20:21:13.107083] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MTZ took 44.2s. Estimated remaining: 2h 12m 50s. Rate: 7.1 symbols/min [2025-10-06T20:21:13.161369] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T20:21:13.299626] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:21:13.315983] [DEBUG] [LOCAL ] MUJ: Loaded 13667 existing records from primary storage. [2025-10-06T20:21:13.316239] [INFO ] [MAIN ] MUJ: Loaded 13667 existing records. [2025-10-06T20:21:13.430755] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-06T20:21:13.507429] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:21:13.507690] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-06T20:21:13.507771] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-06T20:21:13.508010] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-10-06T20:21:13.508067] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-06T20:21:13.876759] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:21:14.225500] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-06T20:21:14.465235] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-06T20:21:14.695708] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-06T20:21:15.025587] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-06T20:21:15.548196] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T20:21:15.825751] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-06T20:21:16.626574] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-06T20:21:16.626380] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T20:21:16.886211] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-06T20:21:17.425636] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-06T20:21:17.703957] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T20:21:17.705439] [INFO ] [REMOTE ] MUC: Full fetch complete (30238 records). [2025-10-06T20:21:17.705525] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-06T20:21:18.099663] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-06T20:21:18.099831] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-06T20:21:18.100551] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-06T20:21:18.100618] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-06T20:21:18.101470] [DEBUG] [LOCAL ] MUC: Trimmed 30238 records to 20520 (keeping 200 days of data) [2025-10-06T20:21:18.225604] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-06T20:21:18.230220] [DEBUG] [LOCAL ] MUC: Primary data saved (20520 records). [2025-10-06T20:21:18.230299] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-06T20:21:18.230456] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MUC took 46.3s. Estimated remaining: 2h 12m 39s. Rate: 7.1 symbols/min [2025-10-06T20:21:18.408242] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:21:18.418761] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T20:21:18.472615] [DEBUG] [LOCAL ] MUR: Loaded 53698 existing records from primary storage. [2025-10-06T20:21:18.473074] [INFO ] [MAIN ] MUR: Loaded 53698 existing records. [2025-10-06T20:21:18.655234] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:21:18.655575] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-06T20:21:18.655627] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-06T20:21:18.655883] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-10-06T20:21:18.655941] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-06T20:21:19.025190] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:21:19.025631] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-06T20:21:19.825521] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-06T20:21:20.230099] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-06T20:21:20.625527] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-06T20:21:20.731412] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T20:21:20.968344] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-06T20:21:21.425596] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-06T20:21:22.225603] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-06T20:21:22.601071] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-06T20:21:23.025596] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-06T20:21:23.318749] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T20:21:23.367554] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T20:21:23.825567] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-06T20:21:24.625591] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-06T20:21:25.064537] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-06T20:21:25.425509] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-06T20:21:25.550627] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T20:21:25.621009] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T20:21:26.096011] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-06T20:21:26.225495] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-06T20:21:27.025533] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-06T20:21:27.116921] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T20:21:27.825554] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-06T20:21:28.625522] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-06T20:21:28.906415] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T20:21:29.027488] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-06T20:21:29.430744] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-06T20:21:29.441519] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T20:21:30.225565] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-06T20:21:31.025539] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-06T20:21:31.327089] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T20:21:31.699061] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T20:21:31.825583] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-06T20:21:32.206524] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-06T20:21:32.482172] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T20:21:32.483558] [INFO ] [REMOTE ] MUE: Full fetch complete (16044 records). [2025-10-06T20:21:32.483667] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-06T20:21:32.630777] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-06T20:21:32.870625] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-06T20:21:32.870775] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-06T20:21:32.871460] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-06T20:21:32.871524] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-06T20:21:32.872404] [DEBUG] [LOCAL ] MUE: Trimmed 16044 records to 11982 (keeping 200 days of data) [2025-10-06T20:21:32.955449] [DEBUG] [LOCAL ] MUE: Primary data saved (11982 records). [2025-10-06T20:21:32.955696] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-06T20:21:32.955824] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUE took 36.7s. Estimated remaining: 2h 12m 35s. Rate: 7.1 symbols/min [2025-10-06T20:21:33.135266] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:21:33.176021] [DEBUG] [LOCAL ] MUSA: Loaded 24978 existing records from primary storage. [2025-10-06T20:21:33.176382] [INFO ] [MAIN ] MUSA: Loaded 24978 existing records. [2025-10-06T20:21:33.359923] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:21:33.360206] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-06T20:21:33.360266] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-06T20:21:33.360526] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-10-06T20:21:33.360584] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-06T20:21:33.434933] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-06T20:21:33.738295] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:21:34.225542] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-06T20:21:34.492673] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-06T20:21:34.674369] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-06T20:21:35.025576] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-06T20:21:35.825528] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-06T20:21:35.884528] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T20:21:35.887367] [INFO ] [REMOTE ] MUFG: Full fetch complete (75544 records). [2025-10-06T20:21:35.887464] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-06T20:21:36.276700] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-10-06T20:21:36.276793] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-10-06T20:21:36.277828] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-10-06T20:21:36.277915] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-10-06T20:21:36.279324] [DEBUG] [LOCAL ] MUFG: Trimmed 75544 records to 52522 (keeping 200 days of data) [2025-10-06T20:21:36.592779] [DEBUG] [LOCAL ] MUFG: Primary data saved (52522 records). [2025-10-06T20:21:36.592936] [INFO ] [MAIN ] MUFG: Full history saved. [2025-10-06T20:21:36.593048] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUFG took 39.2s. Estimated remaining: 2h 12m 23s. Rate: 7.1 symbols/min [2025-10-06T20:21:36.630794] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-06T20:21:36.765177] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:21:36.765379] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-06T20:21:36.765437] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-06T20:21:36.765548] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-06T20:21:36.765589] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-06T20:21:36.765736] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-06T20:21:36.765775] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-06T20:21:37.189389] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:21:37.196332] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-06T20:21:37.222512] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T20:21:37.425527] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-06T20:21:37.739281] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-06T20:21:37.838176] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T20:21:38.225547] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-06T20:21:39.025541] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-06T20:21:39.128860] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T20:21:39.825540] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-06T20:21:40.397252] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T20:21:40.625544] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-06T20:21:40.735489] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-06T20:21:40.737005] [INFO ] [REMOTE ] MUJ: Full fetch complete (20382 records). [2025-10-06T20:21:40.737079] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-06T20:21:40.994557] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:21:41.037301] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-06T20:21:41.051468] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:21:41.065977] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-06T20:21:41.082302] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:21:41.086220] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-06T20:21:41.086330] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-06T20:21:41.086868] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-06T20:21:41.102722] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-06T20:21:41.113135] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUSE took 4.5s. Estimated remaining: 2h 12m 12s. Rate: 7.1 symbols/min [2025-10-06T20:21:41.268464] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-06T20:21:41.290248] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-06T20:21:41.291460] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-06T20:21:41.291978] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-06T20:21:41.332997] [DEBUG] [LOCAL ] MUJ: Trimmed 20382 records to 13605 (keeping 200 days of data) [2025-10-06T20:21:41.401590] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:21:41.428359] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-06T20:21:41.471346] [DEBUG] [LOCAL ] MUJ: Primary data saved (13605 records). [2025-10-06T20:21:41.471614] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-06T20:21:41.471776] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUJ took 28.4s. Estimated remaining: 2h 11m 59s. Rate: 7.1 symbols/min [2025-10-06T20:21:41.589630] [DEBUG] [LOCAL ] MUX: Loaded 43578 existing records from primary storage. [2025-10-06T20:21:41.605932] [INFO ] [MAIN ] MUX: Loaded 43578 existing records. [2025-10-06T20:21:41.744516] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:21:41.872368] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:21:41.873033] [DEBUG] [LOCAL ] MVF: Loaded 13294 existing records from primary storage. [2025-10-06T20:21:41.873242] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-06T20:21:41.873489] [INFO ] [MAIN ] MVF: Loaded 13294 existing records. [2025-10-06T20:21:41.906021] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-06T20:21:41.945365] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-10-06T20:21:41.956086] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-06T20:21:42.230671] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-06T20:21:42.212287] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:21:42.230929] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-06T20:21:42.242421] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-06T20:21:42.259076] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-06T20:21:42.259196] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-06T20:21:42.597066] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:21:42.823928] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:21:42.840374] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T20:21:43.025586] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-06T20:21:43.825484] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-06T20:21:44.323922] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-06T20:21:44.359253] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-06T20:21:44.596878] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-06T20:21:44.625477] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-06T20:21:45.425543] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-06T20:21:45.585449] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T20:21:46.225591] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-06T20:21:47.025509] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-06T20:21:47.277520] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T20:21:47.656144] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T20:21:47.825522] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-06T20:21:48.392585] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T20:21:48.625535] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-06T20:21:49.425561] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-06T20:21:49.600013] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T20:21:49.665261] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T20:21:50.225577] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-06T20:21:50.826504] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T20:21:51.025541] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-06T20:21:51.677259] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T20:21:51.825531] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-06T20:21:51.959845] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T20:21:52.625527] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-06T20:21:53.232620] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T20:21:53.425563] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-06T20:21:53.747133] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T20:21:54.225590] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-06T20:21:54.684422] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T20:21:55.025499] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-06T20:21:55.264916] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T20:21:55.825529] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-06T20:21:56.250366] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T20:21:56.625546] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-06T20:21:57.396717] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-06T20:21:57.399727] [INFO ] [REMOTE ] MUR: Full fetch complete (76534 records). [2025-10-06T20:21:57.399844] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-06T20:21:57.430801] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-06T20:21:57.793887] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-10-06T20:21:57.794015] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-10-06T20:21:57.795106] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-10-06T20:21:57.795185] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-10-06T20:21:57.796701] [DEBUG] [LOCAL ] MUR: Trimmed 76534 records to 52925 (keeping 200 days of data) [2025-10-06T20:21:58.022172] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T20:21:58.136573] [DEBUG] [LOCAL ] MUR: Primary data saved (52925 records). [2025-10-06T20:21:58.136751] [INFO ] [MAIN ] MUR: Full history saved. [2025-10-06T20:21:58.136847] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUR took 39.9s. Estimated remaining: 2h 11m 56s. Rate: 7.1 symbols/min [2025-10-06T20:21:58.233221] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-06T20:21:58.306094] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:21:58.316532] [DEBUG] [LOCAL ] MVO: Loaded 9019 existing records from primary storage. [2025-10-06T20:21:58.316781] [INFO ] [MAIN ] MVO: Loaded 9019 existing records. [2025-10-06T20:21:58.495301] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:21:58.495539] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-06T20:21:58.495586] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-06T20:21:58.495943] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-06T20:21:58.496002] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-06T20:21:58.845949] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:21:58.960197] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-06T20:21:59.025604] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-06T20:21:59.310253] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T20:21:59.825592] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-06T20:21:59.954134] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T20:22:00.625525] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-06T20:22:01.425490] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-06T20:22:01.527910] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T20:22:01.843841] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T20:22:02.225620] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-06T20:22:02.353545] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T20:22:03.025722] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-06T20:22:03.800502] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T20:22:03.825488] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-06T20:22:03.960403] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T20:22:04.625532] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-06T20:22:05.216761] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-06T20:22:05.425539] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-06T20:22:05.650865] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T20:22:06.225545] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-06T20:22:07.025505] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-06T20:22:07.145230] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T20:22:07.168350] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-06T20:22:07.825484] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-06T20:22:08.051035] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T20:22:08.052693] [INFO ] [REMOTE ] MUSA: Full fetch complete (35155 records). [2025-10-06T20:22:08.052770] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-06T20:22:08.424003] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-10-06T20:22:08.424091] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-10-06T20:22:08.424827] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-10-06T20:22:08.424889] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-10-06T20:22:08.425678] [DEBUG] [LOCAL ] MUSA: Trimmed 35155 records to 24719 (keeping 200 days of data) [2025-10-06T20:22:08.582458] [DEBUG] [LOCAL ] MUSA: Primary data saved (24719 records). [2025-10-06T20:22:08.582620] [INFO ] [MAIN ] MUSA: Full history saved. [2025-10-06T20:22:08.582739] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MUSA took 35.6s. Estimated remaining: 2h 11m 48s. Rate: 7.1 symbols/min [2025-10-06T20:22:08.625911] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-06T20:22:08.782955] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:22:08.793732] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T20:22:08.809866] [DEBUG] [LOCAL ] MVT: Loaded 10367 existing records from primary storage. [2025-10-06T20:22:08.810219] [INFO ] [MAIN ] MVT: Loaded 10367 existing records. [2025-10-06T20:22:09.040743] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:22:09.041407] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-06T20:22:09.041486] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-06T20:22:09.042118] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-06T20:22:09.042180] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-06T20:22:09.415048] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:22:09.425473] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-06T20:22:10.225486] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-06T20:22:10.333174] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T20:22:10.365870] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T20:22:11.025531] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-06T20:22:11.061425] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-06T20:22:11.825579] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-06T20:22:12.625499] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-06T20:22:12.777739] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T20:22:12.984636] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T20:22:13.188419] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-06T20:22:13.425537] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-06T20:22:14.225510] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-06T20:22:14.399566] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-06T20:22:14.725971] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-06T20:22:15.025538] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-06T20:22:15.825568] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-06T20:22:15.952237] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T20:22:16.625591] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-06T20:22:17.283229] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T20:22:17.286838] [INFO ] [REMOTE ] MUX: Full fetch complete (59622 records). [2025-10-06T20:22:17.286939] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-06T20:22:17.427708] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-06T20:22:17.460857] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T20:22:17.700228] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-10-06T20:22:17.700321] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-10-06T20:22:17.701249] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-10-06T20:22:17.701313] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-10-06T20:22:17.702543] [DEBUG] [LOCAL ] MUX: Trimmed 59622 records to 42939 (keeping 200 days of data) [2025-10-06T20:22:17.945947] [DEBUG] [LOCAL ] MUX: Primary data saved (42939 records). [2025-10-06T20:22:17.946087] [INFO ] [MAIN ] MUX: Full history saved. [2025-10-06T20:22:17.946182] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MUX took 36.8s. Estimated remaining: 2h 11m 41s. Rate: 7.1 symbols/min [2025-10-06T20:22:18.112566] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:22:18.160712] [DEBUG] [LOCAL ] MWA: Loaded 47219 existing records from primary storage. [2025-10-06T20:22:18.161036] [INFO ] [MAIN ] MWA: Loaded 47219 existing records. [2025-10-06T20:22:18.230744] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-06T20:22:18.341896] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:22:18.342157] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-06T20:22:18.342203] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-06T20:22:18.343163] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-10-06T20:22:18.343223] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-06T20:22:18.632306] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T20:22:18.711562] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:22:19.025552] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-06T20:22:19.070153] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T20:22:19.071503] [INFO ] [REMOTE ] MVF: Full fetch complete (19033 records). [2025-10-06T20:22:19.071574] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-06T20:22:19.432585] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-06T20:22:19.432690] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-06T20:22:19.433112] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-06T20:22:19.433152] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-06T20:22:19.433729] [DEBUG] [LOCAL ] MVF: Trimmed 19033 records to 13103 (keeping 200 days of data) [2025-10-06T20:22:19.508099] [DEBUG] [LOCAL ] MVF: Primary data saved (13103 records). [2025-10-06T20:22:19.508248] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-06T20:22:19.508335] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MVF took 38.0s. Estimated remaining: 2h 11m 28s. Rate: 7.1 symbols/min [2025-10-06T20:22:19.825540] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-06T20:22:20.625495] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-06T20:22:20.761872] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-06T20:22:20.794305] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T20:22:21.425566] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-06T20:22:21.533396] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-06T20:22:22.225527] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-06T20:22:23.025542] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-06T20:22:23.047619] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T20:22:23.172454] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T20:22:23.825525] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-06T20:22:24.046899] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T20:22:24.625504] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-06T20:22:24.743538] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T20:22:25.425568] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-06T20:22:25.497343] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-06T20:22:26.225587] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-06T20:22:27.025559] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-06T20:22:27.080499] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-06T20:22:27.081908] [INFO ] [REMOTE ] MVO: Full fetch complete (14390 records). [2025-10-06T20:22:27.082038] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-06T20:22:27.345246] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-06T20:22:27.495048] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-06T20:22:27.495126] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-06T20:22:27.495387] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-06T20:22:27.495425] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-06T20:22:27.495902] [DEBUG] [LOCAL ] MVO: Trimmed 14390 records to 8813 (keeping 200 days of data) [2025-10-06T20:22:27.546090] [DEBUG] [LOCAL ] MVO: Primary data saved (8813 records). [2025-10-06T20:22:27.546210] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-06T20:22:27.546291] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MVO took 29.4s. Estimated remaining: 2h 11m 19s. Rate: 7.1 symbols/min [2025-10-06T20:22:27.825527] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-06T20:22:28.050138] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T20:22:28.625545] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-06T20:22:29.539057] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T20:22:29.542335] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-06T20:22:29.712846] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T20:22:30.167408] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T20:22:30.169731] [INFO ] [REMOTE ] MVT: Full fetch complete (14462 records). [2025-10-06T20:22:30.169896] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-06T20:22:30.233382] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-06T20:22:30.574296] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-06T20:22:30.574375] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-06T20:22:30.574762] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-06T20:22:30.574823] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-06T20:22:30.575315] [DEBUG] [LOCAL ] MVT: Trimmed 14462 records to 10263 (keeping 200 days of data) [2025-10-06T20:22:30.640495] [DEBUG] [LOCAL ] MVT: Primary data saved (10263 records). [2025-10-06T20:22:30.640619] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-06T20:22:30.640741] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVT took 22.1s. Estimated remaining: 2h 11m 7s. Rate: 7.1 symbols/min [2025-10-06T20:22:32.139998] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T20:22:32.150820] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-06T20:22:34.036247] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T20:22:34.046837] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-06T20:22:35.874750] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T20:22:35.886066] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-06T20:22:37.839931] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-06T20:22:37.849959] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-06T20:22:39.564198] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T20:22:39.577622] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-06T20:22:41.177479] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T20:22:41.186981] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-06T20:22:42.450855] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T20:22:42.453465] [INFO ] [REMOTE ] MWA: Full fetch complete (67699 records). [2025-10-06T20:22:42.453558] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-06T20:22:42.841008] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-10-06T20:22:42.841093] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-10-06T20:22:42.842088] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-10-06T20:22:42.842151] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-10-06T20:22:42.843489] [DEBUG] [LOCAL ] MWA: Trimmed 67699 records to 46357 (keeping 200 days of data) [2025-10-06T20:22:43.128936] [DEBUG] [LOCAL ] MWA: Primary data saved (46357 records). [2025-10-06T20:22:43.129143] [INFO ] [MAIN ] MWA: Full history saved. [2025-10-06T20:22:43.129293] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MWA took 25.2s. Estimated remaining: 2h 11m 1s. Rate: 7.1 symbols/min [2025-10-06T20:22:43.770853] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:22:43.770053] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:22:43.789770] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-06T20:22:43.791498] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:22:43.791626] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-06T20:22:43.803353] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-06T20:22:43.809082] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-06T20:22:43.834215] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-06T20:22:43.847090] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-06T20:22:43.913013] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:22:43.974969] [DEBUG] [LOCAL ] MX: Loaded 22993 existing records from primary storage. [2025-10-06T20:22:43.975544] [DEBUG] [LOCAL ] MXF: Loaded 5813 existing records from primary storage. [2025-10-06T20:22:43.981593] [INFO ] [MAIN ] MXF: Loaded 5813 existing records. [2025-10-06T20:22:44.008205] [INFO ] [MAIN ] MX: Loaded 22993 existing records. [2025-10-06T20:22:44.138774] [DEBUG] [LOCAL ] MYD: Loaded 13877 existing records from primary storage. [2025-10-06T20:22:44.186166] [INFO ] [MAIN ] MYD: Loaded 13877 existing records. [2025-10-06T20:22:44.674401] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:22:44.747985] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-06T20:22:44.772991] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-06T20:22:44.799450] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:22:44.814338] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-06T20:22:44.814604] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-06T20:22:44.814409] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-06T20:22:44.820474] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-06T20:22:44.813973] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:22:44.831103] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-06T20:22:44.846851] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-06T20:22:44.841533] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-06T20:22:44.880365] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-06T20:22:44.986672] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:22:45.025476] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-10-06T20:22:45.066941] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-06T20:22:45.066842] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-06T20:22:45.880013] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T20:22:45.929631] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-06T20:22:46.120591] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:22:46.147793] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:22:46.171838] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:22:46.165356] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-06T20:22:46.172277] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-06T20:22:46.172540] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-06T20:22:46.746135] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T20:22:46.747385] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-06T20:22:47.082008] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T20:22:47.084681] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-06T20:22:47.267959] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-06T20:22:47.269338] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-06T20:22:47.289098] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T20:22:47.293715] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-06T20:22:47.437158] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T20:22:47.442196] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-06T20:22:47.825555] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-06T20:22:47.826742] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-06T20:22:47.963466] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T20:22:47.966550] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-06T20:22:48.212147] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-06T20:22:48.213323] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-06T20:22:48.302438] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T20:22:48.305916] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-06T20:22:48.566321] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T20:22:48.569911] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-06T20:22:48.724760] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-06T20:22:48.725933] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-06T20:22:48.835108] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-06T20:22:48.837486] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-06T20:22:49.182173] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-06T20:22:49.425530] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-06T20:22:49.489525] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T20:22:49.573565] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-06T20:22:49.745720] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T20:22:49.882180] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-06T20:22:50.225573] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-06T20:22:50.881546] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-06T20:22:51.025548] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-06T20:22:51.825573] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-06T20:22:52.625580] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-06T20:22:53.425620] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-06T20:23:05.532704] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (12.11 seconds). [2025-10-06T20:23:05.537240] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-06T20:23:06.066781] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (14.24 seconds). [2025-10-06T20:23:06.072377] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-06T20:23:06.120188] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (15.09 seconds). [2025-10-06T20:23:06.123366] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-06T20:23:06.462684] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (13.84 seconds). [2025-10-06T20:23:06.463958] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-06T20:23:07.456528] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T20:23:07.464566] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-06T20:23:07.624494] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T20:23:07.625284] [INFO ] [REMOTE ] MXE: Full fetch complete (2642 records). [2025-10-06T20:23:07.625356] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-06T20:23:07.803601] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T20:23:07.804075] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:23:07.804454] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:23:07.804698] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-06T20:23:07.804847] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-06T20:23:07.804915] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-06T20:23:07.810180] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-06T20:23:07.818468] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXE took 24.7s. Estimated remaining: 2h 11m 3s. Rate: 7.1 symbols/min [2025-10-06T20:23:07.825147] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-06T20:23:07.916428] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-06T20:23:07.970266] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-06T20:23:07.993810] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-06T20:23:08.049242] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:23:08.074355] [DEBUG] [LOCAL ] MYE: Loaded 24865 existing records from primary storage. [2025-10-06T20:23:08.074630] [INFO ] [MAIN ] MYE: Loaded 24865 existing records. [2025-10-06T20:23:08.271901] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:23:08.272156] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-06T20:23:08.272242] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-06T20:23:08.272481] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-10-06T20:23:08.272545] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-06T20:23:08.701923] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:23:08.702274] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-06T20:23:08.834476] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-06T20:23:08.837631] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-06T20:23:09.077206] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T20:23:09.086866] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-06T20:23:09.098699] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T20:23:09.103479] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-06T20:23:09.444599] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-06T20:23:09.447636] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-06T20:23:09.825450] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T20:23:09.832039] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-06T20:23:10.039491] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T20:23:10.046913] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-06T20:23:10.047071] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T20:23:10.049460] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-06T20:23:10.367212] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T20:23:10.371545] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-06T20:23:10.728561] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T20:23:10.728718] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-06T20:23:10.735091] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-06T20:23:10.735331] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-06T20:23:11.085993] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T20:23:11.089302] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-06T20:23:11.340936] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T20:23:11.341634] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T20:23:11.342481] [INFO ] [REMOTE ] MXF: Full fetch complete (10198 records). [2025-10-06T20:23:11.346866] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-06T20:23:11.347243] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-06T20:23:11.741348] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T20:23:11.741614] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-06T20:23:11.746189] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-06T20:23:11.747304] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-06T20:23:11.747390] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-06T20:23:11.746980] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-06T20:23:11.748860] [DEBUG] [LOCAL ] MXF: Trimmed 10198 records to 5678 (keeping 200 days of data) [2025-10-06T20:23:11.788421] [DEBUG] [LOCAL ] MXF: Primary data saved (5678 records). [2025-10-06T20:23:11.788549] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-06T20:23:11.788630] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MXF took 28.7s. Estimated remaining: 2h 10m 52s. Rate: 7.1 symbols/min [2025-10-06T20:23:11.961811] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:23:11.988873] [DEBUG] [LOCAL ] MYI: Loaded 19693 existing records from primary storage. [2025-10-06T20:23:11.989158] [INFO ] [MAIN ] MYI: Loaded 19693 existing records. [2025-10-06T20:23:12.138353] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T20:23:12.181516] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-06T20:23:12.226798] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:23:12.227053] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-06T20:23:12.227106] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-06T20:23:12.227696] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-10-06T20:23:12.227767] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-06T20:23:12.638714] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:23:12.639161] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-06T20:23:12.755200] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T20:23:12.762011] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-06T20:23:13.145192] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T20:23:13.345972] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T20:23:13.425478] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-06T20:23:13.528832] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T20:23:13.672145] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T20:23:14.225547] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-06T20:23:14.592364] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T20:23:14.964261] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T20:23:14.965713] [INFO ] [REMOTE ] MYD: Full fetch complete (20737 records). [2025-10-06T20:23:14.965803] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-06T20:23:15.033586] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-06T20:23:15.359218] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-06T20:23:15.359314] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-06T20:23:15.359887] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-06T20:23:15.359952] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-06T20:23:15.360952] [DEBUG] [LOCAL ] MYD: Trimmed 20737 records to 13443 (keeping 200 days of data) [2025-10-06T20:23:15.444017] [DEBUG] [LOCAL ] MYD: Primary data saved (13443 records). [2025-10-06T20:23:15.444187] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-06T20:23:15.444273] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MYD took 32.3s. Estimated remaining: 2h 10m 40s. Rate: 7.1 symbols/min [2025-10-06T20:23:15.624317] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:23:15.637568] [DEBUG] [LOCAL ] MYN: Loaded 10083 existing records from primary storage. [2025-10-06T20:23:15.637841] [INFO ] [MAIN ] MYN: Loaded 10083 existing records. [2025-10-06T20:23:15.814317] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:23:15.814559] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-06T20:23:15.814621] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-06T20:23:15.815288] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-06T20:23:15.815352] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-06T20:23:15.835510] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-06T20:23:16.101943] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T20:23:16.124262] [INFO ] [REMOTE ] MX: Full fetch complete (31794 records). [2025-10-06T20:23:16.142181] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-06T20:23:16.261174] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:23:16.555171] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-06T20:23:16.555255] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-06T20:23:16.555956] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-06T20:23:16.556018] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-06T20:23:16.556751] [DEBUG] [LOCAL ] MX: Trimmed 31794 records to 22461 (keeping 200 days of data) [2025-10-06T20:23:16.637816] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-06T20:23:16.687536] [DEBUG] [LOCAL ] MX: Primary data saved (22461 records). [2025-10-06T20:23:16.687698] [INFO ] [MAIN ] MX: Full history saved. [2025-10-06T20:23:16.687794] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MX took 33.6s. Estimated remaining: 2h 10m 27s. Rate: 7.1 symbols/min [2025-10-06T20:23:16.857917] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:23:16.897530] [DEBUG] [LOCAL ] NABL: Loaded 39908 existing records from primary storage. [2025-10-06T20:23:16.897928] [INFO ] [MAIN ] NABL: Loaded 39908 existing records. [2025-10-06T20:23:17.082987] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:23:17.083236] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-06T20:23:17.083308] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-06T20:23:17.089442] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-10-06T20:23:17.094048] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-06T20:23:17.132202] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T20:23:17.430714] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-06T20:23:17.480287] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:23:17.928823] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-06T20:23:18.225522] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-06T20:23:18.587355] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T20:23:19.025610] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-06T20:23:19.713617] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T20:23:19.741030] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-06T20:23:19.825531] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-06T20:23:20.625564] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-06T20:23:21.304299] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-06T20:23:21.425541] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-06T20:23:21.929459] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-06T20:23:22.225590] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-06T20:23:22.716159] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-06T20:23:23.025601] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-06T20:23:23.799388] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T20:23:23.825527] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-06T20:23:24.020076] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T20:23:24.625579] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-06T20:23:25.425705] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-06T20:23:25.533108] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T20:23:25.979832] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T20:23:26.225582] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-06T20:23:26.756221] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T20:23:27.025548] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-06T20:23:27.113515] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-06T20:23:27.825525] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-06T20:23:28.074782] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T20:23:28.625535] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-06T20:23:29.422823] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T20:23:29.432346] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-06T20:23:29.474141] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-06T20:23:30.225565] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-06T20:23:30.359760] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T20:23:31.025532] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-06T20:23:31.503755] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T20:23:31.825528] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-06T20:23:32.024131] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-06T20:23:32.625581] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-06T20:23:32.994354] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T20:23:33.425556] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-06T20:23:34.225554] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-06T20:23:34.292358] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T20:23:34.325325] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T20:23:35.025510] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-06T20:23:35.157231] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T20:23:35.158964] [INFO ] [REMOTE ] MYE: Full fetch complete (36401 records). [2025-10-06T20:23:35.159059] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-06T20:23:35.562948] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-10-06T20:23:35.563123] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-10-06T20:23:35.563938] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-10-06T20:23:35.564005] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-10-06T20:23:35.565036] [DEBUG] [LOCAL ] MYE: Trimmed 36401 records to 24450 (keeping 200 days of data) [2025-10-06T20:23:35.719737] [DEBUG] [LOCAL ] MYE: Primary data saved (24450 records). [2025-10-06T20:23:35.719889] [INFO ] [MAIN ] MYE: Full history saved. [2025-10-06T20:23:35.719974] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYE took 27.9s. Estimated remaining: 2h 10m 26s. Rate: 7.1 symbols/min [2025-10-06T20:23:35.830725] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-06T20:23:35.893526] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:23:35.916953] [DEBUG] [LOCAL ] NAC: Loaded 25229 existing records from primary storage. [2025-10-06T20:23:35.917263] [INFO ] [MAIN ] NAC: Loaded 25229 existing records. [2025-10-06T20:23:36.098160] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:23:36.098423] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-06T20:23:36.098483] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-06T20:23:36.099162] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-10-06T20:23:36.099222] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-06T20:23:36.464782] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:23:36.625482] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-06T20:23:36.699764] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T20:23:36.984680] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T20:23:37.425568] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-06T20:23:37.914394] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T20:23:38.225544] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-06T20:23:38.886748] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T20:23:39.025479] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-06T20:23:39.329403] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T20:23:39.825479] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-06T20:23:40.052847] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T20:23:40.625535] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-06T20:23:40.964210] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-06T20:23:41.425532] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-06T20:23:41.916389] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-06T20:23:42.225541] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-06T20:23:42.931998] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T20:23:43.025624] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-06T20:23:43.558409] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T20:23:43.825550] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-06T20:23:43.957903] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T20:23:44.625594] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-06T20:23:45.122443] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-06T20:23:45.425597] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-06T20:23:46.194360] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T20:23:46.225503] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-06T20:23:46.507064] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T20:23:46.508933] [INFO ] [REMOTE ] MYI: Full fetch complete (29311 records). [2025-10-06T20:23:46.509157] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-06T20:23:46.882701] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-06T20:23:46.882791] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-06T20:23:46.883404] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-06T20:23:46.883455] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-06T20:23:46.884179] [DEBUG] [LOCAL ] MYI: Trimmed 29311 records to 19192 (keeping 200 days of data) [2025-10-06T20:23:47.002474] [DEBUG] [LOCAL ] MYI: Primary data saved (19192 records). [2025-10-06T20:23:47.002719] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-06T20:23:47.002835] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYI took 35.2s. Estimated remaining: 2h 10m 19s. Rate: 7.1 symbols/min [2025-10-06T20:23:47.032287] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-06T20:23:47.173172] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:23:47.217880] [DEBUG] [LOCAL ] NAD: Loaded 34402 existing records from primary storage. [2025-10-06T20:23:47.218227] [INFO ] [MAIN ] NAD: Loaded 34402 existing records. [2025-10-06T20:23:47.438244] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:23:47.438808] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-06T20:23:47.438869] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-06T20:23:47.439710] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-10-06T20:23:47.439795] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-06T20:23:47.547832] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T20:23:47.574368] [INFO ] [REMOTE ] NABL: Full fetch complete (56867 records). [2025-10-06T20:23:47.584957] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-06T20:23:47.846402] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-06T20:23:48.163795] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:23:48.219381] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T20:23:48.302159] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-10-06T20:23:48.302271] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-10-06T20:23:48.303315] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-10-06T20:23:48.303382] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-10-06T20:23:48.305144] [DEBUG] [LOCAL ] NABL: Trimmed 56867 records to 39223 (keeping 200 days of data) [2025-10-06T20:23:48.549468] [DEBUG] [LOCAL ] NABL: Primary data saved (39223 records). [2025-10-06T20:23:48.550092] [INFO ] [MAIN ] NABL: Full history saved. [2025-10-06T20:23:48.550200] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. NABL took 31.9s. Estimated remaining: 2h 10m 6s. Rate: 7.1 symbols/min [2025-10-06T20:23:48.630826] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-06T20:23:48.724771] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:23:48.736737] [DEBUG] [LOCAL ] NAN: Loaded 8941 existing records from primary storage. [2025-10-06T20:23:48.737016] [INFO ] [MAIN ] NAN: Loaded 8941 existing records. [2025-10-06T20:23:48.912499] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:23:48.912782] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-06T20:23:48.912833] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-06T20:23:48.913223] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-10-06T20:23:48.913281] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-06T20:23:49.275923] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:23:49.329503] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T20:23:49.425519] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-06T20:23:50.225500] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-06T20:23:50.398144] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T20:23:50.582406] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T20:23:51.025534] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-06T20:23:51.116180] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T20:23:51.825524] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-06T20:23:52.107324] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T20:23:52.625510] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-06T20:23:52.722770] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T20:23:53.425560] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-06T20:23:54.225527] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-06T20:23:54.296603] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T20:23:54.643213] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T20:23:55.025552] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-06T20:23:55.124591] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T20:23:55.825534] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-06T20:23:56.323540] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T20:23:56.367730] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T20:23:56.368910] [INFO ] [REMOTE ] MYN: Full fetch complete (15340 records). [2025-10-06T20:23:56.368996] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-06T20:23:56.632103] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-06T20:23:56.756799] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-06T20:23:56.756888] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-06T20:23:56.757229] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-06T20:23:56.757268] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-06T20:23:56.757923] [DEBUG] [LOCAL ] MYN: Trimmed 15340 records to 9928 (keeping 200 days of data) [2025-10-06T20:23:56.818287] [DEBUG] [LOCAL ] MYN: Primary data saved (9928 records). [2025-10-06T20:23:56.818454] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-06T20:23:56.818545] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. MYN took 41.4s. Estimated remaining: 2h 9m 58s. Rate: 7.1 symbols/min [2025-10-06T20:23:56.986434] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:23:57.033029] [DEBUG] [LOCAL ] NAT: Loaded 49921 existing records from primary storage. [2025-10-06T20:23:57.033398] [INFO ] [MAIN ] NAT: Loaded 49921 existing records. [2025-10-06T20:23:57.218806] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:23:57.219042] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-06T20:23:57.219090] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-06T20:23:57.219309] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-06T20:23:57.219365] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-06T20:23:57.435232] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-06T20:23:57.579373] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:23:57.890081] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T20:23:58.107587] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-06T20:23:58.225544] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-06T20:23:59.025535] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-06T20:23:59.557592] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T20:23:59.825507] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-06T20:24:00.026259] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T20:24:00.625511] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-06T20:24:01.224694] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T20:24:01.425528] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-06T20:24:01.570770] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-06T20:24:02.225625] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-06T20:24:03.025528] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-06T20:24:03.509610] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-06T20:24:03.743519] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T20:24:03.825506] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-06T20:24:04.065502] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-06T20:24:04.067242] [INFO ] [REMOTE ] NAC: Full fetch complete (36174 records). [2025-10-06T20:24:04.067318] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-06T20:24:04.447006] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-06T20:24:04.447090] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-06T20:24:04.447829] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-06T20:24:04.447923] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-06T20:24:04.448770] [DEBUG] [LOCAL ] NAC: Trimmed 36174 records to 24781 (keeping 200 days of data) [2025-10-06T20:24:04.601239] [DEBUG] [LOCAL ] NAC: Primary data saved (24781 records). [2025-10-06T20:24:04.601394] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-06T20:24:04.601476] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAC took 28.9s. Estimated remaining: 2h 9m 49s. Rate: 7.1 symbols/min [2025-10-06T20:24:04.631983] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-06T20:24:04.773396] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:24:04.805546] [DEBUG] [LOCAL ] NATL: Loaded 32994 existing records from primary storage. [2025-10-06T20:24:04.805857] [INFO ] [MAIN ] NATL: Loaded 32994 existing records. [2025-10-06T20:24:05.018728] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:24:05.019003] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-06T20:24:05.019089] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-06T20:24:05.019327] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-10-06T20:24:05.019386] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-06T20:24:05.457728] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:24:05.457821] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-06T20:24:05.478698] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T20:24:06.225503] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-06T20:24:06.429370] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T20:24:06.736105] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-06T20:24:07.025547] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-06T20:24:07.766110] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T20:24:07.764985] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T20:24:07.825471] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-06T20:24:08.625511] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-06T20:24:08.783826] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T20:24:09.425566] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-06T20:24:10.225531] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-06T20:24:10.451979] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T20:24:10.914678] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T20:24:11.025531] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-06T20:24:11.709433] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T20:24:11.825559] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-06T20:24:12.587452] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T20:24:12.625550] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-06T20:24:13.425571] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-06T20:24:13.784433] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T20:24:14.225605] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-06T20:24:14.714621] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-06T20:24:14.783142] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T20:24:15.025536] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-06T20:24:15.825503] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-06T20:24:16.191304] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T20:24:16.192967] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-06T20:24:16.204934] [INFO ] [REMOTE ] NAD: Full fetch complete (49653 records). [2025-10-06T20:24:16.205433] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-06T20:24:16.588120] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-06T20:24:16.588226] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-06T20:24:16.589150] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-06T20:24:16.589270] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-06T20:24:16.590569] [DEBUG] [LOCAL ] NAD: Trimmed 49653 records to 33873 (keeping 200 days of data) [2025-10-06T20:24:16.653568] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-06T20:24:16.813943] [DEBUG] [LOCAL ] NAD: Primary data saved (33873 records). [2025-10-06T20:24:16.814086] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-06T20:24:16.814169] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NAD took 29.8s. Estimated remaining: 2h 9m 43s. Rate: 7.1 symbols/min [2025-10-06T20:24:17.021554] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:24:17.028112] [DEBUG] [LOCAL ] NAZ: Loaded 2674 existing records from primary storage. [2025-10-06T20:24:17.028446] [INFO ] [MAIN ] NAZ: Loaded 2674 existing records. [2025-10-06T20:24:17.157228] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T20:24:17.241775] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:24:17.241992] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-06T20:24:17.242039] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-06T20:24:17.242194] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-06T20:24:17.242250] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-06T20:24:17.435502] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-06T20:24:17.591578] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:24:18.225581] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-06T20:24:18.601261] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T20:24:18.681935] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-06T20:24:18.930257] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-06T20:24:19.025502] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-06T20:24:19.616979] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-06T20:24:19.825531] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-06T20:24:20.625496] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-06T20:24:20.703034] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T20:24:21.425592] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-06T20:24:22.226015] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-06T20:24:23.025624] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-06T20:24:23.624465] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T20:24:23.626569] [INFO ] [REMOTE ] NAN: Full fetch complete (13805 records). [2025-10-06T20:24:23.626709] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-06T20:24:23.760802] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-06T20:24:23.826537] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-06T20:24:24.009534] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (3.38 seconds). [2025-10-06T20:24:24.102166] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-06T20:24:24.102265] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-06T20:24:24.102625] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-06T20:24:24.102721] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-06T20:24:24.103372] [DEBUG] [LOCAL ] NAN: Trimmed 13805 records to 8534 (keeping 200 days of data) [2025-10-06T20:24:24.156785] [DEBUG] [LOCAL ] NAN: Primary data saved (8534 records). [2025-10-06T20:24:24.156947] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-06T20:24:24.157050] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAN took 35.6s. Estimated remaining: 2h 9m 33s. Rate: 7.1 symbols/min [2025-10-06T20:24:24.340397] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:24:24.353103] [DEBUG] [LOCAL ] NBB: Loaded 9215 existing records from primary storage. [2025-10-06T20:24:24.353366] [INFO ] [MAIN ] NBB: Loaded 9215 existing records. [2025-10-06T20:24:24.469029] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-06T20:24:24.547669] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:24:24.548391] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-06T20:24:24.548450] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-06T20:24:24.576385] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-06T20:24:24.576516] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-06T20:24:24.643089] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (3.22 seconds). [2025-10-06T20:24:24.630809] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-06T20:24:24.953015] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:24:25.425526] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-06T20:24:26.048948] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T20:24:26.225532] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-06T20:24:27.025504] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-06T20:24:27.285237] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-06T20:24:27.637032] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-06T20:24:27.765390] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T20:24:27.825500] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-06T20:24:28.625494] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-06T20:24:28.775298] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-06T20:24:29.425567] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-06T20:24:29.865001] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-06T20:24:30.225580] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-06T20:24:31.025491] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-06T20:24:31.172265] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T20:24:31.189482] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T20:24:31.825572] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-06T20:24:32.565714] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T20:24:32.625514] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-06T20:24:32.684065] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T20:24:33.425532] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-06T20:24:34.144394] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T20:24:34.225527] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-06T20:24:34.888393] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T20:24:35.025525] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-06T20:24:35.152182] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T20:24:35.154141] [INFO ] [REMOTE ] NATL: Full fetch complete (45437 records). [2025-10-06T20:24:35.154215] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-06T20:24:35.528590] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-10-06T20:24:35.528739] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-10-06T20:24:35.529603] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-10-06T20:24:35.529687] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-10-06T20:24:35.530739] [DEBUG] [LOCAL ] NATL: Trimmed 45437 records to 32488 (keeping 200 days of data) [2025-10-06T20:24:35.719725] [DEBUG] [LOCAL ] NATL: Primary data saved (32488 records). [2025-10-06T20:24:35.719872] [INFO ] [MAIN ] NATL: Full history saved. [2025-10-06T20:24:35.719956] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NATL took 31.1s. Estimated remaining: 2h 9m 27s. Rate: 7.1 symbols/min [2025-10-06T20:24:35.830695] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-06T20:24:35.890307] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:24:35.914386] [DEBUG] [LOCAL ] NBHC: Loaded 23679 existing records from primary storage. [2025-10-06T20:24:35.914692] [INFO ] [MAIN ] NBHC: Loaded 23679 existing records. [2025-10-06T20:24:36.101829] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:24:36.102084] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-06T20:24:36.102132] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-06T20:24:36.102759] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-10-06T20:24:36.102817] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-06T20:24:36.470878] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:24:36.625499] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-06T20:24:36.729289] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-06T20:24:36.889352] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-06T20:24:37.335488] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-06T20:24:37.425523] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-06T20:24:37.987291] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-06T20:24:38.225524] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-06T20:24:39.025550] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-06T20:24:39.270583] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T20:24:39.825544] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-06T20:24:40.524808] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T20:24:40.527946] [INFO ] [REMOTE ] NAT: Full fetch complete (72097 records). [2025-10-06T20:24:40.528077] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-06T20:24:40.628945] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-06T20:24:40.928073] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-06T20:24:40.928315] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-06T20:24:40.929482] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-06T20:24:40.929549] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-06T20:24:40.931089] [DEBUG] [LOCAL ] NAT: Trimmed 72097 records to 49148 (keeping 200 days of data) [2025-10-06T20:24:41.114239] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-06T20:24:41.252884] [DEBUG] [LOCAL ] NAT: Primary data saved (49148 records). [2025-10-06T20:24:41.253040] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-06T20:24:41.253129] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NAT took 44.4s. Estimated remaining: 2h 9m 17s. Rate: 7.1 symbols/min [2025-10-06T20:24:41.358831] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T20:24:41.428708] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:24:41.428773] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-06T20:24:41.464724] [DEBUG] [LOCAL ] NBR: Loaded 34980 existing records from primary storage. [2025-10-06T20:24:41.465022] [INFO ] [MAIN ] NBR: Loaded 34980 existing records. [2025-10-06T20:24:41.641056] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:24:41.641291] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-06T20:24:41.641337] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-06T20:24:41.642079] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-10-06T20:24:41.642139] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-06T20:24:41.995949] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:24:42.058472] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-06T20:24:42.225545] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-06T20:24:43.025537] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-06T20:24:43.762504] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T20:24:43.825469] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-06T20:24:44.218790] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T20:24:44.625588] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-06T20:24:45.262236] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T20:24:45.336842] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-06T20:24:45.425503] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-06T20:24:46.225496] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-06T20:24:46.384227] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T20:24:46.761151] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T20:24:46.761954] [INFO ] [REMOTE ] NAZ: Full fetch complete (4370 records). [2025-10-06T20:24:46.762022] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-06T20:24:47.033958] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-06T20:24:47.154519] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-06T20:24:47.154600] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-06T20:24:47.154785] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-06T20:24:47.154854] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-06T20:24:47.155223] [DEBUG] [LOCAL ] NAZ: Trimmed 4370 records to 2663 (keeping 200 days of data) [2025-10-06T20:24:47.172222] [DEBUG] [LOCAL ] NAZ: Primary data saved (2663 records). [2025-10-06T20:24:47.172307] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-06T20:24:47.172380] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NAZ took 30.4s. Estimated remaining: 2h 9m 7s. Rate: 7.1 symbols/min [2025-10-06T20:24:47.342273] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:24:47.342550] [DEBUG] [LOCAL ] NBXG: No existing data file found in primary storage. [2025-10-06T20:24:47.342602] [WARN ] [MAIN ] NBXG: No existing data found, performing full refresh instead. [2025-10-06T20:24:47.342765] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-06T20:24:47.342823] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-06T20:24:47.342867] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-06T20:24:47.342900] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-06T20:24:47.699018] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:24:47.825491] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-06T20:24:48.554224] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T20:24:48.625476] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-06T20:24:49.041143] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T20:24:49.425591] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-06T20:24:50.166688] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T20:24:50.225473] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-06T20:24:50.593773] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-06T20:24:51.025592] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-06T20:24:51.825502] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-06T20:24:51.861960] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-06T20:24:51.861601] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T20:24:52.625624] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-06T20:24:53.067713] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T20:24:53.176159] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-06T20:24:53.425520] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-06T20:24:54.225583] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-06T20:24:55.025507] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-06T20:24:55.106355] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T20:24:55.167384] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-06T20:24:55.825720] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-06T20:24:55.900737] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-06T20:24:56.625559] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-06T20:24:57.180261] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T20:24:57.425512] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-06T20:24:57.479485] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T20:24:58.225502] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-06T20:24:58.272487] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T20:24:59.025542] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-06T20:24:59.228176] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-06T20:24:59.825536] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-06T20:24:59.863065] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T20:25:00.625588] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-06T20:25:01.361979] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T20:25:01.412129] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-06T20:25:01.425483] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-06T20:25:02.225557] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-06T20:25:02.705132] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-06T20:25:03.025557] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-06T20:25:03.203142] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T20:25:03.674417] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T20:25:03.675619] [INFO ] [REMOTE ] NBB: Full fetch complete (13813 records). [2025-10-06T20:25:03.675725] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-06T20:25:03.830598] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-06T20:25:04.061091] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-06T20:25:04.061173] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-06T20:25:04.061481] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-06T20:25:04.061519] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-06T20:25:04.062048] [DEBUG] [LOCAL ] NBB: Trimmed 13813 records to 9119 (keeping 200 days of data) [2025-10-06T20:25:04.119584] [DEBUG] [LOCAL ] NBB: Primary data saved (9119 records). [2025-10-06T20:25:04.119782] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-06T20:25:04.119901] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NBB took 40.0s. Estimated remaining: 2h 9m 4s. Rate: 7.1 symbols/min [2025-10-06T20:25:04.299610] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:25:04.303132] [DEBUG] [LOCAL ] NC: Loaded 1954 existing records from primary storage. [2025-10-06T20:25:04.303281] [INFO ] [MAIN ] NC: Loaded 1954 existing records. [2025-10-06T20:25:04.488383] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:25:04.489011] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-06T20:25:04.489099] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-06T20:25:04.489586] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-06T20:25:04.489744] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-06T20:25:04.630626] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-06T20:25:04.855636] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:25:05.258055] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T20:25:05.425590] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-06T20:25:06.093554] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T20:25:06.225557] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-06T20:25:07.025580] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-06T20:25:07.089070] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T20:25:07.546543] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T20:25:07.825542] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-06T20:25:08.223555] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T20:25:08.440812] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-06T20:25:08.625571] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-06T20:25:09.425499] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-06T20:25:09.798101] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T20:25:10.225497] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-06T20:25:10.435901] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T20:25:10.437790] [INFO ] [REMOTE ] NBHC: Full fetch complete (32432 records). [2025-10-06T20:25:10.437928] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-06T20:25:10.819684] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-10-06T20:25:10.819818] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-10-06T20:25:10.820513] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-10-06T20:25:10.820559] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-10-06T20:25:10.821594] [DEBUG] [LOCAL ] NBHC: Trimmed 32432 records to 23384 (keeping 200 days of data) [2025-10-06T20:25:10.886560] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-06T20:25:10.973401] [DEBUG] [LOCAL ] NBHC: Primary data saved (23384 records). [2025-10-06T20:25:10.973563] [INFO ] [MAIN ] NBHC: Full history saved. [2025-10-06T20:25:10.973675] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NBHC took 35.3s. Estimated remaining: 2h 8m 54s. Rate: 7.1 symbols/min [2025-10-06T20:25:11.030675] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-06T20:25:11.152527] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:25:11.163504] [DEBUG] [LOCAL ] NCA: Loaded 10346 existing records from primary storage. [2025-10-06T20:25:11.163758] [INFO ] [MAIN ] NCA: Loaded 10346 existing records. [2025-10-06T20:25:11.341912] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:25:11.342119] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-06T20:25:11.342167] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-06T20:25:11.342564] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-06T20:25:11.342624] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-06T20:25:11.682410] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-06T20:25:11.713419] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:25:11.825495] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-06T20:25:12.625535] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-06T20:25:12.949381] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T20:25:13.425537] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-06T20:25:13.562507] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-06T20:25:14.225566] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-06T20:25:14.934096] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T20:25:15.025483] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-06T20:25:15.174391] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T20:25:15.825576] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-06T20:25:16.337457] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T20:25:16.339478] [INFO ] [REMOTE ] NBR: Full fetch complete (49535 records). [2025-10-06T20:25:16.339557] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-06T20:25:16.437541] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T20:25:16.630685] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-06T20:25:16.748490] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-10-06T20:25:16.748568] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-10-06T20:25:16.749402] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-10-06T20:25:16.749465] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-10-06T20:25:16.750470] [DEBUG] [LOCAL ] NBR: Trimmed 49535 records to 34410 (keeping 200 days of data) [2025-10-06T20:25:16.951242] [DEBUG] [LOCAL ] NBR: Primary data saved (34410 records). [2025-10-06T20:25:16.951387] [INFO ] [MAIN ] NBR: Full history saved. [2025-10-06T20:25:16.951470] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBR took 35.7s. Estimated remaining: 2h 8m 44s. Rate: 7.1 symbols/min [2025-10-06T20:25:17.125065] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:25:17.147143] [DEBUG] [LOCAL ] NCDL: Loaded 21949 existing records from primary storage. [2025-10-06T20:25:17.147396] [INFO ] [MAIN ] NCDL: Loaded 21949 existing records. [2025-10-06T20:25:17.326270] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:25:17.326498] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-06T20:25:17.326573] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-06T20:25:17.327446] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-10-06T20:25:17.327512] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-06T20:25:17.431042] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-06T20:25:17.690749] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:25:17.703555] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T20:25:18.170504] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T20:25:18.225537] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-06T20:25:19.025574] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-06T20:25:19.155160] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T20:25:19.825561] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-06T20:25:20.428546] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T20:25:20.537716] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-06T20:25:20.625534] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-06T20:25:21.425518] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-06T20:25:21.831997] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T20:25:22.225538] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-06T20:25:22.580252] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T20:25:22.883268] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-06T20:25:23.025517] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-06T20:25:23.825485] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-06T20:25:24.143064] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T20:25:24.222789] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-06T20:25:24.625589] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-06T20:25:25.160678] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-06T20:25:25.425505] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-06T20:25:26.225564] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-06T20:25:26.494588] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T20:25:27.025558] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-06T20:25:27.613737] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T20:25:27.825520] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-06T20:25:27.935875] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-06T20:25:28.625551] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-06T20:25:29.138047] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-06T20:25:29.214446] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-06T20:25:29.425528] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-06T20:25:30.225553] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-06T20:25:30.679474] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T20:25:31.025490] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-06T20:25:31.138976] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-06T20:25:31.140548] [INFO ] [REMOTE ] NBXG: Full fetch complete (32960 records). [2025-10-06T20:25:31.140621] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-06T20:25:31.523067] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-10-06T20:25:31.523167] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-10-06T20:25:31.523902] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-10-06T20:25:31.523965] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-10-06T20:25:31.524779] [DEBUG] [LOCAL ] NBXG: Trimmed 32960 records to 22167 (keeping 200 days of data) [2025-10-06T20:25:31.667371] [DEBUG] [LOCAL ] NBXG: Primary data saved (22167 records). [2025-10-06T20:25:31.667512] [INFO ] [MAIN ] NBXG: Full history saved. [2025-10-06T20:25:31.667630] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NBXG took 44.5s. Estimated remaining: 2h 8m 40s. Rate: 7.1 symbols/min [2025-10-06T20:25:31.837594] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-06T20:25:31.840211] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:25:31.841115] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-06T20:25:31.841170] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-06T20:25:31.841277] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-06T20:25:31.841319] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-06T20:25:31.841361] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-06T20:25:31.841393] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-06T20:25:32.207280] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:25:32.249453] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T20:25:32.625538] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-06T20:25:32.796259] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T20:25:33.425508] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-06T20:25:34.225549] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-06T20:25:34.294094] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T20:25:34.970148] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-06T20:25:35.025475] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-06T20:25:35.825520] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-06T20:25:36.625518] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-06T20:25:36.709798] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T20:25:37.074605] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T20:25:37.425488] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-06T20:25:37.584738] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T20:25:38.225497] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-06T20:25:38.416064] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T20:25:38.926048] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T20:25:38.927056] [INFO ] [REMOTE ] NCA: Full fetch complete (15494 records). [2025-10-06T20:25:38.927126] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-06T20:25:39.029230] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-06T20:25:39.021121] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (4.80 seconds). [2025-10-06T20:25:39.297015] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-06T20:25:39.297108] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-06T20:25:39.297491] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-06T20:25:39.297567] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-06T20:25:39.298137] [DEBUG] [LOCAL ] NCA: Trimmed 15494 records to 10104 (keeping 200 days of data) [2025-10-06T20:25:39.359115] [DEBUG] [LOCAL ] NCA: Primary data saved (10104 records). [2025-10-06T20:25:39.359254] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-06T20:25:39.359341] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NCA took 28.4s. Estimated remaining: 2h 8m 31s. Rate: 7.1 symbols/min [2025-10-06T20:25:39.531942] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:25:39.547534] [DEBUG] [LOCAL ] NCV: Loaded 13987 existing records from primary storage. [2025-10-06T20:25:39.547822] [INFO ] [MAIN ] NCV: Loaded 13987 existing records. [2025-10-06T20:25:39.724607] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:25:39.725459] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-06T20:25:39.725540] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-06T20:25:39.725982] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-06T20:25:39.726040] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-06T20:25:39.831872] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-06T20:25:40.099906] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:25:40.362064] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-06T20:25:40.511185] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-06T20:25:40.625503] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-06T20:25:41.105544] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T20:25:41.106280] [INFO ] [REMOTE ] NC: Full fetch complete (2728 records). [2025-10-06T20:25:41.106350] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-06T20:25:41.434953] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-06T20:25:41.482249] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-06T20:25:41.482400] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-06T20:25:41.482534] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-06T20:25:41.482598] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-06T20:25:41.483007] [DEBUG] [LOCAL ] NC: Trimmed 2728 records to 1932 (keeping 200 days of data) [2025-10-06T20:25:41.495584] [DEBUG] [LOCAL ] NC: Primary data saved (1932 records). [2025-10-06T20:25:41.495688] [INFO ] [MAIN ] NC: Full history saved. [2025-10-06T20:25:41.495778] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NC took 37.4s. Estimated remaining: 2h 8m 18s. Rate: 7.1 symbols/min [2025-10-06T20:25:41.664773] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:25:41.680302] [DEBUG] [LOCAL ] NCZ: Loaded 12247 existing records from primary storage. [2025-10-06T20:25:41.680541] [INFO ] [MAIN ] NCZ: Loaded 12247 existing records. [2025-10-06T20:25:41.857618] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:25:41.857858] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-06T20:25:41.857944] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-06T20:25:41.858294] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-06T20:25:41.858351] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-06T20:25:42.224158] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:25:42.225480] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-06T20:25:42.430533] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-06T20:25:43.025520] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-06T20:25:43.325951] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T20:25:43.825488] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-06T20:25:44.198214] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T20:25:44.625502] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-06T20:25:44.941305] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T20:25:45.425541] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-06T20:25:45.861789] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T20:25:46.225607] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-06T20:25:46.809807] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T20:25:47.025535] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-06T20:25:47.374454] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T20:25:47.825548] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-06T20:25:47.982441] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-06T20:25:48.625738] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-06T20:25:48.943431] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T20:25:49.425607] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-06T20:25:49.773101] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T20:25:50.225580] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-06T20:25:50.714164] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-06T20:25:51.025492] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-06T20:25:51.181122] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T20:25:51.825484] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-06T20:25:52.137512] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T20:25:52.625511] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-06T20:25:52.798875] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T20:25:53.425505] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-06T20:25:53.635596] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-06T20:25:54.225513] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-06T20:25:54.536428] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-06T20:25:55.025564] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-06T20:25:55.187971] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T20:25:55.189883] [INFO ] [REMOTE ] NCDL: Full fetch complete (32921 records). [2025-10-06T20:25:55.189963] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-06T20:25:55.587493] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-10-06T20:25:55.587592] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-10-06T20:25:55.588404] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-10-06T20:25:55.588472] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-10-06T20:25:55.589513] [DEBUG] [LOCAL ] NCDL: Trimmed 32921 records to 21643 (keeping 200 days of data) [2025-10-06T20:25:55.730474] [DEBUG] [LOCAL ] NCDL: Primary data saved (21643 records). [2025-10-06T20:25:55.730607] [INFO ] [MAIN ] NCDL: Full history saved. [2025-10-06T20:25:55.730729] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NCDL took 38.8s. Estimated remaining: 2h 8m 13s. Rate: 7.1 symbols/min [2025-10-06T20:25:55.830406] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-06T20:25:55.910612] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:25:55.928046] [DEBUG] [LOCAL ] NDMO: Loaded 17210 existing records from primary storage. [2025-10-06T20:25:55.928311] [INFO ] [MAIN ] NDMO: Loaded 17210 existing records. [2025-10-06T20:25:56.055039] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T20:25:56.118139] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:25:56.118360] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-06T20:25:56.118419] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-06T20:25:56.118974] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-10-06T20:25:56.119034] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-06T20:25:56.509303] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:25:56.625507] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-06T20:25:56.926038] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-06T20:25:57.425477] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-06T20:25:57.726667] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T20:25:58.225490] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-06T20:25:58.291721] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T20:25:59.025489] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-06T20:25:59.224676] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T20:25:59.653854] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-06T20:25:59.825505] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-06T20:26:00.625585] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-06T20:26:01.302780] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T20:26:01.425584] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-06T20:26:01.552223] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T20:26:02.225523] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-06T20:26:02.462992] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T20:26:03.025539] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-06T20:26:03.605495] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T20:26:03.825538] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-06T20:26:03.847805] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T20:26:03.849964] [INFO ] [REMOTE ] NCV: Full fetch complete (22691 records). [2025-10-06T20:26:03.850095] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-06T20:26:04.231156] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-06T20:26:04.231265] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-06T20:26:04.232090] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-06T20:26:04.232168] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-06T20:26:04.233137] [DEBUG] [LOCAL ] NCV: Trimmed 22691 records to 13835 (keeping 200 days of data) [2025-10-06T20:26:04.331194] [DEBUG] [LOCAL ] NCV: Primary data saved (13835 records). [2025-10-06T20:26:04.331357] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-06T20:26:04.331440] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCV took 25.0s. Estimated remaining: 2h 8m 5s. Rate: 7.1 symbols/min [2025-10-06T20:26:04.508443] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:26:04.560578] [DEBUG] [LOCAL ] NE: Loaded 53111 existing records from primary storage. [2025-10-06T20:26:04.560956] [INFO ] [MAIN ] NE: Loaded 53111 existing records. [2025-10-06T20:26:04.630739] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-06T20:26:04.746557] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:26:04.746796] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-06T20:26:04.746846] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-06T20:26:04.747076] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-10-06T20:26:04.747135] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-06T20:26:04.945120] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T20:26:05.135576] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:26:05.362890] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T20:26:05.365826] [INFO ] [REMOTE ] NCLH: Full fetch complete (77420 records). [2025-10-06T20:26:05.365982] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-06T20:26:05.366750] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:26:05.366838] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:26:05.366881] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:26:05.366943] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-06T20:26:05.367052] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-06T20:26:05.367103] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-06T20:26:05.367161] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-06T20:26:05.367252] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCLH took 33.7s. Estimated remaining: 2h 7m 52s. Rate: 7.1 symbols/min [2025-10-06T20:26:05.430726] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-06T20:26:05.536696] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:26:05.580964] [DEBUG] [LOCAL ] NEA: Loaded 35947 existing records from primary storage. [2025-10-06T20:26:05.581255] [INFO ] [MAIN ] NEA: Loaded 35947 existing records. [2025-10-06T20:26:05.754949] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:26:05.755160] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-06T20:26:05.755207] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-06T20:26:05.755563] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-10-06T20:26:05.755628] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-06T20:26:06.107274] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:26:06.225506] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-06T20:26:06.525245] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T20:26:07.025538] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-06T20:26:07.825517] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-06T20:26:08.084492] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T20:26:08.136997] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T20:26:08.625707] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-06T20:26:09.419015] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T20:26:09.427209] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-06T20:26:09.465155] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T20:26:10.225594] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-06T20:26:11.029386] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-06T20:26:11.035540] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T20:26:11.313870] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T20:26:11.825521] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-06T20:26:11.978741] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T20:26:12.625534] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-06T20:26:13.425559] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-06T20:26:13.602944] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T20:26:13.710258] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-06T20:26:14.225546] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-06T20:26:14.544191] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T20:26:15.025518] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-06T20:26:15.441289] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-06T20:26:15.825516] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-06T20:26:16.625507] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-06T20:26:16.931317] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T20:26:16.983802] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-06T20:26:17.425518] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-06T20:26:18.037514] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T20:26:18.089447] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-06T20:26:18.225523] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-06T20:26:19.025523] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-06T20:26:19.285385] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-06T20:26:19.825536] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-06T20:26:19.836977] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T20:26:19.838602] [INFO ] [REMOTE ] NCZ: Full fetch complete (21358 records). [2025-10-06T20:26:19.838715] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-06T20:26:20.203429] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-06T20:26:20.203551] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-06T20:26:20.204064] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-06T20:26:20.204145] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-06T20:26:20.204857] [DEBUG] [LOCAL ] NCZ: Trimmed 21358 records to 12075 (keeping 200 days of data) [2025-10-06T20:26:20.279538] [DEBUG] [LOCAL ] NCZ: Primary data saved (12075 records). [2025-10-06T20:26:20.279733] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-06T20:26:20.279836] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NCZ took 38.8s. Estimated remaining: 2h 7m 47s. Rate: 7.1 symbols/min [2025-10-06T20:26:20.445754] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:26:20.445956] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-06T20:26:20.446011] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-06T20:26:20.446119] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-06T20:26:20.446160] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-06T20:26:20.446200] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-06T20:26:20.446231] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-06T20:26:20.630984] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-06T20:26:20.796621] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:26:21.425545] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-06T20:26:21.800134] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-06T20:26:21.850740] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-06T20:26:22.225536] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-06T20:26:23.025581] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-06T20:26:23.396805] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-06T20:26:23.800525] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T20:26:23.825475] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-06T20:26:24.096026] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T20:26:24.625534] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-06T20:26:25.425521] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-06T20:26:25.569109] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-06T20:26:25.665020] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T20:26:26.130323] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T20:26:26.131689] [INFO ] [REMOTE ] NDMO: Full fetch complete (24477 records). [2025-10-06T20:26:26.131762] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-06T20:26:26.234730] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-06T20:26:26.515371] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-10-06T20:26:26.515471] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-10-06T20:26:26.516040] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-10-06T20:26:26.516111] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-10-06T20:26:26.517099] [DEBUG] [LOCAL ] NDMO: Trimmed 24477 records to 17000 (keeping 200 days of data) [2025-10-06T20:26:26.617721] [DEBUG] [LOCAL ] NDMO: Primary data saved (17000 records). [2025-10-06T20:26:26.617867] [INFO ] [MAIN ] NDMO: Full history saved. [2025-10-06T20:26:26.617991] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. NDMO took 30.9s. Estimated remaining: 2h 7m 38s. Rate: 7.1 symbols/min [2025-10-06T20:26:26.799460] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:26:26.799681] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-06T20:26:26.799738] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-06T20:26:26.799851] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-06T20:26:26.799895] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-06T20:26:26.799937] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-06T20:26:26.799969] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-06T20:26:27.030784] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-06T20:26:27.170255] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:26:27.825496] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-06T20:26:28.265456] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-06T20:26:28.373765] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-06T20:26:28.625524] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-06T20:26:29.425551] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-06T20:26:29.474872] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T20:26:30.225532] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-06T20:26:30.490254] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T20:26:30.890723] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-06T20:26:31.025527] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-06T20:26:31.674944] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T20:26:31.825484] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-06T20:26:32.625534] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-06T20:26:32.986163] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T20:26:33.274926] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T20:26:33.425499] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-06T20:26:33.687158] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-06T20:26:34.225548] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-06T20:26:34.930762] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T20:26:35.025529] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-06T20:26:35.825494] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-06T20:26:35.863994] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T20:26:36.210720] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T20:26:36.625506] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-06T20:26:36.822831] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T20:26:37.425513] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-06T20:26:37.623331] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-06T20:26:38.225525] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-06T20:26:38.905822] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T20:26:38.908807] [INFO ] [REMOTE ] NE: Full fetch complete (75556 records). [2025-10-06T20:26:38.908912] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-06T20:26:39.027021] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-06T20:26:39.314457] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-10-06T20:26:39.314674] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-10-06T20:26:39.315958] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-10-06T20:26:39.316047] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-10-06T20:26:39.317572] [DEBUG] [LOCAL ] NE: Trimmed 75556 records to 52386 (keeping 200 days of data) [2025-10-06T20:26:39.459445] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-06T20:26:39.681132] [DEBUG] [LOCAL ] NE: Primary data saved (52386 records). [2025-10-06T20:26:39.681298] [INFO ] [MAIN ] NE: Full history saved. [2025-10-06T20:26:39.681396] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NE took 35.3s. Estimated remaining: 2h 7m 32s. Rate: 7.1 symbols/min [2025-10-06T20:26:39.847935] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-06T20:26:39.850561] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:26:39.904699] [DEBUG] [LOCAL ] NET: Loaded 53750 existing records from primary storage. [2025-10-06T20:26:39.905114] [INFO ] [MAIN ] NET: Loaded 53750 existing records. [2025-10-06T20:26:40.080198] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:26:40.080471] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-06T20:26:40.080519] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-06T20:26:40.080816] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-10-06T20:26:40.080874] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-06T20:26:40.461832] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:26:40.618126] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T20:26:40.625519] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-06T20:26:40.746861] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-06T20:26:41.425562] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-06T20:26:42.225596] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-06T20:26:42.351542] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T20:26:42.468666] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T20:26:43.025489] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-06T20:26:43.201452] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T20:26:43.825497] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-06T20:26:44.042761] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T20:26:44.625534] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-06T20:26:45.037858] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T20:26:45.040200] [INFO ] [REMOTE ] NEA: Full fetch complete (51948 records). [2025-10-06T20:26:45.040345] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-06T20:26:45.416995] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-06T20:26:45.417081] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-06T20:26:45.417985] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-06T20:26:45.418048] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-06T20:26:45.419366] [DEBUG] [LOCAL ] NEA: Trimmed 51948 records to 35486 (keeping 200 days of data) [2025-10-06T20:26:45.474236] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-06T20:26:45.644751] [DEBUG] [LOCAL ] NEA: Primary data saved (35486 records). [2025-10-06T20:26:45.644915] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-06T20:26:45.645013] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NEA took 40.3s. Estimated remaining: 2h 7m 22s. Rate: 7.1 symbols/min [2025-10-06T20:26:45.820694] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:26:45.835064] [DEBUG] [LOCAL ] NEU: Loaded 8405 existing records from primary storage. [2025-10-06T20:26:45.835320] [INFO ] [MAIN ] NEU: Loaded 8405 existing records. [2025-10-06T20:26:46.018436] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:26:46.018736] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-06T20:26:46.018790] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-06T20:26:46.019033] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-10-06T20:26:46.019091] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-06T20:26:46.234544] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-06T20:26:46.385812] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:26:46.623763] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T20:26:46.862682] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-06T20:26:47.030002] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-06T20:26:47.036446] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T20:26:47.753794] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-06T20:26:47.825477] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-06T20:26:48.625507] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-06T20:26:48.826106] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T20:26:49.358797] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T20:26:49.425523] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-06T20:26:50.225572] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-06T20:26:50.281133] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T20:26:51.025538] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-06T20:26:51.825782] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-06T20:26:52.114860] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T20:26:52.474344] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T20:26:52.476968] [INFO ] [REMOTE ] NEE: Full fetch complete (77369 records). [2025-10-06T20:26:52.477085] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-06T20:26:52.477761] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:26:52.477844] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:26:52.477919] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:26:52.477978] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-06T20:26:52.478062] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-06T20:26:52.478156] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-06T20:26:52.478221] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-10-06T20:26:52.478298] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NEE took 32.2s. Estimated remaining: 2h 7m 13s. Rate: 7.1 symbols/min [2025-10-06T20:26:52.627622] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-06T20:26:52.676689] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:26:52.685917] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-06T20:26:52.702238] [DEBUG] [LOCAL ] NEXA: Loaded 4449 existing records from primary storage. [2025-10-06T20:26:52.702459] [INFO ] [MAIN ] NEXA: Loaded 4449 existing records. [2025-10-06T20:26:52.879739] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:26:52.879946] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-06T20:26:52.879992] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-06T20:26:52.880178] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-06T20:26:52.880246] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-06T20:26:53.232592] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:26:53.425527] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-06T20:26:53.694560] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-06T20:26:54.225533] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-06T20:26:54.392667] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T20:26:55.025537] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-06T20:26:55.825550] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-06T20:26:55.934788] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T20:26:56.505556] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-06T20:26:56.625561] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-06T20:26:56.718184] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-06T20:26:57.425535] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-06T20:26:58.225551] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-06T20:26:58.233979] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-06T20:26:58.828252] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-06T20:26:58.829051] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-06T20:26:59.025467] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-06T20:26:59.825550] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-06T20:27:00.587741] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T20:27:00.625518] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-06T20:27:01.234637] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-06T20:27:01.259499] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-06T20:27:01.425565] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-06T20:27:02.177004] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T20:27:02.225492] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-06T20:27:03.025570] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-06T20:27:03.313083] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T20:27:03.825534] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-06T20:27:04.625498] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-06T20:27:04.816371] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T20:27:05.334398] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-06T20:27:05.378941] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T20:27:05.425570] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-06T20:27:06.196788] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T20:27:06.225506] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-06T20:27:06.830245] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T20:27:07.025539] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-06T20:27:07.825529] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-06T20:27:07.893991] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-06T20:27:08.574984] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T20:27:08.625479] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-06T20:27:09.425593] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-06T20:27:10.075245] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T20:27:10.076222] [INFO ] [REMOTE ] NEXA: Full fetch complete (7624 records). [2025-10-06T20:27:10.076292] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-06T20:27:10.226366] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-06T20:27:10.442426] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-06T20:27:10.442548] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-06T20:27:10.442803] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-06T20:27:10.442865] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-06T20:27:10.443360] [DEBUG] [LOCAL ] NEXA: Trimmed 7624 records to 4445 (keeping 200 days of data) [2025-10-06T20:27:10.468927] [DEBUG] [LOCAL ] NEXA: Primary data saved (4445 records). [2025-10-06T20:27:10.469050] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-06T20:27:10.469131] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEXA took 18.0s. Estimated remaining: 2h 7m 10s. Rate: 7.1 symbols/min [2025-10-06T20:27:10.647805] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:27:10.684987] [DEBUG] [LOCAL ] NFG: Loaded 39126 existing records from primary storage. [2025-10-06T20:27:10.685401] [INFO ] [MAIN ] NFG: Loaded 39126 existing records. [2025-10-06T20:27:10.880152] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:27:10.880792] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-06T20:27:10.881062] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-06T20:27:10.881399] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-10-06T20:27:10.881481] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-06T20:27:11.030453] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-06T20:27:11.087155] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T20:27:11.142474] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-06T20:27:11.188844] [INFO ] [REMOTE ] NEM: Full fetch complete (77359 records). [2025-10-06T20:27:11.209356] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-06T20:27:11.248249] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:27:11.270079] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:27:11.273155] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:27:11.273274] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-06T20:27:11.279274] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-06T20:27:11.289690] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-06T20:27:11.294975] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-10-06T20:27:11.295102] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEM took 44.7s. Estimated remaining: 2h 6m 57s. Rate: 7.1 symbols/min [2025-10-06T20:27:11.455775] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:27:11.532340] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:27:11.554720] [DEBUG] [LOCAL ] NFJ: Loaded 20735 existing records from primary storage. [2025-10-06T20:27:11.554980] [INFO ] [MAIN ] NFJ: Loaded 20735 existing records. [2025-10-06T20:27:11.730278] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:27:11.730568] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-06T20:27:11.730624] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-06T20:27:11.730879] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-10-06T20:27:11.730938] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-06T20:27:11.831066] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-06T20:27:12.088759] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:27:12.368011] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T20:27:12.625552] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-06T20:27:13.357568] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T20:27:13.425571] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-06T20:27:13.561054] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-06T20:27:14.225525] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-06T20:27:15.026292] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-06T20:27:15.028432] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T20:27:15.226909] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T20:27:15.825522] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-06T20:27:16.625487] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-06T20:27:16.777413] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T20:27:16.827241] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-06T20:27:17.425521] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-06T20:27:17.503219] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T20:27:18.225548] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-06T20:27:18.715038] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-06T20:27:19.025583] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-06T20:27:19.825501] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-06T20:27:19.856348] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T20:27:20.187548] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T20:27:20.560028] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T20:27:20.561272] [INFO ] [REMOTE ] NEU: Full fetch complete (10577 records). [2025-10-06T20:27:20.561350] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-06T20:27:20.630764] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-06T20:27:20.937309] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-10-06T20:27:20.937398] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-10-06T20:27:20.937729] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-10-06T20:27:20.937794] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-10-06T20:27:20.938341] [DEBUG] [LOCAL ] NEU: Trimmed 10577 records to 8396 (keeping 200 days of data) [2025-10-06T20:27:20.993865] [DEBUG] [LOCAL ] NEU: Primary data saved (8396 records). [2025-10-06T20:27:20.994033] [INFO ] [MAIN ] NEU: Full history saved. [2025-10-06T20:27:20.994120] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NEU took 35.3s. Estimated remaining: 2h 6m 49s. Rate: 7.1 symbols/min [2025-10-06T20:27:21.165952] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:27:21.212631] [DEBUG] [LOCAL ] NGG: Loaded 46850 existing records from primary storage. [2025-10-06T20:27:21.213031] [INFO ] [MAIN ] NGG: Loaded 46850 existing records. [2025-10-06T20:27:21.399823] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:27:21.400057] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-06T20:27:21.400103] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-06T20:27:21.400869] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-10-06T20:27:21.400942] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-06T20:27:21.430822] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-06T20:27:21.756974] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:27:21.885124] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-06T20:27:22.225545] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-06T20:27:23.025688] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-06T20:27:23.206846] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T20:27:23.825583] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-06T20:27:24.451196] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-06T20:27:24.625512] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-06T20:27:24.750630] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T20:27:24.984269] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T20:27:25.425576] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-06T20:27:26.225584] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-06T20:27:26.406514] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-06T20:27:26.409564] [INFO ] [REMOTE ] NET: Full fetch complete (76799 records). [2025-10-06T20:27:26.409733] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-06T20:27:26.803668] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-10-06T20:27:26.803815] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-10-06T20:27:26.804896] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-10-06T20:27:26.804959] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-10-06T20:27:26.806423] [DEBUG] [LOCAL ] NET: Trimmed 76799 records to 52971 (keeping 200 days of data) [2025-10-06T20:27:27.027152] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-06T20:27:27.137158] [DEBUG] [LOCAL ] NET: Primary data saved (52971 records). [2025-10-06T20:27:27.137310] [INFO ] [MAIN ] NET: Full history saved. [2025-10-06T20:27:27.137411] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NET took 47.5s. Estimated remaining: 2h 6m 39s. Rate: 7.1 symbols/min [2025-10-06T20:27:27.329959] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:27:27.332118] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T20:27:27.367847] [DEBUG] [LOCAL ] NGL: Loaded 30563 existing records from primary storage. [2025-10-06T20:27:27.368151] [INFO ] [MAIN ] NGL: Loaded 30563 existing records. [2025-10-06T20:27:27.541983] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:27:27.542188] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-06T20:27:27.542233] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-06T20:27:27.542496] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-06T20:27:27.542554] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-06T20:27:27.830275] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-06T20:27:27.900610] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:27:27.938793] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T20:27:28.311858] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-06T20:27:28.625509] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-06T20:27:29.425529] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-06T20:27:29.498227] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T20:27:29.832482] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T20:27:30.225516] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-06T20:27:30.564854] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T20:27:31.025536] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-06T20:27:31.825567] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-06T20:27:31.899547] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T20:27:32.259598] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T20:27:32.625531] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-06T20:27:33.330611] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T20:27:33.425527] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-06T20:27:33.798938] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T20:27:34.225566] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-06T20:27:35.025512] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-06T20:27:35.095356] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T20:27:35.566851] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T20:27:35.825534] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-06T20:27:36.186013] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T20:27:36.625588] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-06T20:27:37.425554] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-06T20:27:37.620813] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T20:27:37.846162] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-06T20:27:38.225553] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-06T20:27:39.025508] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-06T20:27:39.056784] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T20:27:39.652614] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T20:27:39.825535] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-06T20:27:40.145192] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T20:27:40.625526] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-06T20:27:40.931598] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T20:27:41.425516] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-06T20:27:42.225544] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-06T20:27:42.519768] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T20:27:42.823392] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T20:27:43.025556] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-06T20:27:43.731807] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T20:27:43.825478] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-06T20:27:44.625527] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-06T20:27:44.844913] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T20:27:45.126135] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T20:27:45.128836] [INFO ] [REMOTE ] NFG: Full fetch complete (56903 records). [2025-10-06T20:27:45.128931] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-06T20:27:45.430311] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-06T20:27:45.526815] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-10-06T20:27:45.526895] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-10-06T20:27:45.527806] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-10-06T20:27:45.527871] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-10-06T20:27:45.529078] [DEBUG] [LOCAL ] NFG: Trimmed 56903 records to 38439 (keeping 200 days of data) [2025-10-06T20:27:45.770455] [DEBUG] [LOCAL ] NFG: Primary data saved (38439 records). [2025-10-06T20:27:45.770597] [INFO ] [MAIN ] NFG: Full history saved. [2025-10-06T20:27:45.770706] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NFG took 35.3s. Estimated remaining: 2h 6m 37s. Rate: 7.1 symbols/min [2025-10-06T20:27:45.940946] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:27:45.954480] [DEBUG] [LOCAL ] NGS: Loaded 11679 existing records from primary storage. [2025-10-06T20:27:45.954765] [INFO ] [MAIN ] NGS: Loaded 11679 existing records. [2025-10-06T20:27:46.139174] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:27:46.139662] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-06T20:27:46.139740] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-06T20:27:46.147275] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-06T20:27:46.159199] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-06T20:27:46.203380] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T20:27:46.239856] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-06T20:27:46.535523] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:27:46.649284] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-06T20:27:47.025534] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-06T20:27:47.825519] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-06T20:27:48.138185] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T20:27:48.288289] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T20:27:48.625509] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-06T20:27:48.921242] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T20:27:49.425524] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-06T20:27:49.844880] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-06T20:27:50.225710] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-06T20:27:50.535088] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T20:27:51.025575] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-06T20:27:51.825553] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-06T20:27:51.896161] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T20:27:51.959666] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T20:27:52.625579] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-06T20:27:52.728305] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T20:27:52.730080] [INFO ] [REMOTE ] NFJ: Full fetch complete (30575 records). [2025-10-06T20:27:52.730181] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-06T20:27:53.101287] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-06T20:27:53.101379] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-06T20:27:53.102032] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-06T20:27:53.102095] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-06T20:27:53.102836] [DEBUG] [LOCAL ] NFJ: Trimmed 30575 records to 20410 (keeping 200 days of data) [2025-10-06T20:27:53.229395] [DEBUG] [LOCAL ] NFJ: Primary data saved (20410 records). [2025-10-06T20:27:53.229539] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-06T20:27:53.229665] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NFJ took 41.9s. Estimated remaining: 2h 6m 28s. Rate: 7.1 symbols/min [2025-10-06T20:27:53.396342] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:27:53.424251] [DEBUG] [LOCAL ] NGVC: Loaded 22666 existing records from primary storage. [2025-10-06T20:27:53.424747] [INFO ] [MAIN ] NGVC: Loaded 22666 existing records. [2025-10-06T20:27:53.435839] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-06T20:27:53.603869] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:27:53.604194] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-06T20:27:53.604258] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-06T20:27:53.604468] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-10-06T20:27:53.604526] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-06T20:27:53.984527] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:27:54.225537] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-06T20:27:54.456775] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-06T20:27:54.566012] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T20:27:54.567669] [INFO ] [REMOTE ] NGL: Full fetch complete (41248 records). [2025-10-06T20:27:54.567771] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-06T20:27:54.950020] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-06T20:27:54.950140] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-06T20:27:54.950981] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-06T20:27:54.951043] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-06T20:27:54.952794] [DEBUG] [LOCAL ] NGL: Trimmed 41248 records to 30046 (keeping 200 days of data) [2025-10-06T20:27:55.033036] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-06T20:27:55.127146] [DEBUG] [LOCAL ] NGL: Primary data saved (30046 records). [2025-10-06T20:27:55.127317] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-06T20:27:55.127448] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NGL took 28.0s. Estimated remaining: 2h 6m 16s. Rate: 7.1 symbols/min [2025-10-06T20:27:55.242779] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-06T20:27:55.318380] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:27:55.347189] [DEBUG] [LOCAL ] NGVT: Loaded 24460 existing records from primary storage. [2025-10-06T20:27:55.347564] [INFO ] [MAIN ] NGVT: Loaded 24460 existing records. [2025-10-06T20:27:55.527247] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:27:55.527490] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-06T20:27:55.527537] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-06T20:27:55.527775] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-10-06T20:27:55.527832] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-06T20:27:55.839197] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-06T20:27:55.880235] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:27:56.162061] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T20:27:56.165061] [INFO ] [REMOTE ] NGG: Full fetch complete (66383 records). [2025-10-06T20:27:56.165223] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-06T20:27:56.554259] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-10-06T20:27:56.554354] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-10-06T20:27:56.555350] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-10-06T20:27:56.555434] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-10-06T20:27:56.557050] [DEBUG] [LOCAL ] NGG: Trimmed 66383 records to 46308 (keeping 200 days of data) [2025-10-06T20:27:56.626253] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-06T20:27:56.866393] [DEBUG] [LOCAL ] NGG: Primary data saved (46308 records). [2025-10-06T20:27:56.866611] [INFO ] [MAIN ] NGG: Full history saved. [2025-10-06T20:27:56.866756] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NGG took 35.9s. Estimated remaining: 2h 6m 3s. Rate: 7.1 symbols/min [2025-10-06T20:27:57.006352] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-06T20:27:57.058067] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:27:57.079576] [DEBUG] [LOCAL ] NHI: Loaded 22136 existing records from primary storage. [2025-10-06T20:27:57.079888] [INFO ] [MAIN ] NHI: Loaded 22136 existing records. [2025-10-06T20:27:57.255024] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:27:57.255265] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-06T20:27:57.255311] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-06T20:27:57.255530] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-10-06T20:27:57.255589] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-06T20:27:57.430724] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-06T20:27:57.627467] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:27:57.677986] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T20:27:58.225552] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-06T20:27:58.651070] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T20:27:59.025558] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-06T20:27:59.446876] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T20:27:59.825539] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-06T20:28:00.281967] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T20:28:00.625583] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-06T20:28:00.751291] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T20:28:01.425529] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-06T20:28:01.466395] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T20:28:02.225563] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-06T20:28:02.660391] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T20:28:03.025583] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-06T20:28:03.728684] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T20:28:03.825490] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-06T20:28:04.272000] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T20:28:04.625563] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-06T20:28:05.081032] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T20:28:05.425608] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-06T20:28:05.763407] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T20:28:06.225568] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-06T20:28:06.765313] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T20:28:07.025604] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-06T20:28:07.227096] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T20:28:07.825547] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-06T20:28:08.003056] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T20:28:08.625596] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-06T20:28:09.180535] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T20:28:09.425551] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-06T20:28:09.587060] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T20:28:10.225536] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-06T20:28:10.339833] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T20:28:11.025582] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-06T20:28:11.311004] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T20:28:11.825613] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-06T20:28:12.266078] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-06T20:28:12.470939] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-06T20:28:12.625530] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-06T20:28:13.425547] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-06T20:28:13.912602] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-06T20:28:14.225563] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-06T20:28:14.610943] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T20:28:15.025498] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-06T20:28:15.181336] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T20:28:15.825519] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-06T20:28:16.336558] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T20:28:16.625547] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-06T20:28:16.846960] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T20:28:17.243942] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-06T20:28:17.425524] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-06T20:28:18.225598] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-06T20:28:18.520339] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T20:28:19.025534] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-06T20:28:19.459096] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T20:28:19.825519] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-06T20:28:20.211282] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T20:28:20.625542] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-06T20:28:20.740198] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-06T20:28:20.742003] [INFO ] [REMOTE ] NGVC: Full fetch complete (30552 records). [2025-10-06T20:28:20.742120] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-06T20:28:21.139299] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-10-06T20:28:21.139386] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-10-06T20:28:21.140038] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-10-06T20:28:21.140100] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-10-06T20:28:21.140874] [DEBUG] [LOCAL ] NGVC: Trimmed 30552 records to 22455 (keeping 200 days of data) [2025-10-06T20:28:21.282528] [DEBUG] [LOCAL ] NGVC: Primary data saved (22455 records). [2025-10-06T20:28:21.282702] [INFO ] [MAIN ] NGVC: Full history saved. [2025-10-06T20:28:21.282831] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NGVC took 28.1s. Estimated remaining: 2h 6m 4s. Rate: 7.1 symbols/min [2025-10-06T20:28:21.425536] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-06T20:28:21.778846] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T20:28:22.225540] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-06T20:28:22.668521] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-06T20:28:22.988349] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T20:28:22.989479] [INFO ] [REMOTE ] NGS: Full fetch complete (17188 records). [2025-10-06T20:28:22.989558] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-06T20:28:23.032683] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-06T20:28:23.353371] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-06T20:28:23.353453] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-06T20:28:23.353843] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-06T20:28:23.353905] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-06T20:28:23.354489] [DEBUG] [LOCAL ] NGS: Trimmed 17188 records to 11418 (keeping 200 days of data) [2025-10-06T20:28:23.442712] [DEBUG] [LOCAL ] NGS: Primary data saved (11418 records). [2025-10-06T20:28:23.442971] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-06T20:28:23.443163] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NGS took 37.7s. Estimated remaining: 2h 5m 52s. Rate: 7.1 symbols/min [2025-10-06T20:28:23.825588] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-06T20:28:24.367411] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T20:28:24.625525] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-06T20:28:24.925508] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T20:28:25.425605] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-06T20:28:25.775681] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T20:28:26.225546] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-06T20:28:26.600769] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-06T20:28:27.025534] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-06T20:28:27.173292] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T20:28:27.174989] [INFO ] [REMOTE ] NGVT: Full fetch complete (34569 records). [2025-10-06T20:28:27.175062] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-06T20:28:27.553014] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-10-06T20:28:27.553107] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-10-06T20:28:27.553845] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-10-06T20:28:27.553910] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-10-06T20:28:27.554825] [DEBUG] [LOCAL ] NGVT: Trimmed 34569 records to 24179 (keeping 200 days of data) [2025-10-06T20:28:27.701295] [DEBUG] [LOCAL ] NGVT: Primary data saved (24179 records). [2025-10-06T20:28:27.701461] [INFO ] [MAIN ] NGVT: Full history saved. [2025-10-06T20:28:27.701551] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGVT took 32.6s. Estimated remaining: 2h 5m 41s. Rate: 7.1 symbols/min [2025-10-06T20:28:27.948856] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T20:28:27.950430] [INFO ] [REMOTE ] NHI: Full fetch complete (31460 records). [2025-10-06T20:28:27.950520] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-06T20:28:28.328610] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-10-06T20:28:28.328737] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-10-06T20:28:28.329413] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-10-06T20:28:28.329455] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-10-06T20:28:28.330422] [DEBUG] [LOCAL ] NHI: Trimmed 31460 records to 21832 (keeping 200 days of data) [2025-10-06T20:28:28.472880] [DEBUG] [LOCAL ] NHI: Primary data saved (21832 records). [2025-10-06T20:28:28.473103] [INFO ] [MAIN ] NHI: Full history saved. [2025-10-06T20:28:28.473231] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NHI took 31.6s. Estimated remaining: 2h 5m 28s. Rate: 7.1 symbols/min [2025-10-06T20:28:29.071505] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:28:29.168221] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-06T20:28:29.168115] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:28:29.176949] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-06T20:28:29.266558] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:28:29.268386] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-06T20:28:29.267946] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:28:29.268506] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-06T20:28:29.268925] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-06T20:28:29.269523] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-06T20:28:29.376911] [DEBUG] [LOCAL ] NIM: Loaded 4097 existing records from primary storage. [2025-10-06T20:28:29.377348] [DEBUG] [LOCAL ] NIE: Loaded 12087 existing records from primary storage. [2025-10-06T20:28:29.393623] [INFO ] [MAIN ] NIE: Loaded 12087 existing records. [2025-10-06T20:28:29.405384] [DEBUG] [LOCAL ] NIC: Loaded 9103 existing records from primary storage. [2025-10-06T20:28:29.410892] [INFO ] [MAIN ] NIC: Loaded 9103 existing records. [2025-10-06T20:28:29.393221] [INFO ] [MAIN ] NIM: Loaded 4097 existing records. [2025-10-06T20:28:29.952865] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:28:29.968621] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-06T20:28:29.989319] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-06T20:28:30.038941] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-06T20:28:30.087177] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:28:30.117955] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-06T20:28:30.123229] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-06T20:28:30.133694] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-06T20:28:30.220160] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-06T20:28:30.231110] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:28:30.273562] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-06T20:28:30.273732] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-06T20:28:30.338103] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-06T20:28:30.507674] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-10-06T20:28:30.531431] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:28:30.540611] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-06T20:28:30.588847] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-06T20:28:31.035728] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:28:31.112151] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-06T20:28:31.311138] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:28:31.321781] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-06T20:28:31.380307] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:28:31.380689] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-06T20:28:32.084269] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T20:28:32.087279] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-06T20:28:32.214050] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T20:28:32.216253] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-06T20:28:32.288753] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-06T20:28:32.473498] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T20:28:32.625479] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-06T20:28:32.915506] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T20:28:32.976824] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-06T20:28:33.425503] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-06T20:28:33.697260] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T20:28:34.203888] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T20:28:34.225475] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-06T20:28:35.025558] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-06T20:28:35.112676] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-06T20:28:35.785681] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T20:28:35.825488] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-06T20:28:36.625538] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-06T20:28:36.739065] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T20:28:37.204730] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T20:28:37.425545] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-06T20:28:38.184863] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T20:28:38.225530] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-06T20:28:39.025549] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-06T20:28:39.124085] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T20:28:39.825498] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-06T20:28:39.981432] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T20:28:40.625535] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-06T20:28:40.722371] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-06T20:28:41.425545] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-06T20:28:41.664434] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-06T20:28:42.143187] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-06T20:28:42.225553] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-06T20:28:43.025550] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-06T20:28:43.179783] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-06T20:28:43.825520] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-06T20:28:44.004533] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T20:28:44.625687] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-06T20:28:44.734391] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-06T20:28:45.425563] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-06T20:28:45.589015] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T20:28:46.225511] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-06T20:28:46.263449] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T20:28:46.860009] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-06T20:28:47.025534] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-06T20:28:47.825511] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-06T20:28:48.007486] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T20:28:48.449614] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-06T20:28:48.625585] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-06T20:28:49.425525] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-06T20:28:49.580846] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T20:28:50.121274] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T20:28:50.225555] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-06T20:28:50.901553] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-06T20:28:51.025539] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-06T20:28:51.731292] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T20:28:51.825544] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-06T20:28:52.579779] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T20:28:52.625508] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-06T20:28:53.425541] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-06T20:28:53.464686] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T20:28:54.141470] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-06T20:28:54.144038] [INFO ] [REMOTE ] NI: Full fetch complete (76882 records). [2025-10-06T20:28:54.144214] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-06T20:28:54.145270] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:28:54.145454] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:28:54.145523] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:28:54.145595] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-06T20:28:54.145715] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-06T20:28:54.145772] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-06T20:28:54.145829] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-10-06T20:28:54.145931] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NI took 25.7s. Estimated remaining: 2h 5m 30s. Rate: 7.1 symbols/min [2025-10-06T20:28:54.230717] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-06T20:28:54.322052] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:28:54.352248] [DEBUG] [LOCAL ] NINE: Loaded 28549 existing records from primary storage. [2025-10-06T20:28:54.352571] [INFO ] [MAIN ] NINE: Loaded 28549 existing records. [2025-10-06T20:28:54.528033] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:28:54.528245] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-06T20:28:54.528291] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-06T20:28:54.528525] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-06T20:28:54.528582] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-06T20:28:54.884713] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:28:55.025535] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-06T20:28:55.132192] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T20:28:55.825498] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-06T20:28:55.992325] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T20:28:56.625563] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-06T20:28:56.923367] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T20:28:57.425510] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-06T20:28:57.531760] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T20:28:58.225545] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-06T20:28:59.024687] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T20:28:59.026052] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-06T20:28:59.026372] [INFO ] [REMOTE ] NIC: Full fetch complete (12319 records). [2025-10-06T20:28:59.027132] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-06T20:28:59.205964] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T20:28:59.471266] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-10-06T20:28:59.471370] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-10-06T20:28:59.471751] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-10-06T20:28:59.471828] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-10-06T20:28:59.472386] [DEBUG] [LOCAL ] NIC: Trimmed 12319 records to 8872 (keeping 200 days of data) [2025-10-06T20:28:59.536948] [DEBUG] [LOCAL ] NIC: Primary data saved (8872 records). [2025-10-06T20:28:59.537129] [INFO ] [MAIN ] NIC: Full history saved. [2025-10-06T20:28:59.537259] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NIC took 31.1s. Estimated remaining: 2h 5m 20s. Rate: 7.1 symbols/min [2025-10-06T20:28:59.744899] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:28:59.803482] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-10-06T20:28:59.803935] [INFO ] [MAIN ] NIO: Loaded 54582 existing records. [2025-10-06T20:28:59.830728] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-06T20:29:00.029491] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:29:00.029865] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-06T20:29:00.029940] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-06T20:29:00.030231] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-06T20:29:00.030292] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-06T20:29:00.251906] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T20:29:00.470720] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:29:00.625506] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-06T20:29:01.266527] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T20:29:01.425521] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-06T20:29:02.225583] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-06T20:29:02.777559] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T20:29:02.869795] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T20:29:03.025505] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-06T20:29:03.370674] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-06T20:29:03.649016] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-06T20:29:03.825524] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-06T20:29:04.625580] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-06T20:29:05.150766] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T20:29:05.151504] [INFO ] [REMOTE ] NIM: Full fetch complete (6693 records). [2025-10-06T20:29:05.151570] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-06T20:29:05.426132] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-06T20:29:05.505972] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-06T20:29:05.506048] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-06T20:29:05.506225] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-06T20:29:05.506262] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-06T20:29:05.506626] [DEBUG] [LOCAL ] NIM: Trimmed 6693 records to 4024 (keeping 200 days of data) [2025-10-06T20:29:05.530554] [DEBUG] [LOCAL ] NIM: Primary data saved (4024 records). [2025-10-06T20:29:05.530675] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-06T20:29:05.530767] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NIM took 37.0s. Estimated remaining: 2h 5m 10s. Rate: 7.1 symbols/min [2025-10-06T20:29:05.700370] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:29:05.700576] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-06T20:29:05.700634] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-06T20:29:05.700764] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-06T20:29:05.700843] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-06T20:29:05.700894] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-06T20:29:05.700964] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-06T20:29:06.053610] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:29:06.225500] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-06T20:29:06.376574] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-06T20:29:06.396096] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-06T20:29:07.025575] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-06T20:29:07.454579] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T20:29:07.498167] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:29:07.498460] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-06T20:29:07.498568] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:29:07.498696] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-06T20:29:07.498784] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:29:07.498880] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-06T20:29:07.498964] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-06T20:29:07.499003] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-06T20:29:07.499061] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-06T20:29:07.499130] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NIQ took 2.0s. Estimated remaining: 2h 4m 57s. Rate: 7.1 symbols/min [2025-10-06T20:29:07.665798] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:29:07.703997] [DEBUG] [LOCAL ] NJR: Loaded 38713 existing records from primary storage. [2025-10-06T20:29:07.704313] [INFO ] [MAIN ] NJR: Loaded 38713 existing records. [2025-10-06T20:29:07.830708] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-06T20:29:07.887850] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:29:07.888166] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-06T20:29:07.888245] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-06T20:29:07.888890] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-10-06T20:29:07.888948] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-06T20:29:08.238615] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:29:08.625525] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-06T20:29:08.913965] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-06T20:29:09.425529] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-06T20:29:10.134738] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T20:29:10.136069] [INFO ] [REMOTE ] NIE: Full fetch complete (16711 records). [2025-10-06T20:29:10.136151] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-06T20:29:10.232167] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-06T20:29:10.500144] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-06T20:29:10.500229] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-06T20:29:10.500688] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-06T20:29:10.500749] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-06T20:29:10.501311] [DEBUG] [LOCAL ] NIE: Trimmed 16711 records to 11940 (keeping 200 days of data) [2025-10-06T20:29:10.577123] [DEBUG] [LOCAL ] NIE: Primary data saved (11940 records). [2025-10-06T20:29:10.577280] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-06T20:29:10.577363] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIE took 42.0s. Estimated remaining: 2h 4m 46s. Rate: 7.1 symbols/min [2025-10-06T20:29:10.745118] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:29:10.745504] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-06T20:29:10.745555] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-06T20:29:10.745692] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-06T20:29:10.745745] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-06T20:29:10.745787] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-06T20:29:10.745818] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-06T20:29:11.030603] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-06T20:29:11.103348] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:29:11.169996] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-06T20:29:11.784052] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T20:29:11.825468] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-06T20:29:12.189561] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T20:29:12.625523] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-06T20:29:13.161187] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T20:29:13.425558] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-06T20:29:14.225572] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-06T20:29:14.580349] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-06T20:29:14.948161] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T20:29:15.025476] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-06T20:29:15.825540] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-06T20:29:16.603137] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T20:29:16.625471] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-06T20:29:16.943879] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-06T20:29:17.425567] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-06T20:29:18.230798] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-06T20:29:18.243622] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T20:29:18.554501] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-10-06T20:29:19.025533] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-06T20:29:19.423983] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T20:29:19.825501] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-06T20:29:20.121298] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-06T20:29:20.228971] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T20:29:20.625528] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-06T20:29:21.178852] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-06T20:29:21.425504] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-06T20:29:21.839664] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T20:29:22.225578] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-06T20:29:22.605880] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T20:29:23.025522] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-06T20:29:23.825543] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-06T20:29:24.625569] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-06T20:29:24.687833] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T20:29:24.751563] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T20:29:24.836974] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-06T20:29:25.425636] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-06T20:29:25.481500] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-06T20:29:26.225529] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-06T20:29:26.428055] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T20:29:27.025574] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-06T20:29:27.231699] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T20:29:27.233422] [INFO ] [REMOTE ] NINE: Full fetch complete (43657 records). [2025-10-06T20:29:27.233504] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-06T20:29:27.608294] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-06T20:29:27.608385] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-06T20:29:27.609305] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-06T20:29:27.609372] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-06T20:29:27.610361] [DEBUG] [LOCAL ] NINE: Trimmed 43657 records to 28140 (keeping 200 days of data) [2025-10-06T20:29:27.778071] [DEBUG] [LOCAL ] NINE: Primary data saved (28140 records). [2025-10-06T20:29:27.778343] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-06T20:29:27.778436] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NINE took 33.6s. Estimated remaining: 2h 4m 42s. Rate: 7.1 symbols/min [2025-10-06T20:29:27.834109] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-06T20:29:27.953669] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:29:27.970637] [DEBUG] [LOCAL ] NKX: Loaded 13878 existing records from primary storage. [2025-10-06T20:29:27.970936] [INFO ] [MAIN ] NKX: Loaded 13878 existing records. [2025-10-06T20:29:28.146417] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:29:28.146757] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-06T20:29:28.146811] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-06T20:29:28.147104] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-06T20:29:28.147164] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-06T20:29:28.502703] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:29:28.625512] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-06T20:29:29.163024] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T20:29:29.425551] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-06T20:29:29.498256] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-06T20:29:29.774687] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T20:29:30.073548] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-06T20:29:30.225585] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-06T20:29:31.025506] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-06T20:29:31.134694] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T20:29:31.825544] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-06T20:29:32.584308] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T20:29:32.625499] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-06T20:29:33.425594] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-06T20:29:33.531100] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T20:29:34.225586] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-06T20:29:34.377001] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-06T20:29:34.453710] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T20:29:35.025535] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-06T20:29:35.325715] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T20:29:35.825590] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-06T20:29:36.625552] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-06T20:29:37.373577] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T20:29:37.425489] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-06T20:29:37.611306] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-06T20:29:37.816671] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-06T20:29:38.225586] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-06T20:29:38.396361] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T20:29:38.399220] [INFO ] [REMOTE ] NJR: Full fetch complete (54776 records). [2025-10-06T20:29:38.399360] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-06T20:29:38.782578] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-10-06T20:29:38.782689] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-10-06T20:29:38.783599] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-10-06T20:29:38.783661] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-10-06T20:29:38.784847] [DEBUG] [LOCAL ] NJR: Trimmed 54776 records to 38271 (keeping 200 days of data) [2025-10-06T20:29:39.025840] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-06T20:29:39.034110] [DEBUG] [LOCAL ] NJR: Primary data saved (38271 records). [2025-10-06T20:29:39.034244] [INFO ] [MAIN ] NJR: Full history saved. [2025-10-06T20:29:39.034348] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NJR took 31.5s. Estimated remaining: 2h 4m 36s. Rate: 7.1 symbols/min [2025-10-06T20:29:39.125889] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-06T20:29:39.265925] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:29:39.266120] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-06T20:29:39.266211] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-06T20:29:39.266301] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-06T20:29:39.266367] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-06T20:29:39.266459] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-06T20:29:39.266519] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-06T20:29:39.702909] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:29:39.825547] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-06T20:29:40.364182] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T20:29:40.625576] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-06T20:29:41.425556] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-06T20:29:41.530322] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T20:29:41.938226] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-06T20:29:42.225495] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-06T20:29:42.568330] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-06T20:29:42.927146] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-06T20:29:43.025507] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-06T20:29:43.734578] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-06T20:29:43.825539] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-06T20:29:44.434984] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T20:29:44.438382] [INFO ] [REMOTE ] NKE: Full fetch complete (76807 records). [2025-10-06T20:29:44.438536] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-06T20:29:44.439670] [FATAL] [VALIDATOR ] NKE: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:29:44.439776] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:29:44.439822] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:29:44.439867] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-06T20:29:44.439938] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-06T20:29:44.439974] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-06T20:29:44.440016] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-06T20:29:44.440083] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NKE took 33.9s. Estimated remaining: 2h 4m 25s. Rate: 7.1 symbols/min [2025-10-06T20:29:44.625286] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:29:44.625588] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-06T20:29:44.642969] [DEBUG] [LOCAL ] NLOP: Loaded 11886 existing records from primary storage. [2025-10-06T20:29:44.643436] [INFO ] [MAIN ] NLOP: Loaded 11886 existing records. [2025-10-06T20:29:44.834704] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:29:44.835078] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-06T20:29:44.836028] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-06T20:29:44.836338] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-10-06T20:29:44.836398] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-06T20:29:45.212350] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:29:45.373854] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T20:29:45.425564] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-06T20:29:46.225538] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-06T20:29:46.430856] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-06T20:29:46.870843] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T20:29:46.874207] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-10-06T20:29:46.874345] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-06T20:29:47.030764] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-06T20:29:47.361630] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-06T20:29:47.361995] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-06T20:29:47.363132] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-06T20:29:47.363203] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-06T20:29:47.364782] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 53802 (keeping 200 days of data) [2025-10-06T20:29:47.685756] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-10-06T20:29:47.685922] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-06T20:29:47.686012] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NIO took 48.1s. Estimated remaining: 2h 4m 14s. Rate: 7.1 symbols/min [2025-10-06T20:29:47.831525] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-06T20:29:47.857400] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:29:47.908171] [DEBUG] [LOCAL ] NLY: Loaded 54355 existing records from primary storage. [2025-10-06T20:29:47.908502] [INFO ] [MAIN ] NLY: Loaded 54355 existing records. [2025-10-06T20:29:48.089107] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:29:48.089342] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-06T20:29:48.089389] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-06T20:29:48.089837] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-10-06T20:29:48.089896] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-06T20:29:48.353090] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T20:29:48.460357] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:29:48.625518] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-06T20:29:48.685029] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T20:29:49.425586] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-06T20:29:50.225593] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-06T20:29:50.625477] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T20:29:50.779993] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-06T20:29:50.961798] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T20:29:51.025534] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-06T20:29:51.713459] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-06T20:29:51.825478] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-06T20:29:52.556405] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T20:29:52.625477] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-06T20:29:53.354895] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T20:29:53.425498] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-06T20:29:54.211566] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-06T20:29:54.225487] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-06T20:29:55.016733] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-06T20:29:55.025465] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-06T20:29:55.598627] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T20:29:55.599400] [INFO ] [REMOTE ] NL: Full fetch complete (6795 records). [2025-10-06T20:29:55.599468] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-06T20:29:55.776072] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T20:29:55.776330] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:29:55.776417] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:29:55.776512] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-06T20:29:55.776593] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-06T20:29:55.776632] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-06T20:29:55.776728] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-06T20:29:55.776815] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NL took 16.7s. Estimated remaining: 2h 4m 5s. Rate: 7.1 symbols/min [2025-10-06T20:29:55.830813] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-06T20:29:55.947845] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:29:55.962772] [DEBUG] [LOCAL ] NMAI: Loaded 13073 existing records from primary storage. [2025-10-06T20:29:55.963003] [INFO ] [MAIN ] NMAI: Loaded 13073 existing records. [2025-10-06T20:29:56.140917] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:29:56.141162] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-06T20:29:56.141212] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-06T20:29:56.141414] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-06T20:29:56.141474] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-06T20:29:56.515157] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:29:56.625532] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-06T20:29:57.025192] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T20:29:57.425591] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-06T20:29:58.225510] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-06T20:29:58.424113] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T20:29:58.459804] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-06T20:29:58.881214] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-06T20:29:59.025560] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-06T20:29:59.825555] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-06T20:30:00.220135] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T20:30:00.625544] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-06T20:30:00.699748] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T20:30:01.425532] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-06T20:30:02.225553] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-06T20:30:02.413795] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T20:30:02.455761] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T20:30:03.025567] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-06T20:30:03.339694] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T20:30:03.825539] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-06T20:30:04.193213] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T20:30:04.625532] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-06T20:30:04.690281] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T20:30:04.692043] [INFO ] [REMOTE ] NKX: Full fetch complete (19429 records). [2025-10-06T20:30:04.692146] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-06T20:30:05.134834] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-06T20:30:05.134941] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-06T20:30:05.135382] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-06T20:30:05.135425] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-06T20:30:05.136362] [DEBUG] [LOCAL ] NKX: Trimmed 19429 records to 13646 (keeping 200 days of data) [2025-10-06T20:30:05.218938] [DEBUG] [LOCAL ] NKX: Primary data saved (13646 records). [2025-10-06T20:30:05.219087] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-06T20:30:05.219188] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NKX took 37.4s. Estimated remaining: 2h 3m 57s. Rate: 7.1 symbols/min [2025-10-06T20:30:05.388787] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:30:05.388998] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-06T20:30:05.389036] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-06T20:30:05.389150] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-06T20:30:05.389190] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-06T20:30:05.389228] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-06T20:30:05.389258] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-06T20:30:05.435460] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-06T20:30:05.754459] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:30:05.820994] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T20:30:06.225586] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-06T20:30:06.687022] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T20:30:07.025588] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-06T20:30:07.621296] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T20:30:07.825523] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-06T20:30:08.162369] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:30:08.162771] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-06T20:30:08.162920] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:30:08.162998] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-06T20:30:08.163084] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:30:08.163182] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-06T20:30:08.163305] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-06T20:30:08.163361] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-06T20:30:08.163405] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-06T20:30:08.163490] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NMAX took 2.9s. Estimated remaining: 2h 3m 46s. Rate: 7.1 symbols/min [2025-10-06T20:30:08.300229] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-06T20:30:08.352743] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:30:08.371963] [DEBUG] [LOCAL ] NMCO: Loaded 17047 existing records from primary storage. [2025-10-06T20:30:08.372228] [INFO ] [MAIN ] NMCO: Loaded 17047 existing records. [2025-10-06T20:30:08.552721] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:30:08.552980] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-06T20:30:08.553030] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-06T20:30:08.553269] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-10-06T20:30:08.553326] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-06T20:30:08.630799] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-06T20:30:08.928477] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:30:09.425556] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-06T20:30:10.225574] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-06T20:30:10.349874] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-06T20:30:10.881712] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-06T20:30:11.025523] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-06T20:30:11.454170] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T20:30:11.825539] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-06T20:30:12.115746] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T20:30:12.625545] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-06T20:30:12.851882] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T20:30:13.425528] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-06T20:30:14.225538] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-06T20:30:14.364782] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T20:30:14.631712] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T20:30:15.025526] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-06T20:30:15.169358] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T20:30:15.825516] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-06T20:30:16.625510] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-06T20:30:16.766451] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T20:30:17.020065] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-06T20:30:17.425521] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-06T20:30:17.526921] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T20:30:18.225527] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-06T20:30:18.560054] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T20:30:19.025538] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-06T20:30:19.793706] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T20:30:19.794826] [INFO ] [REMOTE ] NLOP: Full fetch complete (17770 records). [2025-10-06T20:30:19.794936] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-06T20:30:19.828747] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-06T20:30:20.176176] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-10-06T20:30:20.176289] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-10-06T20:30:20.176770] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-10-06T20:30:20.176857] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-10-06T20:30:20.177660] [DEBUG] [LOCAL ] NLOP: Trimmed 17770 records to 11756 (keeping 200 days of data) [2025-10-06T20:30:20.261409] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-06T20:30:20.298523] [DEBUG] [LOCAL ] NLOP: Primary data saved (11756 records). [2025-10-06T20:30:20.298808] [INFO ] [MAIN ] NLOP: Full history saved. [2025-10-06T20:30:20.298936] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NLOP took 35.9s. Estimated remaining: 2h 3m 39s. Rate: 7.1 symbols/min [2025-10-06T20:30:20.487777] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:30:20.501422] [DEBUG] [LOCAL ] NMG: Loaded 8496 existing records from primary storage. [2025-10-06T20:30:20.501806] [INFO ] [MAIN ] NMG: Loaded 8496 existing records. [2025-10-06T20:30:20.630604] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-06T20:30:20.709921] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:30:20.711240] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-06T20:30:20.712552] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-06T20:30:20.712436] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T20:30:20.716621] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-06T20:30:20.717035] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-06T20:30:21.077393] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:30:21.425532] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-06T20:30:22.225552] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-06T20:30:22.406921] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T20:30:22.794496] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-06T20:30:23.025547] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-06T20:30:23.315618] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-06T20:30:23.825496] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-06T20:30:24.050807] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T20:30:24.625524] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-06T20:30:25.425488] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-06T20:30:25.648322] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T20:30:25.907062] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-06T20:30:26.225529] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-06T20:30:26.461217] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T20:30:27.025495] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-06T20:30:27.246859] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T20:30:27.825505] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-06T20:30:28.081757] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-06T20:30:28.625547] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-06T20:30:29.424725] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T20:30:29.427157] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-06T20:30:30.165588] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-06T20:30:30.222590] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-06T20:30:30.225458] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-06T20:30:31.025493] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-06T20:30:31.033768] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T20:30:31.825526] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-06T20:30:32.226630] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-06T20:30:32.625491] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-06T20:30:32.650969] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-06T20:30:33.414695] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T20:30:33.425480] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-06T20:30:34.176258] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-06T20:30:34.177799] [INFO ] [REMOTE ] NMAI: Full fetch complete (19939 records). [2025-10-06T20:30:34.177881] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-06T20:30:34.231351] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-06T20:30:34.572214] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-06T20:30:34.572315] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-06T20:30:34.573032] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-06T20:30:34.573097] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-06T20:30:34.573911] [DEBUG] [LOCAL ] NMAI: Trimmed 19939 records to 12867 (keeping 200 days of data) [2025-10-06T20:30:34.663017] [DEBUG] [LOCAL ] NMAI: Primary data saved (12867 records). [2025-10-06T20:30:34.663232] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-06T20:30:34.663341] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NMAI took 38.9s. Estimated remaining: 2h 3m 34s. Rate: 7.1 symbols/min [2025-10-06T20:30:34.850336] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:30:34.859422] [DEBUG] [LOCAL ] NMI: Loaded 4096 existing records from primary storage. [2025-10-06T20:30:34.859770] [INFO ] [MAIN ] NMI: Loaded 4096 existing records. [2025-10-06T20:30:35.050868] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-06T20:30:35.057802] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:30:35.059591] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-06T20:30:35.059677] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-06T20:30:35.059941] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-06T20:30:35.060001] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-06T20:30:35.474067] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:30:35.825499] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-06T20:30:35.897578] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-06T20:30:35.979904] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-06T20:30:35.983121] [INFO ] [REMOTE ] NLY: Full fetch complete (77565 records). [2025-10-06T20:30:35.983265] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-06T20:30:36.387611] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-10-06T20:30:36.387734] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-10-06T20:30:36.388841] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-10-06T20:30:36.388908] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-10-06T20:30:36.390432] [DEBUG] [LOCAL ] NLY: Trimmed 77565 records to 53575 (keeping 200 days of data) [2025-10-06T20:30:36.625782] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-06T20:30:36.735707] [DEBUG] [LOCAL ] NLY: Primary data saved (53575 records). [2025-10-06T20:30:36.735896] [INFO ] [MAIN ] NLY: Full history saved. [2025-10-06T20:30:36.736030] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NLY took 49.0s. Estimated remaining: 2h 3m 22s. Rate: 7.1 symbols/min [2025-10-06T20:30:36.911805] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:30:36.929572] [DEBUG] [LOCAL ] NMM: Loaded 14505 existing records from primary storage. [2025-10-06T20:30:36.929986] [INFO ] [MAIN ] NMM: Loaded 14505 existing records. [2025-10-06T20:30:37.066701] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T20:30:37.138007] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:30:37.138249] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-06T20:30:37.138298] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-06T20:30:37.138499] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-10-06T20:30:37.138557] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-06T20:30:37.430806] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-06T20:30:37.472384] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T20:30:37.531277] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:30:38.225486] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-06T20:30:38.370676] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-06T20:30:39.025487] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-06T20:30:39.263721] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T20:30:39.825500] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-06T20:30:39.923046] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-06T20:30:40.625595] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-06T20:30:41.066927] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T20:30:41.288235] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T20:30:41.289616] [INFO ] [REMOTE ] NMCO: Full fetch complete (24173 records). [2025-10-06T20:30:41.289714] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-06T20:30:41.431845] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-06T20:30:41.662869] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-10-06T20:30:41.662961] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-10-06T20:30:41.663471] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-10-06T20:30:41.663541] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-10-06T20:30:41.664287] [DEBUG] [LOCAL ] NMCO: Trimmed 24173 records to 16847 (keeping 200 days of data) [2025-10-06T20:30:41.767147] [DEBUG] [LOCAL ] NMCO: Primary data saved (16847 records). [2025-10-06T20:30:41.767342] [INFO ] [MAIN ] NMCO: Full history saved. [2025-10-06T20:30:41.767448] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NMCO took 33.6s. Estimated remaining: 2h 3m 12s. Rate: 7.1 symbols/min [2025-10-06T20:30:41.934203] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:30:41.968399] [DEBUG] [LOCAL ] NMR: Loaded 35491 existing records from primary storage. [2025-10-06T20:30:41.968718] [INFO ] [MAIN ] NMR: Loaded 35491 existing records. [2025-10-06T20:30:42.141425] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:30:42.141675] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-06T20:30:42.141734] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-06T20:30:42.142001] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-06T20:30:42.142058] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-06T20:30:42.233919] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-06T20:30:42.535052] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:30:42.657089] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T20:30:43.025551] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-06T20:30:43.194187] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T20:30:43.825544] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-06T20:30:44.257875] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T20:30:44.625559] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-06T20:30:44.951801] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T20:30:45.391597] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T20:30:45.394161] [INFO ] [REMOTE ] NMG: Full fetch complete (13585 records). [2025-10-06T20:30:45.394281] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-06T20:30:45.430743] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-06T20:30:46.002532] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-06T20:30:46.002680] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-06T20:30:46.003284] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-06T20:30:46.003351] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-06T20:30:46.004275] [DEBUG] [LOCAL ] NMG: Trimmed 13585 records to 8586 (keeping 200 days of data) [2025-10-06T20:30:46.078887] [DEBUG] [LOCAL ] NMG: Primary data saved (8586 records). [2025-10-06T20:30:46.079098] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-06T20:30:46.079216] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMG took 25.8s. Estimated remaining: 2h 3m 1s. Rate: 7.1 symbols/min [2025-10-06T20:30:46.230756] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-06T20:30:46.306394] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:30:46.313520] [DEBUG] [LOCAL ] NMS: Loaded 2885 existing records from primary storage. [2025-10-06T20:30:46.313889] [INFO ] [MAIN ] NMS: Loaded 2885 existing records. [2025-10-06T20:30:46.548794] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:30:46.549102] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-06T20:30:46.549175] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-06T20:30:46.549404] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-06T20:30:46.549507] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-06T20:30:46.707270] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T20:30:46.964615] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:30:47.025542] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-06T20:30:47.103058] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T20:30:47.664367] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-06T20:30:47.825512] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-06T20:30:48.455878] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T20:30:48.625577] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-06T20:30:49.425520] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-06T20:30:50.153868] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T20:30:50.210805] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T20:30:50.225471] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-06T20:30:51.025537] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-06T20:30:51.832517] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-06T20:30:51.838884] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T20:30:52.259506] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T20:30:52.545254] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-06T20:30:52.625547] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-06T20:30:53.245553] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T20:30:53.425498] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-06T20:30:54.154082] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T20:30:54.225530] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-06T20:30:54.985988] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-06T20:30:55.025579] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-06T20:30:55.825498] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-06T20:30:55.976136] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-06T20:30:56.347280] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-06T20:30:56.625526] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-06T20:30:57.425558] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-06T20:30:57.631677] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T20:30:57.974804] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-06T20:30:58.225512] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-06T20:30:59.025494] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-06T20:30:59.177825] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T20:30:59.532496] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-06T20:30:59.825525] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-06T20:31:00.602325] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T20:31:00.625486] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-06T20:31:01.425524] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-06T20:31:01.509257] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T20:31:02.225543] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-06T20:31:02.736777] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T20:31:02.899022] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-06T20:31:03.025528] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-06T20:31:03.825555] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-06T20:31:04.078440] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T20:31:04.511211] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T20:31:04.625563] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-06T20:31:05.190485] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-06T20:31:05.425532] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-06T20:31:06.225538] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-06T20:31:06.929887] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-06T20:31:07.025504] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-06T20:31:07.221476] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T20:31:07.825524] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-06T20:31:08.005968] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T20:31:08.430800] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-06T20:31:08.625545] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-06T20:31:09.086688] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T20:31:09.087408] [INFO ] [REMOTE ] NMS: Full fetch complete (4028 records). [2025-10-06T20:31:09.087477] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-06T20:31:09.430813] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-06T20:31:09.474266] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-06T20:31:09.474408] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-06T20:31:09.474671] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-06T20:31:09.474736] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-06T20:31:09.475172] [DEBUG] [LOCAL ] NMS: Trimmed 4028 records to 2855 (keeping 200 days of data) [2025-10-06T20:31:09.494974] [DEBUG] [LOCAL ] NMS: Primary data saved (2855 records). [2025-10-06T20:31:09.495149] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-06T20:31:09.495304] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NMS took 23.4s. Estimated remaining: 2h 3m 1s. Rate: 7.1 symbols/min [2025-10-06T20:31:09.670440] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:31:09.677220] [DEBUG] [LOCAL ] NMT: Loaded 2905 existing records from primary storage. [2025-10-06T20:31:09.677473] [INFO ] [MAIN ] NMT: Loaded 2905 existing records. [2025-10-06T20:31:09.862618] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:31:09.862995] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-06T20:31:09.863045] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-06T20:31:09.863278] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-06T20:31:09.863336] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-06T20:31:10.238804] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-06T20:31:10.238729] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T20:31:10.245028] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:31:10.248262] [INFO ] [REMOTE ] NMM: Full fetch complete (21877 records). [2025-10-06T20:31:10.248372] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-06T20:31:10.611491] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-10-06T20:31:10.611576] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-10-06T20:31:10.612162] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-10-06T20:31:10.612226] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-10-06T20:31:10.612908] [DEBUG] [LOCAL ] NMM: Trimmed 21877 records to 14408 (keeping 200 days of data) [2025-10-06T20:31:10.702584] [DEBUG] [LOCAL ] NMM: Primary data saved (14408 records). [2025-10-06T20:31:10.702763] [INFO ] [MAIN ] NMM: Full history saved. [2025-10-06T20:31:10.702860] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMM took 34.0s. Estimated remaining: 2h 2m 48s. Rate: 7.1 symbols/min [2025-10-06T20:31:10.872801] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:31:10.895992] [DEBUG] [LOCAL ] NMZ: Loaded 22014 existing records from primary storage. [2025-10-06T20:31:10.896302] [INFO ] [MAIN ] NMZ: Loaded 22014 existing records. [2025-10-06T20:31:11.030769] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-06T20:31:11.087620] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:31:11.087868] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-06T20:31:11.087940] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-06T20:31:11.088161] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-10-06T20:31:11.088220] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-06T20:31:11.447132] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:31:11.825486] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-06T20:31:11.872133] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T20:31:11.892771] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-06T20:31:12.625565] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-06T20:31:13.089000] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T20:31:13.280442] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-06T20:31:13.425587] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-06T20:31:14.225538] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-06T20:31:14.857956] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-06T20:31:14.917431] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T20:31:15.025547] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-06T20:31:15.598202] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T20:31:15.825538] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-06T20:31:16.624774] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-06T20:31:16.626275] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-06T20:31:17.425509] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-06T20:31:18.087603] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-06T20:31:18.130901] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T20:31:18.225478] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-06T20:31:19.025553] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-06T20:31:19.662865] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-06T20:31:19.807361] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T20:31:19.825484] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-06T20:31:20.625596] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-06T20:31:21.308199] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T20:31:21.425503] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-06T20:31:21.790192] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T20:31:22.016664] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-06T20:31:22.225524] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-06T20:31:23.025527] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-06T20:31:23.501337] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-06T20:31:23.532375] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T20:31:23.533143] [INFO ] [REMOTE ] NMI: Full fetch complete (6022 records). [2025-10-06T20:31:23.533212] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-06T20:31:23.830673] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-06T20:31:23.940904] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-06T20:31:23.940986] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-06T20:31:23.941169] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-06T20:31:23.941208] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-06T20:31:23.941574] [DEBUG] [LOCAL ] NMI: Trimmed 6022 records to 4055 (keeping 200 days of data) [2025-10-06T20:31:23.968938] [DEBUG] [LOCAL ] NMI: Primary data saved (4055 records). [2025-10-06T20:31:23.969081] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-06T20:31:23.969197] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMI took 49.3s. Estimated remaining: 2h 2m 43s. Rate: 7.1 symbols/min [2025-10-06T20:31:24.136136] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:31:24.151719] [DEBUG] [LOCAL ] NNI: Loaded 10353 existing records from primary storage. [2025-10-06T20:31:24.151974] [INFO ] [MAIN ] NNI: Loaded 10353 existing records. [2025-10-06T20:31:24.329534] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:31:24.329820] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-06T20:31:24.329869] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-06T20:31:24.330076] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-06T20:31:24.330132] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-06T20:31:24.631415] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-06T20:31:24.688583] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:31:25.024229] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-06T20:31:25.316230] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-06T20:31:25.425511] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-06T20:31:26.225511] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-06T20:31:26.309250] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-06T20:31:27.025546] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-06T20:31:27.301492] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T20:31:27.303833] [INFO ] [REMOTE ] NMR: Full fetch complete (50774 records). [2025-10-06T20:31:27.303915] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-06T20:31:27.718852] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-06T20:31:27.718934] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-06T20:31:27.719868] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-06T20:31:27.719930] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-06T20:31:27.721003] [DEBUG] [LOCAL ] NMR: Trimmed 50774 records to 35092 (keeping 200 days of data) [2025-10-06T20:31:27.820800] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T20:31:27.825493] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-06T20:31:27.928346] [DEBUG] [LOCAL ] NMR: Primary data saved (35092 records). [2025-10-06T20:31:27.928527] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-06T20:31:27.928628] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMR took 46.2s. Estimated remaining: 2h 2m 32s. Rate: 7.1 symbols/min [2025-10-06T20:31:28.096244] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:31:28.139033] [DEBUG] [LOCAL ] NNN: Loaded 49066 existing records from primary storage. [2025-10-06T20:31:28.139350] [INFO ] [MAIN ] NNN: Loaded 49066 existing records. [2025-10-06T20:31:28.313849] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:31:28.314076] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-06T20:31:28.314122] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-06T20:31:28.314373] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-10-06T20:31:28.314430] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-06T20:31:28.577561] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T20:31:28.633691] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-06T20:31:28.715188] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:31:29.425560] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-06T20:31:29.454404] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T20:31:29.819883] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-06T20:31:29.820618] [INFO ] [REMOTE ] NMT: Full fetch complete (4087 records). [2025-10-06T20:31:29.820710] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-06T20:31:30.182526] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-06T20:31:30.182608] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-06T20:31:30.182838] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-06T20:31:30.182890] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-06T20:31:30.183240] [DEBUG] [LOCAL ] NMT: Trimmed 4087 records to 2867 (keeping 200 days of data) [2025-10-06T20:31:30.201024] [DEBUG] [LOCAL ] NMT: Primary data saved (2867 records). [2025-10-06T20:31:30.201102] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-06T20:31:30.201175] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMT took 20.7s. Estimated remaining: 2h 2m 20s. Rate: 7.1 symbols/min [2025-10-06T20:31:30.230766] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-06T20:31:30.376717] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:31:30.384527] [DEBUG] [LOCAL ] NNY: Loaded 5784 existing records from primary storage. [2025-10-06T20:31:30.384793] [INFO ] [MAIN ] NNY: Loaded 5784 existing records. [2025-10-06T20:31:30.558559] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:31:30.558754] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-06T20:31:30.558803] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-06T20:31:30.558985] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-06T20:31:30.559041] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-06T20:31:30.907742] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:31:31.025471] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-06T20:31:31.718989] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T20:31:31.825508] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-06T20:31:31.940697] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T20:31:32.625506] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-06T20:31:32.947494] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-06T20:31:33.351848] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T20:31:33.425608] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-06T20:31:34.185219] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T20:31:34.225589] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-06T20:31:35.025493] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-06T20:31:35.400808] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T20:31:35.825540] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-06T20:31:36.618820] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T20:31:36.628076] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-06T20:31:37.217950] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T20:31:37.425540] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-06T20:31:37.478529] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T20:31:38.225958] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-06T20:31:38.229456] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T20:31:39.025546] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-06T20:31:39.346500] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T20:31:39.825549] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-06T20:31:40.625550] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-06T20:31:40.934162] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-06T20:31:41.282405] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T20:31:41.425556] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-06T20:31:41.520416] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-06T20:31:42.225536] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-06T20:31:42.333697] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-06T20:31:42.946062] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-06T20:31:42.947600] [INFO ] [REMOTE ] NMZ: Full fetch complete (31800 records). [2025-10-06T20:31:42.947765] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-06T20:31:43.030630] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-06T20:31:43.319828] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-06T20:31:43.319913] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-06T20:31:43.320687] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-06T20:31:43.320752] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-06T20:31:43.321517] [DEBUG] [LOCAL ] NMZ: Trimmed 31800 records to 21640 (keeping 200 days of data) [2025-10-06T20:31:43.459461] [DEBUG] [LOCAL ] NMZ: Primary data saved (21640 records). [2025-10-06T20:31:43.459599] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-06T20:31:43.459735] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NMZ took 32.8s. Estimated remaining: 2h 2m 14s. Rate: 7.1 symbols/min [2025-10-06T20:31:43.637803] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:31:43.655992] [DEBUG] [LOCAL ] NOA: Loaded 16385 existing records from primary storage. [2025-10-06T20:31:43.656245] [INFO ] [MAIN ] NOA: Loaded 16385 existing records. [2025-10-06T20:31:43.833709] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-06T20:31:43.839382] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:31:43.840321] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-06T20:31:43.840371] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-06T20:31:43.840561] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-10-06T20:31:43.840619] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-06T20:31:44.070010] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T20:31:44.210779] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:31:44.625500] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-06T20:31:44.696429] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T20:31:45.425519] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-06T20:31:46.225493] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-06T20:31:46.459139] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T20:31:46.504451] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-06T20:31:46.917778] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T20:31:47.025533] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-06T20:31:47.825535] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-06T20:31:47.999360] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T20:31:48.625547] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-06T20:31:49.425502] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-06T20:31:49.636595] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T20:31:49.676242] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T20:31:50.225496] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-06T20:31:50.497167] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T20:31:50.900637] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-06T20:31:51.025620] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-06T20:31:51.540538] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-06T20:31:51.825528] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-06T20:31:52.625506] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-06T20:31:53.360788] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-06T20:31:53.425478] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-06T20:31:53.699455] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T20:31:54.040914] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-06T20:31:54.041828] [INFO ] [REMOTE ] NNY: Full fetch complete (8743 records). [2025-10-06T20:31:54.041900] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-06T20:31:54.232814] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-06T20:31:54.411459] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-06T20:31:54.411538] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-06T20:31:54.411783] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-06T20:31:54.411844] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-06T20:31:54.412253] [DEBUG] [LOCAL ] NNY: Trimmed 8743 records to 5717 (keeping 200 days of data) [2025-10-06T20:31:54.446624] [DEBUG] [LOCAL ] NNY: Primary data saved (5717 records). [2025-10-06T20:31:54.446779] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-06T20:31:54.446863] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NNY took 24.2s. Estimated remaining: 2h 2m 7s. Rate: 7.1 symbols/min [2025-10-06T20:31:54.617367] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:31:54.640237] [DEBUG] [LOCAL ] NOAH: Loaded 20616 existing records from primary storage. [2025-10-06T20:31:54.640504] [INFO ] [MAIN ] NOAH: Loaded 20616 existing records. [2025-10-06T20:31:54.816243] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:31:54.816495] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-06T20:31:54.816544] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-06T20:31:54.816784] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-10-06T20:31:54.816850] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-06T20:31:55.030714] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-06T20:31:55.182518] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:31:55.285095] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T20:31:55.825520] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-06T20:31:56.625568] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-06T20:31:56.874586] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T20:31:56.902077] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T20:31:57.425499] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-06T20:31:57.567266] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T20:31:58.225528] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-06T20:31:59.025540] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-06T20:31:59.724263] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T20:31:59.825478] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-06T20:31:59.925333] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-06T20:32:00.100464] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-06T20:32:00.625537] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-06T20:32:00.916492] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T20:32:01.425522] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-06T20:32:02.225509] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-06T20:32:02.455458] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T20:32:02.561706] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-06T20:32:03.025546] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-06T20:32:03.272718] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T20:32:03.825544] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-06T20:32:04.035314] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T20:32:04.594812] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T20:32:04.596094] [INFO ] [REMOTE ] NNI: Full fetch complete (12931 records). [2025-10-06T20:32:04.596166] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-06T20:32:04.630589] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-06T20:32:04.961866] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-06T20:32:04.961962] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-06T20:32:04.962272] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-06T20:32:04.962315] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-06T20:32:04.962849] [DEBUG] [LOCAL ] NNI: Trimmed 12931 records to 10305 (keeping 200 days of data) [2025-10-06T20:32:05.026402] [DEBUG] [LOCAL ] NNI: Primary data saved (10305 records). [2025-10-06T20:32:05.026543] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-06T20:32:05.026623] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNI took 41.1s. Estimated remaining: 2h 1m 60s. Rate: 7.1 symbols/min [2025-10-06T20:32:05.214574] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:32:05.261010] [DEBUG] [LOCAL ] NOC: Loaded 42554 existing records from primary storage. [2025-10-06T20:32:05.261362] [INFO ] [MAIN ] NOC: Loaded 42554 existing records. [2025-10-06T20:32:05.431728] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-06T20:32:05.438497] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:32:05.440272] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-06T20:32:05.440328] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-06T20:32:05.440973] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-10-06T20:32:05.441031] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-06T20:32:05.810598] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:32:05.824777] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T20:32:06.225605] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-06T20:32:06.880321] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T20:32:07.025549] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-06T20:32:07.825526] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-06T20:32:07.996868] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T20:32:08.180382] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T20:32:08.625532] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-06T20:32:09.378488] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-06T20:32:09.425497] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-06T20:32:10.225591] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-06T20:32:10.474000] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T20:32:10.533035] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T20:32:11.025537] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-06T20:32:11.825578] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-06T20:32:12.137108] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-06T20:32:12.368542] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T20:32:12.625483] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-06T20:32:12.741674] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-06T20:32:13.425568] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-06T20:32:14.098842] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T20:32:14.101758] [INFO ] [REMOTE ] NNN: Full fetch complete (70356 records). [2025-10-06T20:32:14.101863] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-06T20:32:14.230690] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-06T20:32:14.520254] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-10-06T20:32:14.520343] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-10-06T20:32:14.521499] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-10-06T20:32:14.521701] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-10-06T20:32:14.523235] [DEBUG] [LOCAL ] NNN: Trimmed 70356 records to 48402 (keeping 200 days of data) [2025-10-06T20:32:14.625048] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-06T20:32:14.846684] [DEBUG] [LOCAL ] NNN: Primary data saved (48402 records). [2025-10-06T20:32:14.846867] [INFO ] [MAIN ] NNN: Full history saved. [2025-10-06T20:32:14.846964] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NNN took 46.9s. Estimated remaining: 2h 1m 52s. Rate: 7.1 symbols/min [2025-10-06T20:32:15.031403] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-06T20:32:15.041618] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:32:15.091490] [DEBUG] [LOCAL ] NOG: Loaded 51954 existing records from primary storage. [2025-10-06T20:32:15.091893] [INFO ] [MAIN ] NOG: Loaded 51954 existing records. [2025-10-06T20:32:15.286049] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:32:15.286419] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-06T20:32:15.286497] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-06T20:32:15.286849] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-10-06T20:32:15.286950] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-06T20:32:15.423788] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T20:32:15.681087] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:32:15.825584] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-06T20:32:16.286710] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T20:32:16.625521] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-06T20:32:16.873689] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-06T20:32:17.425536] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-06T20:32:18.073376] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T20:32:18.225536] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-06T20:32:18.750809] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T20:32:19.025555] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-06T20:32:19.775012] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T20:32:19.825478] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-06T20:32:20.296482] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T20:32:20.625527] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-06T20:32:20.956465] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T20:32:20.958144] [INFO ] [REMOTE ] NOAH: Full fetch complete (28338 records). [2025-10-06T20:32:20.958244] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-06T20:32:21.330973] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-10-06T20:32:21.331151] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-10-06T20:32:21.331864] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-10-06T20:32:21.331933] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-10-06T20:32:21.332832] [DEBUG] [LOCAL ] NOAH: Trimmed 28338 records to 20440 (keeping 200 days of data) [2025-10-06T20:32:21.425803] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-06T20:32:21.460028] [DEBUG] [LOCAL ] NOAH: Primary data saved (20440 records). [2025-10-06T20:32:21.460167] [INFO ] [MAIN ] NOAH: Full history saved. [2025-10-06T20:32:21.460247] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NOAH took 27.0s. Estimated remaining: 2h 1m 43s. Rate: 7.1 symbols/min [2025-10-06T20:32:21.631146] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:32:21.661738] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-06T20:32:21.715148] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-10-06T20:32:21.715507] [INFO ] [MAIN ] NOK: Loaded 54401 existing records. [2025-10-06T20:32:21.890207] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:32:21.890448] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-06T20:32:21.890496] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-06T20:32:21.890746] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-06T20:32:21.890805] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-06T20:32:22.227669] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-06T20:32:22.248966] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:32:23.025528] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-06T20:32:23.137072] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T20:32:23.241892] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T20:32:23.825548] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-06T20:32:24.485406] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T20:32:24.625587] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-06T20:32:25.425517] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-06T20:32:25.773855] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T20:32:26.081104] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-06T20:32:26.225504] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-06T20:32:26.301330] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-06T20:32:26.302735] [INFO ] [REMOTE ] NOA: Full fetch complete (22094 records). [2025-10-06T20:32:26.302808] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-06T20:32:26.682638] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-10-06T20:32:26.682749] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-10-06T20:32:26.683244] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-10-06T20:32:26.683285] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-10-06T20:32:26.683977] [DEBUG] [LOCAL ] NOA: Trimmed 22094 records to 16143 (keeping 200 days of data) [2025-10-06T20:32:26.783987] [DEBUG] [LOCAL ] NOA: Primary data saved (16143 records). [2025-10-06T20:32:26.784142] [INFO ] [MAIN ] NOA: Full history saved. [2025-10-06T20:32:26.784225] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NOA took 43.3s. Estimated remaining: 2h 1m 32s. Rate: 7.1 symbols/min [2025-10-06T20:32:26.956578] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:32:26.956802] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-06T20:32:26.956846] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-06T20:32:26.956987] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-06T20:32:26.957027] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-06T20:32:26.957067] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-06T20:32:26.957096] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-06T20:32:27.030736] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-06T20:32:27.357281] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:32:27.825574] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-06T20:32:28.625615] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-06T20:32:28.710558] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-06T20:32:28.865249] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-06T20:32:29.095369] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-06T20:32:29.238026] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-06T20:32:29.425523] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-06T20:32:30.060442] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T20:32:30.225553] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-06T20:32:31.025632] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-06T20:32:31.531042] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-06T20:32:31.825548] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-06T20:32:32.140449] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T20:32:32.625582] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-06T20:32:33.425518] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-06T20:32:33.533872] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T20:32:33.899975] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-06T20:32:34.070354] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-06T20:32:34.225493] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-06T20:32:35.025581] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-06T20:32:35.612175] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T20:32:35.614009] [INFO ] [REMOTE ] NOC: Full fetch complete (61409 records). [2025-10-06T20:32:35.614229] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-06T20:32:35.614915] [FATAL] [VALIDATOR ] NOC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:32:35.615007] [FATAL] [MAIN ] NOC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:32:35.615051] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:32:35.615114] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-06T20:32:35.615213] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-06T20:32:35.615285] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-10-06T20:32:35.615522] [DEBUG] [LOCAL ] NOC: Deleted derivative data file. [2025-10-06T20:32:35.615619] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOC took 30.6s. Estimated remaining: 2h 1m 24s. Rate: 7.1 symbols/min [2025-10-06T20:32:35.807020] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:32:35.825528] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-06T20:32:35.863672] [DEBUG] [LOCAL ] NOMD: Loaded 42192 existing records from primary storage. [2025-10-06T20:32:35.863987] [INFO ] [MAIN ] NOMD: Loaded 42192 existing records. [2025-10-06T20:32:36.071265] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:32:36.071680] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-06T20:32:36.071808] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-06T20:32:36.072227] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-10-06T20:32:36.072286] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-06T20:32:36.447681] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:32:36.478302] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-06T20:32:36.625611] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-06T20:32:37.425536] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-06T20:32:38.189345] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-06T20:32:38.225574] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-06T20:32:38.420950] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T20:32:39.025553] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-06T20:32:39.083663] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T20:32:39.825612] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-06T20:32:40.279690] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-06T20:32:40.626031] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-06T20:32:40.625956] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T20:32:41.425486] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-06T20:32:41.681516] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T20:32:42.225551] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-06T20:32:42.459593] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T20:32:42.729757] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-06T20:32:42.819057] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T20:32:43.025568] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-06T20:32:43.825534] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-06T20:32:44.625581] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-06T20:32:44.838264] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-06T20:32:45.122691] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-06T20:32:45.425587] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-06T20:32:45.955672] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-06T20:32:46.225559] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-06T20:32:46.958899] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T20:32:47.025526] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-06T20:32:47.825539] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-06T20:32:48.324726] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-06T20:32:48.515678] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-06T20:32:48.625488] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-06T20:32:49.029154] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-06T20:32:49.425563] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-06T20:32:49.961009] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-06T20:32:50.225568] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-06T20:32:50.873406] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-06T20:32:50.908532] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-06T20:32:51.025558] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-06T20:32:51.825539] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-06T20:32:52.625521] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-06T20:32:53.200330] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-06T20:32:53.385841] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T20:32:53.425479] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-06T20:32:53.522945] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-06T20:32:53.889988] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T20:32:53.890690] [INFO ] [REMOTE ] NOM: Full fetch complete (1595 records). [2025-10-06T20:32:53.890762] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-06T20:32:54.073527] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-06T20:32:54.073793] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:32:54.073873] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:32:54.073926] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-06T20:32:54.073986] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-06T20:32:54.074030] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-06T20:32:54.074072] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-06T20:32:54.074131] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOM took 27.3s. Estimated remaining: 2h 1m 21s. Rate: 7.1 symbols/min [2025-10-06T20:32:54.234727] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-06T20:32:54.266968] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:32:54.306290] [DEBUG] [LOCAL ] NOTE: Loaded 42206 existing records from primary storage. [2025-10-06T20:32:54.306611] [INFO ] [MAIN ] NOTE: Loaded 42206 existing records. [2025-10-06T20:32:54.481789] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:32:54.482023] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-06T20:32:54.482069] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-06T20:32:54.482297] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-06T20:32:54.482360] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-06T20:32:54.841881] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:32:55.025558] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-06T20:32:55.825529] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-06T20:32:56.113362] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-06T20:32:56.116422] [INFO ] [REMOTE ] NOK: Full fetch complete (77637 records). [2025-10-06T20:32:56.116553] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-06T20:32:56.512928] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-06T20:32:56.513031] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-06T20:32:56.514125] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-06T20:32:56.514201] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-06T20:32:56.515696] [DEBUG] [LOCAL ] NOK: Trimmed 77637 records to 53621 (keeping 200 days of data) [2025-10-06T20:32:56.625507] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-06T20:32:56.827152] [DEBUG] [LOCAL ] NOK: Primary data saved (53621 records). [2025-10-06T20:32:56.827288] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-06T20:32:56.827370] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOK took 35.4s. Estimated remaining: 2h 1m 10s. Rate: 7.1 symbols/min [2025-10-06T20:32:57.002288] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:32:57.054132] [DEBUG] [LOCAL ] NOV: Loaded 53958 existing records from primary storage. [2025-10-06T20:32:57.054465] [INFO ] [MAIN ] NOV: Loaded 53958 existing records. [2025-10-06T20:32:57.243329] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:32:57.260232] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-06T20:32:57.260386] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-06T20:32:57.261103] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-10-06T20:32:57.261187] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-06T20:32:57.262200] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-06T20:32:57.446406] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-06T20:32:57.634108] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:32:57.663263] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T20:32:58.225501] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-06T20:32:58.333809] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T20:32:59.025567] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-06T20:32:59.557536] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-06T20:32:59.825483] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-06T20:32:59.940486] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T20:33:00.625514] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-06T20:33:01.110460] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-06T20:33:01.425549] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-06T20:33:01.512788] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T20:33:02.146116] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-06T20:33:02.149165] [INFO ] [REMOTE ] NOG: Full fetch complete (73929 records). [2025-10-06T20:33:02.149304] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-06T20:33:02.230685] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-06T20:33:02.567472] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-10-06T20:33:02.567586] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-10-06T20:33:02.568689] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-10-06T20:33:02.568770] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-10-06T20:33:02.570222] [DEBUG] [LOCAL ] NOG: Trimmed 73929 records to 51233 (keeping 200 days of data) [2025-10-06T20:33:02.890640] [DEBUG] [LOCAL ] NOG: Primary data saved (51233 records). [2025-10-06T20:33:02.890833] [INFO ] [MAIN ] NOG: Full history saved. [2025-10-06T20:33:02.890922] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NOG took 48.0s. Estimated remaining: 2h 0m 60s. Rate: 7.1 symbols/min [2025-10-06T20:33:03.030817] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-06T20:33:03.063771] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:33:03.064097] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-06T20:33:03.064199] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-06T20:33:03.064387] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-06T20:33:03.064442] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-06T20:33:03.064486] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-06T20:33:03.064518] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-06T20:33:03.496173] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:33:03.498682] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-06T20:33:03.825530] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-06T20:33:04.068205] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T20:33:04.625555] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-06T20:33:05.220232] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-06T20:33:05.425505] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-06T20:33:05.778058] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-06T20:33:06.225620] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-06T20:33:06.321806] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T20:33:07.025497] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-06T20:33:07.343145] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-06T20:33:07.825550] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-06T20:33:08.090550] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T20:33:08.625528] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-06T20:33:09.230445] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-06T20:33:09.425503] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-06T20:33:09.631093] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T20:33:09.972446] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T20:33:10.225536] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-06T20:33:11.025479] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-06T20:33:11.363146] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T20:33:11.573416] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T20:33:11.576383] [INFO ] [REMOTE ] NOMD: Full fetch complete (59441 records). [2025-10-06T20:33:11.576519] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-06T20:33:11.830779] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-06T20:33:11.956915] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-10-06T20:33:11.957015] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-10-06T20:33:11.958031] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-10-06T20:33:11.958103] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-10-06T20:33:11.959505] [DEBUG] [LOCAL ] NOMD: Trimmed 59441 records to 41837 (keeping 200 days of data) [2025-10-06T20:33:12.219527] [DEBUG] [LOCAL ] NOMD: Primary data saved (41837 records). [2025-10-06T20:33:12.219690] [INFO ] [MAIN ] NOMD: Full history saved. [2025-10-06T20:33:12.219788] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOMD took 36.6s. Estimated remaining: 2h 0m 52s. Rate: 7.1 symbols/min [2025-10-06T20:33:12.385211] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:33:12.385396] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-06T20:33:12.385482] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-06T20:33:12.385562] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-06T20:33:12.385598] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-06T20:33:12.385638] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-06T20:33:12.385713] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-06T20:33:12.628983] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-06T20:33:12.743477] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:33:12.832789] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T20:33:12.969323] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T20:33:13.425578] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-06T20:33:14.225487] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-06T20:33:14.545676] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T20:33:14.720016] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-06T20:33:15.025534] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-06T20:33:15.825487] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-06T20:33:16.268546] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-06T20:33:16.625531] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-06T20:33:16.766345] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T20:33:16.837160] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-06T20:33:16.968596] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:33:16.968958] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-06T20:33:16.969041] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:33:16.969092] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-06T20:33:16.969124] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:33:16.969158] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-06T20:33:16.969232] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-06T20:33:16.969303] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-06T20:33:16.969359] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-06T20:33:16.969406] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NP took 4.7s. Estimated remaining: 2h 0m 41s. Rate: 7.1 symbols/min [2025-10-06T20:33:17.135116] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:33:17.135313] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-06T20:33:17.135351] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-06T20:33:17.135461] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-06T20:33:17.135501] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-06T20:33:17.135540] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-06T20:33:17.135569] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-06T20:33:17.430697] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-06T20:33:17.484453] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:33:18.225547] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-06T20:33:18.563742] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T20:33:19.025587] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-06T20:33:19.825499] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-06T20:33:19.891002] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T20:33:20.123519] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:33:20.123926] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-06T20:33:20.124021] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:33:20.124112] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-06T20:33:20.124185] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:33:20.124277] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-06T20:33:20.124408] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-06T20:33:20.124473] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-06T20:33:20.124519] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-06T20:33:20.124569] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NPB took 3.2s. Estimated remaining: 2h 0m 30s. Rate: 7.1 symbols/min [2025-10-06T20:33:20.331817] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:33:20.365957] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T20:33:20.391842] [DEBUG] [LOCAL ] NPCT: Loaded 17236 existing records from primary storage. [2025-10-06T20:33:20.392231] [INFO ] [MAIN ] NPCT: Loaded 17236 existing records. [2025-10-06T20:33:20.584525] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:33:20.584880] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-06T20:33:20.584941] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-06T20:33:20.585293] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-10-06T20:33:20.585358] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-06T20:33:20.630743] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-06T20:33:20.970885] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:33:21.425502] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-06T20:33:21.577727] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T20:33:22.225612] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-06T20:33:23.025620] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-06T20:33:23.314244] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T20:33:23.825596] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-06T20:33:23.846155] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T20:33:24.204705] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-06T20:33:24.355159] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-06T20:33:24.625556] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-06T20:33:25.190346] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T20:33:25.425580] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-06T20:33:26.225580] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-06T20:33:27.025585] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-06T20:33:27.430738] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T20:33:27.491711] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-06T20:33:27.639831] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-06T20:33:27.825523] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-06T20:33:28.525554] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T20:33:28.528929] [INFO ] [REMOTE ] NOW: Full fetch complete (70354 records). [2025-10-06T20:33:28.529054] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-06T20:33:28.530050] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:33:28.530154] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:33:28.530207] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:33:28.530255] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-06T20:33:28.530328] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-06T20:33:28.530370] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-06T20:33:28.530433] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-10-06T20:33:28.530538] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NOW took 25.6s. Estimated remaining: 2h 0m 21s. Rate: 7.1 symbols/min [2025-10-06T20:33:28.630907] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-06T20:33:28.716066] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:33:28.728245] [DEBUG] [LOCAL ] NPFD: Loaded 9999 existing records from primary storage. [2025-10-06T20:33:28.728490] [INFO ] [MAIN ] NPFD: Loaded 9999 existing records. [2025-10-06T20:33:28.918568] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:33:28.918869] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-06T20:33:28.918918] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-06T20:33:28.919145] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-06T20:33:28.919204] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-06T20:33:29.304910] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:33:29.425500] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-06T20:33:29.805493] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T20:33:30.225499] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-06T20:33:30.572773] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T20:33:31.025576] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-06T20:33:31.771434] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T20:33:31.825522] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-06T20:33:32.022363] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T20:33:32.625499] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-06T20:33:32.782531] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-06T20:33:33.425528] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-06T20:33:33.977824] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T20:33:34.037106] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T20:33:34.225503] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-06T20:33:35.025576] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-06T20:33:35.151889] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T20:33:35.825521] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-06T20:33:36.161282] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T20:33:36.625549] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-06T20:33:36.939026] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T20:33:36.941026] [INFO ] [REMOTE ] NOTE: Full fetch complete (63295 records). [2025-10-06T20:33:36.941133] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-06T20:33:37.331235] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-06T20:33:37.331339] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-06T20:33:37.332328] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-06T20:33:37.332392] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-06T20:33:37.334259] [DEBUG] [LOCAL ] NOTE: Trimmed 63295 records to 41406 (keeping 200 days of data) [2025-10-06T20:33:37.427005] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-06T20:33:37.577105] [DEBUG] [LOCAL ] NOTE: Primary data saved (41406 records). [2025-10-06T20:33:37.577246] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-06T20:33:37.577354] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NOTE took 43.5s. Estimated remaining: 2h 0m 13s. Rate: 7.1 symbols/min [2025-10-06T20:33:38.148904] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-06T20:33:38.152031] [INFO ] [REMOTE ] NOV: Full fetch complete (76992 records). [2025-10-06T20:33:38.152165] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-06T20:33:38.229335] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-06T20:33:38.562051] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-10-06T20:33:38.562156] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-10-06T20:33:38.563689] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-10-06T20:33:38.563947] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-10-06T20:33:38.577276] [DEBUG] [LOCAL ] NOV: Trimmed 76992 records to 53178 (keeping 200 days of data) [2025-10-06T20:33:38.577766] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T20:33:38.935384] [DEBUG] [LOCAL ] NOV: Primary data saved (53178 records). [2025-10-06T20:33:38.935554] [INFO ] [MAIN ] NOV: Full history saved. [2025-10-06T20:33:38.935667] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NOV took 42.1s. Estimated remaining: 2h 0m 1s. Rate: 7.1 symbols/min [2025-10-06T20:33:39.025552] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-06T20:33:39.141068] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-06T20:33:39.825543] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-06T20:33:40.280574] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-06T20:33:40.625610] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-06T20:33:40.739456] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T20:33:41.425526] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-06T20:33:41.828334] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T20:33:42.028194] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T20:33:42.225550] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-06T20:33:43.025637] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-06T20:33:43.058206] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-06T20:33:43.825492] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-06T20:33:44.066193] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T20:33:44.625508] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-06T20:33:44.731894] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T20:33:45.425504] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-06T20:33:45.692116] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T20:33:46.225539] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-06T20:33:46.321702] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T20:33:46.323393] [INFO ] [REMOTE ] NPFD: Full fetch complete (14822 records). [2025-10-06T20:33:46.323488] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-06T20:33:46.704181] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-06T20:33:46.704281] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-06T20:33:46.704658] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-06T20:33:46.704721] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-06T20:33:46.705245] [DEBUG] [LOCAL ] NPFD: Trimmed 14822 records to 9877 (keeping 200 days of data) [2025-10-06T20:33:46.765223] [DEBUG] [LOCAL ] NPFD: Primary data saved (9877 records). [2025-10-06T20:33:46.765366] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-06T20:33:46.765449] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NPFD took 18.2s. Estimated remaining: 1h 59m 52s. Rate: 7.1 symbols/min [2025-10-06T20:33:47.400527] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T20:33:47.405100] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-06T20:33:48.255368] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-06T20:33:48.257059] [INFO ] [REMOTE ] NPCT: Full fetch complete (25232 records). [2025-10-06T20:33:48.257199] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-06T20:33:48.634106] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-10-06T20:33:48.634198] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-10-06T20:33:48.634893] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-10-06T20:33:48.634969] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-10-06T20:33:48.635838] [DEBUG] [LOCAL ] NPCT: Trimmed 25232 records to 16956 (keeping 200 days of data) [2025-10-06T20:33:48.741886] [DEBUG] [LOCAL ] NPCT: Primary data saved (16956 records). [2025-10-06T20:33:48.742058] [INFO ] [MAIN ] NPCT: Full history saved. [2025-10-06T20:33:48.742144] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NPCT took 28.6s. Estimated remaining: 1h 59m 40s. Rate: 7.1 symbols/min [2025-10-06T20:33:49.406769] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:33:49.411184] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:33:49.480442] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:33:49.484084] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:33:49.483258] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-06T20:33:49.486287] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-06T20:33:49.487042] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-06T20:33:49.487361] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-06T20:33:49.487578] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-06T20:33:49.490672] [DEBUG] [LOCAL ] NPV: Loaded 5112 existing records from primary storage. [2025-10-06T20:33:49.490414] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-06T20:33:49.491191] [INFO ] [MAIN ] NPV: Loaded 5112 existing records. [2025-10-06T20:33:49.711889] [DEBUG] [LOCAL ] NPK: Loaded 8174 existing records from primary storage. [2025-10-06T20:33:49.711183] [DEBUG] [LOCAL ] NPO: Loaded 13251 existing records from primary storage. [2025-10-06T20:33:49.715725] [INFO ] [MAIN ] NPO: Loaded 13251 existing records. [2025-10-06T20:33:49.737467] [INFO ] [MAIN ] NPK: Loaded 8174 existing records. [2025-10-06T20:33:50.042934] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:33:50.077105] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-06T20:33:50.085558] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-06T20:33:50.164911] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-06T20:33:50.214395] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-06T20:33:50.461540] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:33:50.487260] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-06T20:33:50.465095] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:33:50.515849] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-06T20:33:50.524292] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-06T20:33:50.530050] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-06T20:33:50.530162] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-06T20:33:50.544537] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-06T20:33:50.562778] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:33:50.584948] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-06T20:33:50.585031] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-10-06T20:33:50.630536] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-06T20:33:51.341426] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:33:51.432429] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-06T20:33:51.546143] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:33:51.551952] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-06T20:33:51.625024] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:33:51.634330] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-06T20:33:51.636335] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T20:33:51.639825] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-06T20:33:52.792062] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T20:33:52.793579] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-06T20:33:53.076233] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T20:33:53.079630] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-06T20:33:53.093912] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T20:33:53.283911] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T20:33:53.396438] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T20:33:53.425483] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-06T20:33:53.963582] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T20:33:54.177526] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T20:33:54.225539] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-06T20:33:54.957590] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T20:33:55.025608] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-06T20:33:55.825584] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-06T20:33:55.840956] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T20:33:56.625534] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-06T20:33:57.252004] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-06T20:33:57.425561] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-06T20:33:57.606444] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T20:33:58.225535] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-06T20:33:59.025475] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-06T20:33:59.052400] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T20:33:59.068870] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T20:33:59.677333] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-06T20:33:59.825528] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-06T20:34:00.625523] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-06T20:34:01.425539] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-06T20:34:01.482433] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T20:34:01.497201] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-06T20:34:02.225531] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-06T20:34:02.534963] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T20:34:02.798217] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T20:34:03.025529] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-06T20:34:03.825501] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-06T20:34:03.885212] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T20:34:04.625485] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-06T20:34:04.928739] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T20:34:05.334394] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T20:34:05.425537] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-06T20:34:06.225508] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-06T20:34:06.410784] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T20:34:07.025545] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-06T20:34:07.252467] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T20:34:07.761631] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T20:34:07.825525] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-06T20:34:08.625547] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-06T20:34:08.634126] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T20:34:09.425506] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-06T20:34:10.230594] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-06T20:34:10.246973] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T20:34:10.265101] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T20:34:11.025506] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-06T20:34:11.138380] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T20:34:11.783367] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-06T20:34:11.825514] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-06T20:34:12.625522] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-06T20:34:13.411361] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T20:34:13.425464] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-06T20:34:13.723424] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T20:34:14.225538] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-06T20:34:15.025554] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-06T20:34:15.113400] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T20:34:15.150569] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T20:34:15.732479] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T20:34:15.733366] [INFO ] [REMOTE ] NPV: Full fetch complete (6914 records). [2025-10-06T20:34:15.733435] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-06T20:34:15.830614] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-06T20:34:16.093875] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-06T20:34:16.093955] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-06T20:34:16.094135] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-06T20:34:16.094173] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-06T20:34:16.094550] [DEBUG] [LOCAL ] NPV: Trimmed 6914 records to 5107 (keeping 200 days of data) [2025-10-06T20:34:16.125154] [DEBUG] [LOCAL ] NPV: Primary data saved (5107 records). [2025-10-06T20:34:16.125270] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-06T20:34:16.125364] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPV took 27.3s. Estimated remaining: 1h 59m 42s. Rate: 7.1 symbols/min [2025-10-06T20:34:16.317389] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:34:16.361206] [DEBUG] [LOCAL ] NPWR: Loaded 43483 existing records from primary storage. [2025-10-06T20:34:16.361543] [INFO ] [MAIN ] NPWR: Loaded 43483 existing records. [2025-10-06T20:34:16.545029] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:34:16.545250] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-06T20:34:16.545299] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-06T20:34:16.545621] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-10-06T20:34:16.545715] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-06T20:34:16.636620] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-06T20:34:16.665099] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-06T20:34:16.915285] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:34:17.425569] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-06T20:34:17.594298] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T20:34:18.136567] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T20:34:18.137634] [INFO ] [REMOTE ] NPK: Full fetch complete (10884 records). [2025-10-06T20:34:18.137749] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-06T20:34:18.234444] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-06T20:34:18.503407] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-06T20:34:18.503487] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-06T20:34:18.503769] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-06T20:34:18.503830] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-06T20:34:18.504261] [DEBUG] [LOCAL ] NPK: Trimmed 10884 records to 8096 (keeping 200 days of data) [2025-10-06T20:34:18.554826] [DEBUG] [LOCAL ] NPK: Primary data saved (8096 records). [2025-10-06T20:34:18.554939] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-06T20:34:18.555020] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPK took 29.8s. Estimated remaining: 1h 59m 30s. Rate: 7.1 symbols/min [2025-10-06T20:34:18.720950] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:34:18.732661] [DEBUG] [LOCAL ] NQP: Loaded 9406 existing records from primary storage. [2025-10-06T20:34:18.732908] [INFO ] [MAIN ] NQP: Loaded 9406 existing records. [2025-10-06T20:34:18.908202] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:34:18.908399] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-06T20:34:18.908445] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-06T20:34:18.908623] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-06T20:34:18.908727] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-06T20:34:19.030734] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-06T20:34:19.289127] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T20:34:19.296032] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:34:19.825548] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-06T20:34:20.625551] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-06T20:34:20.729818] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T20:34:21.254853] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T20:34:21.425608] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-06T20:34:21.970192] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T20:34:22.225488] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-06T20:34:22.425176] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T20:34:23.025535] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-06T20:34:23.711137] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T20:34:23.825543] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-06T20:34:24.625598] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-06T20:34:24.682101] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T20:34:25.172033] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T20:34:25.425504] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-06T20:34:25.490548] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T20:34:25.492240] [INFO ] [REMOTE ] NPO: Full fetch complete (18235 records). [2025-10-06T20:34:25.492323] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-06T20:34:25.852856] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-10-06T20:34:25.852954] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-10-06T20:34:25.853376] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-10-06T20:34:25.853418] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-10-06T20:34:25.854156] [DEBUG] [LOCAL ] NPO: Trimmed 18235 records to 13100 (keeping 200 days of data) [2025-10-06T20:34:25.939493] [DEBUG] [LOCAL ] NPO: Primary data saved (13100 records). [2025-10-06T20:34:25.939679] [INFO ] [MAIN ] NPO: Full history saved. [2025-10-06T20:34:25.939788] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPO took 37.2s. Estimated remaining: 1h 59m 21s. Rate: 7.1 symbols/min [2025-10-06T20:34:26.114055] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:34:26.147428] [DEBUG] [LOCAL ] NRDY: Loaded 33172 existing records from primary storage. [2025-10-06T20:34:26.147764] [INFO ] [MAIN ] NRDY: Loaded 33172 existing records. [2025-10-06T20:34:26.230765] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-06T20:34:26.342727] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-06T20:34:26.342194] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:34:26.346542] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-06T20:34:26.346628] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-06T20:34:26.346943] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-06T20:34:26.347021] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-06T20:34:26.713521] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:34:27.025552] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-06T20:34:27.265495] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T20:34:27.267872] [INFO ] [REMOTE ] NPKI: Full fetch complete (55100 records). [2025-10-06T20:34:27.267979] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-06T20:34:27.455832] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T20:34:27.456415] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:34:27.456487] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:34:27.456536] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-06T20:34:27.456595] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-06T20:34:27.456638] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-06T20:34:27.456728] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-06T20:34:27.456789] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPKI took 38.7s. Estimated remaining: 1h 59m 9s. Rate: 7.1 symbols/min [2025-10-06T20:34:27.631486] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:34:27.644227] [DEBUG] [LOCAL ] NREF: Loaded 7980 existing records from primary storage. [2025-10-06T20:34:27.644469] [INFO ] [MAIN ] NREF: Loaded 7980 existing records. [2025-10-06T20:34:27.825804] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-06T20:34:27.825614] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:34:27.827577] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-06T20:34:27.827714] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-06T20:34:27.828235] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-06T20:34:27.828295] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-06T20:34:27.913714] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-06T20:34:28.218309] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:34:28.625533] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-06T20:34:29.425560] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-06T20:34:29.757220] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-06T20:34:30.225597] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-06T20:34:30.391959] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T20:34:30.853010] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-06T20:34:31.025543] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-06T20:34:31.825521] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-06T20:34:31.989137] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T20:34:32.625625] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-06T20:34:32.796076] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T20:34:33.425514] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-06T20:34:34.225556] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-06T20:34:34.319686] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T20:34:35.025478] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-06T20:34:35.095136] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T20:34:35.118151] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T20:34:35.439599] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (3.61 seconds). [2025-10-06T20:34:35.825492] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-06T20:34:36.625500] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-06T20:34:36.754475] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T20:34:36.812213] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T20:34:37.089221] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-06T20:34:37.425511] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-06T20:34:38.225492] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-06T20:34:38.266282] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T20:34:38.855580] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-06T20:34:39.025530] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-06T20:34:39.825536] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-06T20:34:39.925915] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-06T20:34:40.625545] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-06T20:34:41.425495] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-06T20:34:41.808536] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-06T20:34:42.090478] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-06T20:34:42.229053] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-06T20:34:42.233518] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T20:34:43.025592] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-06T20:34:43.773473] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T20:34:43.825500] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-06T20:34:44.436679] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T20:34:44.625529] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-06T20:34:45.425573] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-06T20:34:45.487562] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T20:34:45.736146] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T20:34:46.225561] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-06T20:34:46.386485] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T20:34:47.025559] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-06T20:34:47.478505] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T20:34:47.482366] [INFO ] [REMOTE ] NPWR: Full fetch complete (59469 records). [2025-10-06T20:34:47.482549] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-06T20:34:47.836230] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-06T20:34:47.873722] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-10-06T20:34:47.873981] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-10-06T20:34:47.875002] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-10-06T20:34:47.875084] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-10-06T20:34:47.876966] [DEBUG] [LOCAL ] NPWR: Trimmed 59469 records to 42902 (keeping 200 days of data) [2025-10-06T20:34:47.975521] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-06T20:34:48.136141] [DEBUG] [LOCAL ] NPWR: Primary data saved (42902 records). [2025-10-06T20:34:48.136284] [INFO ] [MAIN ] NPWR: Full history saved. [2025-10-06T20:34:48.136369] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NPWR took 32.0s. Estimated remaining: 1h 59m 7s. Rate: 7.1 symbols/min [2025-10-06T20:34:48.302117] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:34:48.302317] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-06T20:34:48.302356] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-06T20:34:48.302467] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-06T20:34:48.302508] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-06T20:34:48.302548] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-06T20:34:48.302579] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-06T20:34:48.643235] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-06T20:34:48.657729] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:34:48.973292] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T20:34:49.412743] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T20:34:49.414250] [INFO ] [REMOTE ] NQP: Full fetch complete (13420 records). [2025-10-06T20:34:49.414353] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-06T20:34:49.430760] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-06T20:34:49.793322] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-06T20:34:49.793407] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-06T20:34:49.793725] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-06T20:34:49.793786] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-06T20:34:49.794252] [DEBUG] [LOCAL ] NQP: Trimmed 13420 records to 9259 (keeping 200 days of data) [2025-10-06T20:34:49.850223] [DEBUG] [LOCAL ] NQP: Primary data saved (9259 records). [2025-10-06T20:34:49.850384] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-06T20:34:49.850474] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NQP took 31.3s. Estimated remaining: 1h 58m 55s. Rate: 7.1 symbols/min [2025-10-06T20:34:50.016440] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:34:50.056881] [DEBUG] [LOCAL ] NRGV: Loaded 44114 existing records from primary storage. [2025-10-06T20:34:50.057212] [INFO ] [MAIN ] NRGV: Loaded 44114 existing records. [2025-10-06T20:34:50.232737] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-06T20:34:50.239677] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:34:50.240014] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-06T20:34:50.240085] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-06T20:34:50.240288] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-06T20:34:50.240344] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-06T20:34:50.588555] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:34:50.950225] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-06T20:34:51.025494] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-06T20:34:51.274913] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T20:34:51.825533] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-06T20:34:52.625515] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-06T20:34:52.962378] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-06T20:34:53.425501] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-06T20:34:53.784437] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-06T20:34:53.996051] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-06T20:34:54.225532] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-06T20:34:54.759128] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T20:34:55.025573] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-06T20:34:55.722242] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T20:34:55.793789] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-06T20:34:55.825486] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-06T20:34:56.625565] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-06T20:34:56.652210] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-06T20:34:57.425501] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-06T20:34:57.705757] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T20:34:57.986822] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-06T20:34:58.225534] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-06T20:34:59.025537] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-06T20:34:59.411765] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T20:34:59.825578] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-06T20:34:59.869669] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T20:35:00.625572] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-06T20:35:00.796165] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T20:35:01.425542] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-06T20:35:01.747450] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T20:35:02.225511] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-06T20:35:02.517457] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T20:35:03.025560] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-06T20:35:03.785171] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T20:35:03.825475] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-06T20:35:04.116517] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T20:35:04.122485] [INFO ] [REMOTE ] NRDY: Full fetch complete (51266 records). [2025-10-06T20:35:04.122778] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-06T20:35:04.498211] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-06T20:35:04.498298] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-06T20:35:04.499014] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-06T20:35:04.499076] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-06T20:35:04.500107] [DEBUG] [LOCAL ] NRDY: Trimmed 51266 records to 32547 (keeping 200 days of data) [2025-10-06T20:35:04.634817] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-06T20:35:04.679353] [DEBUG] [LOCAL ] NRDY: Primary data saved (32547 records). [2025-10-06T20:35:04.679456] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-06T20:35:04.679537] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NRDY took 38.7s. Estimated remaining: 1h 58m 50s. Rate: 7.1 symbols/min [2025-10-06T20:35:04.844606] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:35:04.864446] [DEBUG] [LOCAL ] NRK: Loaded 20250 existing records from primary storage. [2025-10-06T20:35:04.864709] [INFO ] [MAIN ] NRK: Loaded 20250 existing records. [2025-10-06T20:35:05.042666] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:35:05.042905] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-06T20:35:05.042988] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-06T20:35:05.043177] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-10-06T20:35:05.043217] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-06T20:35:05.382629] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-06T20:35:05.403357] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:35:05.404971] [INFO ] [REMOTE ] NREF: Full fetch complete (10879 records). [2025-10-06T20:35:05.405138] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-06T20:35:05.434745] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-06T20:35:05.715138] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T20:35:05.802152] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-06T20:35:05.802224] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-06T20:35:05.802484] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-06T20:35:05.802522] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-06T20:35:05.802972] [DEBUG] [LOCAL ] NREF: Trimmed 10879 records to 7894 (keeping 200 days of data) [2025-10-06T20:35:05.850135] [DEBUG] [LOCAL ] NREF: Primary data saved (7894 records). [2025-10-06T20:35:05.850230] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-06T20:35:05.850307] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NREF took 38.4s. Estimated remaining: 1h 58m 38s. Rate: 7.1 symbols/min [2025-10-06T20:35:06.048702] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:35:06.056095] [DEBUG] [LOCAL ] NRP: Loaded 4144 existing records from primary storage. [2025-10-06T20:35:06.056312] [INFO ] [MAIN ] NRP: Loaded 4144 existing records. [2025-10-06T20:35:06.230941] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-06T20:35:06.238975] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:35:06.239306] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-06T20:35:06.239372] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-06T20:35:06.239548] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-06T20:35:06.239618] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-06T20:35:06.599191] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:35:06.630626] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T20:35:07.025584] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-06T20:35:07.751041] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T20:35:07.760435] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-06T20:35:07.825485] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-06T20:35:08.625547] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-06T20:35:09.425538] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-06T20:35:09.651305] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T20:35:09.695402] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T20:35:10.169948] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T20:35:10.225482] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-06T20:35:11.025515] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-06T20:35:11.362850] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T20:35:11.825517] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-06T20:35:12.062386] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T20:35:12.625611] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-06T20:35:12.856072] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T20:35:13.425568] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-06T20:35:14.225503] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-06T20:35:14.299145] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T20:35:14.492429] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T20:35:14.999338] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T20:35:15.025485] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-06T20:35:15.825495] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-06T20:35:15.859845] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T20:35:16.625577] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-06T20:35:17.335094] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-06T20:35:17.410628] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T20:35:17.425464] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-06T20:35:18.225526] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-06T20:35:18.979481] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T20:35:19.027025] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-06T20:35:19.029507] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T20:35:19.825497] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-06T20:35:20.038581] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T20:35:20.499486] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-06T20:35:20.625512] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-06T20:35:21.425550] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-06T20:35:21.696090] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T20:35:22.176020] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T20:35:22.225557] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-06T20:35:23.025531] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-06T20:35:23.741670] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-06T20:35:23.825576] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-06T20:35:23.960525] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T20:35:24.509302] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-06T20:35:24.512334] [INFO ] [REMOTE ] NRG: Full fetch complete (76210 records). [2025-10-06T20:35:24.512508] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-06T20:35:24.513625] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:35:24.513775] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:35:24.513833] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:35:24.513934] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-06T20:35:24.514030] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-06T20:35:24.514099] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-06T20:35:24.514205] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-06T20:35:24.514309] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NRG took 36.4s. Estimated remaining: 1h 58m 35s. Rate: 7.1 symbols/min [2025-10-06T20:35:24.630722] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-06T20:35:24.741110] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:35:24.749819] [DEBUG] [LOCAL ] NRT: Loaded 5039 existing records from primary storage. [2025-10-06T20:35:24.750036] [INFO ] [MAIN ] NRT: Loaded 5039 existing records. [2025-10-06T20:35:24.924759] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:35:24.925016] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-06T20:35:24.925072] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-06T20:35:24.925274] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-06T20:35:24.925329] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-06T20:35:25.273513] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:35:25.425604] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-06T20:35:25.850266] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-06T20:35:26.148342] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T20:35:26.225559] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-06T20:35:26.958582] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-06T20:35:27.025552] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-06T20:35:27.669119] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T20:35:27.825488] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-06T20:35:28.625530] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-06T20:35:29.425543] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-06T20:35:29.492413] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T20:35:29.757405] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-06T20:35:30.225587] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-06T20:35:30.551631] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T20:35:30.960342] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T20:35:31.025532] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-06T20:35:31.825528] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-06T20:35:32.507791] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-06T20:35:32.615618] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T20:35:32.618464] [INFO ] [REMOTE ] NRGV: Full fetch complete (62163 records). [2025-10-06T20:35:32.618557] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-06T20:35:32.630815] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-06T20:35:33.008927] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-06T20:35:33.009009] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-06T20:35:33.009960] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-06T20:35:33.010036] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-06T20:35:33.011291] [DEBUG] [LOCAL ] NRGV: Trimmed 62163 records to 43471 (keeping 200 days of data) [2025-10-06T20:35:33.232034] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T20:35:33.233859] [INFO ] [REMOTE ] NRP: Full fetch complete (6497 records). [2025-10-06T20:35:33.234240] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-06T20:35:33.427547] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-06T20:35:33.617407] [DEBUG] [LOCAL ] NRGV: Primary data saved (43471 records). [2025-10-06T20:35:33.639952] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-06T20:35:33.640126] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRGV took 43.8s. Estimated remaining: 1h 58m 27s. Rate: 7.1 symbols/min [2025-10-06T20:35:33.651788] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-06T20:35:33.671960] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-06T20:35:33.683809] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-06T20:35:33.709884] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-06T20:35:33.742807] [DEBUG] [LOCAL ] NRP: Trimmed 6497 records to 4101 (keeping 200 days of data) [2025-10-06T20:35:33.837032] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:35:33.846979] [DEBUG] [LOCAL ] NRUC: Loaded 3117 existing records from primary storage. [2025-10-06T20:35:33.848182] [INFO ] [MAIN ] NRUC: Loaded 3117 existing records. [2025-10-06T20:35:33.875701] [DEBUG] [LOCAL ] NRP: Primary data saved (4101 records). [2025-10-06T20:35:33.916791] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-06T20:35:33.928369] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRP took 28.1s. Estimated remaining: 1h 58m 14s. Rate: 7.1 symbols/min [2025-10-06T20:35:34.145036] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:35:34.152308] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-06T20:35:34.152416] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-06T20:35:34.157731] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-10-06T20:35:34.162972] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-06T20:35:34.239116] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-06T20:35:34.300880] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:35:34.274470] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-06T20:35:34.640546] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:35:34.642266] [DEBUG] [LOCAL ] NSA: Loaded 45345 existing records from primary storage. [2025-10-06T20:35:34.642504] [INFO ] [MAIN ] NSA: Loaded 45345 existing records. [2025-10-06T20:35:34.814488] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:35:34.814697] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-06T20:35:34.814769] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-06T20:35:34.815017] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-10-06T20:35:34.815073] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-06T20:35:35.030807] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-06T20:35:35.194534] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:35:35.579369] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-06T20:35:35.677216] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-06T20:35:35.825541] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-06T20:35:36.578498] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T20:35:36.625478] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-06T20:35:37.192328] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-06T20:35:37.425533] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-06T20:35:38.225493] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-06T20:35:38.603764] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-06T20:35:38.725525] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-06T20:35:39.025540] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-06T20:35:39.825495] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-06T20:35:40.146512] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T20:35:40.345349] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-06T20:35:40.625609] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-06T20:35:41.425491] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-06T20:35:41.514001] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-06T20:35:41.515567] [INFO ] [REMOTE ] NRK: Full fetch complete (27789 records). [2025-10-06T20:35:41.515678] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-06T20:35:41.889737] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-06T20:35:41.889824] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-06T20:35:41.890451] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-06T20:35:41.890491] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-06T20:35:41.891245] [DEBUG] [LOCAL ] NRK: Trimmed 27789 records to 20025 (keeping 200 days of data) [2025-10-06T20:35:42.013380] [DEBUG] [LOCAL ] NRK: Primary data saved (20025 records). [2025-10-06T20:35:42.013516] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-06T20:35:42.013600] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRK took 37.3s. Estimated remaining: 1h 58m 5s. Rate: 7.1 symbols/min [2025-10-06T20:35:42.123840] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-06T20:35:42.197483] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:35:42.197723] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-06T20:35:42.197781] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-06T20:35:42.197893] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-06T20:35:42.197937] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-06T20:35:42.198019] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-06T20:35:42.198063] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-06T20:35:42.230723] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-06T20:35:42.557136] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:35:43.025592] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-06T20:35:43.829027] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-06T20:35:43.832298] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-06T20:35:43.911886] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T20:35:44.625561] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-06T20:35:45.425586] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-06T20:35:46.021382] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T20:35:46.055352] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-06T20:35:46.225590] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-06T20:35:46.258322] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T20:35:46.811355] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T20:35:46.812289] [INFO ] [REMOTE ] NRT: Full fetch complete (7978 records). [2025-10-06T20:35:46.812363] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-06T20:35:47.030630] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-06T20:35:47.182803] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-06T20:35:47.182882] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-06T20:35:47.183106] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-06T20:35:47.183145] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-06T20:35:47.183541] [DEBUG] [LOCAL ] NRT: Trimmed 7978 records to 4865 (keeping 200 days of data) [2025-10-06T20:35:47.212427] [DEBUG] [LOCAL ] NRT: Primary data saved (4865 records). [2025-10-06T20:35:47.212529] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-06T20:35:47.212605] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRT took 22.7s. Estimated remaining: 1h 57m 55s. Rate: 7.1 symbols/min [2025-10-06T20:35:47.388173] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:35:47.433767] [DEBUG] [LOCAL ] NSP: Loaded 35539 existing records from primary storage. [2025-10-06T20:35:47.434064] [INFO ] [MAIN ] NSP: Loaded 35539 existing records. [2025-10-06T20:35:47.610900] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:35:47.611137] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-06T20:35:47.611866] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-06T20:35:47.612092] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-10-06T20:35:47.612149] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-06T20:35:47.833703] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-06T20:35:47.974718] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:35:48.428560] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T20:35:48.539397] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-06T20:35:48.625476] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-06T20:35:49.353781] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T20:35:49.425531] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-06T20:35:50.180803] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-06T20:35:50.225573] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-06T20:35:50.753890] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-06T20:35:51.025574] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-06T20:35:51.825561] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-06T20:35:52.625630] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-06T20:35:52.698196] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T20:35:53.206600] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T20:35:53.266865] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T20:35:53.425521] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-06T20:35:54.225555] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-06T20:35:55.025548] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-06T20:35:55.067552] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T20:35:55.101338] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T20:35:55.825515] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-06T20:35:56.374218] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-06T20:35:56.625484] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-06T20:35:56.900430] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T20:35:57.425557] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-06T20:35:58.021300] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T20:35:58.225561] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-06T20:35:59.025494] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-06T20:35:59.136381] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T20:35:59.405283] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T20:35:59.825504] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-06T20:35:59.996079] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-06T20:36:00.443545] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-06T20:36:00.625525] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-06T20:36:01.425500] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-06T20:36:01.611766] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-06T20:36:02.225537] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-06T20:36:02.990057] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-06T20:36:03.011111] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T20:36:03.025466] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-06T20:36:03.825535] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-06T20:36:04.602925] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T20:36:04.625474] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-06T20:36:04.721512] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-06T20:36:05.425567] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-06T20:36:06.234022] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-06T20:36:06.236974] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T20:36:06.918420] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-06T20:36:07.025505] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-06T20:36:07.347274] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-06T20:36:07.825524] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-06T20:36:08.465492] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T20:36:08.578252] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T20:36:08.625487] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-06T20:36:09.425554] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-06T20:36:09.707435] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T20:36:10.225538] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-06T20:36:10.749732] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T20:36:10.750534] [INFO ] [REMOTE ] NRUC: Full fetch complete (5432 records). [2025-10-06T20:36:10.750611] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-06T20:36:11.031660] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-06T20:36:11.116995] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-10-06T20:36:11.117167] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-10-06T20:36:11.117401] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-10-06T20:36:11.117532] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-10-06T20:36:11.118277] [DEBUG] [LOCAL ] NRUC: Trimmed 5432 records to 3083 (keeping 200 days of data) [2025-10-06T20:36:11.156933] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T20:36:11.169729] [DEBUG] [LOCAL ] NRUC: Primary data saved (3083 records). [2025-10-06T20:36:11.170002] [INFO ] [MAIN ] NRUC: Full history saved. [2025-10-06T20:36:11.170100] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRUC took 37.5s. Estimated remaining: 1h 57m 55s. Rate: 7.1 symbols/min [2025-10-06T20:36:11.340594] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:36:11.361604] [DEBUG] [LOCAL ] NTB: Loaded 20445 existing records from primary storage. [2025-10-06T20:36:11.361913] [INFO ] [MAIN ] NTB: Loaded 20445 existing records. [2025-10-06T20:36:11.543036] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:36:11.543243] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-06T20:36:11.543290] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-06T20:36:11.543458] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-10-06T20:36:11.543498] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-06T20:36:11.830901] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-06T20:36:11.916827] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:36:12.003087] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T20:36:12.625522] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-06T20:36:13.425544] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-06T20:36:13.472317] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T20:36:13.781038] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T20:36:14.081910] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T20:36:14.084287] [INFO ] [REMOTE ] NSC: Full fetch complete (70543 records). [2025-10-06T20:36:14.084407] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-06T20:36:14.085201] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:36:14.085299] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:36:14.085342] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:36:14.085383] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-06T20:36:14.085461] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-06T20:36:14.085521] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-06T20:36:14.085566] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-06T20:36:14.085696] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NSC took 32.1s. Estimated remaining: 1h 57m 44s. Rate: 7.1 symbols/min [2025-10-06T20:36:14.232150] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-06T20:36:14.264676] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:36:14.265068] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-06T20:36:14.265124] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-06T20:36:14.265243] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-06T20:36:14.265288] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-06T20:36:14.265332] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-06T20:36:14.265365] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-06T20:36:14.636640] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:36:15.025543] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-06T20:36:15.825546] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-06T20:36:16.019027] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T20:36:16.615018] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T20:36:16.625471] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-06T20:36:17.052009] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T20:36:17.425530] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-06T20:36:17.883708] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T20:36:17.885974] [INFO ] [REMOTE ] NSP: Full fetch complete (49781 records). [2025-10-06T20:36:17.886068] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-06T20:36:18.192032] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-06T20:36:18.237040] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-06T20:36:18.309375] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-10-06T20:36:18.309672] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-10-06T20:36:18.310824] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-10-06T20:36:18.310895] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-10-06T20:36:18.312272] [DEBUG] [LOCAL ] NSP: Trimmed 49781 records to 35149 (keeping 200 days of data) [2025-10-06T20:36:18.609004] [DEBUG] [LOCAL ] NSP: Primary data saved (35149 records). [2025-10-06T20:36:18.609224] [INFO ] [MAIN ] NSP: Full history saved. [2025-10-06T20:36:18.609361] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NSP took 31.4s. Estimated remaining: 1h 57m 33s. Rate: 7.1 symbols/min [2025-10-06T20:36:18.890154] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:36:18.973497] [DEBUG] [LOCAL ] NTR: Loaded 53344 existing records from primary storage. [2025-10-06T20:36:18.974079] [INFO ] [MAIN ] NTR: Loaded 53344 existing records. [2025-10-06T20:36:19.003667] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T20:36:19.030748] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-06T20:36:19.243010] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:36:19.243303] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-06T20:36:19.243381] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-06T20:36:19.243730] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-10-06T20:36:19.243805] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-06T20:36:19.632395] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:36:19.825529] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-06T20:36:20.262240] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-06T20:36:20.625534] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-06T20:36:21.189894] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T20:36:21.220487] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-06T20:36:21.425572] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-06T20:36:22.225547] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-06T20:36:22.682146] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T20:36:23.025540] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-06T20:36:23.825498] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-06T20:36:24.036436] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T20:36:24.171087] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T20:36:24.348438] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-06T20:36:24.625572] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-06T20:36:25.294951] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-06T20:36:25.425527] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-06T20:36:26.225598] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-06T20:36:26.607228] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T20:36:27.025558] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-06T20:36:27.626692] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T20:36:27.825514] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-06T20:36:27.970088] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T20:36:28.545570] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-06T20:36:28.625548] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-06T20:36:29.425582] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-06T20:36:30.023515] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T20:36:30.225542] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-06T20:36:30.609221] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-06T20:36:31.025542] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-06T20:36:31.373186] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T20:36:31.825523] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-06T20:36:32.576230] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T20:36:32.578977] [INFO ] [REMOTE ] NSA: Full fetch complete (62093 records). [2025-10-06T20:36:32.579077] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-06T20:36:32.626504] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-06T20:36:32.991262] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-10-06T20:36:32.997009] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-10-06T20:36:32.999277] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T20:36:32.998833] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-10-06T20:36:33.004186] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-10-06T20:36:33.005743] [DEBUG] [LOCAL ] NSA: Trimmed 62093 records to 44679 (keeping 200 days of data) [2025-10-06T20:36:33.241390] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-06T20:36:33.292174] [DEBUG] [LOCAL ] NSA: Primary data saved (44679 records). [2025-10-06T20:36:33.292307] [INFO ] [MAIN ] NSA: Full history saved. [2025-10-06T20:36:33.292401] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NSA took 59.3s. Estimated remaining: 1h 57m 28s. Rate: 7.1 symbols/min [2025-10-06T20:36:33.435537] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-06T20:36:33.468906] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:36:33.509719] [DEBUG] [LOCAL ] NTST: Loaded 44169 existing records from primary storage. [2025-10-06T20:36:33.510034] [INFO ] [MAIN ] NTST: Loaded 44169 existing records. [2025-10-06T20:36:33.686103] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:36:33.686321] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-06T20:36:33.686374] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-06T20:36:33.686585] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-10-06T20:36:33.686677] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-06T20:36:34.037795] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:36:34.225479] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-06T20:36:34.647476] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T20:36:35.025539] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-06T20:36:35.825497] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-06T20:36:36.078331] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T20:36:36.130329] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T20:36:36.625556] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-06T20:36:37.425500] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-06T20:36:37.607924] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T20:36:37.897514] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T20:36:37.898156] [INFO ] [REMOTE ] NTEST: Full fetch complete (1990 records). [2025-10-06T20:36:37.898225] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-06T20:36:38.079119] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-06T20:36:38.079368] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:36:38.079446] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:36:38.079531] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-06T20:36:38.079758] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-06T20:36:38.079817] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-06T20:36:38.079877] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-06T20:36:38.079956] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTEST took 24.0s. Estimated remaining: 1h 57m 18s. Rate: 7.1 symbols/min [2025-10-06T20:36:38.227376] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T20:36:38.227438] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-06T20:36:38.272362] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:36:38.338360] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-10-06T20:36:38.338738] [INFO ] [MAIN ] NU: Loaded 54526 existing records. [2025-10-06T20:36:38.516922] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:36:38.517142] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-06T20:36:38.517206] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-06T20:36:38.518502] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-10-06T20:36:38.518562] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-06T20:36:38.864857] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:36:39.025472] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-06T20:36:39.229352] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T20:36:39.825472] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-06T20:36:40.625557] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-06T20:36:40.765147] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T20:36:40.767606] [INFO ] [REMOTE ] NTB: Full fetch complete (30622 records). [2025-10-06T20:36:40.767772] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-06T20:36:41.160100] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-10-06T20:36:41.160270] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-10-06T20:36:41.160982] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-10-06T20:36:41.161061] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-10-06T20:36:41.162116] [DEBUG] [LOCAL ] NTB: Trimmed 30622 records to 20092 (keeping 200 days of data) [2025-10-06T20:36:41.284127] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-06T20:36:41.327912] [DEBUG] [LOCAL ] NTB: Primary data saved (20092 records). [2025-10-06T20:36:41.328078] [INFO ] [MAIN ] NTB: Full history saved. [2025-10-06T20:36:41.328181] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NTB took 30.2s. Estimated remaining: 1h 57m 6s. Rate: 7.1 symbols/min [2025-10-06T20:36:41.429806] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-06T20:36:41.500259] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:36:41.500415] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-06T20:36:41.500452] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-06T20:36:41.500560] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-06T20:36:41.500600] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-06T20:36:41.500661] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-06T20:36:41.500717] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-06T20:36:41.854617] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:36:42.225497] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-06T20:36:42.318522] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T20:36:43.025549] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-06T20:36:43.293306] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T20:36:43.825551] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-06T20:36:44.004023] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T20:36:44.395668] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T20:36:44.625583] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-06T20:36:45.425528] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-06T20:36:45.704175] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T20:36:46.225554] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-06T20:36:46.468033] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T20:36:47.025555] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-06T20:36:47.825607] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-06T20:36:47.915743] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-06T20:36:47.917450] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T20:36:47.992846] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T20:36:48.625543] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-06T20:36:49.425533] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-06T20:36:49.454077] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T20:36:50.225551] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-06T20:36:50.944935] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T20:36:51.025471] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-06T20:36:51.113518] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-06T20:36:51.825486] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-06T20:36:51.875186] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T20:36:52.199150] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T20:36:52.590922] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-06T20:36:52.625478] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-06T20:36:53.425515] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-06T20:36:53.681010] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T20:36:54.225573] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-06T20:36:55.025518] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-06T20:36:55.257999] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T20:36:55.655216] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T20:36:55.825538] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-06T20:36:56.036557] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-06T20:36:56.625562] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-06T20:36:57.086737] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T20:36:57.425582] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-06T20:36:58.225570] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-06T20:36:58.722843] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-06T20:36:59.025483] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-06T20:36:59.223578] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T20:36:59.292597] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-06T20:36:59.825533] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-06T20:37:00.625567] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-06T20:37:01.381343] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-06T20:37:01.425490] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-06T20:37:01.624865] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T20:37:01.665011] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T20:37:02.225542] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-06T20:37:03.025583] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-06T20:37:03.421568] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-06T20:37:03.696330] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T20:37:03.699403] [INFO ] [REMOTE ] NTR: Full fetch complete (76305 records). [2025-10-06T20:37:03.699529] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-06T20:37:03.839267] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-06T20:37:04.104031] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-10-06T20:37:04.104161] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-10-06T20:37:04.105313] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-10-06T20:37:04.105399] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-10-06T20:37:04.107354] [DEBUG] [LOCAL ] NTR: Trimmed 76305 records to 52588 (keeping 200 days of data) [2025-10-06T20:37:04.236486] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T20:37:04.489462] [DEBUG] [LOCAL ] NTR: Primary data saved (52588 records). [2025-10-06T20:37:04.489633] [INFO ] [MAIN ] NTR: Full history saved. [2025-10-06T20:37:04.490498] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NTR took 45.9s. Estimated remaining: 1h 57m 6s. Rate: 7.1 symbols/min [2025-10-06T20:37:04.635785] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-06T20:37:04.661772] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:37:04.700186] [DEBUG] [LOCAL ] NUS: Loaded 36927 existing records from primary storage. [2025-10-06T20:37:04.700539] [INFO ] [MAIN ] NUS: Loaded 36927 existing records. [2025-10-06T20:37:04.879106] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:37:04.879373] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-06T20:37:04.879421] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-06T20:37:04.880177] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-10-06T20:37:04.880237] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-06T20:37:05.250226] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T20:37:05.254551] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:37:05.257424] [INFO ] [REMOTE ] NTST: Full fetch complete (61316 records). [2025-10-06T20:37:05.257505] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-06T20:37:05.437699] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-06T20:37:05.661194] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-10-06T20:37:05.661340] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-10-06T20:37:05.662367] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-10-06T20:37:05.662430] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-10-06T20:37:05.663920] [DEBUG] [LOCAL ] NTST: Trimmed 61316 records to 43613 (keeping 200 days of data) [2025-10-06T20:37:05.779398] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T20:37:05.960732] [DEBUG] [LOCAL ] NTST: Primary data saved (43613 records). [2025-10-06T20:37:05.960897] [INFO ] [MAIN ] NTST: Full history saved. [2025-10-06T20:37:05.960984] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NTST took 32.7s. Estimated remaining: 1h 56m 54s. Rate: 7.1 symbols/min [2025-10-06T20:37:06.129616] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:37:06.151541] [DEBUG] [LOCAL ] NUV: Loaded 23989 existing records from primary storage. [2025-10-06T20:37:06.151828] [INFO ] [MAIN ] NUV: Loaded 23989 existing records. [2025-10-06T20:37:06.230762] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-06T20:37:06.331679] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:37:06.331905] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-06T20:37:06.331952] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-06T20:37:06.332518] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-06T20:37:06.332578] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-06T20:37:06.701713] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:37:07.025513] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-06T20:37:07.142571] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T20:37:07.269412] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T20:37:07.825545] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-06T20:37:08.477677] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T20:37:08.625508] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-06T20:37:08.973122] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-06T20:37:09.425543] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-06T20:37:09.839081] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T20:37:10.225526] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-06T20:37:10.849961] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-06T20:37:10.852735] [INFO ] [REMOTE ] NUE: Full fetch complete (74468 records). [2025-10-06T20:37:10.852914] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-06T20:37:10.853842] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:37:10.853953] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:37:10.853997] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:37:10.854040] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-06T20:37:10.854130] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-06T20:37:10.854187] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-06T20:37:10.854235] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-06T20:37:10.854300] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NUE took 29.5s. Estimated remaining: 1h 56m 43s. Rate: 7.1 symbols/min [2025-10-06T20:37:11.031946] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-06T20:37:11.141841] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:37:11.215255] [DEBUG] [LOCAL ] NUVB: Loaded 52012 existing records from primary storage. [2025-10-06T20:37:11.215807] [INFO ] [MAIN ] NUVB: Loaded 52012 existing records. [2025-10-06T20:37:11.449513] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:37:11.449781] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-06T20:37:11.449834] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-06T20:37:11.450257] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-06T20:37:11.450316] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-06T20:37:11.866561] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-06T20:37:11.872813] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:37:11.907716] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-06T20:37:12.212339] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T20:37:12.625535] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-06T20:37:13.425560] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-06T20:37:13.664263] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T20:37:14.225580] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-06T20:37:15.025533] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-06T20:37:15.144353] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-06T20:37:15.315114] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-06T20:37:15.825532] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-06T20:37:15.866918] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T20:37:16.086948] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T20:37:16.625581] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-06T20:37:17.415356] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T20:37:17.425485] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-06T20:37:18.092156] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T20:37:18.225572] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-06T20:37:18.926523] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T20:37:19.025497] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-06T20:37:19.406744] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T20:37:19.825537] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-06T20:37:20.625493] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-06T20:37:21.135063] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-06T20:37:21.425589] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-06T20:37:21.628830] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T20:37:21.757729] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-06T20:37:21.760401] [INFO ] [REMOTE ] NU: Full fetch complete (77490 records). [2025-10-06T20:37:21.760534] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-06T20:37:21.761403] [FATAL] [VALIDATOR ] NU: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:37:21.761523] [FATAL] [MAIN ] NU: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:37:21.761581] [WARN ] [MAIN ] NU: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:37:21.761695] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-06T20:37:21.761814] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-06T20:37:21.761856] [INFO ] [LOCAL ] NU: Starting deletion of derivative data. [2025-10-06T20:37:21.762143] [DEBUG] [LOCAL ] NU: Deleted derivative data file. [2025-10-06T20:37:21.762247] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NU took 43.7s. Estimated remaining: 1h 56m 36s. Rate: 7.1 symbols/min [2025-10-06T20:37:21.942784] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:37:21.952988] [DEBUG] [LOCAL ] NUW: Loaded 7367 existing records from primary storage. [2025-10-06T20:37:21.953234] [INFO ] [MAIN ] NUW: Loaded 7367 existing records. [2025-10-06T20:37:22.164198] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:37:22.164672] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-06T20:37:22.164790] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-06T20:37:22.165021] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-06T20:37:22.165078] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-06T20:37:22.228115] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-06T20:37:22.445445] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T20:37:22.555930] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:37:23.025545] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-06T20:37:23.825530] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-06T20:37:23.976633] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T20:37:24.580386] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T20:37:24.625499] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-06T20:37:24.968621] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T20:37:25.425555] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-06T20:37:26.061966] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T20:37:26.225538] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-06T20:37:26.269088] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T20:37:27.025548] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-06T20:37:27.311821] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T20:37:27.825577] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-06T20:37:28.620481] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T20:37:28.627736] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-06T20:37:28.695233] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-06T20:37:29.425536] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-06T20:37:30.225552] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-06T20:37:30.389383] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T20:37:30.458396] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T20:37:31.025521] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-06T20:37:31.733959] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T20:37:31.825484] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-06T20:37:31.906470] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-06T20:37:32.625558] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-06T20:37:33.236823] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T20:37:33.425601] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-06T20:37:33.805546] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-06T20:37:34.225528] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-06T20:37:34.362530] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-06T20:37:35.025580] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-06T20:37:35.391280] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T20:37:35.394516] [INFO ] [REMOTE ] NUS: Full fetch complete (53880 records). [2025-10-06T20:37:35.394639] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-06T20:37:35.805808] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-10-06T20:37:35.805966] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-10-06T20:37:35.807211] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-10-06T20:37:35.807279] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-10-06T20:37:35.810270] [DEBUG] [LOCAL ] NUS: Trimmed 53880 records to 36420 (keeping 200 days of data) [2025-10-06T20:37:35.866365] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-06T20:37:35.916192] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T20:37:36.070394] [DEBUG] [LOCAL ] NUS: Primary data saved (36420 records). [2025-10-06T20:37:36.070616] [INFO ] [MAIN ] NUS: Full history saved. [2025-10-06T20:37:36.070757] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NUS took 31.6s. Estimated remaining: 1h 56m 31s. Rate: 7.1 symbols/min [2025-10-06T20:37:36.252832] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:37:36.296281] [DEBUG] [LOCAL ] NVG: Loaded 27892 existing records from primary storage. [2025-10-06T20:37:36.296786] [INFO ] [MAIN ] NVG: Loaded 27892 existing records. [2025-10-06T20:37:36.476267] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:37:36.476824] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-06T20:37:36.476886] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-06T20:37:36.477102] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-10-06T20:37:36.477145] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-06T20:37:36.630783] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-06T20:37:36.853858] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:37:37.061943] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T20:37:37.425541] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-06T20:37:37.631242] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T20:37:38.225558] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-06T20:37:39.025518] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-06T20:37:39.177105] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T20:37:39.179601] [INFO ] [REMOTE ] NUV: Full fetch complete (34472 records). [2025-10-06T20:37:39.179769] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-06T20:37:39.593547] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-06T20:37:39.593712] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-06T20:37:39.594816] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-06T20:37:39.594893] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-06T20:37:39.627864] [DEBUG] [LOCAL ] NUV: Trimmed 34472 records to 23678 (keeping 200 days of data) [2025-10-06T20:37:39.631829] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-06T20:37:39.795814] [DEBUG] [LOCAL ] NUV: Primary data saved (23678 records). [2025-10-06T20:37:39.796022] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-06T20:37:39.796134] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUV took 33.8s. Estimated remaining: 1h 56m 20s. Rate: 7.1 symbols/min [2025-10-06T20:37:39.832067] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-06T20:37:39.991456] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:37:40.029419] [DEBUG] [LOCAL ] NVGS: Loaded 30976 existing records from primary storage. [2025-10-06T20:37:40.029833] [INFO ] [MAIN ] NVGS: Loaded 30976 existing records. [2025-10-06T20:37:40.217116] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:37:40.217438] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-06T20:37:40.217502] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-06T20:37:40.218157] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-10-06T20:37:40.218220] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-06T20:37:40.605378] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:37:40.613972] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T20:37:40.625499] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-06T20:37:40.784276] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T20:37:41.425536] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-06T20:37:41.923326] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T20:37:42.191469] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-06T20:37:42.225486] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-06T20:37:43.025532] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-06T20:37:43.660508] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T20:37:43.825545] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-06T20:37:44.356439] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T20:37:44.625549] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-06T20:37:45.425505] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-06T20:37:45.745724] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T20:37:45.979321] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-06T20:37:46.225491] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-06T20:37:46.601347] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T20:37:47.025567] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-06T20:37:47.445567] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-06T20:37:47.825534] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-06T20:37:48.424376] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T20:37:48.625584] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-06T20:37:49.203087] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T20:37:49.425559] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-06T20:37:50.225507] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-06T20:37:50.338175] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T20:37:50.714204] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-06T20:37:51.025544] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-06T20:37:51.601974] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T20:37:51.631157] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T20:37:51.631958] [INFO ] [REMOTE ] NUW: Full fetch complete (11504 records). [2025-10-06T20:37:51.632045] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-06T20:37:51.830688] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-06T20:37:51.997530] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-06T20:37:51.997622] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-06T20:37:51.997998] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-06T20:37:51.998075] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-06T20:37:51.998575] [DEBUG] [LOCAL ] NUW: Trimmed 11504 records to 7214 (keeping 200 days of data) [2025-10-06T20:37:52.042116] [DEBUG] [LOCAL ] NUW: Primary data saved (7214 records). [2025-10-06T20:37:52.042247] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-06T20:37:52.042331] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NUW took 30.3s. Estimated remaining: 1h 56m 14s. Rate: 7.1 symbols/min [2025-10-06T20:37:52.211586] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:37:52.211799] [DEBUG] [LOCAL ] NVO: No existing data file found in primary storage. [2025-10-06T20:37:52.211859] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-10-06T20:37:52.212014] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-06T20:37:52.212076] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-06T20:37:52.212126] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-06T20:37:52.212162] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-06T20:37:52.575612] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:37:52.625471] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-06T20:37:53.101130] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-06T20:37:53.425551] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-06T20:37:54.225560] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-06T20:37:54.646526] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-06T20:37:55.025550] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-06T20:37:55.205273] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-06T20:37:55.272882] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T20:37:55.825553] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-06T20:37:56.625576] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-06T20:37:57.126257] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-06T20:37:57.388574] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T20:37:57.425468] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-06T20:37:57.848064] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T20:37:58.225561] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-06T20:37:58.813159] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T20:37:59.025545] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-06T20:37:59.512279] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-06T20:37:59.825560] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-06T20:38:00.625541] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-06T20:38:00.821188] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-06T20:38:00.824200] [INFO ] [REMOTE ] NUVB: Full fetch complete (72897 records). [2025-10-06T20:38:00.824309] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-06T20:38:01.215602] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-06T20:38:01.215724] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-06T20:38:01.216778] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-06T20:38:01.216843] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-06T20:38:01.218255] [DEBUG] [LOCAL ] NUVB: Trimmed 72897 records to 51328 (keeping 200 days of data) [2025-10-06T20:38:01.425860] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-06T20:38:01.514513] [DEBUG] [LOCAL ] NUVB: Primary data saved (51328 records). [2025-10-06T20:38:01.514668] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-06T20:38:01.514774] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NUVB took 50.7s. Estimated remaining: 1h 56m 6s. Rate: 7.1 symbols/min [2025-10-06T20:38:01.685068] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:38:01.706746] [DEBUG] [LOCAL ] NVR: Loaded 18866 existing records from primary storage. [2025-10-06T20:38:01.707077] [INFO ] [MAIN ] NVR: Loaded 18866 existing records. [2025-10-06T20:38:01.916788] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:38:01.917069] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-06T20:38:01.917212] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-06T20:38:01.917453] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-10-06T20:38:01.917541] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-06T20:38:02.147235] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T20:38:02.230439] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-06T20:38:02.305544] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:38:02.336777] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-06T20:38:02.682903] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T20:38:03.025518] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-06T20:38:03.310677] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-06T20:38:03.825580] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-06T20:38:04.372010] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T20:38:04.625521] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-06T20:38:04.724976] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T20:38:04.727106] [INFO ] [REMOTE ] NVGS: Full fetch complete (41445 records). [2025-10-06T20:38:04.727500] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-06T20:38:05.138519] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-10-06T20:38:05.138684] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-10-06T20:38:05.140012] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-10-06T20:38:05.140082] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-10-06T20:38:05.141735] [DEBUG] [LOCAL ] NVGS: Trimmed 41445 records to 30438 (keeping 200 days of data) [2025-10-06T20:38:05.353279] [DEBUG] [LOCAL ] NVGS: Primary data saved (30438 records). [2025-10-06T20:38:05.353556] [INFO ] [MAIN ] NVGS: Full history saved. [2025-10-06T20:38:05.353713] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NVGS took 25.6s. Estimated remaining: 1h 55m 55s. Rate: 7.1 symbols/min [2025-10-06T20:38:05.430775] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-06T20:38:05.556577] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:38:05.599633] [DEBUG] [LOCAL ] NVRI: Loaded 39400 existing records from primary storage. [2025-10-06T20:38:05.600076] [INFO ] [MAIN ] NVRI: Loaded 39400 existing records. [2025-10-06T20:38:05.709990] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T20:38:05.737272] [INFO ] [REMOTE ] NVG: Full fetch complete (40570 records). [2025-10-06T20:38:05.747746] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-06T20:38:05.907613] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:38:05.934765] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-06T20:38:05.937221] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-06T20:38:05.937537] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-10-06T20:38:05.943009] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-06T20:38:06.245168] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-06T20:38:06.614628] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:38:06.627297] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-06T20:38:06.627402] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-06T20:38:06.628439] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-06T20:38:06.628525] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-06T20:38:06.629803] [DEBUG] [LOCAL ] NVG: Trimmed 40570 records to 27517 (keeping 200 days of data) [2025-10-06T20:38:06.805821] [DEBUG] [LOCAL ] NVG: Primary data saved (27517 records). [2025-10-06T20:38:06.805998] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-06T20:38:06.806093] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NVG took 30.7s. Estimated remaining: 1h 55m 43s. Rate: 7.1 symbols/min [2025-10-06T20:38:06.988609] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:38:07.025577] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-06T20:38:07.043508] [DEBUG] [LOCAL ] NVS: Loaded 52306 existing records from primary storage. [2025-10-06T20:38:07.043924] [INFO ] [MAIN ] NVS: Loaded 52306 existing records. [2025-10-06T20:38:07.227491] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T20:38:07.246045] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:38:07.247278] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-06T20:38:07.247327] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-06T20:38:07.247590] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-10-06T20:38:07.247683] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-06T20:38:07.611832] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:38:07.825543] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-06T20:38:08.045976] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-06T20:38:08.625473] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-06T20:38:08.945556] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-06T20:38:09.425487] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-06T20:38:09.835997] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-06T20:38:10.152492] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T20:38:10.225474] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-06T20:38:11.001236] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T20:38:11.025482] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-06T20:38:11.336479] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-06T20:38:11.825544] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-06T20:38:12.527352] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T20:38:12.630592] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-06T20:38:12.649811] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T20:38:13.425495] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-06T20:38:13.443063] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T20:38:14.225553] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-06T20:38:14.847313] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T20:38:15.025565] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-06T20:38:15.710608] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T20:38:15.825489] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-06T20:38:15.953782] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T20:38:16.625540] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-06T20:38:17.425579] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-06T20:38:18.123416] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T20:38:18.199722] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T20:38:18.225498] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-06T20:38:18.613833] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-06T20:38:19.025569] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-06T20:38:19.825554] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-06T20:38:19.906023] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T20:38:20.396361] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-06T20:38:20.625594] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-06T20:38:21.333047] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-06T20:38:21.425520] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-06T20:38:21.474484] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T20:38:21.865333] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-06T20:38:21.866867] [INFO ] [REMOTE ] NVR: Full fetch complete (29168 records). [2025-10-06T20:38:21.866942] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-06T20:38:21.867585] [FATAL] [VALIDATOR ] NVR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:38:21.867695] [FATAL] [MAIN ] NVR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:38:21.867744] [WARN ] [MAIN ] NVR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:38:21.867784] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-06T20:38:21.867858] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-06T20:38:21.867913] [INFO ] [LOCAL ] NVR: Starting deletion of derivative data. [2025-10-06T20:38:21.868151] [DEBUG] [LOCAL ] NVR: Deleted derivative data file. [2025-10-06T20:38:21.868239] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVR took 20.4s. Estimated remaining: 1h 55m 38s. Rate: 7.1 symbols/min [2025-10-06T20:38:22.039150] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:38:22.090164] [DEBUG] [LOCAL ] NVST: Loaded 52348 existing records from primary storage. [2025-10-06T20:38:22.090533] [INFO ] [MAIN ] NVST: Loaded 52348 existing records. [2025-10-06T20:38:22.230715] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-06T20:38:22.270457] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:38:22.270693] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-06T20:38:22.270752] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-06T20:38:22.270986] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-10-06T20:38:22.271043] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-06T20:38:22.649142] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:38:23.025526] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-06T20:38:23.825553] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-06T20:38:24.625614] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-06T20:38:25.222894] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-10-06T20:38:25.238833] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-06T20:38:25.407715] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T20:38:25.425476] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-06T20:38:26.225542] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-06T20:38:26.483140] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T20:38:26.905210] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T20:38:27.025546] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-06T20:38:27.825564] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-06T20:38:28.625571] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-06T20:38:28.926107] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-06T20:38:29.053561] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-06T20:38:29.408549] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T20:38:29.425464] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-06T20:38:29.770881] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T20:38:30.225598] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-06T20:38:30.841961] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T20:38:31.025560] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-06T20:38:31.825547] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-06T20:38:32.395826] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T20:38:32.625486] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-06T20:38:32.729422] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-06T20:38:33.425547] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-06T20:38:33.806787] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-06T20:38:34.129576] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T20:38:34.225522] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-06T20:38:35.025530] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-06T20:38:35.074815] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T20:38:35.825533] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-06T20:38:36.512759] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-06T20:38:36.625535] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-06T20:38:36.719930] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T20:38:37.425558] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-06T20:38:37.716753] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-06T20:38:38.225565] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-06T20:38:38.718678] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T20:38:38.721335] [INFO ] [REMOTE ] NVRI: Full fetch complete (55839 records). [2025-10-06T20:38:38.721475] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-06T20:38:39.027435] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-06T20:38:39.151174] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-10-06T20:38:39.151284] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-10-06T20:38:39.152278] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-10-06T20:38:39.152358] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-10-06T20:38:39.153873] [DEBUG] [LOCAL ] NVRI: Trimmed 55839 records to 38760 (keeping 200 days of data) [2025-10-06T20:38:39.264281] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-06T20:38:39.417042] [DEBUG] [LOCAL ] NVRI: Primary data saved (38760 records). [2025-10-06T20:38:39.417742] [INFO ] [MAIN ] NVRI: Full history saved. [2025-10-06T20:38:39.417985] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVRI took 34.1s. Estimated remaining: 1h 55m 34s. Rate: 7.1 symbols/min [2025-10-06T20:38:39.599372] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:38:39.635301] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T20:38:39.690379] [DEBUG] [LOCAL ] NVT: Loaded 52261 existing records from primary storage. [2025-10-06T20:38:39.690793] [INFO ] [MAIN ] NVT: Loaded 52261 existing records. [2025-10-06T20:38:39.830616] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-06T20:38:39.873235] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:38:39.873678] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-06T20:38:39.873741] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-06T20:38:39.874596] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-10-06T20:38:39.874684] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-06T20:38:40.224227] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:38:40.625566] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-06T20:38:40.895029] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-06T20:38:41.425551] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-06T20:38:41.639974] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T20:38:42.225561] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-06T20:38:42.679145] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-06T20:38:43.025568] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-06T20:38:43.761911] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-06T20:38:43.765693] [INFO ] [REMOTE ] NVO: Full fetch complete (77955 records). [2025-10-06T20:38:43.765821] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-06T20:38:43.830097] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-06T20:38:44.203139] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-06T20:38:44.201711] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-10-06T20:38:44.213222] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-10-06T20:38:44.214773] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-10-06T20:38:44.214989] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-10-06T20:38:44.216584] [DEBUG] [LOCAL ] NVO: Trimmed 77955 records to 53784 (keeping 200 days of data) [2025-10-06T20:38:44.546615] [DEBUG] [LOCAL ] NVO: Primary data saved (53784 records). [2025-10-06T20:38:44.546839] [INFO ] [MAIN ] NVO: Full history saved. [2025-10-06T20:38:44.546925] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVO took 52.5s. Estimated remaining: 1h 55m 24s. Rate: 7.1 symbols/min [2025-10-06T20:38:44.626958] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-06T20:38:44.733509] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:38:44.786893] [DEBUG] [LOCAL ] NWG: Loaded 52239 existing records from primary storage. [2025-10-06T20:38:44.787283] [INFO ] [MAIN ] NWG: Loaded 52239 existing records. [2025-10-06T20:38:44.993591] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:38:45.004306] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-06T20:38:45.004986] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-06T20:38:45.006084] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-06T20:38:45.009781] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-10-06T20:38:45.016053] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-06T20:38:45.379845] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:38:45.425494] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-06T20:38:45.456053] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T20:38:46.225493] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-06T20:38:46.498583] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-06T20:38:46.657507] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T20:38:47.025565] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-06T20:38:47.750907] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T20:38:47.825545] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-06T20:38:48.625551] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-06T20:38:48.798635] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T20:38:49.323502] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T20:38:49.425525] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-06T20:38:50.169506] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-06T20:38:50.174194] [INFO ] [REMOTE ] NVS: Full fetch complete (74798 records). [2025-10-06T20:38:50.174310] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-06T20:38:50.236704] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-06T20:38:50.565673] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-10-06T20:38:50.565768] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-10-06T20:38:50.566812] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-10-06T20:38:50.566876] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-10-06T20:38:50.568522] [DEBUG] [LOCAL ] NVS: Trimmed 74798 records to 51536 (keeping 200 days of data) [2025-10-06T20:38:50.895054] [DEBUG] [LOCAL ] NVS: Primary data saved (51536 records). [2025-10-06T20:38:50.895216] [INFO ] [MAIN ] NVS: Full history saved. [2025-10-06T20:38:50.895311] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NVS took 44.1s. Estimated remaining: 1h 55m 14s. Rate: 7.1 symbols/min [2025-10-06T20:38:51.037039] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-06T20:38:51.070594] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:38:51.097895] [DEBUG] [LOCAL ] NWN: Loaded 27050 existing records from primary storage. [2025-10-06T20:38:51.098195] [INFO ] [MAIN ] NWN: Loaded 27050 existing records. [2025-10-06T20:38:51.286337] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:38:51.286676] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-06T20:38:51.286814] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-06T20:38:51.287169] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-10-06T20:38:51.287229] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-06T20:38:51.583291] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-06T20:38:51.700161] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:38:51.825522] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-06T20:38:52.058278] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T20:38:52.625564] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-06T20:38:52.870845] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-06T20:38:53.307555] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T20:38:53.425508] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-06T20:38:54.225503] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-06T20:38:54.339542] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T20:38:54.825578] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T20:38:55.025546] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-06T20:38:55.727725] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T20:38:55.731275] [INFO ] [REMOTE ] NVST: Full fetch complete (74114 records). [2025-10-06T20:38:55.731387] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-06T20:38:55.830583] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-06T20:38:56.194637] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-10-06T20:38:56.194748] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-10-06T20:38:56.195789] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-10-06T20:38:56.195853] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-10-06T20:38:56.197230] [DEBUG] [LOCAL ] NVST: Trimmed 74114 records to 51599 (keeping 200 days of data) [2025-10-06T20:38:56.488150] [DEBUG] [LOCAL ] NVST: Primary data saved (51599 records). [2025-10-06T20:38:56.488284] [INFO ] [MAIN ] NVST: Full history saved. [2025-10-06T20:38:56.488367] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NVST took 34.6s. Estimated remaining: 1h 55m 4s. Rate: 7.1 symbols/min [2025-10-06T20:38:56.634159] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-06T20:38:56.659591] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:38:56.694393] [DEBUG] [LOCAL ] NX: Loaded 33616 existing records from primary storage. [2025-10-06T20:38:56.694691] [INFO ] [MAIN ] NX: Loaded 33616 existing records. [2025-10-06T20:38:56.878237] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:38:56.878489] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-06T20:38:56.878558] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-06T20:38:56.878875] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-10-06T20:38:56.878935] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-06T20:38:57.145423] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-06T20:38:57.295294] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:38:57.296450] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T20:38:57.425467] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-06T20:38:58.225494] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-06T20:38:58.358739] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T20:38:58.608018] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T20:38:59.025514] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-06T20:38:59.825503] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-06T20:38:59.984958] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T20:39:00.228670] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T20:39:00.625509] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-06T20:39:01.425550] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-06T20:39:01.470494] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T20:39:01.992031] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T20:39:02.225578] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-06T20:39:03.025583] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-06T20:39:03.473699] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-06T20:39:03.825487] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-06T20:39:04.256389] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-06T20:39:04.524235] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T20:39:04.625523] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-06T20:39:05.425548] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-06T20:39:05.689610] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-06T20:39:05.992769] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T20:39:05.995831] [INFO ] [REMOTE ] NVT: Full fetch complete (74556 records). [2025-10-06T20:39:05.995953] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-06T20:39:06.231295] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-06T20:39:06.410215] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-10-06T20:39:06.410310] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-10-06T20:39:06.411403] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-10-06T20:39:06.411485] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-10-06T20:39:06.413000] [DEBUG] [LOCAL ] NVT: Trimmed 74556 records to 51506 (keeping 200 days of data) [2025-10-06T20:39:06.496467] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T20:39:06.760085] [DEBUG] [LOCAL ] NVT: Primary data saved (51506 records). [2025-10-06T20:39:06.760232] [INFO ] [MAIN ] NVT: Full history saved. [2025-10-06T20:39:06.760330] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NVT took 27.3s. Estimated remaining: 1h 54m 57s. Rate: 7.1 symbols/min [2025-10-06T20:39:06.928700] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:39:06.935607] [DEBUG] [LOCAL ] NXC: Loaded 4226 existing records from primary storage. [2025-10-06T20:39:06.935825] [INFO ] [MAIN ] NXC: Loaded 4226 existing records. [2025-10-06T20:39:07.032434] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-06T20:39:07.114801] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:39:07.115009] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-06T20:39:07.115057] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-06T20:39:07.115245] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-06T20:39:07.115303] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-06T20:39:07.465115] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:39:07.818861] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T20:39:07.825933] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-06T20:39:08.302912] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-06T20:39:08.380187] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-06T20:39:08.625581] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-06T20:39:09.425585] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-06T20:39:10.028867] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T20:39:10.028988] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T20:39:10.225537] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-06T20:39:11.025566] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-06T20:39:11.525242] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T20:39:11.825551] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-06T20:39:12.625622] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-06T20:39:12.923854] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T20:39:13.041418] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-06T20:39:13.322155] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T20:39:13.425476] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-06T20:39:14.225579] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-06T20:39:14.907415] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-06T20:39:14.995529] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T20:39:15.025518] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-06T20:39:15.825532] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-06T20:39:16.625584] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-06T20:39:16.746748] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T20:39:17.425546] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-06T20:39:17.713258] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T20:39:17.891687] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T20:39:18.225607] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-06T20:39:19.025553] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-06T20:39:19.057509] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T20:39:19.825524] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-06T20:39:20.038812] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T20:39:20.374395] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-06T20:39:20.555591] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T20:39:20.625510] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-06T20:39:21.275178] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-06T20:39:21.425559] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-06T20:39:22.225536] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-06T20:39:22.856692] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T20:39:23.025529] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-06T20:39:23.520386] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T20:39:23.523739] [INFO ] [REMOTE ] NWG: Full fetch complete (73486 records). [2025-10-06T20:39:23.523856] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-06T20:39:23.831476] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-06T20:39:23.963218] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-10-06T20:39:23.963353] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-10-06T20:39:23.964390] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-10-06T20:39:23.964547] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-10-06T20:39:23.966049] [DEBUG] [LOCAL ] NWG: Trimmed 73486 records to 51460 (keeping 200 days of data) [2025-10-06T20:39:24.071207] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T20:39:24.301266] [DEBUG] [LOCAL ] NWG: Primary data saved (51460 records). [2025-10-06T20:39:24.301410] [INFO ] [MAIN ] NWG: Full history saved. [2025-10-06T20:39:24.301493] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NWG took 39.8s. Estimated remaining: 1h 54m 53s. Rate: 7.1 symbols/min [2025-10-06T20:39:24.474795] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:39:24.475010] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-06T20:39:24.475061] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-06T20:39:24.475200] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-06T20:39:24.475252] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-06T20:39:24.475295] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-06T20:39:24.475326] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-06T20:39:24.582890] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T20:39:24.630598] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-06T20:39:24.845784] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:39:25.425521] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-06T20:39:25.646749] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T20:39:25.648675] [INFO ] [REMOTE ] NWN: Full fetch complete (37332 records). [2025-10-06T20:39:25.648764] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-06T20:39:25.940024] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-06T20:39:26.032842] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-10-06T20:39:26.033189] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-10-06T20:39:26.033977] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-10-06T20:39:26.034050] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-10-06T20:39:26.035235] [DEBUG] [LOCAL ] NWN: Trimmed 37332 records to 26811 (keeping 200 days of data) [2025-10-06T20:39:26.197184] [DEBUG] [LOCAL ] NWN: Primary data saved (26811 records). [2025-10-06T20:39:26.197319] [INFO ] [MAIN ] NWN: Full history saved. [2025-10-06T20:39:26.197415] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NWN took 35.3s. Estimated remaining: 1h 54m 41s. Rate: 7.1 symbols/min [2025-10-06T20:39:26.225509] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-06T20:39:27.025544] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-06T20:39:27.382210] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:39:27.382584] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-06T20:39:27.382717] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:39:27.382762] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-06T20:39:27.382796] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:39:27.382830] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-06T20:39:27.382886] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-06T20:39:27.382930] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-06T20:39:27.382988] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-06T20:39:27.383059] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NXDR took 3.1s. Estimated remaining: 1h 54m 29s. Rate: 7.1 symbols/min [2025-10-06T20:39:27.564739] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T20:39:27.825537] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-06T20:39:28.625704] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-06T20:39:29.312567] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-06T20:39:29.425545] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-06T20:39:29.506160] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T20:39:30.157609] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T20:39:30.225627] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-06T20:39:31.025612] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-06T20:39:31.354196] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T20:39:31.356437] [INFO ] [REMOTE ] NX: Full fetch complete (48368 records). [2025-10-06T20:39:31.356538] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-06T20:39:31.545826] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T20:39:31.603542] [INFO ] [REMOTE ] NXC: Full fetch complete (5915 records). [2025-10-06T20:39:31.637708] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-06T20:39:31.919560] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-10-06T20:39:31.935392] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-10-06T20:39:31.972145] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-10-06T20:39:32.004522] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-10-06T20:39:32.069493] [DEBUG] [LOCAL ] NX: Trimmed 48368 records to 33137 (keeping 200 days of data) [2025-10-06T20:39:32.191563] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-06T20:39:32.192005] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-06T20:39:32.192127] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-06T20:39:32.192199] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-06T20:39:32.220409] [DEBUG] [LOCAL ] NXC: Trimmed 5915 records to 4130 (keeping 200 days of data) [2025-10-06T20:39:32.254976] [DEBUG] [LOCAL ] NXC: Primary data saved (4130 records). [2025-10-06T20:39:32.255600] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-06T20:39:32.255965] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NXC took 25.5s. Estimated remaining: 1h 54m 19s. Rate: 7.1 symbols/min [2025-10-06T20:39:32.357918] [DEBUG] [LOCAL ] NX: Primary data saved (33137 records). [2025-10-06T20:39:32.358085] [INFO ] [MAIN ] NX: Full history saved. [2025-10-06T20:39:32.358175] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NX took 35.9s. Estimated remaining: 1h 54m 6s. Rate: 7.1 symbols/min [2025-10-06T20:39:32.988887] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:39:33.012213] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:39:33.062829] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:39:33.088167] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:39:33.102369] [DEBUG] [LOCAL ] NXG: Loaded 10573 existing records from primary storage. [2025-10-06T20:39:33.102792] [INFO ] [MAIN ] NXG: Loaded 10573 existing records. [2025-10-06T20:39:33.119474] [DEBUG] [LOCAL ] NXDT: Loaded 16344 existing records from primary storage. [2025-10-06T20:39:33.165947] [INFO ] [MAIN ] NXDT: Loaded 16344 existing records. [2025-10-06T20:39:33.218813] [DEBUG] [LOCAL ] NXJ: Loaded 15143 existing records from primary storage. [2025-10-06T20:39:33.243512] [INFO ] [MAIN ] NXJ: Loaded 15143 existing records. [2025-10-06T20:39:33.580269] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:39:33.671860] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:39:33.672021] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-06T20:39:33.695383] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-06T20:39:33.695283] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:39:33.692242] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-06T20:39:33.673057] [DEBUG] [LOCAL ] NXE: Loaded 53770 existing records from primary storage. [2025-10-06T20:39:33.695916] [INFO ] [MAIN ] NXE: Loaded 53770 existing records. [2025-10-06T20:39:33.695833] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-06T20:39:33.716393] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-06T20:39:33.725905] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-06T20:39:33.701457] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-06T20:39:33.731237] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-06T20:39:33.736497] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-06T20:39:33.725803] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-06T20:39:33.826847] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-10-06T20:39:33.856169] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-06T20:39:34.288818] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:39:34.436012] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-06T20:39:34.500384] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-06T20:39:34.542586] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-06T20:39:34.570877] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-06T20:39:34.977472] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:39:35.007358] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-06T20:39:35.196831] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:39:35.243101] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-06T20:39:35.257048] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:39:35.269760] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-06T20:39:35.392638] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:39:35.392925] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-06T20:39:36.090040] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T20:39:36.092904] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-06T20:39:36.674240] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T20:39:36.679948] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-06T20:39:36.722236] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T20:39:36.726719] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-06T20:39:36.734988] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-06T20:39:37.157974] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T20:39:37.425525] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-06T20:39:37.636717] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T20:39:37.744563] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T20:39:38.002785] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T20:39:38.225514] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-06T20:39:39.025531] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-06T20:39:39.190980] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T20:39:39.825541] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-06T20:39:39.953151] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T20:39:40.625534] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-06T20:39:41.425548] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-06T20:39:41.560529] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T20:39:41.772692] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T20:39:42.225492] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-06T20:39:42.308951] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-06T20:39:43.025582] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-06T20:39:43.303254] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T20:39:43.825492] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-06T20:39:43.947352] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T20:39:44.625521] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-06T20:39:45.077942] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-06T20:39:45.425531] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-06T20:39:46.225540] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-06T20:39:46.520766] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-06T20:39:46.557638] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T20:39:46.825364] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T20:39:47.025544] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-06T20:39:47.825524] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-06T20:39:48.064346] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T20:39:48.625538] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-06T20:39:48.886211] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T20:39:49.425581] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-06T20:39:49.567272] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-06T20:39:50.225533] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-06T20:39:50.294235] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-06T20:39:51.025537] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-06T20:39:51.222839] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T20:39:51.825549] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-06T20:39:52.625544] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-06T20:39:52.878953] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T20:39:53.047921] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-06T20:39:53.327918] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-06T20:39:53.425573] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-06T20:39:54.225529] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-06T20:39:55.025550] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-06T20:39:55.272972] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T20:39:55.370733] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T20:39:55.825492] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-06T20:39:55.953844] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T20:39:56.625508] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-06T20:39:56.858908] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T20:39:57.425548] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-06T20:39:58.225487] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-06T20:39:58.612828] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T20:39:58.676476] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-06T20:39:58.968532] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T20:39:58.969679] [INFO ] [REMOTE ] NXG: Full fetch complete (14444 records). [2025-10-06T20:39:58.969756] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-06T20:39:59.033172] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-06T20:39:59.340519] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-06T20:39:59.340606] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-06T20:39:59.341004] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-06T20:39:59.341061] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-06T20:39:59.341538] [DEBUG] [LOCAL ] NXG: Trimmed 14444 records to 10384 (keeping 200 days of data) [2025-10-06T20:39:59.405832] [DEBUG] [LOCAL ] NXG: Primary data saved (10384 records). [2025-10-06T20:39:59.405970] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-06T20:39:59.406053] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXG took 27.0s. Estimated remaining: 1h 54m 7s. Rate: 7.1 symbols/min [2025-10-06T20:39:59.575274] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:39:59.580439] [DEBUG] [LOCAL ] NXN: Loaded 2339 existing records from primary storage. [2025-10-06T20:39:59.580676] [INFO ] [MAIN ] NXN: Loaded 2339 existing records. [2025-10-06T20:39:59.762236] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:39:59.762560] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-06T20:39:59.762631] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-06T20:39:59.762840] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-06T20:39:59.762906] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-06T20:39:59.830616] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-06T20:40:00.139417] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:40:00.153577] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T20:40:00.625536] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-06T20:40:01.262907] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-06T20:40:01.425565] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-06T20:40:01.960840] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-06T20:40:02.083167] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-06T20:40:02.225532] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-06T20:40:03.025541] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-06T20:40:03.155352] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T20:40:03.825519] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-06T20:40:04.042340] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T20:40:04.625567] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-06T20:40:04.802290] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T20:40:05.425606] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-06T20:40:06.143710] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T20:40:06.225532] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-06T20:40:06.666495] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-06T20:40:06.781184] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-06T20:40:07.025502] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-06T20:40:07.825567] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-06T20:40:08.557842] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T20:40:08.559938] [INFO ] [REMOTE ] NXDT: Full fetch complete (25288 records). [2025-10-06T20:40:08.560050] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-06T20:40:08.630802] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-06T20:40:08.974248] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-06T20:40:08.974346] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-06T20:40:08.974981] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-06T20:40:08.975061] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-06T20:40:08.975949] [DEBUG] [LOCAL ] NXDT: Trimmed 25288 records to 15527 (keeping 200 days of data) [2025-10-06T20:40:09.126033] [DEBUG] [LOCAL ] NXDT: Primary data saved (15527 records). [2025-10-06T20:40:09.128248] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-06T20:40:09.126888] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-06T20:40:09.128511] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXDT took 36.8s. Estimated remaining: 1h 53m 59s. Rate: 7.1 symbols/min [2025-10-06T20:40:09.315099] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:40:09.320064] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-06T20:40:09.336279] [DEBUG] [LOCAL ] NXP: Loaded 12677 existing records from primary storage. [2025-10-06T20:40:09.336524] [INFO ] [MAIN ] NXP: Loaded 12677 existing records. [2025-10-06T20:40:09.430723] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-06T20:40:09.534783] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:40:09.535039] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-06T20:40:09.535087] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-06T20:40:09.535315] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-06T20:40:09.535372] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-06T20:40:09.890341] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:40:10.125439] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T20:40:10.225555] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-06T20:40:11.025598] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-06T20:40:11.035394] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T20:40:11.036678] [INFO ] [REMOTE ] NXJ: Full fetch complete (20839 records). [2025-10-06T20:40:11.036758] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-06T20:40:11.437005] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-06T20:40:11.437090] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-06T20:40:11.437537] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-06T20:40:11.437598] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-06T20:40:11.438246] [DEBUG] [LOCAL ] NXJ: Trimmed 20839 records to 15010 (keeping 200 days of data) [2025-10-06T20:40:11.531331] [DEBUG] [LOCAL ] NXJ: Primary data saved (15010 records). [2025-10-06T20:40:11.531488] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-06T20:40:11.531573] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXJ took 39.2s. Estimated remaining: 1h 53m 48s. Rate: 7.1 symbols/min [2025-10-06T20:40:11.698156] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:40:11.718709] [DEBUG] [LOCAL ] NXRT: Loaded 19242 existing records from primary storage. [2025-10-06T20:40:11.719045] [INFO ] [MAIN ] NXRT: Loaded 19242 existing records. [2025-10-06T20:40:11.830747] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-06T20:40:11.903471] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:40:11.903898] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-06T20:40:11.903948] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-06T20:40:11.904137] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-10-06T20:40:11.904201] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-06T20:40:12.261218] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:40:12.625534] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-06T20:40:13.096949] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-06T20:40:13.125903] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T20:40:13.271344] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-06T20:40:13.425541] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-06T20:40:13.945097] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-06T20:40:14.225539] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-06T20:40:15.025574] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-06T20:40:15.825500] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-06T20:40:15.866809] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T20:40:15.869989] [INFO ] [REMOTE ] NXE: Full fetch complete (76712 records). [2025-10-06T20:40:15.870111] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-06T20:40:15.981943] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T20:40:16.271487] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-06T20:40:16.271575] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-06T20:40:16.272593] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-06T20:40:16.272681] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-06T20:40:16.274071] [DEBUG] [LOCAL ] NXE: Trimmed 76712 records to 53004 (keeping 200 days of data) [2025-10-06T20:40:16.571892] [DEBUG] [LOCAL ] NXE: Primary data saved (53004 records). [2025-10-06T20:40:16.572027] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-06T20:40:16.572134] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXE took 44.2s. Estimated remaining: 1h 53m 37s. Rate: 7.1 symbols/min [2025-10-06T20:40:16.631778] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-06T20:40:16.750725] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:40:16.750867] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-06T20:40:16.750904] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-06T20:40:16.751010] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-06T20:40:16.751054] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-06T20:40:16.751093] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-06T20:40:16.751123] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-06T20:40:17.112805] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:40:17.116720] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T20:40:17.425498] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-06T20:40:17.512209] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T20:40:18.173634] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T20:40:18.225471] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-06T20:40:19.025496] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-06T20:40:19.340013] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T20:40:19.728170] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-06T20:40:19.825481] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-06T20:40:20.625497] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-06T20:40:20.742365] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-06T20:40:21.228625] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T20:40:21.425554] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-06T20:40:21.961735] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-06T20:40:22.225555] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-06T20:40:22.788218] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-06T20:40:23.025573] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-06T20:40:23.533415] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-06T20:40:23.825554] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-06T20:40:24.212717] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-06T20:40:24.213414] [INFO ] [REMOTE ] NXN: Full fetch complete (3612 records). [2025-10-06T20:40:24.213498] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-06T20:40:24.580223] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-06T20:40:24.580310] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-06T20:40:24.580433] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-06T20:40:24.580470] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-06T20:40:24.580943] [DEBUG] [LOCAL ] NXN: Trimmed 3612 records to 2315 (keeping 200 days of data) [2025-10-06T20:40:24.599558] [DEBUG] [LOCAL ] NXN: Primary data saved (2315 records). [2025-10-06T20:40:24.599715] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-06T20:40:24.599845] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXN took 25.2s. Estimated remaining: 1h 53m 29s. Rate: 7.1 symbols/min [2025-10-06T20:40:24.630724] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-06T20:40:24.773201] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:40:24.825621] [DEBUG] [LOCAL ] NYT: Loaded 50552 existing records from primary storage. [2025-10-06T20:40:24.826043] [INFO ] [MAIN ] NYT: Loaded 50552 existing records. [2025-10-06T20:40:25.000158] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:40:25.000381] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-06T20:40:25.000427] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-06T20:40:25.000700] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-10-06T20:40:25.000757] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-06T20:40:25.351428] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:40:25.425486] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-06T20:40:25.841915] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T20:40:26.225567] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-06T20:40:26.659057] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T20:40:27.025531] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-06T20:40:27.825704] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-06T20:40:27.879879] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T20:40:27.900240] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T20:40:28.340923] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-06T20:40:28.625577] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-06T20:40:29.425548] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-06T20:40:29.621336] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T20:40:30.225541] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-06T20:40:30.711199] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-06T20:40:30.991190] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T20:40:31.025480] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-06T20:40:31.825530] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-06T20:40:32.604033] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T20:40:32.625481] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-06T20:40:32.788479] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T20:40:33.425610] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-06T20:40:34.225524] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-06T20:40:34.381180] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T20:40:34.447017] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T20:40:34.733855] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-06T20:40:35.025554] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-06T20:40:35.825535] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-06T20:40:36.280741] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-06T20:40:36.625491] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-06T20:40:36.835625] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T20:40:37.425546] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-06T20:40:37.758840] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T20:40:38.225550] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-06T20:40:39.025550] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-06T20:40:39.164572] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T20:40:39.361767] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T20:40:39.825590] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-06T20:40:39.924366] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T20:40:40.220151] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-06T20:40:40.625561] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-06T20:40:41.425528] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-06T20:40:41.652875] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T20:40:41.980346] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-06T20:40:42.225523] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-06T20:40:43.025524] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-06T20:40:43.033870] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T20:40:43.035366] [INFO ] [REMOTE ] NXP: Full fetch complete (16913 records). [2025-10-06T20:40:43.035537] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-06T20:40:43.417960] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-06T20:40:43.418087] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-06T20:40:43.418535] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-06T20:40:43.418578] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-06T20:40:43.419333] [DEBUG] [LOCAL ] NXP: Trimmed 16913 records to 12444 (keeping 200 days of data) [2025-10-06T20:40:43.501924] [DEBUG] [LOCAL ] NXP: Primary data saved (12444 records). [2025-10-06T20:40:43.502092] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-06T20:40:43.502184] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXP took 34.4s. Estimated remaining: 1h 53m 26s. Rate: 7.1 symbols/min [2025-10-06T20:40:43.709117] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:40:43.743737] [DEBUG] [LOCAL ] NZF: Loaded 29526 existing records from primary storage. [2025-10-06T20:40:43.744048] [INFO ] [MAIN ] NZF: Loaded 29526 existing records. [2025-10-06T20:40:43.832750] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-06T20:40:43.923770] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:40:43.923973] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-06T20:40:43.924020] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-06T20:40:43.924251] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-10-06T20:40:43.924308] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-06T20:40:44.281614] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:40:44.592948] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T20:40:44.625473] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-06T20:40:44.971902] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T20:40:45.425536] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-06T20:40:46.096611] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T20:40:46.225542] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-06T20:40:46.649258] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T20:40:47.025586] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-06T20:40:47.825493] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-06T20:40:47.871959] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T20:40:48.625483] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-06T20:40:48.780488] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T20:40:48.843812] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T20:40:49.425541] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-06T20:40:50.186472] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T20:40:50.225478] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-06T20:40:50.288557] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T20:40:50.290049] [INFO ] [REMOTE ] NXRT: Full fetch complete (25608 records). [2025-10-06T20:40:50.290143] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-06T20:40:50.653717] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-10-06T20:40:50.653803] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-10-06T20:40:50.654289] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-10-06T20:40:50.654328] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-10-06T20:40:50.654985] [DEBUG] [LOCAL ] NXRT: Trimmed 25608 records to 18928 (keeping 200 days of data) [2025-10-06T20:40:50.769591] [DEBUG] [LOCAL ] NXRT: Primary data saved (18928 records). [2025-10-06T20:40:50.769761] [INFO ] [MAIN ] NXRT: Full history saved. [2025-10-06T20:40:50.769851] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NXRT took 39.2s. Estimated remaining: 1h 53m 17s. Rate: 7.1 symbols/min [2025-10-06T20:40:50.952315] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:40:50.952507] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-06T20:40:50.952561] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-06T20:40:50.952786] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-06T20:40:50.952839] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-06T20:40:50.952881] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-06T20:40:50.952914] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-06T20:40:51.030765] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-06T20:40:51.305586] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:40:51.710627] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T20:40:51.713437] [INFO ] [REMOTE ] NYT: Full fetch complete (72081 records). [2025-10-06T20:40:51.713532] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-06T20:40:51.830766] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-06T20:40:52.121327] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-10-06T20:40:52.121419] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-10-06T20:40:52.122440] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-10-06T20:40:52.122506] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-10-06T20:40:52.123930] [DEBUG] [LOCAL ] NYT: Trimmed 72081 records to 49837 (keeping 200 days of data) [2025-10-06T20:40:52.240010] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-06T20:40:52.241442] [INFO ] [REMOTE ] NYC: Full fetch complete (1894 records). [2025-10-06T20:40:52.241967] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-06T20:40:52.437316] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-06T20:40:52.437964] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:40:52.439117] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:40:52.440333] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-06T20:40:52.445619] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-06T20:40:52.456377] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-06T20:40:52.457445] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-06T20:40:52.458034] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T20:40:52.460793] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NYC took 35.9s. Estimated remaining: 1h 53m 5s. Rate: 7.1 symbols/min [2025-10-06T20:40:52.628169] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-06T20:40:52.784742] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:40:52.895404] [DEBUG] [LOCAL ] NYT: Primary data saved (49837 records). [2025-10-06T20:40:52.895601] [INFO ] [MAIN ] NYT: Full history saved. [2025-10-06T20:40:52.895832] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NYT took 28.3s. Estimated remaining: 1h 52m 52s. Rate: 7.1 symbols/min [2025-10-06T20:40:52.896925] [DEBUG] [LOCAL ] OBDC: Loaded 52438 existing records from primary storage. [2025-10-06T20:40:52.948270] [INFO ] [MAIN ] OBDC: Loaded 52438 existing records. [2025-10-06T20:40:53.248450] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:40:53.326409] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:40:53.326717] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-06T20:40:53.326776] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-06T20:40:53.327054] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-10-06T20:40:53.327146] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-06T20:40:53.425247] [DEBUG] [LOCAL ] OBK: Loaded 16319 existing records from primary storage. [2025-10-06T20:40:53.432724] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-06T20:40:53.437148] [INFO ] [MAIN ] OBK: Loaded 16319 existing records. [2025-10-06T20:40:53.768543] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:40:53.780487] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-06T20:40:53.804842] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-06T20:40:53.807480] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-10-06T20:40:53.807550] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-06T20:40:53.993717] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:40:54.079133] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T20:40:54.236507] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-06T20:40:54.278233] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:40:55.025583] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-06T20:40:55.825517] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-06T20:40:56.028620] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T20:40:56.076909] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T20:40:56.338236] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-10-06T20:40:56.625550] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-06T20:40:56.969118] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T20:40:57.425619] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-06T20:40:58.225560] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-06T20:40:58.326528] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T20:40:58.592949] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T20:40:59.025559] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-06T20:40:59.244357] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T20:40:59.830621] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-06T20:40:59.839588] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T20:41:00.625571] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-06T20:41:01.425523] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-06T20:41:01.525285] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T20:41:01.764904] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-06T20:41:02.225550] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-06T20:41:02.739383] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T20:41:03.025594] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-06T20:41:03.825567] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-06T20:41:03.920410] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T20:41:04.057490] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T20:41:04.625522] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-06T20:41:04.863712] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T20:41:05.425538] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-06T20:41:06.225531] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-06T20:41:06.541723] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T20:41:06.592839] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T20:41:06.697623] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-06T20:41:07.025586] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-06T20:41:07.825553] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-06T20:41:08.625537] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-06T20:41:08.954932] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-06T20:41:09.242359] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T20:41:09.425539] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-06T20:41:09.608596] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T20:41:10.225555] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-06T20:41:11.025512] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-06T20:41:11.160932] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T20:41:11.222445] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-06T20:41:11.825516] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-06T20:41:12.372141] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T20:41:12.625717] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-06T20:41:13.425573] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-06T20:41:13.691300] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-06T20:41:13.830455] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T20:41:13.832704] [INFO ] [REMOTE ] NZF: Full fetch complete (43294 records). [2025-10-06T20:41:13.832797] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-06T20:41:14.214232] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-06T20:41:14.214450] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-06T20:41:14.215283] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-06T20:41:14.215363] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-06T20:41:14.216550] [DEBUG] [LOCAL ] NZF: Trimmed 43294 records to 29130 (keeping 200 days of data) [2025-10-06T20:41:14.296776] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-06T20:41:14.339607] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-06T20:41:14.442802] [DEBUG] [LOCAL ] NZF: Primary data saved (29130 records). [2025-10-06T20:41:14.442955] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-06T20:41:14.443041] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NZF took 30.9s. Estimated remaining: 1h 52m 50s. Rate: 7.1 symbols/min [2025-10-06T20:41:14.611538] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:41:14.660547] [DEBUG] [LOCAL ] OC: Loaded 45253 existing records from primary storage. [2025-10-06T20:41:14.660915] [INFO ] [MAIN ] OC: Loaded 45253 existing records. [2025-10-06T20:41:14.835928] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:41:14.836158] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-06T20:41:14.836205] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-06T20:41:14.836454] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-10-06T20:41:14.836511] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-06T20:41:15.034020] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-06T20:41:15.190618] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:41:15.825487] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-06T20:41:16.191689] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T20:41:16.246527] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T20:41:16.625538] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-06T20:41:17.402614] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T20:41:17.425495] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-06T20:41:17.721615] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T20:41:18.225563] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-06T20:41:19.025520] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-06T20:41:19.437973] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-06T20:41:19.811208] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T20:41:19.825473] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-06T20:41:20.108751] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T20:41:20.625544] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-06T20:41:21.425569] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-06T20:41:21.480683] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T20:41:21.537104] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-06T20:41:22.225496] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-06T20:41:22.400390] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T20:41:22.906806] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-06T20:41:23.025512] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-06T20:41:23.825526] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-06T20:41:24.386606] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T20:41:24.389932] [INFO ] [REMOTE ] OBDC: Full fetch complete (75043 records). [2025-10-06T20:41:24.390085] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-06T20:41:24.630720] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-06T20:41:24.791303] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-10-06T20:41:24.791419] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-10-06T20:41:24.792561] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-10-06T20:41:24.792715] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-10-06T20:41:24.794276] [DEBUG] [LOCAL ] OBDC: Trimmed 75043 records to 51661 (keeping 200 days of data) [2025-10-06T20:41:24.865225] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T20:41:25.120715] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-06T20:41:25.125214] [INFO ] [REMOTE ] O: Full fetch complete (77169 records). [2025-10-06T20:41:25.126222] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-06T20:41:25.127889] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:41:25.128855] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:41:25.130234] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:41:25.130625] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-06T20:41:25.131350] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-06T20:41:25.131696] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-06T20:41:25.133189] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-06T20:41:25.133899] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. O took 34.4s. Estimated remaining: 1h 52m 43s. Rate: 7.1 symbols/min [2025-10-06T20:41:25.363136] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:41:25.368302] [DEBUG] [LOCAL ] OBDC: Primary data saved (51661 records). [2025-10-06T20:41:25.368631] [INFO ] [MAIN ] OBDC: Full history saved. [2025-10-06T20:41:25.368776] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. OBDC took 32.8s. Estimated remaining: 1h 52m 30s. Rate: 7.1 symbols/min [2025-10-06T20:41:25.430690] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-06T20:41:25.490083] [DEBUG] [LOCAL ] OCFT: Loaded 8222 existing records from primary storage. [2025-10-06T20:41:25.495708] [INFO ] [MAIN ] OCFT: Loaded 8222 existing records. [2025-10-06T20:41:25.648975] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:41:25.734279] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:41:25.737820] [DEBUG] [LOCAL ] ODC: Loaded 8504 existing records from primary storage. [2025-10-06T20:41:25.737959] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-06T20:41:25.738080] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-06T20:41:25.738248] [INFO ] [MAIN ] ODC: Loaded 8504 existing records. [2025-10-06T20:41:25.802176] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-06T20:41:25.813823] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-06T20:41:26.077232] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:41:26.102032] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-06T20:41:26.139190] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-06T20:41:26.171386] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-06T20:41:26.177181] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-06T20:41:26.240804] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-06T20:41:26.429209] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:41:26.714390] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:41:27.025495] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-06T20:41:27.302950] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T20:41:27.494767] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T20:41:27.825503] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-06T20:41:27.904191] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-06T20:41:28.625540] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-06T20:41:29.425483] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-06T20:41:29.542915] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-06T20:41:29.693180] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T20:41:30.045621] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-06T20:41:30.225528] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-06T20:41:30.853694] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T20:41:31.025560] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-06T20:41:31.825556] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-06T20:41:32.625539] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-06T20:41:32.827859] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T20:41:32.916198] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T20:41:33.157785] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-06T20:41:33.425531] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-06T20:41:34.225604] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-06T20:41:34.927514] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-06T20:41:35.025499] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-06T20:41:35.164382] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T20:41:35.710471] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-06T20:41:35.825527] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-06T20:41:36.625533] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-06T20:41:37.025459] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T20:41:37.425503] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-06T20:41:37.553960] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T20:41:38.225609] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-06T20:41:39.009754] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T20:41:39.025476] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-06T20:41:39.144002] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-06T20:41:39.825529] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-06T20:41:40.625495] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-06T20:41:40.683234] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T20:41:40.887034] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T20:41:41.385935] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T20:41:41.387673] [INFO ] [REMOTE ] OBK: Full fetch complete (23870 records). [2025-10-06T20:41:41.387763] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-06T20:41:41.430585] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-06T20:41:41.856093] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-10-06T20:41:41.856177] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-10-06T20:41:41.856782] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-10-06T20:41:41.856848] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-10-06T20:41:41.857461] [DEBUG] [LOCAL ] OBK: Trimmed 23870 records to 16137 (keeping 200 days of data) [2025-10-06T20:41:41.966382] [DEBUG] [LOCAL ] OBK: Primary data saved (16137 records). [2025-10-06T20:41:41.966533] [INFO ] [MAIN ] OBK: Full history saved. [2025-10-06T20:41:41.966619] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OBK took 49.1s. Estimated remaining: 1h 52m 26s. Rate: 7.1 symbols/min [2025-10-06T20:41:42.178426] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:41:42.207063] [DEBUG] [LOCAL ] ODV: Loaded 27495 existing records from primary storage. [2025-10-06T20:41:42.207322] [INFO ] [MAIN ] ODV: Loaded 27495 existing records. [2025-10-06T20:41:42.232927] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-06T20:41:42.413844] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:41:42.414078] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-06T20:41:42.414125] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-06T20:41:42.414339] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-06T20:41:42.414398] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-06T20:41:42.769928] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:41:43.025488] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-06T20:41:43.148718] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T20:41:43.150272] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T20:41:43.825506] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-06T20:41:44.006637] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T20:41:44.625505] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-06T20:41:44.710265] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T20:41:45.425550] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-06T20:41:45.570808] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T20:41:46.225534] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-06T20:41:46.250042] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-06T20:41:47.025498] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-06T20:41:47.060963] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T20:41:47.825498] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-06T20:41:47.915681] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-06T20:41:48.625577] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-06T20:41:48.645451] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-06T20:41:49.425525] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-06T20:41:49.592217] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T20:41:50.225530] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-06T20:41:50.266827] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T20:41:51.025525] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-06T20:41:51.130923] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-06T20:41:51.716280] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-06T20:41:51.825480] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-06T20:41:52.322838] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-06T20:41:52.323607] [INFO ] [REMOTE ] OCFT: Full fetch complete (11675 records). [2025-10-06T20:41:52.323703] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-06T20:41:52.638870] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-06T20:41:52.681032] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-06T20:41:52.681159] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-06T20:41:52.681450] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-06T20:41:52.681490] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-06T20:41:52.681971] [DEBUG] [LOCAL ] OCFT: Trimmed 11675 records to 7844 (keeping 200 days of data) [2025-10-06T20:41:52.724824] [DEBUG] [LOCAL ] OCFT: Primary data saved (7844 records). [2025-10-06T20:41:52.724961] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-06T20:41:52.725048] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OCFT took 27.6s. Estimated remaining: 1h 52m 19s. Rate: 7.1 symbols/min [2025-10-06T20:41:52.894820] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:41:52.931220] [DEBUG] [LOCAL ] OEC: Loaded 37501 existing records from primary storage. [2025-10-06T20:41:52.931518] [INFO ] [MAIN ] OEC: Loaded 37501 existing records. [2025-10-06T20:41:53.105098] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:41:53.105326] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-06T20:41:53.105371] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-06T20:41:53.105611] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-10-06T20:41:53.105702] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-06T20:41:53.428682] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-06T20:41:53.458575] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:41:53.719364] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T20:41:54.225496] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-06T20:41:54.305524] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T20:41:55.025624] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-06T20:41:55.378890] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T20:41:55.825538] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-06T20:41:56.328711] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T20:41:56.625539] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-06T20:41:56.913583] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T20:41:57.425533] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-06T20:41:58.058464] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T20:41:58.061613] [INFO ] [REMOTE ] OC: Full fetch complete (64145 records). [2025-10-06T20:41:58.061818] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-06T20:41:58.237738] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-06T20:41:58.466514] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-10-06T20:41:58.466614] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-10-06T20:41:58.467687] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-10-06T20:41:58.467765] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-10-06T20:41:58.469240] [DEBUG] [LOCAL ] OC: Trimmed 64145 records to 44624 (keeping 200 days of data) [2025-10-06T20:41:58.592431] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T20:41:58.797271] [DEBUG] [LOCAL ] OC: Primary data saved (44624 records). [2025-10-06T20:41:58.797446] [INFO ] [MAIN ] OC: Full history saved. [2025-10-06T20:41:58.797538] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. OC took 44.4s. Estimated remaining: 1h 52m 9s. Rate: 7.1 symbols/min [2025-10-06T20:41:58.976554] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:41:58.998594] [DEBUG] [LOCAL ] OFG: Loaded 21781 existing records from primary storage. [2025-10-06T20:41:58.998896] [INFO ] [MAIN ] OFG: Loaded 21781 existing records. [2025-10-06T20:41:59.034186] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T20:41:59.030878] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-06T20:41:59.048677] [INFO ] [REMOTE ] ODC: Full fetch complete (10882 records). [2025-10-06T20:41:59.082017] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-06T20:41:59.339155] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:41:59.348948] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-06T20:41:59.349035] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-06T20:41:59.405176] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-10-06T20:41:59.479094] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-06T20:41:59.728259] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-06T20:41:59.735145] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-06T20:41:59.742330] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-06T20:41:59.744673] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-06T20:41:59.746583] [DEBUG] [LOCAL ] ODC: Trimmed 10882 records to 8343 (keeping 200 days of data) [2025-10-06T20:41:59.829896] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-06T20:41:59.990039] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:42:00.003439] [DEBUG] [LOCAL ] ODC: Primary data saved (8343 records). [2025-10-06T20:42:00.003556] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-06T20:42:00.003631] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. ODC took 34.6s. Estimated remaining: 1h 51m 57s. Rate: 7.1 symbols/min [2025-10-06T20:42:00.175269] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:42:00.220389] [DEBUG] [LOCAL ] OGE: Loaded 47004 existing records from primary storage. [2025-10-06T20:42:00.220856] [INFO ] [MAIN ] OGE: Loaded 47004 existing records. [2025-10-06T20:42:00.418440] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T20:42:00.438589] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:42:00.444949] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-06T20:42:00.445106] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-06T20:42:00.445685] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-10-06T20:42:00.445746] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-06T20:42:00.634735] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-06T20:42:00.810268] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:42:00.896956] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T20:42:01.425551] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-06T20:42:02.097673] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T20:42:02.225621] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-06T20:42:02.995259] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T20:42:03.025499] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-06T20:42:03.825572] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-06T20:42:04.091677] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-06T20:42:04.153420] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-06T20:42:04.625617] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-06T20:42:05.372539] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T20:42:05.425476] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-06T20:42:06.225591] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-06T20:42:06.352178] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T20:42:06.800307] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T20:42:07.025582] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-06T20:42:07.682335] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T20:42:07.825518] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-06T20:42:08.571880] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T20:42:08.625498] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-06T20:42:09.083164] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T20:42:09.425532] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-06T20:42:10.164124] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-06T20:42:10.225528] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-06T20:42:10.782612] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T20:42:10.785334] [INFO ] [REMOTE ] ODV: Full fetch complete (33613 records). [2025-10-06T20:42:10.785458] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-06T20:42:11.037903] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-06T20:42:11.171275] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-06T20:42:11.171362] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-06T20:42:11.172062] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-06T20:42:11.172141] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-06T20:42:11.173068] [DEBUG] [LOCAL ] ODV: Trimmed 33613 records to 27384 (keeping 200 days of data) [2025-10-06T20:42:11.325970] [DEBUG] [LOCAL ] ODV: Primary data saved (27384 records). [2025-10-06T20:42:11.326117] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-06T20:42:11.326217] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. ODV took 29.4s. Estimated remaining: 1h 51m 50s. Rate: 7.1 symbols/min [2025-10-06T20:42:11.495861] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:42:11.547875] [DEBUG] [LOCAL ] OGN: Loaded 53867 existing records from primary storage. [2025-10-06T20:42:11.548257] [INFO ] [MAIN ] OGN: Loaded 53867 existing records. [2025-10-06T20:42:11.725515] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:42:11.725794] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-06T20:42:11.725855] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-06T20:42:11.726123] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-10-06T20:42:11.726184] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-06T20:42:11.826740] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-06T20:42:12.120873] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:42:12.116166] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T20:42:12.625492] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-06T20:42:12.656015] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T20:42:13.416909] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T20:42:13.425498] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-06T20:42:14.152996] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T20:42:14.225525] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-06T20:42:14.745789] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-06T20:42:15.025603] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-06T20:42:15.825520] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-06T20:42:16.027687] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T20:42:16.625567] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-06T20:42:17.186936] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-06T20:42:17.430707] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-06T20:42:17.443810] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T20:42:18.225598] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-06T20:42:18.336097] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T20:42:18.414718] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T20:42:19.025545] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-06T20:42:19.772945] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T20:42:19.825480] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-06T20:42:20.625488] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-06T20:42:20.967089] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-06T20:42:21.367486] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T20:42:21.425520] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-06T20:42:21.858970] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T20:42:22.225541] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-06T20:42:22.623842] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T20:42:22.626501] [INFO ] [REMOTE ] OEC: Full fetch complete (52839 records). [2025-10-06T20:42:22.626638] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-06T20:42:23.030663] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-06T20:42:23.082920] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-10-06T20:42:23.083002] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-10-06T20:42:23.083890] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-10-06T20:42:23.083955] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-10-06T20:42:23.085368] [DEBUG] [LOCAL ] OEC: Trimmed 52839 records to 36886 (keeping 200 days of data) [2025-10-06T20:42:23.318619] [DEBUG] [LOCAL ] OEC: Primary data saved (36886 records). [2025-10-06T20:42:23.318803] [INFO ] [MAIN ] OEC: Full history saved. [2025-10-06T20:42:23.318896] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. OEC took 30.6s. Estimated remaining: 1h 51m 43s. Rate: 7.1 symbols/min [2025-10-06T20:42:23.512094] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:42:23.508627] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T20:42:23.550170] [DEBUG] [LOCAL ] OGS: Loaded 34630 existing records from primary storage. [2025-10-06T20:42:23.550466] [INFO ] [MAIN ] OGS: Loaded 34630 existing records. [2025-10-06T20:42:23.725354] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:42:23.725621] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-06T20:42:23.725714] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-06T20:42:23.725956] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-10-06T20:42:23.726017] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-06T20:42:23.830592] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-06T20:42:24.083027] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:42:24.625542] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-06T20:42:24.772744] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T20:42:24.893720] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T20:42:25.425574] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-06T20:42:26.073467] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T20:42:26.225572] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-06T20:42:26.593877] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T20:42:27.025558] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-06T20:42:27.163007] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-06T20:42:27.825562] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-06T20:42:27.849789] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T20:42:28.625496] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-06T20:42:29.425521] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-06T20:42:29.500842] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T20:42:29.792163] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T20:42:30.225579] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-06T20:42:30.514990] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-06T20:42:30.860519] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T20:42:30.862056] [INFO ] [REMOTE ] OFG: Full fetch complete (34147 records). [2025-10-06T20:42:30.862132] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-06T20:42:31.037793] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-06T20:42:31.238401] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-10-06T20:42:31.238484] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-10-06T20:42:31.239208] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-10-06T20:42:31.239309] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-10-06T20:42:31.240139] [DEBUG] [LOCAL ] OFG: Trimmed 34147 records to 21218 (keeping 200 days of data) [2025-10-06T20:42:31.370341] [DEBUG] [LOCAL ] OFG: Primary data saved (21218 records). [2025-10-06T20:42:31.370480] [INFO ] [MAIN ] OFG: Full history saved. [2025-10-06T20:42:31.370561] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OFG took 32.6s. Estimated remaining: 1h 51m 35s. Rate: 7.1 symbols/min [2025-10-06T20:42:31.536204] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:42:31.588033] [DEBUG] [LOCAL ] OHI: Loaded 52709 existing records from primary storage. [2025-10-06T20:42:31.588440] [INFO ] [MAIN ] OHI: Loaded 52709 existing records. [2025-10-06T20:42:31.764882] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:42:31.765108] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-06T20:42:31.765156] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-06T20:42:31.765672] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-10-06T20:42:31.765731] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-06T20:42:31.832879] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-06T20:42:32.121228] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:42:32.625493] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-06T20:42:32.782784] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T20:42:32.826070] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T20:42:33.425552] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-06T20:42:33.773785] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-06T20:42:34.225533] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-06T20:42:34.830952] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T20:42:34.834797] [INFO ] [REMOTE ] OGE: Full fetch complete (66759 records). [2025-10-06T20:42:34.834943] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-06T20:42:35.028899] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-06T20:42:35.240497] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-10-06T20:42:35.240588] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-10-06T20:42:35.241668] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-10-06T20:42:35.241733] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-10-06T20:42:35.243129] [DEBUG] [LOCAL ] OGE: Trimmed 66759 records to 46258 (keeping 200 days of data) [2025-10-06T20:42:35.541393] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-06T20:42:35.572382] [DEBUG] [LOCAL ] OGE: Primary data saved (46258 records). [2025-10-06T20:42:35.572544] [INFO ] [MAIN ] OGE: Full history saved. [2025-10-06T20:42:35.572637] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OGE took 35.6s. Estimated remaining: 1h 51m 24s. Rate: 7.1 symbols/min [2025-10-06T20:42:35.738224] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:42:35.781990] [DEBUG] [LOCAL ] OI: Loaded 47791 existing records from primary storage. [2025-10-06T20:42:35.782346] [INFO ] [MAIN ] OI: Loaded 47791 existing records. [2025-10-06T20:42:35.830904] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-06T20:42:35.965108] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:42:35.965352] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-06T20:42:35.965399] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-06T20:42:35.965701] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-10-06T20:42:35.965759] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-06T20:42:36.317813] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:42:36.392678] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-06T20:42:36.625532] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-06T20:42:36.844497] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-06T20:42:37.425591] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-06T20:42:38.210802] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T20:42:38.225691] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-06T20:42:39.025603] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-06T20:42:39.096478] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T20:42:39.825516] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-06T20:42:39.889162] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T20:42:40.625586] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-06T20:42:40.809342] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T20:42:41.261380] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T20:42:41.425578] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-06T20:42:41.921200] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T20:42:42.225584] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-06T20:42:42.512943] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T20:42:43.025542] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-06T20:42:43.825524] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-06T20:42:43.920468] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T20:42:44.625519] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-06T20:42:44.772133] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T20:42:44.909327] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T20:42:45.425527] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-06T20:42:46.187472] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T20:42:46.225493] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-06T20:42:47.025550] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-06T20:42:47.119515] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T20:42:47.248423] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T20:42:47.825567] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-06T20:42:48.563881] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T20:42:48.625562] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-06T20:42:49.425572] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-06T20:42:49.825380] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-06T20:42:50.118153] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T20:42:50.225599] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-06T20:42:50.231866] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-06T20:42:51.025609] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-06T20:42:51.825502] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-06T20:42:52.003483] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-06T20:42:52.029337] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T20:42:52.031461] [INFO ] [REMOTE ] OGS: Full fetch complete (48035 records). [2025-10-06T20:42:52.031581] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-06T20:42:52.415297] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-10-06T20:42:52.415410] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-10-06T20:42:52.416244] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-10-06T20:42:52.416306] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-10-06T20:42:52.417465] [DEBUG] [LOCAL ] OGS: Trimmed 48035 records to 34301 (keeping 200 days of data) [2025-10-06T20:42:52.628941] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-06T20:42:52.660030] [DEBUG] [LOCAL ] OGS: Primary data saved (34301 records). [2025-10-06T20:42:52.660234] [INFO ] [MAIN ] OGS: Full history saved. [2025-10-06T20:42:52.660363] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGS took 29.3s. Estimated remaining: 1h 51m 20s. Rate: 7.1 symbols/min [2025-10-06T20:42:52.880977] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:42:52.897508] [DEBUG] [LOCAL ] OIA: Loaded 13898 existing records from primary storage. [2025-10-06T20:42:52.897816] [INFO ] [MAIN ] OIA: Loaded 13898 existing records. [2025-10-06T20:42:53.117061] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:42:53.117299] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-06T20:42:53.117345] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-06T20:42:53.117509] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-06T20:42:53.117557] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-06T20:42:53.438824] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-06T20:42:53.618724] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:42:53.620836] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T20:42:53.726427] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T20:42:54.225543] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-06T20:42:54.839874] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T20:42:54.842594] [INFO ] [REMOTE ] OGN: Full fetch complete (76411 records). [2025-10-06T20:42:54.842779] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-06T20:42:54.843635] [FATAL] [VALIDATOR ] OGN: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:42:54.843747] [FATAL] [MAIN ] OGN: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:42:54.843823] [WARN ] [MAIN ] OGN: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:42:54.843878] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-06T20:42:54.843958] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-06T20:42:54.844015] [INFO ] [LOCAL ] OGN: Starting deletion of derivative data. [2025-10-06T20:42:54.844300] [DEBUG] [LOCAL ] OGN: Deleted derivative data file. [2025-10-06T20:42:54.844423] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OGN took 43.5s. Estimated remaining: 1h 51m 8s. Rate: 7.1 symbols/min [2025-10-06T20:42:55.037627] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-06T20:42:55.051133] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:42:55.097105] [DEBUG] [LOCAL ] OII: Loaded 43127 existing records from primary storage. [2025-10-06T20:42:55.097459] [INFO ] [MAIN ] OII: Loaded 43127 existing records. [2025-10-06T20:42:55.324696] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:42:55.325080] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-06T20:42:55.325174] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-06T20:42:55.325596] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-10-06T20:42:55.325697] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-06T20:42:55.663473] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-06T20:42:55.830068] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:42:55.830151] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-06T20:42:56.099632] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-06T20:42:56.625585] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-06T20:42:57.425595] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-06T20:42:57.633211] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-06T20:42:58.210283] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T20:42:58.225466] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-06T20:42:58.805320] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T20:42:59.025620] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-06T20:42:59.825560] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-06T20:43:00.049687] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T20:43:00.082909] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T20:43:00.625587] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-06T20:43:01.425487] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-06T20:43:01.949772] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-06T20:43:02.087776] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-06T20:43:02.225521] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-06T20:43:02.271408] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T20:43:03.025575] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-06T20:43:03.825501] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-06T20:43:03.996725] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T20:43:04.625588] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-06T20:43:04.670131] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T20:43:05.425605] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-06T20:43:05.939412] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-06T20:43:05.982254] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-06T20:43:06.225572] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-06T20:43:06.958067] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T20:43:07.025532] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-06T20:43:07.467611] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T20:43:07.471038] [INFO ] [REMOTE ] OI: Full fetch complete (68141 records). [2025-10-06T20:43:07.471199] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-06T20:43:07.833023] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-06T20:43:07.874188] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-10-06T20:43:07.874350] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-10-06T20:43:07.875454] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-10-06T20:43:07.875562] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-10-06T20:43:07.876994] [DEBUG] [LOCAL ] OI: Trimmed 68141 records to 47053 (keeping 200 days of data) [2025-10-06T20:43:08.171533] [DEBUG] [LOCAL ] OI: Primary data saved (47053 records). [2025-10-06T20:43:08.171706] [INFO ] [MAIN ] OI: Full history saved. [2025-10-06T20:43:08.171805] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OI took 32.6s. Estimated remaining: 1h 51m 2s. Rate: 7.1 symbols/min [2025-10-06T20:43:08.341212] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:43:08.378361] [DEBUG] [LOCAL ] OIS: Loaded 40930 existing records from primary storage. [2025-10-06T20:43:08.378682] [INFO ] [MAIN ] OIS: Loaded 40930 existing records. [2025-10-06T20:43:08.559980] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:43:08.560307] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-06T20:43:08.560365] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-06T20:43:08.560609] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-06T20:43:08.560698] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-06T20:43:08.638975] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-06T20:43:08.851025] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T20:43:08.937719] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:43:08.965902] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T20:43:09.425628] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-06T20:43:10.041971] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-06T20:43:10.220792] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T20:43:10.230377] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-06T20:43:11.025538] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-06T20:43:11.743403] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T20:43:11.746390] [INFO ] [REMOTE ] OHI: Full fetch complete (75127 records). [2025-10-06T20:43:11.746506] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-06T20:43:11.834883] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-06T20:43:12.131444] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-10-06T20:43:12.131531] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-10-06T20:43:12.132569] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-10-06T20:43:12.132635] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-10-06T20:43:12.134257] [DEBUG] [LOCAL ] OHI: Trimmed 75127 records to 51954 (keeping 200 days of data) [2025-10-06T20:43:12.459808] [DEBUG] [LOCAL ] OHI: Primary data saved (51954 records). [2025-10-06T20:43:12.460004] [INFO ] [MAIN ] OHI: Full history saved. [2025-10-06T20:43:12.460136] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OHI took 41.1s. Estimated remaining: 1h 50m 52s. Rate: 7.1 symbols/min [2025-10-06T20:43:12.630338] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-06T20:43:12.635095] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:43:12.658193] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T20:43:12.712369] [DEBUG] [LOCAL ] OKE: Loaded 54317 existing records from primary storage. [2025-10-06T20:43:12.712741] [INFO ] [MAIN ] OKE: Loaded 54317 existing records. [2025-10-06T20:43:12.884566] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:43:12.884829] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-06T20:43:12.884876] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-06T20:43:12.885112] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-10-06T20:43:12.885168] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-06T20:43:13.241442] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:43:13.425582] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-06T20:43:13.639026] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T20:43:13.638557] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T20:43:14.225605] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-06T20:43:15.025558] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-06T20:43:15.128801] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-06T20:43:15.504907] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-06T20:43:15.825544] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-06T20:43:16.599022] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T20:43:16.625497] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-06T20:43:17.400698] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T20:43:17.425495] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-06T20:43:17.813197] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T20:43:18.225535] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-06T20:43:19.030674] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-06T20:43:19.041229] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T20:43:19.277114] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T20:43:19.825531] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-06T20:43:20.510572] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T20:43:20.625520] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-06T20:43:21.425591] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-06T20:43:21.658165] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-06T20:43:21.901850] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T20:43:22.225555] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-06T20:43:22.500534] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T20:43:23.025601] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-06T20:43:23.825490] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-06T20:43:23.864982] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T20:43:24.272954] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-06T20:43:24.596866] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T20:43:24.597984] [INFO ] [REMOTE ] OIA: Full fetch complete (21125 records). [2025-10-06T20:43:24.598098] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-06T20:43:24.630737] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-06T20:43:24.972477] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-06T20:43:24.972570] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-06T20:43:24.973065] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-06T20:43:24.973127] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-06T20:43:24.973724] [DEBUG] [LOCAL ] OIA: Trimmed 21125 records to 13637 (keeping 200 days of data) [2025-10-06T20:43:25.054015] [DEBUG] [LOCAL ] OIA: Primary data saved (13637 records). [2025-10-06T20:43:25.054159] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-06T20:43:25.054259] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OIA took 32.4s. Estimated remaining: 1h 50m 46s. Rate: 7.1 symbols/min [2025-10-06T20:43:25.221752] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:43:25.221921] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-06T20:43:25.221958] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-06T20:43:25.222071] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-06T20:43:25.222114] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-06T20:43:25.222154] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-06T20:43:25.222187] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-06T20:43:25.430772] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-06T20:43:25.577679] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:43:26.225625] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-06T20:43:26.274449] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T20:43:26.917353] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-06T20:43:27.025493] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-06T20:43:27.269615] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T20:43:27.825558] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-06T20:43:28.593930] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T20:43:28.625474] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-06T20:43:29.143471] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T20:43:29.145992] [INFO ] [REMOTE ] OII: Full fetch complete (61902 records). [2025-10-06T20:43:29.146094] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-06T20:43:29.435826] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-06T20:43:29.533875] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-10-06T20:43:29.533965] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-10-06T20:43:29.535084] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-10-06T20:43:29.535150] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-10-06T20:43:29.536417] [DEBUG] [LOCAL ] OII: Trimmed 61902 records to 42297 (keeping 200 days of data) [2025-10-06T20:43:29.787874] [DEBUG] [LOCAL ] OII: Primary data saved (42297 records). [2025-10-06T20:43:29.788031] [INFO ] [MAIN ] OII: Full history saved. [2025-10-06T20:43:29.788135] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OII took 34.9s. Estimated remaining: 1h 50m 35s. Rate: 7.1 symbols/min [2025-10-06T20:43:29.956898] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:43:30.005150] [DEBUG] [LOCAL ] OLN: Loaded 52549 existing records from primary storage. [2025-10-06T20:43:30.005479] [INFO ] [MAIN ] OLN: Loaded 52549 existing records. [2025-10-06T20:43:30.179390] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T20:43:30.217621] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:43:30.221313] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-06T20:43:30.221414] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-06T20:43:30.221684] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-10-06T20:43:30.221741] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-06T20:43:30.232899] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-06T20:43:30.573740] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:43:31.025550] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-06T20:43:31.825506] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-06T20:43:31.925578] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T20:43:32.027909] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T20:43:32.069567] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-06T20:43:32.625570] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-06T20:43:33.425481] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-06T20:43:33.558256] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T20:43:33.596868] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T20:43:34.225532] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-06T20:43:35.025526] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-06T20:43:35.561954] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T20:43:35.825511] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-06T20:43:36.259826] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-10-06T20:43:36.370518] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-06T20:43:36.625501] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-06T20:43:36.842541] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T20:43:37.148238] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-06T20:43:37.425548] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-06T20:43:38.225526] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-06T20:43:38.772845] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T20:43:38.776316] [INFO ] [REMOTE ] OIS: Full fetch complete (57143 records). [2025-10-06T20:43:38.776497] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-06T20:43:39.034838] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-06T20:43:39.175365] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-06T20:43:39.175451] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-06T20:43:39.176508] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-06T20:43:39.176573] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-06T20:43:39.177823] [DEBUG] [LOCAL ] OIS: Trimmed 57143 records to 40226 (keeping 200 days of data) [2025-10-06T20:43:39.401979] [DEBUG] [LOCAL ] OIS: Primary data saved (40226 records). [2025-10-06T20:43:39.402121] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-06T20:43:39.402235] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OIS took 31.2s. Estimated remaining: 1h 50m 27s. Rate: 7.1 symbols/min [2025-10-06T20:43:39.570481] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:43:39.581988] [DEBUG] [LOCAL ] OLP: Loaded 10054 existing records from primary storage. [2025-10-06T20:43:39.582246] [INFO ] [MAIN ] OLP: Loaded 10054 existing records. [2025-10-06T20:43:39.757471] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:43:39.757699] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-06T20:43:39.757758] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-06T20:43:39.757948] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-06T20:43:39.758004] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-06T20:43:39.826832] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-06T20:43:40.120689] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:43:40.158115] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-06T20:43:40.625528] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-06T20:43:40.830937] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-06T20:43:41.113239] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-06T20:43:41.425542] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-06T20:43:41.648779] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-06T20:43:42.225595] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-06T20:43:42.497507] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T20:43:43.025547] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-06T20:43:43.614688] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T20:43:43.617257] [INFO ] [REMOTE ] OKE: Full fetch complete (77111 records). [2025-10-06T20:43:43.617399] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-06T20:43:43.618315] [FATAL] [VALIDATOR ] OKE: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:43:43.618407] [FATAL] [MAIN ] OKE: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:43:43.618449] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:43:43.618488] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-06T20:43:43.618549] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-06T20:43:43.618583] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-10-06T20:43:43.618914] [DEBUG] [LOCAL ] OKE: Deleted derivative data file. [2025-10-06T20:43:43.620182] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OKE took 31.2s. Estimated remaining: 1h 50m 17s. Rate: 7.1 symbols/min [2025-10-06T20:43:43.790027] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:43:43.825513] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-06T20:43:43.842707] [DEBUG] [LOCAL ] OMC: Loaded 54069 existing records from primary storage. [2025-10-06T20:43:43.843049] [INFO ] [MAIN ] OMC: Loaded 54069 existing records. [2025-10-06T20:43:44.019475] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:43:44.019740] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-06T20:43:44.019792] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-06T20:43:44.020030] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-10-06T20:43:44.020086] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-06T20:43:44.373016] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:43:44.625545] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-06T20:43:44.972369] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-10-06T20:43:45.425513] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-06T20:43:45.759088] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-06T20:43:46.225616] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-06T20:43:46.356760] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T20:43:47.025618] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-06T20:43:47.825511] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-06T20:43:47.894690] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T20:43:48.045520] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T20:43:48.171099] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-06T20:43:48.625527] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-06T20:43:48.690902] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T20:43:49.425601] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-06T20:43:49.507043] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T20:43:50.225557] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-06T20:43:51.025632] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-06T20:43:51.110948] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-06T20:43:51.825582] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-06T20:43:52.190590] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-10-06T20:43:52.625616] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-06T20:43:52.939769] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-06T20:43:52.999732] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-06T20:43:53.425728] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-06T20:43:54.225716] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-06T20:43:55.025511] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-06T20:43:55.262471] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T20:43:55.292824] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T20:43:55.332274] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-06T20:43:55.825493] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-06T20:43:56.084346] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-06T20:43:56.625516] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-06T20:43:57.425509] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-06T20:43:57.540100] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T20:43:58.225483] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-06T20:43:58.745831] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-06T20:43:59.025597] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-06T20:43:59.096750] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T20:43:59.178276] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T20:43:59.825574] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-06T20:43:59.913182] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T20:44:00.625568] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-06T20:44:01.425495] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-06T20:44:01.677549] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T20:44:01.734160] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-06T20:44:02.225693] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-06T20:44:03.025526] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-06T20:44:03.825510] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-06T20:44:03.987777] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T20:44:04.134320] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-06T20:44:04.265579] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-10-06T20:44:04.625538] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-06T20:44:04.747445] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T20:44:05.425530] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-06T20:44:06.215301] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-06T20:44:06.218340] [INFO ] [REMOTE ] OLN: Full fetch complete (74650 records). [2025-10-06T20:44:06.218489] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-06T20:44:06.230676] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-06T20:44:06.626673] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-10-06T20:44:06.626976] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-10-06T20:44:06.628048] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-10-06T20:44:06.628113] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-10-06T20:44:06.629632] [DEBUG] [LOCAL ] OLN: Trimmed 74650 records to 51821 (keeping 200 days of data) [2025-10-06T20:44:06.951932] [DEBUG] [LOCAL ] OLN: Primary data saved (51821 records). [2025-10-06T20:44:06.952073] [INFO ] [MAIN ] OLN: Full history saved. [2025-10-06T20:44:06.952159] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OLN took 37.2s. Estimated remaining: 1h 50m 16s. Rate: 7.1 symbols/min [2025-10-06T20:44:07.027826] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-06T20:44:07.142950] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:44:07.180937] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T20:44:07.222851] [DEBUG] [LOCAL ] OMF: Loaded 46922 existing records from primary storage. [2025-10-06T20:44:07.223159] [INFO ] [MAIN ] OMF: Loaded 46922 existing records. [2025-10-06T20:44:07.402806] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:44:07.402968] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-06T20:44:07.403016] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-06T20:44:07.403379] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-10-06T20:44:07.403436] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-06T20:44:07.750389] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:44:07.825477] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-06T20:44:08.269213] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-06T20:44:08.296359] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T20:44:08.625567] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-06T20:44:09.425518] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-06T20:44:09.486964] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T20:44:09.606109] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-06T20:44:10.046942] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-06T20:44:10.225564] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-06T20:44:11.025491] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-06T20:44:11.276322] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T20:44:11.825546] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-06T20:44:12.625513] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-06T20:44:12.777879] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T20:44:12.865223] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T20:44:13.425512] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-06T20:44:13.443341] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T20:44:13.444685] [INFO ] [REMOTE ] OLP: Full fetch complete (14120 records). [2025-10-06T20:44:13.444762] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-06T20:44:13.814026] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-06T20:44:13.814134] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-06T20:44:13.814521] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-06T20:44:13.814592] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-06T20:44:13.815208] [DEBUG] [LOCAL ] OLP: Trimmed 14120 records to 9941 (keeping 200 days of data) [2025-10-06T20:44:13.881379] [DEBUG] [LOCAL ] OLP: Primary data saved (9941 records). [2025-10-06T20:44:13.881539] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-06T20:44:13.881672] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OLP took 34.5s. Estimated remaining: 1h 50m 6s. Rate: 7.1 symbols/min [2025-10-06T20:44:14.056522] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:44:14.064903] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T20:44:14.068296] [INFO ] [REMOTE ] OMC: Full fetch complete (76597 records). [2025-10-06T20:44:14.068477] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-06T20:44:14.069466] [FATAL] [VALIDATOR ] OMC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:44:14.069687] [FATAL] [MAIN ] OMC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:44:14.069762] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:44:14.069876] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-06T20:44:14.070000] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-06T20:44:14.070061] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-10-06T20:44:14.070328] [DEBUG] [LOCAL ] OMC: Deleted derivative data file. [2025-10-06T20:44:14.071203] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OMC took 30.5s. Estimated remaining: 1h 49m 54s. Rate: 7.1 symbols/min [2025-10-06T20:44:14.229785] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-06T20:44:14.291213] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:44:14.307221] [DEBUG] [LOCAL ] ONIT: No existing data file found in primary storage. [2025-10-06T20:44:14.307343] [WARN ] [MAIN ] ONIT: No existing data found, performing full refresh instead. [2025-10-06T20:44:14.308420] [DEBUG] [LOCAL ] OMI: Loaded 46558 existing records from primary storage. [2025-10-06T20:44:14.308993] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-06T20:44:14.309210] [INFO ] [MAIN ] OMI: Loaded 46558 existing records. [2025-10-06T20:44:14.309342] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-06T20:44:14.342482] [DEBUG] [LOCAL ] ONIT: No primary data file found to delete. [2025-10-06T20:44:14.375281] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-06T20:44:14.688587] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:44:14.704116] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-06T20:44:14.714124] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-06T20:44:14.773236] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-10-06T20:44:14.778895] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-06T20:44:15.069936] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:44:15.070089] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-06T20:44:15.270403] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:44:15.825566] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-06T20:44:16.120603] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T20:44:16.141057] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T20:44:16.143757] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-10-06T20:44:16.143904] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-06T20:44:16.144759] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:44:16.144870] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:44:16.144913] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:44:16.144979] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-06T20:44:16.145080] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-06T20:44:16.145137] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-06T20:44:16.145179] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-06T20:44:16.145241] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OKLO took 51.1s. Estimated remaining: 1h 49m 42s. Rate: 7.1 symbols/min [2025-10-06T20:44:16.324160] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:44:16.355104] [DEBUG] [LOCAL ] ONL: Loaded 30810 existing records from primary storage. [2025-10-06T20:44:16.355394] [INFO ] [MAIN ] ONL: Loaded 30810 existing records. [2025-10-06T20:44:16.536056] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:44:16.536300] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-06T20:44:16.536346] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-06T20:44:16.536570] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-06T20:44:16.536627] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-06T20:44:16.632736] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-06T20:44:16.896508] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:44:17.174073] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T20:44:17.425557] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-06T20:44:18.193321] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-06T20:44:18.225499] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-06T20:44:18.468468] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-06T20:44:19.025570] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-06T20:44:19.657897] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T20:44:19.825507] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-06T20:44:19.836398] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T20:44:20.625526] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-06T20:44:21.369529] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T20:44:21.425510] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-06T20:44:22.225559] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-06T20:44:22.332663] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T20:44:23.025532] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-06T20:44:23.066845] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T20:44:23.578511] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T20:44:23.825543] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-06T20:44:24.625495] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-06T20:44:24.754248] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T20:44:25.425511] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-06T20:44:25.471529] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T20:44:25.868746] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T20:44:26.001049] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T20:44:26.225569] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-06T20:44:27.025502] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-06T20:44:27.272548] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T20:44:27.825545] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-06T20:44:27.893749] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-06T20:44:28.625546] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-06T20:44:29.294303] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T20:44:29.425526] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-06T20:44:30.225583] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-06T20:44:31.025553] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-06T20:44:31.064895] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T20:44:31.080589] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T20:44:31.354076] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-10-06T20:44:31.825566] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-06T20:44:32.541199] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T20:44:32.625506] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-06T20:44:33.425555] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-06T20:44:33.490844] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T20:44:34.225496] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-06T20:44:34.280440] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T20:44:34.366966] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T20:44:35.025546] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-06T20:44:35.825504] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-06T20:44:36.208267] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T20:44:36.537064] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T20:44:36.625534] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-06T20:44:37.342276] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T20:44:37.425491] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-06T20:44:37.962092] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T20:44:38.225530] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-06T20:44:39.025511] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-06T20:44:39.033968] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-06T20:44:39.064528] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T20:44:39.825523] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-06T20:44:40.634215] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-06T20:44:40.653710] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T20:44:40.877098] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-06T20:44:41.425547] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-06T20:44:42.225551] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-06T20:44:42.324957] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T20:44:42.749565] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T20:44:43.025563] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-06T20:44:43.550867] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T20:44:43.554077] [INFO ] [REMOTE ] OMF: Full fetch complete (67036 records). [2025-10-06T20:44:43.554202] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-06T20:44:43.827091] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-06T20:44:44.109739] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-10-06T20:44:44.109928] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-10-06T20:44:44.112023] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-10-06T20:44:44.112129] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-10-06T20:44:44.114042] [DEBUG] [LOCAL ] OMF: Trimmed 67036 records to 46267 (keeping 200 days of data) [2025-10-06T20:44:44.281347] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T20:44:44.583056] [DEBUG] [LOCAL ] OMF: Primary data saved (46267 records). [2025-10-06T20:44:44.583338] [INFO ] [MAIN ] OMF: Full history saved. [2025-10-06T20:44:44.583483] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. OMF took 37.6s. Estimated remaining: 1h 49m 44s. Rate: 7.1 symbols/min [2025-10-06T20:44:44.635554] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-06T20:44:44.847758] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:44:44.850911] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T20:44:44.923694] [DEBUG] [LOCAL ] ONON: Loaded 54393 existing records from primary storage. [2025-10-06T20:44:44.924259] [INFO ] [MAIN ] ONON: Loaded 54393 existing records. [2025-10-06T20:44:45.125101] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:44:45.125463] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-06T20:44:45.125515] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-06T20:44:45.125821] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-10-06T20:44:45.125883] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-06T20:44:45.430905] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-06T20:44:45.507945] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:44:46.090106] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T20:44:46.093350] [INFO ] [REMOTE ] OMI: Full fetch complete (64719 records). [2025-10-06T20:44:46.093489] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-06T20:44:46.206338] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T20:44:46.230590] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-06T20:44:46.512976] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-10-06T20:44:46.513065] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-10-06T20:44:46.514134] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-10-06T20:44:46.514204] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-10-06T20:44:46.515593] [DEBUG] [LOCAL ] OMI: Trimmed 64719 records to 45904 (keeping 200 days of data) [2025-10-06T20:44:46.782238] [DEBUG] [LOCAL ] OMI: Primary data saved (45904 records). [2025-10-06T20:44:46.782391] [INFO ] [MAIN ] OMI: Full history saved. [2025-10-06T20:44:46.782496] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. OMI took 32.9s. Estimated remaining: 1h 49m 32s. Rate: 7.1 symbols/min [2025-10-06T20:44:46.959270] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:44:46.982458] [DEBUG] [LOCAL ] ONTF: Loaded 22832 existing records from primary storage. [2025-10-06T20:44:46.982775] [INFO ] [MAIN ] ONTF: Loaded 22832 existing records. [2025-10-06T20:44:47.030764] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-06T20:44:47.188917] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:44:47.189225] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-06T20:44:47.189279] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-06T20:44:47.189542] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-06T20:44:47.189605] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-06T20:44:47.273188] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-06T20:44:47.311868] [INFO ] [REMOTE ] ONL: Full fetch complete (43074 records). [2025-10-06T20:44:47.318079] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-06T20:44:47.859220] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-06T20:44:47.864836] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:44:47.999701] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-06T20:44:47.999794] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-06T20:44:48.000683] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-06T20:44:48.000747] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-06T20:44:48.001767] [DEBUG] [LOCAL ] ONL: Trimmed 43074 records to 30131 (keeping 200 days of data) [2025-10-06T20:44:48.180711] [DEBUG] [LOCAL ] ONL: Primary data saved (30131 records). [2025-10-06T20:44:48.180877] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-06T20:44:48.180966] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. ONL took 32.0s. Estimated remaining: 1h 49m 20s. Rate: 7.1 symbols/min [2025-10-06T20:44:48.352361] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:44:48.396231] [DEBUG] [LOCAL ] ONTO: Loaded 47395 existing records from primary storage. [2025-10-06T20:44:48.396583] [INFO ] [MAIN ] ONTO: Loaded 47395 existing records. [2025-10-06T20:44:48.576814] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:44:48.577078] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-06T20:44:48.577127] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-06T20:44:48.577380] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-10-06T20:44:48.577440] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-06T20:44:48.649136] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-06T20:44:48.971125] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:44:48.978689] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T20:44:49.187688] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-06T20:44:49.425535] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-06T20:44:49.971990] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T20:44:50.225562] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-06T20:44:51.025616] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-06T20:44:51.300678] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T20:44:51.474527] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-06T20:44:51.825565] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-06T20:44:52.625549] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-06T20:44:52.710587] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T20:44:53.425544] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-06T20:44:53.666157] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T20:44:53.958195] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-06T20:44:54.016261] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T20:44:54.017963] [INFO ] [REMOTE ] ONIT: Full fetch complete (11082 records). [2025-10-06T20:44:54.018075] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-06T20:44:54.230827] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-06T20:44:54.436490] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-06T20:44:54.436606] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-06T20:44:54.437239] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-06T20:44:54.437327] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-06T20:44:54.438288] [DEBUG] [LOCAL ] ONIT: Trimmed 11082 records to 7741 (keeping 200 days of data) [2025-10-06T20:44:54.492076] [DEBUG] [LOCAL ] ONIT: Primary data saved (7741 records). [2025-10-06T20:44:54.492315] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-06T20:44:54.492425] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. ONIT took 40.4s. Estimated remaining: 1h 49m 11s. Rate: 7.1 symbols/min [2025-10-06T20:44:54.663161] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:44:54.684975] [DEBUG] [LOCAL ] OOMA: Loaded 19059 existing records from primary storage. [2025-10-06T20:44:54.685245] [INFO ] [MAIN ] OOMA: Loaded 19059 existing records. [2025-10-06T20:44:54.866135] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:44:54.866392] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-06T20:44:54.866441] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-06T20:44:54.866680] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-10-06T20:44:54.866740] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-06T20:44:55.036027] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-06T20:44:55.218817] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:44:55.825487] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-06T20:44:56.168614] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-06T20:44:56.625626] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-06T20:44:56.979103] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-06T20:44:57.099020] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T20:44:57.425506] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-06T20:44:57.727209] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T20:44:58.225530] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-06T20:44:59.025594] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-06T20:44:59.490539] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-06T20:44:59.825499] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-06T20:44:59.944321] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T20:45:00.184285] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T20:45:00.561874] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-06T20:45:00.625521] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-06T20:45:01.425587] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-06T20:45:02.024127] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T20:45:02.225588] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-06T20:45:03.025574] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-06T20:45:03.242667] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T20:45:03.292329] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T20:45:03.825532] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-06T20:45:04.361280] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T20:45:04.625525] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-06T20:45:05.425498] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-06T20:45:05.756746] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-06T20:45:05.850830] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-06T20:45:06.225526] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-06T20:45:07.025542] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-06T20:45:07.364954] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T20:45:07.825487] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-06T20:45:07.869396] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-06T20:45:08.310779] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T20:45:08.625514] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-06T20:45:09.425493] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-06T20:45:09.595393] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T20:45:09.621003] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T20:45:10.225499] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-06T20:45:10.612806] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T20:45:11.025539] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-06T20:45:11.442313] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T20:45:11.825530] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-06T20:45:12.250177] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T20:45:12.625515] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-06T20:45:13.141792] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T20:45:13.425552] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-06T20:45:13.801887] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-06T20:45:14.225548] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-06T20:45:14.606172] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-06T20:45:15.025589] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-06T20:45:15.825516] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-06T20:45:16.087409] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-06T20:45:16.553555] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T20:45:16.555200] [INFO ] [REMOTE ] ONTF: Full fetch complete (31630 records). [2025-10-06T20:45:16.555368] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-06T20:45:16.630638] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-06T20:45:16.941777] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-06T20:45:16.941855] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-06T20:45:16.942479] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-06T20:45:16.942519] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-06T20:45:16.943268] [DEBUG] [LOCAL ] ONTF: Trimmed 31630 records to 22433 (keeping 200 days of data) [2025-10-06T20:45:17.069041] [DEBUG] [LOCAL ] ONTF: Primary data saved (22433 records). [2025-10-06T20:45:17.069190] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-06T20:45:17.069279] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONTF took 30.3s. Estimated remaining: 1h 49m 9s. Rate: 7.1 symbols/min [2025-10-06T20:45:17.170747] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-06T20:45:17.425548] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-06T20:45:18.225508] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-06T20:45:18.302319] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-06T20:45:18.303796] [INFO ] [REMOTE ] OOMA: Full fetch complete (25859 records). [2025-10-06T20:45:18.303871] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-06T20:45:18.488732] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T20:45:18.728183] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-10-06T20:45:18.728264] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-10-06T20:45:18.728851] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-10-06T20:45:18.728912] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-10-06T20:45:18.729534] [DEBUG] [LOCAL ] OOMA: Trimmed 25859 records to 18660 (keeping 200 days of data) [2025-10-06T20:45:18.843433] [DEBUG] [LOCAL ] OOMA: Primary data saved (18660 records). [2025-10-06T20:45:18.843578] [INFO ] [MAIN ] OOMA: Full history saved. [2025-10-06T20:45:18.843684] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. OOMA took 24.4s. Estimated remaining: 1h 48m 57s. Rate: 7.1 symbols/min [2025-10-06T20:45:19.025575] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-06T20:45:20.433635] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-06T20:45:20.445551] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-06T20:45:21.023507] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-06T20:45:21.034141] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-06T20:45:22.778295] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-06T20:45:22.789831] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-06T20:45:22.914619] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T20:45:22.925355] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-06T20:45:24.247792] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T20:45:24.250576] [INFO ] [REMOTE ] ONTO: Full fetch complete (66291 records). [2025-10-06T20:45:24.250702] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-06T20:45:24.638191] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-10-06T20:45:24.638272] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-10-06T20:45:24.639331] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-10-06T20:45:24.639396] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-10-06T20:45:24.640912] [DEBUG] [LOCAL ] ONTO: Trimmed 66291 records to 46896 (keeping 200 days of data) [2025-10-06T20:45:24.994877] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-06T20:45:25.012014] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-06T20:45:25.017067] [DEBUG] [LOCAL ] ONTO: Primary data saved (46896 records). [2025-10-06T20:45:25.018117] [INFO ] [MAIN ] ONTO: Full history saved. [2025-10-06T20:45:25.018345] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. ONTO took 36.8s. Estimated remaining: 1h 48m 48s. Rate: 7.1 symbols/min [2025-10-06T20:45:26.836530] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-06T20:45:26.839752] [INFO ] [REMOTE ] ONON: Full fetch complete (77582 records). [2025-10-06T20:45:26.839875] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-06T20:45:27.241803] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-10-06T20:45:27.242017] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-10-06T20:45:27.243117] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-10-06T20:45:27.243180] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-10-06T20:45:27.244779] [DEBUG] [LOCAL ] ONON: Trimmed 77582 records to 53613 (keeping 200 days of data) [2025-10-06T20:45:27.562775] [DEBUG] [LOCAL ] ONON: Primary data saved (53613 records). [2025-10-06T20:45:27.562955] [INFO ] [MAIN ] ONON: Full history saved. [2025-10-06T20:45:27.563141] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. ONON took 43.0s. Estimated remaining: 1h 48m 37s. Rate: 7.1 symbols/min [2025-10-06T20:45:28.155337] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:45:28.292935] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:45:28.297760] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:45:28.295525] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:45:28.299251] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-06T20:45:28.299308] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-06T20:45:28.299436] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-06T20:45:28.299512] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-06T20:45:28.299607] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-06T20:45:28.299797] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-06T20:45:28.425292] [DEBUG] [LOCAL ] OPP: Loaded 11836 existing records from primary storage. [2025-10-06T20:45:28.441702] [INFO ] [MAIN ] OPP: Loaded 11836 existing records. [2025-10-06T20:45:28.608015] [DEBUG] [LOCAL ] OPAD: Loaded 22500 existing records from primary storage. [2025-10-06T20:45:28.658487] [INFO ] [MAIN ] OPAD: Loaded 22500 existing records. [2025-10-06T20:45:28.703205] [DEBUG] [LOCAL ] OPFI: Loaded 47102 existing records from primary storage. [2025-10-06T20:45:28.842538] [INFO ] [MAIN ] OPFI: Loaded 47102 existing records. [2025-10-06T20:45:28.880558] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:45:28.925260] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-06T20:45:29.048231] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-06T20:45:29.184401] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-06T20:45:29.163773] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:45:29.248251] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:45:29.240137] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-06T20:45:29.251471] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-06T20:45:29.232252] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-06T20:45:29.257043] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-06T20:45:29.274406] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-06T20:45:29.377717] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:45:29.372520] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-06T20:45:29.383704] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-06T20:45:29.409084] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-06T20:45:29.428539] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-10-06T20:45:29.451329] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-06T20:45:30.363167] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-06T20:45:30.429911] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:45:30.448810] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-06T20:45:30.479781] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-06T20:45:30.474216] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:45:30.495630] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-06T20:45:30.527474] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:45:30.527857] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-06T20:45:31.385924] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-06T20:45:31.388268] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-06T20:45:31.487109] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T20:45:31.488992] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-06T20:45:31.902797] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-06T20:45:31.907234] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-06T20:45:31.954278] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-06T20:45:31.956069] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-06T20:45:32.044050] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-06T20:45:32.045691] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-06T20:45:32.151865] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T20:45:32.159394] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-06T20:45:32.576692] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T20:45:32.625530] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-06T20:45:32.881360] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T20:45:33.094190] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T20:45:33.333077] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-06T20:45:33.425530] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-06T20:45:34.189429] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-06T20:45:34.225524] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-06T20:45:34.313833] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T20:45:35.025509] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-06T20:45:35.114148] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T20:45:35.825535] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-06T20:45:36.625554] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-06T20:45:36.708853] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T20:45:37.052352] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-06T20:45:37.425512] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-06T20:45:37.525911] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T20:45:38.225509] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-06T20:45:39.025495] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-06T20:45:39.132549] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T20:45:39.225127] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T20:45:39.795114] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-06T20:45:39.825475] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-06T20:45:40.625490] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-06T20:45:40.686512] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-06T20:45:41.425551] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-06T20:45:41.540000] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T20:45:42.225554] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-06T20:45:42.831060] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T20:45:43.025537] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-06T20:45:43.825550] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-06T20:45:44.010748] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T20:45:44.049409] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T20:45:44.625550] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-06T20:45:44.675445] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-06T20:45:45.425569] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-06T20:45:45.591444] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T20:45:46.225581] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-06T20:45:47.025553] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-06T20:45:47.092972] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-06T20:45:47.380876] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T20:45:47.725305] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-06T20:45:47.825516] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-06T20:45:48.625524] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-06T20:45:48.752585] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T20:45:49.264794] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T20:45:49.425529] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-06T20:45:50.083692] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T20:45:50.084764] [INFO ] [REMOTE ] OPY: Full fetch complete (10108 records). [2025-10-06T20:45:50.084843] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-06T20:45:50.233283] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-06T20:45:50.278660] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T20:45:50.279005] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:45:50.279112] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:45:50.279211] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-06T20:45:50.279334] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-06T20:45:50.279395] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-06T20:45:50.279442] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-06T20:45:50.279519] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPY took 22.7s. Estimated remaining: 1h 48m 35s. Rate: 7.1 symbols/min [2025-10-06T20:45:50.453195] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:45:50.498206] [DEBUG] [LOCAL ] OR: Loaded 46875 existing records from primary storage. [2025-10-06T20:45:50.498685] [INFO ] [MAIN ] OR: Loaded 46875 existing records. [2025-10-06T20:45:50.706183] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:45:50.706477] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-06T20:45:50.706535] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-06T20:45:50.706789] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-10-06T20:45:50.706846] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-06T20:45:51.051798] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-06T20:45:51.057578] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:45:51.825585] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-06T20:45:52.625484] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-06T20:45:52.706432] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T20:45:52.751522] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-06T20:45:53.177946] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-06T20:45:53.425631] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-06T20:45:54.225536] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-06T20:45:54.263708] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T20:45:54.410511] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T20:45:55.025566] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-06T20:45:55.825544] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-06T20:45:56.073379] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-06T20:45:56.076225] [INFO ] [REMOTE ] OPAD: Full fetch complete (25731 records). [2025-10-06T20:45:56.076341] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-06T20:45:56.451558] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-06T20:45:56.451661] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-06T20:45:56.452203] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-06T20:45:56.452245] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-06T20:45:56.452973] [DEBUG] [LOCAL ] OPAD: Trimmed 25731 records to 22813 (keeping 200 days of data) [2025-10-06T20:45:56.584940] [DEBUG] [LOCAL ] OPAD: Primary data saved (22813 records). [2025-10-06T20:45:56.585075] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-06T20:45:56.585156] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OPAD took 29.0s. Estimated remaining: 1h 48m 26s. Rate: 7.1 symbols/min [2025-10-06T20:45:56.629340] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-06T20:45:56.759927] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:45:56.791514] [DEBUG] [LOCAL ] ORA: Loaded 33070 existing records from primary storage. [2025-10-06T20:45:56.791855] [INFO ] [MAIN ] ORA: Loaded 33070 existing records. [2025-10-06T20:45:56.984797] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:45:56.985175] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-06T20:45:56.985303] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-06T20:45:56.985609] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-10-06T20:45:56.985712] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-06T20:45:57.167883] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-06T20:45:57.408824] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:45:57.409067] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T20:45:57.410767] [INFO ] [REMOTE ] OPP: Full fetch complete (17418 records). [2025-10-06T20:45:57.410852] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-06T20:45:57.435975] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-06T20:45:57.533560] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T20:45:57.818631] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-06T20:45:57.818780] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-06T20:45:57.819295] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-06T20:45:57.819356] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-06T20:45:57.820291] [DEBUG] [LOCAL ] OPP: Trimmed 17418 records to 11702 (keeping 200 days of data) [2025-10-06T20:45:57.898195] [DEBUG] [LOCAL ] OPP: Primary data saved (11702 records). [2025-10-06T20:45:57.898338] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-06T20:45:57.898421] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OPP took 30.3s. Estimated remaining: 1h 48m 14s. Rate: 7.1 symbols/min [2025-10-06T20:45:58.069668] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:45:58.120535] [DEBUG] [LOCAL ] ORC: Loaded 53146 existing records from primary storage. [2025-10-06T20:45:58.120916] [INFO ] [MAIN ] ORC: Loaded 53146 existing records. [2025-10-06T20:45:58.230753] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-06T20:45:58.299280] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:45:58.299546] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-06T20:45:58.299592] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-06T20:45:58.300186] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-06T20:45:58.300246] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-06T20:45:58.650201] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:45:59.025509] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-06T20:45:59.177767] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T20:45:59.825505] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-06T20:45:59.905077] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T20:46:00.625505] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-06T20:46:00.800495] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T20:46:01.067209] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T20:46:01.425536] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-06T20:46:02.225600] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-06T20:46:02.469866] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-06T20:46:03.025573] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-06T20:46:03.404084] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-06T20:46:03.825487] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-06T20:46:04.083622] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T20:46:04.327349] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T20:46:04.625559] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-06T20:46:05.425580] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-06T20:46:05.572464] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T20:46:06.194274] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T20:46:06.225475] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-06T20:46:07.025567] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-06T20:46:07.074677] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T20:46:07.680737] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T20:46:07.684722] [INFO ] [REMOTE ] OPFI: Full fetch complete (68166 records). [2025-10-06T20:46:07.684912] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-06T20:46:07.831632] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-06T20:46:08.082777] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-10-06T20:46:08.082877] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-10-06T20:46:08.083891] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-10-06T20:46:08.083956] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-10-06T20:46:08.085381] [DEBUG] [LOCAL ] OPFI: Trimmed 68166 records to 46414 (keeping 200 days of data) [2025-10-06T20:46:08.363459] [DEBUG] [LOCAL ] OPFI: Primary data saved (46414 records). [2025-10-06T20:46:08.363605] [INFO ] [MAIN ] OPFI: Full history saved. [2025-10-06T20:46:08.363714] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPFI took 40.8s. Estimated remaining: 1h 48m 6s. Rate: 7.1 symbols/min [2025-10-06T20:46:08.530257] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:46:08.530469] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-06T20:46:08.530523] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-06T20:46:08.530633] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-06T20:46:08.530713] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-06T20:46:08.530764] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-06T20:46:08.530796] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-06T20:46:08.630399] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-06T20:46:08.897942] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:46:08.980599] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-06T20:46:09.425584] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-06T20:46:09.480225] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T20:46:10.225568] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-06T20:46:10.490158] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T20:46:11.025528] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-06T20:46:11.825557] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-06T20:46:11.930733] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-06T20:46:12.314839] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-06T20:46:12.625565] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-06T20:46:12.838097] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T20:46:13.027458] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T20:46:13.425534] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-06T20:46:14.225554] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-06T20:46:14.874282] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-06T20:46:14.939850] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T20:46:15.025483] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-06T20:46:15.207399] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T20:46:15.825549] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-06T20:46:16.625523] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-06T20:46:17.230277] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-06T20:46:17.425557] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-06T20:46:17.509016] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T20:46:17.551045] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T20:46:18.225543] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-06T20:46:19.025612] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-06T20:46:19.551073] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-06T20:46:19.618188] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T20:46:19.825559] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-06T20:46:20.625595] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-06T20:46:20.724012] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T20:46:21.425531] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-06T20:46:21.855255] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-06T20:46:22.080094] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T20:46:22.225527] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-06T20:46:22.376537] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-06T20:46:23.025579] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-06T20:46:23.155965] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T20:46:23.158769] [INFO ] [REMOTE ] ORA: Full fetch complete (49158 records). [2025-10-06T20:46:23.158868] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-06T20:46:23.533182] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-10-06T20:46:23.533273] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-10-06T20:46:23.534191] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-10-06T20:46:23.534255] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-10-06T20:46:23.535306] [DEBUG] [LOCAL ] ORA: Trimmed 49158 records to 32689 (keeping 200 days of data) [2025-10-06T20:46:23.738679] [DEBUG] [LOCAL ] ORA: Primary data saved (32689 records). [2025-10-06T20:46:23.738853] [INFO ] [MAIN ] ORA: Full history saved. [2025-10-06T20:46:23.738944] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. ORA took 27.2s. Estimated remaining: 1h 48m 1s. Rate: 7.1 symbols/min [2025-10-06T20:46:23.830805] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-06T20:46:23.914617] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:46:23.914829] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-06T20:46:23.914884] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-06T20:46:23.914994] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-06T20:46:23.915035] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-06T20:46:23.915121] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-06T20:46:23.915170] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-06T20:46:24.272336] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:46:24.307153] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-06T20:46:24.625588] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-06T20:46:25.425525] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-06T20:46:26.076350] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-06T20:46:26.225514] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-06T20:46:26.266947] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T20:46:27.025564] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-06T20:46:27.178931] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-06T20:46:27.238529] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T20:46:27.825567] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-06T20:46:28.540065] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T20:46:28.625504] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-06T20:46:28.742076] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T20:46:29.425491] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-06T20:46:29.607441] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T20:46:30.225559] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-06T20:46:30.871529] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T20:46:31.025550] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-06T20:46:31.825490] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-06T20:46:32.071707] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T20:46:32.108427] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T20:46:32.625584] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-06T20:46:33.425506] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-06T20:46:33.455453] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T20:46:34.225504] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-06T20:46:34.413858] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T20:46:34.597242] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-06T20:46:35.025587] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-06T20:46:35.825506] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-06T20:46:35.858365] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T20:46:36.625619] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-06T20:46:36.838341] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-06T20:46:36.842297] [INFO ] [REMOTE ] ORC: Full fetch complete (75389 records). [2025-10-06T20:46:36.842451] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-06T20:46:37.326861] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-06T20:46:37.327047] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-06T20:46:37.328339] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-06T20:46:37.328428] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-06T20:46:37.330308] [DEBUG] [LOCAL ] ORC: Trimmed 75389 records to 52443 (keeping 200 days of data) [2025-10-06T20:46:37.430611] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-06T20:46:37.431845] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-06T20:46:37.436924] [INFO ] [REMOTE ] OR: Full fetch complete (65634 records). [2025-10-06T20:46:37.437870] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-06T20:46:37.863210] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-10-06T20:46:37.863601] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-10-06T20:46:37.865165] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-10-06T20:46:37.865251] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-10-06T20:46:37.869303] [DEBUG] [LOCAL ] OR: Trimmed 65634 records to 46259 (keeping 200 days of data) [2025-10-06T20:46:38.058972] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T20:46:38.064265] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-10-06T20:46:38.065277] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-06T20:46:38.067201] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:46:38.068006] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:46:38.068742] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:46:38.070110] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-06T20:46:38.071541] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-06T20:46:38.071891] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-06T20:46:38.072840] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-06T20:46:38.073420] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. ORCL took 29.7s. Estimated remaining: 1h 47m 55s. Rate: 7.1 symbols/min [2025-10-06T20:46:38.263371] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:46:38.312337] [DEBUG] [LOCAL ] ORN: Loaded 31360 existing records from primary storage. [2025-10-06T20:46:38.313904] [INFO ] [MAIN ] ORN: Loaded 31360 existing records. [2025-10-06T20:46:38.660779] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:46:38.661754] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-06T20:46:38.662560] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-06T20:46:38.664775] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-06T20:46:38.665195] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-06T20:46:39.064206] [DEBUG] [LOCAL ] ORC: Primary data saved (52443 records). [2025-10-06T20:46:39.062234] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-06T20:46:39.080942] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-06T20:46:39.113838] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. ORC took 41.2s. Estimated remaining: 1h 47m 43s. Rate: 7.1 symbols/min [2025-10-06T20:46:39.150251] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-06T20:46:39.307345] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:46:39.318577] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-06T20:46:39.404067] [DEBUG] [LOCAL ] OR: Primary data saved (46259 records). [2025-10-06T20:46:39.421908] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:46:39.419001] [INFO ] [MAIN ] OR: Full history saved. [2025-10-06T20:46:39.422097] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. OR took 49.1s. Estimated remaining: 1h 47m 31s. Rate: 7.1 symbols/min [2025-10-06T20:46:39.654074] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:46:39.654338] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-06T20:46:39.654403] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-06T20:46:39.654551] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-06T20:46:39.654631] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-06T20:46:39.654737] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-06T20:46:39.654782] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-06T20:46:39.803437] [DEBUG] [LOCAL ] OSCR: Loaded 54502 existing records from primary storage. [2025-10-06T20:46:39.804047] [INFO ] [MAIN ] OSCR: Loaded 54502 existing records. [2025-10-06T20:46:40.210319] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:46:40.216222] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-06T20:46:40.221405] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-06T20:46:40.232799] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-10-06T20:46:40.237966] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-06T20:46:40.401380] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:46:40.412639] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-06T20:46:40.671786] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:46:40.672166] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-06T20:46:40.716451] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T20:46:40.857329] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T20:46:41.425577] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-06T20:46:42.236731] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-06T20:46:42.241971] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T20:46:42.470513] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T20:46:42.523220] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T20:46:43.025529] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-06T20:46:43.825506] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-06T20:46:43.995902] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T20:46:44.625485] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-06T20:46:45.040125] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-06T20:46:45.425582] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-06T20:46:45.508536] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T20:46:46.225613] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-06T20:46:46.519991] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-06T20:46:46.681178] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T20:46:47.025614] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-06T20:46:47.798140] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T20:46:47.825496] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-06T20:46:48.088482] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T20:46:48.625535] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-06T20:46:49.425501] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-06T20:46:49.537915] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T20:46:50.225528] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-06T20:46:50.462346] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-06T20:46:50.905681] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T20:46:51.025493] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-06T20:46:51.825769] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-06T20:46:51.945699] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T20:46:52.545190] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T20:46:52.625481] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-06T20:46:53.425534] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-06T20:46:53.520417] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T20:46:53.968898] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T20:46:54.225532] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-06T20:46:55.025549] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-06T20:46:55.593687] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-06T20:46:55.638314] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T20:46:55.825501] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-06T20:46:56.625488] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-06T20:46:56.762001] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T20:46:57.281318] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T20:46:57.284824] [INFO ] [REMOTE ] ORI: Full fetch complete (70307 records). [2025-10-06T20:46:57.285030] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-06T20:46:57.430702] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-06T20:46:57.521774] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T20:46:57.522893] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:46:57.522993] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:46:57.523084] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-06T20:46:57.523175] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-06T20:46:57.523215] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-06T20:46:57.523258] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-06T20:46:57.523334] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. ORI took 33.8s. Estimated remaining: 1h 47m 27s. Rate: 7.1 symbols/min [2025-10-06T20:46:57.699875] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:46:57.700253] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-06T20:46:57.700359] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-06T20:46:57.706911] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-06T20:46:57.716536] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-06T20:46:57.717505] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-06T20:46:57.718175] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T20:46:57.718376] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-06T20:46:58.113913] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:46:58.225498] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-06T20:46:58.499544] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:46:58.499880] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-06T20:46:58.499970] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:46:58.500041] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-06T20:46:58.500106] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:46:58.500177] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-06T20:46:58.500243] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-06T20:46:58.500278] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-06T20:46:58.500316] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-06T20:46:58.500363] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. OTF took 1.0s. Estimated remaining: 1h 47m 15s. Rate: 7.1 symbols/min [2025-10-06T20:46:58.670129] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:46:58.722846] [DEBUG] [LOCAL ] OTIS: Loaded 53475 existing records from primary storage. [2025-10-06T20:46:58.723190] [INFO ] [MAIN ] OTIS: Loaded 53475 existing records. [2025-10-06T20:46:58.905580] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:46:58.905829] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-06T20:46:58.905876] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-06T20:46:58.906293] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-10-06T20:46:58.906351] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-06T20:46:59.027807] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-06T20:46:59.274435] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:46:59.300713] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-06T20:46:59.825543] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-06T20:47:00.625523] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-06T20:47:01.282187] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-06T20:47:01.425481] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-06T20:47:01.798927] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-06T20:47:01.837372] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T20:47:02.225607] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-06T20:47:03.025544] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-06T20:47:03.804029] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-06T20:47:03.825469] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-06T20:47:03.995571] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T20:47:04.040386] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-06T20:47:04.625578] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-06T20:47:05.425525] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-06T20:47:06.020131] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T20:47:06.225578] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-06T20:47:06.461896] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-06T20:47:07.023180] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T20:47:07.031880] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-06T20:47:07.214448] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T20:47:07.825525] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-06T20:47:08.553583] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T20:47:08.625497] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-06T20:47:09.425564] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-06T20:47:09.693784] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T20:47:10.225599] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-06T20:47:10.855214] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-10-06T20:47:10.872259] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T20:47:10.876951] [INFO ] [REMOTE ] OSK: Full fetch complete (61291 records). [2025-10-06T20:47:10.877180] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-06T20:47:11.031932] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-06T20:47:11.096107] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T20:47:11.100124] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:47:11.100481] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:47:11.100630] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-06T20:47:11.100852] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-06T20:47:11.100914] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-06T20:47:11.100960] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-06T20:47:11.101059] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. OSK took 31.7s. Estimated remaining: 1h 47m 9s. Rate: 7.1 symbols/min [2025-10-06T20:47:11.296938] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:47:11.350348] [DEBUG] [LOCAL ] OUT: Loaded 48517 existing records from primary storage. [2025-10-06T20:47:11.350877] [INFO ] [MAIN ] OUT: Loaded 48517 existing records. [2025-10-06T20:47:11.571494] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:47:11.571985] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-06T20:47:11.572054] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-06T20:47:11.600969] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-10-06T20:47:11.601127] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-06T20:47:11.672276] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T20:47:11.830726] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-06T20:47:12.055771] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:47:12.625570] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-06T20:47:13.031275] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T20:47:13.033143] [INFO ] [REMOTE ] ORN: Full fetch complete (45363 records). [2025-10-06T20:47:13.033228] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-06T20:47:13.413802] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-06T20:47:13.413899] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-06T20:47:13.414762] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-06T20:47:13.414828] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-06T20:47:13.415847] [DEBUG] [LOCAL ] ORN: Trimmed 45363 records to 30826 (keeping 200 days of data) [2025-10-06T20:47:13.460947] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-06T20:47:13.593140] [DEBUG] [LOCAL ] ORN: Primary data saved (30826 records). [2025-10-06T20:47:13.593288] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-06T20:47:13.593386] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. ORN took 35.5s. Estimated remaining: 1h 46m 57s. Rate: 7.1 symbols/min [2025-10-06T20:47:13.768606] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:47:13.799504] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-06T20:47:13.843435] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-10-06T20:47:13.895283] [DEBUG] [LOCAL ] OVV: Loaded 54295 existing records from primary storage. [2025-10-06T20:47:13.895616] [INFO ] [MAIN ] OVV: Loaded 54295 existing records. [2025-10-06T20:47:14.092907] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:47:14.093188] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-06T20:47:14.093249] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-06T20:47:14.093844] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-10-06T20:47:14.093906] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-06T20:47:14.237055] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-06T20:47:14.471706] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:47:15.025488] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-06T20:47:15.183120] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T20:47:15.366176] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T20:47:15.825543] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-06T20:47:16.625505] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-06T20:47:16.786045] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T20:47:17.425557] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-06T20:47:17.513807] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-06T20:47:18.225574] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-06T20:47:18.438920] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-06T20:47:19.025547] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-06T20:47:19.070024] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T20:47:19.630484] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T20:47:19.633107] [INFO ] [REMOTE ] OSCR: Full fetch complete (77116 records). [2025-10-06T20:47:19.633271] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-06T20:47:19.634250] [FATAL] [VALIDATOR ] OSCR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:47:19.634348] [FATAL] [MAIN ] OSCR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:47:19.634392] [WARN ] [MAIN ] OSCR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:47:19.634434] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-06T20:47:19.634523] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-06T20:47:19.634580] [INFO ] [LOCAL ] OSCR: Starting deletion of derivative data. [2025-10-06T20:47:19.634892] [DEBUG] [LOCAL ] OSCR: Deleted derivative data file. [2025-10-06T20:47:19.634995] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OSCR took 40.5s. Estimated remaining: 1h 46m 48s. Rate: 7.1 symbols/min [2025-10-06T20:47:19.816081] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:47:19.825551] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-06T20:47:19.868256] [DEBUG] [LOCAL ] OWL: Loaded 54335 existing records from primary storage. [2025-10-06T20:47:19.868694] [INFO ] [MAIN ] OWL: Loaded 54335 existing records. [2025-10-06T20:47:20.078554] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:47:20.080761] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T20:47:20.091094] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-06T20:47:20.091931] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-06T20:47:20.093216] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-10-06T20:47:20.093277] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-06T20:47:20.472394] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:47:20.625503] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-06T20:47:21.425582] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-06T20:47:21.472727] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T20:47:22.148576] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T20:47:22.225523] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-06T20:47:23.025496] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-06T20:47:23.159521] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T20:47:23.287772] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T20:47:23.825492] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-06T20:47:24.532213] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T20:47:24.625483] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-06T20:47:25.232091] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T20:47:25.234716] [INFO ] [REMOTE ] OTIS: Full fetch complete (75563 records). [2025-10-06T20:47:25.234814] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-06T20:47:25.235526] [FATAL] [VALIDATOR ] OTIS: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:47:25.235616] [FATAL] [MAIN ] OTIS: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:47:25.235692] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:47:25.235811] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-06T20:47:25.235913] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-06T20:47:25.235971] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-10-06T20:47:25.236226] [DEBUG] [LOCAL ] OTIS: Deleted derivative data file. [2025-10-06T20:47:25.236331] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OTIS took 26.7s. Estimated remaining: 1h 46m 38s. Rate: 7.1 symbols/min [2025-10-06T20:47:25.407241] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:47:25.418567] [DEBUG] [LOCAL ] OWLT: Loaded 8992 existing records from primary storage. [2025-10-06T20:47:25.418808] [INFO ] [MAIN ] OWLT: Loaded 8992 existing records. [2025-10-06T20:47:25.430784] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-06T20:47:25.600060] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:47:25.600508] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-06T20:47:25.600560] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-06T20:47:25.619355] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-06T20:47:25.632036] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-06T20:47:25.712991] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T20:47:25.998584] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:47:26.225533] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-06T20:47:26.989827] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-06T20:47:27.025526] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-06T20:47:27.422537] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-06T20:47:27.679237] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-06T20:47:27.825489] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-06T20:47:28.291821] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-06T20:47:28.625559] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-06T20:47:29.425523] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-06T20:47:30.225573] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-06T20:47:30.464315] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T20:47:31.025529] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-06T20:47:31.230899] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-06T20:47:31.294228] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T20:47:31.825522] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-06T20:47:32.625540] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-06T20:47:32.909070] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T20:47:33.377801] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T20:47:33.425468] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-06T20:47:33.847423] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-06T20:47:33.873302] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-06T20:47:34.225469] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-06T20:47:35.025535] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-06T20:47:35.198117] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T20:47:35.825504] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-06T20:47:36.625542] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-06T20:47:36.673144] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-06T20:47:36.918086] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T20:47:37.425578] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-06T20:47:38.225516] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-06T20:47:38.397197] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-06T20:47:38.451630] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T20:47:39.025598] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-06T20:47:39.825526] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-06T20:47:40.243459] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-06T20:47:40.625490] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-06T20:47:40.835890] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T20:47:41.237677] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T20:47:41.425532] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-06T20:47:42.225563] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-06T20:47:42.592627] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T20:47:43.025585] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-06T20:47:43.158781] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T20:47:43.241369] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T20:47:43.825579] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-06T20:47:44.613464] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T20:47:44.614855] [INFO ] [REMOTE ] OWLT: Full fetch complete (11759 records). [2025-10-06T20:47:44.614948] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-06T20:47:44.630773] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-06T20:47:44.845061] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T20:47:45.062995] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-06T20:47:45.063112] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-06T20:47:45.063595] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-06T20:47:45.063688] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-06T20:47:45.064287] [DEBUG] [LOCAL ] OWLT: Trimmed 11759 records to 8988 (keeping 200 days of data) [2025-10-06T20:47:45.121368] [DEBUG] [LOCAL ] OWLT: Primary data saved (8988 records). [2025-10-06T20:47:45.121595] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-06T20:47:45.121742] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OWLT took 19.9s. Estimated remaining: 1h 46m 35s. Rate: 7.1 symbols/min [2025-10-06T20:47:45.308608] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:47:45.348476] [DEBUG] [LOCAL ] OXM: Loaded 33720 existing records from primary storage. [2025-10-06T20:47:45.348930] [INFO ] [MAIN ] OXM: Loaded 33720 existing records. [2025-10-06T20:47:45.430766] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-06T20:47:45.536765] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:47:45.537006] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-06T20:47:45.537155] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-06T20:47:45.538001] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-10-06T20:47:45.538090] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-06T20:47:45.883621] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:47:46.225481] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-06T20:47:46.699843] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-06T20:47:47.025553] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-06T20:47:47.236320] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T20:47:47.825504] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-06T20:47:48.280662] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-06T20:47:48.625482] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-06T20:47:48.748908] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T20:47:49.322866] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T20:47:49.425512] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-06T20:47:49.902381] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T20:47:49.905429] [INFO ] [REMOTE ] OVV: Full fetch complete (77320 records). [2025-10-06T20:47:49.905578] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-06T20:47:50.238551] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-06T20:47:50.297326] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-10-06T20:47:50.297415] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-10-06T20:47:50.298535] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-10-06T20:47:50.298604] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-10-06T20:47:50.300129] [DEBUG] [LOCAL ] OVV: Trimmed 77320 records to 53516 (keeping 200 days of data) [2025-10-06T20:47:50.634248] [DEBUG] [LOCAL ] OVV: Primary data saved (53516 records). [2025-10-06T20:47:50.634402] [INFO ] [MAIN ] OVV: Full history saved. [2025-10-06T20:47:50.635449] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OVV took 37.0s. Estimated remaining: 1h 46m 25s. Rate: 7.1 symbols/min [2025-10-06T20:47:50.804553] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:47:50.804751] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-06T20:47:50.804797] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-06T20:47:50.804907] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-06T20:47:50.804955] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-06T20:47:50.804994] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-06T20:47:50.805025] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-06T20:47:51.033875] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-06T20:47:51.196057] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:47:51.226772] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T20:47:51.825582] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-06T20:47:52.276254] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-06T20:47:52.428991] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T20:47:52.625556] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-06T20:47:53.425491] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-06T20:47:53.541304] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T20:47:54.225105] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T20:47:54.229311] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-06T20:47:55.025546] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-06T20:47:55.202220] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T20:47:55.825503] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-06T20:47:56.039566] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-06T20:47:56.591494] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T20:47:56.625494] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-06T20:47:56.828845] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T20:47:56.831798] [INFO ] [REMOTE ] OUT: Full fetch complete (69070 records). [2025-10-06T20:47:56.831927] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-06T20:47:57.232066] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-10-06T20:47:57.232148] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-10-06T20:47:57.233144] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-10-06T20:47:57.233209] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-10-06T20:47:57.234513] [DEBUG] [LOCAL ] OUT: Trimmed 69070 records to 47809 (keeping 200 days of data) [2025-10-06T20:47:57.446339] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-06T20:47:57.529063] [DEBUG] [LOCAL ] OUT: Primary data saved (47809 records). [2025-10-06T20:47:57.529203] [INFO ] [MAIN ] OUT: Full history saved. [2025-10-06T20:47:57.529285] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OUT took 46.4s. Estimated remaining: 1h 46m 16s. Rate: 7.1 symbols/min [2025-10-06T20:47:57.700502] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:47:57.753209] [DEBUG] [LOCAL ] PAAS: Loaded 54384 existing records from primary storage. [2025-10-06T20:47:57.753593] [INFO ] [MAIN ] PAAS: Loaded 54384 existing records. [2025-10-06T20:47:57.956045] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:47:57.956242] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-06T20:47:57.956290] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-06T20:47:57.957437] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-10-06T20:47:57.957500] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-06T20:47:58.231356] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-06T20:47:58.319070] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-06T20:47:58.324340] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:47:58.327606] [INFO ] [REMOTE ] OWL: Full fetch complete (77530 records). [2025-10-06T20:47:58.327737] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-06T20:47:58.724256] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-10-06T20:47:58.724366] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-10-06T20:47:58.725550] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-10-06T20:47:58.725676] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-10-06T20:47:58.744427] [DEBUG] [LOCAL ] OWL: Trimmed 77530 records to 53556 (keeping 200 days of data) [2025-10-06T20:47:58.762204] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T20:47:59.028475] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-06T20:47:59.113761] [DEBUG] [LOCAL ] OWL: Primary data saved (53556 records). [2025-10-06T20:47:59.113934] [INFO ] [MAIN ] OWL: Full history saved. [2025-10-06T20:47:59.114025] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OWL took 39.5s. Estimated remaining: 1h 46m 4s. Rate: 7.1 symbols/min [2025-10-06T20:47:59.285151] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:47:59.301506] [DEBUG] [LOCAL ] PAC: Loaded 11760 existing records from primary storage. [2025-10-06T20:47:59.301786] [INFO ] [MAIN ] PAC: Loaded 11760 existing records. [2025-10-06T20:47:59.481072] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:47:59.481303] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-06T20:47:59.481352] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-06T20:47:59.481517] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-06T20:47:59.481555] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-06T20:47:59.826669] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-06T20:47:59.848381] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:47:59.872129] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T20:48:00.625584] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-06T20:48:01.247420] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T20:48:01.311450] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-06T20:48:01.425524] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-06T20:48:02.225521] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-06T20:48:02.254823] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T20:48:02.412287] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T20:48:03.025564] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-06T20:48:03.825554] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-06T20:48:04.054208] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-06T20:48:04.502170] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T20:48:04.625498] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-06T20:48:04.875186] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T20:48:05.425529] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-06T20:48:06.225569] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-06T20:48:06.280366] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T20:48:06.296223] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T20:48:07.025553] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-06T20:48:07.825507] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-06T20:48:08.043152] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T20:48:08.187495] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-06T20:48:08.625618] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-06T20:48:09.433502] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-06T20:48:09.456707] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T20:48:09.635028] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-06T20:48:10.144872] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-06T20:48:10.225534] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-06T20:48:11.025599] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-06T20:48:11.186704] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T20:48:11.825526] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-06T20:48:12.625552] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-06T20:48:12.929859] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-06T20:48:13.116806] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-06T20:48:13.425552] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-06T20:48:14.014751] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T20:48:14.225607] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-06T20:48:14.509311] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-06T20:48:15.025563] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-06T20:48:15.248758] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T20:48:15.733199] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T20:48:15.825534] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-06T20:48:16.625507] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-06T20:48:16.795314] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T20:48:17.425591] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-06T20:48:18.096253] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-06T20:48:18.225504] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-06T20:48:19.025565] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-06T20:48:19.551873] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-06T20:48:19.567456] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T20:48:19.570203] [INFO ] [REMOTE ] OXM: Full fetch complete (45937 records). [2025-10-06T20:48:19.570315] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-06T20:48:19.830170] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-06T20:48:19.960212] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-10-06T20:48:19.960373] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-10-06T20:48:19.961261] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-10-06T20:48:19.961357] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-10-06T20:48:19.962539] [DEBUG] [LOCAL ] OXM: Trimmed 45937 records to 33171 (keeping 200 days of data) [2025-10-06T20:48:20.107190] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T20:48:20.210553] [DEBUG] [LOCAL ] OXM: Primary data saved (33171 records). [2025-10-06T20:48:20.210741] [INFO ] [MAIN ] OXM: Full history saved. [2025-10-06T20:48:20.210842] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. OXM took 35.1s. Estimated remaining: 1h 46m 2s. Rate: 7.1 symbols/min [2025-10-06T20:48:20.381808] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:48:20.412808] [DEBUG] [LOCAL ] PACK: Loaded 32354 existing records from primary storage. [2025-10-06T20:48:20.413134] [INFO ] [MAIN ] PACK: Loaded 32354 existing records. [2025-10-06T20:48:20.595488] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:48:20.595841] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-06T20:48:20.595901] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-06T20:48:20.596592] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-06T20:48:20.596691] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-06T20:48:20.630825] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-06T20:48:20.972729] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:48:21.425549] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-06T20:48:21.570821] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-06T20:48:22.092893] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-06T20:48:22.204935] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-06T20:48:22.225488] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-06T20:48:23.025526] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-06T20:48:23.825492] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-06T20:48:24.018995] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-06T20:48:24.062849] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T20:48:24.625490] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-06T20:48:24.651194] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T20:48:25.425537] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-06T20:48:26.225524] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-06T20:48:26.329908] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T20:48:26.787936] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-06T20:48:27.025556] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-06T20:48:27.124088] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T20:48:27.825554] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-06T20:48:28.514265] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T20:48:28.515500] [INFO ] [REMOTE ] PAC: Full fetch complete (16518 records). [2025-10-06T20:48:28.515574] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-06T20:48:28.632421] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-06T20:48:28.934704] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-06T20:48:28.934794] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-06T20:48:28.935178] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-06T20:48:28.935217] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-06T20:48:28.935753] [DEBUG] [LOCAL ] PAC: Trimmed 16518 records to 11550 (keeping 200 days of data) [2025-10-06T20:48:29.006425] [DEBUG] [LOCAL ] PAC: Primary data saved (11550 records). [2025-10-06T20:48:29.006590] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-06T20:48:29.006702] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. PAC took 29.9s. Estimated remaining: 1h 45m 53s. Rate: 7.1 symbols/min [2025-10-06T20:48:29.185463] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:48:29.220279] [DEBUG] [LOCAL ] PACS: Loaded 34910 existing records from primary storage. [2025-10-06T20:48:29.220573] [INFO ] [MAIN ] PACS: Loaded 34910 existing records. [2025-10-06T20:48:29.405338] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:48:29.405623] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-06T20:48:29.405710] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-06T20:48:29.406011] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-10-06T20:48:29.406074] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-06T20:48:29.438916] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-06T20:48:29.782827] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:48:30.225589] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-06T20:48:30.524941] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T20:48:30.983939] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-06T20:48:31.025721] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-06T20:48:31.211711] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (4.19 seconds). [2025-10-06T20:48:31.655874] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T20:48:31.658637] [INFO ] [REMOTE ] OXY: Full fetch complete (77180 records). [2025-10-06T20:48:31.658789] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-06T20:48:31.660012] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:48:31.660160] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:48:31.660239] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:48:31.660331] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-06T20:48:31.660419] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-06T20:48:31.660457] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-06T20:48:31.660496] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-06T20:48:31.660557] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. OXY took 41.0s. Estimated remaining: 1h 45m 42s. Rate: 7.1 symbols/min [2025-10-06T20:48:31.833066] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:48:31.830737] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-06T20:48:31.859724] [DEBUG] [LOCAL ] PAG: Loaded 21976 existing records from primary storage. [2025-10-06T20:48:31.860023] [INFO ] [MAIN ] PAG: Loaded 21976 existing records. [2025-10-06T20:48:32.083283] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:48:32.083822] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-06T20:48:32.083912] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-06T20:48:32.084251] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-10-06T20:48:32.084327] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-06T20:48:32.458135] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:48:32.625524] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-06T20:48:33.425520] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-06T20:48:34.036995] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (3.81 seconds). [2025-10-06T20:48:34.225557] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-06T20:48:34.472124] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T20:48:35.025737] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-06T20:48:35.692892] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T20:48:35.825564] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-06T20:48:36.227665] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-06T20:48:36.316853] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (4.49 seconds). [2025-10-06T20:48:36.625509] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-06T20:48:37.425513] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-06T20:48:37.704274] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (5.08 seconds). [2025-10-06T20:48:37.873920] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T20:48:38.225501] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-06T20:48:39.013070] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (3.19 seconds). [2025-10-06T20:48:39.025477] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-06T20:48:39.117503] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-06T20:48:39.121250] [INFO ] [REMOTE ] PAAS: Full fetch complete (77412 records). [2025-10-06T20:48:39.121438] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-06T20:48:39.534516] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-10-06T20:48:39.534764] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-10-06T20:48:39.536765] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-10-06T20:48:39.536873] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-10-06T20:48:39.539102] [DEBUG] [LOCAL ] PAAS: Trimmed 77412 records to 53605 (keeping 200 days of data) [2025-10-06T20:48:39.848358] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-06T20:48:39.908261] [DEBUG] [LOCAL ] PAAS: Primary data saved (53605 records). [2025-10-06T20:48:39.908507] [INFO ] [MAIN ] PAAS: Full history saved. [2025-10-06T20:48:39.908672] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PAAS took 42.4s. Estimated remaining: 1h 45m 34s. Rate: 7.1 symbols/min [2025-10-06T20:48:40.094952] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:48:40.153012] [DEBUG] [LOCAL ] PAGS: Loaded 53489 existing records from primary storage. [2025-10-06T20:48:40.153513] [INFO ] [MAIN ] PAGS: Loaded 53489 existing records. [2025-10-06T20:48:40.358153] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:48:40.358716] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-06T20:48:40.358852] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-06T20:48:40.359161] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-10-06T20:48:40.359245] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-06T20:48:40.498356] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-06T20:48:40.638380] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-06T20:48:40.791933] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:48:41.302851] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T20:48:41.425539] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-06T20:48:42.079450] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T20:48:42.225593] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-06T20:48:42.442170] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T20:48:43.025589] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-06T20:48:43.555620] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-06T20:48:43.825560] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-06T20:48:44.054849] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T20:48:44.625552] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-06T20:48:45.252826] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T20:48:45.425503] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-06T20:48:46.225533] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-06T20:48:46.584140] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-06T20:48:46.861980] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T20:48:47.025517] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-06T20:48:47.077106] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (8.85 seconds). [2025-10-06T20:48:47.818341] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T20:48:47.825798] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-06T20:48:48.454947] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T20:48:48.625560] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-06T20:48:49.298701] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T20:48:49.425539] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-06T20:48:50.190891] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T20:48:50.225574] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-06T20:48:51.025561] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-06T20:48:51.173174] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T20:48:51.825566] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-06T20:48:52.110024] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T20:48:52.167709] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T20:48:52.625527] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-06T20:48:53.142665] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T20:48:53.144996] [INFO ] [REMOTE ] PACS: Full fetch complete (50792 records). [2025-10-06T20:48:53.145096] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-06T20:48:53.431321] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-06T20:48:53.530185] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-10-06T20:48:53.530347] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-10-06T20:48:53.531800] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-10-06T20:48:53.531893] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-10-06T20:48:53.533389] [DEBUG] [LOCAL ] PACS: Trimmed 50792 records to 34501 (keeping 200 days of data) [2025-10-06T20:48:53.637736] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T20:48:53.779844] [DEBUG] [LOCAL ] PACS: Primary data saved (34501 records). [2025-10-06T20:48:53.780003] [INFO ] [MAIN ] PACS: Full history saved. [2025-10-06T20:48:53.780090] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PACS took 24.8s. Estimated remaining: 1h 45m 28s. Rate: 7.1 symbols/min [2025-10-06T20:48:53.982237] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:48:53.988092] [DEBUG] [LOCAL ] PAI: Loaded 2707 existing records from primary storage. [2025-10-06T20:48:53.988350] [INFO ] [MAIN ] PAI: Loaded 2707 existing records. [2025-10-06T20:48:54.205880] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:48:54.206219] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-06T20:48:54.206291] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-06T20:48:54.207672] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-06T20:48:54.207754] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-06T20:48:54.231203] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-06T20:48:54.595035] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:48:55.025540] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-06T20:48:55.266357] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-06T20:48:55.503037] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T20:48:55.505350] [INFO ] [REMOTE ] PACK: Full fetch complete (44290 records). [2025-10-06T20:48:55.505428] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-06T20:48:55.681583] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-06T20:48:55.839506] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-06T20:48:55.893160] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-06T20:48:55.893271] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-06T20:48:55.894141] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-06T20:48:55.894263] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-06T20:48:55.895683] [DEBUG] [LOCAL ] PACK: Trimmed 44290 records to 31829 (keeping 200 days of data) [2025-10-06T20:48:56.067899] [DEBUG] [LOCAL ] PACK: Primary data saved (31829 records). [2025-10-06T20:48:56.068074] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-06T20:48:56.068184] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PACK took 35.9s. Estimated remaining: 1h 45m 16s. Rate: 7.1 symbols/min [2025-10-06T20:48:56.235177] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:48:56.235407] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-06T20:48:56.235462] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-06T20:48:56.235572] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-06T20:48:56.235612] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-06T20:48:56.235680] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-06T20:48:56.235732] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-06T20:48:56.583545] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:48:56.625472] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-06T20:48:56.971415] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:48:56.971782] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-06T20:48:56.971879] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:48:56.971958] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-06T20:48:56.972021] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:48:56.972090] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-06T20:48:56.972177] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-06T20:48:56.972214] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-06T20:48:56.972270] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-06T20:48:56.972339] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PAII took 0.9s. Estimated remaining: 1h 45m 4s. Rate: 7.1 symbols/min [2025-10-06T20:48:57.146396] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:48:57.175596] [DEBUG] [LOCAL ] PAM: Loaded 28652 existing records from primary storage. [2025-10-06T20:48:57.175927] [INFO ] [MAIN ] PAM: Loaded 28652 existing records. [2025-10-06T20:48:57.363590] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:48:57.363810] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-06T20:48:57.363868] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-06T20:48:57.364122] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-10-06T20:48:57.364180] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-06T20:48:57.428920] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-06T20:48:57.738228] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:48:57.793371] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-06T20:48:58.225598] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-06T20:48:58.691276] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T20:48:59.025549] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-06T20:48:59.709752] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-06T20:48:59.825486] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-06T20:49:00.028307] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T20:49:00.367026] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-06T20:49:00.625514] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-06T20:49:01.250556] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-06T20:49:01.425531] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-06T20:49:02.225538] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-06T20:49:03.004622] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T20:49:03.025473] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-06T20:49:03.827571] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-06T20:49:03.833358] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T20:49:04.446924] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-06T20:49:04.571977] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T20:49:04.625511] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-06T20:49:05.425601] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-06T20:49:06.193352] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T20:49:06.225480] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-06T20:49:07.025551] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-06T20:49:07.202688] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-06T20:49:07.475304] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-06T20:49:07.825503] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-06T20:49:08.192621] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-06T20:49:08.625547] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-06T20:49:09.197970] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T20:49:09.425535] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-06T20:49:09.696973] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T20:49:10.225564] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-06T20:49:10.952264] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-06T20:49:10.953761] [INFO ] [REMOTE ] PAG: Full fetch complete (30407 records). [2025-10-06T20:49:10.953855] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-06T20:49:11.026022] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-06T20:49:11.342425] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-10-06T20:49:11.342545] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-10-06T20:49:11.343366] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-10-06T20:49:11.343444] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-10-06T20:49:11.344704] [DEBUG] [LOCAL ] PAG: Trimmed 30407 records to 21658 (keeping 200 days of data) [2025-10-06T20:49:11.471467] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-06T20:49:11.530172] [DEBUG] [LOCAL ] PAG: Primary data saved (21658 records). [2025-10-06T20:49:11.530312] [INFO ] [MAIN ] PAG: Full history saved. [2025-10-06T20:49:11.530421] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. PAG took 39.9s. Estimated remaining: 1h 44m 59s. Rate: 7.1 symbols/min [2025-10-06T20:49:11.706352] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:49:11.712841] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-06T20:49:11.751158] [DEBUG] [LOCAL ] PAR: Loaded 33393 existing records from primary storage. [2025-10-06T20:49:11.751456] [INFO ] [MAIN ] PAR: Loaded 33393 existing records. [2025-10-06T20:49:11.830597] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-06T20:49:11.935053] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:49:11.935263] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-06T20:49:11.935309] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-06T20:49:11.935536] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-10-06T20:49:11.935598] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-06T20:49:12.296426] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:49:12.625498] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-06T20:49:13.425515] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-06T20:49:13.699077] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-06T20:49:13.759789] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-06T20:49:14.054278] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-06T20:49:14.225538] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-06T20:49:14.825177] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T20:49:15.025552] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-06T20:49:15.625492] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T20:49:15.825532] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-06T20:49:16.625512] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-06T20:49:17.175493] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-06T20:49:17.425588] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-06T20:49:17.934197] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T20:49:18.179363] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T20:49:18.225506] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-06T20:49:18.617957] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-06T20:49:18.618716] [INFO ] [REMOTE ] PAI: Full fetch complete (4052 records). [2025-10-06T20:49:18.618803] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-06T20:49:19.003990] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-06T20:49:19.004074] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-06T20:49:19.004221] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-06T20:49:19.004261] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-06T20:49:19.004607] [DEBUG] [LOCAL ] PAI: Trimmed 4052 records to 2671 (keeping 200 days of data) [2025-10-06T20:49:19.020791] [DEBUG] [LOCAL ] PAI: Primary data saved (2671 records). [2025-10-06T20:49:19.020864] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-06T20:49:19.020936] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAI took 25.2s. Estimated remaining: 1h 44m 50s. Rate: 7.1 symbols/min [2025-10-06T20:49:19.031731] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-06T20:49:19.189437] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:49:19.238854] [DEBUG] [LOCAL ] PARR: Loaded 49031 existing records from primary storage. [2025-10-06T20:49:19.239226] [INFO ] [MAIN ] PARR: Loaded 49031 existing records. [2025-10-06T20:49:19.415140] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:49:19.415376] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-06T20:49:19.415425] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-06T20:49:19.415639] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-10-06T20:49:19.415729] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-06T20:49:19.759144] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:49:19.825476] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-06T20:49:20.625525] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-06T20:49:21.163937] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-06T20:49:21.425448] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-06T20:49:21.460608] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T20:49:22.027068] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T20:49:22.225505] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-06T20:49:22.652905] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T20:49:23.025549] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-06T20:49:23.705613] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T20:49:23.825552] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-06T20:49:24.501796] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T20:49:24.625549] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-06T20:49:25.425613] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-06T20:49:25.440048] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-06T20:49:25.443220] [INFO ] [REMOTE ] PAGS: Full fetch complete (76325 records). [2025-10-06T20:49:25.443376] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-06T20:49:25.853639] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-10-06T20:49:25.853767] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-10-06T20:49:25.854847] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-10-06T20:49:25.854916] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-10-06T20:49:25.856488] [DEBUG] [LOCAL ] PAGS: Trimmed 76325 records to 52717 (keeping 200 days of data) [2025-10-06T20:49:26.174236] [DEBUG] [LOCAL ] PAGS: Primary data saved (52717 records). [2025-10-06T20:49:26.174376] [INFO ] [MAIN ] PAGS: Full history saved. [2025-10-06T20:49:26.174458] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAGS took 46.3s. Estimated remaining: 1h 44m 41s. Rate: 7.1 symbols/min [2025-10-06T20:49:26.238792] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-06T20:49:26.362360] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:49:26.388515] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T20:49:26.445435] [DEBUG] [LOCAL ] PATH: Loaded 54457 existing records from primary storage. [2025-10-06T20:49:26.445827] [INFO ] [MAIN ] PATH: Loaded 54457 existing records. [2025-10-06T20:49:26.627049] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:49:26.627286] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-06T20:49:26.627351] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-06T20:49:26.627611] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-10-06T20:49:26.627697] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-06T20:49:27.015914] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:49:27.027672] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-06T20:49:27.038141] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T20:49:27.687479] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T20:49:27.825531] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-06T20:49:28.625528] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-06T20:49:29.280890] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T20:49:29.425518] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-06T20:49:29.600707] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-06T20:49:30.040913] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T20:49:30.225541] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-06T20:49:30.599012] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T20:49:30.601042] [INFO ] [REMOTE ] PAM: Full fetch complete (41984 records). [2025-10-06T20:49:30.601155] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-06T20:49:31.033223] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-06T20:49:31.050244] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-06T20:49:31.051454] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-06T20:49:31.052618] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-06T20:49:31.052840] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-06T20:49:31.054015] [DEBUG] [LOCAL ] PAM: Trimmed 41984 records to 28113 (keeping 200 days of data) [2025-10-06T20:49:31.230171] [DEBUG] [LOCAL ] PAM: Primary data saved (28113 records). [2025-10-06T20:49:31.230330] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-06T20:49:31.230418] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PAM took 34.3s. Estimated remaining: 1h 44m 31s. Rate: 7.1 symbols/min [2025-10-06T20:49:31.400509] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:49:31.423386] [DEBUG] [LOCAL ] PAXS: Loaded 21046 existing records from primary storage. [2025-10-06T20:49:31.423687] [INFO ] [MAIN ] PAXS: Loaded 21046 existing records. [2025-10-06T20:49:31.610472] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:49:31.611074] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-06T20:49:31.611136] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-06T20:49:31.611388] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-10-06T20:49:31.611447] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-06T20:49:31.830634] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-06T20:49:32.003416] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T20:49:32.026548] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:49:32.625518] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-06T20:49:33.204545] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T20:49:33.251628] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-06T20:49:33.425523] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-06T20:49:34.225495] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-06T20:49:34.416388] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T20:49:35.025545] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-06T20:49:35.260593] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T20:49:35.786799] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-06T20:49:35.825486] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-06T20:49:36.625496] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-06T20:49:36.841421] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T20:49:37.425553] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-06T20:49:37.964638] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T20:49:38.225491] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-06T20:49:38.375822] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-06T20:49:38.850514] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T20:49:39.025512] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-06T20:49:39.711570] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T20:49:39.825502] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-06T20:49:40.176178] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-06T20:49:40.625566] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-06T20:49:40.999305] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T20:49:41.001959] [INFO ] [REMOTE ] PAR: Full fetch complete (48258 records). [2025-10-06T20:49:41.002099] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-06T20:49:41.371859] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-10-06T20:49:41.371990] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-10-06T20:49:41.372874] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-10-06T20:49:41.372938] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-10-06T20:49:41.374122] [DEBUG] [LOCAL ] PAR: Trimmed 48258 records to 33107 (keeping 200 days of data) [2025-10-06T20:49:41.431471] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-06T20:49:41.490900] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-06T20:49:41.590700] [DEBUG] [LOCAL ] PAR: Primary data saved (33107 records). [2025-10-06T20:49:41.590860] [INFO ] [MAIN ] PAR: Full history saved. [2025-10-06T20:49:41.590960] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PAR took 30.1s. Estimated remaining: 1h 44m 23s. Rate: 7.1 symbols/min [2025-10-06T20:49:41.756858] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:49:41.796867] [DEBUG] [LOCAL ] PAY: Loaded 38592 existing records from primary storage. [2025-10-06T20:49:41.797183] [INFO ] [MAIN ] PAY: Loaded 38592 existing records. [2025-10-06T20:49:41.972190] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:49:41.972426] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-06T20:49:41.972474] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-06T20:49:41.972719] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-10-06T20:49:41.972784] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-06T20:49:42.232270] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-06T20:49:42.322542] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:49:42.866013] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T20:49:43.025527] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-06T20:49:43.825530] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-06T20:49:44.345969] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-06T20:49:44.625523] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-06T20:49:44.679404] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T20:49:44.961325] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T20:49:45.425591] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-06T20:49:46.225549] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-06T20:49:46.582053] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T20:49:46.771537] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-06T20:49:47.025605] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-06T20:49:47.814145] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T20:49:47.826023] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-06T20:49:48.230864] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-06T20:49:48.625531] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-06T20:49:49.092576] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T20:49:49.425549] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-06T20:49:50.225493] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-06T20:49:50.368957] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T20:49:50.556711] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T20:49:51.025548] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-06T20:49:51.825546] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-06T20:49:52.015505] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T20:49:52.499000] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-06T20:49:52.625491] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-06T20:49:53.225519] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T20:49:53.425537] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-06T20:49:54.225536] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-06T20:49:54.822899] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T20:49:55.001481] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-06T20:49:55.025481] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-06T20:49:55.825546] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-06T20:49:56.008729] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T20:49:56.625620] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-06T20:49:56.927398] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T20:49:57.139570] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-06T20:49:57.425556] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-06T20:49:57.902034] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T20:49:58.225535] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-06T20:49:59.025619] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-06T20:49:59.257355] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-06T20:49:59.825518] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-06T20:49:59.991189] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-06T20:50:00.435851] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T20:50:00.438883] [INFO ] [REMOTE ] PARR: Full fetch complete (69001 records). [2025-10-06T20:50:00.438993] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-06T20:50:00.632377] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-06T20:50:00.672036] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-06T20:50:00.852574] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-10-06T20:50:00.852689] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-10-06T20:50:00.853763] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-10-06T20:50:00.853827] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-10-06T20:50:00.855186] [DEBUG] [LOCAL ] PARR: Trimmed 69001 records to 48330 (keeping 200 days of data) [2025-10-06T20:50:01.140337] [DEBUG] [LOCAL ] PARR: Primary data saved (48330 records). [2025-10-06T20:50:01.140490] [INFO ] [MAIN ] PARR: Full history saved. [2025-10-06T20:50:01.140575] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PARR took 42.1s. Estimated remaining: 1h 44m 20s. Rate: 7.1 symbols/min [2025-10-06T20:50:01.308455] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:50:01.346319] [DEBUG] [LOCAL ] PAYC: Loaded 36933 existing records from primary storage. [2025-10-06T20:50:01.346686] [INFO ] [MAIN ] PAYC: Loaded 36933 existing records. [2025-10-06T20:50:01.430766] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-06T20:50:01.553701] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:50:01.553954] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-06T20:50:01.554006] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-06T20:50:01.554279] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-10-06T20:50:01.554338] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-06T20:50:01.908228] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:50:02.225537] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-06T20:50:02.384065] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T20:50:02.385477] [INFO ] [REMOTE ] PAXS: Full fetch complete (30653 records). [2025-10-06T20:50:02.385549] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-06T20:50:02.764098] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-10-06T20:50:02.764178] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-10-06T20:50:02.764804] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-10-06T20:50:02.764867] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-10-06T20:50:02.765548] [DEBUG] [LOCAL ] PAXS: Trimmed 30653 records to 20787 (keeping 200 days of data) [2025-10-06T20:50:02.895979] [DEBUG] [LOCAL ] PAXS: Primary data saved (20787 records). [2025-10-06T20:50:02.896118] [INFO ] [MAIN ] PAXS: Full history saved. [2025-10-06T20:50:02.896216] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PAXS took 31.7s. Estimated remaining: 1h 44m 8s. Rate: 7.1 symbols/min [2025-10-06T20:50:03.036816] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-06T20:50:03.069307] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:50:03.123069] [DEBUG] [LOCAL ] PB: Loaded 42171 existing records from primary storage. [2025-10-06T20:50:03.123373] [INFO ] [MAIN ] PB: Loaded 42171 existing records. [2025-10-06T20:50:03.311428] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:50:03.312332] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-06T20:50:03.312503] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-06T20:50:03.315250] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-06T20:50:03.315568] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-10-06T20:50:03.315618] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-06T20:50:03.349203] [INFO ] [REMOTE ] PATH: Full fetch complete (77764 records). [2025-10-06T20:50:03.389062] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-06T20:50:04.008455] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:50:04.008917] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-06T20:50:04.108815] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-10-06T20:50:04.109094] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-10-06T20:50:04.110524] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-10-06T20:50:04.110743] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-10-06T20:50:04.131069] [DEBUG] [LOCAL ] PATH: Trimmed 77764 records to 53678 (keeping 200 days of data) [2025-10-06T20:50:04.132619] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T20:50:04.454603] [DEBUG] [LOCAL ] PATH: Primary data saved (53678 records). [2025-10-06T20:50:04.454777] [INFO ] [MAIN ] PATH: Full history saved. [2025-10-06T20:50:04.454868] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PATH took 38.3s. Estimated remaining: 1h 43m 57s. Rate: 7.1 symbols/min [2025-10-06T20:50:04.623272] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:50:04.625481] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-06T20:50:04.668157] [DEBUG] [LOCAL ] PBA: Loaded 49592 existing records from primary storage. [2025-10-06T20:50:04.668517] [INFO ] [MAIN ] PBA: Loaded 49592 existing records. [2025-10-06T20:50:04.851636] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:50:04.852014] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-06T20:50:04.852070] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-06T20:50:04.852279] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-10-06T20:50:04.852336] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-06T20:50:05.217235] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-06T20:50:05.239175] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:50:05.425493] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-06T20:50:05.481737] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T20:50:05.652590] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T20:50:06.225562] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-06T20:50:07.025554] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-06T20:50:07.299700] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-06T20:50:07.825620] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-06T20:50:08.323813] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-06T20:50:08.625587] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-06T20:50:08.885064] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T20:50:09.033352] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-06T20:50:09.425530] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-06T20:50:10.225512] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-06T20:50:10.257384] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T20:50:10.299832] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-06T20:50:11.025598] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-06T20:50:11.826418] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T20:50:11.825630] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-06T20:50:12.625524] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-06T20:50:12.987022] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-06T20:50:13.425569] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-06T20:50:13.472549] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T20:50:13.911011] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-06T20:50:14.225532] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-06T20:50:14.420208] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T20:50:15.025524] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-06T20:50:15.825491] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-06T20:50:16.035448] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T20:50:16.625547] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-06T20:50:16.763398] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T20:50:17.425516] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-06T20:50:17.510140] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T20:50:18.225502] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-06T20:50:18.341900] [DEBUG] [REMOTE ] PB: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-06T20:50:18.354670] [WARN ] [REMOTE ] PB: No data returned for month 2025-04 [2025-10-06T20:50:18.355182] [FATAL] [REMOTE ] PB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:50:18.357131] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T20:50:18.355814] [FATAL] [MAIN ] PB: Failed to fetch primary data. [2025-10-06T20:50:18.361060] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:50:18.367811] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-06T20:50:18.368329] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-06T20:50:18.368388] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-10-06T20:50:18.368623] [DEBUG] [LOCAL ] PB: Deleted derivative data file. [2025-10-06T20:50:18.368763] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PB took 15.5s. Estimated remaining: 1h 43m 51s. Rate: 7.1 symbols/min [2025-10-06T20:50:18.537996] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:50:18.587416] [DEBUG] [LOCAL ] PBF: Loaded 53892 existing records from primary storage. [2025-10-06T20:50:18.587981] [INFO ] [MAIN ] PBF: Loaded 53892 existing records. [2025-10-06T20:50:18.745456] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T20:50:18.851674] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:50:18.851891] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-06T20:50:18.851945] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-06T20:50:18.852163] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-10-06T20:50:18.852216] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-06T20:50:19.034170] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-06T20:50:19.213718] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:50:19.825500] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-06T20:50:20.063893] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T20:50:20.625510] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-06T20:50:21.425508] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-06T20:50:21.673689] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T20:50:22.225550] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-06T20:50:22.589088] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-06T20:50:23.025593] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-06T20:50:23.056387] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T20:50:23.834802] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-06T20:50:23.854367] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T20:50:24.625486] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-06T20:50:24.902769] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T20:50:25.128226] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T20:50:25.130573] [INFO ] [REMOTE ] PAY: Full fetch complete (53518 records). [2025-10-06T20:50:25.130672] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-06T20:50:25.426846] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-06T20:50:25.543352] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-10-06T20:50:25.543814] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-10-06T20:50:25.544767] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-10-06T20:50:25.545627] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T20:50:25.545714] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-10-06T20:50:25.555394] [DEBUG] [LOCAL ] PAY: Trimmed 53518 records to 37988 (keeping 200 days of data) [2025-10-06T20:50:25.779925] [DEBUG] [LOCAL ] PAY: Primary data saved (37988 records). [2025-10-06T20:50:25.780073] [INFO ] [MAIN ] PAY: Full history saved. [2025-10-06T20:50:25.780154] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PAY took 44.2s. Estimated remaining: 1h 43m 42s. Rate: 7.1 symbols/min [2025-10-06T20:50:25.946446] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:50:25.981883] [DEBUG] [LOCAL ] PBH: Loaded 32356 existing records from primary storage. [2025-10-06T20:50:25.982192] [INFO ] [MAIN ] PBH: Loaded 32356 existing records. [2025-10-06T20:50:26.166957] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:50:26.167232] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-06T20:50:26.167279] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-06T20:50:26.167537] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-10-06T20:50:26.167594] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-06T20:50:26.230812] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-06T20:50:26.517284] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:50:27.025538] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-06T20:50:27.368370] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-06T20:50:27.825537] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-06T20:50:28.175810] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-06T20:50:28.254567] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T20:50:28.415890] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T20:50:28.417920] [INFO ] [REMOTE ] PAYC: Full fetch complete (52772 records). [2025-10-06T20:50:28.418003] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-06T20:50:28.418679] [FATAL] [VALIDATOR ] PAYC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:50:28.418767] [FATAL] [MAIN ] PAYC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:50:28.418810] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:50:28.418941] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-06T20:50:28.419020] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-06T20:50:28.419057] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-10-06T20:50:28.419260] [DEBUG] [LOCAL ] PAYC: Deleted derivative data file. [2025-10-06T20:50:28.419367] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PAYC took 27.3s. Estimated remaining: 1h 43m 31s. Rate: 7.1 symbols/min [2025-10-06T20:50:28.595010] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:50:28.625509] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-06T20:50:28.649621] [DEBUG] [LOCAL ] PBI: Loaded 50683 existing records from primary storage. [2025-10-06T20:50:28.650044] [INFO ] [MAIN ] PBI: Loaded 50683 existing records. [2025-10-06T20:50:28.837471] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:50:28.837723] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-06T20:50:28.837781] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-06T20:50:28.838050] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-10-06T20:50:28.838137] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-06T20:50:29.211052] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:50:29.425549] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-06T20:50:29.899471] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-06T20:50:30.225556] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-06T20:50:31.033179] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-06T20:50:31.038749] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T20:50:31.608685] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-06T20:50:31.825521] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-06T20:50:32.625510] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-06T20:50:32.680637] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T20:50:33.015979] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T20:50:33.425529] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-06T20:50:34.186082] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T20:50:34.225565] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-06T20:50:34.721895] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-06T20:50:35.025562] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-06T20:50:35.825511] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-06T20:50:36.106770] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-06T20:50:36.150065] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T20:50:36.625527] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-06T20:50:37.425495] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-06T20:50:37.512083] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T20:50:38.132865] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T20:50:38.225538] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-06T20:50:39.035415] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-06T20:50:39.041157] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T20:50:39.736405] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T20:50:39.825568] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-06T20:50:40.625516] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-06T20:50:40.863971] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T20:50:41.254212] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T20:50:41.257231] [INFO ] [REMOTE ] PBA: Full fetch complete (71394 records). [2025-10-06T20:50:41.257367] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-06T20:50:41.438474] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-06T20:50:41.664515] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-10-06T20:50:41.664625] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-10-06T20:50:41.665835] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-10-06T20:50:41.665903] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-10-06T20:50:41.667333] [DEBUG] [LOCAL ] PBA: Trimmed 71394 records to 48952 (keeping 200 days of data) [2025-10-06T20:50:41.792726] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T20:50:41.997184] [DEBUG] [LOCAL ] PBA: Primary data saved (48952 records). [2025-10-06T20:50:41.997340] [INFO ] [MAIN ] PBA: Full history saved. [2025-10-06T20:50:41.997425] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PBA took 37.5s. Estimated remaining: 1h 43m 25s. Rate: 7.1 symbols/min [2025-10-06T20:50:42.225531] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-06T20:50:43.025584] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-06T20:50:44.086565] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T20:50:44.098556] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-06T20:50:44.582220] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T20:50:44.610031] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (3.17 seconds). [2025-10-06T20:50:44.625461] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-06T20:50:45.425964] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-06T20:50:45.760610] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T20:50:46.225498] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-06T20:50:46.445632] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T20:50:46.839849] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T20:50:47.025539] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-06T20:50:47.825603] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-06T20:50:48.082137] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T20:50:48.505549] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T20:50:48.625603] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-06T20:50:49.096944] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T20:50:49.099286] [INFO ] [REMOTE ] PBH: Full fetch complete (43713 records). [2025-10-06T20:50:49.099404] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-06T20:50:49.431197] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-06T20:50:49.483255] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-10-06T20:50:49.483359] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-10-06T20:50:49.485103] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-10-06T20:50:49.485210] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-10-06T20:50:49.486530] [DEBUG] [LOCAL ] PBH: Trimmed 43713 records to 32095 (keeping 200 days of data) [2025-10-06T20:50:49.678464] [DEBUG] [LOCAL ] PBH: Primary data saved (32095 records). [2025-10-06T20:50:49.678616] [INFO ] [MAIN ] PBH: Full history saved. [2025-10-06T20:50:49.678732] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PBH took 23.9s. Estimated remaining: 1h 43m 16s. Rate: 7.1 symbols/min [2025-10-06T20:50:50.429143] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T20:50:50.440720] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-06T20:50:51.185386] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T20:50:51.195333] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-06T20:50:53.441803] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-10-06T20:50:53.453905] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-06T20:50:54.686766] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (3.49 seconds). [2025-10-06T20:50:54.698422] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-06T20:50:55.018576] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-06T20:50:55.022359] [INFO ] [REMOTE ] PBF: Full fetch complete (76629 records). [2025-10-06T20:50:55.022527] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-06T20:50:55.420356] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-10-06T20:50:55.420485] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-10-06T20:50:55.421602] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-10-06T20:50:55.421698] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-10-06T20:50:55.423218] [DEBUG] [LOCAL ] PBF: Trimmed 76629 records to 53143 (keeping 200 days of data) [2025-10-06T20:50:55.752581] [DEBUG] [LOCAL ] PBF: Primary data saved (53143 records). [2025-10-06T20:50:55.752750] [INFO ] [MAIN ] PBF: Full history saved. [2025-10-06T20:50:55.752841] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. PBF took 37.4s. Estimated remaining: 1h 43m 6s. Rate: 7.1 symbols/min [2025-10-06T20:50:56.629781] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-06T20:50:56.641113] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-06T20:50:58.440235] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T20:50:58.451743] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-06T20:50:59.707468] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T20:50:59.710482] [INFO ] [REMOTE ] PBI: Full fetch complete (72111 records). [2025-10-06T20:50:59.710612] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-06T20:51:00.107736] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-10-06T20:51:00.107942] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-10-06T20:51:00.109081] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-10-06T20:51:00.109153] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-10-06T20:51:00.110934] [DEBUG] [LOCAL ] PBI: Trimmed 72111 records to 49909 (keeping 200 days of data) [2025-10-06T20:51:00.427353] [DEBUG] [LOCAL ] PBI: Primary data saved (49909 records). [2025-10-06T20:51:00.427509] [INFO ] [MAIN ] PBI: Full history saved. [2025-10-06T20:51:00.427611] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. PBI took 32.0s. Estimated remaining: 1h 42m 56s. Rate: 7.1 symbols/min [2025-10-06T20:51:01.146023] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:51:01.150434] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:51:01.128907] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:51:01.172048] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:51:01.172722] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-06T20:51:01.172781] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-06T20:51:01.172904] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-06T20:51:01.172957] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-06T20:51:01.173122] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-06T20:51:01.173197] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-06T20:51:01.262305] [DEBUG] [LOCAL ] PCF: Loaded 9033 existing records from primary storage. [2025-10-06T20:51:01.297604] [INFO ] [MAIN ] PCF: Loaded 9033 existing records. [2025-10-06T20:51:01.332105] [DEBUG] [LOCAL ] PBT: Loaded 17494 existing records from primary storage. [2025-10-06T20:51:01.387297] [INFO ] [MAIN ] PBT: Loaded 17494 existing records. [2025-10-06T20:51:01.762526] [DEBUG] [LOCAL ] PBR: Loaded 54491 existing records from primary storage. [2025-10-06T20:51:01.808609] [INFO ] [MAIN ] PBR: Loaded 54491 existing records. [2025-10-06T20:51:01.850301] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:51:01.943607] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-06T20:51:01.990842] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-06T20:51:02.064930] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-06T20:51:02.122226] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-06T20:51:02.155396] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:51:02.233949] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:51:02.224975] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-06T20:51:02.263479] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-06T20:51:02.284738] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-06T20:51:02.330770] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-10-06T20:51:02.352147] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-06T20:51:02.390345] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:51:02.427674] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-06T20:51:02.428164] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-06T20:51:02.471273] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-10-06T20:51:02.483383] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-06T20:51:03.200103] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:51:03.223768] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-06T20:51:03.352201] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:51:03.352678] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-06T20:51:03.432614] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:51:03.432980] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-06T20:51:04.361987] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-06T20:51:04.375496] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-06T20:51:04.523528] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T20:51:04.528088] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-06T20:51:04.611166] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T20:51:04.615680] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-06T20:51:05.447616] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T20:51:05.458168] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-06T20:51:05.493981] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T20:51:05.498755] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-06T20:51:05.505137] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T20:51:05.508884] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-06T20:51:05.754227] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-06T20:51:05.765053] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-06T20:51:06.326716] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-06T20:51:06.337264] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-06T20:51:06.543014] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T20:51:06.546434] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-06T20:51:06.568442] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T20:51:06.571834] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-06T20:51:07.279611] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T20:51:07.290854] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-06T20:51:07.442731] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-06T20:51:07.446617] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-06T20:51:07.540412] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T20:51:07.825484] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-06T20:51:08.252022] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T20:51:08.481351] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-06T20:51:08.600368] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-06T20:51:08.630687] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-06T20:51:08.651515] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.89 seconds). [2025-10-06T20:51:09.425495] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-06T20:51:09.437757] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T20:51:10.225540] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-06T20:51:10.289924] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T20:51:11.025477] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-06T20:51:11.405077] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T20:51:11.825538] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-06T20:51:11.999206] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T20:51:12.625488] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-06T20:51:12.806511] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T20:51:13.425545] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-06T20:51:13.482498] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-06T20:51:14.225510] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-06T20:51:14.455303] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T20:51:15.025484] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-06T20:51:15.086678] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T20:51:15.825501] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-06T20:51:16.070005] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T20:51:16.625506] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-06T20:51:16.740951] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T20:51:17.425496] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-06T20:51:17.615570] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-06T20:51:18.225554] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-06T20:51:18.654973] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T20:51:19.025576] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-06T20:51:19.825516] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-06T20:51:20.130262] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-06T20:51:20.184560] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-06T20:51:20.625541] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-06T20:51:20.801063] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T20:51:21.425564] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-06T20:51:22.039101] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T20:51:22.040223] [INFO ] [REMOTE ] PCF: Full fetch complete (14111 records). [2025-10-06T20:51:22.040313] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-06T20:51:22.230732] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-06T20:51:22.415491] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-06T20:51:22.415599] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-06T20:51:22.415965] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-06T20:51:22.416041] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-06T20:51:22.416689] [DEBUG] [LOCAL ] PCF: Trimmed 14111 records to 8944 (keeping 200 days of data) [2025-10-06T20:51:22.470485] [DEBUG] [LOCAL ] PCF: Primary data saved (8944 records). [2025-10-06T20:51:22.470674] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-06T20:51:22.470785] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PCF took 22.0s. Estimated remaining: 1h 42m 54s. Rate: 7.1 symbols/min [2025-10-06T20:51:22.670601] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:51:22.679637] [DEBUG] [LOCAL ] PCM: Loaded 6801 existing records from primary storage. [2025-10-06T20:51:22.679865] [INFO ] [MAIN ] PCM: Loaded 6801 existing records. [2025-10-06T20:51:22.860168] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:51:22.860424] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-06T20:51:22.860488] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-06T20:51:22.860784] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-06T20:51:22.860912] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-06T20:51:23.037775] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-06T20:51:23.152230] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T20:51:23.186230] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-06T20:51:23.197890] [INFO ] [REMOTE ] PCG: Full fetch complete (77347 records). [2025-10-06T20:51:23.208522] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-06T20:51:23.255735] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:51:23.266705] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:51:23.274751] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:51:23.275990] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-06T20:51:23.279921] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-06T20:51:23.280012] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-06T20:51:23.280077] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-06T20:51:23.279824] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:51:23.280250] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PCG took 22.9s. Estimated remaining: 1h 42m 42s. Rate: 7.1 symbols/min [2025-10-06T20:51:23.452501] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:51:23.478013] [DEBUG] [LOCAL ] PCN: Loaded 24844 existing records from primary storage. [2025-10-06T20:51:23.478295] [INFO ] [MAIN ] PCN: Loaded 24844 existing records. [2025-10-06T20:51:23.652096] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:51:23.652283] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-06T20:51:23.652328] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-06T20:51:23.652531] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-10-06T20:51:23.652587] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-06T20:51:23.836273] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-06T20:51:24.003758] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:51:24.206505] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T20:51:24.625622] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-06T20:51:24.731096] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T20:51:25.425509] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-06T20:51:25.495450] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T20:51:25.497429] [INFO ] [REMOTE ] PBT: Full fetch complete (25299 records). [2025-10-06T20:51:25.497693] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-06T20:51:25.914390] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-10-06T20:51:25.914512] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-10-06T20:51:25.915686] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-10-06T20:51:25.915757] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-10-06T20:51:25.916982] [DEBUG] [LOCAL ] PBT: Trimmed 25299 records to 17357 (keeping 200 days of data) [2025-10-06T20:51:26.039230] [DEBUG] [LOCAL ] PBT: Primary data saved (17357 records). [2025-10-06T20:51:26.039470] [INFO ] [MAIN ] PBT: Full history saved. [2025-10-06T20:51:26.039627] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PBT took 25.6s. Estimated remaining: 1h 42m 31s. Rate: 7.1 symbols/min [2025-10-06T20:51:26.232106] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-06T20:51:26.236553] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:51:26.292312] [DEBUG] [LOCAL ] PCOR: Loaded 48706 existing records from primary storage. [2025-10-06T20:51:26.292781] [INFO ] [MAIN ] PCOR: Loaded 48706 existing records. [2025-10-06T20:51:26.498914] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:51:26.499198] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-06T20:51:26.499249] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-06T20:51:26.499825] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-10-06T20:51:26.499896] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-06T20:51:26.882379] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T20:51:26.952681] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:51:27.025565] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-06T20:51:27.825501] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-06T20:51:28.032336] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T20:51:28.419524] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-06T20:51:28.625502] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-06T20:51:29.049204] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T20:51:29.425580] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-06T20:51:30.205991] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T20:51:30.225521] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-06T20:51:30.948677] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-06T20:51:30.965820] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T20:51:31.025501] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-06T20:51:31.825563] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-06T20:51:32.134306] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T20:51:32.625618] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-06T20:51:33.425541] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-06T20:51:33.471052] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-06T20:51:33.864899] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-06T20:51:34.225541] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-06T20:51:34.916212] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T20:51:35.025553] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-06T20:51:35.825548] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-06T20:51:36.430329] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-06T20:51:36.625554] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-06T20:51:36.709617] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T20:51:36.756732] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T20:51:37.425559] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-06T20:51:37.443429] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-06T20:51:38.225589] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-06T20:51:39.025563] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-06T20:51:39.058697] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-06T20:51:39.344892] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-06T20:51:39.825577] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-06T20:51:40.416618] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T20:51:40.625560] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-06T20:51:41.432240] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-06T20:51:41.461367] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T20:51:42.193437] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T20:51:42.225514] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-06T20:51:42.824583] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-06T20:51:42.976182] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-06T20:51:43.025525] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-06T20:51:43.825548] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-06T20:51:43.879531] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-06T20:51:44.625539] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-06T20:51:45.373392] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-06T20:51:45.374406] [INFO ] [REMOTE ] PCM: Full fetch complete (10459 records). [2025-10-06T20:51:45.374477] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-06T20:51:45.430784] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-06T20:51:45.749057] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-06T20:51:45.749290] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-06T20:51:45.749635] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-06T20:51:45.749801] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-06T20:51:45.759779] [DEBUG] [LOCAL ] PCM: Trimmed 10459 records to 6735 (keeping 200 days of data) [2025-10-06T20:51:45.796472] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T20:51:45.827809] [DEBUG] [LOCAL ] PCM: Primary data saved (6735 records). [2025-10-06T20:51:45.827914] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-06T20:51:45.827991] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PCM took 23.4s. Estimated remaining: 1h 42m 28s. Rate: 7.1 symbols/min [2025-10-06T20:51:45.992959] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:51:46.006574] [DEBUG] [LOCAL ] PCQ: Loaded 12462 existing records from primary storage. [2025-10-06T20:51:46.006839] [INFO ] [MAIN ] PCQ: Loaded 12462 existing records. [2025-10-06T20:51:46.179349] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:51:46.179578] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-06T20:51:46.179625] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-06T20:51:46.179837] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-06T20:51:46.179894] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-06T20:51:46.232490] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-06T20:51:46.534129] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:51:47.025544] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-06T20:51:47.425999] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-06T20:51:47.590203] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T20:51:47.825551] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-06T20:51:48.625552] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-06T20:51:48.769720] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T20:51:49.425528] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-06T20:51:49.558249] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-06T20:51:49.561498] [INFO ] [REMOTE ] PBR: Full fetch complete (77775 records). [2025-10-06T20:51:49.561686] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-06T20:51:50.005859] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T20:51:50.036022] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-10-06T20:51:50.036449] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-10-06T20:51:50.037624] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-10-06T20:51:50.037713] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-10-06T20:51:50.039283] [DEBUG] [LOCAL ] PBR: Trimmed 77775 records to 53710 (keeping 200 days of data) [2025-10-06T20:51:50.234546] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-06T20:51:50.383931] [DEBUG] [LOCAL ] PBR: Primary data saved (53710 records). [2025-10-06T20:51:50.384091] [INFO ] [MAIN ] PBR: Full history saved. [2025-10-06T20:51:50.384241] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PBR took 50.0s. Estimated remaining: 1h 42m 17s. Rate: 7.1 symbols/min [2025-10-06T20:51:50.554007] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:51:50.600272] [DEBUG] [LOCAL ] PD: Loaded 48630 existing records from primary storage. [2025-10-06T20:51:50.600661] [INFO ] [MAIN ] PD: Loaded 48630 existing records. [2025-10-06T20:51:50.777192] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:51:50.777394] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-06T20:51:50.777439] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-06T20:51:50.777720] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-10-06T20:51:50.777778] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-06T20:51:51.030775] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-06T20:51:51.152623] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:51:51.178259] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T20:51:51.225777] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T20:51:51.825551] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-06T20:51:52.394758] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T20:51:52.625625] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-06T20:51:53.425615] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-06T20:51:53.465749] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T20:51:53.501616] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T20:51:54.225552] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-06T20:51:54.696058] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-06T20:51:55.025586] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-06T20:51:55.825508] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-06T20:51:55.879275] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-06T20:51:56.467033] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T20:51:56.625550] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-06T20:51:57.425533] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-06T20:51:57.623062] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T20:51:57.683932] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T20:51:57.685760] [INFO ] [REMOTE ] PCN: Full fetch complete (34143 records). [2025-10-06T20:51:57.685835] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-06T20:51:58.060038] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-06T20:51:58.060128] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-06T20:51:58.060847] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-06T20:51:58.060911] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-06T20:51:58.061726] [DEBUG] [LOCAL ] PCN: Trimmed 34143 records to 24578 (keeping 200 days of data) [2025-10-06T20:51:58.210827] [DEBUG] [LOCAL ] PCN: Primary data saved (24578 records). [2025-10-06T20:51:58.210965] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-06T20:51:58.211048] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCN took 34.9s. Estimated remaining: 1h 42m 9s. Rate: 7.1 symbols/min [2025-10-06T20:51:58.231592] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-06T20:51:58.343155] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T20:51:58.394278] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:51:58.394482] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-06T20:51:58.394525] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-06T20:51:58.394633] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-06T20:51:58.394711] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-06T20:51:58.394760] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-06T20:51:58.394793] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-06T20:51:58.763607] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:51:59.025527] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-06T20:51:59.825511] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-06T20:51:59.953494] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T20:52:00.160940] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-06T20:52:00.221232] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-06T20:52:00.625585] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-06T20:52:01.425494] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-06T20:52:01.714602] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T20:52:01.805188] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-06T20:52:02.225526] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-06T20:52:03.025580] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-06T20:52:03.825528] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-06T20:52:03.948632] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T20:52:04.065414] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T20:52:04.350200] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-06T20:52:04.625520] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-06T20:52:05.425488] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-06T20:52:05.548622] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T20:52:06.225590] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-06T20:52:06.778176] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T20:52:06.781952] [INFO ] [REMOTE ] PCOR: Full fetch complete (69498 records). [2025-10-06T20:52:06.782073] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-06T20:52:07.032194] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-06T20:52:07.185847] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T20:52:07.186086] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-10-06T20:52:07.188729] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-10-06T20:52:07.190243] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-10-06T20:52:07.190311] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-10-06T20:52:07.191872] [DEBUG] [LOCAL ] PCOR: Trimmed 69498 records to 47854 (keeping 200 days of data) [2025-10-06T20:52:07.487622] [DEBUG] [LOCAL ] PCOR: Primary data saved (47854 records). [2025-10-06T20:52:07.487803] [INFO ] [MAIN ] PCOR: Full history saved. [2025-10-06T20:52:07.487941] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCOR took 41.4s. Estimated remaining: 1h 42m 1s. Rate: 7.1 symbols/min [2025-10-06T20:52:07.662511] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:52:07.660942] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-06T20:52:07.713098] [DEBUG] [LOCAL ] PDI: Loaded 50810 existing records from primary storage. [2025-10-06T20:52:07.713425] [INFO ] [MAIN ] PDI: Loaded 50810 existing records. [2025-10-06T20:52:07.830687] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-06T20:52:07.900007] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:52:07.900210] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-06T20:52:07.900257] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-06T20:52:07.900711] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-10-06T20:52:07.900783] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-06T20:52:08.257269] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:52:08.625498] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-06T20:52:08.981145] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-06T20:52:09.189487] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-06T20:52:09.425523] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-06T20:52:10.225485] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-06T20:52:10.494330] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T20:52:11.025527] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-06T20:52:11.825519] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-06T20:52:11.852625] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T20:52:11.853892] [INFO ] [REMOTE ] PCQ: Full fetch complete (17339 records). [2025-10-06T20:52:11.853966] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-06T20:52:12.232029] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-06T20:52:12.232192] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-06T20:52:12.232780] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-06T20:52:12.233008] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-06T20:52:12.233863] [DEBUG] [LOCAL ] PCQ: Trimmed 17339 records to 12075 (keeping 200 days of data) [2025-10-06T20:52:12.307177] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-06T20:52:12.334854] [DEBUG] [LOCAL ] PCQ: Primary data saved (12075 records). [2025-10-06T20:52:12.337525] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-06T20:52:12.337618] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PCQ took 26.5s. Estimated remaining: 1h 41m 50s. Rate: 7.1 symbols/min [2025-10-06T20:52:12.371490] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-06T20:52:12.521325] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:52:12.559280] [DEBUG] [LOCAL ] PDM: Loaded 40131 existing records from primary storage. [2025-10-06T20:52:12.559613] [INFO ] [MAIN ] PDM: Loaded 40131 existing records. [2025-10-06T20:52:12.630697] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-06T20:52:12.749630] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:52:12.749893] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-06T20:52:12.749940] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-06T20:52:12.750176] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-10-06T20:52:12.750231] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-06T20:52:13.112039] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:52:13.227933] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T20:52:13.425560] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-06T20:52:13.882271] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-06T20:52:14.225574] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-06T20:52:15.025551] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-06T20:52:15.457816] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T20:52:15.809463] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T20:52:15.825461] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-06T20:52:16.625548] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-06T20:52:17.425596] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-06T20:52:17.611125] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T20:52:17.858099] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-06T20:52:18.225572] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-06T20:52:18.543336] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T20:52:19.025588] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-06T20:52:19.832261] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-06T20:52:19.837911] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T20:52:20.625591] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-06T20:52:20.904328] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-06T20:52:21.140206] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T20:52:21.425525] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-06T20:52:22.225556] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-06T20:52:22.624286] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-06T20:52:23.025578] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-06T20:52:23.385440] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-06T20:52:23.492045] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-06T20:52:23.825544] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-06T20:52:24.641199] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-06T20:52:24.677884] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T20:52:25.092906] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T20:52:25.093984] [INFO ] [REMOTE ] PDCC: Full fetch complete (1334 records). [2025-10-06T20:52:25.094073] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-06T20:52:25.295533] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-06T20:52:25.296397] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:52:25.296476] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:52:25.296550] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-06T20:52:25.296673] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-06T20:52:25.296736] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-06T20:52:25.296800] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-06T20:52:25.296902] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PDCC took 27.1s. Estimated remaining: 1h 41m 44s. Rate: 7.1 symbols/min [2025-10-06T20:52:25.430155] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-06T20:52:25.485573] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:52:25.515854] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T20:52:25.552366] [DEBUG] [LOCAL ] PDO: Loaded 31781 existing records from primary storage. [2025-10-06T20:52:25.552714] [INFO ] [MAIN ] PDO: Loaded 31781 existing records. [2025-10-06T20:52:25.734822] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:52:25.735091] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-06T20:52:25.735142] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-06T20:52:25.735414] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-10-06T20:52:25.735475] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-06T20:52:26.097937] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:52:26.225499] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-06T20:52:27.025576] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-06T20:52:27.313585] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-06T20:52:27.482064] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T20:52:27.825532] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-06T20:52:28.625581] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-06T20:52:28.979526] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T20:52:29.374762] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T20:52:29.425491] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-06T20:52:30.225504] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-06T20:52:30.364832] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T20:52:30.574171] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-06T20:52:31.025602] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-06T20:52:31.825536] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-06T20:52:32.036325] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T20:52:32.625531] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-06T20:52:33.138134] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-06T20:52:33.425573] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-06T20:52:33.616382] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T20:52:33.760877] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T20:52:34.225533] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-06T20:52:35.025543] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-06T20:52:35.304118] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-06T20:52:35.670823] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T20:52:35.673923] [INFO ] [REMOTE ] PD: Full fetch complete (67870 records). [2025-10-06T20:52:35.674040] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-06T20:52:35.832085] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-06T20:52:36.086255] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-10-06T20:52:36.086499] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-10-06T20:52:36.087576] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-10-06T20:52:36.087666] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-10-06T20:52:36.089121] [DEBUG] [LOCAL ] PD: Trimmed 67870 records to 47928 (keeping 200 days of data) [2025-10-06T20:52:36.376309] [DEBUG] [LOCAL ] PD: Primary data saved (47928 records). [2025-10-06T20:52:36.376572] [INFO ] [MAIN ] PD: Full history saved. [2025-10-06T20:52:36.376689] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PD took 46.0s. Estimated remaining: 1h 41m 37s. Rate: 7.1 symbols/min [2025-10-06T20:52:36.592400] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T20:52:36.602807] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:52:36.622820] [DEBUG] [LOCAL ] PDS: Loaded 17809 existing records from primary storage. [2025-10-06T20:52:36.623084] [INFO ] [MAIN ] PDS: Loaded 17809 existing records. [2025-10-06T20:52:36.634353] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-06T20:52:36.801307] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:52:36.801573] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-06T20:52:36.801620] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-06T20:52:36.801945] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-06T20:52:36.802003] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-06T20:52:37.160572] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:52:37.425527] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-06T20:52:37.730679] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T20:52:38.225542] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-06T20:52:38.518265] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-06T20:52:38.661730] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-06T20:52:39.025554] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-06T20:52:39.187616] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T20:52:39.825550] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-06T20:52:40.279047] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T20:52:40.625545] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-06T20:52:41.425495] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-06T20:52:41.488741] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T20:52:41.618816] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T20:52:42.225588] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-06T20:52:43.012828] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T20:52:43.025458] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-06T20:52:43.825539] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-06T20:52:44.182349] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T20:52:44.300546] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-06T20:52:44.501981] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-06T20:52:44.625517] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-06T20:52:45.425502] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-06T20:52:45.789305] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T20:52:46.225582] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-06T20:52:47.023944] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-06T20:52:47.026760] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-06T20:52:47.028342] [INFO ] [REMOTE ] PDI: Full fetch complete (72999 records). [2025-10-06T20:52:47.028435] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-06T20:52:47.442379] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-06T20:52:47.442632] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-06T20:52:47.443743] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-06T20:52:47.443810] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-06T20:52:47.445580] [DEBUG] [LOCAL ] PDI: Trimmed 72999 records to 50065 (keeping 200 days of data) [2025-10-06T20:52:47.533744] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T20:52:47.795411] [DEBUG] [LOCAL ] PDI: Primary data saved (50065 records). [2025-10-06T20:52:47.795559] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-06T20:52:47.795668] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PDI took 40.3s. Estimated remaining: 1h 41m 30s. Rate: 7.1 symbols/min [2025-10-06T20:52:47.827604] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-06T20:52:47.965091] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:52:47.983950] [DEBUG] [LOCAL ] PDT: Loaded 17673 existing records from primary storage. [2025-10-06T20:52:47.984216] [INFO ] [MAIN ] PDT: Loaded 17673 existing records. [2025-10-06T20:52:48.171110] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:52:48.172115] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-06T20:52:48.172174] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-06T20:52:48.172874] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-06T20:52:48.172948] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-06T20:52:48.530003] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:52:48.548097] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-06T20:52:48.625508] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-06T20:52:49.215453] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T20:52:49.425638] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-06T20:52:50.032762] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T20:52:50.225594] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-06T20:52:50.708023] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T20:52:51.025570] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-06T20:52:51.495535] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T20:52:51.717447] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-06T20:52:51.825556] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-06T20:52:52.625535] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-06T20:52:52.831581] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T20:52:53.425532] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-06T20:52:53.462663] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-06T20:52:54.225519] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-06T20:52:54.556844] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T20:52:55.025511] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-06T20:52:55.298186] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-06T20:52:55.825515] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-06T20:52:56.549521] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T20:52:56.625527] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-06T20:52:56.744954] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-06T20:52:57.425558] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-06T20:52:57.590139] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T20:52:58.225568] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-06T20:52:58.460920] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T20:52:59.025551] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-06T20:52:59.291991] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T20:52:59.825548] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-06T20:53:00.592915] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T20:53:00.594332] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T20:53:00.602995] [INFO ] [REMOTE ] PDS: Full fetch complete (25569 records). [2025-10-06T20:53:00.603442] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-06T20:53:00.635554] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-06T20:53:00.976521] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-06T20:53:00.976607] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-06T20:53:00.977197] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-06T20:53:00.977261] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-06T20:53:00.978038] [DEBUG] [LOCAL ] PDS: Trimmed 25569 records to 17468 (keeping 200 days of data) [2025-10-06T20:53:01.085405] [DEBUG] [LOCAL ] PDS: Primary data saved (17468 records). [2025-10-06T20:53:01.085574] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-06T20:53:01.085703] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDS took 24.7s. Estimated remaining: 1h 41m 23s. Rate: 7.1 symbols/min [2025-10-06T20:53:01.257902] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:53:01.274005] [DEBUG] [LOCAL ] PDX: Loaded 14525 existing records from primary storage. [2025-10-06T20:53:01.274275] [INFO ] [MAIN ] PDX: Loaded 14525 existing records. [2025-10-06T20:53:01.433075] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-06T20:53:01.483206] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:53:01.483444] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-06T20:53:01.483521] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-06T20:53:01.483789] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-10-06T20:53:01.483848] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-06T20:53:01.884631] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T20:53:01.890156] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:53:02.225549] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-06T20:53:02.540490] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T20:53:02.543609] [INFO ] [REMOTE ] PDO: Full fetch complete (47428 records). [2025-10-06T20:53:02.543825] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-06T20:53:02.954386] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-10-06T20:53:02.954475] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-10-06T20:53:02.955320] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-10-06T20:53:02.955383] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-10-06T20:53:02.956405] [DEBUG] [LOCAL ] PDO: Trimmed 47428 records to 31295 (keeping 200 days of data) [2025-10-06T20:53:03.043946] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-06T20:53:03.157036] [DEBUG] [LOCAL ] PDO: Primary data saved (31295 records). [2025-10-06T20:53:03.157194] [INFO ] [MAIN ] PDO: Full history saved. [2025-10-06T20:53:03.157285] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDO took 37.9s. Estimated remaining: 1h 41m 12s. Rate: 7.1 symbols/min [2025-10-06T20:53:03.332377] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:53:03.381845] [DEBUG] [LOCAL ] PEB: Loaded 51395 existing records from primary storage. [2025-10-06T20:53:03.382179] [INFO ] [MAIN ] PEB: Loaded 51395 existing records. [2025-10-06T20:53:03.496606] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T20:53:03.521009] [INFO ] [REMOTE ] PDM: Full fetch complete (57397 records). [2025-10-06T20:53:03.549620] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-06T20:53:03.622163] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:53:03.666895] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-06T20:53:03.682695] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-06T20:53:03.693478] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-10-06T20:53:03.698997] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-06T20:53:03.825814] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-06T20:53:04.399627] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:53:04.471261] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T20:53:04.478792] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-10-06T20:53:04.479788] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-10-06T20:53:04.480941] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-10-06T20:53:04.481008] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-10-06T20:53:04.482547] [DEBUG] [LOCAL ] PDM: Trimmed 57397 records to 39499 (keeping 200 days of data) [2025-10-06T20:53:04.638961] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-06T20:53:04.712139] [DEBUG] [LOCAL ] PDM: Primary data saved (39499 records). [2025-10-06T20:53:04.712338] [INFO ] [MAIN ] PDM: Full history saved. [2025-10-06T20:53:04.712434] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDM took 52.4s. Estimated remaining: 1h 41m 1s. Rate: 7.1 symbols/min [2025-10-06T20:53:04.894552] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:53:04.894985] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-06T20:53:04.895041] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-06T20:53:04.895245] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-06T20:53:04.895302] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-06T20:53:04.895346] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-06T20:53:04.895382] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-06T20:53:05.264630] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T20:53:05.268614] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:53:05.425528] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-06T20:53:06.194266] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T20:53:06.225481] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-06T20:53:06.768031] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-06T20:53:07.025507] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-06T20:53:07.425423] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T20:53:07.825531] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-06T20:53:08.625518] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-06T20:53:08.742073] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T20:53:08.865148] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T20:53:09.425581] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-06T20:53:10.225547] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-06T20:53:10.494615] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-06T20:53:11.025499] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-06T20:53:11.139035] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T20:53:11.374672] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T20:53:11.825563] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-06T20:53:12.140486] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T20:53:12.478165] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-06T20:53:12.625604] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-06T20:53:13.425601] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-06T20:53:13.556111] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T20:53:14.225587] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-06T20:53:14.716417] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T20:53:15.025538] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-06T20:53:15.825580] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-06T20:53:15.976882] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T20:53:16.033000] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T20:53:16.625562] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-06T20:53:16.886706] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T20:53:17.425554] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-06T20:53:17.446149] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T20:53:17.447994] [INFO ] [REMOTE ] PDT: Full fetch complete (25224 records). [2025-10-06T20:53:17.448136] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-06T20:53:17.857983] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-06T20:53:17.858171] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-06T20:53:17.859138] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-06T20:53:17.859214] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-06T20:53:17.860566] [DEBUG] [LOCAL ] PDT: Trimmed 25224 records to 17389 (keeping 200 days of data) [2025-10-06T20:53:17.978843] [DEBUG] [LOCAL ] PDT: Primary data saved (17389 records). [2025-10-06T20:53:17.979087] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-06T20:53:17.979200] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDT took 30.2s. Estimated remaining: 1h 40m 54s. Rate: 7.1 symbols/min [2025-10-06T20:53:18.160604] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:53:18.196109] [DEBUG] [LOCAL ] PEN: Loaded 30624 existing records from primary storage. [2025-10-06T20:53:18.196492] [INFO ] [MAIN ] PEN: Loaded 30624 existing records. [2025-10-06T20:53:18.230706] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-06T20:53:18.393471] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:53:18.393912] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-06T20:53:18.393987] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-06T20:53:18.394312] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-10-06T20:53:18.394370] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-06T20:53:18.581920] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T20:53:18.810984] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:53:19.025545] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-06T20:53:19.825488] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-06T20:53:19.925495] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T20:53:20.005050] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T20:53:20.625526] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-06T20:53:20.680298] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T20:53:21.341602] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T20:53:21.425518] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-06T20:53:22.225601] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-06T20:53:22.620923] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T20:53:23.025614] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-06T20:53:23.131519] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T20:53:23.825557] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-06T20:53:23.978591] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-06T20:53:24.519148] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T20:53:24.520323] [INFO ] [REMOTE ] PDX: Full fetch complete (24248 records). [2025-10-06T20:53:24.520432] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-06T20:53:24.630722] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-06T20:53:24.896365] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-10-06T20:53:24.896446] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-10-06T20:53:24.896965] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-10-06T20:53:24.897042] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-10-06T20:53:24.897667] [DEBUG] [LOCAL ] PDX: Trimmed 24248 records to 14391 (keeping 200 days of data) [2025-10-06T20:53:24.986397] [DEBUG] [LOCAL ] PDX: Primary data saved (14391 records). [2025-10-06T20:53:24.986539] [INFO ] [MAIN ] PDX: Full history saved. [2025-10-06T20:53:24.986621] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDX took 23.9s. Estimated remaining: 1h 40m 45s. Rate: 7.1 symbols/min [2025-10-06T20:53:25.160844] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:53:25.173893] [DEBUG] [LOCAL ] PEO: Loaded 11227 existing records from primary storage. [2025-10-06T20:53:25.174100] [INFO ] [MAIN ] PEO: Loaded 11227 existing records. [2025-10-06T20:53:25.360298] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:53:25.360590] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-06T20:53:25.360678] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-06T20:53:25.360919] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-06T20:53:25.360979] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-06T20:53:25.434980] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-06T20:53:25.718339] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:53:26.219697] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T20:53:26.227230] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-06T20:53:26.471932] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T20:53:27.025585] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-06T20:53:27.825499] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-06T20:53:28.222593] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-06T20:53:28.301994] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-06T20:53:28.625506] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-06T20:53:28.824361] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-06T20:53:29.425558] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-06T20:53:30.255412] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-06T20:53:30.273880] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T20:53:31.025521] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-06T20:53:31.205686] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-06T20:53:31.322069] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T20:53:31.825484] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-06T20:53:32.037027] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-06T20:53:32.625525] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-06T20:53:32.868554] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T20:53:33.425601] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-06T20:53:34.068682] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T20:53:34.225553] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-06T20:53:34.279578] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T20:53:35.025537] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-06T20:53:35.747326] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T20:53:35.763690] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T20:53:35.825505] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-06T20:53:36.625554] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-06T20:53:36.756163] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T20:53:37.425541] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-06T20:53:38.225548] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-06T20:53:38.388462] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T20:53:38.847699] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T20:53:39.025501] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-06T20:53:39.195474] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-06T20:53:39.825588] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-06T20:53:40.625503] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-06T20:53:40.937437] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-06T20:53:41.236635] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T20:53:41.346893] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-06T20:53:41.425524] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-06T20:53:42.225494] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-06T20:53:42.552427] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T20:53:42.816538] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T20:53:42.819241] [INFO ] [REMOTE ] PEG: Full fetch complete (76320 records). [2025-10-06T20:53:42.819388] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-06T20:53:42.820537] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:53:42.820627] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:53:42.820712] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:53:42.820761] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-06T20:53:42.820822] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-06T20:53:42.820856] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-06T20:53:42.820910] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-06T20:53:42.820991] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PEG took 38.1s. Estimated remaining: 1h 40m 41s. Rate: 7.1 symbols/min [2025-10-06T20:53:42.992786] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:53:43.009359] [DEBUG] [LOCAL ] PERF: Loaded 14240 existing records from primary storage. [2025-10-06T20:53:43.009678] [INFO ] [MAIN ] PERF: Loaded 14240 existing records. [2025-10-06T20:53:43.030812] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-06T20:53:43.187820] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:53:43.188038] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-06T20:53:43.188101] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-06T20:53:43.188316] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-06T20:53:43.188373] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-06T20:53:43.535590] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:53:43.825564] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-06T20:53:43.970044] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T20:53:44.625603] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-06T20:53:45.425540] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-06T20:53:45.651383] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T20:53:45.670617] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T20:53:46.225540] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-06T20:53:46.561207] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T20:53:46.564591] [INFO ] [REMOTE ] PEN: Full fetch complete (44191 records). [2025-10-06T20:53:46.564952] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-06T20:53:46.960428] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-10-06T20:53:46.960537] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-10-06T20:53:46.961824] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-10-06T20:53:46.961921] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-10-06T20:53:46.963224] [DEBUG] [LOCAL ] PEN: Trimmed 44191 records to 30168 (keeping 200 days of data) [2025-10-06T20:53:47.027608] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-06T20:53:47.176024] [DEBUG] [LOCAL ] PEN: Primary data saved (30168 records). [2025-10-06T20:53:47.176262] [INFO ] [MAIN ] PEN: Full history saved. [2025-10-06T20:53:47.176482] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEN took 29.2s. Estimated remaining: 1h 40m 30s. Rate: 7.1 symbols/min [2025-10-06T20:53:47.359466] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T20:53:47.386162] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:53:47.386923] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-06T20:53:47.386974] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-06T20:53:47.387110] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-06T20:53:47.387159] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-06T20:53:47.387250] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-06T20:53:47.387299] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-06T20:53:47.755518] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:53:47.825482] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-06T20:53:48.116821] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T20:53:48.117122] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-06T20:53:48.117218] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:53:48.117267] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-06T20:53:48.117301] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:53:48.117337] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-06T20:53:48.117394] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-06T20:53:48.117427] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-06T20:53:48.117466] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-06T20:53:48.117512] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEW took 0.9s. Estimated remaining: 1h 40m 19s. Rate: 7.1 symbols/min [2025-10-06T20:53:48.293280] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:53:48.302389] [DEBUG] [LOCAL ] PFD: Loaded 5226 existing records from primary storage. [2025-10-06T20:53:48.302590] [INFO ] [MAIN ] PFD: Loaded 5226 existing records. [2025-10-06T20:53:48.479021] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:53:48.479236] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-06T20:53:48.479282] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-06T20:53:48.479431] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-06T20:53:48.479489] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-06T20:53:48.626130] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-06T20:53:48.843817] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:53:48.880788] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T20:53:49.425554] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-06T20:53:49.857959] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T20:53:50.225585] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-06T20:53:50.685835] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T20:53:50.688851] [INFO ] [REMOTE ] PEB: Full fetch complete (72928 records). [2025-10-06T20:53:50.688965] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-06T20:53:51.030725] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-06T20:53:51.089335] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-10-06T20:53:51.089541] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-10-06T20:53:51.091254] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-10-06T20:53:51.091390] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-10-06T20:53:51.094049] [DEBUG] [LOCAL ] PEB: Trimmed 72928 records to 50658 (keeping 200 days of data) [2025-10-06T20:53:51.411079] [DEBUG] [LOCAL ] PEB: Primary data saved (50658 records). [2025-10-06T20:53:51.411282] [INFO ] [MAIN ] PEB: Full history saved. [2025-10-06T20:53:51.411378] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEB took 48.3s. Estimated remaining: 1h 40m 8s. Rate: 7.1 symbols/min [2025-10-06T20:53:51.529165] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T20:53:51.606432] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:53:51.606713] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-06T20:53:51.606769] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-06T20:53:51.606885] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-06T20:53:51.606927] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-06T20:53:51.606966] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-06T20:53:51.606996] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-06T20:53:51.715574] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-06T20:53:51.830853] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-06T20:53:51.977503] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:53:52.584891] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T20:53:52.625519] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-06T20:53:53.425602] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-06T20:53:53.474571] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T20:53:54.225540] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-06T20:53:54.671139] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T20:53:55.025548] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-06T20:53:55.825550] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-06T20:53:55.991901] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T20:53:56.521312] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-06T20:53:56.625488] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-06T20:53:56.687703] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-10-06T20:53:57.347320] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-06T20:53:57.425538] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-06T20:53:58.225494] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-06T20:53:58.394224] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-06T20:53:59.025495] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-06T20:53:59.096001] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T20:53:59.762697] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T20:53:59.825518] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-06T20:54:00.625489] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-06T20:54:00.769940] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-06T20:54:01.425508] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-06T20:54:01.784591] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T20:54:02.152684] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T20:54:02.225719] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-06T20:54:03.025514] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-06T20:54:03.155084] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T20:54:03.825496] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-06T20:54:03.920561] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T20:54:04.625521] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-06T20:54:04.740827] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T20:54:05.263063] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T20:54:05.425509] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-06T20:54:06.225580] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-06T20:54:06.539348] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T20:54:06.741624] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T20:54:06.742817] [INFO ] [REMOTE ] PEO: Full fetch complete (16287 records). [2025-10-06T20:54:06.742890] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-06T20:54:07.027679] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-06T20:54:07.118780] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-06T20:54:07.118968] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-06T20:54:07.119360] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-06T20:54:07.119400] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-06T20:54:07.119963] [DEBUG] [LOCAL ] PEO: Trimmed 16287 records to 11128 (keeping 200 days of data) [2025-10-06T20:54:07.187031] [DEBUG] [LOCAL ] PEO: Primary data saved (11128 records). [2025-10-06T20:54:07.187167] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-06T20:54:07.187292] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PEO took 42.2s. Estimated remaining: 1h 40m 3s. Rate: 7.1 symbols/min [2025-10-06T20:54:07.353090] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:54:07.398373] [DEBUG] [LOCAL ] PFGC: Loaded 47509 existing records from primary storage. [2025-10-06T20:54:07.398737] [INFO ] [MAIN ] PFGC: Loaded 47509 existing records. [2025-10-06T20:54:07.572907] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:54:07.573125] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-06T20:54:07.573172] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-06T20:54:07.573383] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-10-06T20:54:07.573438] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-06T20:54:07.839742] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-06T20:54:07.898638] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-06T20:54:07.940026] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:54:08.625543] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-06T20:54:08.782301] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T20:54:09.425521] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-06T20:54:09.900836] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T20:54:09.901745] [INFO ] [REMOTE ] PFD: Full fetch complete (7492 records). [2025-10-06T20:54:09.901817] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-06T20:54:10.226355] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-06T20:54:10.264164] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-06T20:54:10.264252] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-06T20:54:10.264448] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-06T20:54:10.264486] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-06T20:54:10.264911] [DEBUG] [LOCAL ] PFD: Trimmed 7492 records to 5201 (keeping 200 days of data) [2025-10-06T20:54:10.297408] [DEBUG] [LOCAL ] PFD: Primary data saved (5201 records). [2025-10-06T20:54:10.297505] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-06T20:54:10.297584] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PFD took 22.2s. Estimated remaining: 1h 39m 52s. Rate: 7.1 symbols/min [2025-10-06T20:54:10.468347] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:54:10.495203] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-06T20:54:10.507534] [DEBUG] [LOCAL ] PFH: Loaded 6882 existing records from primary storage. [2025-10-06T20:54:10.507740] [INFO ] [MAIN ] PFH: Loaded 6882 existing records. [2025-10-06T20:54:10.681858] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:54:10.682112] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-06T20:54:10.682158] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-06T20:54:10.682356] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-06T20:54:10.682415] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-06T20:54:11.035012] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-06T20:54:11.039796] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:54:11.539008] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T20:54:11.825499] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-06T20:54:12.084031] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-06T20:54:12.401870] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-06T20:54:12.625609] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-06T20:54:13.425690] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-06T20:54:14.227179] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T20:54:14.225500] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-06T20:54:14.413406] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-06T20:54:15.025519] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-06T20:54:15.362220] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T20:54:15.825570] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-06T20:54:16.625493] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-06T20:54:16.784594] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T20:54:16.815258] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T20:54:17.425690] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-06T20:54:17.455777] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T20:54:18.115780] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T20:54:18.117209] [INFO ] [REMOTE ] PERF: Full fetch complete (21967 records). [2025-10-06T20:54:18.117283] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-06T20:54:18.230782] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-06T20:54:18.486981] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-06T20:54:18.487061] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-06T20:54:18.487564] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-06T20:54:18.487604] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-06T20:54:18.488255] [DEBUG] [LOCAL ] PERF: Trimmed 21967 records to 14234 (keeping 200 days of data) [2025-10-06T20:54:18.568479] [DEBUG] [LOCAL ] PERF: Primary data saved (14234 records). [2025-10-06T20:54:18.568635] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-06T20:54:18.568780] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PERF took 35.7s. Estimated remaining: 1h 39m 43s. Rate: 7.1 symbols/min [2025-10-06T20:54:18.737167] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:54:18.753233] [DEBUG] [LOCAL ] PFL: Loaded 13879 existing records from primary storage. [2025-10-06T20:54:18.753462] [INFO ] [MAIN ] PFL: Loaded 13879 existing records. [2025-10-06T20:54:18.927706] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:54:18.927919] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-06T20:54:18.927966] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-06T20:54:18.928192] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-06T20:54:18.928263] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-06T20:54:19.027462] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-06T20:54:19.296662] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:54:19.438492] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T20:54:19.825514] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-06T20:54:20.625502] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-06T20:54:20.813533] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T20:54:20.885096] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-06T20:54:21.265875] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-06T20:54:21.425545] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-06T20:54:22.225535] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-06T20:54:22.433381] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-06T20:54:23.027750] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-06T20:54:23.032026] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T20:54:23.825559] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-06T20:54:24.625495] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-06T20:54:24.730490] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T20:54:24.834857] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-06T20:54:25.425507] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-06T20:54:25.624250] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-06T20:54:26.044627] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-06T20:54:26.225578] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-06T20:54:27.025503] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-06T20:54:27.825547] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-06T20:54:27.836871] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T20:54:27.997237] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T20:54:28.625545] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-06T20:54:28.779252] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-06T20:54:29.425571] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-06T20:54:29.497384] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-06T20:54:30.225516] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-06T20:54:30.258594] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T20:54:31.030507] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-06T20:54:31.029498] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-06T20:54:31.594395] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T20:54:31.597803] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-10-06T20:54:31.597991] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-06T20:54:31.598933] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:54:31.599037] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:54:31.599082] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:54:31.599124] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-06T20:54:31.599452] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-06T20:54:31.599781] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-06T20:54:31.599859] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-06T20:54:31.600006] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PFE took 40.2s. Estimated remaining: 1h 39m 37s. Rate: 7.1 symbols/min [2025-10-06T20:54:31.794078] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:54:31.834689] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-06T20:54:31.838260] [DEBUG] [LOCAL ] PFLT: Loaded 44496 existing records from primary storage. [2025-10-06T20:54:31.838728] [INFO ] [MAIN ] PFLT: Loaded 44496 existing records. [2025-10-06T20:54:32.020871] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:54:32.021159] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-06T20:54:32.021217] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-06T20:54:32.021456] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-10-06T20:54:32.021515] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-06T20:54:32.378725] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:54:32.625528] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-06T20:54:32.799298] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T20:54:33.425514] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-06T20:54:33.528632] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-06T20:54:34.225516] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-06T20:54:34.527594] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-06T20:54:35.025531] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-06T20:54:35.839494] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-06T20:54:35.847931] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T20:54:35.944799] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T20:54:36.609674] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-06T20:54:36.625470] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-06T20:54:37.238359] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T20:54:37.239380] [INFO ] [REMOTE ] PFH: Full fetch complete (10403 records). [2025-10-06T20:54:37.239455] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-06T20:54:37.430837] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-06T20:54:37.647214] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-06T20:54:37.647311] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-06T20:54:37.647601] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-06T20:54:37.647685] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-06T20:54:37.648169] [DEBUG] [LOCAL ] PFH: Trimmed 10403 records to 6805 (keeping 200 days of data) [2025-10-06T20:54:37.693373] [DEBUG] [LOCAL ] PFH: Primary data saved (6805 records). [2025-10-06T20:54:37.693533] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-06T20:54:37.693636] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFH took 27.4s. Estimated remaining: 1h 39m 28s. Rate: 7.1 symbols/min [2025-10-06T20:54:37.860064] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:54:37.883772] [DEBUG] [LOCAL ] PFN: Loaded 22188 existing records from primary storage. [2025-10-06T20:54:37.884040] [INFO ] [MAIN ] PFN: Loaded 22188 existing records. [2025-10-06T20:54:38.058883] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:54:38.059133] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-06T20:54:38.059181] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-06T20:54:38.059412] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-06T20:54:38.059470] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-06T20:54:38.230313] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-06T20:54:38.424049] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:54:38.462235] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T20:54:39.025538] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-06T20:54:39.825489] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-06T20:54:40.064755] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-06T20:54:40.148370] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T20:54:40.625538] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-06T20:54:41.425590] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-06T20:54:41.548780] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T20:54:42.225493] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-06T20:54:42.355278] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T20:54:42.396220] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T20:54:43.025535] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-06T20:54:43.825546] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-06T20:54:43.961158] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T20:54:44.625592] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-06T20:54:44.873289] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T20:54:44.925418] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T20:54:45.425570] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-06T20:54:46.129625] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T20:54:46.204520] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T20:54:46.225472] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-06T20:54:47.025584] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-06T20:54:47.423270] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T20:54:47.825541] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-06T20:54:48.149584] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T20:54:48.625581] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-06T20:54:49.143179] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-06T20:54:49.425556] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-06T20:54:49.795381] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T20:54:50.225528] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-06T20:54:51.025586] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-06T20:54:51.120587] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T20:54:51.186022] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T20:54:51.187458] [INFO ] [REMOTE ] PFL: Full fetch complete (20158 records). [2025-10-06T20:54:51.187532] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-06T20:54:51.566474] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-06T20:54:51.566563] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-06T20:54:51.567082] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-06T20:54:51.567148] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-06T20:54:51.567879] [DEBUG] [LOCAL ] PFL: Trimmed 20158 records to 13790 (keeping 200 days of data) [2025-10-06T20:54:51.650028] [DEBUG] [LOCAL ] PFL: Primary data saved (13790 records). [2025-10-06T20:54:51.650180] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-06T20:54:51.650262] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFL took 33.1s. Estimated remaining: 1h 39m 21s. Rate: 7.1 symbols/min [2025-10-06T20:54:51.844618] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-06T20:54:51.847483] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:54:51.857119] [DEBUG] [LOCAL ] PFO: Loaded 6032 existing records from primary storage. [2025-10-06T20:54:51.857365] [INFO ] [MAIN ] PFO: Loaded 6032 existing records. [2025-10-06T20:54:52.033416] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:54:52.033695] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-06T20:54:52.033752] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-06T20:54:52.034065] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-06T20:54:52.034122] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-06T20:54:52.378320] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T20:54:52.398712] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:54:52.402187] [INFO ] [REMOTE ] PFGC: Full fetch complete (67353 records). [2025-10-06T20:54:52.402337] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-06T20:54:52.629018] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-06T20:54:52.800413] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-10-06T20:54:52.800510] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-10-06T20:54:52.801637] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-10-06T20:54:52.801725] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-10-06T20:54:52.803136] [DEBUG] [LOCAL ] PFGC: Trimmed 67353 records to 46910 (keeping 200 days of data) [2025-10-06T20:54:53.020146] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T20:54:53.100211] [DEBUG] [LOCAL ] PFGC: Primary data saved (46910 records). [2025-10-06T20:54:53.100351] [INFO ] [MAIN ] PFGC: Full history saved. [2025-10-06T20:54:53.100433] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFGC took 45.9s. Estimated remaining: 1h 39m 10s. Rate: 7.1 symbols/min [2025-10-06T20:54:53.273688] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:54:53.309196] [DEBUG] [LOCAL ] PFS: Loaded 36112 existing records from primary storage. [2025-10-06T20:54:53.309503] [INFO ] [MAIN ] PFS: Loaded 36112 existing records. [2025-10-06T20:54:53.430733] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-06T20:54:53.497159] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:54:53.497522] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-06T20:54:53.497579] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-06T20:54:53.497868] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-10-06T20:54:53.497927] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-06T20:54:53.599782] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T20:54:53.863264] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:54:54.225535] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-06T20:54:54.543086] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T20:54:55.025554] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-06T20:54:55.599024] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T20:54:55.825522] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-06T20:54:56.625508] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-06T20:54:56.747200] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T20:54:57.392110] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T20:54:57.425470] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-06T20:54:57.485523] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T20:54:58.225557] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-06T20:54:59.025602] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-06T20:54:59.219966] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T20:54:59.486712] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-06T20:54:59.798427] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T20:54:59.825491] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-06T20:55:00.625546] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-06T20:55:01.425592] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-06T20:55:01.568339] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T20:55:02.156302] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T20:55:02.223626] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T20:55:02.226637] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-06T20:55:02.918626] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-06T20:55:03.025587] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-06T20:55:03.825582] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-06T20:55:04.625553] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-06T20:55:04.764521] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-06T20:55:05.145023] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T20:55:05.425546] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-06T20:55:06.225495] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-06T20:55:06.328770] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T20:55:07.025527] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-06T20:55:07.250773] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T20:55:07.422549] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-06T20:55:07.752356] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-06T20:55:07.825536] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-06T20:55:08.625614] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-06T20:55:09.425508] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-06T20:55:09.682307] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-06T20:55:09.741218] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T20:55:10.072838] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-06T20:55:10.225594] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-06T20:55:11.025538] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-06T20:55:11.137394] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-06T20:55:11.139294] [INFO ] [REMOTE ] PFN: Full fetch complete (31078 records). [2025-10-06T20:55:11.139381] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-06T20:55:11.522453] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-06T20:55:11.522813] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-06T20:55:11.523501] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-06T20:55:11.523546] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-06T20:55:11.524620] [DEBUG] [LOCAL ] PFN: Trimmed 31078 records to 21981 (keeping 200 days of data) [2025-10-06T20:55:11.654933] [DEBUG] [LOCAL ] PFN: Primary data saved (21981 records). [2025-10-06T20:55:11.655085] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-06T20:55:11.655172] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFN took 34.0s. Estimated remaining: 1h 39m 6s. Rate: 7.1 symbols/min [2025-10-06T20:55:11.830138] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:55:11.830220] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-06T20:55:11.864336] [DEBUG] [LOCAL ] PFSI: Loaded 29124 existing records from primary storage. [2025-10-06T20:55:11.864691] [INFO ] [MAIN ] PFSI: Loaded 29124 existing records. [2025-10-06T20:55:12.049292] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:55:12.049589] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-06T20:55:12.049665] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-06T20:55:12.050082] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-10-06T20:55:12.050140] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-06T20:55:12.436965] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:55:12.525409] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T20:55:12.528384] [INFO ] [REMOTE ] PFLT: Full fetch complete (63863 records). [2025-10-06T20:55:12.528515] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-06T20:55:12.631180] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-06T20:55:12.919145] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-10-06T20:55:12.919230] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-10-06T20:55:12.920254] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-10-06T20:55:12.920321] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-10-06T20:55:12.921555] [DEBUG] [LOCAL ] PFLT: Trimmed 63863 records to 43861 (keeping 200 days of data) [2025-10-06T20:55:13.192432] [DEBUG] [LOCAL ] PFLT: Primary data saved (43861 records). [2025-10-06T20:55:13.192618] [INFO ] [MAIN ] PFLT: Full history saved. [2025-10-06T20:55:13.192762] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFLT took 41.6s. Estimated remaining: 1h 38m 54s. Rate: 7.1 symbols/min [2025-10-06T20:55:13.364461] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:55:13.364690] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-06T20:55:13.364804] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-06T20:55:13.364916] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-06T20:55:13.364957] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-06T20:55:13.364998] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-06T20:55:13.365034] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-06T20:55:13.428006] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-06T20:55:13.511906] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T20:55:13.755573] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:55:13.878032] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T20:55:14.184298] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T20:55:14.225533] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-06T20:55:15.025562] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-06T20:55:15.696425] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-06T20:55:15.825530] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-06T20:55:16.625542] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-06T20:55:17.238015] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-06T20:55:17.263306] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T20:55:17.331249] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T20:55:17.425500] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-06T20:55:18.225597] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-06T20:55:18.724009] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T20:55:19.025618] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-06T20:55:19.673573] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T20:55:19.825521] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-06T20:55:20.366006] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-06T20:55:20.625529] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-06T20:55:21.158612] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T20:55:21.425520] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-06T20:55:21.714021] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T20:55:21.716692] [INFO ] [REMOTE ] PFS: Full fetch complete (51821 records). [2025-10-06T20:55:21.716826] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-06T20:55:22.149087] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-10-06T20:55:22.149318] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-10-06T20:55:22.150484] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-10-06T20:55:22.150621] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-10-06T20:55:22.151927] [DEBUG] [LOCAL ] PFS: Trimmed 51821 records to 35572 (keeping 200 days of data) [2025-10-06T20:55:22.239571] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-06T20:55:22.287998] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T20:55:22.416435] [DEBUG] [LOCAL ] PFS: Primary data saved (35572 records). [2025-10-06T20:55:22.416604] [INFO ] [MAIN ] PFS: Full history saved. [2025-10-06T20:55:22.416717] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFS took 29.3s. Estimated remaining: 1h 38m 46s. Rate: 7.1 symbols/min [2025-10-06T20:55:22.584318] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:55:22.592436] [DEBUG] [LOCAL ] PGP: Loaded 5609 existing records from primary storage. [2025-10-06T20:55:22.592636] [INFO ] [MAIN ] PGP: Loaded 5609 existing records. [2025-10-06T20:55:22.767673] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:55:22.767986] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-06T20:55:22.768040] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-06T20:55:22.768248] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-06T20:55:22.768324] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-06T20:55:23.030601] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-06T20:55:23.190452] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:55:23.575571] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-06T20:55:23.825507] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-06T20:55:24.047891] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T20:55:24.625549] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-06T20:55:25.194080] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T20:55:25.194965] [INFO ] [REMOTE ] PFO: Full fetch complete (7951 records). [2025-10-06T20:55:25.195037] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-06T20:55:25.437680] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-06T20:55:25.576146] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-06T20:55:25.576276] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-06T20:55:25.576538] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-06T20:55:25.576680] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-06T20:55:25.577467] [DEBUG] [LOCAL ] PFO: Trimmed 7951 records to 6020 (keeping 200 days of data) [2025-10-06T20:55:25.638277] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T20:55:25.663354] [DEBUG] [LOCAL ] PFO: Primary data saved (6020 records). [2025-10-06T20:55:25.663538] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-06T20:55:25.663665] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PFO took 34.0s. Estimated remaining: 1h 38m 36s. Rate: 7.1 symbols/min [2025-10-06T20:55:25.857498] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:55:25.857813] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-06T20:55:25.857872] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-06T20:55:25.857998] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-06T20:55:25.858052] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-06T20:55:25.858146] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-06T20:55:25.858200] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-06T20:55:26.233850] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-06T20:55:26.264324] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:55:26.265874] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-06T20:55:27.025555] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-06T20:55:27.531868] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T20:55:27.825537] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-06T20:55:28.006036] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T20:55:28.521994] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-06T20:55:28.625549] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-06T20:55:29.403632] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T20:55:29.425495] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-06T20:55:30.089149] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-06T20:55:30.225522] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-06T20:55:31.025544] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-06T20:55:31.125920] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T20:55:31.825533] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-06T20:55:31.957677] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-06T20:55:32.625563] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-06T20:55:32.739727] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-06T20:55:33.425599] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-06T20:55:33.475390] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T20:55:34.111142] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-06T20:55:34.225558] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-06T20:55:34.902926] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-06T20:55:35.025554] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-06T20:55:35.825546] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-06T20:55:35.963441] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T20:55:36.576324] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T20:55:36.625548] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-06T20:55:37.425560] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-06T20:55:37.754284] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T20:55:38.092494] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-06T20:55:38.225590] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-06T20:55:39.025488] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-06T20:55:39.078517] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T20:55:39.825532] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-06T20:55:40.350887] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-06T20:55:40.625515] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-06T20:55:40.845399] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T20:55:41.425527] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-06T20:55:42.225543] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-06T20:55:42.576000] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T20:55:43.025578] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-06T20:55:43.179617] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T20:55:43.825534] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-06T20:55:44.213743] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T20:55:44.593323] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-06T20:55:44.625529] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-06T20:55:45.425496] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-06T20:55:45.681596] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T20:55:46.017906] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T20:55:46.019171] [INFO ] [REMOTE ] PGP: Full fetch complete (7886 records). [2025-10-06T20:55:46.019275] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-06T20:55:46.225861] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-06T20:55:46.458805] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (5.03 seconds). [2025-10-06T20:55:46.489382] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-06T20:55:46.489562] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-06T20:55:46.489800] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-06T20:55:46.489889] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-06T20:55:46.490679] [DEBUG] [LOCAL ] PGP: Trimmed 7886 records to 5591 (keeping 200 days of data) [2025-10-06T20:55:46.524024] [DEBUG] [LOCAL ] PGP: Primary data saved (5591 records). [2025-10-06T20:55:46.524135] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-06T20:55:46.524236] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PGP took 24.1s. Estimated remaining: 1h 38m 32s. Rate: 7.1 symbols/min [2025-10-06T20:55:46.691431] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:55:46.735944] [DEBUG] [LOCAL ] PGRE: Loaded 47369 existing records from primary storage. [2025-10-06T20:55:46.736282] [INFO ] [MAIN ] PGRE: Loaded 47369 existing records. [2025-10-06T20:55:46.920616] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:55:46.920916] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-06T20:55:46.920965] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-06T20:55:46.921190] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-06T20:55:46.921247] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-06T20:55:47.030755] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-06T20:55:47.282838] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:55:47.318576] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T20:55:47.825494] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-06T20:55:48.128485] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T20:55:48.625500] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-06T20:55:49.116958] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T20:55:49.288754] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-06T20:55:49.425526] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-06T20:55:50.225580] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-06T20:55:50.872712] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T20:55:51.025575] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-06T20:55:51.199518] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T20:55:51.825580] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-06T20:55:51.983463] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T20:55:51.985450] [INFO ] [REMOTE ] PFSI: Full fetch complete (41146 records). [2025-10-06T20:55:51.985553] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-06T20:55:52.354085] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-10-06T20:55:52.354171] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-10-06T20:55:52.355012] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-10-06T20:55:52.355075] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-10-06T20:55:52.356053] [DEBUG] [LOCAL ] PFSI: Trimmed 41146 records to 28803 (keeping 200 days of data) [2025-10-06T20:55:52.542975] [DEBUG] [LOCAL ] PFSI: Primary data saved (28803 records). [2025-10-06T20:55:52.543138] [INFO ] [MAIN ] PFSI: Full history saved. [2025-10-06T20:55:52.543276] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PFSI took 40.9s. Estimated remaining: 1h 38m 23s. Rate: 7.1 symbols/min [2025-10-06T20:55:52.630827] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-06T20:55:52.721100] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:55:52.731179] [DEBUG] [LOCAL ] PGZ: Loaded 5549 existing records from primary storage. [2025-10-06T20:55:52.731442] [INFO ] [MAIN ] PGZ: Loaded 5549 existing records. [2025-10-06T20:55:52.884194] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T20:55:52.965671] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:55:52.965976] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-06T20:55:52.966032] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-06T20:55:52.966214] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-06T20:55:52.966273] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-06T20:55:53.325033] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:55:53.405918] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T20:55:53.408558] [INFO ] [REMOTE ] PGR: Full fetch complete (76148 records). [2025-10-06T20:55:53.408702] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-06T20:55:53.409522] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:55:53.409624] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:55:53.409762] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:55:53.409854] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-06T20:55:53.409941] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-06T20:55:53.409982] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-06T20:55:53.410022] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-10-06T20:55:53.410079] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PGR took 27.7s. Estimated remaining: 1h 38m 11s. Rate: 7.1 symbols/min [2025-10-06T20:55:53.430671] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-06T20:55:53.579182] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:55:53.617055] [DEBUG] [LOCAL ] PH: Loaded 38442 existing records from primary storage. [2025-10-06T20:55:53.617346] [INFO ] [MAIN ] PH: Loaded 38442 existing records. [2025-10-06T20:55:53.793290] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:55:53.793532] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-06T20:55:53.793585] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-06T20:55:53.793968] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-10-06T20:55:53.794025] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-06T20:55:54.146665] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:55:54.225513] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-06T20:55:54.367669] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-06T20:55:55.012678] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-06T20:55:55.025848] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-06T20:55:55.676635] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T20:55:55.679295] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-10-06T20:55:55.679634] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-06T20:55:55.682314] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:55:55.682524] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:55:55.682595] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:55:55.682757] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-06T20:55:55.682854] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-06T20:55:55.682896] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-06T20:55:55.682938] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-06T20:55:55.683018] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PG took 42.5s. Estimated remaining: 1h 38m 0s. Rate: 7.1 symbols/min [2025-10-06T20:55:55.832525] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-06T20:55:55.870489] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:55:55.887680] [DEBUG] [LOCAL ] PHD: Loaded 10840 existing records from primary storage. [2025-10-06T20:55:55.888054] [INFO ] [MAIN ] PHD: Loaded 10840 existing records. [2025-10-06T20:55:56.069713] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:55:56.070030] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-10-06T20:55:56.070082] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-10-06T20:55:56.070314] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-10-06T20:55:56.070372] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-10-06T20:55:56.438943] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:55:56.625634] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-06T20:55:57.425595] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-10-06T20:55:57.506381] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T20:55:57.567973] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-06T20:55:58.196700] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-06T20:55:58.225533] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-06T20:55:59.025572] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-10-06T20:55:59.307524] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T20:55:59.825490] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-06T20:55:59.949413] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-06T20:56:00.572638] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T20:56:00.625474] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-06T20:56:01.395248] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-06T20:56:01.425533] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-06T20:56:02.163310] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T20:56:02.225623] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-10-06T20:56:03.025510] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-06T20:56:03.109099] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T20:56:03.693055] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-06T20:56:03.825525] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-06T20:56:04.625629] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-10-06T20:56:05.377196] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T20:56:05.431239] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-06T20:56:05.433031] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T20:56:06.225549] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-06T20:56:06.303259] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-06T20:56:06.898059] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T20:56:07.025704] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-06T20:56:07.825532] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-06T20:56:08.517541] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T20:56:08.531302] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-06T20:56:08.625675] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-06T20:56:09.425609] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-06T20:56:10.085287] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T20:56:10.210239] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T20:56:10.225470] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-06T20:56:11.025594] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-06T20:56:11.185592] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T20:56:11.771346] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-06T20:56:11.825765] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-10-06T20:56:12.625512] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-06T20:56:12.816149] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T20:56:13.432703] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-06T20:56:13.437996] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T20:56:14.225536] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-10-06T20:56:15.025514] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-06T20:56:15.079484] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T20:56:15.121972] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T20:56:15.825513] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-06T20:56:15.899705] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-06T20:56:16.625546] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-06T20:56:17.425532] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-10-06T20:56:17.487464] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-06T20:56:17.725203] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-06T20:56:17.951557] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-06T20:56:18.225606] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-06T20:56:19.025634] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-06T20:56:19.761768] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T20:56:19.759710] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T20:56:19.825553] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-06T20:56:20.625587] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-06T20:56:21.101447] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T20:56:21.102420] [INFO ] [REMOTE ] PGZ: Full fetch complete (8966 records). [2025-10-06T20:56:21.102507] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-06T20:56:21.425734] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-10-06T20:56:21.547636] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T20:56:21.606028] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-06T20:56:21.606145] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-06T20:56:21.607138] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-06T20:56:21.607211] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-06T20:56:21.607837] [DEBUG] [LOCAL ] PGZ: Trimmed 8966 records to 5468 (keeping 200 days of data) [2025-10-06T20:56:21.646319] [DEBUG] [LOCAL ] PGZ: Primary data saved (5468 records). [2025-10-06T20:56:21.646438] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-06T20:56:21.646576] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGZ took 29.1s. Estimated remaining: 1h 37m 59s. Rate: 7.1 symbols/min [2025-10-06T20:56:21.875515] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:56:21.927407] [DEBUG] [LOCAL ] PHG: Loaded 46644 existing records from primary storage. [2025-10-06T20:56:21.927840] [INFO ] [MAIN ] PHG: Loaded 46644 existing records. [2025-10-06T20:56:22.108776] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:56:22.108998] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-06T20:56:22.109045] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-06T20:56:22.109422] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-10-06T20:56:22.109478] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-06T20:56:22.227202] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-06T20:56:22.466609] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T20:56:22.512702] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:56:23.025573] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-06T20:56:23.825549] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-10-06T20:56:23.908771] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T20:56:24.625522] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-06T20:56:24.706080] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T20:56:24.763309] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T20:56:25.425542] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-06T20:56:26.225508] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-06T20:56:26.425443] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T20:56:27.025554] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-06T20:56:27.091325] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T20:56:27.152550] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T20:56:27.825551] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-06T20:56:28.625594] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-10-06T20:56:28.754289] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T20:56:29.425557] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-06T20:56:29.504755] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T20:56:29.687371] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T20:56:30.225543] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-06T20:56:30.786188] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T20:56:30.789220] [INFO ] [REMOTE ] PGRE: Full fetch complete (64089 records). [2025-10-06T20:56:30.789398] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-06T20:56:31.035287] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-10. [2025-10-06T20:56:31.208812] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-06T20:56:31.208992] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-06T20:56:31.210194] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-06T20:56:31.210361] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-06T20:56:31.231811] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T20:56:31.231953] [DEBUG] [LOCAL ] PGRE: Trimmed 64089 records to 46751 (keeping 200 days of data) [2025-10-06T20:56:31.533368] [DEBUG] [LOCAL ] PGRE: Primary data saved (46751 records). [2025-10-06T20:56:31.533561] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-06T20:56:31.533684] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGRE took 45.0s. Estimated remaining: 1h 37m 51s. Rate: 7.1 symbols/min [2025-10-06T20:56:31.825504] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-06T20:56:31.971262] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T20:56:31.972818] [INFO ] [REMOTE ] PHD: Full fetch complete (14990 records). [2025-10-06T20:56:31.972893] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-10-06T20:56:32.361984] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-10-06T20:56:32.362064] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-10-06T20:56:32.362400] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-10-06T20:56:32.362439] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-10-06T20:56:32.362982] [DEBUG] [LOCAL ] PHD: Trimmed 14990 records to 10767 (keeping 200 days of data) [2025-10-06T20:56:32.427380] [DEBUG] [LOCAL ] PHD: Primary data saved (10767 records). [2025-10-06T20:56:32.427524] [INFO ] [MAIN ] PHD: Full history saved. [2025-10-06T20:56:32.427608] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PHD took 36.7s. Estimated remaining: 1h 37m 40s. Rate: 7.1 symbols/min [2025-10-06T20:56:32.625608] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-06T20:56:33.205214] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-06T20:56:33.207499] [INFO ] [REMOTE ] PH: Full fetch complete (55912 records). [2025-10-06T20:56:33.207687] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-06T20:56:33.208859] [FATAL] [VALIDATOR ] PH: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:56:33.208973] [FATAL] [MAIN ] PH: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:56:33.209040] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:56:33.209136] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-06T20:56:33.209249] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-06T20:56:33.209315] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-06T20:56:33.209669] [DEBUG] [LOCAL ] PH: Deleted derivative data file. [2025-10-06T20:56:33.209794] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PH took 39.8s. Estimated remaining: 1h 37m 28s. Rate: 7.1 symbols/min [2025-10-06T20:56:33.623551] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T20:56:33.636062] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-06T20:56:35.375595] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T20:56:35.386076] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-06T20:56:36.854798] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T20:56:36.865096] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-06T20:56:38.495965] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T20:56:38.508814] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-06T20:56:40.350596] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T20:56:40.362770] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-06T20:56:42.150894] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T20:56:42.160605] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-06T20:56:43.823222] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T20:56:43.832969] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-06T20:56:44.952955] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-06T20:56:44.955793] [INFO ] [REMOTE ] PHG: Full fetch complete (65669 records). [2025-10-06T20:56:44.955927] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-06T20:56:45.389421] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-10-06T20:56:45.389526] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-10-06T20:56:45.390570] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-10-06T20:56:45.390634] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-10-06T20:56:45.392000] [DEBUG] [LOCAL ] PHG: Trimmed 65669 records to 45936 (keeping 200 days of data) [2025-10-06T20:56:45.669217] [DEBUG] [LOCAL ] PHG: Primary data saved (45936 records). [2025-10-06T20:56:45.669360] [INFO ] [MAIN ] PHG: Full history saved. [2025-10-06T20:56:45.669443] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PHG took 24.0s. Estimated remaining: 1h 37m 21s. Rate: 7.1 symbols/min [2025-10-06T20:56:46.286942] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:56:46.291585] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:56:46.439231] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:56:46.458774] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:56:46.459637] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-06T20:56:46.459751] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-06T20:56:46.459987] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-06T20:56:46.460035] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-06T20:56:46.460079] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-06T20:56:46.460112] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-06T20:56:46.547055] [DEBUG] [LOCAL ] PHI: Loaded 15378 existing records from primary storage. [2025-10-06T20:56:46.568882] [INFO ] [MAIN ] PHI: Loaded 15378 existing records. [2025-10-06T20:56:46.788781] [DEBUG] [LOCAL ] PHK: Loaded 26746 existing records from primary storage. [2025-10-06T20:56:46.793877] [DEBUG] [LOCAL ] PHIN: Loaded 33036 existing records from primary storage. [2025-10-06T20:56:46.794751] [INFO ] [MAIN ] PHK: Loaded 26746 existing records. [2025-10-06T20:56:46.825018] [INFO ] [MAIN ] PHIN: Loaded 33036 existing records. [2025-10-06T20:56:47.121433] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:56:47.161395] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-06T20:56:47.208066] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-06T20:56:47.234344] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-06T20:56:47.277075] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-06T20:56:47.609827] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:56:47.619777] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-06T20:56:47.647463] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:56:47.669740] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:56:47.665281] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-06T20:56:47.665357] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-06T20:56:47.692580] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-06T20:56:47.696944] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-06T20:56:47.695837] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-10-06T20:56:47.707795] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-06T20:56:47.736602] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-06T20:56:47.771970] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-06T20:56:48.346605] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:56:48.349051] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-06T20:56:48.757574] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:56:48.768327] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-06T20:56:48.844824] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:56:48.845266] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-06T20:56:49.525102] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T20:56:49.529426] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-06T20:56:49.670393] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-06T20:56:49.680937] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-06T20:56:49.773906] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-06T20:56:49.779857] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-06T20:56:50.161721] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-06T20:56:50.166259] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-06T20:56:50.457424] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T20:56:50.465208] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-06T20:56:50.698195] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T20:56:50.708958] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-06T20:56:50.865274] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T20:56:50.872419] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-06T20:56:51.143353] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T20:56:51.146526] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-06T20:56:51.300286] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-06T20:56:51.315120] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-06T20:56:51.509446] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T20:56:51.516444] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-06T20:56:52.071483] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T20:56:52.077272] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-06T20:56:52.219945] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T20:56:52.224358] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-06T20:56:52.421329] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T20:56:52.432462] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-06T20:56:52.547831] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T20:56:52.625483] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-06T20:56:53.079110] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T20:56:53.263097] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-06T20:56:53.291861] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T20:56:53.425590] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-06T20:56:54.225508] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-06T20:56:54.325994] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T20:56:54.519697] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T20:56:55.025507] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-06T20:56:55.666322] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T20:56:55.825547] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-06T20:56:56.625558] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-06T20:56:56.657884] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T20:56:56.968437] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T20:56:57.425486] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-06T20:56:57.544314] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-06T20:56:58.225536] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-06T20:56:58.379405] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T20:56:59.025504] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-06T20:56:59.195609] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T20:56:59.825489] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-06T20:57:00.041263] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T20:57:00.625544] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-06T20:57:01.194176] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T20:57:01.346079] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-06T20:57:01.425512] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-06T20:57:02.225536] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-06T20:57:02.497948] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T20:57:03.025556] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-06T20:57:03.535389] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T20:57:03.825538] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-06T20:57:04.017699] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T20:57:04.625508] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-06T20:57:04.809093] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T20:57:05.425634] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-06T20:57:05.900163] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-06T20:57:06.055826] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T20:57:06.058355] [INFO ] [REMOTE ] PHM: Full fetch complete (74553 records). [2025-10-06T20:57:06.058479] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-06T20:57:06.059345] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:57:06.059439] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:57:06.059481] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:57:06.059520] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-06T20:57:06.059594] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-06T20:57:06.059629] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-06T20:57:06.059715] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-06T20:57:06.059782] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHM took 20.4s. Estimated remaining: 1h 37m 18s. Rate: 7.1 symbols/min [2025-10-06T20:57:06.232408] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-06T20:57:06.232323] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:57:06.271592] [DEBUG] [LOCAL ] PHR: Loaded 37977 existing records from primary storage. [2025-10-06T20:57:06.271951] [INFO ] [MAIN ] PHR: Loaded 37977 existing records. [2025-10-06T20:57:06.459727] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:57:06.460279] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-06T20:57:06.460339] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-06T20:57:06.460883] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-10-06T20:57:06.460960] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-06T20:57:06.827780] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:57:07.025543] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-06T20:57:07.594145] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T20:57:07.825532] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-06T20:57:08.534129] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T20:57:08.625545] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-06T20:57:09.232215] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T20:57:09.425516] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-06T20:57:09.767563] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T20:57:10.225530] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-06T20:57:10.872173] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T20:57:11.025571] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-06T20:57:11.670470] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T20:57:11.825547] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-06T20:57:12.543150] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T20:57:12.625547] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-06T20:57:13.143681] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T20:57:13.425506] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-06T20:57:13.444066] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T20:57:14.225587] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-06T20:57:14.312601] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-06T20:57:14.315358] [INFO ] [REMOTE ] PHIN: Full fetch complete (48050 records). [2025-10-06T20:57:14.315478] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-06T20:57:14.744183] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-10-06T20:57:14.744304] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-10-06T20:57:14.745184] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-10-06T20:57:14.745251] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-10-06T20:57:14.746278] [DEBUG] [LOCAL ] PHIN: Trimmed 48050 records to 32374 (keeping 200 days of data) [2025-10-06T20:57:14.945253] [DEBUG] [LOCAL ] PHIN: Primary data saved (32374 records). [2025-10-06T20:57:14.945408] [INFO ] [MAIN ] PHIN: Full history saved. [2025-10-06T20:57:14.945498] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHIN took 29.3s. Estimated remaining: 1h 37m 9s. Rate: 7.1 symbols/min [2025-10-06T20:57:15.033127] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-06T20:57:15.137344] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:57:15.181404] [DEBUG] [LOCAL ] PII: Loaded 49663 existing records from primary storage. [2025-10-06T20:57:15.181775] [INFO ] [MAIN ] PII: Loaded 49663 existing records. [2025-10-06T20:57:15.375167] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:57:15.375477] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-06T20:57:15.375544] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-06T20:57:15.375891] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-10-06T20:57:15.375960] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-06T20:57:15.731030] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T20:57:15.751368] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:57:15.825560] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-06T20:57:16.129914] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T20:57:16.131936] [INFO ] [REMOTE ] PHK: Full fetch complete (39536 records). [2025-10-06T20:57:16.132057] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-06T20:57:16.509087] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-06T20:57:16.509180] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-06T20:57:16.509982] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-06T20:57:16.510050] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-06T20:57:16.511100] [DEBUG] [LOCAL ] PHK: Trimmed 39536 records to 26508 (keeping 200 days of data) [2025-10-06T20:57:16.625689] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-06T20:57:16.680001] [DEBUG] [LOCAL ] PHK: Primary data saved (26508 records). [2025-10-06T20:57:16.680155] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-06T20:57:16.680261] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHK took 31.0s. Estimated remaining: 1h 36m 58s. Rate: 7.1 symbols/min [2025-10-06T20:57:16.790604] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T20:57:16.814722] [INFO ] [REMOTE ] PHI: Full fetch complete (21062 records). [2025-10-06T20:57:16.834019] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-06T20:57:16.905923] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:57:17.033295] [DEBUG] [LOCAL ] PIM: Loaded 4831 existing records from primary storage. [2025-10-06T20:57:17.039947] [INFO ] [MAIN ] PIM: Loaded 4831 existing records. [2025-10-06T20:57:17.416707] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:57:17.442284] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-06T20:57:17.442148] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-06T20:57:17.450783] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-06T20:57:17.482719] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-06T20:57:17.482819] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-06T20:57:17.483339] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-06T20:57:17.483436] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-06T20:57:17.483509] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-06T20:57:17.483784] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-06T20:57:17.558904] [DEBUG] [LOCAL ] PHI: Trimmed 21062 records to 15090 (keeping 200 days of data) [2025-10-06T20:57:17.953251] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:57:17.966565] [DEBUG] [LOCAL ] PHI: Primary data saved (15090 records). [2025-10-06T20:57:17.966855] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-06T20:57:17.966978] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHI took 32.3s. Estimated remaining: 1h 36m 47s. Rate: 7.1 symbols/min [2025-10-06T20:57:18.156980] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:57:18.181054] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T20:57:18.204461] [DEBUG] [LOCAL ] PINE: Loaded 14278 existing records from primary storage. [2025-10-06T20:57:18.204868] [INFO ] [MAIN ] PINE: Loaded 14278 existing records. [2025-10-06T20:57:18.235863] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-06T20:57:18.403185] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:57:18.403523] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-06T20:57:18.403578] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-06T20:57:18.403917] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-06T20:57:18.403976] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-06T20:57:18.761362] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:57:19.025720] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-06T20:57:19.297558] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T20:57:19.802186] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T20:57:19.828592] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-06T20:57:19.831204] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T20:57:20.625588] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-06T20:57:21.193607] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T20:57:21.425540] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-06T20:57:22.225491] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-06T20:57:22.482830] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T20:57:22.649095] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T20:57:23.025605] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-06T20:57:23.415785] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T20:57:23.825541] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-06T20:57:24.500998] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-06T20:57:24.625495] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-06T20:57:24.732752] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T20:57:25.425579] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-06T20:57:26.036910] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T20:57:26.225562] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-06T20:57:26.503259] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T20:57:27.025544] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-06T20:57:27.825491] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-06T20:57:27.972807] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-06T20:57:28.094933] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T20:57:28.571613] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T20:57:28.625541] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-06T20:57:29.425591] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-06T20:57:30.213299] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T20:57:30.225457] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-06T20:57:30.533232] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T20:57:31.025716] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-06T20:57:31.725003] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-06T20:57:31.825471] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-06T20:57:32.051020] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T20:57:32.320354] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-06T20:57:32.625566] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-06T20:57:33.425551] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-06T20:57:34.103714] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-06T20:57:34.225530] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-06T20:57:34.288488] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T20:57:35.025541] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-06T20:57:35.825499] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-06T20:57:36.031459] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-06T20:57:36.625614] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-06T20:57:36.736596] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-06T20:57:36.771090] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T20:57:37.425505] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-06T20:57:38.225518] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-06T20:57:38.498035] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-06T20:57:38.878810] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T20:57:38.881567] [INFO ] [REMOTE ] PHR: Full fetch complete (52620 records). [2025-10-06T20:57:38.881726] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-06T20:57:39.033249] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-06T20:57:39.232360] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-06T20:57:39.311494] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-10-06T20:57:39.311603] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-10-06T20:57:39.312583] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-10-06T20:57:39.312671] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-10-06T20:57:39.314094] [DEBUG] [LOCAL ] PHR: Trimmed 52620 records to 37515 (keeping 200 days of data) [2025-10-06T20:57:39.540010] [DEBUG] [LOCAL ] PHR: Primary data saved (37515 records). [2025-10-06T20:57:39.540181] [INFO ] [MAIN ] PHR: Full history saved. [2025-10-06T20:57:39.540269] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PHR took 33.5s. Estimated remaining: 1h 36m 44s. Rate: 7.1 symbols/min [2025-10-06T20:57:39.708594] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:57:39.766354] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-10-06T20:57:39.766716] [INFO ] [MAIN ] PINS: Loaded 54473 existing records. [2025-10-06T20:57:39.833486] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-06T20:57:39.955991] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:57:39.956263] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-06T20:57:39.956320] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-06T20:57:39.957237] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-10-06T20:57:39.957298] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-06T20:57:40.308716] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:57:40.561392] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T20:57:40.625553] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-06T20:57:40.794325] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T20:57:41.425542] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-06T20:57:42.225598] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-06T20:57:42.748424] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-06T20:57:42.833915] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-06T20:57:43.027510] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-06T20:57:43.030573] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-06T20:57:43.825691] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-06T20:57:44.477302] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-06T20:57:44.625533] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-06T20:57:45.110637] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-06T20:57:45.425588] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-06T20:57:45.753348] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T20:57:46.225600] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-06T20:57:47.002279] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T20:57:47.025560] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-06T20:57:47.431822] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-06T20:57:47.825492] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-06T20:57:48.014321] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-06T20:57:48.625690] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-06T20:57:48.637172] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-06T20:57:49.425553] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-06T20:57:49.603802] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T20:57:50.225607] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-06T20:57:50.596941] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T20:57:50.599738] [INFO ] [REMOTE ] PII: Full fetch complete (71193 records). [2025-10-06T20:57:50.599850] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-06T20:57:50.993894] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-10-06T20:57:50.994012] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-10-06T20:57:50.995060] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-10-06T20:57:50.995136] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-10-06T20:57:50.996517] [DEBUG] [LOCAL ] PII: Trimmed 71193 records to 48885 (keeping 200 days of data) [2025-10-06T20:57:51.049935] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-06T20:57:51.064091] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T20:57:51.092329] [INFO ] [REMOTE ] PINE: Full fetch complete (21083 records). [2025-10-06T20:57:51.092932] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-06T20:57:51.483924] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-06T20:57:51.484768] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-06T20:57:51.485263] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-06T20:57:51.485570] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-06T20:57:51.487707] [DEBUG] [LOCAL ] PINE: Trimmed 21083 records to 14143 (keeping 200 days of data) [2025-10-06T20:57:51.684987] [DEBUG] [LOCAL ] PINE: Primary data saved (14143 records). [2025-10-06T20:57:51.685704] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-06T20:57:51.686160] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PINE took 33.7s. Estimated remaining: 1h 36m 37s. Rate: 7.1 symbols/min [2025-10-06T20:57:51.704760] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T20:57:51.743056] [INFO ] [REMOTE ] PIM: Full fetch complete (6514 records). [2025-10-06T20:57:51.776307] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-06T20:57:51.827445] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-06T20:57:52.031385] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:57:52.201814] [DEBUG] [LOCAL ] PIPR: Loaded 14998 existing records from primary storage. [2025-10-06T20:57:52.216296] [INFO ] [MAIN ] PIPR: Loaded 14998 existing records. [2025-10-06T20:57:52.491358] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-06T20:57:52.512016] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-06T20:57:52.518504] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-06T20:57:52.551073] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:57:52.552263] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-06T20:57:52.553834] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-06T20:57:52.554786] [DEBUG] [LOCAL ] PIM: Trimmed 6514 records to 4804 (keeping 200 days of data) [2025-10-06T20:57:52.554677] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-06T20:57:52.559357] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-10-06T20:57:52.573089] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-06T20:57:52.650760] [DEBUG] [LOCAL ] PII: Primary data saved (48885 records). [2025-10-06T20:57:52.663337] [INFO ] [MAIN ] PII: Full history saved. [2025-10-06T20:57:52.663767] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PII took 37.7s. Estimated remaining: 1h 36m 25s. Rate: 7.1 symbols/min [2025-10-06T20:57:53.007408] [DEBUG] [LOCAL ] PIM: Primary data saved (4804 records). [2025-10-06T20:57:53.007332] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:57:53.037496] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-06T20:57:53.051536] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PIM took 36.4s. Estimated remaining: 1h 36m 14s. Rate: 7.1 symbols/min [2025-10-06T20:57:53.360536] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:57:53.315330] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:57:53.360923] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-06T20:57:53.357941] [DEBUG] [LOCAL ] PJT: Loaded 21887 existing records from primary storage. [2025-10-06T20:57:53.362502] [INFO ] [MAIN ] PJT: Loaded 21887 existing records. [2025-10-06T20:57:53.584212] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:57:53.605996] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-06T20:57:53.606052] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-06T20:57:53.606788] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-10-06T20:57:53.606846] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-06T20:57:53.755122] [DEBUG] [LOCAL ] PK: Loaded 53584 existing records from primary storage. [2025-10-06T20:57:53.796180] [INFO ] [MAIN ] PK: Loaded 53584 existing records. [2025-10-06T20:57:54.226484] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:57:54.227328] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T20:57:54.218819] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:57:54.227889] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-06T20:57:54.229494] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-06T20:57:54.229603] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-06T20:57:54.233452] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-06T20:57:54.233676] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-10-06T20:57:54.233873] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-06T20:57:54.551932] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-06T20:57:54.672629] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:57:55.025548] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-06T20:57:55.322770] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T20:57:55.454325] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T20:57:55.825584] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-06T20:57:56.625582] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-06T20:57:56.957985] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T20:57:57.197066] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-06T20:57:57.425548] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-06T20:57:57.763138] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T20:57:58.191204] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-06T20:57:58.225502] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-06T20:57:59.025607] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-06T20:57:59.381576] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T20:57:59.825539] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-06T20:58:00.625565] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-06T20:58:00.881916] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T20:58:01.158749] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-06T20:58:01.425563] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-06T20:58:01.635606] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T20:58:02.225604] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-06T20:58:03.025577] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-06T20:58:03.756071] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-06T20:58:03.757615] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T20:58:03.825512] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-06T20:58:04.625593] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-06T20:58:04.820627] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T20:58:05.425531] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-06T20:58:05.734911] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T20:58:05.842096] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-06T20:58:06.225613] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-06T20:58:06.553981] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T20:58:07.025615] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-06T20:58:07.831377] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-06T20:58:07.836824] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T20:58:08.625479] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-06T20:58:09.048037] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T20:58:09.136534] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-06T20:58:09.425610] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-06T20:58:09.676245] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T20:58:10.225606] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-06T20:58:11.025616] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-06T20:58:11.175372] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T20:58:11.367462] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-06T20:58:11.825539] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-06T20:58:12.088782] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T20:58:12.625565] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-06T20:58:13.425617] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-06T20:58:13.517058] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-06T20:58:13.624402] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T20:58:14.225535] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-06T20:58:14.612523] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T20:58:15.025596] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-06T20:58:15.825500] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-06T20:58:16.177679] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-06T20:58:16.201898] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-06T20:58:16.602143] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T20:58:16.603376] [INFO ] [REMOTE ] PIPR: Full fetch complete (20578 records). [2025-10-06T20:58:16.603470] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-06T20:58:16.633672] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-06T20:58:16.981265] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-10-06T20:58:16.981359] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-10-06T20:58:16.981862] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-10-06T20:58:16.981926] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-10-06T20:58:16.982539] [DEBUG] [LOCAL ] PIPR: Trimmed 20578 records to 14899 (keeping 200 days of data) [2025-10-06T20:58:17.083360] [DEBUG] [LOCAL ] PIPR: Primary data saved (14899 records). [2025-10-06T20:58:17.083514] [INFO ] [MAIN ] PIPR: Full history saved. [2025-10-06T20:58:17.083614] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PIPR took 25.4s. Estimated remaining: 1h 36m 11s. Rate: 7.1 symbols/min [2025-10-06T20:58:17.260501] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:58:17.275814] [DEBUG] [LOCAL ] PKE: Loaded 13281 existing records from primary storage. [2025-10-06T20:58:17.276060] [INFO ] [MAIN ] PKE: Loaded 13281 existing records. [2025-10-06T20:58:17.430715] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-06T20:58:17.463008] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:58:17.463265] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-06T20:58:17.463314] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-06T20:58:17.463512] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-06T20:58:17.463570] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-06T20:58:17.818597] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-06T20:58:17.862900] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:58:18.225616] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-06T20:58:19.025511] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-06T20:58:19.196889] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T20:58:19.294863] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-06T20:58:19.825506] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-06T20:58:20.625556] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-06T20:58:21.215769] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-06T20:58:21.425484] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-06T20:58:21.464791] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T20:58:21.466388] [INFO ] [REMOTE ] PJT: Full fetch complete (32044 records). [2025-10-06T20:58:21.466466] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-06T20:58:21.853895] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-10-06T20:58:21.854115] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-10-06T20:58:21.854982] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-10-06T20:58:21.855109] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-10-06T20:58:21.884087] [DEBUG] [LOCAL ] PJT: Trimmed 32044 records to 21570 (keeping 200 days of data) [2025-10-06T20:58:21.886537] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-06T20:58:22.031545] [DEBUG] [LOCAL ] PJT: Primary data saved (21570 records). [2025-10-06T20:58:22.031715] [INFO ] [MAIN ] PJT: Full history saved. [2025-10-06T20:58:22.031815] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PJT took 29.4s. Estimated remaining: 1h 36m 1s. Rate: 7.1 symbols/min [2025-10-06T20:58:22.202049] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:58:22.202283] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-06T20:58:22.202332] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-06T20:58:22.202442] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-06T20:58:22.202487] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-06T20:58:22.202532] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-06T20:58:22.202592] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-06T20:58:22.233121] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-06T20:58:22.575794] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:58:23.025491] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-06T20:58:23.342770] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-06T20:58:23.825512] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-06T20:58:23.964188] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-06T20:58:24.202635] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-06T20:58:24.625536] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-06T20:58:25.287394] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T20:58:25.290555] [INFO ] [REMOTE ] PINS: Full fetch complete (77740 records). [2025-10-06T20:58:25.290744] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-06T20:58:25.431868] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-06T20:58:25.680565] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-10-06T20:58:25.680696] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-10-06T20:58:25.681842] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-10-06T20:58:25.681971] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-10-06T20:58:25.683536] [DEBUG] [LOCAL ] PINS: Trimmed 77740 records to 53693 (keeping 200 days of data) [2025-10-06T20:58:26.012138] [DEBUG] [LOCAL ] PINS: Primary data saved (53693 records). [2025-10-06T20:58:26.012327] [INFO ] [MAIN ] PINS: Full history saved. [2025-10-06T20:58:26.013231] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PINS took 46.5s. Estimated remaining: 1h 35m 51s. Rate: 7.1 symbols/min [2025-10-06T20:58:26.235559] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-06T20:58:26.236933] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:58:26.263369] [DEBUG] [LOCAL ] PKST: Loaded 19053 existing records from primary storage. [2025-10-06T20:58:26.263764] [INFO ] [MAIN ] PKST: Loaded 19053 existing records. [2025-10-06T20:58:26.370179] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T20:58:26.507473] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:58:26.507957] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-06T20:58:26.508083] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-06T20:58:26.508531] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-10-06T20:58:26.508700] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-06T20:58:26.659217] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-06T20:58:26.931136] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:58:27.025552] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-06T20:58:27.831444] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-06T20:58:27.836519] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T20:58:28.410383] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T20:58:28.413441] [INFO ] [REMOTE ] PK: Full fetch complete (76369 records). [2025-10-06T20:58:28.413568] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-06T20:58:28.633056] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-06T20:58:28.829361] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-10-06T20:58:28.829451] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-10-06T20:58:28.830577] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-10-06T20:58:28.830666] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-10-06T20:58:28.832194] [DEBUG] [LOCAL ] PK: Trimmed 76369 records to 52805 (keeping 200 days of data) [2025-10-06T20:58:29.076090] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T20:58:29.182492] [DEBUG] [LOCAL ] PK: Primary data saved (52805 records). [2025-10-06T20:58:29.182667] [INFO ] [MAIN ] PK: Full history saved. [2025-10-06T20:58:29.182775] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PK took 36.1s. Estimated remaining: 1h 35m 41s. Rate: 7.1 symbols/min [2025-10-06T20:58:29.353998] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:58:29.387204] [DEBUG] [LOCAL ] PKX: Loaded 24566 existing records from primary storage. [2025-10-06T20:58:29.393757] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T20:58:29.393480] [INFO ] [MAIN ] PKX: Loaded 24566 existing records. [2025-10-06T20:58:29.430626] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-06T20:58:29.582083] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:58:29.582307] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-06T20:58:29.582367] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-06T20:58:29.582696] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-10-06T20:58:29.582774] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-06T20:58:29.950736] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:58:30.225526] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-06T20:58:30.437200] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T20:58:30.809090] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-06T20:58:31.025530] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-06T20:58:31.825553] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-06T20:58:31.926206] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T20:58:32.632482] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-06T20:58:32.649408] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-06T20:58:33.425589] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-06T20:58:33.626621] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-06T20:58:34.225540] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-06T20:58:34.479237] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T20:58:35.025550] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-06T20:58:35.102802] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T20:58:35.825499] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-06T20:58:35.928922] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T20:58:36.625525] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-06T20:58:37.081394] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T20:58:37.425534] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-06T20:58:37.810986] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T20:58:38.225505] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-06T20:58:38.401450] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T20:58:39.025518] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-06T20:58:39.368780] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T20:58:39.825563] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-06T20:58:39.900676] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T20:58:40.625596] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-06T20:58:40.954343] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T20:58:41.425627] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-06T20:58:41.854779] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T20:58:42.225504] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-06T20:58:42.333854] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-06T20:58:43.025550] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-06T20:58:43.481668] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T20:58:43.825581] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-06T20:58:44.161372] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T20:58:44.625529] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-06T20:58:44.702928] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-06T20:58:44.705983] [INFO ] [REMOTE ] PKE: Full fetch complete (17478 records). [2025-10-06T20:58:44.706169] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-06T20:58:45.103848] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-06T20:58:45.103954] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-06T20:58:45.104425] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-06T20:58:45.104490] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-06T20:58:45.105285] [DEBUG] [LOCAL ] PKE: Trimmed 17478 records to 13242 (keeping 200 days of data) [2025-10-06T20:58:45.191820] [DEBUG] [LOCAL ] PKE: Primary data saved (13242 records). [2025-10-06T20:58:45.191984] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-06T20:58:45.192098] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PKE took 28.1s. Estimated remaining: 1h 35m 35s. Rate: 7.1 symbols/min [2025-10-06T20:58:45.368402] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:58:45.422236] [DEBUG] [LOCAL ] PL: Loaded 53911 existing records from primary storage. [2025-10-06T20:58:45.422566] [INFO ] [MAIN ] PL: Loaded 53911 existing records. [2025-10-06T20:58:45.434215] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-06T20:58:45.608455] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:58:45.608981] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-06T20:58:45.609195] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-06T20:58:45.609625] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-10-06T20:58:45.609717] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-06T20:58:45.883940] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T20:58:45.999240] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:58:46.225522] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-06T20:58:46.450800] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T20:58:47.025570] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-06T20:58:47.825545] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-06T20:58:48.064253] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T20:58:48.573250] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-06T20:58:48.625470] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-06T20:58:48.740535] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-06T20:58:49.425528] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-06T20:58:50.225524] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-06T20:58:50.488438] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T20:58:50.518468] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-06T20:58:50.521125] [INFO ] [REMOTE ] PKG: Full fetch complete (57489 records). [2025-10-06T20:58:50.521593] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-06T20:58:50.523446] [FATAL] [VALIDATOR ] PKG: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:58:50.523782] [FATAL] [MAIN ] PKG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:58:50.523864] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:58:50.523951] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-06T20:58:50.524077] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-06T20:58:50.524121] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-06T20:58:50.524163] [DEBUG] [LOCAL ] PKG: No derivative data file found to delete. [2025-10-06T20:58:50.524263] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PKG took 28.5s. Estimated remaining: 1h 35m 25s. Rate: 7.1 symbols/min [2025-10-06T20:58:50.710091] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:58:50.766269] [DEBUG] [LOCAL ] PLD: Loaded 54213 existing records from primary storage. [2025-10-06T20:58:50.766709] [INFO ] [MAIN ] PLD: Loaded 54213 existing records. [2025-10-06T20:58:50.955696] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:58:50.956186] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-06T20:58:50.956381] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-06T20:58:50.956753] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-10-06T20:58:50.956879] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-06T20:58:51.030956] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-06T20:58:51.186082] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-06T20:58:51.389901] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:58:51.825552] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-06T20:58:52.618394] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T20:58:52.626259] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-06T20:58:53.425501] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-06T20:58:53.700810] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T20:58:53.957682] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-06T20:58:54.225538] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-06T20:58:54.937368] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T20:58:55.025580] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-06T20:58:55.649430] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T20:58:55.825512] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-06T20:58:56.468271] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T20:58:56.625529] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-06T20:58:56.683720] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T20:58:57.409294] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T20:58:57.425476] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-06T20:58:58.225559] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-06T20:58:58.640936] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T20:58:59.025542] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-06T20:58:59.333079] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T20:58:59.825544] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-06T20:59:00.162495] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-06T20:59:00.373718] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-06T20:59:00.625537] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-06T20:59:01.425581] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-06T20:59:01.445555] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T20:59:01.448448] [INFO ] [REMOTE ] PKST: Full fetch complete (29490 records). [2025-10-06T20:59:01.448598] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-06T20:59:01.848998] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-10-06T20:59:01.849104] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-10-06T20:59:01.850090] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-10-06T20:59:01.850157] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-10-06T20:59:01.851183] [DEBUG] [LOCAL ] PKST: Trimmed 29490 records to 18746 (keeping 200 days of data) [2025-10-06T20:59:01.969870] [DEBUG] [LOCAL ] PKST: Primary data saved (18746 records). [2025-10-06T20:59:01.970074] [INFO ] [MAIN ] PKST: Full history saved. [2025-10-06T20:59:01.970179] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKST took 36.0s. Estimated remaining: 1h 35m 18s. Rate: 7.1 symbols/min [2025-10-06T20:59:02.148187] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:59:02.203919] [DEBUG] [LOCAL ] PLNT: Loaded 48933 existing records from primary storage. [2025-10-06T20:59:02.204413] [INFO ] [MAIN ] PLNT: Loaded 48933 existing records. [2025-10-06T20:59:02.234197] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-06T20:59:02.413158] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:59:02.413433] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-06T20:59:02.413482] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-06T20:59:02.414096] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-10-06T20:59:02.414156] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-06T20:59:02.748006] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T20:59:02.816271] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:59:03.025517] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-06T20:59:03.825567] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-06T20:59:04.371177] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-06T20:59:04.625624] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-06T20:59:04.747577] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T20:59:04.805821] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T20:59:05.425811] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-06T20:59:05.787444] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T20:59:06.225590] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-06T20:59:07.025611] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-06T20:59:07.163591] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T20:59:07.825531] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-06T20:59:07.953605] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T20:59:08.522508] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-06T20:59:08.625593] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-06T20:59:09.425565] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-06T20:59:09.591783] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T20:59:09.789584] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-06T20:59:10.225557] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-06T20:59:10.453783] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T20:59:11.025534] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-06T20:59:11.615140] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T20:59:11.825535] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-06T20:59:12.625555] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-06T20:59:13.109450] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-06T20:59:13.425581] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-06T20:59:13.624238] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T20:59:13.626477] [INFO ] [REMOTE ] PKX: Full fetch complete (36699 records). [2025-10-06T20:59:13.626922] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-06T20:59:13.796434] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-06T20:59:14.075320] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-10-06T20:59:14.075455] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-10-06T20:59:14.076432] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-10-06T20:59:14.076498] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-10-06T20:59:14.077785] [DEBUG] [LOCAL ] PKX: Trimmed 36699 records to 24067 (keeping 200 days of data) [2025-10-06T20:59:14.221269] [DEBUG] [LOCAL ] PKX: Primary data saved (24067 records). [2025-10-06T20:59:14.221407] [INFO ] [MAIN ] PKX: Full history saved. [2025-10-06T20:59:14.221487] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PKX took 45.0s. Estimated remaining: 1h 35m 11s. Rate: 7.1 symbols/min [2025-10-06T20:59:14.233155] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-06T20:59:14.396896] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:59:14.417381] [DEBUG] [LOCAL ] PLOW: Loaded 20552 existing records from primary storage. [2025-10-06T20:59:14.417623] [INFO ] [MAIN ] PLOW: Loaded 20552 existing records. [2025-10-06T20:59:14.592896] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:59:14.593152] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-06T20:59:14.593198] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-06T20:59:14.593437] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-10-06T20:59:14.593493] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-06T20:59:15.008967] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:59:15.025483] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-06T20:59:15.412157] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-06T20:59:15.825542] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-06T20:59:16.067951] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T20:59:16.215292] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-06T20:59:16.625515] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-06T20:59:16.799026] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-06T20:59:17.425593] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-06T20:59:18.225636] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-06T20:59:18.922601] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-06T20:59:19.025486] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-06T20:59:19.086292] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T20:59:19.418486] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T20:59:19.825517] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-06T20:59:20.625587] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-06T20:59:21.430742] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-06T20:59:21.449572] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-06T20:59:21.475503] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T20:59:21.520928] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T20:59:22.083018] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T20:59:22.085754] [INFO ] [REMOTE ] PLD: Full fetch complete (76991 records). [2025-10-06T20:59:22.085915] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-06T20:59:22.086712] [FATAL] [VALIDATOR ] PLD: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T20:59:22.086805] [FATAL] [MAIN ] PLD: Fetched primary data is invalid. Refusing to save it. [2025-10-06T20:59:22.086851] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to validation failure. [2025-10-06T20:59:22.086891] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-06T20:59:22.086951] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-06T20:59:22.086989] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-10-06T20:59:22.087237] [DEBUG] [LOCAL ] PLD: Deleted derivative data file. [2025-10-06T20:59:22.087335] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PLD took 31.6s. Estimated remaining: 1h 35m 3s. Rate: 7.1 symbols/min [2025-10-06T20:59:22.234936] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-06T20:59:22.260673] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:59:22.296786] [DEBUG] [LOCAL ] PLYM: Loaded 34055 existing records from primary storage. [2025-10-06T20:59:22.297115] [INFO ] [MAIN ] PLYM: Loaded 34055 existing records. [2025-10-06T20:59:22.488156] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:59:22.489140] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-06T20:59:22.489198] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-06T20:59:22.489913] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-10-06T20:59:22.489972] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-06T20:59:22.842631] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:59:23.025521] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-06T20:59:23.348311] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T20:59:23.825537] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-06T20:59:23.925614] [DEBUG] [REMOTE ] PLOW: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-06T20:59:23.926013] [WARN ] [REMOTE ] PLOW: No data returned for month 2025-03 [2025-10-06T20:59:23.926121] [FATAL] [REMOTE ] PLOW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T20:59:23.926205] [FATAL] [MAIN ] PLOW: Failed to fetch primary data. [2025-10-06T20:59:23.926292] [WARN ] [MAIN ] PLOW: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T20:59:23.926366] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-06T20:59:23.926431] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-06T20:59:23.926467] [INFO ] [LOCAL ] PLOW: Starting deletion of derivative data. [2025-10-06T20:59:23.926690] [DEBUG] [LOCAL ] PLOW: Deleted derivative data file. [2025-10-06T20:59:23.926781] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PLOW took 9.7s. Estimated remaining: 1h 34m 51s. Rate: 7.1 symbols/min [2025-10-06T20:59:24.169394] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:59:24.227184] [DEBUG] [LOCAL ] PM: Loaded 54447 existing records from primary storage. [2025-10-06T20:59:24.227535] [INFO ] [MAIN ] PM: Loaded 54447 existing records. [2025-10-06T20:59:24.423221] [WARN ] [MAIN ] PM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:59:24.423566] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-06T20:59:24.423627] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-06T20:59:24.424003] [DEBUG] [LOCAL ] PM: Deleted primary data file. [2025-10-06T20:59:24.424061] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-06T20:59:24.633893] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-06T20:59:24.794131] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:59:25.182709] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-06T20:59:25.425571] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-06T20:59:26.225506] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-06T20:59:26.477292] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T20:59:26.887356] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T20:59:27.025526] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-06T20:59:27.825526] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-06T20:59:28.140729] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T20:59:28.334816] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-06T20:59:28.625509] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-06T20:59:29.425543] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-06T20:59:29.580801] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T20:59:29.912042] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T20:59:30.225541] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-06T20:59:31.025591] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-06T20:59:31.641623] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T20:59:31.787675] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-06T20:59:31.791386] [INFO ] [REMOTE ] PL: Full fetch complete (76965 records). [2025-10-06T20:59:31.791572] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-06T20:59:31.827673] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-06T20:59:32.203379] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-10-06T20:59:32.203469] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-10-06T20:59:32.204577] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-10-06T20:59:32.204675] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-10-06T20:59:32.206363] [DEBUG] [LOCAL ] PL: Trimmed 76965 records to 53152 (keeping 200 days of data) [2025-10-06T20:59:32.516886] [DEBUG] [LOCAL ] PL: Primary data saved (53152 records). [2025-10-06T20:59:32.517039] [INFO ] [MAIN ] PL: Full history saved. [2025-10-06T20:59:32.517145] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PL took 47.3s. Estimated remaining: 1h 34m 43s. Rate: 7.1 symbols/min [2025-10-06T20:59:32.630667] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-06T20:59:32.689974] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:59:32.712941] [DEBUG] [LOCAL ] PML: Loaded 21631 existing records from primary storage. [2025-10-06T20:59:32.713228] [INFO ] [MAIN ] PML: Loaded 21631 existing records. [2025-10-06T20:59:32.891848] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:59:32.892074] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-06T20:59:32.892124] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-06T20:59:32.892353] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-06T20:59:32.892416] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-06T20:59:33.258007] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:59:33.293593] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-06T20:59:33.425498] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-06T20:59:33.659664] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-06T20:59:33.933719] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-06T20:59:34.225552] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-06T20:59:34.574911] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T20:59:35.025544] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-06T20:59:35.409392] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T20:59:35.412394] [INFO ] [REMOTE ] PLNT: Full fetch complete (70406 records). [2025-10-06T20:59:35.412525] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-06T20:59:35.690144] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-06T20:59:35.828179] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-06T20:59:35.845895] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-10-06T20:59:35.847487] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-10-06T20:59:35.848874] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-10-06T20:59:35.849068] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-10-06T20:59:35.850860] [DEBUG] [LOCAL ] PLNT: Trimmed 70406 records to 48202 (keeping 200 days of data) [2025-10-06T20:59:36.157254] [DEBUG] [LOCAL ] PLNT: Primary data saved (48202 records). [2025-10-06T20:59:36.157400] [INFO ] [MAIN ] PLNT: Full history saved. [2025-10-06T20:59:36.157485] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLNT took 34.2s. Estimated remaining: 1h 34m 33s. Rate: 7.1 symbols/min [2025-10-06T20:59:36.324147] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:59:36.336818] [DEBUG] [LOCAL ] PMM: Loaded 10993 existing records from primary storage. [2025-10-06T20:59:36.337065] [INFO ] [MAIN ] PMM: Loaded 10993 existing records. [2025-10-06T20:59:36.517732] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:59:36.518030] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-06T20:59:36.518083] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-06T20:59:36.518291] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-06T20:59:36.518348] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-06T20:59:36.628291] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-06T20:59:36.925549] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:59:36.940433] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T20:59:37.425537] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-06T20:59:37.934522] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T20:59:38.225621] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-06T20:59:38.438871] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-06T20:59:39.025582] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-06T20:59:39.424187] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-06T20:59:39.825485] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-06T20:59:40.013915] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T20:59:40.625618] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-06T20:59:40.964636] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T20:59:41.425489] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-06T20:59:41.665522] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T20:59:42.225488] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-06T20:59:42.247765] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-06T20:59:43.025508] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-06T20:59:43.367790] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-06T20:59:43.825510] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-06T20:59:44.566314] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T20:59:44.625508] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-06T20:59:44.788975] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T20:59:45.425515] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-06T20:59:45.863814] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-06T20:59:46.225549] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-06T20:59:46.344085] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-06T20:59:47.025596] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-06T20:59:47.396427] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T20:59:47.399194] [INFO ] [REMOTE ] PLYM: Full fetch complete (47127 records). [2025-10-06T20:59:47.399291] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-06T20:59:47.810761] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-10-06T20:59:47.811006] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-10-06T20:59:47.812633] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-10-06T20:59:47.812883] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-10-06T20:59:47.814813] [DEBUG] [LOCAL ] PLYM: Trimmed 47127 records to 33649 (keeping 200 days of data) [2025-10-06T20:59:47.872504] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-06T20:59:48.060044] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T20:59:48.101212] [DEBUG] [LOCAL ] PLYM: Primary data saved (33649 records). [2025-10-06T20:59:48.101453] [INFO ] [MAIN ] PLYM: Full history saved. [2025-10-06T20:59:48.101577] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLYM took 26.0s. Estimated remaining: 1h 34m 26s. Rate: 7.1 symbols/min [2025-10-06T20:59:48.282267] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T20:59:48.302496] [DEBUG] [LOCAL ] PMO: Loaded 10606 existing records from primary storage. [2025-10-06T20:59:48.302846] [INFO ] [MAIN ] PMO: Loaded 10606 existing records. [2025-10-06T20:59:48.499746] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T20:59:48.500143] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-06T20:59:48.500217] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-06T20:59:48.500453] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-06T20:59:48.500514] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-06T20:59:48.630747] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-06T20:59:48.888030] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T20:59:48.959338] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T20:59:49.425544] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-06T20:59:49.899147] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T20:59:50.225581] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-06T20:59:50.505008] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-06T20:59:51.025584] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-06T20:59:51.368176] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T20:59:51.825578] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-06T20:59:52.143476] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-06T20:59:52.625544] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-06T20:59:52.871953] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T20:59:53.168155] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-06T20:59:53.425520] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-06T20:59:54.225557] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-06T20:59:54.330277] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T20:59:55.025557] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-06T20:59:55.181506] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-06T20:59:55.825512] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-06T20:59:55.986107] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T20:59:56.625541] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-06T20:59:56.789097] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T20:59:57.425511] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-06T20:59:57.616232] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T20:59:58.225694] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-06T20:59:58.406050] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T20:59:59.025712] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-06T20:59:59.307084] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T20:59:59.825547] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-06T20:59:59.863102] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T21:00:00.625584] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-06T21:00:00.900538] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T21:00:01.425511] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-06T21:00:01.664067] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-06T21:00:02.225518] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-06T21:00:02.413126] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-06T21:00:03.025523] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-06T21:00:03.380738] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-06T21:00:03.825482] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-06T21:00:04.124717] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T21:00:04.625582] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-06T21:00:04.676217] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-06T21:00:04.677590] [INFO ] [REMOTE ] PMM: Full fetch complete (18164 records). [2025-10-06T21:00:04.677717] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-06T21:00:05.050404] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-06T21:00:05.050489] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-06T21:00:05.050908] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-06T21:00:05.050972] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-06T21:00:05.051593] [DEBUG] [LOCAL ] PMM: Trimmed 18164 records to 10754 (keeping 200 days of data) [2025-10-06T21:00:05.115158] [DEBUG] [LOCAL ] PMM: Primary data saved (10754 records). [2025-10-06T21:00:05.115305] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-06T21:00:05.115391] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PMM took 29.0s. Estimated remaining: 1h 34m 21s. Rate: 7.1 symbols/min [2025-10-06T21:00:05.291385] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:00:05.333483] [DEBUG] [LOCAL ] PMT: Loaded 40904 existing records from primary storage. [2025-10-06T21:00:05.333893] [INFO ] [MAIN ] PMT: Loaded 40904 existing records. [2025-10-06T21:00:05.430706] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-06T21:00:05.537271] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:00:05.537523] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-06T21:00:05.537665] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-06T21:00:05.538164] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-10-06T21:00:05.538292] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-06T21:00:05.936556] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-06T21:00:05.944365] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:00:06.225584] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-06T21:00:06.768777] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-06T21:00:07.025500] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-06T21:00:07.240209] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T21:00:07.825550] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-06T21:00:08.471198] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T21:00:08.475389] [INFO ] [REMOTE ] PM: Full fetch complete (77318 records). [2025-10-06T21:00:08.475577] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-06T21:00:08.476945] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:00:08.477059] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:00:08.477111] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:00:08.477163] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-06T21:00:08.477269] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-06T21:00:08.477328] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-06T21:00:08.477723] [DEBUG] [LOCAL ] PM: Deleted derivative data file. [2025-10-06T21:00:08.478587] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PM took 44.6s. Estimated remaining: 1h 34m 10s. Rate: 7.1 symbols/min [2025-10-06T21:00:08.630697] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-06T21:00:08.751334] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:00:08.751735] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-06T21:00:08.751818] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-06T21:00:08.752313] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-06T21:00:08.752373] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-06T21:00:08.752419] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-06T21:00:08.752453] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-06T21:00:09.086447] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-06T21:00:09.207044] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:00:09.425549] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-06T21:00:09.578117] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T21:00:10.225558] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-06T21:00:10.501600] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T21:00:10.631081] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-06T21:00:11.025603] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-06T21:00:11.825536] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-06T21:00:12.462975] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T21:00:12.625526] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-06T21:00:13.225918] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T21:00:13.373005] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-06T21:00:13.374778] [INFO ] [REMOTE ] PML: Full fetch complete (29859 records). [2025-10-06T21:00:13.374857] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-06T21:00:13.430726] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-06T21:00:13.746420] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-06T21:00:13.746506] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-06T21:00:13.747123] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-06T21:00:13.747185] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-06T21:00:13.747971] [DEBUG] [LOCAL ] PML: Trimmed 29859 records to 21461 (keeping 200 days of data) [2025-10-06T21:00:13.874827] [DEBUG] [LOCAL ] PML: Primary data saved (21461 records). [2025-10-06T21:00:13.874972] [INFO ] [MAIN ] PML: Full history saved. [2025-10-06T21:00:13.875060] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PML took 41.4s. Estimated remaining: 1h 34m 0s. Rate: 7.1 symbols/min [2025-10-06T21:00:14.043506] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:00:14.043710] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-06T21:00:14.043760] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-06T21:00:14.043875] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-06T21:00:14.043916] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-06T21:00:14.043990] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-06T21:00:14.044048] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-06T21:00:14.230759] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-06T21:00:14.414147] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:00:14.415030] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-06T21:00:15.025554] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-06T21:00:15.825489] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-06T21:00:15.920466] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T21:00:15.921097] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T21:00:16.194406] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:00:16.194759] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-06T21:00:16.194853] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:00:16.194900] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-06T21:00:16.194996] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:00:16.195065] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-06T21:00:16.195130] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-06T21:00:16.195183] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-06T21:00:16.195260] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-06T21:00:16.195313] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PMTV took 2.3s. Estimated remaining: 1h 33m 50s. Rate: 7.1 symbols/min [2025-10-06T21:00:16.368633] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:00:16.368844] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-06T21:00:16.368884] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-06T21:00:16.368995] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-06T21:00:16.369036] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-06T21:00:16.369079] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-06T21:00:16.369113] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-06T21:00:16.630612] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-06T21:00:16.741787] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:00:17.071942] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-06T21:00:17.425541] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-06T21:00:17.752752] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:00:17.753085] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-06T21:00:17.753174] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:00:17.753245] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-06T21:00:17.753323] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:00:17.753408] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-06T21:00:17.753531] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-06T21:00:17.753593] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-06T21:00:17.753685] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-06T21:00:17.753774] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMTW took 1.6s. Estimated remaining: 1h 33m 38s. Rate: 7.1 symbols/min [2025-10-06T21:00:17.925052] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:00:17.925354] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-06T21:00:17.925411] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-06T21:00:17.925525] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-06T21:00:17.925566] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-06T21:00:17.925607] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-06T21:00:17.925638] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-06T21:00:18.238507] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-06T21:00:18.280861] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:00:19.025542] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-06T21:00:19.825490] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-06T21:00:19.997302] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T21:00:20.294011] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-06T21:00:20.625483] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-06T21:00:20.955041] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-06T21:00:21.061864] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-06T21:00:21.425544] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-06T21:00:22.225542] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-06T21:00:22.418868] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T21:00:22.897326] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-06T21:00:22.898409] [INFO ] [REMOTE ] PMO: Full fetch complete (16942 records). [2025-10-06T21:00:22.898483] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-06T21:00:23.030618] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-06T21:00:23.284740] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-06T21:00:23.284843] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-06T21:00:23.285269] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-06T21:00:23.285311] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-06T21:00:23.285933] [DEBUG] [LOCAL ] PMO: Trimmed 16942 records to 10208 (keeping 200 days of data) [2025-10-06T21:00:23.346802] [DEBUG] [LOCAL ] PMO: Primary data saved (10208 records). [2025-10-06T21:00:23.346954] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-06T21:00:23.347040] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMO took 35.2s. Estimated remaining: 1h 33m 29s. Rate: 7.1 symbols/min [2025-10-06T21:00:23.517950] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:00:23.518177] [DEBUG] [LOCAL ] PNI: No existing data file found in primary storage. [2025-10-06T21:00:23.518231] [WARN ] [MAIN ] PNI: No existing data found, performing full refresh instead. [2025-10-06T21:00:23.518342] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-06T21:00:23.518383] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-06T21:00:23.518423] [DEBUG] [LOCAL ] PNI: No primary data file found to delete. [2025-10-06T21:00:23.518454] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-06T21:00:23.602238] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-06T21:00:23.830607] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-06T21:00:23.887572] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:00:24.625491] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-06T21:00:24.717865] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-06T21:00:25.215812] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T21:00:25.425542] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-06T21:00:26.225553] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-06T21:00:26.347713] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-06T21:00:27.025506] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-06T21:00:27.103242] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T21:00:27.547226] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-06T21:00:27.825522] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-06T21:00:28.319297] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-06T21:00:28.625538] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-06T21:00:29.118726] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-06T21:00:29.425602] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-06T21:00:29.920937] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-06T21:00:30.225529] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-06T21:00:31.025531] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-06T21:00:31.109069] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T21:00:31.519111] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-06T21:00:31.825536] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-06T21:00:32.220383] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-06T21:00:32.221326] [INFO ] [REMOTE ] PMTU: Full fetch complete (1215 records). [2025-10-06T21:00:32.221404] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-06T21:00:32.420921] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-06T21:00:32.421235] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:00:32.421383] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:00:32.421491] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-06T21:00:32.421581] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-06T21:00:32.421639] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-06T21:00:32.421784] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-06T21:00:32.421875] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PMTU took 23.9s. Estimated remaining: 1h 33m 21s. Rate: 7.1 symbols/min [2025-10-06T21:00:32.611833] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:00:32.625556] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-06T21:00:32.658878] [DEBUG] [LOCAL ] PNNT: Loaded 33359 existing records from primary storage. [2025-10-06T21:00:32.659290] [INFO ] [MAIN ] PNNT: Loaded 33359 existing records. [2025-10-06T21:00:32.853332] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:00:32.853692] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-06T21:00:32.853753] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-06T21:00:32.854037] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-06T21:00:32.854096] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-06T21:00:33.222050] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:00:33.425558] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-06T21:00:34.225583] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-06T21:00:34.710194] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-06T21:00:34.967595] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T21:00:35.025495] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-06T21:00:35.266496] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T21:00:35.825563] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-06T21:00:36.611258] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T21:00:36.625472] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-06T21:00:37.425583] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-06T21:00:37.562906] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T21:00:38.198498] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T21:00:38.198806] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-06T21:00:38.225500] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-06T21:00:39.025554] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-06T21:00:39.793858] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T21:00:39.825464] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-06T21:00:39.981151] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-06T21:00:40.625583] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-06T21:00:41.425592] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-06T21:00:41.543358] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T21:00:42.225526] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-06T21:00:42.289878] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T21:00:42.448021] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T21:00:43.025636] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-06T21:00:43.582693] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-06T21:00:43.825613] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-06T21:00:44.625492] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-06T21:00:44.632402] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T21:00:44.811176] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T21:00:45.425595] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-06T21:00:45.526800] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-06T21:00:46.225573] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-06T21:00:46.733203] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T21:00:47.025586] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-06T21:00:47.828752] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-06T21:00:47.843712] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T21:00:48.196210] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T21:00:48.625558] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-06T21:00:48.823220] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T21:00:49.309020] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-06T21:00:49.425555] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-06T21:00:50.225532] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-06T21:00:51.016699] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T21:00:51.026535] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-06T21:00:51.026783] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-06T21:00:51.825579] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-06T21:00:52.026365] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T21:00:52.625591] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-06T21:00:53.189164] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T21:00:53.192159] [INFO ] [REMOTE ] PMT: Full fetch complete (58579 records). [2025-10-06T21:00:53.192254] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-06T21:00:53.428592] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-06T21:00:53.587798] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T21:00:53.609928] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-10-06T21:00:53.610002] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-10-06T21:00:53.610956] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-10-06T21:00:53.611022] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-10-06T21:00:53.612195] [DEBUG] [LOCAL ] PMT: Trimmed 58579 records to 40380 (keeping 200 days of data) [2025-10-06T21:00:53.853624] [DEBUG] [LOCAL ] PMT: Primary data saved (40380 records). [2025-10-06T21:00:53.853780] [INFO ] [MAIN ] PMT: Full history saved. [2025-10-06T21:00:53.853877] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PMT took 48.7s. Estimated remaining: 1h 33m 17s. Rate: 7.1 symbols/min [2025-10-06T21:00:54.030025] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:00:54.030246] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-06T21:00:54.030383] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-06T21:00:54.030511] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-06T21:00:54.030578] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-06T21:00:54.030676] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-06T21:00:54.030749] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-06T21:00:54.235392] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-06T21:00:54.383285] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:00:54.973733] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T21:00:55.025488] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-06T21:00:55.385833] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T21:00:55.825549] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-06T21:00:56.625548] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-06T21:00:56.680076] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T21:00:56.693210] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-06T21:00:57.253624] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T21:00:57.256799] [INFO ] [REMOTE ] PNC: Full fetch complete (75030 records). [2025-10-06T21:00:57.256950] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-06T21:00:57.257880] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:00:57.257977] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:00:57.258023] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:00:57.258090] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-06T21:00:57.258194] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-06T21:00:57.258256] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-06T21:00:57.258329] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-06T21:00:57.258418] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PNC took 39.5s. Estimated remaining: 1h 33m 7s. Rate: 7.1 symbols/min [2025-10-06T21:00:57.430731] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-06T21:00:57.470792] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:00:57.523386] [DEBUG] [LOCAL ] PNW: Loaded 46446 existing records from primary storage. [2025-10-06T21:00:57.523844] [INFO ] [MAIN ] PNW: Loaded 46446 existing records. [2025-10-06T21:00:57.698019] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:00:57.698224] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-06T21:00:57.698276] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-06T21:00:57.698520] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-10-06T21:00:57.698577] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-06T21:00:58.047078] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:00:58.225527] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-06T21:00:59.025565] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-06T21:00:59.100348] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T21:00:59.825569] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-06T21:00:59.990266] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T21:01:00.238788] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T21:01:00.241418] [INFO ] [REMOTE ] PNNT: Full fetch complete (47512 records). [2025-10-06T21:01:00.241526] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-06T21:01:00.522550] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T21:01:00.557612] [INFO ] [REMOTE ] PNI: Full fetch complete (9810 records). [2025-10-06T21:01:00.561679] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-06T21:01:00.630590] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-06T21:01:00.802719] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-06T21:01:00.808012] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-06T21:01:00.824927] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-06T21:01:00.835850] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-06T21:01:00.963307] [DEBUG] [LOCAL ] PNNT: Trimmed 47512 records to 32938 (keeping 200 days of data) [2025-10-06T21:01:01.179802] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-06T21:01:01.182160] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-06T21:01:01.183895] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-06T21:01:01.183977] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-06T21:01:01.191033] [DEBUG] [LOCAL ] PNI: Trimmed 9810 records to 6790 (keeping 200 days of data) [2025-10-06T21:01:01.237049] [DEBUG] [LOCAL ] PNI: Primary data saved (6790 records). [2025-10-06T21:01:01.237863] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-06T21:01:01.238632] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PNI took 37.9s. Estimated remaining: 1h 32m 57s. Rate: 7.1 symbols/min [2025-10-06T21:01:01.428422] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-06T21:01:01.531209] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:01:01.557524] [DEBUG] [LOCAL ] PNNT: Primary data saved (32938 records). [2025-10-06T21:01:01.557913] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-06T21:01:01.558263] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNNT took 29.1s. Estimated remaining: 1h 32m 45s. Rate: 7.1 symbols/min [2025-10-06T21:01:01.762525] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:01:01.779829] [DEBUG] [LOCAL ] POR: Loaded 47696 existing records from primary storage. [2025-10-06T21:01:01.826669] [INFO ] [MAIN ] POR: Loaded 47696 existing records. [2025-10-06T21:01:01.874897] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T21:01:02.053575] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:01:02.067026] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-06T21:01:02.067179] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-06T21:01:02.068015] [DEBUG] [LOCAL ] POST: Loaded 39260 existing records from primary storage. [2025-10-06T21:01:02.068390] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-10-06T21:01:02.068348] [INFO ] [MAIN ] POST: Loaded 39260 existing records. [2025-10-06T21:01:02.068500] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-06T21:01:02.229633] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-06T21:01:02.498582] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:01:02.537160] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-06T21:01:02.570753] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-06T21:01:02.574928] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-10-06T21:01:02.590681] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-06T21:01:02.695277] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:01:02.768173] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T21:01:03.032085] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-06T21:01:03.063624] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:01:03.544192] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T21:01:03.825469] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-06T21:01:04.013095] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T21:01:04.625575] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-06T21:01:05.364895] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T21:01:05.425529] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-06T21:01:06.225517] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-06T21:01:06.422917] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T21:01:06.481330] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T21:01:07.025558] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-06T21:01:07.535226] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T21:01:07.728381] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-06T21:01:07.825572] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-06T21:01:08.625575] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-06T21:01:09.396709] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-06T21:01:09.425499] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-06T21:01:09.459211] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T21:01:10.225602] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-06T21:01:10.521433] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T21:01:11.025594] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-06T21:01:11.825538] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-06T21:01:12.042519] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T21:01:12.081275] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-06T21:01:12.625553] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-06T21:01:13.361306] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T21:01:13.425531] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-06T21:01:13.753362] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T21:01:14.225712] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-06T21:01:15.025560] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-06T21:01:15.190207] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T21:01:15.825527] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-06T21:01:15.972483] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T21:01:16.019076] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T21:01:16.456634] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-06T21:01:16.625522] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-06T21:01:17.425537] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-06T21:01:17.527489] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T21:01:18.225546] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-06T21:01:19.025503] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-06T21:01:19.189981] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T21:01:19.570473] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T21:01:19.573239] [INFO ] [REMOTE ] PNR: Full fetch complete (68798 records). [2025-10-06T21:01:19.573392] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-06T21:01:19.574153] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:01:19.574248] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:01:19.574292] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:01:19.574362] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-06T21:01:19.574455] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-06T21:01:19.574510] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-06T21:01:19.574554] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-06T21:01:19.574613] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PNR took 25.7s. Estimated remaining: 1h 32m 40s. Rate: 7.1 symbols/min [2025-10-06T21:01:19.754235] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:01:19.808294] [DEBUG] [LOCAL ] PPG: Loaded 51413 existing records from primary storage. [2025-10-06T21:01:19.808829] [INFO ] [MAIN ] PPG: Loaded 51413 existing records. [2025-10-06T21:01:19.830684] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-06T21:01:20.040315] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:01:20.043318] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-06T21:01:20.043574] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-06T21:01:20.045480] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T21:01:20.045530] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-10-06T21:01:20.055413] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-06T21:01:20.432606] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:01:20.625525] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-06T21:01:20.880252] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T21:01:21.425552] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-06T21:01:22.225525] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-06T21:01:22.306203] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T21:01:23.025508] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-06T21:01:23.137951] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T21:01:23.825576] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-06T21:01:24.056583] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T21:01:24.587804] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T21:01:24.625508] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-06T21:01:25.425484] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-06T21:01:25.589470] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T21:01:26.225491] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-06T21:01:26.295700] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T21:01:26.601119] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T21:01:27.025520] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-06T21:01:27.270542] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T21:01:27.825524] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-06T21:01:28.625542] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-06T21:01:28.952184] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-06T21:01:29.092148] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-06T21:01:29.425580] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-06T21:01:29.662546] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-06T21:01:30.225532] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-06T21:01:31.008759] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T21:01:31.025463] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-06T21:01:31.128065] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-06T21:01:31.825512] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-06T21:01:32.625559] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-06T21:01:32.707207] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T21:01:32.882284] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-06T21:01:33.425561] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-06T21:01:34.225616] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-06T21:01:34.361079] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T21:01:34.559327] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-06T21:01:35.025518] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-06T21:01:35.651461] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T21:01:35.654431] [INFO ] [REMOTE ] POR: Full fetch complete (68551 records). [2025-10-06T21:01:35.654549] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-06T21:01:35.831257] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-06T21:01:36.047243] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-10-06T21:01:36.047331] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-10-06T21:01:36.048439] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-10-06T21:01:36.048508] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-10-06T21:01:36.049993] [DEBUG] [LOCAL ] POR: Trimmed 68551 records to 47006 (keeping 200 days of data) [2025-10-06T21:01:36.352278] [DEBUG] [LOCAL ] POR: Primary data saved (47006 records). [2025-10-06T21:01:36.352448] [INFO ] [MAIN ] POR: Full history saved. [2025-10-06T21:01:36.352553] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. POR took 35.1s. Estimated remaining: 1h 32m 35s. Rate: 7.1 symbols/min [2025-10-06T21:01:36.470019] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T21:01:36.493723] [INFO ] [REMOTE ] POST: Full fetch complete (55704 records). [2025-10-06T21:01:36.549996] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-06T21:01:36.551511] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:01:36.551943] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-06T21:01:36.552532] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-06T21:01:36.552936] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-06T21:01:36.568754] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-06T21:01:36.600999] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-06T21:01:36.628208] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-06T21:01:36.636691] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-06T21:01:37.305267] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-10-06T21:01:37.316420] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-10-06T21:01:37.400873] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T21:01:37.388869] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-10-06T21:01:37.437527] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:01:37.437611] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-10-06T21:01:37.439019] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-06T21:01:37.437779] [INFO ] [REMOTE ] PNW: Full fetch complete (65690 records). [2025-10-06T21:01:37.441386] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T21:01:37.441555] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-06T21:01:37.456065] [DEBUG] [LOCAL ] POST: Trimmed 55704 records to 38793 (keeping 200 days of data) [2025-10-06T21:01:37.456415] [FATAL] [VALIDATOR ] PNW: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:01:37.456955] [FATAL] [MAIN ] PNW: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:01:37.457322] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:01:37.457400] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-06T21:01:37.457470] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-06T21:01:37.457527] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-10-06T21:01:37.458015] [DEBUG] [LOCAL ] PNW: Deleted derivative data file. [2025-10-06T21:01:37.458129] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. PNW took 40.2s. Estimated remaining: 1h 32m 24s. Rate: 7.1 symbols/min [2025-10-06T21:01:37.750224] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:01:37.877667] [DEBUG] [LOCAL ] PPT: Loaded 20416 existing records from primary storage. [2025-10-06T21:01:37.880493] [DEBUG] [LOCAL ] POST: Primary data saved (38793 records). [2025-10-06T21:01:37.880853] [INFO ] [MAIN ] PPT: Loaded 20416 existing records. [2025-10-06T21:01:37.880935] [INFO ] [MAIN ] POST: Full history saved. [2025-10-06T21:01:37.881048] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. POST took 36.3s. Estimated remaining: 1h 32m 12s. Rate: 7.1 symbols/min [2025-10-06T21:01:38.212303] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:01:38.228397] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-06T21:01:38.234532] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:01:38.235010] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-06T21:01:38.235071] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-06T21:01:38.235270] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-06T21:01:38.235326] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-06T21:01:38.627208] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:01:38.629743] [DEBUG] [LOCAL ] PR: Loaded 54390 existing records from primary storage. [2025-10-06T21:01:38.630006] [INFO ] [MAIN ] PR: Loaded 54390 existing records. [2025-10-06T21:01:38.805092] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:01:38.805278] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-06T21:01:38.805323] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-06T21:01:38.805539] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-10-06T21:01:38.805595] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-06T21:01:39.048373] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-06T21:01:39.171884] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:01:39.252491] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T21:01:39.490859] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-06T21:01:39.825491] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-06T21:01:40.219632] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T21:01:40.440782] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T21:01:40.625628] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-06T21:01:41.425565] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-06T21:01:41.697352] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T21:01:42.225506] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-06T21:01:43.025557] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-06T21:01:43.160393] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T21:01:43.266892] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T21:01:43.825505] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-06T21:01:44.107302] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T21:01:44.625497] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-06T21:01:44.986113] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T21:01:45.425558] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-06T21:01:45.576575] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T21:01:46.225531] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-06T21:01:47.025502] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-06T21:01:47.202949] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T21:01:47.266455] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-06T21:01:47.825538] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-06T21:01:48.183887] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-06T21:01:48.625518] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-06T21:01:48.770226] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-06T21:01:49.425546] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-06T21:01:50.225495] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-06T21:01:50.351932] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T21:01:50.386368] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-06T21:01:51.025585] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-06T21:01:51.253060] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-06T21:01:51.825544] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-06T21:01:52.274971] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-06T21:01:52.625558] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-06T21:01:52.879034] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T21:01:53.425528] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-06T21:01:54.225485] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-06T21:01:54.396546] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T21:01:54.815102] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T21:01:55.025535] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-06T21:01:55.130517] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T21:01:55.825571] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-06T21:01:56.193600] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T21:01:56.625524] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-06T21:01:56.814762] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T21:01:57.425495] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-06T21:01:57.586208] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T21:01:57.588891] [INFO ] [REMOTE ] PPG: Full fetch complete (73414 records). [2025-10-06T21:01:57.588988] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-06T21:01:57.589694] [FATAL] [VALIDATOR ] PPG: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:01:57.589782] [FATAL] [MAIN ] PPG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:01:57.589823] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:01:57.589862] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-06T21:01:57.589918] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-06T21:01:57.589952] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-10-06T21:01:57.590164] [DEBUG] [LOCAL ] PPG: Deleted derivative data file. [2025-10-06T21:01:57.590253] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. PPG took 38.0s. Estimated remaining: 1h 32m 8s. Rate: 7.1 symbols/min [2025-10-06T21:01:58.225537] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-06T21:01:58.836187] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T21:01:59.025487] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-06T21:01:59.363638] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T21:01:59.825580] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-06T21:02:00.148060] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T21:02:00.625622] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-06T21:02:01.425516] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-06T21:02:01.838943] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T21:02:01.839521] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T21:02:02.225624] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-06T21:02:02.576020] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-06T21:02:02.941967] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-06T21:02:02.943832] [INFO ] [REMOTE ] PPT: Full fetch complete (29064 records). [2025-10-06T21:02:02.943939] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-06T21:02:03.030721] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-06T21:02:03.336093] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-06T21:02:03.336195] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-06T21:02:03.336839] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-06T21:02:03.336905] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-06T21:02:03.337832] [DEBUG] [LOCAL ] PPT: Trimmed 29064 records to 19961 (keeping 200 days of data) [2025-10-06T21:02:03.464233] [DEBUG] [LOCAL ] PPT: Primary data saved (19961 records). [2025-10-06T21:02:03.464393] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-06T21:02:03.464477] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PPT took 26.0s. Estimated remaining: 1h 31m 59s. Rate: 7.1 symbols/min [2025-10-06T21:02:03.825559] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-06T21:02:04.152884] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T21:02:04.625531] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-06T21:02:05.257687] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T21:02:05.260208] [INFO ] [REMOTE ] PPL: Full fetch complete (77029 records). [2025-10-06T21:02:05.260316] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-06T21:02:05.260978] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:02:05.261085] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:02:05.261127] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:02:05.261164] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-06T21:02:05.261221] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-06T21:02:05.261254] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-06T21:02:05.261293] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-06T21:02:05.261356] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PPL took 28.9s. Estimated remaining: 1h 31m 48s. Rate: 7.1 symbols/min [2025-10-06T21:02:05.527979] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T21:02:05.539603] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-06T21:02:07.558855] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-06T21:02:07.570489] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-06T21:02:09.710311] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-06T21:02:09.721983] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-06T21:02:11.684880] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T21:02:11.697931] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-06T21:02:13.693290] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-06T21:02:13.706431] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-06T21:02:15.103250] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T21:02:15.106291] [INFO ] [REMOTE ] PR: Full fetch complete (77598 records). [2025-10-06T21:02:15.106425] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-06T21:02:15.493145] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-10-06T21:02:15.493250] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-10-06T21:02:15.494380] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-10-06T21:02:15.494446] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-10-06T21:02:15.496071] [DEBUG] [LOCAL ] PR: Trimmed 77598 records to 53611 (keeping 200 days of data) [2025-10-06T21:02:15.815036] [DEBUG] [LOCAL ] PR: Primary data saved (53611 records). [2025-10-06T21:02:15.815170] [INFO ] [MAIN ] PR: Full history saved. [2025-10-06T21:02:15.815248] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PR took 37.9s. Estimated remaining: 1h 31m 40s. Rate: 7.1 symbols/min [2025-10-06T21:02:16.376723] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:02:16.437254] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:02:16.473524] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:02:16.525588] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:02:16.531708] [DEBUG] [LOCAL ] PRCS: Loaded 2779 existing records from primary storage. [2025-10-06T21:02:16.532377] [INFO ] [MAIN ] PRCS: Loaded 2779 existing records. [2025-10-06T21:02:16.691534] [DEBUG] [LOCAL ] PRG: Loaded 30280 existing records from primary storage. [2025-10-06T21:02:16.727558] [INFO ] [MAIN ] PRG: Loaded 30280 existing records. [2025-10-06T21:02:16.765274] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:02:16.795306] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-06T21:02:16.818520] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-06T21:02:16.878126] [DEBUG] [LOCAL ] PRGO: Loaded 47657 existing records from primary storage. [2025-10-06T21:02:16.877272] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-06T21:02:16.887832] [DEBUG] [LOCAL ] PRA: Loaded 35566 existing records from primary storage. [2025-10-06T21:02:16.888273] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-06T21:02:16.888554] [INFO ] [MAIN ] PRA: Loaded 35566 existing records. [2025-10-06T21:02:16.888442] [INFO ] [MAIN ] PRGO: Loaded 47657 existing records. [2025-10-06T21:02:17.169178] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:02:17.208886] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-06T21:02:17.224468] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-06T21:02:17.297635] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-10-06T21:02:17.297804] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-06T21:02:17.532566] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:02:17.588469] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:02:17.603302] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-06T21:02:17.608562] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-06T21:02:17.613751] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-06T21:02:17.625855] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-06T21:02:17.679358] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-10-06T21:02:17.679476] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-10-06T21:02:17.699792] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-06T21:02:17.699719] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-06T21:02:18.174529] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:02:18.209230] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-06T21:02:18.399585] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:02:18.456638] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-06T21:02:18.816841] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:02:18.819530] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-06T21:02:18.820521] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-06T21:02:18.822824] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-06T21:02:18.826959] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:02:18.827844] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-06T21:02:19.343296] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-06T21:02:19.344905] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-06T21:02:19.961583] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T21:02:19.968962] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-06T21:02:20.051155] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-06T21:02:20.053280] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T21:02:20.054842] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-06T21:02:20.059770] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-06T21:02:20.455382] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T21:02:20.465150] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-06T21:02:20.666692] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T21:02:20.668091] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-06T21:02:21.076881] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T21:02:21.081186] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-06T21:02:21.167687] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-06T21:02:21.169435] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-06T21:02:21.202388] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-06T21:02:21.208803] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-06T21:02:21.826895] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-06T21:02:21.828346] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-06T21:02:21.885511] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T21:02:21.895694] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-06T21:02:21.912762] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T21:02:22.225512] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-06T21:02:22.394155] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-06T21:02:22.529187] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T21:02:23.025481] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-06T21:02:23.263095] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T21:02:23.690793] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-06T21:02:23.693937] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-06T21:02:23.825528] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-06T21:02:24.625538] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-06T21:02:25.214596] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T21:02:25.244528] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-06T21:02:25.425548] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-06T21:02:25.928074] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-06T21:02:26.225527] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-06T21:02:26.579264] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-06T21:02:26.580073] [INFO ] [REMOTE ] PRCS: Full fetch complete (3858 records). [2025-10-06T21:02:26.580169] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-06T21:02:26.947281] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-06T21:02:26.947360] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-06T21:02:26.947488] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-06T21:02:26.947538] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-06T21:02:26.947937] [DEBUG] [LOCAL ] PRCS: Trimmed 3858 records to 2758 (keeping 200 days of data) [2025-10-06T21:02:26.964403] [DEBUG] [LOCAL ] PRCS: Primary data saved (2758 records). [2025-10-06T21:02:26.964500] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-06T21:02:26.964575] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRCS took 11.1s. Estimated remaining: 1h 31m 33s. Rate: 7.1 symbols/min [2025-10-06T21:02:27.030751] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-06T21:02:27.135897] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:02:27.143498] [DEBUG] [LOCAL ] PRH: Loaded 4837 existing records from primary storage. [2025-10-06T21:02:27.143719] [INFO ] [MAIN ] PRH: Loaded 4837 existing records. [2025-10-06T21:02:27.322869] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:02:27.323128] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-06T21:02:27.323186] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-06T21:02:27.323394] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-06T21:02:27.323451] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-06T21:02:27.673451] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:02:27.825471] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-06T21:02:28.625529] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-06T21:02:28.713403] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T21:02:28.738181] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T21:02:29.425556] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-06T21:02:30.225510] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-06T21:02:30.430778] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T21:02:30.928444] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T21:02:31.025524] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-06T21:02:31.509905] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T21:02:31.825511] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-06T21:02:32.476872] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T21:02:32.625589] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-06T21:02:33.412382] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T21:02:33.425497] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-06T21:02:33.528261] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T21:02:34.204821] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T21:02:34.225468] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-06T21:02:34.909171] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-06T21:02:35.025538] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-06T21:02:35.825521] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-06T21:02:36.572600] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T21:02:36.625514] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-06T21:02:36.635198] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T21:02:37.425527] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-06T21:02:38.225498] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-06T21:02:38.640782] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-06T21:02:38.793166] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-06T21:02:38.903394] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T21:02:39.025512] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-06T21:02:39.825516] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-06T21:02:40.622593] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T21:02:40.631617] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-06T21:02:41.412070] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T21:02:41.422868] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-06T21:02:41.425444] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-06T21:02:42.225561] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-06T21:02:42.711810] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T21:02:43.025549] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-06T21:02:43.825485] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-06T21:02:44.016004] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T21:02:44.055302] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-06T21:02:44.625537] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-06T21:02:45.269545] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T21:02:45.356968] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T21:02:45.425508] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-06T21:02:46.225581] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-06T21:02:46.428501] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T21:02:46.430932] [INFO ] [REMOTE ] PRA: Full fetch complete (43992 records). [2025-10-06T21:02:46.431063] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-06T21:02:46.893490] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-10-06T21:02:46.893586] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-10-06T21:02:46.894626] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-10-06T21:02:46.894762] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-10-06T21:02:46.896031] [DEBUG] [LOCAL ] PRA: Trimmed 43992 records to 35372 (keeping 200 days of data) [2025-10-06T21:02:47.025831] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-06T21:02:47.130076] [DEBUG] [LOCAL ] PRA: Primary data saved (35372 records). [2025-10-06T21:02:47.130225] [INFO ] [MAIN ] PRA: Full history saved. [2025-10-06T21:02:47.130314] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRA took 31.3s. Estimated remaining: 1h 31m 29s. Rate: 7.1 symbols/min [2025-10-06T21:02:47.344083] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:02:47.366742] [DEBUG] [LOCAL ] PRI: Loaded 18492 existing records from primary storage. [2025-10-06T21:02:47.367036] [INFO ] [MAIN ] PRI: Loaded 18492 existing records. [2025-10-06T21:02:47.591591] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:02:47.591864] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-06T21:02:47.591950] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-06T21:02:47.592283] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-10-06T21:02:47.592478] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-06T21:02:47.747768] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T21:02:47.832206] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-06T21:02:48.070837] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:02:48.072729] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T21:02:48.625554] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-06T21:02:49.232808] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-06T21:02:49.425547] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-06T21:02:49.710050] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-06T21:02:50.225547] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-06T21:02:50.710383] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T21:02:50.832109] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-06T21:02:51.025518] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-06T21:02:51.825563] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-06T21:02:52.195034] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T21:02:52.197271] [INFO ] [REMOTE ] PRG: Full fetch complete (44434 records). [2025-10-06T21:02:52.197357] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-06T21:02:52.604209] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-10-06T21:02:52.604317] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-10-06T21:02:52.605432] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-10-06T21:02:52.605545] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-10-06T21:02:52.606832] [DEBUG] [LOCAL ] PRG: Trimmed 44434 records to 29868 (keeping 200 days of data) [2025-10-06T21:02:52.675410] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-06T21:02:52.873841] [DEBUG] [LOCAL ] PRG: Primary data saved (29868 records). [2025-10-06T21:02:52.874598] [INFO ] [MAIN ] PRG: Full history saved. [2025-10-06T21:02:52.874827] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PRG took 37.0s. Estimated remaining: 1h 31m 19s. Rate: 7.1 symbols/min [2025-10-06T21:02:53.154494] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T21:02:53.229040] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:02:53.284634] [DEBUG] [LOCAL ] PRIM: Loaded 45009 existing records from primary storage. [2025-10-06T21:02:53.285087] [INFO ] [MAIN ] PRIM: Loaded 45009 existing records. [2025-10-06T21:02:53.430710] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-06T21:02:53.507538] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:02:53.511902] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-06T21:02:53.512142] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-06T21:02:53.512474] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-10-06T21:02:53.512553] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-06T21:02:53.960069] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:02:54.003346] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T21:02:54.004267] [INFO ] [REMOTE ] PRH: Full fetch complete (7538 records). [2025-10-06T21:02:54.004336] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-06T21:02:54.230080] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-06T21:02:54.388186] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-06T21:02:54.388382] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-06T21:02:54.389100] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-06T21:02:54.389200] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-06T21:02:54.390132] [DEBUG] [LOCAL ] PRH: Trimmed 7538 records to 4780 (keeping 200 days of data) [2025-10-06T21:02:54.460567] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T21:02:54.480450] [DEBUG] [LOCAL ] PRH: Primary data saved (4780 records). [2025-10-06T21:02:54.480610] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-06T21:02:54.480733] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PRH took 27.5s. Estimated remaining: 1h 31m 8s. Rate: 7.1 symbols/min [2025-10-06T21:02:54.655286] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:02:54.698241] [DEBUG] [LOCAL ] PRKS: Loaded 43142 existing records from primary storage. [2025-10-06T21:02:54.698542] [INFO ] [MAIN ] PRKS: Loaded 43142 existing records. [2025-10-06T21:02:54.889122] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:02:54.889338] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-06T21:02:54.889389] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-06T21:02:54.889612] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-10-06T21:02:54.889704] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-06T21:02:55.030924] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-06T21:02:55.258073] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:02:55.572405] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T21:02:55.825515] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-06T21:02:56.453589] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T21:02:56.456828] [INFO ] [REMOTE ] PRGO: Full fetch complete (68541 records). [2025-10-06T21:02:56.456959] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-06T21:02:56.631512] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-06T21:02:56.849930] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-10-06T21:02:56.850028] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-10-06T21:02:56.851048] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-10-06T21:02:56.851114] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-10-06T21:02:56.852503] [DEBUG] [LOCAL ] PRGO: Trimmed 68541 records to 46941 (keeping 200 days of data) [2025-10-06T21:02:57.104581] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T21:02:57.162823] [DEBUG] [LOCAL ] PRGO: Primary data saved (46941 records). [2025-10-06T21:02:57.162972] [INFO ] [MAIN ] PRGO: Full history saved. [2025-10-06T21:02:57.163074] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRGO took 41.3s. Estimated remaining: 1h 30m 57s. Rate: 7.1 symbols/min [2025-10-06T21:02:57.331730] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:02:57.352815] [DEBUG] [LOCAL ] PRLB: Loaded 20678 existing records from primary storage. [2025-10-06T21:02:57.353062] [INFO ] [MAIN ] PRLB: Loaded 20678 existing records. [2025-10-06T21:02:57.430719] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-06T21:02:57.532148] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:02:57.532333] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-06T21:02:57.532378] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-06T21:02:57.532596] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-10-06T21:02:57.532686] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-06T21:02:57.890987] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:02:58.225565] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-06T21:02:58.426934] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T21:02:58.809532] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T21:02:59.025514] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-06T21:02:59.424186] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-06T21:02:59.825531] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-06T21:02:59.918909] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T21:03:00.625567] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-06T21:03:01.394863] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T21:03:01.425504] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-06T21:03:01.816455] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T21:03:02.225554] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-06T21:03:02.943344] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T21:03:03.025518] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-06T21:03:03.830673] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-06T21:03:03.850099] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T21:03:04.625528] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-06T21:03:04.853389] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T21:03:05.315120] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T21:03:05.425525] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-06T21:03:06.201090] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T21:03:06.225498] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-06T21:03:07.025567] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-06T21:03:07.163277] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T21:03:07.825558] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-06T21:03:08.088008] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T21:03:08.296057] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-06T21:03:08.625623] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-06T21:03:09.105312] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-06T21:03:09.425562] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-06T21:03:09.472514] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T21:03:10.225588] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-06T21:03:11.025493] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-06T21:03:11.133173] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T21:03:11.441036] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-06T21:03:11.825502] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-06T21:03:12.285051] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T21:03:12.625529] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-06T21:03:13.127325] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T21:03:13.425541] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-06T21:03:14.204865] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T21:03:14.225560] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-06T21:03:14.636862] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T21:03:15.025548] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-06T21:03:15.423338] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T21:03:15.825559] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-06T21:03:16.590126] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T21:03:16.625541] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-06T21:03:16.707562] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-06T21:03:16.709548] [INFO ] [REMOTE ] PRI: Full fetch complete (25758 records). [2025-10-06T21:03:16.709660] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-06T21:03:17.093185] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-10-06T21:03:17.093303] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-10-06T21:03:17.093958] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-10-06T21:03:17.094138] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-10-06T21:03:17.095195] [DEBUG] [LOCAL ] PRI: Trimmed 25758 records to 18263 (keeping 200 days of data) [2025-10-06T21:03:17.213528] [DEBUG] [LOCAL ] PRI: Primary data saved (18263 records). [2025-10-06T21:03:17.213717] [INFO ] [MAIN ] PRI: Full history saved. [2025-10-06T21:03:17.213815] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRI took 30.1s. Estimated remaining: 1h 30m 53s. Rate: 7.1 symbols/min [2025-10-06T21:03:17.393068] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:03:17.425993] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-06T21:03:17.440414] [DEBUG] [LOCAL ] PRM: Loaded 45329 existing records from primary storage. [2025-10-06T21:03:17.440847] [INFO ] [MAIN ] PRM: Loaded 45329 existing records. [2025-10-06T21:03:17.619375] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:03:17.619610] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-06T21:03:17.619683] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-06T21:03:17.619951] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-10-06T21:03:17.620008] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-06T21:03:17.976436] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:03:18.225544] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-06T21:03:18.387011] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T21:03:18.677081] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T21:03:19.025531] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-06T21:03:19.825549] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-06T21:03:19.885311] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T21:03:20.237841] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T21:03:20.625552] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-06T21:03:21.425565] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-06T21:03:21.536982] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T21:03:22.225569] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-06T21:03:22.446328] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T21:03:22.733941] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T21:03:23.025524] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-06T21:03:23.082424] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-06T21:03:23.825553] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-06T21:03:24.413247] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-06T21:03:24.625520] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-06T21:03:25.148259] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T21:03:25.425565] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-06T21:03:26.225557] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-06T21:03:26.302852] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T21:03:26.931626] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T21:03:26.933159] [INFO ] [REMOTE ] PRLB: Full fetch complete (30575 records). [2025-10-06T21:03:26.933245] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-06T21:03:27.025765] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-06T21:03:27.357702] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-06T21:03:27.443365] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-10-06T21:03:27.443460] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-10-06T21:03:27.444309] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-10-06T21:03:27.444406] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-10-06T21:03:27.445373] [DEBUG] [LOCAL ] PRLB: Trimmed 30575 records to 20362 (keeping 200 days of data) [2025-10-06T21:03:27.583812] [DEBUG] [LOCAL ] PRLB: Primary data saved (20362 records). [2025-10-06T21:03:27.583957] [INFO ] [MAIN ] PRLB: Full history saved. [2025-10-06T21:03:27.584043] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRLB took 30.4s. Estimated remaining: 1h 30m 46s. Rate: 7.1 symbols/min [2025-10-06T21:03:27.812353] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:03:27.825517] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-06T21:03:27.876531] [DEBUG] [LOCAL ] PRMB: Loaded 53910 existing records from primary storage. [2025-10-06T21:03:27.876984] [INFO ] [MAIN ] PRMB: Loaded 53910 existing records. [2025-10-06T21:03:28.111989] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:03:28.112249] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-06T21:03:28.112327] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-06T21:03:28.112625] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-10-06T21:03:28.112777] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-06T21:03:28.567949] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:03:28.625526] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-06T21:03:28.886976] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T21:03:29.161883] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T21:03:29.164794] [INFO ] [REMOTE ] PRKS: Full fetch complete (61493 records). [2025-10-06T21:03:29.164925] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-06T21:03:29.432080] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-06T21:03:29.569444] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-10-06T21:03:29.569546] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-10-06T21:03:29.570553] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-10-06T21:03:29.570619] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-10-06T21:03:29.572069] [DEBUG] [LOCAL ] PRKS: Trimmed 61493 records to 42476 (keeping 200 days of data) [2025-10-06T21:03:29.828824] [DEBUG] [LOCAL ] PRKS: Primary data saved (42476 records). [2025-10-06T21:03:29.828974] [INFO ] [MAIN ] PRKS: Full history saved. [2025-10-06T21:03:29.829096] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRKS took 35.3s. Estimated remaining: 1h 30m 35s. Rate: 7.1 symbols/min [2025-10-06T21:03:30.008407] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:03:30.045240] [DEBUG] [LOCAL ] PRO: Loaded 38992 existing records from primary storage. [2025-10-06T21:03:30.045548] [INFO ] [MAIN ] PRO: Loaded 38992 existing records. [2025-10-06T21:03:30.221998] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:03:30.222248] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-06T21:03:30.222360] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-06T21:03:30.222841] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-10-06T21:03:30.222907] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-06T21:03:30.253230] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-06T21:03:30.587093] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:03:30.621443] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-06T21:03:30.863295] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-06T21:03:31.025522] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-06T21:03:31.825525] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-06T21:03:32.083575] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T21:03:32.134684] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-06T21:03:32.625535] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-06T21:03:33.425512] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-06T21:03:33.614640] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T21:03:34.165958] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T21:03:34.225477] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-06T21:03:34.749709] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-06T21:03:35.025625] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-06T21:03:35.612170] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T21:03:35.825530] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-06T21:03:36.625581] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-06T21:03:37.018502] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-06T21:03:37.202917] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T21:03:37.425632] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-06T21:03:38.225630] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-06T21:03:38.267694] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T21:03:38.974415] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T21:03:38.977125] [INFO ] [REMOTE ] PRIM: Full fetch complete (63577 records). [2025-10-06T21:03:38.977258] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-06T21:03:39.033830] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-06T21:03:39.365110] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-10-06T21:03:39.365202] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-10-06T21:03:39.366193] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-10-06T21:03:39.366260] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-10-06T21:03:39.367559] [DEBUG] [LOCAL ] PRIM: Trimmed 63577 records to 44236 (keeping 200 days of data) [2025-10-06T21:03:39.651764] [DEBUG] [LOCAL ] PRIM: Primary data saved (44236 records). [2025-10-06T21:03:39.651918] [INFO ] [MAIN ] PRIM: Full history saved. [2025-10-06T21:03:39.652002] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRIM took 46.8s. Estimated remaining: 1h 30m 27s. Rate: 7.1 symbols/min [2025-10-06T21:03:39.827634] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-06T21:03:39.827557] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:03:39.829041] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-06T21:03:39.829110] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-06T21:03:39.829251] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-06T21:03:39.829309] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-06T21:03:39.829354] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-06T21:03:39.829387] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-06T21:03:40.162951] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-06T21:03:40.253907] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:03:40.625555] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-06T21:03:40.662778] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T21:03:40.959044] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:03:40.959497] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-06T21:03:40.959619] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:03:40.959706] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-06T21:03:40.960086] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:03:40.960217] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-06T21:03:40.960310] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-06T21:03:40.960378] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-06T21:03:40.960466] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-06T21:03:40.960540] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRSU took 1.3s. Estimated remaining: 1h 30m 16s. Rate: 7.1 symbols/min [2025-10-06T21:03:41.136807] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:03:41.164556] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T21:03:41.175818] [DEBUG] [LOCAL ] PRT: Loaded 5333 existing records from primary storage. [2025-10-06T21:03:41.176143] [INFO ] [MAIN ] PRT: Loaded 5333 existing records. [2025-10-06T21:03:41.353086] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:03:41.353335] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-06T21:03:41.353381] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-06T21:03:41.353847] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-06T21:03:41.353906] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-06T21:03:41.430714] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-06T21:03:41.718121] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:03:42.225535] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-06T21:03:42.623896] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T21:03:43.025583] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-06T21:03:43.825537] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-06T21:03:43.986120] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T21:03:44.594011] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T21:03:44.625494] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-06T21:03:44.807801] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T21:03:45.425635] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-06T21:03:46.225551] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-06T21:03:46.362492] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T21:03:47.025684] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-06T21:03:47.223166] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T21:03:47.568739] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T21:03:47.825521] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-06T21:03:48.580605] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-06T21:03:48.625592] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-06T21:03:49.397184] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T21:03:49.425486] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-06T21:03:50.225599] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-06T21:03:50.296068] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T21:03:50.667167] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T21:03:50.670074] [INFO ] [REMOTE ] PRM: Full fetch complete (64518 records). [2025-10-06T21:03:50.670184] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-06T21:03:51.033577] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-06T21:03:51.055103] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-10-06T21:03:51.055220] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-10-06T21:03:51.056562] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-10-06T21:03:51.056637] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-10-06T21:03:51.058555] [DEBUG] [LOCAL ] PRM: Trimmed 64518 records to 44679 (keeping 200 days of data) [2025-10-06T21:03:51.155818] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-06T21:03:51.344964] [DEBUG] [LOCAL ] PRM: Primary data saved (44679 records). [2025-10-06T21:03:51.345129] [INFO ] [MAIN ] PRM: Full history saved. [2025-10-06T21:03:51.345257] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRM took 34.1s. Estimated remaining: 1h 30m 8s. Rate: 7.1 symbols/min [2025-10-06T21:03:51.519380] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:03:51.572010] [DEBUG] [LOCAL ] PRU: Loaded 52123 existing records from primary storage. [2025-10-06T21:03:51.572352] [INFO ] [MAIN ] PRU: Loaded 52123 existing records. [2025-10-06T21:03:51.752535] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:03:51.752793] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-06T21:03:51.752858] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-06T21:03:51.753210] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-10-06T21:03:51.753279] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-06T21:03:51.830680] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-06T21:03:52.120024] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:03:52.625508] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-06T21:03:53.060913] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-06T21:03:53.378293] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T21:03:53.425481] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-06T21:03:53.508778] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T21:03:54.225553] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-06T21:03:54.238087] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T21:03:55.025590] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-06T21:03:55.825531] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-06T21:03:56.176013] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-06T21:03:56.531591] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T21:03:56.550432] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-06T21:03:56.625539] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-06T21:03:57.327351] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-06T21:03:57.425561] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-06T21:03:58.225544] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-06T21:03:59.025533] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-06T21:03:59.341982] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-06T21:03:59.735207] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T21:03:59.766867] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T21:03:59.825520] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-06T21:04:00.625553] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-06T21:04:01.318940] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T21:04:01.323006] [INFO ] [REMOTE ] PRMB: Full fetch complete (76076 records). [2025-10-06T21:04:01.323186] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-06T21:04:01.426583] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-06T21:04:01.656125] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T21:04:01.824845] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-10-06T21:04:01.824970] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-10-06T21:04:01.827034] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-10-06T21:04:01.827105] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-10-06T21:04:01.829361] [DEBUG] [LOCAL ] PRMB: Trimmed 76076 records to 53159 (keeping 200 days of data) [2025-10-06T21:04:02.204183] [DEBUG] [LOCAL ] PRMB: Primary data saved (53159 records). [2025-10-06T21:04:02.210755] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T21:04:02.210508] [INFO ] [MAIN ] PRMB: Full history saved. [2025-10-06T21:04:02.212860] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRMB took 34.6s. Estimated remaining: 1h 30m 1s. Rate: 7.1 symbols/min [2025-10-06T21:04:02.234449] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-06T21:04:02.411227] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:04:02.411521] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-06T21:04:02.411579] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-06T21:04:02.411758] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-06T21:04:02.411800] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-06T21:04:02.411841] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-06T21:04:02.411906] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-06T21:04:02.825526] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:04:03.025555] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-06T21:04:03.209512] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T21:04:03.825529] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-06T21:04:04.556205] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-06T21:04:04.625546] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-06T21:04:04.706500] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T21:04:05.425564] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-06T21:04:05.585204] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T21:04:06.173406] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T21:04:06.225485] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-06T21:04:06.737816] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-06T21:04:07.025545] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-06T21:04:07.523801] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-06T21:04:07.524804] [INFO ] [REMOTE ] PRT: Full fetch complete (9064 records). [2025-10-06T21:04:07.524888] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-06T21:04:07.833718] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-06T21:04:07.932681] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-06T21:04:07.932774] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-06T21:04:07.933156] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-06T21:04:07.933233] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-06T21:04:07.933779] [DEBUG] [LOCAL ] PRT: Trimmed 9064 records to 5232 (keeping 200 days of data) [2025-10-06T21:04:07.967463] [DEBUG] [LOCAL ] PRT: Primary data saved (5232 records). [2025-10-06T21:04:07.967611] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-06T21:04:07.967752] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRT took 27.0s. Estimated remaining: 1h 29m 51s. Rate: 7.1 symbols/min [2025-10-06T21:04:08.154535] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:04:08.195782] [DEBUG] [LOCAL ] PSA: Loaded 42296 existing records from primary storage. [2025-10-06T21:04:08.196112] [INFO ] [MAIN ] PSA: Loaded 42296 existing records. [2025-10-06T21:04:08.371900] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:04:08.372165] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-06T21:04:08.372211] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-06T21:04:08.372424] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-10-06T21:04:08.372483] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-06T21:04:08.473704] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-06T21:04:08.630614] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-06T21:04:08.809868] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:04:09.425543] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-06T21:04:10.087221] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T21:04:10.090233] [INFO ] [REMOTE ] PRO: Full fetch complete (52366 records). [2025-10-06T21:04:10.090403] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-06T21:04:10.226752] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-06T21:04:10.502565] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-10-06T21:04:10.502739] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-10-06T21:04:10.503702] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-10-06T21:04:10.503813] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-10-06T21:04:10.533782] [DEBUG] [LOCAL ] PRO: Trimmed 52366 records to 38575 (keeping 200 days of data) [2025-10-06T21:04:10.535746] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T21:04:10.747299] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-06T21:04:10.778336] [DEBUG] [LOCAL ] PRO: Primary data saved (38575 records). [2025-10-06T21:04:10.778512] [INFO ] [MAIN ] PRO: Full history saved. [2025-10-06T21:04:10.778617] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRO took 40.9s. Estimated remaining: 1h 29m 41s. Rate: 7.1 symbols/min [2025-10-06T21:04:10.950032] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:04:10.960156] [DEBUG] [LOCAL ] PSBD: Loaded 7287 existing records from primary storage. [2025-10-06T21:04:10.960377] [INFO ] [MAIN ] PSBD: Loaded 7287 existing records. [2025-10-06T21:04:11.030851] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-06T21:04:11.141178] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:04:11.141419] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-06T21:04:11.141472] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-06T21:04:11.141729] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-06T21:04:11.141798] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-06T21:04:11.540979] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:04:11.825531] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-06T21:04:12.034669] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T21:04:12.340832] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-06T21:04:12.625538] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-06T21:04:13.425533] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-06T21:04:13.689717] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T21:04:14.225557] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-06T21:04:14.392693] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T21:04:15.025540] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-06T21:04:15.193330] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T21:04:15.825528] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-06T21:04:16.415748] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T21:04:16.625532] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-06T21:04:16.793123] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-06T21:04:17.093612] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-06T21:04:17.425524] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-06T21:04:18.225515] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-06T21:04:18.272213] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T21:04:18.898087] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-06T21:04:19.025511] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-06T21:04:19.761046] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T21:04:19.825502] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-06T21:04:20.625519] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-06T21:04:20.634358] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T21:04:21.072456] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-06T21:04:21.425551] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-06T21:04:21.900915] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-06T21:04:22.225539] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-06T21:04:22.648777] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-06T21:04:23.025606] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-06T21:04:23.825544] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-06T21:04:23.964808] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T21:04:24.536715] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-06T21:04:24.625538] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-06T21:04:25.424278] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T21:04:25.425485] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-06T21:04:26.225552] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-06T21:04:26.282819] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-06T21:04:26.672585] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-06T21:04:27.025491] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-06T21:04:27.650914] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T21:04:27.653400] [INFO ] [REMOTE ] PRU: Full fetch complete (73840 records). [2025-10-06T21:04:27.653502] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-06T21:04:27.654174] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:04:27.654263] [FATAL] [MAIN ] PRU: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:04:27.654304] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:04:27.654342] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-06T21:04:27.654401] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-06T21:04:27.654434] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-10-06T21:04:27.654710] [DEBUG] [LOCAL ] PRU: Deleted derivative data file. [2025-10-06T21:04:27.654810] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PRU took 36.3s. Estimated remaining: 1h 29m 35s. Rate: 7.1 symbols/min [2025-10-06T21:04:27.819619] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:04:27.825502] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-06T21:04:27.830017] [DEBUG] [LOCAL ] PSF: Loaded 7060 existing records from primary storage. [2025-10-06T21:04:27.830194] [INFO ] [MAIN ] PSF: Loaded 7060 existing records. [2025-10-06T21:04:28.012424] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:04:28.012673] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-06T21:04:28.012735] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-06T21:04:28.012893] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-06T21:04:28.012949] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-06T21:04:28.356768] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:04:28.625488] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-06T21:04:28.639822] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T21:04:29.155225] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-06T21:04:29.425598] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-06T21:04:30.225635] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-06T21:04:30.390490] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T21:04:31.025523] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-06T21:04:31.096302] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T21:04:31.825551] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-06T21:04:31.834600] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-06T21:04:32.491250] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-06T21:04:32.625533] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-06T21:04:33.425522] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-06T21:04:33.590609] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T21:04:33.797093] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-06T21:04:34.225523] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-06T21:04:35.025492] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-06T21:04:35.204787] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T21:04:35.547592] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-06T21:04:35.825477] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-06T21:04:36.518755] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-06T21:04:36.625568] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-06T21:04:37.425495] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-06T21:04:37.636486] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-06T21:04:38.225546] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-06T21:04:38.308086] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T21:04:39.025504] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-06T21:04:39.191136] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-06T21:04:39.761235] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T21:04:39.825475] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-06T21:04:40.625515] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-06T21:04:40.721992] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T21:04:41.425503] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-06T21:04:41.616782] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T21:04:41.956386] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T21:04:41.957747] [INFO ] [REMOTE ] PSBD: Full fetch complete (9674 records). [2025-10-06T21:04:41.957839] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-06T21:04:42.230744] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-06T21:04:42.330489] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-06T21:04:42.330571] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-06T21:04:42.330825] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-06T21:04:42.330899] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-06T21:04:42.331320] [DEBUG] [LOCAL ] PSBD: Trimmed 9674 records to 7270 (keeping 200 days of data) [2025-10-06T21:04:42.376588] [DEBUG] [LOCAL ] PSBD: Primary data saved (7270 records). [2025-10-06T21:04:42.376719] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-06T21:04:42.376805] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PSBD took 31.6s. Estimated remaining: 1h 29m 29s. Rate: 7.1 symbols/min [2025-10-06T21:04:42.548454] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:04:42.582326] [DEBUG] [LOCAL ] PSFE: Loaded 30388 existing records from primary storage. [2025-10-06T21:04:42.582620] [INFO ] [MAIN ] PSFE: Loaded 30388 existing records. [2025-10-06T21:04:42.769452] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:04:42.769890] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-06T21:04:42.769946] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-06T21:04:42.770148] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-10-06T21:04:42.770205] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-06T21:04:42.887917] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T21:04:42.928923] [INFO ] [REMOTE ] PSA: Full fetch complete (59000 records). [2025-10-06T21:04:42.963890] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-06T21:04:43.027248] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-06T21:04:43.027151] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:04:43.045694] [FATAL] [MAIN ] PSA: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:04:43.066300] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:04:43.069988] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-06T21:04:43.070065] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-06T21:04:43.070123] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-10-06T21:04:43.081403] [DEBUG] [LOCAL ] PSA: Deleted derivative data file. [2025-10-06T21:04:43.111702] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PSA took 35.1s. Estimated remaining: 1h 29m 18s. Rate: 7.1 symbols/min [2025-10-06T21:04:43.268300] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:04:43.343582] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:04:43.386723] [DEBUG] [LOCAL ] PSN: Loaded 46674 existing records from primary storage. [2025-10-06T21:04:43.387042] [INFO ] [MAIN ] PSN: Loaded 46674 existing records. [2025-10-06T21:04:43.504123] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T21:04:43.531173] [INFO ] [REMOTE ] PRVS: Full fetch complete (1271 records). [2025-10-06T21:04:43.560368] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-06T21:04:43.655468] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:04:43.681902] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-06T21:04:43.694134] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-06T21:04:43.704763] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-10-06T21:04:43.715262] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-06T21:04:43.827587] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-06T21:04:43.887162] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-06T21:04:43.892379] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:04:43.898084] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:04:43.898214] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-06T21:04:43.932888] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-06T21:04:43.953952] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-06T21:04:43.972838] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-06T21:04:44.008186] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PRVS took 41.8s. Estimated remaining: 1h 29m 7s. Rate: 7.1 symbols/min [2025-10-06T21:04:44.318687] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:04:44.337451] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:04:44.375145] [DEBUG] [LOCAL ] PSO: Loaded 37454 existing records from primary storage. [2025-10-06T21:04:44.375432] [INFO ] [MAIN ] PSO: Loaded 37454 existing records. [2025-10-06T21:04:44.557605] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:04:44.557876] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-06T21:04:44.557936] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-06T21:04:44.558186] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-10-06T21:04:44.558259] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-06T21:04:44.632417] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-06T21:04:44.924426] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:04:44.940003] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-06T21:04:45.425567] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-06T21:04:46.215555] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T21:04:46.225468] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-06T21:04:46.786171] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T21:04:47.025593] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-06T21:04:47.825503] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-06T21:04:47.909830] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T21:04:47.951062] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T21:04:48.625528] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-06T21:04:49.338373] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T21:04:49.425518] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-06T21:04:50.148230] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-06T21:04:50.225491] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-06T21:04:50.421562] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T21:04:50.939492] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-06T21:04:51.025572] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-06T21:04:51.825522] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-06T21:04:51.896195] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T21:04:52.625578] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-06T21:04:53.161482] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T21:04:53.425715] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-06T21:04:53.647663] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T21:04:54.225581] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-06T21:04:55.039892] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-06T21:04:55.077382] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T21:04:55.111051] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-06T21:04:55.825571] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-06T21:04:56.507107] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-06T21:04:56.508685] [INFO ] [REMOTE ] PSF: Full fetch complete (9910 records). [2025-10-06T21:04:56.508773] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-06T21:04:56.630760] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-06T21:04:56.906495] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-06T21:04:56.906627] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-06T21:04:56.907235] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-06T21:04:56.907316] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-06T21:04:56.908538] [DEBUG] [LOCAL ] PSF: Trimmed 9910 records to 6963 (keeping 200 days of data) [2025-10-06T21:04:56.936396] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T21:04:56.997188] [DEBUG] [LOCAL ] PSF: Primary data saved (6963 records). [2025-10-06T21:04:56.997411] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-06T21:04:56.997551] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PSF took 29.3s. Estimated remaining: 1h 28m 60s. Rate: 7.1 symbols/min [2025-10-06T21:04:57.187550] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:04:57.238406] [DEBUG] [LOCAL ] PSQH: Loaded 35362 existing records from primary storage. [2025-10-06T21:04:57.238948] [INFO ] [MAIN ] PSQH: Loaded 35362 existing records. [2025-10-06T21:04:57.435913] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:04:57.430828] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-06T21:04:57.436236] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-06T21:04:57.437197] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-06T21:04:57.437599] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-06T21:04:57.437695] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-06T21:04:57.821245] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:04:58.225550] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-06T21:04:58.486580] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T21:04:59.025545] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-06T21:04:59.304405] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T21:04:59.825524] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-06T21:05:00.381622] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-06T21:05:00.625493] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-06T21:05:00.762599] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T21:05:01.135762] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T21:05:01.425549] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-06T21:05:02.041459] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T21:05:02.225560] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-06T21:05:03.025495] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-06T21:05:03.104493] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T21:05:03.825503] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-06T21:05:04.066233] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-06T21:05:04.625502] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-06T21:05:04.731971] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T21:05:05.205418] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T21:05:05.425584] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-06T21:05:06.175041] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T21:05:06.225549] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-06T21:05:07.025512] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-06T21:05:07.077159] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T21:05:07.438769] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T21:05:07.825520] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-06T21:05:08.424870] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T21:05:08.625597] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-06T21:05:09.288847] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T21:05:09.425528] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-06T21:05:09.843139] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-06T21:05:10.225517] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-06T21:05:10.926439] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-06T21:05:11.025531] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-06T21:05:11.825493] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-06T21:05:11.994954] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T21:05:12.075603] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T21:05:12.625524] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-06T21:05:13.276137] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T21:05:13.278314] [INFO ] [REMOTE ] PSO: Full fetch complete (51968 records). [2025-10-06T21:05:13.278404] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-06T21:05:13.435518] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-06T21:05:13.674438] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-10-06T21:05:13.674531] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-10-06T21:05:13.675499] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-10-06T21:05:13.675563] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-10-06T21:05:13.676696] [DEBUG] [LOCAL ] PSO: Trimmed 51968 records to 36922 (keeping 200 days of data) [2025-10-06T21:05:13.901404] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-06T21:05:13.937129] [DEBUG] [LOCAL ] PSO: Primary data saved (36922 records). [2025-10-06T21:05:13.937265] [INFO ] [MAIN ] PSO: Full history saved. [2025-10-06T21:05:13.937351] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSO took 29.9s. Estimated remaining: 1h 28m 54s. Rate: 7.1 symbols/min [2025-10-06T21:05:14.112077] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:05:14.162322] [DEBUG] [LOCAL ] PSTG: Loaded 53615 existing records from primary storage. [2025-10-06T21:05:14.162683] [INFO ] [MAIN ] PSTG: Loaded 53615 existing records. [2025-10-06T21:05:14.230810] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-06T21:05:14.347692] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:05:14.347925] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-06T21:05:14.347975] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-06T21:05:14.348228] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-10-06T21:05:14.348286] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-06T21:05:14.698639] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:05:15.025554] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-06T21:05:15.087897] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T21:05:15.825530] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-06T21:05:16.026940] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T21:05:16.625586] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-06T21:05:17.093400] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-06T21:05:17.367337] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T21:05:17.425529] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-06T21:05:17.980721] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T21:05:18.225583] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-06T21:05:18.554254] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T21:05:19.025517] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-06T21:05:19.358040] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T21:05:19.825529] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-06T21:05:20.625551] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-06T21:05:20.849889] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T21:05:20.850893] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T21:05:20.863696] [INFO ] [REMOTE ] PSFE: Full fetch complete (43061 records). [2025-10-06T21:05:20.863953] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-06T21:05:21.297000] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-10-06T21:05:21.297103] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-10-06T21:05:21.298107] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-10-06T21:05:21.298227] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-10-06T21:05:21.300102] [DEBUG] [LOCAL ] PSFE: Trimmed 43061 records to 29798 (keeping 200 days of data) [2025-10-06T21:05:21.425761] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-06T21:05:21.494447] [DEBUG] [LOCAL ] PSFE: Primary data saved (29798 records). [2025-10-06T21:05:21.494609] [INFO ] [MAIN ] PSFE: Full history saved. [2025-10-06T21:05:21.494725] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSFE took 39.1s. Estimated remaining: 1h 28m 46s. Rate: 7.1 symbols/min [2025-10-06T21:05:21.665467] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:05:21.688921] [DEBUG] [LOCAL ] PSTL: Loaded 20371 existing records from primary storage. [2025-10-06T21:05:21.689216] [INFO ] [MAIN ] PSTL: Loaded 20371 existing records. [2025-10-06T21:05:21.869588] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:05:21.869955] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-06T21:05:21.870009] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-06T21:05:21.870254] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-10-06T21:05:21.870312] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-06T21:05:22.235284] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:05:22.235442] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-06T21:05:22.256005] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T21:05:23.025557] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-06T21:05:23.484383] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-06T21:05:23.632605] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T21:05:23.636813] [INFO ] [REMOTE ] PSN: Full fetch complete (67012 records). [2025-10-06T21:05:23.637105] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-06T21:05:23.830600] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-06T21:05:24.076593] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-10-06T21:05:24.076778] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-10-06T21:05:24.077826] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-10-06T21:05:24.077892] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-10-06T21:05:24.079245] [DEBUG] [LOCAL ] PSN: Trimmed 67012 records to 45927 (keeping 200 days of data) [2025-10-06T21:05:24.189538] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T21:05:24.388236] [DEBUG] [LOCAL ] PSN: Primary data saved (45927 records). [2025-10-06T21:05:24.388387] [INFO ] [MAIN ] PSN: Full history saved. [2025-10-06T21:05:24.388482] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSN took 41.3s. Estimated remaining: 1h 28m 35s. Rate: 7.1 symbols/min [2025-10-06T21:05:24.556243] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:05:24.608033] [DEBUG] [LOCAL ] PSX: Loaded 53881 existing records from primary storage. [2025-10-06T21:05:24.608435] [INFO ] [MAIN ] PSX: Loaded 53881 existing records. [2025-10-06T21:05:24.630956] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-06T21:05:24.787504] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:05:24.787753] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-06T21:05:24.787807] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-06T21:05:24.788139] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-10-06T21:05:24.788214] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-06T21:05:25.157602] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:05:25.363366] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T21:05:25.425546] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-06T21:05:26.225620] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-06T21:05:26.337721] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T21:05:26.349243] [DEBUG] [REMOTE ] PSX: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-06T21:05:26.350597] [WARN ] [REMOTE ] PSX: No data returned for month 2024-12 [2025-10-06T21:05:26.350748] [FATAL] [REMOTE ] PSX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:05:26.367007] [FATAL] [MAIN ] PSX: Failed to fetch primary data. [2025-10-06T21:05:26.367231] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:05:26.367463] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-06T21:05:26.368046] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-06T21:05:26.368939] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-06T21:05:26.375372] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-10-06T21:05:26.375980] [DEBUG] [LOCAL ] PSX: Deleted derivative data file. [2025-10-06T21:05:26.376065] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSX took 2.0s. Estimated remaining: 1h 28m 24s. Rate: 7.1 symbols/min [2025-10-06T21:05:26.546581] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:05:26.564896] [DEBUG] [LOCAL ] PTA: Loaded 15164 existing records from primary storage. [2025-10-06T21:05:26.565170] [INFO ] [MAIN ] PTA: Loaded 15164 existing records. [2025-10-06T21:05:26.765148] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:05:26.765403] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-06T21:05:26.765450] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-06T21:05:26.765632] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-10-06T21:05:26.765723] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-06T21:05:27.030765] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-06T21:05:27.126849] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:05:27.825523] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-06T21:05:28.624090] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T21:05:28.628611] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-06T21:05:29.051281] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-06T21:05:29.425620] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-06T21:05:30.225519] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-06T21:05:30.524402] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T21:05:30.702102] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T21:05:31.025558] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-06T21:05:31.065254] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T21:05:31.825553] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-06T21:05:32.105350] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T21:05:32.625551] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-06T21:05:33.425545] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-06T21:05:33.502636] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T21:05:33.757665] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-06T21:05:34.225518] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-06T21:05:34.935010] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T21:05:34.937408] [INFO ] [REMOTE ] PSQH: Full fetch complete (53470 records). [2025-10-06T21:05:34.937500] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-06T21:05:35.030697] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-06T21:05:35.074989] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T21:05:35.346873] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-06T21:05:35.346981] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-06T21:05:35.347947] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-06T21:05:35.348013] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-06T21:05:35.349306] [DEBUG] [LOCAL ] PSQH: Trimmed 53470 records to 34901 (keeping 200 days of data) [2025-10-06T21:05:35.549911] [DEBUG] [LOCAL ] PSQH: Primary data saved (34901 records). [2025-10-06T21:05:35.550059] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-06T21:05:35.550142] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSQH took 38.6s. Estimated remaining: 1h 28m 16s. Rate: 7.1 symbols/min [2025-10-06T21:05:35.717788] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:05:35.755674] [DEBUG] [LOCAL ] PTY: Loaded 37828 existing records from primary storage. [2025-10-06T21:05:35.755978] [INFO ] [MAIN ] PTY: Loaded 37828 existing records. [2025-10-06T21:05:35.829798] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-06T21:05:35.936776] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:05:35.937048] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-06T21:05:35.937095] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-06T21:05:35.937538] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-10-06T21:05:35.937599] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-06T21:05:36.302919] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T21:05:36.308282] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:05:36.625531] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-06T21:05:37.425514] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-06T21:05:37.587389] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T21:05:38.166523] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T21:05:38.225466] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-06T21:05:38.487012] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-06T21:05:39.025522] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-06T21:05:39.774028] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T21:05:39.789804] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-06T21:05:39.825468] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-06T21:05:40.625587] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-06T21:05:41.286587] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T21:05:41.425514] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-06T21:05:41.653560] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T21:05:42.225582] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-06T21:05:43.025610] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-06T21:05:43.143177] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T21:05:43.179604] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T21:05:43.825510] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-06T21:05:44.555690] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T21:05:44.625553] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-06T21:05:45.425527] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-06T21:05:45.911276] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-06T21:05:46.225534] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-06T21:05:46.290882] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T21:05:46.524084] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-06T21:05:46.983279] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-06T21:05:47.025584] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-06T21:05:47.825545] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-06T21:05:48.158527] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T21:05:48.625557] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-06T21:05:49.425528] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-06T21:05:49.725580] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T21:05:49.958309] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-06T21:05:50.225513] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-06T21:05:50.640551] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-06T21:05:51.025601] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-06T21:05:51.825564] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-06T21:05:51.856541] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T21:05:51.858948] [INFO ] [REMOTE ] PTA: Full fetch complete (23218 records). [2025-10-06T21:05:51.859058] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-06T21:05:52.255157] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-10-06T21:05:52.255332] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-10-06T21:05:52.255979] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-10-06T21:05:52.256065] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-10-06T21:05:52.257116] [DEBUG] [LOCAL ] PTA: Trimmed 23218 records to 14982 (keeping 200 days of data) [2025-10-06T21:05:52.381960] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-06T21:05:52.423737] [DEBUG] [LOCAL ] PTA: Primary data saved (14982 records). [2025-10-06T21:05:52.423890] [INFO ] [MAIN ] PTA: Full history saved. [2025-10-06T21:05:52.423983] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PTA took 26.0s. Estimated remaining: 1h 28m 11s. Rate: 7.1 symbols/min [2025-10-06T21:05:52.595310] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:05:52.635159] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-06T21:05:52.638473] [DEBUG] [LOCAL ] PUK: Loaded 45329 existing records from primary storage. [2025-10-06T21:05:52.638908] [INFO ] [MAIN ] PUK: Loaded 45329 existing records. [2025-10-06T21:05:52.818334] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:05:52.818517] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-06T21:05:52.818564] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-06T21:05:52.818778] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-10-06T21:05:52.818834] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-06T21:05:53.181636] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:05:53.427539] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-06T21:05:53.429928] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T21:05:53.842849] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T21:05:54.225556] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-06T21:05:54.893240] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T21:05:55.025568] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-06T21:05:55.417807] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T21:05:55.825533] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-06T21:05:56.625506] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-06T21:05:56.740161] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T21:05:57.404103] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T21:05:57.425501] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-06T21:05:58.136491] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T21:05:58.139881] [INFO ] [REMOTE ] PSTG: Full fetch complete (76543 records). [2025-10-06T21:05:58.139993] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-06T21:05:58.230973] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-06T21:05:58.545351] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-10-06T21:05:58.545460] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-10-06T21:05:58.546664] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-10-06T21:05:58.546738] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-10-06T21:05:58.548354] [DEBUG] [LOCAL ] PSTG: Trimmed 76543 records to 52841 (keeping 200 days of data) [2025-10-06T21:05:58.884071] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T21:05:58.904860] [DEBUG] [LOCAL ] PSTG: Primary data saved (52841 records). [2025-10-06T21:05:58.905051] [INFO ] [MAIN ] PSTG: Full history saved. [2025-10-06T21:05:58.905154] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PSTG took 45.0s. Estimated remaining: 1h 28m 2s. Rate: 7.1 symbols/min [2025-10-06T21:05:59.030612] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-06T21:05:59.080077] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:05:59.080235] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-06T21:05:59.080272] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-06T21:05:59.080384] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-06T21:05:59.080475] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-06T21:05:59.080539] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-06T21:05:59.080573] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-06T21:05:59.451030] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:05:59.462780] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-06T21:05:59.825564] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-06T21:06:00.625573] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-06T21:06:00.739728] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T21:06:01.388795] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T21:06:01.425487] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-06T21:06:02.225567] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-06T21:06:02.413859] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T21:06:02.597326] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T21:06:02.599754] [INFO ] [REMOTE ] PTY: Full fetch complete (53876 records). [2025-10-06T21:06:02.599851] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-06T21:06:02.984797] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-06T21:06:02.984879] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-06T21:06:02.985829] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-06T21:06:02.985893] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-06T21:06:02.987029] [DEBUG] [LOCAL ] PTY: Trimmed 53876 records to 37336 (keeping 200 days of data) [2025-10-06T21:06:03.043925] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-06T21:06:03.230017] [DEBUG] [LOCAL ] PTY: Primary data saved (37336 records). [2025-10-06T21:06:03.230176] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-06T21:06:03.230282] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PTY took 27.7s. Estimated remaining: 1h 27m 52s. Rate: 7.1 symbols/min [2025-10-06T21:06:03.316166] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T21:06:03.346264] [INFO ] [REMOTE ] PSTL: Full fetch complete (29755 records). [2025-10-06T21:06:03.357302] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-06T21:06:03.524381] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:06:03.829004] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-06T21:06:03.843417] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-10-06T21:06:03.863856] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-10-06T21:06:03.867312] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-10-06T21:06:03.867436] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-10-06T21:06:03.870154] [DEBUG] [LOCAL ] PVH: Loaded 51026 existing records from primary storage. [2025-10-06T21:06:03.870840] [DEBUG] [LOCAL ] PSTL: Trimmed 29755 records to 20041 (keeping 200 days of data) [2025-10-06T21:06:03.871292] [INFO ] [MAIN ] PVH: Loaded 51026 existing records. [2025-10-06T21:06:04.202369] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:06:04.203852] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-06T21:06:04.204258] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-06T21:06:04.205444] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-10-06T21:06:04.206361] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-06T21:06:04.647104] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:06:04.649974] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-06T21:06:04.659736] [DEBUG] [LOCAL ] PSTL: Primary data saved (20041 records). [2025-10-06T21:06:04.659950] [INFO ] [MAIN ] PSTL: Full history saved. [2025-10-06T21:06:04.660050] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PSTL took 43.2s. Estimated remaining: 1h 27m 41s. Rate: 7.1 symbols/min [2025-10-06T21:06:04.851776] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:06:04.885113] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-06T21:06:04.899504] [DEBUG] [LOCAL ] PVL: Loaded 4798 existing records from primary storage. [2025-10-06T21:06:04.900044] [INFO ] [MAIN ] PVL: Loaded 4798 existing records. [2025-10-06T21:06:05.075932] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:06:05.076199] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-06T21:06:05.076247] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-06T21:06:05.076404] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-06T21:06:05.076460] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-06T21:06:05.425628] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-06T21:06:05.431111] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:06:05.622143] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T21:06:06.225554] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-06T21:06:06.456248] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T21:06:07.025548] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-06T21:06:07.213259] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T21:06:07.676506] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T21:06:07.825528] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-06T21:06:08.625544] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-06T21:06:08.781448] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T21:06:09.425486] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-06T21:06:09.602103] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T21:06:10.225609] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-06T21:06:10.382573] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T21:06:11.025615] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-06T21:06:11.208330] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T21:06:11.655820] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-06T21:06:11.825491] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-06T21:06:11.996636] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-06T21:06:12.625561] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-06T21:06:13.425505] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-06T21:06:13.700883] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T21:06:14.130679] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T21:06:14.163740] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-06T21:06:14.225494] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-06T21:06:15.025548] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-06T21:06:15.825543] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-06T21:06:16.058925] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T21:06:16.340916] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-06T21:06:16.625528] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-06T21:06:16.888940] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T21:06:17.425524] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-06T21:06:18.225511] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-06T21:06:18.369024] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T21:06:18.839465] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T21:06:19.025520] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-06T21:06:19.733791] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-06T21:06:19.825541] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-06T21:06:20.142231] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-06T21:06:20.610713] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-06T21:06:20.625492] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-06T21:06:21.425515] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-06T21:06:21.431784] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T21:06:22.225560] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-06T21:06:23.025557] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-06T21:06:23.083309] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T21:06:23.668225] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T21:06:23.671306] [INFO ] [REMOTE ] PUK: Full fetch complete (65213 records). [2025-10-06T21:06:23.671450] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-06T21:06:23.830004] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T21:06:23.830123] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-06T21:06:24.132459] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-10-06T21:06:24.132546] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-10-06T21:06:24.133567] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-10-06T21:06:24.133702] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-10-06T21:06:24.135074] [DEBUG] [LOCAL ] PUK: Trimmed 65213 records to 44658 (keeping 200 days of data) [2025-10-06T21:06:24.418321] [DEBUG] [LOCAL ] PUK: Primary data saved (44658 records). [2025-10-06T21:06:24.418473] [INFO ] [MAIN ] PUK: Full history saved. [2025-10-06T21:06:24.418564] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PUK took 32.0s. Estimated remaining: 1h 27m 36s. Rate: 7.1 symbols/min [2025-10-06T21:06:24.590486] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:06:24.634747] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-06T21:06:24.637992] [DEBUG] [LOCAL ] PWR: Loaded 47641 existing records from primary storage. [2025-10-06T21:06:24.638458] [INFO ] [MAIN ] PWR: Loaded 47641 existing records. [2025-10-06T21:06:24.817591] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:06:24.817905] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-06T21:06:24.817954] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-06T21:06:24.818189] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-10-06T21:06:24.818248] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-06T21:06:25.176934] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:06:25.368304] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T21:06:25.425501] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-06T21:06:25.852138] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-06T21:06:26.225541] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-06T21:06:27.025555] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-06T21:06:27.092140] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T21:06:27.134130] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T21:06:27.825550] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-06T21:06:28.625512] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-06T21:06:28.907014] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T21:06:29.154621] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-06T21:06:29.425531] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-06T21:06:30.225571] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-06T21:06:30.613361] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T21:06:31.025577] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-06T21:06:31.197915] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T21:06:31.259992] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T21:06:31.825487] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-06T21:06:31.975273] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-06T21:06:32.625527] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-06T21:06:33.425508] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-06T21:06:33.537553] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T21:06:34.037881] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T21:06:34.038716] [INFO ] [REMOTE ] PVL: Full fetch complete (7427 records). [2025-10-06T21:06:34.038785] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-06T21:06:34.225875] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-06T21:06:34.412430] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-06T21:06:34.412580] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-06T21:06:34.412849] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-06T21:06:34.412931] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-06T21:06:34.413751] [DEBUG] [LOCAL ] PVL: Trimmed 7427 records to 4697 (keeping 200 days of data) [2025-10-06T21:06:34.466813] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T21:06:34.482663] [DEBUG] [LOCAL ] PVL: Primary data saved (4697 records). [2025-10-06T21:06:34.482787] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-06T21:06:34.482863] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PVL took 29.8s. Estimated remaining: 1h 27m 28s. Rate: 7.1 symbols/min [2025-10-06T21:06:34.650437] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:06:34.684962] [DEBUG] [LOCAL ] PX: Loaded 34896 existing records from primary storage. [2025-10-06T21:06:34.685252] [INFO ] [MAIN ] PX: Loaded 34896 existing records. [2025-10-06T21:06:34.866836] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:06:34.867075] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-06T21:06:34.867128] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-06T21:06:34.867347] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-10-06T21:06:34.867404] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-06T21:06:35.040612] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-06T21:06:35.223926] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:06:35.437860] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-06T21:06:35.825506] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-06T21:06:36.625503] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-06T21:06:36.942975] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T21:06:36.986538] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-06T21:06:37.425587] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-06T21:06:37.884764] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T21:06:37.887499] [INFO ] [REMOTE ] PUMP: Full fetch complete (71712 records). [2025-10-06T21:06:37.887625] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-06T21:06:38.252140] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-06T21:06:38.278691] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-10-06T21:06:38.278781] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-10-06T21:06:38.280212] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-10-06T21:06:38.280970] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-10-06T21:06:38.283014] [DEBUG] [LOCAL ] PUMP: Trimmed 71712 records to 49373 (keeping 200 days of data) [2025-10-06T21:06:38.561627] [DEBUG] [LOCAL ] PUMP: Primary data saved (49373 records). [2025-10-06T21:06:38.561798] [INFO ] [MAIN ] PUMP: Full history saved. [2025-10-06T21:06:38.561888] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PUMP took 39.7s. Estimated remaining: 1h 27m 18s. Rate: 7.1 symbols/min [2025-10-06T21:06:38.739674] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:06:38.739888] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-06T21:06:38.740060] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-06T21:06:38.740192] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-06T21:06:38.740256] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-06T21:06:38.740328] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-06T21:06:38.740396] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-06T21:06:39.025851] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-06T21:06:39.167213] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:06:39.168906] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T21:06:39.708897] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T21:06:39.714134] [INFO ] [REMOTE ] PVH: Full fetch complete (70859 records). [2025-10-06T21:06:39.714402] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-06T21:06:39.829869] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-06T21:06:40.340698] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-10-06T21:06:40.341093] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-10-06T21:06:40.343249] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-10-06T21:06:40.343569] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-10-06T21:06:40.377249] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T21:06:40.375224] [DEBUG] [LOCAL ] PVH: Trimmed 70859 records to 50263 (keeping 200 days of data) [2025-10-06T21:06:40.626786] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-06T21:06:40.732516] [DEBUG] [LOCAL ] PVH: Primary data saved (50263 records). [2025-10-06T21:06:40.732689] [INFO ] [MAIN ] PVH: Full history saved. [2025-10-06T21:06:40.732788] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PVH took 37.5s. Estimated remaining: 1h 27m 8s. Rate: 7.1 symbols/min [2025-10-06T21:06:40.900731] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:06:40.929328] [DEBUG] [LOCAL ] QD: Loaded 28286 existing records from primary storage. [2025-10-06T21:06:40.929616] [INFO ] [MAIN ] QD: Loaded 28286 existing records. [2025-10-06T21:06:41.111396] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:06:41.111629] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-06T21:06:41.111712] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-06T21:06:41.111939] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-06T21:06:41.111996] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-06T21:06:41.431529] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-06T21:06:41.498235] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:06:41.504794] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T21:06:41.631127] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T21:06:42.225562] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-06T21:06:43.025575] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-06T21:06:43.723435] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T21:06:43.825474] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-06T21:06:43.870775] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-06T21:06:44.559508] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T21:06:44.625492] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-06T21:06:45.307793] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T21:06:45.425558] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-06T21:06:45.573454] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T21:06:46.225544] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-06T21:06:46.748335] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-06T21:06:47.025584] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-06T21:06:47.503344] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T21:06:47.825485] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-06T21:06:47.940806] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-06T21:06:48.625527] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-06T21:06:49.301009] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T21:06:49.425555] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-06T21:06:49.558776] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T21:06:50.225593] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-06T21:06:51.025486] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-06T21:06:51.149135] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T21:06:51.219072] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T21:06:51.825546] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-06T21:06:52.338450] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T21:06:52.625604] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-06T21:06:53.367568] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T21:06:53.425538] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-06T21:06:53.751834] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T21:06:54.225536] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-06T21:06:54.956198] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T21:06:55.025593] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T21:06:55.025670] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-06T21:06:55.029032] [INFO ] [REMOTE ] PWR: Full fetch complete (68489 records). [2025-10-06T21:06:55.029177] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-06T21:06:55.030355] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:06:55.030540] [FATAL] [MAIN ] PWR: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:06:55.030639] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:06:55.030765] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-06T21:06:55.030864] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-06T21:06:55.030919] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-10-06T21:06:55.031123] [DEBUG] [LOCAL ] PWR: Deleted derivative data file. [2025-10-06T21:06:55.031225] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PWR took 30.6s. Estimated remaining: 1h 27m 1s. Rate: 7.1 symbols/min [2025-10-06T21:06:55.200424] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:06:55.245249] [DEBUG] [LOCAL ] QGEN: Loaded 49814 existing records from primary storage. [2025-10-06T21:06:55.245578] [INFO ] [MAIN ] QGEN: Loaded 49814 existing records. [2025-10-06T21:06:55.419207] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:06:55.419446] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-06T21:06:55.419498] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-06T21:06:55.420581] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-10-06T21:06:55.420669] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-06T21:06:55.773472] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:06:55.825522] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-06T21:06:56.538426] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T21:06:56.625499] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-06T21:06:56.955590] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T21:06:57.425529] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-06T21:06:58.225539] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-06T21:06:58.454316] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T21:06:58.456120] [INFO ] [REMOTE ] PX: Full fetch complete (50603 records). [2025-10-06T21:06:58.456215] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-06T21:06:58.855183] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-10-06T21:06:58.855361] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-10-06T21:06:58.856290] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-10-06T21:06:58.856356] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-10-06T21:06:58.857579] [DEBUG] [LOCAL ] PX: Trimmed 50603 records to 34376 (keeping 200 days of data) [2025-10-06T21:06:59.027745] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-06T21:06:59.081809] [DEBUG] [LOCAL ] PX: Primary data saved (34376 records). [2025-10-06T21:06:59.081983] [INFO ] [MAIN ] PX: Full history saved. [2025-10-06T21:06:59.082116] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PX took 24.6s. Estimated remaining: 1h 26m 51s. Rate: 7.1 symbols/min [2025-10-06T21:06:59.254390] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:06:59.291219] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-06T21:06:59.349843] [DEBUG] [LOCAL ] QS: Loaded 54523 existing records from primary storage. [2025-10-06T21:06:59.350305] [INFO ] [MAIN ] QS: Loaded 54523 existing records. [2025-10-06T21:06:59.526239] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:06:59.526526] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-06T21:06:59.526578] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-06T21:06:59.527959] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-10-06T21:06:59.528035] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-06T21:06:59.832221] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-06T21:06:59.927096] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:07:00.046541] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T21:07:00.381500] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-06T21:07:00.625538] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-06T21:07:01.425532] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-06T21:07:02.225545] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-06T21:07:02.321464] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-06T21:07:02.378285] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T21:07:03.025496] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-06T21:07:03.092449] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-06T21:07:03.830723] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-06T21:07:03.854067] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-06T21:07:04.625544] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-06T21:07:05.131811] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-06T21:07:05.425509] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-06T21:07:05.862438] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-10-06T21:07:06.225561] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-06T21:07:06.814227] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T21:07:07.025565] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-06T21:07:07.203597] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-06T21:07:07.825547] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-06T21:07:08.294190] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-06T21:07:08.625586] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-06T21:07:08.692381] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-06T21:07:09.425546] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-06T21:07:10.014735] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-06T21:07:10.225525] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-06T21:07:10.687205] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-06T21:07:11.025614] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-06T21:07:11.284781] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T21:07:11.286432] [INFO ] [REMOTE ] QD: Full fetch complete (40108 records). [2025-10-06T21:07:11.286525] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-06T21:07:11.699942] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-06T21:07:11.700153] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-06T21:07:11.701775] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-06T21:07:11.701910] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-06T21:07:11.703501] [DEBUG] [LOCAL ] QD: Trimmed 40108 records to 27749 (keeping 200 days of data) [2025-10-06T21:07:11.826054] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-06T21:07:11.889691] [DEBUG] [LOCAL ] QD: Primary data saved (27749 records). [2025-10-06T21:07:11.889905] [INFO ] [MAIN ] QD: Full history saved. [2025-10-06T21:07:11.890017] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. QD took 31.2s. Estimated remaining: 1h 26m 45s. Rate: 7.1 symbols/min [2025-10-06T21:07:12.068288] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-06T21:07:12.138353] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:07:12.200385] [DEBUG] [LOCAL ] QSR: Loaded 53202 existing records from primary storage. [2025-10-06T21:07:12.200951] [INFO ] [MAIN ] QSR: Loaded 53202 existing records. [2025-10-06T21:07:12.393078] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:07:12.393551] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-06T21:07:12.393681] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-06T21:07:12.394078] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-10-06T21:07:12.394140] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-06T21:07:12.635196] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-06T21:07:12.783868] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:07:12.815819] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T21:07:13.425560] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-06T21:07:14.097315] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-06T21:07:14.225528] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-06T21:07:15.025525] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-06T21:07:15.125924] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-06T21:07:15.345618] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-06T21:07:15.825566] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-06T21:07:16.639313] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-06T21:07:16.669685] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-06T21:07:16.769936] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T21:07:17.272277] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T21:07:17.425610] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-06T21:07:18.225561] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-06T21:07:19.025526] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-06T21:07:19.487534] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-06T21:07:19.634078] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-10-06T21:07:19.825545] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-06T21:07:20.085875] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-06T21:07:20.547768] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T21:07:20.625551] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-06T21:07:21.425560] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-06T21:07:22.227635] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-06T21:07:22.232672] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-06T21:07:22.526915] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-06T21:07:23.025694] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-06T21:07:23.825512] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-06T21:07:24.248176] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-06T21:07:24.296780] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-10-06T21:07:24.567809] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T21:07:24.625556] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-06T21:07:25.425608] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-06T21:07:26.225581] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-06T21:07:26.369524] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T21:07:26.825047] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-10-06T21:07:27.025604] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-06T21:07:27.218686] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T21:07:27.825555] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-06T21:07:28.625630] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-06T21:07:28.999803] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-06T21:07:29.138245] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-06T21:07:29.425618] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-06T21:07:29.658584] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-06T21:07:30.225542] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-06T21:07:31.025556] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-06T21:07:31.202747] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-06T21:07:31.264146] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T21:07:31.294833] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-06T21:07:31.297861] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-06T21:07:31.297999] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-06T21:07:31.299128] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:07:31.299228] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:07:31.299273] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:07:31.299314] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-06T21:07:31.299439] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-06T21:07:31.299496] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-06T21:07:31.299580] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-06T21:07:31.299699] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QBTS took 52.7s. Estimated remaining: 1h 26m 40s. Rate: 7.1 symbols/min [2025-10-06T21:07:31.490717] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:07:31.502722] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T21:07:31.508066] [INFO ] [REMOTE ] QGEN: Full fetch complete (70201 records). [2025-10-06T21:07:31.508359] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-06T21:07:31.789707] [DEBUG] [LOCAL ] QTWO: Loaded 39720 existing records from primary storage. [2025-10-06T21:07:31.830786] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-06T21:07:31.838312] [INFO ] [MAIN ] QTWO: Loaded 39720 existing records. [2025-10-06T21:07:32.218994] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-10-06T21:07:32.222919] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-10-06T21:07:32.224895] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-10-06T21:07:32.251185] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:07:32.251902] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-06T21:07:32.251608] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-10-06T21:07:32.251985] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-06T21:07:32.252608] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-10-06T21:07:32.253069] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-06T21:07:32.345322] [DEBUG] [LOCAL ] QGEN: Trimmed 70201 records to 49157 (keeping 200 days of data) [2025-10-06T21:07:32.629491] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-06T21:07:32.940362] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:07:33.142726] [DEBUG] [LOCAL ] QGEN: Primary data saved (49157 records). [2025-10-06T21:07:33.142887] [INFO ] [MAIN ] QGEN: Full history saved. [2025-10-06T21:07:33.142979] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QGEN took 38.1s. Estimated remaining: 1h 26m 29s. Rate: 7.1 symbols/min [2025-10-06T21:07:33.425541] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-06T21:07:34.636553] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-06T21:07:34.649311] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-06T21:07:34.690886] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-10-06T21:07:35.025574] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-06T21:07:35.055874] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T21:07:35.825540] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-06T21:07:36.472858] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T21:07:36.625538] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-06T21:07:37.183604] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-06T21:07:37.186846] [INFO ] [REMOTE ] QS: Full fetch complete (77886 records). [2025-10-06T21:07:37.186967] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-06T21:07:37.620019] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T21:07:37.654506] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-10-06T21:07:37.654286] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-06T21:07:37.654729] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-10-06T21:07:37.656085] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-10-06T21:07:37.656177] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-10-06T21:07:37.658556] [DEBUG] [LOCAL ] QS: Trimmed 77886 records to 53745 (keeping 200 days of data) [2025-10-06T21:07:37.976162] [DEBUG] [LOCAL ] QS: Primary data saved (53745 records). [2025-10-06T21:07:37.976315] [INFO ] [MAIN ] QS: Full history saved. [2025-10-06T21:07:37.976396] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QS took 38.9s. Estimated remaining: 1h 26m 19s. Rate: 7.1 symbols/min [2025-10-06T21:07:38.669003] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-06T21:07:38.684955] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-06T21:07:39.283538] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T21:07:39.291698] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-06T21:07:40.237145] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T21:07:40.241333] [INFO ] [REMOTE ] QSR: Full fetch complete (75849 records). [2025-10-06T21:07:40.241528] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-06T21:07:40.673566] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-10-06T21:07:40.673745] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-10-06T21:07:40.674853] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-10-06T21:07:40.674917] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-10-06T21:07:40.676401] [DEBUG] [LOCAL ] QSR: Trimmed 75849 records to 52452 (keeping 200 days of data) [2025-10-06T21:07:40.809592] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T21:07:40.820534] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-06T21:07:41.037941] [DEBUG] [LOCAL ] QSR: Primary data saved (52452 records). [2025-10-06T21:07:41.038112] [INFO ] [MAIN ] QSR: Full history saved. [2025-10-06T21:07:41.038241] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QSR took 29.1s. Estimated remaining: 1h 26m 9s. Rate: 7.1 symbols/min [2025-10-06T21:07:42.267284] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T21:07:42.276569] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-06T21:07:43.877692] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T21:07:43.886266] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-06T21:07:45.298915] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T21:07:45.306331] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-06T21:07:46.728774] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T21:07:46.736527] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-06T21:07:48.375379] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T21:07:48.385930] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-06T21:07:49.957036] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T21:07:49.967375] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-06T21:07:51.324489] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T21:07:51.327193] [INFO ] [REMOTE ] QTWO: Full fetch complete (57565 records). [2025-10-06T21:07:51.327329] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-06T21:07:51.710986] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-10-06T21:07:51.711070] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-10-06T21:07:51.712009] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-10-06T21:07:51.712074] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-10-06T21:07:51.713301] [DEBUG] [LOCAL ] QTWO: Trimmed 57565 records to 39198 (keeping 200 days of data) [2025-10-06T21:07:51.949333] [DEBUG] [LOCAL ] QTWO: Primary data saved (39198 records). [2025-10-06T21:07:51.949499] [INFO ] [MAIN ] QTWO: Full history saved. [2025-10-06T21:07:51.949622] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. QTWO took 20.6s. Estimated remaining: 1h 26m 2s. Rate: 7.1 symbols/min [2025-10-06T21:07:52.625293] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:07:52.732188] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:07:52.736567] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:07:52.761479] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:07:52.776793] [DEBUG] [LOCAL ] QVCC: Loaded 9027 existing records from primary storage. [2025-10-06T21:07:52.777053] [DEBUG] [LOCAL ] QVCD: Loaded 4578 existing records from primary storage. [2025-10-06T21:07:52.777469] [INFO ] [MAIN ] QVCD: Loaded 4578 existing records. [2025-10-06T21:07:52.777688] [INFO ] [MAIN ] QVCC: Loaded 9027 existing records. [2025-10-06T21:07:53.073820] [DEBUG] [LOCAL ] QUAD: Loaded 23662 existing records from primary storage. [2025-10-06T21:07:53.163406] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:07:53.180736] [INFO ] [MAIN ] QUAD: Loaded 23662 existing records. [2025-10-06T21:07:53.196565] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-06T21:07:53.200904] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:07:53.206363] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-06T21:07:53.207545] [DEBUG] [LOCAL ] QXO: Loaded 54046 existing records from primary storage. [2025-10-06T21:07:53.232376] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-06T21:07:53.238425] [INFO ] [MAIN ] QXO: Loaded 54046 existing records. [2025-10-06T21:07:53.232695] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-06T21:07:53.279783] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-06T21:07:53.288989] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-06T21:07:53.455777] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-10-06T21:07:53.522330] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-06T21:07:53.767815] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:07:53.888568] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:07:53.959953] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-06T21:07:53.965274] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-06T21:07:53.981251] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-06T21:07:54.020548] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-06T21:07:54.020188] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-06T21:07:54.020841] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-06T21:07:54.021512] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-10-06T21:07:54.070528] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-06T21:07:54.652194] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:07:54.708951] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-06T21:07:54.778060] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:07:54.816441] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-06T21:07:55.275716] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:07:55.291669] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-06T21:07:55.346705] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:07:55.347110] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-06T21:07:55.678576] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T21:07:55.680292] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-06T21:07:55.805098] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T21:07:55.807740] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-06T21:07:56.317094] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-06T21:07:56.318550] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-06T21:07:56.528314] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-06T21:07:56.530808] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-06T21:07:56.651714] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T21:07:56.657870] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-06T21:07:56.854364] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-06T21:07:56.856135] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-06T21:07:57.058241] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-06T21:07:57.060081] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-06T21:07:57.188965] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T21:07:57.199066] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-06T21:07:57.298609] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-06T21:07:57.300349] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-06T21:07:57.826960] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-06T21:07:57.831759] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-06T21:07:57.969479] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T21:07:57.972625] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-06T21:07:58.163664] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T21:07:58.165799] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-06T21:07:58.868494] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T21:07:58.871402] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-06T21:07:58.941880] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T21:07:59.029618] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-06T21:07:59.032445] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T21:07:59.082291] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T21:07:59.723149] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T21:07:59.773562] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T21:07:59.825491] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-06T21:08:00.625548] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-06T21:08:00.789720] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T21:08:01.425520] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-06T21:08:02.225539] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-06T21:08:02.259365] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T21:08:02.315900] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-06T21:08:02.875139] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-06T21:08:03.025538] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-06T21:08:03.764984] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T21:08:03.825534] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-06T21:08:04.511479] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-06T21:08:04.625523] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-06T21:08:05.425488] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-06T21:08:05.433145] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-06T21:08:06.225492] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-06T21:08:06.554073] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T21:08:06.763218] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T21:08:06.764099] [INFO ] [REMOTE ] QVCD: Full fetch complete (6191 records). [2025-10-06T21:08:06.764167] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-06T21:08:07.030755] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-06T21:08:07.124333] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-06T21:08:07.124409] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-06T21:08:07.124581] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-06T21:08:07.124618] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-06T21:08:07.125023] [DEBUG] [LOCAL ] QVCD: Trimmed 6191 records to 4548 (keeping 200 days of data) [2025-10-06T21:08:07.156797] [DEBUG] [LOCAL ] QVCD: Primary data saved (4548 records). [2025-10-06T21:08:07.157068] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-06T21:08:07.157223] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCD took 15.2s. Estimated remaining: 1h 25m 55s. Rate: 7.1 symbols/min [2025-10-06T21:08:07.327822] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:08:07.365725] [DEBUG] [LOCAL ] R: Loaded 29355 existing records from primary storage. [2025-10-06T21:08:07.366072] [INFO ] [MAIN ] R: Loaded 29355 existing records. [2025-10-06T21:08:07.549421] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:08:07.549736] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-06T21:08:07.549805] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-06T21:08:07.550060] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-10-06T21:08:07.550133] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-06T21:08:07.827183] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-06T21:08:07.910495] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:08:08.625489] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-06T21:08:08.988491] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-06T21:08:09.142919] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-06T21:08:09.425526] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-06T21:08:09.977255] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T21:08:10.225589] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-06T21:08:10.879980] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T21:08:11.025544] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-06T21:08:11.176224] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-06T21:08:11.825548] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-06T21:08:12.099545] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T21:08:12.625527] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-06T21:08:12.926738] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T21:08:13.425499] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-06T21:08:13.708113] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T21:08:14.225561] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-06T21:08:15.025514] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-06T21:08:15.444777] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-06T21:08:15.631120] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T21:08:15.825529] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-06T21:08:15.924956] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-06T21:08:16.625528] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-06T21:08:17.425536] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-06T21:08:17.715391] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T21:08:17.841257] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-06T21:08:17.915179] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-06T21:08:17.916184] [INFO ] [REMOTE ] QVCC: Full fetch complete (11997 records). [2025-10-06T21:08:17.916254] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-06T21:08:18.231536] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-06T21:08:18.274878] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-10-06T21:08:18.276292] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-10-06T21:08:18.276620] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-10-06T21:08:18.276698] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-10-06T21:08:18.277187] [DEBUG] [LOCAL ] QVCC: Trimmed 11997 records to 8892 (keeping 200 days of data) [2025-10-06T21:08:18.331248] [DEBUG] [LOCAL ] QVCC: Primary data saved (8892 records). [2025-10-06T21:08:18.331410] [INFO ] [MAIN ] QVCC: Full history saved. [2025-10-06T21:08:18.331499] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QVCC took 26.4s. Estimated remaining: 1h 25m 48s. Rate: 7.1 symbols/min [2025-10-06T21:08:18.501309] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:08:18.524425] [DEBUG] [LOCAL ] RA: Loaded 22099 existing records from primary storage. [2025-10-06T21:08:18.524735] [INFO ] [MAIN ] RA: Loaded 22099 existing records. [2025-10-06T21:08:18.700571] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:08:18.700845] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-06T21:08:18.700903] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-06T21:08:18.701102] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-10-06T21:08:18.701143] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-06T21:08:19.028684] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-06T21:08:19.051527] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:08:19.479770] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-06T21:08:19.825537] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-06T21:08:20.625478] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-06T21:08:20.744425] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T21:08:20.747284] [INFO ] [REMOTE ] QUAD: Full fetch complete (34431 records). [2025-10-06T21:08:20.747516] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-06T21:08:21.163147] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-06T21:08:21.182162] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-06T21:08:21.182496] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-06T21:08:21.183767] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-06T21:08:21.183892] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-06T21:08:21.185322] [DEBUG] [LOCAL ] QUAD: Trimmed 34431 records to 23420 (keeping 200 days of data) [2025-10-06T21:08:21.329695] [DEBUG] [LOCAL ] QUAD: Primary data saved (23420 records). [2025-10-06T21:08:21.329835] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-06T21:08:21.329931] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QUAD took 29.4s. Estimated remaining: 1h 25m 38s. Rate: 7.1 symbols/min [2025-10-06T21:08:21.429519] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-06T21:08:21.502135] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:08:21.535737] [DEBUG] [LOCAL ] RACE: Loaded 33057 existing records from primary storage. [2025-10-06T21:08:21.536049] [INFO ] [MAIN ] RACE: Loaded 33057 existing records. [2025-10-06T21:08:21.713228] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:08:21.713561] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-06T21:08:21.713631] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-06T21:08:21.713974] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-10-06T21:08:21.714045] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-06T21:08:22.096115] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T21:08:22.110490] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:08:22.225485] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-06T21:08:23.025562] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-06T21:08:23.620554] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-06T21:08:23.692184] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T21:08:23.825533] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-06T21:08:23.859346] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T21:08:24.625574] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-06T21:08:25.425548] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-06T21:08:25.794003] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-06T21:08:25.822486] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T21:08:26.225620] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-06T21:08:26.559889] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-06T21:08:27.025566] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-06T21:08:27.825584] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-06T21:08:28.194246] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-06T21:08:28.222387] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T21:08:28.625484] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-06T21:08:28.968978] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T21:08:29.425567] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-06T21:08:29.727533] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T21:08:30.225619] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-06T21:08:30.846531] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T21:08:31.025555] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-06T21:08:31.438047] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T21:08:31.825551] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-06T21:08:32.625492] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-06T21:08:32.784573] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-06T21:08:32.787781] [INFO ] [REMOTE ] QXO: Full fetch complete (75707 records). [2025-10-06T21:08:32.787941] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-06T21:08:33.265955] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-10-06T21:08:33.265799] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T21:08:33.266257] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-10-06T21:08:33.273194] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-10-06T21:08:33.273874] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-10-06T21:08:33.275678] [DEBUG] [LOCAL ] QXO: Trimmed 75707 records to 53309 (keeping 200 days of data) [2025-10-06T21:08:33.474227] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-06T21:08:33.642567] [DEBUG] [LOCAL ] QXO: Primary data saved (53309 records). [2025-10-06T21:08:33.642774] [INFO ] [MAIN ] QXO: Full history saved. [2025-10-06T21:08:33.643542] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QXO took 41.7s. Estimated remaining: 1h 25m 30s. Rate: 7.1 symbols/min [2025-10-06T21:08:33.810878] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:08:33.851355] [DEBUG] [LOCAL ] RAMP: Loaded 38075 existing records from primary storage. [2025-10-06T21:08:33.851689] [INFO ] [MAIN ] RAMP: Loaded 38075 existing records. [2025-10-06T21:08:34.031952] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:08:34.032209] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-06T21:08:34.032263] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-06T21:08:34.032508] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-10-06T21:08:34.032565] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-06T21:08:34.231106] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-06T21:08:34.394755] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:08:34.416478] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T21:08:34.757256] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T21:08:35.025609] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-06T21:08:35.505970] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-06T21:08:35.825519] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-06T21:08:36.625506] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-06T21:08:36.707115] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T21:08:36.880942] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T21:08:36.882844] [INFO ] [REMOTE ] R: Full fetch complete (42313 records). [2025-10-06T21:08:36.882925] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-06T21:08:37.283364] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-10-06T21:08:37.283464] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-10-06T21:08:37.284308] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-10-06T21:08:37.284371] [DEBUG] [LOCAL ] R: Saving primary data. [2025-10-06T21:08:37.285413] [DEBUG] [LOCAL ] R: Trimmed 42313 records to 28763 (keeping 200 days of data) [2025-10-06T21:08:37.436707] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-06T21:08:37.473388] [DEBUG] [LOCAL ] R: Primary data saved (28763 records). [2025-10-06T21:08:37.473540] [INFO ] [MAIN ] R: Full history saved. [2025-10-06T21:08:37.473627] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. R took 30.3s. Estimated remaining: 1h 25m 20s. Rate: 7.1 symbols/min [2025-10-06T21:08:37.643811] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:08:37.695029] [DEBUG] [LOCAL ] RBA: Loaded 46530 existing records from primary storage. [2025-10-06T21:08:37.695539] [INFO ] [MAIN ] RBA: Loaded 46530 existing records. [2025-10-06T21:08:37.826224] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T21:08:37.893799] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:08:37.894009] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-06T21:08:37.894101] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-06T21:08:37.894330] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-10-06T21:08:37.894387] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-06T21:08:38.230678] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-06T21:08:38.243199] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:08:38.430370] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T21:08:39.025554] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-06T21:08:39.825590] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-06T21:08:40.021671] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T21:08:40.243290] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T21:08:40.625630] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-06T21:08:41.425624] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-06T21:08:41.471123] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T21:08:41.967465] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T21:08:42.225560] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-06T21:08:42.987893] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T21:08:43.025581] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-06T21:08:43.807871] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T21:08:43.825461] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-06T21:08:44.625516] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-06T21:08:44.699447] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T21:08:45.107422] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-06T21:08:45.425495] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-06T21:08:46.225486] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-06T21:08:46.256206] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T21:08:46.900504] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T21:08:47.025499] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-06T21:08:47.808381] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T21:08:47.825463] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-06T21:08:48.244795] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T21:08:48.625525] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-06T21:08:49.425561] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-06T21:08:49.511452] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T21:08:50.225511] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-06T21:08:50.258726] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T21:08:50.575891] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T21:08:51.025536] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-06T21:08:51.825566] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-06T21:08:51.879164] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T21:08:51.926532] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T21:08:51.928577] [INFO ] [REMOTE ] RA: Full fetch complete (31987 records). [2025-10-06T21:08:51.928934] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-06T21:08:52.299168] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-06T21:08:52.299258] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-06T21:08:52.299991] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-06T21:08:52.300082] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-06T21:08:52.300905] [DEBUG] [LOCAL ] RA: Trimmed 31987 records to 21763 (keeping 200 days of data) [2025-10-06T21:08:52.437050] [DEBUG] [LOCAL ] RA: Primary data saved (21763 records). [2025-10-06T21:08:52.437193] [INFO ] [MAIN ] RA: Full history saved. [2025-10-06T21:08:52.437275] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. RA took 34.1s. Estimated remaining: 1h 25m 14s. Rate: 7.1 symbols/min [2025-10-06T21:08:52.606936] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:08:52.624743] [DEBUG] [LOCAL ] RBC: Loaded 15487 existing records from primary storage. [2025-10-06T21:08:52.625016] [INFO ] [MAIN ] RBC: Loaded 15487 existing records. [2025-10-06T21:08:52.636104] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-06T21:08:52.819476] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:08:52.819790] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-06T21:08:52.819846] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-06T21:08:52.820093] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-10-06T21:08:52.820152] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-06T21:08:53.191012] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:08:53.374352] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T21:08:53.425522] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-06T21:08:54.203929] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T21:08:54.225478] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-06T21:08:54.646612] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-06T21:08:55.025553] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-06T21:08:55.650194] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T21:08:55.825535] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-06T21:08:56.401861] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T21:08:56.404572] [INFO ] [REMOTE ] RACE: Full fetch complete (47766 records). [2025-10-06T21:08:56.404774] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-06T21:08:56.625610] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-06T21:08:56.816985] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-10-06T21:08:56.817100] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-10-06T21:08:56.818403] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-10-06T21:08:56.818492] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-10-06T21:08:56.820097] [DEBUG] [LOCAL ] RACE: Trimmed 47766 records to 32600 (keeping 200 days of data) [2025-10-06T21:08:57.061494] [DEBUG] [LOCAL ] RACE: Primary data saved (32600 records). [2025-10-06T21:08:57.061746] [INFO ] [MAIN ] RACE: Full history saved. [2025-10-06T21:08:57.061870] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. RACE took 35.7s. Estimated remaining: 1h 25m 4s. Rate: 7.1 symbols/min [2025-10-06T21:08:57.250803] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:08:57.251329] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-06T21:08:57.251404] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-06T21:08:57.251615] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-06T21:08:57.251706] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-06T21:08:57.251914] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-06T21:08:57.252014] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-06T21:08:57.401995] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T21:08:57.441931] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-06T21:08:57.684614] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:08:58.225512] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-06T21:08:58.272689] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T21:08:58.607931] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T21:08:59.025556] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-06T21:08:59.825504] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-06T21:08:59.955095] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T21:08:59.997141] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T21:09:00.625559] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-06T21:09:01.351104] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T21:09:01.425555] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-06T21:09:02.225522] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-06T21:09:02.339953] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T21:09:02.501947] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T21:09:03.025635] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-06T21:09:03.825547] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-06T21:09:04.363625] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-06T21:09:04.625510] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-06T21:09:04.735971] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T21:09:04.897704] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T21:09:04.900601] [INFO ] [REMOTE ] RAMP: Full fetch complete (53659 records). [2025-10-06T21:09:04.900784] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-06T21:09:05.279537] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-10-06T21:09:05.279616] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-10-06T21:09:05.280469] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-10-06T21:09:05.280526] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-10-06T21:09:05.281629] [DEBUG] [LOCAL ] RAMP: Trimmed 53659 records to 37446 (keeping 200 days of data) [2025-10-06T21:09:05.437707] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-06T21:09:05.499547] [DEBUG] [LOCAL ] RAMP: Primary data saved (37446 records). [2025-10-06T21:09:05.499702] [INFO ] [MAIN ] RAMP: Full history saved. [2025-10-06T21:09:05.501160] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RAMP took 31.9s. Estimated remaining: 1h 24m 56s. Rate: 7.1 symbols/min [2025-10-06T21:09:05.680108] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:09:05.691480] [DEBUG] [LOCAL ] RBOT: Loaded 5519 existing records from primary storage. [2025-10-06T21:09:05.691752] [INFO ] [MAIN ] RBOT: Loaded 5519 existing records. [2025-10-06T21:09:05.875067] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:09:05.875283] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-06T21:09:05.875340] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-06T21:09:05.875561] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-06T21:09:05.875618] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-06T21:09:06.228869] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:09:06.228958] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-06T21:09:06.941983] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-06T21:09:07.025543] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-06T21:09:07.198161] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T21:09:07.271165] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T21:09:07.825480] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-06T21:09:08.625574] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-06T21:09:09.046013] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-06T21:09:09.375205] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-06T21:09:09.425479] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-06T21:09:10.211969] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T21:09:10.225460] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-06T21:09:11.025484] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-06T21:09:11.504047] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-06T21:09:11.825517] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-06T21:09:12.003990] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T21:09:12.138225] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T21:09:12.625506] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-06T21:09:13.425498] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-06T21:09:13.634378] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T21:09:14.101519] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-06T21:09:14.225487] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-06T21:09:14.381866] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T21:09:15.025515] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-06T21:09:15.355017] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T21:09:15.358244] [INFO ] [REMOTE ] RBA: Full fetch complete (65832 records). [2025-10-06T21:09:15.358412] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-06T21:09:15.765725] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-10-06T21:09:15.765843] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-10-06T21:09:15.766892] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-10-06T21:09:15.766960] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-10-06T21:09:15.768439] [DEBUG] [LOCAL ] RBA: Trimmed 65832 records to 45793 (keeping 200 days of data) [2025-10-06T21:09:15.829705] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-06T21:09:16.070052] [DEBUG] [LOCAL ] RBA: Primary data saved (45793 records). [2025-10-06T21:09:16.070201] [INFO ] [MAIN ] RBA: Full history saved. [2025-10-06T21:09:16.070302] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RBA took 38.6s. Estimated remaining: 1h 24m 48s. Rate: 7.1 symbols/min [2025-10-06T21:09:16.255996] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:09:16.257078] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T21:09:16.310543] [DEBUG] [LOCAL ] RBRK: Loaded 53907 existing records from primary storage. [2025-10-06T21:09:16.310962] [INFO ] [MAIN ] RBRK: Loaded 53907 existing records. [2025-10-06T21:09:16.492436] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:09:16.492673] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-06T21:09:16.492732] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-06T21:09:16.493011] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-10-06T21:09:16.493069] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-06T21:09:16.631878] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-06T21:09:16.807407] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T21:09:16.868910] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:09:17.425496] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-06T21:09:17.746369] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-06T21:09:18.225505] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-06T21:09:18.407373] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T21:09:19.025571] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-06T21:09:19.825562] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-06T21:09:19.998053] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T21:09:20.343068] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-06T21:09:20.625550] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-06T21:09:20.661774] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T21:09:21.425550] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-06T21:09:22.225552] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-06T21:09:22.482736] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T21:09:23.031497] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-06T21:09:23.058136] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-06T21:09:23.264085] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T21:09:23.825565] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-06T21:09:24.245593] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-06T21:09:24.625508] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-06T21:09:24.680330] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T21:09:25.425542] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-06T21:09:25.731274] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T21:09:26.208730] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-06T21:09:26.225481] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-06T21:09:27.025568] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-06T21:09:27.825539] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-06T21:09:27.924878] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T21:09:27.926708] [INFO ] [REMOTE ] RBC: Full fetch complete (21847 records). [2025-10-06T21:09:27.926783] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-06T21:09:28.318711] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-10-06T21:09:28.318820] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-10-06T21:09:28.319572] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-10-06T21:09:28.319699] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-10-06T21:09:28.320599] [DEBUG] [LOCAL ] RBC: Trimmed 21847 records to 15284 (keeping 200 days of data) [2025-10-06T21:09:28.424402] [DEBUG] [LOCAL ] RBC: Primary data saved (15284 records). [2025-10-06T21:09:28.424589] [INFO ] [MAIN ] RBC: Full history saved. [2025-10-06T21:09:28.424710] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBC took 36.0s. Estimated remaining: 1h 24m 41s. Rate: 7.1 symbols/min [2025-10-06T21:09:28.610442] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:09:28.625532] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-06T21:09:28.663598] [DEBUG] [LOCAL ] RC: Loaded 49655 existing records from primary storage. [2025-10-06T21:09:28.664105] [INFO ] [MAIN ] RC: Loaded 49655 existing records. [2025-10-06T21:09:28.854536] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:09:28.855441] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-06T21:09:28.855697] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-06T21:09:28.856156] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-06T21:09:28.856282] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-06T21:09:29.133835] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-06T21:09:29.240561] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T21:09:29.342946] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T21:09:29.342706] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:09:29.425513] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-06T21:09:30.225590] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-06T21:09:30.989290] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-06T21:09:31.025484] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-06T21:09:31.065154] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T21:09:31.825500] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-06T21:09:31.937259] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-06T21:09:32.625532] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-06T21:09:33.314786] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-06T21:09:33.425545] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-06T21:09:34.000499] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-06T21:09:34.225545] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-06T21:09:34.471006] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-06T21:09:35.031558] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-06T21:09:35.060899] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T21:09:35.825568] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-06T21:09:36.292841] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T21:09:36.295382] [INFO ] [REMOTE ] RBRK: Full fetch complete (76141 records). [2025-10-06T21:09:36.295477] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-06T21:09:36.296291] [FATAL] [VALIDATOR ] RBRK: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:09:36.296377] [FATAL] [MAIN ] RBRK: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:09:36.296420] [WARN ] [MAIN ] RBRK: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:09:36.296486] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-06T21:09:36.296553] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-06T21:09:36.296590] [INFO ] [LOCAL ] RBRK: Starting deletion of derivative data. [2025-10-06T21:09:36.296859] [DEBUG] [LOCAL ] RBRK: Deleted derivative data file. [2025-10-06T21:09:36.297623] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBRK took 20.2s. Estimated remaining: 1h 24m 32s. Rate: 7.1 symbols/min [2025-10-06T21:09:36.466144] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:09:36.466304] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-06T21:09:36.466358] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-06T21:09:36.466467] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-06T21:09:36.466507] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-06T21:09:36.466550] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-06T21:09:36.466582] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-06T21:09:36.639749] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-06T21:09:36.825477] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:09:37.425503] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-06T21:09:37.575979] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-06T21:09:37.596474] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T21:09:38.225532] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-06T21:09:39.025502] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-06T21:09:39.066171] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T21:09:39.320778] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-06T21:09:39.511792] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-06T21:09:39.825508] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-06T21:09:40.625582] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-06T21:09:41.425580] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-06T21:09:41.977911] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-06T21:09:41.981764] [INFO ] [REMOTE ] RBLX: Full fetch complete (77777 records). [2025-10-06T21:09:41.981979] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-06T21:09:42.228323] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-06T21:09:42.287337] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T21:09:42.425821] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T21:09:42.464598] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-10-06T21:09:42.465164] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-10-06T21:09:42.467531] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-10-06T21:09:42.467715] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-10-06T21:09:42.470380] [DEBUG] [LOCAL ] RBLX: Trimmed 77777 records to 53714 (keeping 200 days of data) [2025-10-06T21:09:42.829943] [DEBUG] [LOCAL ] RBLX: Primary data saved (53714 records). [2025-10-06T21:09:42.830161] [INFO ] [MAIN ] RBLX: Full history saved. [2025-10-06T21:09:42.830255] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBLX took 45.8s. Estimated remaining: 1h 24m 23s. Rate: 7.1 symbols/min [2025-10-06T21:09:43.021503] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:09:43.021799] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-06T21:09:43.021847] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-06T21:09:43.021975] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-06T21:09:43.022018] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-06T21:09:43.022061] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-06T21:09:43.022096] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-06T21:09:43.033989] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-06T21:09:43.239115] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T21:09:43.442900] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:09:43.825495] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-06T21:09:43.838674] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T21:09:44.625566] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-06T21:09:44.695884] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T21:09:45.366879] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T21:09:45.425550] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-06T21:09:46.199369] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T21:09:46.201281] [INFO ] [REMOTE ] RBOT: Full fetch complete (8839 records). [2025-10-06T21:09:46.201377] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-06T21:09:46.231256] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-06T21:09:46.582830] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-06T21:09:46.582911] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-06T21:09:46.583125] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-06T21:09:46.583164] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-06T21:09:46.583705] [DEBUG] [LOCAL ] RBOT: Trimmed 8839 records to 5599 (keeping 200 days of data) [2025-10-06T21:09:46.616364] [DEBUG] [LOCAL ] RBOT: Primary data saved (5599 records). [2025-10-06T21:09:46.616528] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-06T21:09:46.616624] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RBOT took 41.1s. Estimated remaining: 1h 24m 13s. Rate: 7.1 symbols/min [2025-10-06T21:09:46.786190] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:09:46.839471] [DEBUG] [LOCAL ] RCI: Loaded 49304 existing records from primary storage. [2025-10-06T21:09:46.840015] [INFO ] [MAIN ] RCI: Loaded 49304 existing records. [2025-10-06T21:09:47.017133] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:09:47.017535] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-06T21:09:47.017611] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-06T21:09:47.018074] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-10-06T21:09:47.018144] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-06T21:09:47.030692] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-06T21:09:47.369594] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:09:47.794856] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T21:09:47.825466] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-06T21:09:48.229418] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-06T21:09:48.544637] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T21:09:48.625531] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-06T21:09:49.106049] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-06T21:09:49.425516] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-06T21:09:49.908945] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-06T21:09:50.225613] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-06T21:09:51.025587] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-06T21:09:51.825508] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-06T21:09:51.907442] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T21:09:51.909865] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T21:09:52.350105] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-06T21:09:52.625548] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-06T21:09:53.425586] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-06T21:09:53.865555] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-06T21:09:54.225490] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-06T21:09:54.553937] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-06T21:09:54.593522] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-06T21:09:54.594230] [INFO ] [REMOTE ] RCB: Full fetch complete (3743 records). [2025-10-06T21:09:54.594300] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-06T21:09:54.777245] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T21:09:54.777466] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:09:54.777545] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:09:54.777595] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-06T21:09:54.777684] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-06T21:09:54.777741] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-06T21:09:54.777785] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-06T21:09:54.777844] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RCB took 18.5s. Estimated remaining: 1h 24m 5s. Rate: 7.1 symbols/min [2025-10-06T21:09:54.978472] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:09:54.978712] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-06T21:09:54.978769] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-06T21:09:54.978901] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-06T21:09:54.978943] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-06T21:09:54.978984] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-06T21:09:54.979015] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-06T21:09:55.030690] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-06T21:09:55.331900] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:09:55.825538] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-06T21:09:56.625485] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-06T21:09:56.765223] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T21:09:57.266359] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-06T21:09:57.425522] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-06T21:09:57.521865] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T21:09:57.973799] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-06T21:09:58.225525] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-06T21:09:59.025518] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-06T21:09:59.825569] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-06T21:09:59.836618] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T21:10:00.044869] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T21:10:00.625548] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-06T21:10:00.768790] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-06T21:10:01.425540] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-06T21:10:02.106850] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-06T21:10:02.225597] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-06T21:10:02.887371] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-06T21:10:03.025494] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-06T21:10:03.825500] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-06T21:10:03.904376] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-06T21:10:04.497031] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T21:10:04.625536] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-06T21:10:05.315805] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-06T21:10:05.425486] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-06T21:10:05.979172] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (5.35 seconds). [2025-10-06T21:10:06.225515] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-06T21:10:06.572621] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-06T21:10:06.925566] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-06T21:10:07.025581] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-06T21:10:07.825571] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-06T21:10:08.469073] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T21:10:08.625525] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-06T21:10:08.908770] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T21:10:09.425535] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-06T21:10:09.602623] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T21:10:09.806343] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T21:10:09.807317] [INFO ] [REMOTE ] RCD: Full fetch complete (6972 records). [2025-10-06T21:10:09.807401] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-06T21:10:10.004386] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T21:10:10.004703] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:10:10.004796] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:10:10.004895] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-06T21:10:10.004987] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-06T21:10:10.005027] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-06T21:10:10.005067] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-06T21:10:10.005126] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RCD took 27.2s. Estimated remaining: 1h 23m 59s. Rate: 7.1 symbols/min [2025-10-06T21:10:10.182697] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:10:10.196853] [DEBUG] [LOCAL ] RCS: Loaded 11877 existing records from primary storage. [2025-10-06T21:10:10.197106] [INFO ] [MAIN ] RCS: Loaded 11877 existing records. [2025-10-06T21:10:10.230676] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-06T21:10:10.385717] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:10:10.385987] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-06T21:10:10.386041] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-06T21:10:10.386332] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-06T21:10:10.386391] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-06T21:10:10.741958] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:10:11.025552] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-06T21:10:11.305585] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T21:10:11.825541] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-06T21:10:12.167832] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T21:10:12.625618] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-06T21:10:13.425576] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-06T21:10:13.545793] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T21:10:14.225497] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-06T21:10:14.346825] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T21:10:14.412443] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T21:10:15.025594] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-06T21:10:15.678883] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T21:10:15.681903] [INFO ] [REMOTE ] RC: Full fetch complete (70931 records). [2025-10-06T21:10:15.682027] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-06T21:10:15.828629] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-06T21:10:16.138799] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-06T21:10:16.139000] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-06T21:10:16.140173] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-06T21:10:16.140259] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-06T21:10:16.142103] [DEBUG] [LOCAL ] RC: Trimmed 70931 records to 48920 (keeping 200 days of data) [2025-10-06T21:10:16.269027] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-06T21:10:16.481288] [DEBUG] [LOCAL ] RC: Primary data saved (48920 records). [2025-10-06T21:10:16.481446] [INFO ] [MAIN ] RC: Full history saved. [2025-10-06T21:10:16.481534] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RC took 48.1s. Estimated remaining: 1h 23m 49s. Rate: 7.1 symbols/min [2025-10-06T21:10:16.630612] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-06T21:10:16.661095] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:10:16.702192] [DEBUG] [LOCAL ] RCUS: Loaded 43030 existing records from primary storage. [2025-10-06T21:10:16.702500] [INFO ] [MAIN ] RCUS: Loaded 43030 existing records. [2025-10-06T21:10:16.878413] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:10:16.878628] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-06T21:10:16.878708] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-06T21:10:16.878970] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-10-06T21:10:16.879026] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-06T21:10:17.241771] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:10:17.258738] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T21:10:17.298703] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-06T21:10:17.425564] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-06T21:10:18.225597] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-06T21:10:18.516929] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T21:10:19.025572] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-06T21:10:19.825532] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-06T21:10:19.975821] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T21:10:20.009890] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T21:10:20.625625] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-06T21:10:21.354599] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T21:10:21.425489] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-06T21:10:21.591441] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T21:10:22.225620] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-06T21:10:22.835157] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T21:10:22.860760] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T21:10:22.863360] [INFO ] [REMOTE ] RCL: Full fetch complete (75022 records). [2025-10-06T21:10:22.863499] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-06T21:10:22.864295] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:10:22.864395] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:10:22.864438] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:10:22.864498] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-06T21:10:22.864560] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-06T21:10:22.864594] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-06T21:10:22.864633] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-06T21:10:22.864736] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RCL took 28.1s. Estimated remaining: 1h 23m 40s. Rate: 7.1 symbols/min [2025-10-06T21:10:23.037674] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-06T21:10:23.041572] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:10:23.041803] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-06T21:10:23.041875] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-06T21:10:23.042018] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-06T21:10:23.042076] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-06T21:10:23.042312] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-06T21:10:23.042974] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-06T21:10:23.416755] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:10:23.825557] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-06T21:10:24.627429] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-06T21:10:24.630500] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T21:10:24.860361] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-06T21:10:25.425590] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-06T21:10:26.225606] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-06T21:10:26.484696] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T21:10:26.560557] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T21:10:26.863732] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-06T21:10:27.025546] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-06T21:10:27.825552] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-06T21:10:28.623081] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-06T21:10:28.632845] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-06T21:10:28.778131] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T21:10:29.425510] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-06T21:10:30.225512] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-06T21:10:30.335455] [DEBUG] [REMOTE ] RCUS: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-06T21:10:30.335875] [WARN ] [REMOTE ] RCUS: No data returned for month 2025-05 [2025-10-06T21:10:30.335976] [FATAL] [REMOTE ] RCUS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:10:30.336094] [FATAL] [MAIN ] RCUS: Failed to fetch primary data. [2025-10-06T21:10:30.336139] [WARN ] [MAIN ] RCUS: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:10:30.336230] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-06T21:10:30.336372] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-06T21:10:30.336450] [INFO ] [LOCAL ] RCUS: Starting deletion of derivative data. [2025-10-06T21:10:30.336722] [DEBUG] [LOCAL ] RCUS: Deleted derivative data file. [2025-10-06T21:10:30.336826] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCUS took 13.9s. Estimated remaining: 1h 23m 32s. Rate: 7.1 symbols/min [2025-10-06T21:10:30.573543] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:10:30.571408] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-06T21:10:30.618901] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T21:10:30.680472] [DEBUG] [LOCAL ] RDN: Loaded 45683 existing records from primary storage. [2025-10-06T21:10:30.680948] [INFO ] [MAIN ] RDN: Loaded 45683 existing records. [2025-10-06T21:10:30.858751] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:10:30.859001] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-06T21:10:30.859063] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-06T21:10:30.859299] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-10-06T21:10:30.859356] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-06T21:10:31.031533] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-06T21:10:31.238155] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:10:31.825548] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-06T21:10:31.990262] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-06T21:10:32.625561] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-06T21:10:33.425529] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-06T21:10:33.516358] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T21:10:34.056520] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T21:10:34.225513] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-06T21:10:34.409234] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T21:10:35.025546] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-06T21:10:35.825559] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-06T21:10:36.107151] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T21:10:36.161211] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-06T21:10:36.625560] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-06T21:10:36.785579] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T21:10:37.425531] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-06T21:10:38.127172] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T21:10:38.225484] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-06T21:10:38.357034] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T21:10:39.025537] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-06T21:10:39.292268] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T21:10:39.825554] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-06T21:10:39.931096] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-06T21:10:40.622901] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T21:10:40.627235] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-06T21:10:41.425556] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-06T21:10:42.230631] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-06T21:10:42.255552] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-06T21:10:42.353594] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T21:10:43.025551] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-06T21:10:43.769797] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T21:10:43.825542] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-06T21:10:44.321392] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T21:10:44.325000] [INFO ] [REMOTE ] RCI: Full fetch complete (70506 records). [2025-10-06T21:10:44.325130] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-06T21:10:44.630760] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-06T21:10:44.805030] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-10-06T21:10:44.805126] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-10-06T21:10:44.806213] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-10-06T21:10:44.806303] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-10-06T21:10:44.807831] [DEBUG] [LOCAL ] RCI: Trimmed 70506 records to 48598 (keeping 200 days of data) [2025-10-06T21:10:45.112867] [DEBUG] [LOCAL ] RCI: Primary data saved (48598 records). [2025-10-06T21:10:45.113028] [INFO ] [MAIN ] RCI: Full history saved. [2025-10-06T21:10:45.113955] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCI took 58.5s. Estimated remaining: 1h 23m 25s. Rate: 7.1 symbols/min [2025-10-06T21:10:45.282129] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:10:45.338459] [DEBUG] [LOCAL ] RDW: Loaded 52824 existing records from primary storage. [2025-10-06T21:10:45.338900] [INFO ] [MAIN ] RDW: Loaded 52824 existing records. [2025-10-06T21:10:45.430675] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-06T21:10:45.531427] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:10:45.531953] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-06T21:10:45.532071] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-06T21:10:45.532481] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-10-06T21:10:45.532589] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-06T21:10:45.959926] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-06T21:10:45.984313] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:10:46.044048] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T21:10:46.225525] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-06T21:10:46.383610] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-06T21:10:47.025592] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-06T21:10:47.825490] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-06T21:10:47.930996] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-06T21:10:47.932844] [INFO ] [REMOTE ] RCS: Full fetch complete (19238 records). [2025-10-06T21:10:47.932925] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-06T21:10:48.336729] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-06T21:10:48.337105] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-06T21:10:48.337951] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-06T21:10:48.338039] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-06T21:10:48.370127] [DEBUG] [LOCAL ] RCS: Trimmed 19238 records to 11893 (keeping 200 days of data) [2025-10-06T21:10:48.372506] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-06T21:10:48.462386] [DEBUG] [LOCAL ] RCS: Primary data saved (11893 records). [2025-10-06T21:10:48.462797] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-06T21:10:48.462958] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RCS took 38.5s. Estimated remaining: 1h 23m 15s. Rate: 7.1 symbols/min [2025-10-06T21:10:48.629426] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-06T21:10:48.663818] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:10:48.726729] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T21:10:48.755986] [DEBUG] [LOCAL ] RDY: Loaded 47521 existing records from primary storage. [2025-10-06T21:10:48.756343] [INFO ] [MAIN ] RDY: Loaded 47521 existing records. [2025-10-06T21:10:48.937419] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:10:48.937691] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-06T21:10:48.937753] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-06T21:10:48.937994] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-10-06T21:10:48.938079] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-06T21:10:49.302788] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:10:49.425520] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-06T21:10:49.878493] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T21:10:49.881141] [INFO ] [REMOTE ] RDDT: Full fetch complete (77497 records). [2025-10-06T21:10:49.881260] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-06T21:10:49.882290] [FATAL] [VALIDATOR ] RDDT: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:10:49.882406] [FATAL] [MAIN ] RDDT: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:10:49.882484] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:10:49.882585] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-06T21:10:49.882714] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-06T21:10:49.882773] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-10-06T21:10:49.882824] [DEBUG] [LOCAL ] RDDT: No derivative data file found to delete. [2025-10-06T21:10:49.882882] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RDDT took 27.0s. Estimated remaining: 1h 23m 4s. Rate: 7.1 symbols/min [2025-10-06T21:10:50.054699] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:10:50.104226] [DEBUG] [LOCAL ] RELX: Loaded 48642 existing records from primary storage. [2025-10-06T21:10:50.104553] [INFO ] [MAIN ] RELX: Loaded 48642 existing records. [2025-10-06T21:10:50.230701] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-06T21:10:50.305605] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:10:50.306880] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-06T21:10:50.306997] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-06T21:10:50.307394] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-10-06T21:10:50.307597] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-06T21:10:50.697216] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:10:50.735937] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-06T21:10:51.025551] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-06T21:10:51.825542] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-06T21:10:52.352849] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-06T21:10:52.637086] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-06T21:10:52.640052] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T21:10:53.313432] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T21:10:53.425539] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-06T21:10:54.225610] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-06T21:10:54.818475] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-06T21:10:55.025530] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-06T21:10:55.114877] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T21:10:55.825510] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-06T21:10:55.956201] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T21:10:56.625561] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-06T21:10:57.112382] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-06T21:10:57.179293] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-06T21:10:57.425615] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-06T21:10:58.225501] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-06T21:10:58.413455] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T21:10:59.031419] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-06T21:10:59.045387] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T21:10:59.825588] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-06T21:11:00.055622] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T21:11:00.133682] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T21:11:00.625519] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-06T21:11:01.425562] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-06T21:11:01.575606] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T21:11:02.225565] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-06T21:11:02.495893] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-06T21:11:02.913571] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T21:11:03.025479] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-06T21:11:03.715465] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T21:11:03.825484] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-06T21:11:04.625559] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-06T21:11:04.926542] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-06T21:11:05.425580] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-06T21:11:05.510958] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T21:11:06.225591] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-06T21:11:06.764146] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-06T21:11:06.918962] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-06T21:11:07.025521] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-06T21:11:07.362526] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T21:11:07.825549] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-06T21:11:08.571382] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T21:11:08.625515] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-06T21:11:09.425566] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-06T21:11:09.560661] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T21:11:10.225526] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-06T21:11:10.615886] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T21:11:11.025538] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-06T21:11:11.772599] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T21:11:11.775761] [INFO ] [REMOTE ] RDN: Full fetch complete (66087 records). [2025-10-06T21:11:11.775949] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-06T21:11:11.828972] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-06T21:11:11.892485] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-06T21:11:12.326167] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-10-06T21:11:12.326297] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-10-06T21:11:12.328306] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-10-06T21:11:12.328418] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-10-06T21:11:12.330672] [DEBUG] [LOCAL ] RDN: Trimmed 66087 records to 44886 (keeping 200 days of data) [2025-10-06T21:11:12.633934] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-06T21:11:12.655705] [DEBUG] [LOCAL ] RDN: Primary data saved (44886 records). [2025-10-06T21:11:12.655984] [INFO ] [MAIN ] RDN: Full history saved. [2025-10-06T21:11:12.656139] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDN took 42.3s. Estimated remaining: 1h 23m 1s. Rate: 7.1 symbols/min [2025-10-06T21:11:12.858621] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:11:12.889775] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T21:11:12.951432] [DEBUG] [LOCAL ] RERE: Loaded 41747 existing records from primary storage. [2025-10-06T21:11:12.951891] [INFO ] [MAIN ] RERE: Loaded 41747 existing records. [2025-10-06T21:11:13.141178] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:11:13.141452] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-06T21:11:13.141510] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-06T21:11:13.141814] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-06T21:11:13.141871] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-06T21:11:13.426833] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-06T21:11:13.511525] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:11:13.550187] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T21:11:14.225585] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-06T21:11:15.025614] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-06T21:11:15.224692] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-06T21:11:15.281320] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-06T21:11:15.473249] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T21:11:15.825584] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-06T21:11:16.625486] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-06T21:11:16.889000] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-06T21:11:17.425581] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-06T21:11:17.577936] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T21:11:18.225586] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-06T21:11:18.712755] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-06T21:11:19.025090] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-06T21:11:19.035577] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-06T21:11:19.756994] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T21:11:19.760734] [INFO ] [REMOTE ] RELX: Full fetch complete (67585 records). [2025-10-06T21:11:19.760940] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-06T21:11:19.838588] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-06T21:11:20.241208] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-10-06T21:11:20.241327] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-10-06T21:11:20.243127] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-10-06T21:11:20.243274] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-10-06T21:11:20.245571] [DEBUG] [LOCAL ] RELX: Trimmed 67585 records to 48055 (keeping 200 days of data) [2025-10-06T21:11:20.584003] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T21:11:20.626115] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-06T21:11:20.714901] [DEBUG] [LOCAL ] RELX: Primary data saved (48055 records). [2025-10-06T21:11:20.715094] [INFO ] [MAIN ] RELX: Full history saved. [2025-10-06T21:11:20.715214] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RELX took 30.8s. Estimated remaining: 1h 22m 52s. Rate: 7.1 symbols/min [2025-10-06T21:11:20.953725] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:11:21.000074] [DEBUG] [LOCAL ] RES: Loaded 48031 existing records from primary storage. [2025-10-06T21:11:21.000511] [INFO ] [MAIN ] RES: Loaded 48031 existing records. [2025-10-06T21:11:21.196100] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:11:21.196460] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-06T21:11:21.196523] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-06T21:11:21.196881] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-06T21:11:21.196939] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-06T21:11:21.436350] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-06T21:11:21.555013] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:11:21.603696] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T21:11:22.225601] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-06T21:11:22.894626] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-06T21:11:23.025521] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-06T21:11:23.190320] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T21:11:23.825494] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-06T21:11:24.001105] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T21:11:24.625562] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-06T21:11:25.288713] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-06T21:11:25.291980] [INFO ] [REMOTE ] RDW: Full fetch complete (75014 records). [2025-10-06T21:11:25.292128] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-06T21:11:25.438587] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-06T21:11:25.709630] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-10-06T21:11:25.709910] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-10-06T21:11:25.711175] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-10-06T21:11:25.711254] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-10-06T21:11:25.743217] [DEBUG] [LOCAL ] RDW: Trimmed 75014 records to 52096 (keeping 200 days of data) [2025-10-06T21:11:25.746294] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-06T21:11:26.058268] [DEBUG] [LOCAL ] RDW: Primary data saved (52096 records). [2025-10-06T21:11:26.058431] [INFO ] [MAIN ] RDW: Full history saved. [2025-10-06T21:11:26.059283] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RDW took 40.9s. Estimated remaining: 1h 22m 42s. Rate: 7.1 symbols/min [2025-10-06T21:11:26.226793] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-06T21:11:26.231046] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:11:26.279046] [DEBUG] [LOCAL ] REVG: Loaded 41293 existing records from primary storage. [2025-10-06T21:11:26.279394] [INFO ] [MAIN ] REVG: Loaded 41293 existing records. [2025-10-06T21:11:26.465243] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:11:26.465706] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-06T21:11:26.465902] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-06T21:11:26.466267] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-10-06T21:11:26.466331] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-06T21:11:26.584967] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-06T21:11:26.610209] [INFO ] [REMOTE ] RDY: Full fetch complete (68879 records). [2025-10-06T21:11:26.648400] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-06T21:11:27.065343] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:11:27.072889] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-06T21:11:27.285157] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-10-06T21:11:27.285257] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-10-06T21:11:27.286404] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-10-06T21:11:27.286475] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-10-06T21:11:27.288032] [DEBUG] [LOCAL ] RDY: Trimmed 68879 records to 46845 (keeping 200 days of data) [2025-10-06T21:11:27.576943] [DEBUG] [LOCAL ] RDY: Primary data saved (46845 records). [2025-10-06T21:11:27.577096] [INFO ] [MAIN ] RDY: Full history saved. [2025-10-06T21:11:27.577186] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RDY took 39.1s. Estimated remaining: 1h 22m 32s. Rate: 7.1 symbols/min [2025-10-06T21:11:27.781925] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:11:27.797917] [DEBUG] [LOCAL ] REX: Loaded 14424 existing records from primary storage. [2025-10-06T21:11:27.798218] [INFO ] [MAIN ] REX: Loaded 14424 existing records. [2025-10-06T21:11:27.974776] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:11:27.975056] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-06T21:11:27.975105] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-06T21:11:27.975302] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-10-06T21:11:27.975357] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-06T21:11:28.371058] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-10-06T21:11:28.376281] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:11:28.376602] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-06T21:11:28.625508] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-06T21:11:28.897787] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-06T21:11:29.404899] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-06T21:11:29.425468] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-06T21:11:30.225544] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-06T21:11:30.367280] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (3.29 seconds). [2025-10-06T21:11:30.540029] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T21:11:31.025499] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-06T21:11:31.260373] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-10-06T21:11:31.825486] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-06T21:11:31.969721] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T21:11:32.138637] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T21:11:32.625613] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-06T21:11:33.147400] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T21:11:33.425538] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-06T21:11:34.225516] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-06T21:11:34.333032] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T21:11:34.451890] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T21:11:35.025625] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-06T21:11:35.825499] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-06T21:11:35.961156] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-06T21:11:36.574897] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T21:11:36.625552] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-06T21:11:36.836809] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T21:11:37.425563] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-06T21:11:37.520355] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T21:11:38.225539] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-06T21:11:38.981838] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T21:11:38.983219] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-06T21:11:39.025557] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-06T21:11:39.825490] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-06T21:11:40.051936] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T21:11:40.625522] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-06T21:11:41.425560] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-06T21:11:42.225744] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-06T21:11:42.257074] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-06T21:11:42.866772] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T21:11:43.025506] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-06T21:11:43.098151] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-06T21:11:43.793677] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T21:11:43.825492] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-06T21:11:44.115778] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T21:11:44.625545] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-06T21:11:45.331427] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T21:11:45.425530] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-06T21:11:46.225518] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-06T21:11:46.360294] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T21:11:47.025545] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-06T21:11:47.072046] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T21:11:47.150798] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T21:11:47.152498] [INFO ] [REMOTE ] REX: Full fetch complete (21182 records). [2025-10-06T21:11:47.152597] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-06T21:11:47.522003] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-10-06T21:11:47.522097] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-10-06T21:11:47.522676] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-10-06T21:11:47.522748] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-10-06T21:11:47.523516] [DEBUG] [LOCAL ] REX: Trimmed 21182 records to 14253 (keeping 200 days of data) [2025-10-06T21:11:47.614279] [DEBUG] [LOCAL ] REX: Primary data saved (14253 records). [2025-10-06T21:11:47.614436] [INFO ] [MAIN ] REX: Full history saved. [2025-10-06T21:11:47.614523] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. REX took 20.0s. Estimated remaining: 1h 22m 27s. Rate: 7.1 symbols/min [2025-10-06T21:11:47.781858] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:11:47.829565] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-06T21:11:47.831909] [DEBUG] [LOCAL ] REXR: Loaded 52834 existing records from primary storage. [2025-10-06T21:11:47.832362] [INFO ] [MAIN ] REXR: Loaded 52834 existing records. [2025-10-06T21:11:48.007808] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:11:48.008083] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-06T21:11:48.008143] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-06T21:11:48.008399] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-10-06T21:11:48.008458] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-06T21:11:48.361048] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:11:48.625492] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-06T21:11:48.870557] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T21:11:49.425547] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-06T21:11:49.479947] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T21:11:50.225484] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-06T21:11:50.294526] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T21:11:51.025542] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-06T21:11:51.230361] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T21:11:51.825543] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-06T21:11:51.953076] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T21:11:52.625567] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-06T21:11:52.975112] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-06T21:11:53.230690] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T21:11:53.233274] [INFO ] [REMOTE ] RERE: Full fetch complete (57449 records). [2025-10-06T21:11:53.233392] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-06T21:11:53.432960] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-06T21:11:53.616774] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-06T21:11:53.616854] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-06T21:11:53.617806] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-06T21:11:53.617869] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-06T21:11:53.619068] [DEBUG] [LOCAL ] RERE: Trimmed 57449 records to 41085 (keeping 200 days of data) [2025-10-06T21:11:53.856252] [DEBUG] [LOCAL ] RERE: Primary data saved (41085 records). [2025-10-06T21:11:53.856394] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-06T21:11:53.856482] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. RERE took 41.2s. Estimated remaining: 1h 22m 18s. Rate: 7.1 symbols/min [2025-10-06T21:11:54.026319] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:11:54.070064] [DEBUG] [LOCAL ] REZI: Loaded 47649 existing records from primary storage. [2025-10-06T21:11:54.070415] [INFO ] [MAIN ] REZI: Loaded 47649 existing records. [2025-10-06T21:11:54.228873] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-06T21:11:54.251542] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:11:54.253146] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-06T21:11:54.253282] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-06T21:11:54.253684] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-10-06T21:11:54.253795] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-06T21:11:54.463783] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T21:11:54.653074] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:11:55.025553] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-06T21:11:55.219571] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T21:11:55.700905] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T21:11:55.825506] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-06T21:11:56.374502] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-06T21:11:56.625532] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-06T21:11:57.425508] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-06T21:11:57.530798] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T21:11:58.225566] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-06T21:11:58.529058] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T21:11:59.025592] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-06T21:11:59.298749] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T21:11:59.696344] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T21:11:59.825529] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-06T21:12:00.424285] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T21:12:00.428083] [INFO ] [REMOTE ] RES: Full fetch complete (68840 records). [2025-10-06T21:12:00.428301] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-06T21:12:00.626998] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-06T21:12:00.854511] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-06T21:12:00.854631] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-06T21:12:00.856478] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-06T21:12:00.856554] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-06T21:12:00.858852] [DEBUG] [LOCAL ] RES: Trimmed 68840 records to 47230 (keeping 200 days of data) [2025-10-06T21:12:01.181915] [DEBUG] [LOCAL ] RES: Primary data saved (47230 records). [2025-10-06T21:12:01.182202] [INFO ] [MAIN ] RES: Full history saved. [2025-10-06T21:12:01.182374] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. RES took 40.5s. Estimated remaining: 1h 22m 9s. Rate: 7.1 symbols/min [2025-10-06T21:12:01.395111] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:12:01.426126] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T21:12:01.426290] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-06T21:12:01.492506] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-10-06T21:12:01.493029] [INFO ] [MAIN ] RF: Loaded 54410 existing records. [2025-10-06T21:12:01.704708] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:12:01.705035] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-06T21:12:01.705086] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-06T21:12:01.705384] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-10-06T21:12:01.705453] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-06T21:12:02.137886] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:12:02.225623] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-06T21:12:02.708202] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-06T21:12:03.034522] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-06T21:12:03.059777] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T21:12:03.596240] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T21:12:03.599729] [INFO ] [REMOTE ] REVG: Full fetch complete (58083 records). [2025-10-06T21:12:03.599893] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-06T21:12:03.833791] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-06T21:12:04.035256] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-10-06T21:12:04.035518] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-10-06T21:12:04.037350] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-10-06T21:12:04.037424] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-10-06T21:12:04.039530] [DEBUG] [LOCAL ] REVG: Trimmed 58083 records to 40624 (keeping 200 days of data) [2025-10-06T21:12:04.310704] [DEBUG] [LOCAL ] REVG: Primary data saved (40624 records). [2025-10-06T21:12:04.310898] [INFO ] [MAIN ] REVG: Full history saved. [2025-10-06T21:12:04.312926] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. REVG took 38.3s. Estimated remaining: 1h 21m 59s. Rate: 7.1 symbols/min [2025-10-06T21:12:04.501763] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:12:04.523009] [DEBUG] [LOCAL ] RFI: Loaded 10606 existing records from primary storage. [2025-10-06T21:12:04.523370] [INFO ] [MAIN ] RFI: Loaded 10606 existing records. [2025-10-06T21:12:04.631790] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-06T21:12:04.743812] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:12:04.744600] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-06T21:12:04.744753] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-06T21:12:04.745322] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-06T21:12:04.745921] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-06T21:12:05.042839] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-06T21:12:05.183929] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:12:05.425502] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-06T21:12:05.846393] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-06T21:12:06.109686] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T21:12:06.225581] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-06T21:12:07.025515] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-06T21:12:07.213415] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T21:12:07.374494] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-06T21:12:07.825512] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-06T21:12:07.978124] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-06T21:12:08.625597] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-06T21:12:09.006863] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T21:12:09.425561] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-06T21:12:10.225531] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-06T21:12:10.348150] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T21:12:11.025546] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-06T21:12:11.257486] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T21:12:11.415875] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T21:12:11.825556] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-06T21:12:12.625497] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-06T21:12:12.748798] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T21:12:12.876164] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-06T21:12:13.425551] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-06T21:12:14.225514] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-06T21:12:14.472676] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T21:12:14.556603] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-06T21:12:15.025544] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-06T21:12:15.825553] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-06T21:12:15.878195] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T21:12:16.625523] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-06T21:12:16.741147] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T21:12:17.172593] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-06T21:12:17.425537] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-06T21:12:18.225503] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-06T21:12:18.266423] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T21:12:18.430380] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-06T21:12:19.025558] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-06T21:12:19.702281] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T21:12:19.705880] [INFO ] [REMOTE ] REXR: Full fetch complete (75173 records). [2025-10-06T21:12:19.706032] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-06T21:12:19.830604] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-06T21:12:20.032525] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T21:12:20.166855] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-10-06T21:12:20.166968] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-10-06T21:12:20.169621] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-10-06T21:12:20.169719] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-10-06T21:12:20.171754] [DEBUG] [LOCAL ] REXR: Trimmed 75173 records to 52097 (keeping 200 days of data) [2025-10-06T21:12:20.535378] [DEBUG] [LOCAL ] REXR: Primary data saved (52097 records). [2025-10-06T21:12:20.535593] [INFO ] [MAIN ] REXR: Full history saved. [2025-10-06T21:12:20.535726] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. REXR took 32.9s. Estimated remaining: 1h 21m 53s. Rate: 7.1 symbols/min [2025-10-06T21:12:20.626704] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-06T21:12:20.746131] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:12:20.762166] [DEBUG] [LOCAL ] RFL: Loaded 11269 existing records from primary storage. [2025-10-06T21:12:20.762509] [INFO ] [MAIN ] RFL: Loaded 11269 existing records. [2025-10-06T21:12:20.966330] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:12:20.966764] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-06T21:12:20.966967] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-06T21:12:20.967379] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-06T21:12:20.967499] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-06T21:12:21.167729] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-06T21:12:21.426728] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-06T21:12:21.426580] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:12:21.616857] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T21:12:22.225546] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-06T21:12:23.025568] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-06T21:12:23.249786] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T21:12:23.825570] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-06T21:12:24.028451] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T21:12:24.552823] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-06T21:12:24.625587] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-06T21:12:25.425558] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-06T21:12:25.614530] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T21:12:26.225539] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-06T21:12:26.861632] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T21:12:26.864424] [INFO ] [REMOTE ] RF: Full fetch complete (77237 records). [2025-10-06T21:12:26.864815] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-06T21:12:26.866084] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:12:26.866224] [FATAL] [MAIN ] RF: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:12:26.866274] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:12:26.866320] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-06T21:12:26.866386] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-06T21:12:26.866422] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-10-06T21:12:26.866706] [DEBUG] [LOCAL ] RF: Deleted derivative data file. [2025-10-06T21:12:26.867459] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. RF took 25.7s. Estimated remaining: 1h 21m 44s. Rate: 7.1 symbols/min [2025-10-06T21:12:27.035765] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-06T21:12:27.052676] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:12:27.061433] [DEBUG] [LOCAL ] RFM: Loaded 4209 existing records from primary storage. [2025-10-06T21:12:27.061879] [INFO ] [MAIN ] RFM: Loaded 4209 existing records. [2025-10-06T21:12:27.268152] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:12:27.287484] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-06T21:12:27.287724] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-06T21:12:27.288319] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-06T21:12:27.288950] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-06T21:12:27.296158] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-06T21:12:27.703633] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:12:27.806481] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T21:12:27.825511] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-06T21:12:28.625559] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-06T21:12:29.425537] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-06T21:12:30.079081] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T21:12:30.083198] [INFO ] [REMOTE ] REZI: Full fetch complete (66048 records). [2025-10-06T21:12:30.084041] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-06T21:12:30.274610] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T21:12:30.297974] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-06T21:12:30.644315] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-10-06T21:12:30.644484] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-10-06T21:12:30.646087] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-10-06T21:12:30.646159] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-10-06T21:12:30.648296] [DEBUG] [LOCAL ] REZI: Trimmed 66048 records to 47026 (keeping 200 days of data) [2025-10-06T21:12:30.953605] [DEBUG] [LOCAL ] REZI: Primary data saved (47026 records). [2025-10-06T21:12:30.953920] [INFO ] [MAIN ] REZI: Full history saved. [2025-10-06T21:12:30.954060] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. REZI took 37.1s. Estimated remaining: 1h 21m 34s. Rate: 7.1 symbols/min [2025-10-06T21:12:31.140771] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:12:31.141206] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T21:12:31.144763] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-06T21:12:31.160860] [DEBUG] [LOCAL ] RFMZ: Loaded 8851 existing records from primary storage. [2025-10-06T21:12:31.161379] [INFO ] [MAIN ] RFMZ: Loaded 8851 existing records. [2025-10-06T21:12:31.352413] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:12:31.352764] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-06T21:12:31.352836] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-06T21:12:31.353088] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-06T21:12:31.353148] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-06T21:12:31.736963] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:12:31.822767] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-06T21:12:31.825471] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-06T21:12:32.514715] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-06T21:12:32.625543] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-06T21:12:33.425561] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-06T21:12:34.289470] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-06T21:12:34.293555] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-06T21:12:35.268390] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (13.04 seconds). [2025-10-06T21:12:35.272522] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-06T21:12:36.242379] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T21:12:36.245127] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-06T21:12:37.134610] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-06T21:12:37.137402] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-06T21:12:37.143507] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (9.32 seconds). [2025-10-06T21:12:37.425596] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-06T21:12:38.119834] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-06T21:12:38.142007] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-06T21:12:38.225532] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-06T21:12:39.001268] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-06T21:12:39.025495] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-06T21:12:39.825542] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-06T21:12:39.969059] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T21:12:40.440125] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T21:12:40.625560] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-06T21:12:41.425570] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-06T21:12:42.076042] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T21:12:42.225535] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-06T21:12:42.320391] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-06T21:12:43.025541] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-06T21:12:43.219079] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T21:12:43.763383] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T21:12:43.764537] [INFO ] [REMOTE ] RFI: Full fetch complete (15679 records). [2025-10-06T21:12:43.764614] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-06T21:12:43.835417] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-06T21:12:44.181540] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-06T21:12:44.181331] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (11.56 seconds). [2025-10-06T21:12:44.181842] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-06T21:12:44.184842] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-06T21:12:44.185369] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-06T21:12:44.186293] [DEBUG] [LOCAL ] RFI: Trimmed 15679 records to 10454 (keeping 200 days of data) [2025-10-06T21:12:44.259037] [DEBUG] [LOCAL ] RFI: Primary data saved (10454 records). [2025-10-06T21:12:44.259235] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-06T21:12:44.259366] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RFI took 39.9s. Estimated remaining: 1h 21m 27s. Rate: 7.1 symbols/min [2025-10-06T21:12:44.446292] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:12:44.487617] [DEBUG] [LOCAL ] RGA: Loaded 30097 existing records from primary storage. [2025-10-06T21:12:44.488005] [INFO ] [MAIN ] RGA: Loaded 30097 existing records. [2025-10-06T21:12:44.630752] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-06T21:12:44.693456] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:12:44.694278] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-06T21:12:44.694341] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-06T21:12:44.694708] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-10-06T21:12:44.694770] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-06T21:12:44.879680] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-06T21:12:45.108565] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:12:45.380636] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T21:12:45.425508] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-06T21:12:46.225544] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-06T21:12:47.005384] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T21:12:47.025497] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-06T21:12:47.421954] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T21:12:47.825523] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-06T21:12:48.625553] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-06T21:12:48.653857] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T21:12:48.671044] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-06T21:12:48.672451] [INFO ] [REMOTE ] RFL: Full fetch complete (13064 records). [2025-10-06T21:12:48.672552] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-06T21:12:49.045867] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-06T21:12:49.045969] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-06T21:12:49.046448] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-06T21:12:49.046535] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-06T21:12:49.047115] [DEBUG] [LOCAL ] RFL: Trimmed 13064 records to 11280 (keeping 200 days of data) [2025-10-06T21:12:49.121312] [DEBUG] [LOCAL ] RFL: Primary data saved (11280 records). [2025-10-06T21:12:49.121531] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-06T21:12:49.122062] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RFL took 28.6s. Estimated remaining: 1h 21m 17s. Rate: 7.1 symbols/min [2025-10-06T21:12:49.297523] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:12:49.322902] [DEBUG] [LOCAL ] RGR: Loaded 20929 existing records from primary storage. [2025-10-06T21:12:49.323284] [INFO ] [MAIN ] RGR: Loaded 20929 existing records. [2025-10-06T21:12:49.427317] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-06T21:12:49.512545] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:12:49.512853] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-06T21:12:49.512906] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-06T21:12:49.513210] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-10-06T21:12:49.513270] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-06T21:12:49.876728] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:12:50.225522] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-06T21:12:50.909513] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T21:12:51.025626] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-06T21:12:51.509691] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T21:12:51.825600] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-06T21:12:52.221210] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T21:12:52.625601] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-06T21:12:52.979302] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-06T21:12:53.425577] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-06T21:12:54.066377] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T21:12:54.178373] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T21:12:54.225568] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-06T21:12:55.025581] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-06T21:12:55.899865] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T21:12:55.907786] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-06T21:12:56.123718] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T21:12:56.625600] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-06T21:12:57.229881] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T21:12:57.425551] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-06T21:12:57.807798] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T21:12:58.225575] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-06T21:12:58.800211] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T21:12:59.025573] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-06T21:12:59.510051] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-06T21:12:59.825566] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-06T21:13:01.076150] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-06T21:13:01.081516] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-06T21:13:02.310983] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T21:13:02.316891] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-06T21:13:03.116746] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (28.82 seconds). [2025-10-06T21:13:03.119215] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-06T21:13:03.592630] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T21:13:03.599162] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-06T21:13:04.789930] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (5.76 seconds). [2025-10-06T21:13:04.797729] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-06T21:13:04.870902] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-06T21:13:04.876924] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-06T21:13:04.910441] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (16.28 seconds). [2025-10-06T21:13:05.425508] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-06T21:13:05.941130] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T21:13:05.943563] [INFO ] [REMOTE ] RGR: Full fetch complete (28877 records). [2025-10-06T21:13:05.943716] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-06T21:13:06.173868] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T21:13:06.226564] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-06T21:13:06.366864] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-10-06T21:13:06.367167] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-10-06T21:13:06.368019] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-10-06T21:13:06.368238] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-10-06T21:13:06.387211] [DEBUG] [LOCAL ] RGR: Trimmed 28877 records to 20697 (keeping 200 days of data) [2025-10-06T21:13:06.388708] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T21:13:06.487092] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (3.37 seconds). [2025-10-06T21:13:06.529089] [DEBUG] [LOCAL ] RGR: Primary data saved (20697 records). [2025-10-06T21:13:06.529241] [INFO ] [MAIN ] RGR: Full history saved. [2025-10-06T21:13:06.529341] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RGR took 17.4s. Estimated remaining: 1h 21m 12s. Rate: 7.1 symbols/min [2025-10-06T21:13:06.698358] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:13:06.704280] [DEBUG] [LOCAL ] RGT: Loaded 2794 existing records from primary storage. [2025-10-06T21:13:06.704452] [INFO ] [MAIN ] RGT: Loaded 2794 existing records. [2025-10-06T21:13:06.885847] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:13:06.886059] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-06T21:13:06.886107] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-06T21:13:06.886304] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-06T21:13:06.886365] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-06T21:13:07.001463] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-06T21:13:07.038447] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-06T21:13:07.276617] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:13:07.825552] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-06T21:13:07.880664] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T21:13:08.492671] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-06T21:13:08.625593] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-06T21:13:09.425722] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-06T21:13:09.723593] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T21:13:09.725685] [INFO ] [REMOTE ] RGA: Full fetch complete (45509 records). [2025-10-06T21:13:09.725769] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-06T21:13:10.047544] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T21:13:10.124508] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-10-06T21:13:10.124618] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-10-06T21:13:10.126668] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-10-06T21:13:10.126738] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-10-06T21:13:10.128246] [DEBUG] [LOCAL ] RGA: Trimmed 45509 records to 29656 (keeping 200 days of data) [2025-10-06T21:13:10.235524] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-06T21:13:10.347773] [DEBUG] [LOCAL ] RGA: Primary data saved (29656 records). [2025-10-06T21:13:10.347980] [INFO ] [MAIN ] RGA: Full history saved. [2025-10-06T21:13:10.348085] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RGA took 26.1s. Estimated remaining: 1h 21m 2s. Rate: 7.1 symbols/min [2025-10-06T21:13:10.535318] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:13:10.589051] [DEBUG] [LOCAL ] RH: Loaded 48202 existing records from primary storage. [2025-10-06T21:13:10.589523] [INFO ] [MAIN ] RH: Loaded 48202 existing records. [2025-10-06T21:13:10.775923] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:13:10.776200] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-06T21:13:10.776252] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-06T21:13:10.776594] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-10-06T21:13:10.776723] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-06T21:13:10.853902] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T21:13:11.030850] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-06T21:13:11.170479] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:13:11.825569] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-06T21:13:11.849894] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-06T21:13:12.625557] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-06T21:13:13.179751] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T21:13:13.180815] [INFO ] [REMOTE ] RFM: Full fetch complete (5884 records). [2025-10-06T21:13:13.180899] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-06T21:13:13.434010] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-06T21:13:13.555130] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-06T21:13:13.555218] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-06T21:13:13.555397] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-06T21:13:13.555436] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-06T21:13:13.555887] [DEBUG] [LOCAL ] RFM: Trimmed 5884 records to 4146 (keeping 200 days of data) [2025-10-06T21:13:13.582767] [DEBUG] [LOCAL ] RFM: Primary data saved (4146 records). [2025-10-06T21:13:13.582925] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-06T21:13:13.583016] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RFM took 46.7s. Estimated remaining: 1h 20m 52s. Rate: 7.1 symbols/min [2025-10-06T21:13:14.225586] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-06T21:13:15.113739] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-06T21:13:15.116213] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-06T21:13:16.061310] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-06T21:13:16.065100] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-06T21:13:16.844050] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T21:13:16.847044] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-06T21:13:17.698943] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-06T21:13:17.701312] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-06T21:13:18.553571] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-06T21:13:18.556329] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-06T21:13:19.333790] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T21:13:19.336073] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-06T21:13:26.077708] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (14.25 seconds). [2025-10-06T21:13:26.086498] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-06T21:13:26.357384] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (12.92 seconds). [2025-10-06T21:13:26.359267] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-06T21:13:26.951359] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (7.62 seconds). [2025-10-06T21:13:26.956091] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-06T21:13:27.097412] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T21:13:27.098819] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-06T21:13:27.615953] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T21:13:27.616950] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12655 records). [2025-10-06T21:13:27.617019] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-06T21:13:27.782193] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-06T21:13:27.836058] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-06T21:13:27.942040] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T21:13:27.990209] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-06T21:13:28.036679] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-06T21:13:28.036778] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-06T21:13:28.037105] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-06T21:13:28.037168] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-06T21:13:28.037780] [DEBUG] [LOCAL ] RFMZ: Trimmed 12655 records to 8713 (keeping 200 days of data) [2025-10-06T21:13:28.095167] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8713 records). [2025-10-06T21:13:28.095313] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-06T21:13:28.095399] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RFMZ took 57.1s. Estimated remaining: 1h 20m 45s. Rate: 7.1 symbols/min [2025-10-06T21:13:28.595910] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T21:13:28.597377] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-06T21:13:29.115530] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-06T21:13:29.117279] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-06T21:13:29.508120] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T21:13:29.515867] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-06T21:13:29.690781] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-06T21:13:29.692204] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-06T21:13:30.241324] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T21:13:30.242279] [INFO ] [REMOTE ] RGT: Full fetch complete (4132 records). [2025-10-06T21:13:30.242352] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-06T21:13:30.605774] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-06T21:13:30.605859] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-06T21:13:30.606019] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-06T21:13:30.606057] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-06T21:13:30.606424] [DEBUG] [LOCAL ] RGT: Trimmed 4132 records to 2739 (keeping 200 days of data) [2025-10-06T21:13:30.623230] [DEBUG] [LOCAL ] RGT: Primary data saved (2739 records). [2025-10-06T21:13:30.623303] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-06T21:13:30.623378] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RGT took 24.1s. Estimated remaining: 1h 20m 35s. Rate: 7.1 symbols/min [2025-10-06T21:13:31.376104] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T21:13:31.386363] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-06T21:13:33.401267] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T21:13:33.412394] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-06T21:13:35.506296] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-06T21:13:35.516953] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-06T21:13:37.611796] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-06T21:13:37.622916] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-06T21:13:39.524847] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T21:13:39.536706] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-06T21:13:41.493979] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T21:13:41.503800] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-06T21:13:43.534187] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-06T21:13:43.545897] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-06T21:13:45.181879] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T21:13:45.184689] [INFO ] [REMOTE ] RH: Full fetch complete (65651 records). [2025-10-06T21:13:45.184787] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-06T21:13:45.563174] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-10-06T21:13:45.563257] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-10-06T21:13:45.564286] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-10-06T21:13:45.564351] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-10-06T21:13:45.565712] [DEBUG] [LOCAL ] RH: Trimmed 65651 records to 47481 (keeping 200 days of data) [2025-10-06T21:13:45.865041] [DEBUG] [LOCAL ] RH: Primary data saved (47481 records). [2025-10-06T21:13:45.865174] [INFO ] [MAIN ] RH: Full history saved. [2025-10-06T21:13:45.865260] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RH took 35.5s. Estimated remaining: 1h 20m 29s. Rate: 7.1 symbols/min [2025-10-06T21:13:46.412797] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:13:46.471311] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-06T21:13:46.507735] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-06T21:13:46.562769] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:13:46.570193] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-06T21:13:46.626600] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-06T21:13:46.652255] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-06T21:13:46.626490] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:13:46.651931] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:13:46.652450] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-06T21:13:47.080417] [DEBUG] [LOCAL ] RHP: Loaded 41824 existing records from primary storage. [2025-10-06T21:13:47.079803] [DEBUG] [LOCAL ] RIG: Loaded 54450 existing records from primary storage. [2025-10-06T21:13:47.111582] [INFO ] [MAIN ] RHP: Loaded 41824 existing records. [2025-10-06T21:13:47.113022] [DEBUG] [LOCAL ] RHI: Loaded 49999 existing records from primary storage. [2025-10-06T21:13:47.131019] [INFO ] [MAIN ] RHI: Loaded 49999 existing records. [2025-10-06T21:13:47.130399] [INFO ] [MAIN ] RIG: Loaded 54450 existing records. [2025-10-06T21:13:47.263829] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:13:47.353182] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-06T21:13:47.708765] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:13:47.760532] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:13:47.760681] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-06T21:13:47.768291] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-06T21:13:47.768519] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-06T21:13:47.768022] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:13:47.768610] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-06T21:13:47.769130] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-06T21:13:47.769254] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-10-06T21:13:47.769307] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-10-06T21:13:47.769497] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-06T21:13:47.769749] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-06T21:13:47.775157] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-06T21:13:47.775413] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-06T21:13:47.775235] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-06T21:13:47.842767] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:13:47.870607] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-06T21:13:47.950279] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:13:48.038696] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-06T21:13:48.082556] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:13:48.148752] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-06T21:13:48.247400] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-06T21:13:48.311230] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-06T21:13:48.327200] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-06T21:13:48.405278] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RHLD took 2.5s. Estimated remaining: 1h 20m 18s. Rate: 7.1 symbols/min [2025-10-06T21:13:48.851753] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:13:48.912946] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-06T21:13:49.029364] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:13:49.153751] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:13:49.159728] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-06T21:13:49.196587] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:13:49.198211] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-06T21:13:49.249515] [DEBUG] [LOCAL ] RIO: Loaded 54173 existing records from primary storage. [2025-10-06T21:13:49.250220] [INFO ] [MAIN ] RIO: Loaded 54173 existing records. [2025-10-06T21:13:49.437211] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:13:49.437734] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-06T21:13:49.437822] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-06T21:13:49.438345] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-10-06T21:13:49.438437] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-06T21:13:49.841767] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:13:49.842221] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-06T21:13:50.854880] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-06T21:13:50.865573] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-06T21:13:50.937200] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T21:13:50.945346] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-06T21:13:51.297770] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-06T21:13:51.310957] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-06T21:13:51.445351] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-06T21:13:51.455603] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-06T21:13:51.937859] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-06T21:13:51.949848] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-06T21:13:52.419521] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-06T21:13:52.430265] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-06T21:13:52.630771] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T21:13:52.638105] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-06T21:13:53.327023] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-06T21:13:53.337627] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-06T21:13:53.557613] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-06T21:13:53.573018] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-06T21:13:54.241038] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-06T21:13:54.253363] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-06T21:13:54.313151] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T21:13:54.325361] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-06T21:13:54.351381] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T21:13:54.361261] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-06T21:13:55.267869] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T21:13:55.277837] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-06T21:13:55.454864] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-06T21:13:55.466059] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-06T21:13:55.887762] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T21:13:55.899930] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-06T21:13:56.131280] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-06T21:13:56.142578] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-06T21:13:56.243072] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-06T21:13:56.254357] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-06T21:13:57.085116] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-06T21:13:57.097605] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-06T21:13:57.358020] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T21:13:57.368975] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-06T21:13:57.642230] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-06T21:13:57.653695] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-06T21:13:58.199028] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T21:13:58.211338] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-06T21:13:58.615140] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-06T21:13:58.627805] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-06T21:13:59.117019] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T21:13:59.128108] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-06T21:13:59.161399] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-06T21:13:59.173127] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-06T21:13:59.784664] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T21:13:59.787633] [INFO ] [REMOTE ] RHI: Full fetch complete (69721 records). [2025-10-06T21:13:59.787798] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-06T21:13:59.788675] [FATAL] [VALIDATOR ] RHI: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:13:59.788769] [FATAL] [MAIN ] RHI: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:13:59.788835] [WARN ] [MAIN ] RHI: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:13:59.788911] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-06T21:13:59.788988] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-06T21:13:59.789034] [INFO ] [LOCAL ] RHI: Starting deletion of derivative data. [2025-10-06T21:13:59.789461] [DEBUG] [LOCAL ] RHI: Deleted derivative data file. [2025-10-06T21:13:59.789584] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RHI took 13.9s. Estimated remaining: 1h 20m 11s. Rate: 7.1 symbols/min [2025-10-06T21:13:59.987683] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:14:00.014259] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-06T21:14:00.027638] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-06T21:14:00.086147] [DEBUG] [LOCAL ] RITM: Loaded 53610 existing records from primary storage. [2025-10-06T21:14:00.086591] [INFO ] [MAIN ] RITM: Loaded 53610 existing records. [2025-10-06T21:14:00.278518] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:14:00.278977] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-06T21:14:00.279035] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-06T21:14:00.279346] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-10-06T21:14:00.279404] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-06T21:14:00.653271] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:14:00.654000] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-06T21:14:00.691432] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T21:14:00.701636] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-06T21:14:00.981734] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-06T21:14:00.993298] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-06T21:14:02.328737] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-06T21:14:02.341551] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-06T21:14:02.467895] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T21:14:02.478474] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-06T21:14:02.707920] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-06T21:14:02.718830] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-06T21:14:03.257947] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-06T21:14:03.270424] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-06T21:14:04.158777] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T21:14:04.167979] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-06T21:14:04.392303] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-06T21:14:04.403881] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-06T21:14:04.891920] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T21:14:04.905387] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-06T21:14:05.057285] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-06T21:14:05.425571] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-06T21:14:05.867456] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T21:14:06.225516] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-06T21:14:06.630720] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-06T21:14:07.015233] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-06T21:14:07.027586] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-06T21:14:07.390302] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-06T21:14:07.522700] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T21:14:07.525571] [INFO ] [REMOTE ] RHP: Full fetch complete (58099 records). [2025-10-06T21:14:07.525748] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-06T21:14:07.830747] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-06T21:14:07.916734] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-10-06T21:14:07.916857] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-10-06T21:14:07.917919] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-10-06T21:14:07.917988] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-10-06T21:14:07.919460] [DEBUG] [LOCAL ] RHP: Trimmed 58099 records to 41067 (keeping 200 days of data) [2025-10-06T21:14:08.187588] [DEBUG] [LOCAL ] RHP: Primary data saved (41067 records). [2025-10-06T21:14:08.187769] [INFO ] [MAIN ] RHP: Full history saved. [2025-10-06T21:14:08.187861] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RHP took 22.3s. Estimated remaining: 1h 20m 2s. Rate: 7.1 symbols/min [2025-10-06T21:14:08.393377] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:14:08.411337] [DEBUG] [LOCAL ] RIV: Loaded 12542 existing records from primary storage. [2025-10-06T21:14:08.411713] [INFO ] [MAIN ] RIV: Loaded 12542 existing records. [2025-10-06T21:14:08.630743] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-06T21:14:08.637385] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:14:08.639178] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-06T21:14:08.639244] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-06T21:14:08.639543] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-10-06T21:14:08.639604] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-06T21:14:09.018943] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:14:09.373016] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-06T21:14:09.425475] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-06T21:14:10.102121] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-06T21:14:10.225489] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-06T21:14:10.299940] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T21:14:11.025554] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-06T21:14:11.506813] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-06T21:14:11.825498] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-06T21:14:12.475122] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-06T21:14:12.625525] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-06T21:14:13.212018] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-06T21:14:13.425593] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-06T21:14:13.537838] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-06T21:14:13.542262] [INFO ] [REMOTE ] RIG: Full fetch complete (77706 records). [2025-10-06T21:14:13.542471] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-06T21:14:13.962531] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-06T21:14:13.962751] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-06T21:14:13.964676] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-06T21:14:13.964751] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-06T21:14:13.968437] [DEBUG] [LOCAL ] RIG: Trimmed 77706 records to 53670 (keeping 200 days of data) [2025-10-06T21:14:14.171620] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T21:14:14.225812] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-06T21:14:14.339212] [DEBUG] [LOCAL ] RIG: Primary data saved (53670 records). [2025-10-06T21:14:14.339418] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-06T21:14:14.339522] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RIG took 28.5s. Estimated remaining: 1h 19m 53s. Rate: 7.1 symbols/min [2025-10-06T21:14:14.519785] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:14:14.571298] [DEBUG] [LOCAL ] RJF: Loaded 47609 existing records from primary storage. [2025-10-06T21:14:14.571753] [INFO ] [MAIN ] RJF: Loaded 47609 existing records. [2025-10-06T21:14:14.768888] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:14:14.769377] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-06T21:14:14.769451] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-06T21:14:14.769743] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-10-06T21:14:14.769801] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-06T21:14:15.035987] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-06T21:14:15.128444] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:14:15.158105] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-06T21:14:15.161490] [INFO ] [REMOTE ] RIO: Full fetch complete (77358 records). [2025-10-06T21:14:15.161821] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-06T21:14:15.594885] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-10-06T21:14:15.595031] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-10-06T21:14:15.597588] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-10-06T21:14:15.597714] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-10-06T21:14:15.599735] [DEBUG] [LOCAL ] RIO: Trimmed 77358 records to 53393 (keeping 200 days of data) [2025-10-06T21:14:15.851298] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-06T21:14:16.032426] [DEBUG] [LOCAL ] RIO: Primary data saved (53393 records). [2025-10-06T21:14:16.032784] [INFO ] [MAIN ] RIO: Full history saved. [2025-10-06T21:14:16.033044] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RIO took 27.6s. Estimated remaining: 1h 19m 43s. Rate: 7.1 symbols/min [2025-10-06T21:14:16.224876] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-06T21:14:16.319425] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:14:16.371263] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-06T21:14:16.448427] [DEBUG] [LOCAL ] RKT: Loaded 54501 existing records from primary storage. [2025-10-06T21:14:16.448970] [INFO ] [MAIN ] RKT: Loaded 54501 existing records. [2025-10-06T21:14:16.626793] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-06T21:14:16.659671] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:14:16.660099] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-06T21:14:16.660161] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-06T21:14:16.660419] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-10-06T21:14:16.660476] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-06T21:14:17.031673] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:14:17.425631] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-06T21:14:17.524193] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T21:14:17.591698] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T21:14:18.225622] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-06T21:14:19.025564] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-06T21:14:19.389209] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-06T21:14:19.409994] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T21:14:19.825509] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-06T21:14:19.901741] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T21:14:20.625563] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-06T21:14:21.425555] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-06T21:14:21.575329] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T21:14:21.706670] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-06T21:14:22.225588] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-06T21:14:23.025522] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-06T21:14:23.369894] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-06T21:14:23.825553] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-06T21:14:23.951159] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T21:14:24.184985] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T21:14:24.625544] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-06T21:14:25.425515] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-06T21:14:25.542115] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-06T21:14:25.598412] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T21:14:26.225553] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-06T21:14:26.325203] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T21:14:27.025582] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-06T21:14:27.825568] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-06T21:14:27.866304] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-06T21:14:28.132165] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T21:14:28.625543] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-06T21:14:29.425554] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-06T21:14:29.485615] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-06T21:14:29.983728] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-06T21:14:30.225554] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-06T21:14:30.554527] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-06T21:14:31.025533] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-06T21:14:31.182396] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T21:14:31.825543] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-06T21:14:31.971768] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T21:14:32.508755] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-06T21:14:32.625542] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-06T21:14:33.425552] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-06T21:14:34.225492] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-06T21:14:34.583203] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-06T21:14:34.785640] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-06T21:14:35.025563] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-06T21:14:35.759087] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T21:14:35.762915] [INFO ] [REMOTE ] RITM: Full fetch complete (76602 records). [2025-10-06T21:14:35.763129] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-06T21:14:35.832298] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-06T21:14:36.184829] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T21:14:36.254478] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-10-06T21:14:36.254592] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-10-06T21:14:36.256489] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-10-06T21:14:36.256580] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-10-06T21:14:36.258662] [DEBUG] [LOCAL ] RITM: Trimmed 76602 records to 52870 (keeping 200 days of data) [2025-10-06T21:14:36.623807] [DEBUG] [LOCAL ] RITM: Primary data saved (52870 records). [2025-10-06T21:14:36.624020] [INFO ] [MAIN ] RITM: Full history saved. [2025-10-06T21:14:36.625379] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RITM took 36.8s. Estimated remaining: 1h 19m 38s. Rate: 7.1 symbols/min [2025-10-06T21:14:36.625738] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-06T21:14:36.812541] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:14:36.859472] [DEBUG] [LOCAL ] RL: Loaded 41526 existing records from primary storage. [2025-10-06T21:14:36.859889] [INFO ] [MAIN ] RL: Loaded 41526 existing records. [2025-10-06T21:14:37.046196] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:14:37.046436] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-06T21:14:37.046538] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-06T21:14:37.046833] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-10-06T21:14:37.046892] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-06T21:14:37.428383] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:14:37.428534] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-06T21:14:37.704152] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T21:14:38.085172] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-06T21:14:38.141142] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T21:14:38.142800] [INFO ] [REMOTE ] RIV: Full fetch complete (17777 records). [2025-10-06T21:14:38.142883] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-06T21:14:38.230789] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-06T21:14:38.527172] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-06T21:14:38.527275] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-06T21:14:38.527937] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-06T21:14:38.528001] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-06T21:14:38.528831] [DEBUG] [LOCAL ] RIV: Trimmed 17777 records to 12420 (keeping 200 days of data) [2025-10-06T21:14:38.617435] [DEBUG] [LOCAL ] RIV: Primary data saved (12420 records). [2025-10-06T21:14:38.617633] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-06T21:14:38.617779] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RIV took 30.4s. Estimated remaining: 1h 19m 27s. Rate: 7.1 symbols/min [2025-10-06T21:14:38.810806] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:14:38.857617] [DEBUG] [LOCAL ] RLI: Loaded 34136 existing records from primary storage. [2025-10-06T21:14:38.858165] [INFO ] [MAIN ] RLI: Loaded 34136 existing records. [2025-10-06T21:14:39.030712] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-06T21:14:39.123820] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:14:39.124236] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-06T21:14:39.124356] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-06T21:14:39.124947] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-10-06T21:14:39.125016] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-06T21:14:39.546030] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T21:14:39.600265] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:14:39.825572] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-06T21:14:40.625569] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-06T21:14:41.055792] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T21:14:41.107950] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-06T21:14:41.128933] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-06T21:14:41.132051] [INFO ] [REMOTE ] RJF: Full fetch complete (68063 records). [2025-10-06T21:14:41.132232] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-06T21:14:41.133298] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:14:41.133395] [FATAL] [MAIN ] RJF: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:14:41.133468] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:14:41.133543] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-06T21:14:41.133620] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-06T21:14:41.133698] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-10-06T21:14:41.133938] [DEBUG] [LOCAL ] RJF: Deleted derivative data file. [2025-10-06T21:14:41.134847] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RJF took 26.8s. Estimated remaining: 1h 19m 17s. Rate: 7.1 symbols/min [2025-10-06T21:14:41.316507] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:14:41.380005] [DEBUG] [LOCAL ] RLJ: Loaded 48812 existing records from primary storage. [2025-10-06T21:14:41.380498] [INFO ] [MAIN ] RLJ: Loaded 48812 existing records. [2025-10-06T21:14:41.430697] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-06T21:14:41.620549] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:14:41.620854] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-06T21:14:41.620907] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-06T21:14:41.621911] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-10-06T21:14:41.622152] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-06T21:14:42.013527] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:14:42.225600] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-06T21:14:43.025512] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-06T21:14:43.570748] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-06T21:14:43.825562] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-06T21:14:44.037570] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T21:14:44.625563] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-06T21:14:44.840173] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T21:14:45.395484] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T21:14:45.425560] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-06T21:14:46.062150] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T21:14:46.225521] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-06T21:14:46.259001] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T21:14:47.025564] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-06T21:14:47.671007] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T21:14:47.825565] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-06T21:14:48.625532] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-06T21:14:49.227852] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-06T21:14:49.282950] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T21:14:49.425566] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-06T21:14:49.575223] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T21:14:50.225526] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-06T21:14:51.025516] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-06T21:14:51.211926] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T21:14:51.825544] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-06T21:14:51.893724] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-06T21:14:52.625537] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-06T21:14:52.701496] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-06T21:14:52.905545] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T21:14:53.425561] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-06T21:14:54.225518] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-06T21:14:54.284113] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T21:14:55.025553] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-06T21:14:55.070550] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-06T21:14:55.209975] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T21:14:55.825564] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-06T21:14:56.625563] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-06T21:14:56.886896] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T21:14:57.425585] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-06T21:14:57.806129] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-06T21:14:57.809819] [INFO ] [REMOTE ] RKT: Full fetch complete (77422 records). [2025-10-06T21:14:57.809989] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-06T21:14:58.233615] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T21:14:58.238521] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-06T21:14:58.298501] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-10-06T21:14:58.298681] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-10-06T21:14:58.300731] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-10-06T21:14:58.301064] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-10-06T21:14:58.303562] [DEBUG] [LOCAL ] RKT: Trimmed 77422 records to 53723 (keeping 200 days of data) [2025-10-06T21:14:58.437331] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T21:14:58.694419] [DEBUG] [LOCAL ] RKT: Primary data saved (53723 records). [2025-10-06T21:14:58.694612] [INFO ] [MAIN ] RKT: Full history saved. [2025-10-06T21:14:58.694762] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RKT took 42.7s. Estimated remaining: 1h 19m 12s. Rate: 7.1 symbols/min [2025-10-06T21:14:58.873435] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:14:58.889937] [DEBUG] [LOCAL ] RLTY: Loaded 11318 existing records from primary storage. [2025-10-06T21:14:58.890285] [INFO ] [MAIN ] RLTY: Loaded 11318 existing records. [2025-10-06T21:14:59.036535] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-06T21:14:59.083425] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:14:59.083700] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-06T21:14:59.083761] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-06T21:14:59.084052] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-06T21:14:59.084198] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-06T21:14:59.467883] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:14:59.825529] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-06T21:15:00.095612] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T21:15:00.132840] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-06T21:15:00.625544] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-06T21:15:01.302502] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T21:15:01.425562] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-06T21:15:02.225536] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-06T21:15:02.363140] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T21:15:03.025533] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-06T21:15:03.380562] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T21:15:03.518828] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-06T21:15:03.825548] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-06T21:15:04.468232] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T21:15:04.554000] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-06T21:15:04.625567] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-06T21:15:05.425544] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-06T21:15:06.185051] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T21:15:06.225601] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-06T21:15:06.884961] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T21:15:07.025585] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-06T21:15:07.451914] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-06T21:15:07.454276] [INFO ] [REMOTE ] RL: Full fetch complete (59653 records). [2025-10-06T21:15:07.454392] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-06T21:15:07.455545] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:15:07.455673] [FATAL] [MAIN ] RL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:15:07.455739] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:15:07.455800] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-06T21:15:07.455904] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-06T21:15:07.455959] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-10-06T21:15:07.456259] [DEBUG] [LOCAL ] RL: Deleted derivative data file. [2025-10-06T21:15:07.456379] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RL took 30.8s. Estimated remaining: 1h 19m 3s. Rate: 7.1 symbols/min [2025-10-06T21:15:07.660160] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:15:07.712914] [DEBUG] [LOCAL ] RLX: Loaded 48956 existing records from primary storage. [2025-10-06T21:15:07.713272] [INFO ] [MAIN ] RLX: Loaded 48956 existing records. [2025-10-06T21:15:07.830389] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-06T21:15:07.897591] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:15:07.898697] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-06T21:15:07.898833] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-06T21:15:07.899253] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-06T21:15:07.899315] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-06T21:15:08.332965] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-06T21:15:08.467262] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:15:08.625709] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-06T21:15:08.844245] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T21:15:09.425579] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-06T21:15:10.034193] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T21:15:10.225613] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-06T21:15:11.025573] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-06T21:15:11.179157] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T21:15:11.386008] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-06T21:15:11.825549] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-06T21:15:12.443694] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T21:15:12.625554] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-06T21:15:13.321952] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T21:15:13.425475] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-06T21:15:13.508120] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-06T21:15:14.225567] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-06T21:15:15.025738] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-06T21:15:15.081872] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T21:15:15.182233] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-06T21:15:15.825536] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-06T21:15:16.364502] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T21:15:16.367431] [INFO ] [REMOTE ] RLI: Full fetch complete (47488 records). [2025-10-06T21:15:16.367594] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-06T21:15:16.630736] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-06T21:15:16.768600] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-10-06T21:15:16.768730] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-10-06T21:15:16.769730] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-10-06T21:15:16.769796] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-10-06T21:15:16.770979] [DEBUG] [LOCAL ] RLI: Trimmed 47488 records to 33924 (keeping 200 days of data) [2025-10-06T21:15:16.989707] [DEBUG] [LOCAL ] RLI: Primary data saved (33924 records). [2025-10-06T21:15:16.989900] [INFO ] [MAIN ] RLI: Full history saved. [2025-10-06T21:15:16.990026] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RLI took 38.4s. Estimated remaining: 1h 18m 55s. Rate: 7.1 symbols/min [2025-10-06T21:15:17.157707] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:15:17.168504] [DEBUG] [LOCAL ] RM: Loaded 7730 existing records from primary storage. [2025-10-06T21:15:17.168792] [INFO ] [MAIN ] RM: Loaded 7730 existing records. [2025-10-06T21:15:17.345109] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:15:17.345403] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-06T21:15:17.345493] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-06T21:15:17.345745] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-06T21:15:17.345803] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-06T21:15:17.430636] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-06T21:15:17.727802] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:15:17.801777] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-06T21:15:17.842209] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-06T21:15:18.225553] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-06T21:15:19.025563] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-06T21:15:19.343519] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-06T21:15:19.825494] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-06T21:15:19.876321] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-06T21:15:20.587868] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-06T21:15:20.617694] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-06T21:15:20.625466] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-06T21:15:21.425499] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-06T21:15:21.521621] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T21:15:22.225486] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-06T21:15:22.397465] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T21:15:23.025521] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-06T21:15:23.778206] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T21:15:23.825560] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-06T21:15:24.080559] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T21:15:24.625505] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-06T21:15:24.817134] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-06T21:15:25.425515] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-06T21:15:25.546485] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-06T21:15:26.225492] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-06T21:15:26.364398] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T21:15:27.025526] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-06T21:15:27.579135] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T21:15:27.582239] [INFO ] [REMOTE ] RLJ: Full fetch complete (69275 records). [2025-10-06T21:15:27.582418] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-06T21:15:27.838270] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-06T21:15:27.971036] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-10-06T21:15:27.971129] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-10-06T21:15:27.972283] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-10-06T21:15:27.972348] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-10-06T21:15:27.973826] [DEBUG] [LOCAL ] RLJ: Trimmed 69275 records to 48114 (keeping 200 days of data) [2025-10-06T21:15:28.266395] [DEBUG] [LOCAL ] RLJ: Primary data saved (48114 records). [2025-10-06T21:15:28.266566] [INFO ] [MAIN ] RLJ: Full history saved. [2025-10-06T21:15:28.266704] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RLJ took 47.1s. Estimated remaining: 1h 18m 47s. Rate: 7.1 symbols/min [2025-10-06T21:15:28.437267] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:15:28.437599] [DEBUG] [LOCAL ] RMAX: No existing data file found in primary storage. [2025-10-06T21:15:28.437679] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-10-06T21:15:28.437812] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-06T21:15:28.437853] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-06T21:15:28.437895] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-06T21:15:28.437926] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-06T21:15:28.626242] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-06T21:15:28.683116] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T21:15:28.713005] [INFO ] [REMOTE ] RLTY: Full fetch complete (17778 records). [2025-10-06T21:15:28.734973] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-06T21:15:28.893825] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:15:29.174321] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-06T21:15:29.261389] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-06T21:15:29.261478] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-06T21:15:29.261982] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-06T21:15:29.262763] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-06T21:15:29.263430] [DEBUG] [LOCAL ] RLTY: Trimmed 17778 records to 11206 (keeping 200 days of data) [2025-10-06T21:15:29.336803] [DEBUG] [LOCAL ] RLTY: Primary data saved (11206 records). [2025-10-06T21:15:29.336966] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-06T21:15:29.337084] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLTY took 30.6s. Estimated remaining: 1h 18m 37s. Rate: 7.1 symbols/min [2025-10-06T21:15:29.430704] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-06T21:15:29.527685] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:15:29.579077] [DEBUG] [LOCAL ] RMD: Loaded 42565 existing records from primary storage. [2025-10-06T21:15:29.579960] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-06T21:15:29.584154] [INFO ] [MAIN ] RMD: Loaded 42565 existing records. [2025-10-06T21:15:29.780920] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:15:29.781194] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-06T21:15:29.781248] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-06T21:15:29.781891] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-10-06T21:15:29.781953] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-06T21:15:30.154469] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:15:30.225494] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-06T21:15:30.575524] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T21:15:31.025604] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-06T21:15:31.825535] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-06T21:15:32.042886] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-06T21:15:32.625555] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-06T21:15:32.785580] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T21:15:32.989149] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T21:15:33.425504] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-06T21:15:34.225512] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-06T21:15:34.452211] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T21:15:34.694539] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-06T21:15:35.025534] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-06T21:15:35.118909] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T21:15:35.825546] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-06T21:15:36.153342] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T21:15:36.587211] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-06T21:15:36.625568] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-06T21:15:37.425561] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-06T21:15:38.225530] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-06T21:15:38.270157] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T21:15:38.332092] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T21:15:39.025515] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-06T21:15:39.104128] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T21:15:39.825682] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-06T21:15:40.477837] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T21:15:40.481560] [INFO ] [REMOTE ] RLX: Full fetch complete (70168 records). [2025-10-06T21:15:40.481828] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-06T21:15:40.639905] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-06T21:15:40.913147] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-06T21:15:40.913336] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-06T21:15:40.914995] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-06T21:15:40.924007] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-06T21:15:40.947063] [DEBUG] [LOCAL ] RLX: Trimmed 70168 records to 48160 (keeping 200 days of data) [2025-10-06T21:15:40.946840] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T21:15:41.269391] [DEBUG] [LOCAL ] RLX: Primary data saved (48160 records). [2025-10-06T21:15:41.269595] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-06T21:15:41.269731] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RLX took 33.8s. Estimated remaining: 1h 18m 29s. Rate: 7.1 symbols/min [2025-10-06T21:15:41.428777] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-06T21:15:41.449503] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:15:41.459904] [DEBUG] [LOCAL ] RMI: Loaded 4750 existing records from primary storage. [2025-10-06T21:15:41.460253] [INFO ] [MAIN ] RMI: Loaded 4750 existing records. [2025-10-06T21:15:41.597452] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T21:15:41.672887] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:15:41.673249] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-06T21:15:41.673305] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-06T21:15:41.673574] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-10-06T21:15:41.673637] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-06T21:15:42.095183] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:15:42.225574] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-06T21:15:42.718979] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-06T21:15:43.025583] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-06T21:15:43.248610] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T21:15:43.825506] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-06T21:15:43.903841] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T21:15:44.522442] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-06T21:15:44.625493] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-06T21:15:45.275347] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T21:15:45.276626] [INFO ] [REMOTE ] RM: Full fetch complete (11562 records). [2025-10-06T21:15:45.276728] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-06T21:15:45.430763] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-06T21:15:45.644766] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-06T21:15:45.644857] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-06T21:15:45.645138] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-06T21:15:45.645176] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-06T21:15:45.645615] [DEBUG] [LOCAL ] RM: Trimmed 11562 records to 7565 (keeping 200 days of data) [2025-10-06T21:15:45.690819] [DEBUG] [LOCAL ] RM: Primary data saved (7565 records). [2025-10-06T21:15:45.690950] [INFO ] [MAIN ] RM: Full history saved. [2025-10-06T21:15:45.691034] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RM took 28.7s. Estimated remaining: 1h 18m 20s. Rate: 7.1 symbols/min [2025-10-06T21:15:45.882913] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:15:45.896508] [DEBUG] [LOCAL ] RMM: Loaded 10691 existing records from primary storage. [2025-10-06T21:15:45.896764] [INFO ] [MAIN ] RMM: Loaded 10691 existing records. [2025-10-06T21:15:46.070102] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:15:46.070314] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-06T21:15:46.070360] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-06T21:15:46.070878] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-10-06T21:15:46.070936] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-06T21:15:46.225509] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-06T21:15:46.425722] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:15:46.591136] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T21:15:46.915414] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-06T21:15:47.025768] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-06T21:15:47.825567] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-06T21:15:47.980878] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T21:15:48.312638] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-06T21:15:48.625535] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-06T21:15:49.425541] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-06T21:15:49.641272] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T21:15:50.050877] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-06T21:15:50.225542] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-06T21:15:51.025547] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-06T21:15:51.304035] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T21:15:51.784452] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T21:15:51.825547] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-06T21:15:52.529937] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-06T21:15:52.625586] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-06T21:15:53.425606] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-06T21:15:53.857123] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T21:15:54.052373] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-06T21:15:54.225577] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-06T21:15:55.025565] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-06T21:15:55.191249] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T21:15:55.728929] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-06T21:15:55.825498] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-06T21:15:56.620799] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T21:15:56.625466] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-06T21:15:57.295326] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T21:15:57.425556] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-06T21:15:58.225514] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-06T21:15:58.349145] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-06T21:15:58.666797] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-06T21:15:58.667573] [INFO ] [REMOTE ] RMI: Full fetch complete (6267 records). [2025-10-06T21:15:58.667665] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-06T21:15:59.025765] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-06T21:15:59.031400] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-10-06T21:15:59.032838] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-10-06T21:15:59.033070] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-10-06T21:15:59.033115] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-10-06T21:15:59.033543] [DEBUG] [LOCAL ] RMI: Trimmed 6267 records to 4694 (keeping 200 days of data) [2025-10-06T21:15:59.064866] [DEBUG] [LOCAL ] RMI: Primary data saved (4694 records). [2025-10-06T21:15:59.065057] [INFO ] [MAIN ] RMI: Full history saved. [2025-10-06T21:15:59.065172] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RMI took 17.8s. Estimated remaining: 1h 18m 13s. Rate: 7.1 symbols/min [2025-10-06T21:15:59.245369] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:15:59.253918] [DEBUG] [LOCAL ] RMMZ: Loaded 4894 existing records from primary storage. [2025-10-06T21:15:59.254195] [INFO ] [MAIN ] RMMZ: Loaded 4894 existing records. [2025-10-06T21:15:59.435145] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:15:59.435454] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-06T21:15:59.435503] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-06T21:15:59.435741] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-06T21:15:59.435817] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-06T21:15:59.787200] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:15:59.825469] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-06T21:16:00.325961] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-06T21:16:00.423438] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-06T21:16:00.625830] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-06T21:16:01.425701] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-06T21:16:01.504034] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T21:16:02.039949] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T21:16:02.225614] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-06T21:16:02.916041] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-06T21:16:03.025552] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-06T21:16:03.825698] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-06T21:16:04.359890] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T21:16:04.362583] [INFO ] [REMOTE ] RMD: Full fetch complete (60890 records). [2025-10-06T21:16:04.362767] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-06T21:16:04.363740] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:16:04.363851] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:16:04.364066] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:16:04.371032] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-06T21:16:04.383444] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-06T21:16:04.385768] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-10-06T21:16:04.386537] [DEBUG] [LOCAL ] RMD: Deleted derivative data file. [2025-10-06T21:16:04.386688] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RMD took 35.0s. Estimated remaining: 1h 18m 3s. Rate: 7.1 symbols/min [2025-10-06T21:16:04.388374] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T21:16:04.570539] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:16:04.590083] [DEBUG] [LOCAL ] RMT: Loaded 17594 existing records from primary storage. [2025-10-06T21:16:04.590408] [INFO ] [MAIN ] RMT: Loaded 17594 existing records. [2025-10-06T21:16:04.630795] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-06T21:16:04.771171] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:16:04.771467] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-06T21:16:04.771525] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-06T21:16:04.771815] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-06T21:16:04.771872] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-06T21:16:05.121820] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:16:05.425542] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-06T21:16:05.910797] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T21:16:06.225512] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-06T21:16:06.386596] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T21:16:07.025500] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-06T21:16:07.344511] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T21:16:07.825501] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-06T21:16:07.884172] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T21:16:08.625496] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-06T21:16:08.727963] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T21:16:08.729593] [INFO ] [REMOTE ] RMAX: Full fetch complete (29955 records). [2025-10-06T21:16:08.729833] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-06T21:16:09.088671] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-10-06T21:16:09.088773] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-10-06T21:16:09.089431] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-10-06T21:16:09.089470] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-10-06T21:16:09.090235] [DEBUG] [LOCAL ] RMAX: Trimmed 29955 records to 21508 (keeping 200 days of data) [2025-10-06T21:16:09.212890] [DEBUG] [LOCAL ] RMAX: Primary data saved (21508 records). [2025-10-06T21:16:09.213050] [INFO ] [MAIN ] RMAX: Full history saved. [2025-10-06T21:16:09.213126] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMAX took 40.9s. Estimated remaining: 1h 17m 54s. Rate: 7.1 symbols/min [2025-10-06T21:16:09.382928] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:16:09.426876] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-06T21:16:09.429034] [DEBUG] [LOCAL ] RNG: Loaded 48745 existing records from primary storage. [2025-10-06T21:16:09.429363] [INFO ] [MAIN ] RNG: Loaded 48745 existing records. [2025-10-06T21:16:09.624132] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:16:09.624443] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-06T21:16:09.624510] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-06T21:16:09.625695] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-10-06T21:16:09.625759] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-06T21:16:09.763529] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T21:16:10.032620] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:16:10.140689] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-06T21:16:10.225525] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-06T21:16:11.025590] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-06T21:16:11.149616] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T21:16:11.762971] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T21:16:11.825524] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-06T21:16:12.625506] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-06T21:16:12.760984] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T21:16:13.366110] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T21:16:13.425486] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-06T21:16:14.141210] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-06T21:16:14.225522] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-06T21:16:15.025567] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-06T21:16:15.825511] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-06T21:16:15.982491] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T21:16:16.243904] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-06T21:16:16.625497] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-06T21:16:16.767177] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T21:16:17.425558] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-06T21:16:18.123170] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-06T21:16:18.126171] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T21:16:18.225623] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-06T21:16:19.025566] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-06T21:16:19.825549] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-06T21:16:19.904351] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T21:16:19.905024] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-06T21:16:20.600305] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-06T21:16:20.625551] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-06T21:16:21.425553] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-06T21:16:22.182284] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-06T21:16:22.225558] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-06T21:16:22.442178] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T21:16:23.025498] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-06T21:16:23.097885] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-06T21:16:23.825528] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-06T21:16:24.625545] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-06T21:16:24.694686] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T21:16:24.806332] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T21:16:25.249957] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-06T21:16:25.425526] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-06T21:16:26.225616] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-06T21:16:26.505768] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-06T21:16:26.698153] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T21:16:26.699115] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7083 records). [2025-10-06T21:16:26.699199] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-06T21:16:27.033057] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-06T21:16:27.079008] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-06T21:16:27.079095] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-06T21:16:27.079311] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-06T21:16:27.079385] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-06T21:16:27.079850] [DEBUG] [LOCAL ] RMMZ: Trimmed 7083 records to 4816 (keeping 200 days of data) [2025-10-06T21:16:27.111172] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4816 records). [2025-10-06T21:16:27.111286] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-06T21:16:27.111371] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMMZ took 28.0s. Estimated remaining: 1h 17m 48s. Rate: 7.1 symbols/min [2025-10-06T21:16:27.286502] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:16:27.309353] [DEBUG] [LOCAL ] RNGR: Loaded 20656 existing records from primary storage. [2025-10-06T21:16:27.309699] [INFO ] [MAIN ] RNGR: Loaded 20656 existing records. [2025-10-06T21:16:27.490162] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:16:27.490411] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-06T21:16:27.490459] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-06T21:16:27.490716] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-10-06T21:16:27.490774] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-06T21:16:27.833023] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-06T21:16:27.858263] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:16:28.625504] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-06T21:16:28.779389] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T21:16:28.845747] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T21:16:29.425561] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-06T21:16:29.463927] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-06T21:16:30.225585] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-06T21:16:30.582629] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T21:16:31.025530] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-06T21:16:31.236075] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T21:16:31.825558] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-06T21:16:32.289301] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T21:16:32.625590] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-06T21:16:33.425506] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-06T21:16:33.509552] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T21:16:33.777245] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T21:16:34.225603] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-06T21:16:34.352338] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T21:16:35.025620] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-06T21:16:35.475425] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T21:16:35.773855] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-06T21:16:35.775037] [INFO ] [REMOTE ] RMM: Full fetch complete (15068 records). [2025-10-06T21:16:35.775119] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-06T21:16:35.830679] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-06T21:16:36.166122] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-10-06T21:16:36.166247] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-10-06T21:16:36.166626] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-10-06T21:16:36.166706] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-10-06T21:16:36.167456] [DEBUG] [LOCAL ] RMM: Trimmed 15068 records to 10607 (keeping 200 days of data) [2025-10-06T21:16:36.233664] [DEBUG] [LOCAL ] RMM: Primary data saved (10607 records). [2025-10-06T21:16:36.233893] [INFO ] [MAIN ] RMM: Full history saved. [2025-10-06T21:16:36.234005] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMM took 50.5s. Estimated remaining: 1h 17m 40s. Rate: 7.1 symbols/min [2025-10-06T21:16:36.404610] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:16:36.421416] [DEBUG] [LOCAL ] RNP: Loaded 16151 existing records from primary storage. [2025-10-06T21:16:36.421703] [INFO ] [MAIN ] RNP: Loaded 16151 existing records. [2025-10-06T21:16:36.596098] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:16:36.596321] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-06T21:16:36.596370] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-06T21:16:36.596923] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-06T21:16:36.596983] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-06T21:16:36.630845] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-06T21:16:37.001492] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:16:37.096680] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-06T21:16:37.425564] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-06T21:16:37.840748] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-06T21:16:38.225575] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-06T21:16:38.480780] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T21:16:39.025592] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-06T21:16:39.362675] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T21:16:39.825540] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-06T21:16:40.630911] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-06T21:16:40.653836] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T21:16:40.926190] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T21:16:41.425583] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-06T21:16:41.660050] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-06T21:16:42.225545] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-06T21:16:43.025535] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-06T21:16:43.219959] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T21:16:43.550847] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-06T21:16:43.825557] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-06T21:16:44.269153] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T21:16:44.625542] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-06T21:16:45.089302] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T21:16:45.425546] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-06T21:16:45.667986] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T21:16:46.225489] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-06T21:16:46.586017] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-06T21:16:46.822667] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T21:16:46.824898] [INFO ] [REMOTE ] RMT: Full fetch complete (25461 records). [2025-10-06T21:16:46.825053] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-06T21:16:47.027940] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-06T21:16:47.239560] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-06T21:16:47.239677] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-06T21:16:47.240547] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-06T21:16:47.240591] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-06T21:16:47.241448] [DEBUG] [LOCAL ] RMT: Trimmed 25461 records to 17391 (keeping 200 days of data) [2025-10-06T21:16:47.356699] [DEBUG] [LOCAL ] RMT: Primary data saved (17391 records). [2025-10-06T21:16:47.356894] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-06T21:16:47.356996] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RMT took 43.0s. Estimated remaining: 1h 17m 32s. Rate: 7.1 symbols/min [2025-10-06T21:16:47.548232] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:16:47.594890] [DEBUG] [LOCAL ] RNR: Loaded 34345 existing records from primary storage. [2025-10-06T21:16:47.595397] [INFO ] [MAIN ] RNR: Loaded 34345 existing records. [2025-10-06T21:16:47.785062] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:16:47.785374] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-06T21:16:47.785426] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-06T21:16:47.785727] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-10-06T21:16:47.785785] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-06T21:16:47.830727] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-06T21:16:48.152697] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:16:48.625570] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-06T21:16:48.969114] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T21:16:49.012481] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-06T21:16:49.425561] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-06T21:16:50.225490] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-06T21:16:50.300339] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T21:16:50.316805] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-06T21:16:50.318234] [INFO ] [REMOTE ] RNGR: Full fetch complete (28209 records). [2025-10-06T21:16:50.318331] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-06T21:16:50.687320] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-10-06T21:16:50.687430] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-10-06T21:16:50.688108] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-10-06T21:16:50.688171] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-10-06T21:16:50.688957] [DEBUG] [LOCAL ] RNGR: Trimmed 28209 records to 20390 (keeping 200 days of data) [2025-10-06T21:16:50.819136] [DEBUG] [LOCAL ] RNGR: Primary data saved (20390 records). [2025-10-06T21:16:50.819297] [INFO ] [MAIN ] RNGR: Full history saved. [2025-10-06T21:16:50.819391] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RNGR took 23.7s. Estimated remaining: 1h 17m 22s. Rate: 7.1 symbols/min [2025-10-06T21:16:50.986746] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:16:51.030769] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-06T21:16:51.033913] [DEBUG] [LOCAL ] RNST: Loaded 37572 existing records from primary storage. [2025-10-06T21:16:51.034279] [INFO ] [MAIN ] RNST: Loaded 37572 existing records. [2025-10-06T21:16:51.229901] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:16:51.230268] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-06T21:16:51.230355] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-06T21:16:51.230758] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-10-06T21:16:51.230817] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-06T21:16:51.414618] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T21:16:51.487261] [INFO ] [REMOTE ] RNG: Full fetch complete (69383 records). [2025-10-06T21:16:51.499036] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-06T21:16:51.807397] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:16:51.828421] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-06T21:16:52.046688] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-10-06T21:16:52.046806] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-10-06T21:16:52.048002] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-10-06T21:16:52.048088] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-10-06T21:16:52.049716] [DEBUG] [LOCAL ] RNG: Trimmed 69383 records to 47976 (keeping 200 days of data) [2025-10-06T21:16:52.260721] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T21:16:52.343664] [DEBUG] [LOCAL ] RNG: Primary data saved (47976 records). [2025-10-06T21:16:52.343839] [INFO ] [MAIN ] RNG: Full history saved. [2025-10-06T21:16:52.343932] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNG took 43.1s. Estimated remaining: 1h 17m 12s. Rate: 7.1 symbols/min [2025-10-06T21:16:52.515068] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:16:52.537680] [DEBUG] [LOCAL ] ROG: Loaded 23154 existing records from primary storage. [2025-10-06T21:16:52.537953] [INFO ] [MAIN ] ROG: Loaded 23154 existing records. [2025-10-06T21:16:52.634698] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-06T21:16:52.726330] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:16:52.726679] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-06T21:16:52.726746] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-06T21:16:52.726953] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-10-06T21:16:52.726998] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-06T21:16:53.100918] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:16:53.425707] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-06T21:16:53.495173] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T21:16:53.522749] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T21:16:54.225515] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-06T21:16:54.524031] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T21:16:55.025524] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-06T21:16:55.818756] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T21:16:55.826922] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-06T21:16:56.127485] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T21:16:56.625557] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-06T21:16:56.993468] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-06T21:16:57.425572] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-06T21:16:58.222818] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T21:16:58.229925] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-06T21:16:58.507836] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T21:16:59.025552] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-06T21:16:59.723194] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T21:16:59.825549] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-06T21:17:00.598969] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T21:17:00.625564] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-06T21:17:00.981509] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T21:17:01.425580] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-06T21:17:02.232438] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-06T21:17:02.246998] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T21:17:03.025564] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-06T21:17:03.155630] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T21:17:03.550713] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T21:17:03.825537] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-06T21:17:04.438143] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T21:17:04.625595] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-06T21:17:05.119728] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-06T21:17:05.425616] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-06T21:17:06.225570] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-06T21:17:06.261852] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T21:17:07.021926] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T21:17:07.030290] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-06T21:17:07.336473] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-06T21:17:07.825542] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-06T21:17:08.453846] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T21:17:08.625506] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-06T21:17:08.890982] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T21:17:09.425562] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-06T21:17:10.179009] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T21:17:10.225636] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-06T21:17:10.607127] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T21:17:11.025814] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-06T21:17:11.825543] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-06T21:17:11.897890] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T21:17:12.625520] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-06T21:17:12.709510] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T21:17:12.746719] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T21:17:12.748579] [INFO ] [REMOTE ] RNP: Full fetch complete (23648 records). [2025-10-06T21:17:12.748688] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-06T21:17:13.160932] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-06T21:17:13.161044] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-06T21:17:13.161774] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-06T21:17:13.161838] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-06T21:17:13.162756] [DEBUG] [LOCAL ] RNP: Trimmed 23648 records to 15983 (keeping 200 days of data) [2025-10-06T21:17:13.275551] [DEBUG] [LOCAL ] RNP: Primary data saved (15983 records). [2025-10-06T21:17:13.275821] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-06T21:17:13.275944] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNP took 37.0s. Estimated remaining: 1h 17m 7s. Rate: 7.1 symbols/min [2025-10-06T21:17:13.434373] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-06T21:17:13.473629] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:17:13.519870] [DEBUG] [LOCAL ] ROK: Loaded 44301 existing records from primary storage. [2025-10-06T21:17:13.520317] [INFO ] [MAIN ] ROK: Loaded 44301 existing records. [2025-10-06T21:17:13.707911] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:17:13.708329] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-06T21:17:13.708393] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-06T21:17:13.708768] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-10-06T21:17:13.708827] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-06T21:17:14.071241] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:17:14.087604] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T21:17:14.225559] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-06T21:17:15.025545] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-06T21:17:15.076408] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T21:17:15.674009] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T21:17:15.825572] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-06T21:17:16.603868] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T21:17:16.625514] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-06T21:17:16.729186] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T21:17:17.425584] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-06T21:17:17.566096] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T21:17:18.225543] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-06T21:17:19.025498] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-06T21:17:19.185063] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T21:17:19.360739] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T21:17:19.363240] [INFO ] [REMOTE ] RNST: Full fetch complete (53284 records). [2025-10-06T21:17:19.363382] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-06T21:17:19.776753] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-10-06T21:17:19.776852] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-10-06T21:17:19.778063] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-10-06T21:17:19.778189] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-10-06T21:17:19.779559] [DEBUG] [LOCAL ] RNST: Trimmed 53284 records to 36974 (keeping 200 days of data) [2025-10-06T21:17:19.837174] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-06T21:17:20.030341] [DEBUG] [LOCAL ] RNST: Primary data saved (36974 records). [2025-10-06T21:17:20.030546] [INFO ] [MAIN ] RNST: Full history saved. [2025-10-06T21:17:20.030688] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNST took 29.2s. Estimated remaining: 1h 16m 58s. Rate: 7.1 symbols/min [2025-10-06T21:17:20.198419] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:17:20.254545] [DEBUG] [LOCAL ] ROL: Loaded 51042 existing records from primary storage. [2025-10-06T21:17:20.255137] [INFO ] [MAIN ] ROL: Loaded 51042 existing records. [2025-10-06T21:17:20.352032] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T21:17:20.379943] [INFO ] [REMOTE ] RNR: Full fetch complete (51126 records). [2025-10-06T21:17:20.406901] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-06T21:17:20.487059] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:17:20.517999] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-06T21:17:20.550381] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-06T21:17:20.577213] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-10-06T21:17:20.578123] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-06T21:17:20.638452] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-06T21:17:21.163303] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-10-06T21:17:21.173858] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-10-06T21:17:21.202882] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-10-06T21:17:21.208804] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-10-06T21:17:21.223699] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T21:17:21.224704] [DEBUG] [LOCAL ] RNR: Trimmed 51126 records to 33812 (keeping 200 days of data) [2025-10-06T21:17:21.316705] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:17:21.425639] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-06T21:17:21.561246] [DEBUG] [LOCAL ] RNR: Primary data saved (33812 records). [2025-10-06T21:17:21.561448] [INFO ] [MAIN ] RNR: Full history saved. [2025-10-06T21:17:21.561554] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. RNR took 34.2s. Estimated remaining: 1h 16m 48s. Rate: 7.1 symbols/min [2025-10-06T21:17:21.746998] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:17:21.793108] [DEBUG] [LOCAL ] RPM: Loaded 42177 existing records from primary storage. [2025-10-06T21:17:21.793578] [INFO ] [MAIN ] RPM: Loaded 42177 existing records. [2025-10-06T21:17:21.953028] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T21:17:22.001580] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:17:22.001906] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-06T21:17:22.001959] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-06T21:17:22.002212] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-10-06T21:17:22.002272] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-06T21:17:22.231504] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-06T21:17:22.357017] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:17:23.025717] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-06T21:17:23.259108] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T21:17:23.300889] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-06T21:17:23.825550] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-06T21:17:24.625595] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-06T21:17:24.712350] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T21:17:24.786689] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T21:17:25.187740] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-06T21:17:25.425523] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-06T21:17:26.225565] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-06T21:17:26.322078] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-06T21:17:27.025554] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-06T21:17:27.825500] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-06T21:17:27.849433] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T21:17:28.006090] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T21:17:28.625577] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-06T21:17:28.715586] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T21:17:29.425619] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-06T21:17:29.475836] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T21:17:30.225560] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-06T21:17:31.025495] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-06T21:17:31.056245] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T21:17:31.213300] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T21:17:31.825528] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-06T21:17:32.254932] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-06T21:17:32.625496] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-06T21:17:32.888297] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-06T21:17:33.425602] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-06T21:17:33.611634] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-06T21:17:34.225544] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-06T21:17:34.323976] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T21:17:35.025521] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-06T21:17:35.101703] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-06T21:17:35.103341] [INFO ] [REMOTE ] ROG: Full fetch complete (30962 records). [2025-10-06T21:17:35.103462] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-06T21:17:35.171448] [DEBUG] [REMOTE ] ROK: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-06T21:17:35.208143] [WARN ] [REMOTE ] ROK: No data returned for month 2025-06 [2025-10-06T21:17:35.211145] [FATAL] [REMOTE ] ROK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:17:35.211272] [FATAL] [MAIN ] ROK: Failed to fetch primary data. [2025-10-06T21:17:35.217199] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:17:35.232998] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-06T21:17:35.272903] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-06T21:17:35.293588] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-10-06T21:17:35.363598] [DEBUG] [LOCAL ] ROK: Deleted derivative data file. [2025-10-06T21:17:35.374846] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. ROK took 22.1s. Estimated remaining: 1h 16m 41s. Rate: 7.1 symbols/min [2025-10-06T21:17:35.639254] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-10-06T21:17:35.655717] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-10-06T21:17:35.656519] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-10-06T21:17:35.656593] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-10-06T21:17:35.655662] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:17:35.658590] [DEBUG] [LOCAL ] ROG: Trimmed 30962 records to 22753 (keeping 200 days of data) [2025-10-06T21:17:35.779100] [DEBUG] [LOCAL ] RPT: Loaded 19194 existing records from primary storage. [2025-10-06T21:17:35.785372] [INFO ] [MAIN ] RPT: Loaded 19194 existing records. [2025-10-06T21:17:35.825993] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-06T21:17:35.926241] [DEBUG] [LOCAL ] ROG: Primary data saved (22753 records). [2025-10-06T21:17:35.947026] [INFO ] [MAIN ] ROG: Full history saved. [2025-10-06T21:17:35.960274] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. ROG took 43.6s. Estimated remaining: 1h 16m 30s. Rate: 7.1 symbols/min [2025-10-06T21:17:36.111527] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:17:36.117690] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-06T21:17:36.122937] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-06T21:17:36.151312] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-06T21:17:36.164849] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-06T21:17:36.264988] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:17:36.517178] [DEBUG] [LOCAL ] RQI: Loaded 29489 existing records from primary storage. [2025-10-06T21:17:36.538456] [INFO ] [MAIN ] RQI: Loaded 29489 existing records. [2025-10-06T21:17:36.595279] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:17:36.627361] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-06T21:17:36.776738] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:17:36.777142] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-06T21:17:36.777215] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-06T21:17:36.777573] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-10-06T21:17:36.777630] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-06T21:17:37.061967] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-06T21:17:37.182164] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:17:37.425518] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-06T21:17:37.815837] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-06T21:17:38.225549] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-06T21:17:39.021209] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T21:17:39.027740] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-06T21:17:39.346876] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T21:17:39.825548] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-06T21:17:40.630995] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-06T21:17:40.648095] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T21:17:40.788518] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T21:17:41.425551] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-06T21:17:42.223088] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T21:17:42.233485] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-06T21:17:42.319454] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T21:17:43.025537] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-06T21:17:43.825541] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-06T21:17:43.907538] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T21:17:44.200101] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T21:17:44.625567] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-06T21:17:44.972388] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T21:17:45.425501] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-06T21:17:45.798831] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-06T21:17:46.225552] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-06T21:17:46.552810] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T21:17:47.025565] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-06T21:17:47.430135] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T21:17:47.825608] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-06T21:17:48.625513] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-06T21:17:48.867692] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T21:17:49.265122] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T21:17:49.425594] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-06T21:17:49.666015] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-06T21:17:50.225595] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-06T21:17:50.896206] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T21:17:51.025552] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-06T21:17:51.825489] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-06T21:17:51.921601] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T21:17:52.299961] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T21:17:52.303556] [INFO ] [REMOTE ] ROL: Full fetch complete (72498 records). [2025-10-06T21:17:52.303726] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-06T21:17:52.304612] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:17:52.304745] [FATAL] [MAIN ] ROL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:17:52.304793] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:17:52.304905] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-06T21:17:52.305003] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-06T21:17:52.305061] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-06T21:17:52.305377] [DEBUG] [LOCAL ] ROL: Deleted derivative data file. [2025-10-06T21:17:52.305486] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. ROL took 32.3s. Estimated remaining: 1h 16m 24s. Rate: 7.1 symbols/min [2025-10-06T21:17:52.456019] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T21:17:52.519632] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:17:52.578555] [DEBUG] [LOCAL ] RRC: Loaded 53576 existing records from primary storage. [2025-10-06T21:17:52.579018] [INFO ] [MAIN ] RRC: Loaded 53576 existing records. [2025-10-06T21:17:52.635094] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-06T21:17:52.772950] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:17:52.773261] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-06T21:17:52.773318] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-06T21:17:52.773691] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-10-06T21:17:52.773757] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-06T21:17:53.151822] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:17:53.425602] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-06T21:17:54.225540] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-06T21:17:54.409056] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T21:17:54.577834] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T21:17:55.025552] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-06T21:17:55.629314] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T21:17:55.825565] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-06T21:17:56.263807] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T21:17:56.625548] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-06T21:17:57.425533] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-06T21:17:57.588387] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T21:17:57.639341] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T21:17:58.225584] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-06T21:17:58.750026] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T21:17:59.003598] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T21:17:59.005068] [INFO ] [REMOTE ] RPT: Full fetch complete (28501 records). [2025-10-06T21:17:59.005143] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-06T21:17:59.034044] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-06T21:17:59.367157] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-06T21:17:59.367254] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-06T21:17:59.367948] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-06T21:17:59.368011] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-06T21:17:59.368782] [DEBUG] [LOCAL ] RPT: Trimmed 28501 records to 18988 (keeping 200 days of data) [2025-10-06T21:17:59.480577] [DEBUG] [LOCAL ] RPT: Primary data saved (18988 records). [2025-10-06T21:17:59.480805] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-06T21:17:59.480906] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. RPT took 24.1s. Estimated remaining: 1h 16m 15s. Rate: 7.1 symbols/min [2025-10-06T21:17:59.678532] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:17:59.725070] [DEBUG] [LOCAL ] RRX: Loaded 41590 existing records from primary storage. [2025-10-06T21:17:59.725455] [INFO ] [MAIN ] RRX: Loaded 41590 existing records. [2025-10-06T21:17:59.835077] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-06T21:17:59.934722] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:17:59.935007] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-06T21:17:59.935073] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-06T21:17:59.935377] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-10-06T21:17:59.935456] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-06T21:18:00.294455] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:18:00.625512] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-06T21:18:00.662823] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T21:18:01.425535] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-06T21:18:01.459923] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T21:18:02.225557] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-06T21:18:02.601747] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-06T21:18:02.949712] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T21:18:03.025518] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-06T21:18:03.580410] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T21:18:03.825605] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-06T21:18:04.456101] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-06T21:18:04.625530] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-06T21:18:04.857096] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T21:18:04.860757] [INFO ] [REMOTE ] RPM: Full fetch complete (59483 records). [2025-10-06T21:18:04.860874] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-06T21:18:05.284135] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-10-06T21:18:05.284232] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-10-06T21:18:05.285508] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-10-06T21:18:05.285577] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-10-06T21:18:05.287225] [DEBUG] [LOCAL ] RPM: Trimmed 59483 records to 41589 (keeping 200 days of data) [2025-10-06T21:18:05.475235] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-06T21:18:05.569679] [DEBUG] [LOCAL ] RPM: Primary data saved (41589 records). [2025-10-06T21:18:05.569857] [INFO ] [MAIN ] RPM: Full history saved. [2025-10-06T21:18:05.569963] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RPM took 44.0s. Estimated remaining: 1h 16m 6s. Rate: 7.1 symbols/min [2025-10-06T21:18:05.749063] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:18:05.749298] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-06T21:18:05.749346] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-06T21:18:05.749475] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-06T21:18:05.749543] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-06T21:18:05.749590] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-06T21:18:05.749623] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-06T21:18:06.156384] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:18:06.193444] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T21:18:06.225592] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-06T21:18:06.573904] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T21:18:06.575882] [INFO ] [REMOTE ] RQI: Full fetch complete (43202 records). [2025-10-06T21:18:06.575979] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-06T21:18:06.973219] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-10-06T21:18:06.973343] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-10-06T21:18:06.974500] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-10-06T21:18:06.974565] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-10-06T21:18:06.975747] [DEBUG] [LOCAL ] RQI: Trimmed 43202 records to 29074 (keeping 200 days of data) [2025-10-06T21:18:07.029683] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-06T21:18:07.166996] [DEBUG] [LOCAL ] RQI: Primary data saved (29074 records). [2025-10-06T21:18:07.167178] [INFO ] [MAIN ] RQI: Full history saved. [2025-10-06T21:18:07.167270] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. RQI took 31.2s. Estimated remaining: 1h 15m 55s. Rate: 7.1 symbols/min [2025-10-06T21:18:07.339208] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:18:07.347108] [DEBUG] [LOCAL ] RSF: Loaded 4294 existing records from primary storage. [2025-10-06T21:18:07.347408] [INFO ] [MAIN ] RSF: Loaded 4294 existing records. [2025-10-06T21:18:07.550074] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:18:07.550337] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-06T21:18:07.550388] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-06T21:18:07.550669] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-06T21:18:07.550731] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-06T21:18:07.832822] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-06T21:18:07.997539] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:18:08.001173] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T21:18:08.625574] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-06T21:18:08.966613] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-06T21:18:09.425616] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-06T21:18:09.451940] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-06T21:18:09.473210] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T21:18:10.225558] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-06T21:18:11.025589] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-06T21:18:11.310263] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T21:18:11.759740] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T21:18:11.783569] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T21:18:11.825700] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-06T21:18:12.625543] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-06T21:18:13.425561] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-06T21:18:13.448230] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T21:18:14.225589] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-06T21:18:14.487471] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T21:18:14.840755] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T21:18:15.025507] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-06T21:18:15.229991] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T21:18:15.823135] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-06T21:18:15.825474] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-06T21:18:16.452860] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-06T21:18:16.625560] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-06T21:18:17.425595] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-06T21:18:18.225557] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-06T21:18:18.435325] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T21:18:18.903783] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-06T21:18:19.025535] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-06T21:18:19.177070] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T21:18:19.825607] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-06T21:18:20.450216] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-06T21:18:20.625561] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-06T21:18:20.924541] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-06T21:18:21.425599] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-06T21:18:22.090764] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-06T21:18:22.225540] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-06T21:18:23.025552] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-06T21:18:23.354205] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-06T21:18:23.809275] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T21:18:23.825504] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-06T21:18:24.625631] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-06T21:18:24.750084] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T21:18:25.384106] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T21:18:25.395897] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T21:18:25.425552] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-06T21:18:26.225589] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-06T21:18:26.667325] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T21:18:26.879131] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-06T21:18:27.025599] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-06T21:18:27.825563] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-06T21:18:28.625564] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-06T21:18:28.711252] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T21:18:29.245167] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-06T21:18:29.425556] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-06T21:18:29.783771] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T21:18:29.943732] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T21:18:29.944637] [INFO ] [REMOTE ] RSF: Full fetch complete (5671 records). [2025-10-06T21:18:29.944753] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-06T21:18:30.228816] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-06T21:18:30.317141] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-06T21:18:30.317235] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-06T21:18:30.317424] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-06T21:18:30.317463] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-06T21:18:30.317863] [DEBUG] [LOCAL ] RSF: Trimmed 5671 records to 4284 (keeping 200 days of data) [2025-10-06T21:18:30.344313] [DEBUG] [LOCAL ] RSF: Primary data saved (4284 records). [2025-10-06T21:18:30.344401] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-06T21:18:30.344480] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RSF took 23.2s. Estimated remaining: 1h 15m 51s. Rate: 7.1 symbols/min [2025-10-06T21:18:30.513549] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:18:30.561413] [DEBUG] [LOCAL ] RSG: Loaded 48147 existing records from primary storage. [2025-10-06T21:18:30.561819] [INFO ] [MAIN ] RSG: Loaded 48147 existing records. [2025-10-06T21:18:30.739030] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:18:30.739275] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-06T21:18:30.739324] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-06T21:18:30.739626] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-10-06T21:18:30.739743] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-06T21:18:31.030786] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-06T21:18:31.125336] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:18:31.598075] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T21:18:31.825609] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-06T21:18:32.625567] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-06T21:18:33.062436] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-06T21:18:33.376504] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T21:18:33.425496] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-06T21:18:33.974239] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T21:18:34.225615] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-06T21:18:34.803134] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T21:18:35.025545] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-06T21:18:35.735900] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T21:18:35.739962] [INFO ] [REMOTE ] RRC: Full fetch complete (76411 records). [2025-10-06T21:18:35.740292] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-06T21:18:35.830806] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-06T21:18:36.160473] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-10-06T21:18:36.160731] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-10-06T21:18:36.162381] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-10-06T21:18:36.162453] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-10-06T21:18:36.164484] [DEBUG] [LOCAL ] RRC: Trimmed 76411 records to 52852 (keeping 200 days of data) [2025-10-06T21:18:36.288090] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T21:18:36.551179] [DEBUG] [LOCAL ] RRC: Primary data saved (52852 records). [2025-10-06T21:18:36.551390] [INFO ] [MAIN ] RRC: Full history saved. [2025-10-06T21:18:36.551500] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RRC took 44.2s. Estimated remaining: 1h 15m 42s. Rate: 7.1 symbols/min [2025-10-06T21:18:36.631712] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-06T21:18:36.740982] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:18:36.791605] [DEBUG] [LOCAL ] RSI: Loaded 47575 existing records from primary storage. [2025-10-06T21:18:36.792119] [INFO ] [MAIN ] RSI: Loaded 47575 existing records. [2025-10-06T21:18:36.981433] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:18:36.981783] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-06T21:18:36.981864] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-06T21:18:36.982248] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-10-06T21:18:36.982350] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-06T21:18:37.392032] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:18:37.425488] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-06T21:18:37.553179] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T21:18:38.144235] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T21:18:38.225542] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-06T21:18:39.031516] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-06T21:18:39.053292] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T21:18:39.096404] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-06T21:18:39.825554] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-06T21:18:40.167192] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T21:18:40.169334] [INFO ] [REMOTE ] RS: Full fetch complete (39298 records). [2025-10-06T21:18:40.169454] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-06T21:18:40.562716] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-10-06T21:18:40.562849] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-10-06T21:18:40.564246] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-10-06T21:18:40.564335] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-10-06T21:18:40.565574] [DEBUG] [LOCAL ] RS: Trimmed 39298 records to 25118 (keeping 200 days of data) [2025-10-06T21:18:40.634443] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-06T21:18:40.738864] [DEBUG] [LOCAL ] RS: Primary data saved (25118 records). [2025-10-06T21:18:40.739056] [INFO ] [MAIN ] RS: Full history saved. [2025-10-06T21:18:40.739147] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RS took 35.2s. Estimated remaining: 1h 15m 32s. Rate: 7.1 symbols/min [2025-10-06T21:18:40.912360] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:18:40.948719] [DEBUG] [LOCAL ] RSKD: Loaded 33954 existing records from primary storage. [2025-10-06T21:18:40.949093] [INFO ] [MAIN ] RSKD: Loaded 33954 existing records. [2025-10-06T21:18:41.135620] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:18:41.135939] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-06T21:18:41.135995] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-06T21:18:41.136351] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-06T21:18:41.136412] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-06T21:18:41.427550] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-06T21:18:41.529272] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:18:41.563147] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T21:18:41.634310] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-06T21:18:42.225595] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-06T21:18:43.025579] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-06T21:18:43.136907] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-06T21:18:43.417018] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-06T21:18:43.825555] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-06T21:18:44.216921] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-06T21:18:44.625544] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-06T21:18:45.425537] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-06T21:18:45.611030] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T21:18:45.954532] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T21:18:45.957318] [INFO ] [REMOTE ] RRX: Full fetch complete (58330 records). [2025-10-06T21:18:45.957471] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-06T21:18:46.230751] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-06T21:18:46.368699] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-10-06T21:18:46.368831] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-10-06T21:18:46.370442] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-10-06T21:18:46.370513] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-10-06T21:18:46.372080] [DEBUG] [LOCAL ] RRX: Trimmed 58330 records to 41022 (keeping 200 days of data) [2025-10-06T21:18:46.649920] [DEBUG] [LOCAL ] RRX: Primary data saved (41022 records). [2025-10-06T21:18:46.650092] [INFO ] [MAIN ] RRX: Full history saved. [2025-10-06T21:18:46.650206] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RRX took 47.2s. Estimated remaining: 1h 15m 23s. Rate: 7.1 symbols/min [2025-10-06T21:18:46.855393] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:18:46.857670] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T21:18:46.912513] [DEBUG] [LOCAL ] RTO: Loaded 40642 existing records from primary storage. [2025-10-06T21:18:46.912934] [INFO ] [MAIN ] RTO: Loaded 40642 existing records. [2025-10-06T21:18:47.030705] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-06T21:18:47.105056] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:18:47.105382] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-06T21:18:47.105449] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-06T21:18:47.105873] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-10-06T21:18:47.105942] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-06T21:18:47.475631] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:18:47.825533] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-06T21:18:48.145747] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T21:18:48.623008] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T21:18:48.628909] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-06T21:18:48.988634] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T21:18:49.425556] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-06T21:18:50.225563] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-06T21:18:50.322064] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T21:18:50.387107] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-06T21:18:51.025554] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-06T21:18:51.825494] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-06T21:18:51.905054] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T21:18:52.288703] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T21:18:52.625512] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-06T21:18:52.808111] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T21:18:53.425533] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-06T21:18:54.225515] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-06T21:18:54.397310] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T21:18:54.497066] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-06T21:18:55.025525] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-06T21:18:55.828365] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-06T21:18:55.840421] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T21:18:56.541134] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T21:18:56.625597] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-06T21:18:57.425525] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-06T21:18:57.461957] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T21:18:58.228798] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-06T21:18:58.234208] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T21:18:58.866350] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T21:18:59.025524] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-06T21:18:59.825501] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-06T21:18:59.943501] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-06T21:19:00.035536] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T21:19:00.625547] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-06T21:19:01.425553] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-06T21:19:01.640060] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T21:19:02.024566] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T21:19:02.225559] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-06T21:19:03.027264] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-06T21:19:03.032550] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T21:19:03.328200] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T21:19:03.825552] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-06T21:19:04.625534] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-06T21:19:04.844523] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T21:19:05.026829] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T21:19:05.425551] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-06T21:19:06.225559] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-06T21:19:06.489309] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T21:19:07.025536] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-06T21:19:07.825519] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-06T21:19:07.866697] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T21:19:07.869025] [INFO ] [REMOTE ] RSG: Full fetch complete (67721 records). [2025-10-06T21:19:07.869175] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-06T21:19:07.870311] [FATAL] [VALIDATOR ] RSG: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:19:07.870401] [FATAL] [MAIN ] RSG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:19:07.870467] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:19:07.870537] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-06T21:19:07.870610] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-06T21:19:07.870685] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-10-06T21:19:07.870935] [DEBUG] [LOCAL ] RSG: Deleted derivative data file. [2025-10-06T21:19:07.871595] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RSG took 37.5s. Estimated remaining: 1h 15m 18s. Rate: 7.1 symbols/min [2025-10-06T21:19:08.296513] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (2.87 seconds). [2025-10-06T21:19:08.625535] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-06T21:19:09.034561] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-06T21:19:09.425517] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-06T21:19:09.492906] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T21:19:10.225546] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-06T21:19:10.272527] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T21:19:10.930766] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T21:19:11.025489] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-06T21:19:11.483271] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T21:19:11.486681] [INFO ] [REMOTE ] RSI: Full fetch complete (69486 records). [2025-10-06T21:19:11.486803] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-06T21:19:11.832737] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-06T21:19:11.896953] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-10-06T21:19:11.897078] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-10-06T21:19:11.898450] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-10-06T21:19:11.898533] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-10-06T21:19:11.903918] [DEBUG] [LOCAL ] RSI: Trimmed 69486 records to 46819 (keeping 200 days of data) [2025-10-06T21:19:12.193832] [DEBUG] [LOCAL ] RSI: Primary data saved (46819 records). [2025-10-06T21:19:12.193996] [INFO ] [MAIN ] RSI: Full history saved. [2025-10-06T21:19:12.194089] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RSI took 35.6s. Estimated remaining: 1h 15m 9s. Rate: 7.1 symbols/min [2025-10-06T21:19:12.744108] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T21:19:12.754337] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-06T21:19:13.040553] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T21:19:13.043019] [INFO ] [REMOTE ] RSKD: Full fetch complete (48238 records). [2025-10-06T21:19:13.043127] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-06T21:19:13.465531] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-06T21:19:13.465678] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-06T21:19:13.467075] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-06T21:19:13.467147] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-06T21:19:13.468885] [DEBUG] [LOCAL ] RSKD: Trimmed 48238 records to 33490 (keeping 200 days of data) [2025-10-06T21:19:13.677971] [DEBUG] [LOCAL ] RSKD: Primary data saved (33490 records). [2025-10-06T21:19:13.678145] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-06T21:19:13.678246] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RSKD took 32.9s. Estimated remaining: 1h 14m 58s. Rate: 7.1 symbols/min [2025-10-06T21:19:14.531247] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T21:19:14.540753] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-06T21:19:15.928561] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-06T21:19:15.931551] [INFO ] [REMOTE ] RTO: Full fetch complete (58585 records). [2025-10-06T21:19:15.931696] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-06T21:19:16.326542] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-10-06T21:19:16.326671] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-10-06T21:19:16.328060] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-10-06T21:19:16.328128] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-10-06T21:19:16.329731] [DEBUG] [LOCAL ] RTO: Trimmed 58585 records to 40048 (keeping 200 days of data) [2025-10-06T21:19:16.586206] [DEBUG] [LOCAL ] RTO: Primary data saved (40048 records). [2025-10-06T21:19:16.586358] [INFO ] [MAIN ] RTO: Full history saved. [2025-10-06T21:19:16.586449] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RTO took 29.9s. Estimated remaining: 1h 14m 48s. Rate: 7.1 symbols/min [2025-10-06T21:19:17.273134] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:19:17.278087] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:19:17.345988] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:19:17.374922] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:19:17.420890] [DEBUG] [LOCAL ] RVT: Loaded 26927 existing records from primary storage. [2025-10-06T21:19:17.421510] [INFO ] [MAIN ] RVT: Loaded 26927 existing records. [2025-10-06T21:19:17.590821] [DEBUG] [LOCAL ] RVTY: Loaded 48261 existing records from primary storage. [2025-10-06T21:19:17.675534] [DEBUG] [LOCAL ] RTX: Loaded 54484 existing records from primary storage. [2025-10-06T21:19:17.681597] [INFO ] [MAIN ] RVTY: Loaded 48261 existing records. [2025-10-06T21:19:17.686680] [INFO ] [MAIN ] RTX: Loaded 54484 existing records. [2025-10-06T21:19:17.674283] [DEBUG] [LOCAL ] RVLV: Loaded 48281 existing records from primary storage. [2025-10-06T21:19:17.802887] [INFO ] [MAIN ] RVLV: Loaded 48281 existing records. [2025-10-06T21:19:17.791241] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:19:17.946234] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-06T21:19:18.004026] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-06T21:19:18.168175] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-10-06T21:19:18.206804] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-06T21:19:18.222783] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:19:18.308115] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-06T21:19:18.307629] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:19:18.318361] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-06T21:19:18.369884] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-06T21:19:18.379842] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:19:18.385159] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-06T21:19:18.397137] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-10-06T21:19:18.397386] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-06T21:19:18.429415] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-06T21:19:18.445020] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-06T21:19:18.445134] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-10-06T21:19:18.466287] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-06T21:19:18.503493] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-10-06T21:19:18.569183] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-06T21:19:19.681808] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:19:19.817947] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:19:19.811889] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-06T21:19:19.830389] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-06T21:19:19.891885] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:19:19.932454] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-06T21:19:19.957864] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:19:19.958527] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-06T21:19:21.329883] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T21:19:21.336793] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-06T21:19:21.447252] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T21:19:21.455774] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-06T21:19:21.722791] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T21:19:21.732994] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-06T21:19:21.816361] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T21:19:21.828582] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-06T21:19:22.467341] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T21:19:22.474406] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-06T21:19:22.508294] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T21:19:22.517495] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-06T21:19:22.740530] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T21:19:22.752122] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-06T21:19:23.017961] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T21:19:23.028821] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-06T21:19:23.102120] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T21:19:23.704020] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T21:19:23.762477] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T21:19:23.825527] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-06T21:19:24.403694] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T21:19:24.625535] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-06T21:19:25.215131] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T21:19:25.425497] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-06T21:19:25.805982] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T21:19:26.225514] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-06T21:19:27.013319] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T21:19:27.025479] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-06T21:19:27.825498] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-06T21:19:28.109781] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T21:19:28.155988] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-06T21:19:28.625554] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-06T21:19:28.756821] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T21:19:29.425596] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-06T21:19:30.225505] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-06T21:19:30.279116] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-06T21:19:30.320317] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T21:19:31.025525] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-06T21:19:31.651052] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T21:19:31.830881] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-06T21:19:31.859033] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T21:19:32.625549] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-06T21:19:32.952464] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T21:19:33.425557] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-06T21:19:34.225500] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-06T21:19:34.494637] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T21:19:34.558912] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-06T21:19:35.025519] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-06T21:19:35.834262] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-06T21:19:35.838915] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T21:19:36.625513] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-06T21:19:36.790989] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-06T21:19:36.836430] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T21:19:37.425587] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-06T21:19:37.849728] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T21:19:38.225579] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-06T21:19:38.576419] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T21:19:39.025572] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-06T21:19:39.203553] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T21:19:39.825540] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-06T21:19:40.632992] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-06T21:19:40.640096] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-06T21:19:40.725637] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T21:19:41.425532] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-06T21:19:41.639621] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-06T21:19:42.225522] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-06T21:19:42.345631] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T21:19:43.025565] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-06T21:19:43.196469] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T21:19:43.825531] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-06T21:19:43.987090] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T21:19:44.625539] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-06T21:19:45.004128] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T21:19:45.006175] [INFO ] [REMOTE ] RVT: Full fetch complete (39451 records). [2025-10-06T21:19:45.006264] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-06T21:19:45.410062] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T21:19:45.415896] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-06T21:19:45.416025] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-06T21:19:45.417300] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-06T21:19:45.417414] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-06T21:19:45.417563] [INFO ] [REMOTE ] RVTY: Full fetch complete (66534 records). [2025-10-06T21:19:45.418002] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-06T21:19:45.419478] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:19:45.419728] [FATAL] [MAIN ] RVTY: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:19:45.420456] [DEBUG] [LOCAL ] RVT: Trimmed 39451 records to 26395 (keeping 200 days of data) [2025-10-06T21:19:45.420211] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:19:45.420630] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-06T21:19:45.420850] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-06T21:19:45.421323] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-06T21:19:45.421780] [DEBUG] [LOCAL ] RVTY: Deleted derivative data file. [2025-10-06T21:19:45.421932] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVTY took 28.8s. Estimated remaining: 1h 14m 46s. Rate: 7.1 symbols/min [2025-10-06T21:19:45.427373] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-06T21:19:45.738709] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:19:45.817976] [DEBUG] [LOCAL ] RVT: Primary data saved (26395 records). [2025-10-06T21:19:45.818162] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-06T21:19:45.818268] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RVT took 29.2s. Estimated remaining: 1h 14m 35s. Rate: 7.1 symbols/min [2025-10-06T21:19:45.945894] [DEBUG] [LOCAL ] RWT: Loaded 41431 existing records from primary storage. [2025-10-06T21:19:45.967362] [INFO ] [MAIN ] RWT: Loaded 41431 existing records. [2025-10-06T21:19:46.141516] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:19:46.141766] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-06T21:19:46.142283] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-06T21:19:46.163463] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-06T21:19:46.182102] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-06T21:19:46.187442] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-06T21:19:46.187544] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-06T21:19:46.237137] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-06T21:19:46.322694] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:19:46.339516] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-06T21:19:46.362581] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-06T21:19:46.391243] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-06T21:19:46.401895] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-06T21:19:46.991152] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:19:47.033638] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-06T21:19:47.079207] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:19:47.424570] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T21:19:47.471534] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-06T21:19:47.725200] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-06T21:19:47.825533] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-06T21:19:48.575446] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T21:19:48.625542] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-06T21:19:49.197009] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-06T21:19:49.425526] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-06T21:19:50.036791] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T21:19:50.040033] [INFO ] [REMOTE ] RTX: Full fetch complete (77340 records). [2025-10-06T21:19:50.040228] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-06T21:19:50.041046] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-06). Symbol may be delisted or halted. [2025-10-06T21:19:50.041212] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:19:50.041289] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:19:50.041364] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-06T21:19:50.041437] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-06T21:19:50.041480] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-10-06T21:19:50.042075] [DEBUG] [LOCAL ] RTX: Deleted derivative data file. [2025-10-06T21:19:50.042235] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RTX took 33.4s. Estimated remaining: 1h 14m 25s. Rate: 7.1 symbols/min [2025-10-06T21:19:50.219133] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:19:50.219389] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-06T21:19:50.219443] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-06T21:19:50.219561] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-06T21:19:50.219623] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-06T21:19:50.219715] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-06T21:19:50.219757] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-06T21:19:50.230730] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-06T21:19:50.597494] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:19:50.867928] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-06T21:19:51.025502] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-06T21:19:51.612279] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T21:19:51.825543] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-06T21:19:52.625578] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-06T21:19:53.414686] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T21:19:53.425468] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-06T21:19:53.542182] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T21:19:53.797055] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-06T21:19:54.225532] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-06T21:19:55.025588] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-06T21:19:55.632269] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T21:19:55.825691] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-06T21:19:55.943460] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T21:19:56.380921] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-06T21:19:56.625545] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-06T21:19:57.425552] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-06T21:19:58.001875] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T21:19:58.006129] [INFO ] [REMOTE ] RVLV: Full fetch complete (68757 records). [2025-10-06T21:19:58.006328] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-06T21:19:58.230751] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-06T21:19:58.425499] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-10-06T21:19:58.425594] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-10-06T21:19:58.427425] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-10-06T21:19:58.427496] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-10-06T21:19:58.429629] [DEBUG] [LOCAL ] RVLV: Trimmed 68757 records to 47506 (keeping 200 days of data) [2025-10-06T21:19:58.731750] [DEBUG] [LOCAL ] RVLV: Primary data saved (47506 records). [2025-10-06T21:19:58.731922] [INFO ] [MAIN ] RVLV: Full history saved. [2025-10-06T21:19:58.732025] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RVLV took 42.1s. Estimated remaining: 1h 14m 17s. Rate: 7.1 symbols/min [2025-10-06T21:19:58.911986] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:19:58.912390] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-06T21:19:58.912724] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-06T21:19:58.912907] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-06T21:19:58.912957] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-06T21:19:58.913003] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-06T21:19:58.913043] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-06T21:19:58.988429] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T21:19:59.030588] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-06T21:19:59.376616] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:19:59.379787] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-06T21:19:59.595255] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T21:19:59.825535] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-06T21:20:00.164141] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:20:00.164531] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-06T21:20:00.164627] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:20:00.164711] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-06T21:20:00.164776] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:20:00.164846] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-06T21:20:00.164915] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-06T21:20:00.164953] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-06T21:20:00.164993] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-06T21:20:00.165042] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RWTP took 1.4s. Estimated remaining: 1h 14m 6s. Rate: 7.1 symbols/min [2025-10-06T21:20:00.355314] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:20:00.409927] [DEBUG] [LOCAL ] RXO: Loaded 48570 existing records from primary storage. [2025-10-06T21:20:00.410352] [INFO ] [MAIN ] RXO: Loaded 48570 existing records. [2025-10-06T21:20:00.606222] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:20:00.606529] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-06T21:20:00.606604] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-06T21:20:00.606967] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-10-06T21:20:00.607041] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-06T21:20:00.630635] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-06T21:20:00.984272] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:20:01.425584] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-06T21:20:01.946465] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-06T21:20:02.225533] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-06T21:20:02.312856] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T21:20:02.696439] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-06T21:20:03.025540] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-06T21:20:03.575532] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-06T21:20:03.825537] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-06T21:20:04.625614] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-06T21:20:05.187886] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-06T21:20:05.425546] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-06T21:20:05.685415] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T21:20:06.213154] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-06T21:20:06.225476] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-06T21:20:07.025609] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-06T21:20:07.030042] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-06T21:20:07.825537] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-06T21:20:08.536592] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-06T21:20:08.631174] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-06T21:20:08.636986] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T21:20:09.282552] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-06T21:20:09.425544] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-06T21:20:09.890602] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T21:20:09.891433] [INFO ] [REMOTE ] RWTN: Full fetch complete (3151 records). [2025-10-06T21:20:09.891504] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-06T21:20:10.081929] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-06T21:20:10.082196] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:20:10.082271] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:20:10.082347] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-06T21:20:10.082417] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-06T21:20:10.082455] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-06T21:20:10.082496] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-06T21:20:10.082560] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RWTN took 24.3s. Estimated remaining: 1h 13m 58s. Rate: 7.1 symbols/min [2025-10-06T21:20:10.230592] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-06T21:20:10.258013] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:20:10.310745] [DEBUG] [LOCAL ] RY: Loaded 48550 existing records from primary storage. [2025-10-06T21:20:10.311215] [INFO ] [MAIN ] RY: Loaded 48550 existing records. [2025-10-06T21:20:10.517328] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:20:10.518061] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-06T21:20:10.518125] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-06T21:20:10.518617] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-06T21:20:10.518753] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-06T21:20:10.898269] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:20:11.025545] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-06T21:20:11.825525] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-06T21:20:12.149939] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T21:20:12.490378] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-06T21:20:12.625501] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-06T21:20:12.749986] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T21:20:13.169602] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T21:20:13.170483] [INFO ] [REMOTE ] RWTO: Full fetch complete (4845 records). [2025-10-06T21:20:13.170551] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-06T21:20:13.348442] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T21:20:13.348725] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:20:13.348813] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:20:13.348907] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-06T21:20:13.348998] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-06T21:20:13.349037] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-06T21:20:13.349079] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-06T21:20:13.349195] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RWTO took 23.3s. Estimated remaining: 1h 13m 48s. Rate: 7.1 symbols/min [2025-10-06T21:20:13.430696] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-06T21:20:13.524389] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:20:13.562021] [DEBUG] [LOCAL ] RYAM: Loaded 35553 existing records from primary storage. [2025-10-06T21:20:13.562348] [INFO ] [MAIN ] RYAM: Loaded 35553 existing records. [2025-10-06T21:20:13.743063] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:20:13.743466] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-06T21:20:13.743523] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-06T21:20:13.743833] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-06T21:20:13.743891] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-06T21:20:14.093213] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:20:14.225536] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-06T21:20:15.025577] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-06T21:20:15.109532] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T21:20:15.825506] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-06T21:20:16.000473] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T21:20:16.421501] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T21:20:16.625555] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-06T21:20:17.312730] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T21:20:17.425538] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-06T21:20:18.225523] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-06T21:20:18.356854] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T21:20:19.025548] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-06T21:20:19.057439] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T21:20:19.792981] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-06T21:20:19.825470] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-06T21:20:20.295903] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-06T21:20:20.625533] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-06T21:20:21.398355] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T21:20:21.425487] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-06T21:20:21.804336] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T21:20:22.225545] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-06T21:20:23.025497] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-06T21:20:23.128705] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T21:20:23.825562] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-06T21:20:24.146999] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-06T21:20:24.193465] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T21:20:24.625557] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-06T21:20:25.425505] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-06T21:20:25.591744] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T21:20:26.189196] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T21:20:26.225513] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-06T21:20:27.007436] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T21:20:27.025484] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-06T21:20:27.479916] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-06T21:20:27.825558] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-06T21:20:28.625545] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-06T21:20:28.700251] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T21:20:28.988671] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T21:20:29.425545] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-06T21:20:30.230799] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-06T21:20:30.250907] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T21:20:30.745992] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T21:20:31.025512] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-06T21:20:31.510558] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T21:20:31.825527] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-06T21:20:32.217632] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T21:20:32.625516] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-06T21:20:33.425484] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-06T21:20:33.618503] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T21:20:33.966876] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T21:20:33.969737] [INFO ] [REMOTE ] RWT: Full fetch complete (58693 records). [2025-10-06T21:20:33.969863] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-06T21:20:34.230759] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-06T21:20:34.420755] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-06T21:20:34.420899] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-06T21:20:34.422439] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-06T21:20:34.422509] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-06T21:20:34.424346] [DEBUG] [LOCAL ] RWT: Trimmed 58693 records to 40852 (keeping 200 days of data) [2025-10-06T21:20:34.683301] [DEBUG] [LOCAL ] RWT: Primary data saved (40852 records). [2025-10-06T21:20:34.683540] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-06T21:20:34.683673] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RWT took 49.3s. Estimated remaining: 1h 13m 44s. Rate: 7.1 symbols/min [2025-10-06T21:20:34.875371] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:20:34.940369] [DEBUG] [LOCAL ] RYAN: Loaded 45175 existing records from primary storage. [2025-10-06T21:20:34.951275] [INFO ] [MAIN ] RYAN: Loaded 45175 existing records. [2025-10-06T21:20:34.952412] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T21:20:35.031231] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-06T21:20:35.156729] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:20:35.157009] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-06T21:20:35.157058] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-06T21:20:35.157364] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-06T21:20:35.157421] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-06T21:20:35.529019] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:20:35.825551] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-06T21:20:36.132844] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T21:20:36.631160] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-06T21:20:36.639487] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T21:20:37.242826] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T21:20:37.425563] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-06T21:20:38.225538] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-06T21:20:38.431668] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T21:20:38.643060] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T21:20:38.645567] [INFO ] [REMOTE ] RYAM: Full fetch complete (49109 records). [2025-10-06T21:20:38.645726] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-06T21:20:39.030757] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-06T21:20:39.087214] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-06T21:20:39.087342] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-06T21:20:39.088486] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-06T21:20:39.088553] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-06T21:20:39.089888] [DEBUG] [LOCAL ] RYAM: Trimmed 49109 records to 35095 (keeping 200 days of data) [2025-10-06T21:20:39.288129] [DEBUG] [LOCAL ] RYAM: Primary data saved (35095 records). [2025-10-06T21:20:39.288317] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-06T21:20:39.288463] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RYAM took 25.9s. Estimated remaining: 1h 13m 34s. Rate: 7.1 symbols/min [2025-10-06T21:20:39.453800] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:20:39.476165] [DEBUG] [LOCAL ] RYI: Loaded 21847 existing records from primary storage. [2025-10-06T21:20:39.476452] [INFO ] [MAIN ] RYI: Loaded 21847 existing records. [2025-10-06T21:20:39.654433] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:20:39.654862] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-06T21:20:39.654997] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-06T21:20:39.655297] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-06T21:20:39.655371] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-06T21:20:39.827942] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-06T21:20:39.940419] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T21:20:40.061016] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:20:40.625560] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-06T21:20:40.985524] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-06T21:20:41.425500] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-06T21:20:41.836346] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-06T21:20:42.225553] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-06T21:20:42.334938] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T21:20:43.025513] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-06T21:20:43.075695] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T21:20:43.382947] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T21:20:43.825583] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-06T21:20:44.221737] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T21:20:44.625584] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-06T21:20:45.431574] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-06T21:20:45.453683] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T21:20:46.225599] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-06T21:20:46.276847] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T21:20:46.479373] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T21:20:47.025538] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-06T21:20:47.694424] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T21:20:47.697441] [INFO ] [REMOTE ] RY: Full fetch complete (68921 records). [2025-10-06T21:20:47.697629] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-06T21:20:47.826863] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-06T21:20:48.156757] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-06T21:20:48.156956] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-06T21:20:48.158311] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-06T21:20:48.158410] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-06T21:20:48.176548] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T21:20:48.182916] [DEBUG] [LOCAL ] RY: Trimmed 68921 records to 47823 (keeping 200 days of data) [2025-10-06T21:20:48.516933] [DEBUG] [LOCAL ] RY: Primary data saved (47823 records). [2025-10-06T21:20:48.517112] [INFO ] [MAIN ] RY: Full history saved. [2025-10-06T21:20:48.517218] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RY took 38.4s. Estimated remaining: 1h 13m 26s. Rate: 7.1 symbols/min [2025-10-06T21:20:48.630806] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-06T21:20:48.704199] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:20:48.754338] [DEBUG] [LOCAL ] RYN: Loaded 46225 existing records from primary storage. [2025-10-06T21:20:48.754781] [INFO ] [MAIN ] RYN: Loaded 46225 existing records. [2025-10-06T21:20:48.946422] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:20:48.946817] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-06T21:20:48.946874] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-06T21:20:48.947179] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-06T21:20:48.947242] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-06T21:20:49.337474] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:20:49.425689] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-06T21:20:49.563748] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-06T21:20:49.606924] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-06T21:20:50.225544] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-06T21:20:50.901559] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T21:20:51.025531] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-06T21:20:51.825720] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-06T21:20:51.825551] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T21:20:52.583179] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T21:20:52.625573] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-06T21:20:53.135207] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T21:20:53.138954] [INFO ] [REMOTE ] RXO: Full fetch complete (68421 records). [2025-10-06T21:20:53.139105] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-06T21:20:53.431245] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-06T21:20:53.563688] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-06T21:20:53.563795] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-06T21:20:53.564920] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-06T21:20:53.564984] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-06T21:20:53.566698] [DEBUG] [LOCAL ] RXO: Trimmed 68421 records to 47976 (keeping 200 days of data) [2025-10-06T21:20:53.861553] [DEBUG] [LOCAL ] RXO: Primary data saved (47976 records). [2025-10-06T21:20:53.861705] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-06T21:20:53.861808] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RXO took 53.7s. Estimated remaining: 1h 13m 16s. Rate: 7.1 symbols/min [2025-10-06T21:20:54.032120] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:20:54.041664] [DEBUG] [LOCAL ] RZB: Loaded 6252 existing records from primary storage. [2025-10-06T21:20:54.041931] [INFO ] [MAIN ] RZB: Loaded 6252 existing records. [2025-10-06T21:20:54.227370] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-06T21:20:54.227203] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:20:54.239237] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-06T21:20:54.254323] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-06T21:20:54.258504] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-06T21:20:54.258781] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-06T21:20:54.305770] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T21:20:54.636825] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T21:20:54.663587] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:20:55.025538] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-06T21:20:55.657592] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T21:20:55.825564] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-06T21:20:56.625563] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-06T21:20:56.709159] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T21:20:57.363787] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T21:20:57.416467] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T21:20:57.425488] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-06T21:20:58.225577] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-06T21:20:58.434615] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T21:20:59.025534] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-06T21:20:59.684621] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T21:20:59.688867] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-06T21:20:59.825483] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-06T21:21:00.625535] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-06T21:21:01.137382] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T21:21:01.214861] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-06T21:21:01.425541] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-06T21:21:02.225574] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-06T21:21:03.025556] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-06T21:21:03.110108] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T21:21:03.438820] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T21:21:03.441917] [INFO ] [REMOTE ] RYAN: Full fetch complete (64136 records). [2025-10-06T21:21:03.442065] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-06T21:21:03.625987] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T21:21:03.826254] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-06T21:21:03.845933] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-06T21:21:03.847059] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-06T21:21:03.848823] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-06T21:21:03.849046] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-06T21:21:03.850572] [DEBUG] [LOCAL ] RYAN: Trimmed 64136 records to 44584 (keeping 200 days of data) [2025-10-06T21:21:04.126475] [DEBUG] [LOCAL ] RYAN: Primary data saved (44584 records). [2025-10-06T21:21:04.126634] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-06T21:21:04.126761] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RYAN took 29.4s. Estimated remaining: 1h 13m 9s. Rate: 7.1 symbols/min [2025-10-06T21:21:04.301104] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:21:04.326781] [DEBUG] [LOCAL ] RZC: Loaded 6845 existing records from primary storage. [2025-10-06T21:21:04.327031] [INFO ] [MAIN ] RZC: Loaded 6845 existing records. [2025-10-06T21:21:04.501625] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:21:04.501900] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-06T21:21:04.501949] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-06T21:21:04.502129] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-06T21:21:04.502185] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-06T21:21:04.629501] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-06T21:21:04.886169] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:21:05.033550] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T21:21:05.425559] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-06T21:21:06.099400] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-06T21:21:06.225565] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-06T21:21:06.373101] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T21:21:06.923457] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-06T21:21:07.025533] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-06T21:21:07.825574] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-06T21:21:08.163060] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T21:21:08.397444] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-06T21:21:08.625541] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-06T21:21:09.300751] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-06T21:21:09.425521] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-06T21:21:10.225500] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-06T21:21:10.555038] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T21:21:11.025547] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-06T21:21:11.721977] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-06T21:21:11.825573] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-06T21:21:11.904609] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-06T21:21:11.907430] [INFO ] [REMOTE ] RYI: Full fetch complete (32370 records). [2025-10-06T21:21:11.907591] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-06T21:21:12.311515] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-06T21:21:12.311618] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-06T21:21:12.312869] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-06T21:21:12.312993] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-06T21:21:12.314194] [DEBUG] [LOCAL ] RYI: Trimmed 32370 records to 21616 (keeping 200 days of data) [2025-10-06T21:21:12.447554] [DEBUG] [LOCAL ] RYI: Primary data saved (21616 records). [2025-10-06T21:21:12.447732] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-06T21:21:12.447837] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RYI took 33.2s. Estimated remaining: 1h 13m 0s. Rate: 7.1 symbols/min [2025-10-06T21:21:12.622696] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:21:12.625565] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-06T21:21:12.685474] [DEBUG] [LOCAL ] S: Loaded 54312 existing records from primary storage. [2025-10-06T21:21:12.685930] [INFO ] [MAIN ] S: Loaded 54312 existing records. [2025-10-06T21:21:12.867334] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:21:12.867614] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-06T21:21:12.867885] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-06T21:21:12.868142] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-06T21:21:12.868199] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-06T21:21:13.228148] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:21:13.253282] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-06T21:21:13.425536] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-06T21:21:13.487363] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T21:21:13.994802] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-06T21:21:14.225611] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-06T21:21:15.025503] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-06T21:21:15.643346] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T21:21:15.825535] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-06T21:21:16.626701] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-06T21:21:16.640891] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-06T21:21:17.425591] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-06T21:21:17.636739] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T21:21:18.225571] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-06T21:21:19.025579] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-06T21:21:19.472691] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-06T21:21:19.602113] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-06T21:21:19.820554] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T21:21:19.830097] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-06T21:21:19.938592] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (4.11 seconds). [2025-10-06T21:21:20.625599] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-06T21:21:21.227507] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T21:21:21.425538] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-06T21:21:21.756446] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-06T21:21:22.016846] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T21:21:22.225621] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-06T21:21:22.823536] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T21:21:23.025698] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-06T21:21:23.825596] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-06T21:21:24.625533] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-06T21:21:24.879341] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T21:21:25.009030] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T21:21:25.009889] [INFO ] [REMOTE ] RZB: Full fetch complete (8620 records). [2025-10-06T21:21:25.009962] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-06T21:21:25.391379] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-06T21:21:25.391632] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-06T21:21:25.391946] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-06T21:21:25.392170] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-06T21:21:25.393006] [DEBUG] [LOCAL ] RZB: Trimmed 8620 records to 6105 (keeping 200 days of data) [2025-10-06T21:21:25.432894] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-06T21:21:25.449325] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T21:21:25.469802] [DEBUG] [LOCAL ] RZB: Primary data saved (6105 records). [2025-10-06T21:21:25.469928] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-06T21:21:25.470022] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RZB took 31.6s. Estimated remaining: 1h 12m 53s. Rate: 7.1 symbols/min [2025-10-06T21:21:25.636534] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:21:25.678967] [DEBUG] [LOCAL ] SA: Loaded 44164 existing records from primary storage. [2025-10-06T21:21:25.679310] [INFO ] [MAIN ] SA: Loaded 44164 existing records. [2025-10-06T21:21:25.851891] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:21:25.852116] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-06T21:21:25.852164] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-06T21:21:25.852389] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-06T21:21:25.852447] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-06T21:21:26.196701] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:21:26.225466] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-06T21:21:27.025599] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-06T21:21:27.326056] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T21:21:27.624028] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T21:21:27.825519] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-06T21:21:27.872924] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T21:21:28.625638] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-06T21:21:29.038851] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T21:21:29.041864] [INFO ] [REMOTE ] RYN: Full fetch complete (65049 records). [2025-10-06T21:21:29.041968] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-06T21:21:29.357476] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T21:21:29.433458] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-06T21:21:29.436977] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-06T21:21:29.438265] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-06T21:21:29.439476] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-06T21:21:29.439636] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-06T21:21:29.441037] [DEBUG] [LOCAL ] RYN: Trimmed 65049 records to 45522 (keeping 200 days of data) [2025-10-06T21:21:29.722402] [DEBUG] [LOCAL ] RYN: Primary data saved (45522 records). [2025-10-06T21:21:29.722559] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-06T21:21:29.722666] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RYN took 41.2s. Estimated remaining: 1h 12m 43s. Rate: 7.1 symbols/min [2025-10-06T21:21:29.898210] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:21:29.909610] [DEBUG] [LOCAL ] SABA: Loaded 9395 existing records from primary storage. [2025-10-06T21:21:29.909899] [INFO ] [MAIN ] SABA: Loaded 9395 existing records. [2025-10-06T21:21:30.085013] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:21:30.085311] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-06T21:21:30.085361] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-06T21:21:30.085611] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-06T21:21:30.085710] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-06T21:21:30.236178] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-06T21:21:30.457451] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:21:31.025565] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-06T21:21:31.085801] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T21:21:31.548025] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-06T21:21:31.825529] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-06T21:21:32.425287] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T21:21:32.490571] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T21:21:32.625481] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-06T21:21:33.425554] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-06T21:21:34.119850] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T21:21:34.225560] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-06T21:21:35.025562] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-06T21:21:35.553276] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-06T21:21:35.606138] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T21:21:35.810635] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-06T21:21:35.825464] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-06T21:21:36.625621] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-06T21:21:36.810735] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T21:21:37.008568] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T21:21:37.010210] [INFO ] [REMOTE ] RZC: Full fetch complete (9807 records). [2025-10-06T21:21:37.010327] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-06T21:21:37.387829] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-06T21:21:37.387929] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-06T21:21:37.388319] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-06T21:21:37.388419] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-06T21:21:37.389150] [DEBUG] [LOCAL ] RZC: Trimmed 9807 records to 6753 (keeping 200 days of data) [2025-10-06T21:21:37.425704] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-06T21:21:37.436480] [DEBUG] [LOCAL ] RZC: Primary data saved (6753 records). [2025-10-06T21:21:37.436596] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-06T21:21:37.436711] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. RZC took 33.3s. Estimated remaining: 1h 12m 35s. Rate: 7.1 symbols/min [2025-10-06T21:21:37.614978] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:21:37.652547] [DEBUG] [LOCAL ] SAFE: Loaded 30539 existing records from primary storage. [2025-10-06T21:21:37.652951] [INFO ] [MAIN ] SAFE: Loaded 30539 existing records. [2025-10-06T21:21:37.847604] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:21:37.847891] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-06T21:21:37.847988] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-06T21:21:37.848323] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-06T21:21:37.848408] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-06T21:21:38.220113] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:21:38.225476] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-06T21:21:38.256471] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T21:21:39.025541] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-06T21:21:39.535503] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T21:21:39.825565] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-06T21:21:40.567973] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T21:21:40.625564] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-06T21:21:41.425576] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-06T21:21:42.225524] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-06T21:21:42.290714] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T21:21:42.509493] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (3.48 seconds). [2025-10-06T21:21:42.807049] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-06T21:21:43.025533] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-06T21:21:43.156271] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T21:21:43.825538] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-06T21:21:44.625577] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-06T21:21:45.409173] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T21:21:45.424493] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-06T21:21:45.434999] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-06T21:21:45.818261] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T21:21:46.225574] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-06T21:21:47.030560] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-06T21:21:47.049216] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T21:21:47.050031] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-06T21:21:47.825539] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-06T21:21:48.582353] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-06T21:21:48.625473] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-06T21:21:49.347888] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-06T21:21:49.426570] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-06T21:21:49.426332] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-06T21:21:50.225577] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-06T21:21:50.974363] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T21:21:50.997528] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-06T21:21:51.025545] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-06T21:21:51.829482] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-06T21:21:51.832961] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-06T21:21:52.625558] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-06T21:21:53.267674] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T21:21:53.425544] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-06T21:21:54.152282] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T21:21:54.225533] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-06T21:21:54.302483] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-06T21:21:54.304115] [INFO ] [REMOTE ] SABA: Full fetch complete (15416 records). [2025-10-06T21:21:54.304215] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-06T21:21:54.668423] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-06T21:21:54.668523] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-06T21:21:54.668903] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-06T21:21:54.668970] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-06T21:21:54.669514] [DEBUG] [LOCAL ] SABA: Trimmed 15416 records to 9269 (keeping 200 days of data) [2025-10-06T21:21:54.725043] [DEBUG] [LOCAL ] SABA: Primary data saved (9269 records). [2025-10-06T21:21:54.725197] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-06T21:21:54.725284] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. SABA took 25.0s. Estimated remaining: 1h 12m 29s. Rate: 7.1 symbols/min [2025-10-06T21:21:54.896734] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:21:54.920966] [DEBUG] [LOCAL ] SAH: Loaded 22154 existing records from primary storage. [2025-10-06T21:21:54.921274] [INFO ] [MAIN ] SAH: Loaded 22154 existing records. [2025-10-06T21:21:55.030741] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-06T21:21:55.103799] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:21:55.104020] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-06T21:21:55.104092] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-06T21:21:55.104306] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-06T21:21:55.104377] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-06T21:21:55.468235] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:21:55.602865] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T21:21:55.825589] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-06T21:21:56.625561] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-06T21:21:56.722625] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T21:21:57.010418] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-06T21:21:57.013639] [INFO ] [REMOTE ] S: Full fetch complete (77546 records). [2025-10-06T21:21:57.013784] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-06T21:21:57.406231] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-06T21:21:57.406330] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-06T21:21:57.407523] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-06T21:21:57.407587] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-06T21:21:57.409325] [DEBUG] [LOCAL ] S: Trimmed 77546 records to 53532 (keeping 200 days of data) [2025-10-06T21:21:57.461170] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-06T21:21:57.725956] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T21:21:57.754387] [DEBUG] [LOCAL ] S: Primary data saved (53532 records). [2025-10-06T21:21:57.754508] [INFO ] [MAIN ] S: Full history saved. [2025-10-06T21:21:57.754605] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. S took 45.3s. Estimated remaining: 1h 12m 19s. Rate: 7.1 symbols/min [2025-10-06T21:21:57.925901] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:21:57.926078] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-06T21:21:57.926116] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-06T21:21:57.926224] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-06T21:21:57.926265] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-06T21:21:57.926305] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-06T21:21:57.926335] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-06T21:21:58.236337] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-06T21:21:58.276372] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:21:59.025493] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-06T21:21:59.237626] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-06T21:21:59.302060] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-06T21:21:59.359413] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T21:21:59.825533] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-06T21:22:00.625509] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-06T21:22:00.890987] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T21:22:01.425579] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-06T21:22:01.780041] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-06T21:22:01.793831] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T21:22:02.225610] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-06T21:22:03.025556] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-06T21:22:03.408601] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T21:22:03.825589] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-06T21:22:04.469188] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T21:22:04.625563] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-06T21:22:05.287527] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T21:22:05.291203] [INFO ] [REMOTE ] SA: Full fetch complete (62725 records). [2025-10-06T21:22:05.291455] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-06T21:22:05.437786] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-06T21:22:05.715707] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-06T21:22:05.715865] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-06T21:22:05.717142] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-06T21:22:05.717211] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-06T21:22:05.718805] [DEBUG] [LOCAL ] SA: Trimmed 62725 records to 43688 (keeping 200 days of data) [2025-10-06T21:22:05.979234] [DEBUG] [LOCAL ] SA: Primary data saved (43688 records). [2025-10-06T21:22:05.979409] [INFO ] [MAIN ] SA: Full history saved. [2025-10-06T21:22:05.979515] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. SA took 40.5s. Estimated remaining: 1h 12m 10s. Rate: 7.1 symbols/min [2025-10-06T21:22:06.117636] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T21:22:06.179420] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:22:06.202459] [DEBUG] [LOCAL ] SAM: Loaded 21716 existing records from primary storage. [2025-10-06T21:22:06.202761] [INFO ] [MAIN ] SAM: Loaded 21716 existing records. [2025-10-06T21:22:06.232709] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-06T21:22:06.389102] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:22:06.389402] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-06T21:22:06.389460] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-06T21:22:06.389836] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-06T21:22:06.389901] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-06T21:22:06.781211] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:22:06.798471] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-06T21:22:07.025716] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-06T21:22:07.675985] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T21:22:07.825481] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-06T21:22:08.014391] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T21:22:08.625490] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-06T21:22:08.785003] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T21:22:08.786825] [INFO ] [REMOTE ] SAFE: Full fetch complete (45021 records). [2025-10-06T21:22:08.786903] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-06T21:22:09.011293] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-06T21:22:09.195717] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-06T21:22:09.195814] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-06T21:22:09.196775] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-06T21:22:09.196839] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-06T21:22:09.197878] [DEBUG] [LOCAL ] SAFE: Trimmed 45021 records to 30265 (keeping 200 days of data) [2025-10-06T21:22:09.384308] [DEBUG] [LOCAL ] SAFE: Primary data saved (30265 records). [2025-10-06T21:22:09.384523] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-06T21:22:09.384673] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. SAFE took 31.9s. Estimated remaining: 1h 12m 0s. Rate: 7.1 symbols/min [2025-10-06T21:22:09.430612] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-06T21:22:09.569359] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:22:09.626241] [DEBUG] [LOCAL ] SAN: Loaded 53758 existing records from primary storage. [2025-10-06T21:22:09.626759] [INFO ] [MAIN ] SAN: Loaded 53758 existing records. [2025-10-06T21:22:09.812483] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:22:09.812824] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-06T21:22:09.812907] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-06T21:22:09.813255] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-06T21:22:09.813328] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-06T21:22:10.230718] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-06T21:22:10.272397] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:22:10.612289] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T21:22:11.025567] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-06T21:22:11.418910] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T21:22:11.825557] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-06T21:22:12.625551] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-06T21:22:12.716157] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T21:22:12.924025] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T21:22:13.425589] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-06T21:22:13.616611] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T21:22:14.225560] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-06T21:22:14.602404] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T21:22:15.025550] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-06T21:22:15.383095] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T21:22:15.825566] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-06T21:22:16.625547] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-06T21:22:16.693924] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T21:22:16.943133] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-06T21:22:17.086405] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T21:22:17.425601] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-06T21:22:18.225557] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-06T21:22:18.545592] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-06T21:22:18.606398] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-06T21:22:19.025597] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-06T21:22:19.825537] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-06T21:22:20.625718] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-06T21:22:20.782380] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-06T21:22:20.901930] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-06T21:22:20.924277] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T21:22:21.425555] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-06T21:22:22.225538] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-06T21:22:23.025537] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-06T21:22:23.340699] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-06T21:22:23.418203] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T21:22:23.447664] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T21:22:23.825539] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-06T21:22:24.625558] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-06T21:22:25.045314] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T21:22:25.425594] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-06T21:22:26.225552] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-06T21:22:26.578259] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-06T21:22:26.581613] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-06T21:22:26.611065] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T21:22:27.025553] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-06T21:22:27.376853] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-06T21:22:27.825541] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-06T21:22:28.139949] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-06T21:22:28.625552] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-06T21:22:29.425577] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-06T21:22:29.600216] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-06T21:22:29.680460] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-06T21:22:29.681352] [INFO ] [REMOTE ] SAJ: Full fetch complete (927 records). [2025-10-06T21:22:29.681429] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-06T21:22:29.876265] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-06T21:22:29.876517] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:22:29.876565] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:22:29.876608] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-06T21:22:29.876748] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-06T21:22:29.876806] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-06T21:22:29.876880] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-06T21:22:29.876970] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAJ took 32.1s. Estimated remaining: 1h 11m 55s. Rate: 7.1 symbols/min [2025-10-06T21:22:30.062285] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:22:30.117395] [DEBUG] [LOCAL ] SAND: Loaded 52561 existing records from primary storage. [2025-10-06T21:22:30.117877] [INFO ] [MAIN ] SAND: Loaded 52561 existing records. [2025-10-06T21:22:30.230707] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-06T21:22:30.310103] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:22:30.310377] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-06T21:22:30.310430] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-06T21:22:30.311077] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-06T21:22:30.311139] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-06T21:22:30.692173] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:22:31.025700] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-06T21:22:31.185326] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T21:22:31.187415] [INFO ] [REMOTE ] SAH: Full fetch complete (30614 records). [2025-10-06T21:22:31.187515] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-06T21:22:31.624261] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-06T21:22:31.624358] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-06T21:22:31.625186] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-06T21:22:31.625249] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-06T21:22:31.626196] [DEBUG] [LOCAL ] SAH: Trimmed 30614 records to 21715 (keeping 200 days of data) [2025-10-06T21:22:31.777221] [DEBUG] [LOCAL ] SAH: Primary data saved (21715 records). [2025-10-06T21:22:31.777408] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-06T21:22:31.777519] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. SAH took 37.1s. Estimated remaining: 1h 11m 45s. Rate: 7.1 symbols/min [2025-10-06T21:22:31.835871] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-06T21:22:31.961288] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:22:32.020097] [DEBUG] [LOCAL ] SAP: Loaded 50718 existing records from primary storage. [2025-10-06T21:22:32.020513] [INFO ] [MAIN ] SAP: Loaded 50718 existing records. [2025-10-06T21:22:32.220983] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:22:32.221396] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-06T21:22:32.221460] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-06T21:22:32.221770] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-06T21:22:32.221829] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-06T21:22:32.611592] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:22:32.625491] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-06T21:22:32.685863] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T21:22:33.345184] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T21:22:33.425541] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-06T21:22:34.225580] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-06T21:22:34.292825] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T21:22:34.294885] [INFO ] [REMOTE ] SAM: Full fetch complete (30836 records). [2025-10-06T21:22:34.294970] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-06T21:22:34.642700] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-06T21:22:34.729856] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-06T21:22:34.729959] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-06T21:22:34.730954] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-06T21:22:34.731020] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-06T21:22:34.731903] [DEBUG] [LOCAL ] SAM: Trimmed 30836 records to 21406 (keeping 200 days of data) [2025-10-06T21:22:34.868741] [DEBUG] [LOCAL ] SAM: Primary data saved (21406 records). [2025-10-06T21:22:34.868896] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-06T21:22:34.868991] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAM took 28.9s. Estimated remaining: 1h 11m 35s. Rate: 7.1 symbols/min [2025-10-06T21:22:35.034675] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-06T21:22:35.063765] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:22:35.084326] [DEBUG] [LOCAL ] SAR: Loaded 16503 existing records from primary storage. [2025-10-06T21:22:35.084677] [INFO ] [MAIN ] SAR: Loaded 16503 existing records. [2025-10-06T21:22:35.264034] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:22:35.264908] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-06T21:22:35.264967] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-06T21:22:35.265254] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-06T21:22:35.265314] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-06T21:22:35.637732] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:22:35.756417] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T21:22:35.825567] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-06T21:22:36.625512] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-06T21:22:36.678037] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T21:22:36.948727] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-06T21:22:37.425556] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-06T21:22:38.225558] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-06T21:22:38.352949] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T21:22:39.025561] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-06T21:22:39.098512] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T21:22:39.825579] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-06T21:22:40.124080] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-06T21:22:40.625529] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-06T21:22:40.793627] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-06T21:22:41.425588] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-06T21:22:41.490316] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T21:22:42.225620] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-06T21:22:42.758490] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-06T21:22:43.025541] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-06T21:22:43.366505] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-06T21:22:43.825534] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-06T21:22:43.871821] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T21:22:44.625539] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-06T21:22:45.191790] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-06T21:22:45.425566] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-06T21:22:46.225521] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-06T21:22:46.245605] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T21:22:46.756738] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-06T21:22:47.025517] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-06T21:22:47.825557] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-06T21:22:47.995770] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-10-06T21:22:48.207705] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T21:22:48.316926] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-06T21:22:48.625545] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-06T21:22:49.425499] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-06T21:22:49.507053] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T21:22:50.225497] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-06T21:22:50.359956] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T21:22:50.537838] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T21:22:51.025534] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-06T21:22:51.596151] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T21:22:51.599816] [INFO ] [REMOTE ] SAN: Full fetch complete (76290 records). [2025-10-06T21:22:51.599990] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-06T21:22:51.830721] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-06T21:22:52.025980] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-06T21:22:52.026079] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-06T21:22:52.027669] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-06T21:22:52.027761] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-06T21:22:52.029711] [DEBUG] [LOCAL ] SAN: Trimmed 76290 records to 52977 (keeping 200 days of data) [2025-10-06T21:22:52.375961] [DEBUG] [LOCAL ] SAN: Primary data saved (52977 records). [2025-10-06T21:22:52.376140] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-06T21:22:52.376241] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAN took 43.0s. Estimated remaining: 1h 11m 29s. Rate: 7.1 symbols/min [2025-10-06T21:22:52.553215] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:22:52.597941] [DEBUG] [LOCAL ] SARO: Loaded 49327 existing records from primary storage. [2025-10-06T21:22:52.598635] [INFO ] [MAIN ] SARO: Loaded 49327 existing records. [2025-10-06T21:22:52.630509] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-06T21:22:52.783703] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:22:52.784118] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-06T21:22:52.784212] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-06T21:22:52.784619] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-06T21:22:52.784730] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-06T21:22:53.002064] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-06T21:22:53.219941] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:22:53.425574] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-06T21:22:54.225561] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-06T21:23:06.383740] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (12.16 seconds). [2025-10-06T21:23:06.394330] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-06T21:23:06.805228] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (13.38 seconds). [2025-10-06T21:23:06.817488] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-06T21:23:07.158128] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (15.33 seconds). [2025-10-06T21:23:07.162759] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-06T21:23:07.568521] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (14.94 seconds). [2025-10-06T21:23:07.582509] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-06T21:23:07.669772] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T21:23:07.680700] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-06T21:23:07.859845] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-06T21:23:07.864406] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-06T21:23:08.635168] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T21:23:08.639718] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-06T21:23:08.700664] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T21:23:08.712973] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-06T21:23:09.291634] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T21:23:09.303325] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-06T21:23:09.817568] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T21:23:09.821171] [INFO ] [REMOTE ] SAND: Full fetch complete (74439 records). [2025-10-06T21:23:09.821335] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-06T21:23:10.106486] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T21:23:10.170971] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-06T21:23:10.330055] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-10-06T21:23:10.327681] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-06T21:23:10.337698] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-06T21:23:10.340683] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-06T21:23:10.340094] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-06T21:23:10.340825] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-06T21:23:10.343759] [DEBUG] [LOCAL ] SAND: Trimmed 74439 records to 51800 (keeping 200 days of data) [2025-10-06T21:23:10.684147] [DEBUG] [LOCAL ] SAND: Primary data saved (51800 records). [2025-10-06T21:23:10.684334] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-06T21:23:10.684440] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAND took 40.8s. Estimated remaining: 1h 11m 23s. Rate: 7.1 symbols/min [2025-10-06T21:23:10.862793] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:23:10.863055] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-06T21:23:10.863218] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-06T21:23:10.863498] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-06T21:23:10.863599] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-06T21:23:10.863804] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-06T21:23:10.863909] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-06T21:23:11.020213] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T21:23:11.134062] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-06T21:23:11.262705] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T21:23:11.323368] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-06T21:23:11.347058] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:23:11.349017] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-06T21:23:11.814673] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-06T21:23:11.816025] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-06T21:23:12.054860] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T21:23:12.060080] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-06T21:23:12.101821] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T21:23:12.113270] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-06T21:23:12.349705] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-06T21:23:12.350824] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-06T21:23:12.778239] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-06T21:23:12.780902] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-06T21:23:12.798028] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T21:23:12.799957] [INFO ] [REMOTE ] SAR: Full fetch complete (22925 records). [2025-10-06T21:23:12.800056] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-06T21:23:13.197750] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-06T21:23:13.202268] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-06T21:23:13.203495] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-06T21:23:13.202480] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-06T21:23:13.205353] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-06T21:23:13.205474] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-06T21:23:13.207493] [DEBUG] [LOCAL ] SAR: Trimmed 22925 records to 16460 (keeping 200 days of data) [2025-10-06T21:23:13.311303] [DEBUG] [LOCAL ] SAR: Primary data saved (16460 records). [2025-10-06T21:23:13.311746] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-06T21:23:13.311963] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SAR took 38.4s. Estimated remaining: 1h 11m 13s. Rate: 7.1 symbols/min [2025-10-06T21:23:13.532712] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-06T21:23:13.538188] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:23:13.549067] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-06T21:23:13.549976] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-06T21:23:13.550502] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-06T21:23:13.550579] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-06T21:23:13.550850] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-06T21:23:13.550904] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-06T21:23:13.593749] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-06T21:23:13.616825] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-06T21:23:13.631311] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-06T21:23:14.004754] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T21:23:14.012283] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:23:14.012952] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-06T21:23:14.029258] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-06T21:23:14.030660] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-06T21:23:14.225606] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-06T21:23:14.301359] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-06T21:23:14.509881] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-06T21:23:15.025576] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-06T21:23:15.361658] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-06T21:23:15.392393] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-06T21:23:15.396041] [INFO ] [REMOTE ] SAP: Full fetch complete (71897 records). [2025-10-06T21:23:15.396233] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-06T21:23:15.829134] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-06T21:23:15.856621] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-06T21:23:15.856769] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-06T21:23:15.858196] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-06T21:23:15.858457] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-06T21:23:15.860627] [DEBUG] [LOCAL ] SAP: Trimmed 71897 records to 49939 (keeping 200 days of data) [2025-10-06T21:23:16.009355] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T21:23:16.248291] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-06T21:23:16.266774] [DEBUG] [LOCAL ] SAP: Primary data saved (49939 records). [2025-10-06T21:23:16.266971] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-06T21:23:16.267080] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. SAP took 44.5s. Estimated remaining: 1h 11m 3s. Rate: 7.1 symbols/min [2025-10-06T21:23:16.445848] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:23:16.446100] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-06T21:23:16.446141] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-06T21:23:16.446263] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-06T21:23:16.446305] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-06T21:23:16.446347] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-06T21:23:16.446380] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-06T21:23:16.632359] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-06T21:23:16.847257] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:23:17.081801] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-06T21:23:17.425597] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-06T21:23:17.776872] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-06T21:23:18.225555] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-06T21:23:18.577547] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-06T21:23:19.025597] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-06T21:23:19.383743] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-06T21:23:19.825552] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-06T21:23:20.159342] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-06T21:23:20.625603] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-06T21:23:20.977170] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-06T21:23:21.425546] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-06T21:23:21.678393] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-06T21:23:21.679475] [INFO ] [REMOTE ] SAT: Full fetch complete (1578 records). [2025-10-06T21:23:21.679557] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-06T21:23:21.871965] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-06T21:23:21.872235] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:23:21.872309] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:23:21.872385] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-06T21:23:21.872477] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-06T21:23:21.872534] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-06T21:23:21.872594] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-06T21:23:21.872711] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. SAT took 11.2s. Estimated remaining: 1h 10m 54s. Rate: 7.1 symbols/min [2025-10-06T21:23:22.066346] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:23:22.105008] [DEBUG] [LOCAL ] SB: Loaded 33642 existing records from primary storage. [2025-10-06T21:23:22.105451] [INFO ] [MAIN ] SB: Loaded 33642 existing records. [2025-10-06T21:23:22.230682] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-06T21:23:22.305678] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:23:22.305964] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-06T21:23:22.306041] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-06T21:23:22.306325] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-06T21:23:22.306383] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-06T21:23:22.696937] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:23:22.715954] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-06T21:23:23.025593] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-06T21:23:23.825542] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-06T21:23:24.539706] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T21:23:24.625526] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-06T21:23:25.248669] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T21:23:25.425502] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-06T21:23:25.602510] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-06T21:23:25.873408] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-06T21:23:26.225624] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-06T21:23:26.561475] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-06T21:23:27.025603] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-06T21:23:27.486530] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-06T21:23:27.825546] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-06T21:23:28.625854] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-06T21:23:29.353882] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-06T21:23:29.425547] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-06T21:23:30.225527] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-06T21:23:30.613121] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-06T21:23:30.634372] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-06T21:23:30.891672] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T21:23:31.025497] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-06T21:23:31.825568] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-06T21:23:32.544347] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T21:23:32.625576] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-06T21:23:32.799886] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-06T21:23:32.901415] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-06T21:23:33.425577] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-06T21:23:34.225564] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-06T21:23:34.721324] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T21:23:34.725874] [INFO ] [REMOTE ] SARO: Full fetch complete (68982 records). [2025-10-06T21:23:34.726063] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-06T21:23:35.034300] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-06T21:23:35.176982] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-06T21:23:35.177155] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-06T21:23:35.178465] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-06T21:23:35.178540] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-06T21:23:35.180413] [DEBUG] [LOCAL ] SARO: Trimmed 68982 records to 48593 (keeping 200 days of data) [2025-10-06T21:23:35.421306] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-06T21:23:35.492097] [DEBUG] [LOCAL ] SARO: Primary data saved (48593 records). [2025-10-06T21:23:35.492292] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-06T21:23:35.492403] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SARO took 43.1s. Estimated remaining: 1h 10m 47s. Rate: 7.1 symbols/min [2025-10-06T21:23:35.672223] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:23:35.672408] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-06T21:23:35.672447] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-06T21:23:35.672556] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-06T21:23:35.672597] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-06T21:23:35.672636] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-06T21:23:35.672712] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-06T21:23:35.851464] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-06T21:23:35.865176] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T21:23:36.093950] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:23:36.283492] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T21:23:36.625558] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-06T21:23:36.986305] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-06T21:23:37.425546] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-06T21:23:37.701103] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-06T21:23:37.701971] [INFO ] [REMOTE ] SAZ: Full fetch complete (1823 records). [2025-10-06T21:23:37.702048] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-06T21:23:37.893451] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T21:23:37.893864] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:23:37.893925] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:23:37.893969] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-06T21:23:37.894049] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-06T21:23:37.894098] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-06T21:23:37.894142] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-06T21:23:37.894212] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SAZ took 21.6s. Estimated remaining: 1h 10m 37s. Rate: 7.1 symbols/min [2025-10-06T21:23:38.070954] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:23:38.128064] [DEBUG] [LOCAL ] SBH: Loaded 50518 existing records from primary storage. [2025-10-06T21:23:38.128545] [INFO ] [MAIN ] SBH: Loaded 50518 existing records. [2025-10-06T21:23:38.230854] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-06T21:23:38.319117] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:23:38.319415] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-06T21:23:38.319474] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-06T21:23:38.319869] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-06T21:23:38.319934] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-06T21:23:38.719785] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-06T21:23:38.754977] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:23:39.025538] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-06T21:23:39.825545] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-06T21:23:40.625561] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-06T21:23:40.744185] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T21:23:41.316365] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-06T21:23:41.346336] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T21:23:41.425477] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-06T21:23:42.225558] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-06T21:23:42.480716] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T21:23:42.573863] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-06T21:23:43.025530] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-06T21:23:43.296841] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-06T21:23:43.825565] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-06T21:23:44.625556] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-06T21:23:45.425504] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-06T21:23:45.494078] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T21:23:45.548820] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T21:23:45.624749] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:23:45.625128] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-06T21:23:45.625268] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:23:45.625343] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-06T21:23:45.625407] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:23:45.625478] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-06T21:23:45.625563] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-06T21:23:45.625620] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-06T21:23:45.625699] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-06T21:23:45.625761] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SBDS took 10.1s. Estimated remaining: 1h 10m 28s. Rate: 7.1 symbols/min [2025-10-06T21:23:45.792411] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:23:45.802710] [DEBUG] [LOCAL ] SBI: Loaded 7638 existing records from primary storage. [2025-10-06T21:23:45.802951] [INFO ] [MAIN ] SBI: Loaded 7638 existing records. [2025-10-06T21:23:45.975200] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:23:45.975440] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-06T21:23:45.975488] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-06T21:23:45.975784] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-06T21:23:45.975841] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-06T21:23:46.230589] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-06T21:23:46.327086] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:23:46.526774] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-06T21:23:46.527593] [INFO ] [REMOTE ] SAY: Full fetch complete (1384 records). [2025-10-06T21:23:46.527708] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-06T21:23:46.722582] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-06T21:23:46.722870] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:23:46.722953] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:23:46.723035] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-06T21:23:46.723110] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-06T21:23:46.723147] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-06T21:23:46.723187] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-06T21:23:46.723248] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SAY took 33.4s. Estimated remaining: 1h 10m 18s. Rate: 7.1 symbols/min [2025-10-06T21:23:46.913789] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:23:46.928612] [DEBUG] [LOCAL ] SBR: Loaded 7573 existing records from primary storage. [2025-10-06T21:23:46.928963] [INFO ] [MAIN ] SBR: Loaded 7573 existing records. [2025-10-06T21:23:47.030732] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-06T21:23:47.125169] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:23:47.125502] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-06T21:23:47.125565] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-06T21:23:47.125875] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-06T21:23:47.125999] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-06T21:23:47.509370] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:23:47.825551] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-06T21:23:48.625498] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-06T21:23:48.744910] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T21:23:48.815493] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T21:23:49.323774] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-06T21:23:49.425553] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-06T21:23:50.225603] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-06T21:23:51.025555] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-06T21:23:51.164912] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T21:23:51.544201] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-06T21:23:51.709999] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-06T21:23:51.825578] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-06T21:23:52.625744] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-06T21:23:53.425480] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-06T21:23:53.536801] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T21:23:53.888295] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T21:23:54.052551] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-06T21:23:54.225577] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-06T21:23:55.025574] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-06T21:23:55.044148] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T21:23:55.812554] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-06T21:23:55.825461] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-06T21:23:56.625501] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-06T21:23:56.683925] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T21:23:57.226851] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T21:23:57.425559] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-06T21:23:58.183889] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T21:23:58.225489] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-06T21:23:59.025532] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-06T21:23:59.825550] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-06T21:23:59.971175] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T21:24:00.019522] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-06T21:24:00.022153] [INFO ] [REMOTE ] SB: Full fetch complete (50130 records). [2025-10-06T21:24:00.022245] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-06T21:24:00.421808] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-06T21:24:00.421934] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-06T21:24:00.423206] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-06T21:24:00.423289] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-06T21:24:00.424779] [DEBUG] [LOCAL ] SB: Trimmed 50130 records to 33086 (keeping 200 days of data) [2025-10-06T21:24:00.625889] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-06T21:24:00.659255] [DEBUG] [LOCAL ] SB: Primary data saved (33086 records). [2025-10-06T21:24:00.667581] [INFO ] [MAIN ] SB: Full history saved. [2025-10-06T21:24:00.668241] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T21:24:00.671888] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SB took 38.8s. Estimated remaining: 1h 10m 11s. Rate: 7.1 symbols/min [2025-10-06T21:24:00.871629] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:24:00.922546] [DEBUG] [LOCAL ] SBS: Loaded 50163 existing records from primary storage. [2025-10-06T21:24:00.923019] [INFO ] [MAIN ] SBS: Loaded 50163 existing records. [2025-10-06T21:24:01.122940] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:24:01.123227] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-06T21:24:01.123277] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-06T21:24:01.123576] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-06T21:24:01.123678] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-06T21:24:01.308810] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-06T21:24:01.430806] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-06T21:24:01.523113] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:24:02.225578] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-06T21:24:02.472083] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T21:24:02.683851] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-06T21:24:03.025551] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-06T21:24:03.736076] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-06T21:24:03.825551] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-06T21:24:04.541874] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T21:24:04.625542] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-06T21:24:05.209836] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-06T21:24:05.425539] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-06T21:24:06.225574] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-06T21:24:06.643762] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-06T21:24:06.645095] [INFO ] [REMOTE ] SBI: Full fetch complete (10543 records). [2025-10-06T21:24:06.645173] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-06T21:24:07.027686] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-06T21:24:07.106616] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-06T21:24:07.107548] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-06T21:24:07.108087] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-06T21:24:07.110286] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-06T21:24:07.110130] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T21:24:07.121972] [DEBUG] [LOCAL ] SBI: Trimmed 10543 records to 7412 (keeping 200 days of data) [2025-10-06T21:24:07.172685] [DEBUG] [LOCAL ] SBI: Primary data saved (7412 records). [2025-10-06T21:24:07.172898] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-06T21:24:07.173010] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SBI took 21.5s. Estimated remaining: 1h 10m 2s. Rate: 7.1 symbols/min [2025-10-06T21:24:07.369185] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:24:07.388283] [DEBUG] [LOCAL ] SBSI: Loaded 15017 existing records from primary storage. [2025-10-06T21:24:07.388634] [INFO ] [MAIN ] SBSI: Loaded 15017 existing records. [2025-10-06T21:24:07.587709] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:24:07.588079] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-06T21:24:07.588183] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-06T21:24:07.588507] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-06T21:24:07.588567] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-06T21:24:07.834737] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-06T21:24:07.952244] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:24:08.626933] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-06T21:24:08.628124] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T21:24:08.746043] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T21:24:09.425542] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-06T21:24:10.151714] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T21:24:10.225536] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-06T21:24:10.346255] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T21:24:10.775323] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-06T21:24:11.025550] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-06T21:24:11.825555] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-06T21:24:11.841249] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T21:24:12.625553] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-06T21:24:13.335144] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T21:24:13.425596] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-06T21:24:14.193508] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-06T21:24:14.225489] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-06T21:24:14.277847] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T21:24:14.811079] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T21:24:14.812532] [INFO ] [REMOTE ] SBR: Full fetch complete (11165 records). [2025-10-06T21:24:14.812620] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-06T21:24:15.030772] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-06T21:24:15.205052] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-06T21:24:15.205150] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-06T21:24:15.205475] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-06T21:24:15.205514] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-06T21:24:15.206032] [DEBUG] [LOCAL ] SBR: Trimmed 11165 records to 7502 (keeping 200 days of data) [2025-10-06T21:24:15.256154] [DEBUG] [LOCAL ] SBR: Primary data saved (7502 records). [2025-10-06T21:24:15.256330] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-06T21:24:15.256435] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SBR took 28.5s. Estimated remaining: 1h 9m 53s. Rate: 7.1 symbols/min [2025-10-06T21:24:15.424358] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:24:15.486481] [DEBUG] [LOCAL ] SBSW: Loaded 53812 existing records from primary storage. [2025-10-06T21:24:15.486870] [INFO ] [MAIN ] SBSW: Loaded 53812 existing records. [2025-10-06T21:24:15.668203] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:24:15.668453] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-06T21:24:15.668511] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-06T21:24:15.668806] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-06T21:24:15.668874] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-06T21:24:15.833420] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-06T21:24:16.044048] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:24:16.625548] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-06T21:24:16.763598] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T21:24:16.886986] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T21:24:17.425594] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-06T21:24:18.225520] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-06T21:24:18.406205] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T21:24:18.411185] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T21:24:19.025569] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-06T21:24:19.825579] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-06T21:24:20.117720] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T21:24:20.627560] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-06T21:24:20.628532] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T21:24:20.916493] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T21:24:21.425591] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-06T21:24:22.225510] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-06T21:24:22.344900] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T21:24:22.440842] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T21:24:23.025559] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-06T21:24:23.825590] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-06T21:24:23.917002] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T21:24:24.625548] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-06T21:24:24.815625] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T21:24:24.929798] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-06T21:24:25.425572] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-06T21:24:26.225515] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-06T21:24:26.400292] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T21:24:26.777853] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T21:24:26.780912] [INFO ] [REMOTE ] SBH: Full fetch complete (72853 records). [2025-10-06T21:24:26.781031] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-06T21:24:27.030742] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-06T21:24:27.193534] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-06T21:24:27.193710] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-06T21:24:27.195581] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-06T21:24:27.195733] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-06T21:24:27.197358] [DEBUG] [LOCAL ] SBH: Trimmed 72853 records to 49800 (keeping 200 days of data) [2025-10-06T21:24:27.493565] [DEBUG] [LOCAL ] SBH: Primary data saved (49800 records). [2025-10-06T21:24:27.493772] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-06T21:24:27.493877] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBH took 49.6s. Estimated remaining: 1h 9m 46s. Rate: 7.1 symbols/min [2025-10-06T21:24:27.661512] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:24:27.661762] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-06T21:24:27.661825] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-06T21:24:27.661942] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-06T21:24:27.661985] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-06T21:24:27.662031] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-06T21:24:27.662063] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-06T21:24:27.830710] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-06T21:24:28.035434] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:24:28.047823] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T21:24:28.087353] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T21:24:28.625536] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-06T21:24:29.425493] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-06T21:24:29.540396] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T21:24:30.225504] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-06T21:24:30.345950] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T21:24:30.565853] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T21:24:31.025538] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-06T21:24:31.721285] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T21:24:31.825509] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-06T21:24:31.932386] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-06T21:24:32.050445] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.22 seconds). [2025-10-06T21:24:32.625551] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-06T21:24:32.882498] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-06T21:24:33.425531] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-06T21:24:33.756274] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-06T21:24:34.225611] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-06T21:24:35.025547] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-06T21:24:35.245344] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-06T21:24:35.825499] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-06T21:24:35.960299] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T21:24:36.075618] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-06T21:24:36.625544] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-06T21:24:36.976869] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-06T21:24:37.425584] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-06T21:24:38.226243] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-06T21:24:38.981927] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T21:24:39.025511] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-06T21:24:39.825528] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-06T21:24:40.273262] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-06T21:24:40.425216] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T21:24:40.428898] [INFO ] [REMOTE ] SBS: Full fetch complete (70139 records). [2025-10-06T21:24:40.429090] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-06T21:24:40.598615] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T21:24:40.638626] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-06T21:24:40.863555] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-06T21:24:40.863687] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-06T21:24:40.865049] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-06T21:24:40.865118] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-06T21:24:40.866632] [DEBUG] [LOCAL ] SBS: Trimmed 70139 records to 49382 (keeping 200 days of data) [2025-10-06T21:24:41.170976] [DEBUG] [LOCAL ] SBS: Primary data saved (49382 records). [2025-10-06T21:24:41.171146] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-06T21:24:41.171240] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBS took 40.5s. Estimated remaining: 1h 9m 39s. Rate: 7.1 symbols/min [2025-10-06T21:24:41.425538] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-06T21:24:42.225569] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-06T21:24:42.359733] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-06T21:24:42.647901] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-06T21:24:42.822633] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T21:24:43.025533] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-06T21:24:43.825550] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-06T21:24:44.545814] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-06T21:24:44.625547] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-06T21:24:44.823811] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-06T21:24:45.410313] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T21:24:45.412936] [INFO ] [REMOTE ] SBSI: Full fetch complete (21287 records). [2025-10-06T21:24:45.413078] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-06T21:24:45.430723] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-06T21:24:45.826356] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-06T21:24:45.826514] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-06T21:24:45.827219] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-06T21:24:45.827320] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-06T21:24:45.828163] [DEBUG] [LOCAL ] SBSI: Trimmed 21287 records to 14853 (keeping 200 days of data) [2025-10-06T21:24:45.929476] [DEBUG] [LOCAL ] SBSI: Primary data saved (14853 records). [2025-10-06T21:24:45.929680] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-06T21:24:45.929815] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SBSI took 38.8s. Estimated remaining: 1h 9m 29s. Rate: 7.1 symbols/min [2025-10-06T21:24:46.225549] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-06T21:24:46.676704] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-06T21:24:47.025549] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-06T21:24:47.366049] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-06T21:24:47.478755] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-06T21:24:47.825561] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-06T21:24:48.109085] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-06T21:24:48.110004] [INFO ] [REMOTE ] SBXD: Full fetch complete (3102 records). [2025-10-06T21:24:48.110084] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-06T21:24:48.289883] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-10-06T21:24:48.290138] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:24:48.290206] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:24:48.290259] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-06T21:24:48.290321] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-06T21:24:48.290356] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-06T21:24:48.290393] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-06T21:24:48.290452] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SBXD took 20.8s. Estimated remaining: 1h 9m 19s. Rate: 7.1 symbols/min [2025-10-06T21:24:48.625584] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-06T21:24:50.698217] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-06T21:24:50.710006] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-06T21:24:52.076777] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T21:24:52.079977] [INFO ] [REMOTE ] SBSW: Full fetch complete (76532 records). [2025-10-06T21:24:52.080112] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-06T21:24:52.476635] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-06T21:24:52.476795] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-06T21:24:52.478163] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-06T21:24:52.478239] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-06T21:24:52.480010] [DEBUG] [LOCAL ] SBSW: Trimmed 76532 records to 53054 (keeping 200 days of data) [2025-10-06T21:24:52.798888] [DEBUG] [LOCAL ] SBSW: Primary data saved (53054 records). [2025-10-06T21:24:52.799069] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-06T21:24:52.800038] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SBSW took 37.5s. Estimated remaining: 1h 9m 10s. Rate: 7.1 symbols/min [2025-10-06T21:24:53.525388] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:24:53.534146] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:24:53.556481] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:24:53.589933] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:24:53.617723] [DEBUG] [LOCAL ] SCD: Loaded 13029 existing records from primary storage. [2025-10-06T21:24:53.618191] [INFO ] [MAIN ] SCD: Loaded 13029 existing records. [2025-10-06T21:24:53.814827] [DEBUG] [LOCAL ] SCI: Loaded 47113 existing records from primary storage. [2025-10-06T21:24:53.860612] [INFO ] [MAIN ] SCI: Loaded 47113 existing records. [2025-10-06T21:24:53.876222] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-10-06T21:24:53.982618] [INFO ] [MAIN ] SCHW: Loaded 54465 existing records. [2025-10-06T21:24:53.995791] [DEBUG] [LOCAL ] SCCO: Loaded 50173 existing records from primary storage. [2025-10-06T21:24:54.009264] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:24:54.028053] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-06T21:24:54.038371] [INFO ] [MAIN ] SCCO: Loaded 50173 existing records. [2025-10-06T21:24:54.037925] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-06T21:24:54.188931] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-06T21:24:54.263546] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-06T21:24:54.539462] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:24:54.585704] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-06T21:24:54.595093] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-06T21:24:54.627505] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:24:54.547510] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:24:54.628226] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-06T21:24:54.628537] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-06T21:24:54.628716] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-06T21:24:54.634232] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-06T21:24:54.639789] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-06T21:24:54.639681] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-06T21:24:54.650504] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-06T21:24:54.650746] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-06T21:24:54.656032] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-06T21:24:54.707173] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-06T21:24:56.106630] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:24:56.197664] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:24:56.190168] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-06T21:24:56.227742] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-06T21:24:56.255016] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:24:56.255406] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-06T21:24:56.301556] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:24:56.302514] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-06T21:24:56.977688] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-06T21:24:56.980214] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-06T21:24:57.818163] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T21:24:57.821700] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-06T21:24:57.851421] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T21:24:57.861881] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-06T21:24:57.894569] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T21:24:57.905178] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-06T21:24:58.350335] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-06T21:24:58.361903] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-06T21:24:58.580680] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T21:24:58.583079] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-06T21:24:59.304729] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T21:24:59.307848] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-06T21:24:59.448052] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T21:24:59.458498] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-06T21:24:59.516408] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T21:24:59.825523] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-06T21:25:00.122812] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T21:25:00.340343] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-06T21:25:00.625492] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-06T21:25:01.101282] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T21:25:01.266132] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T21:25:01.425621] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-06T21:25:02.225574] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-06T21:25:02.227825] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-06T21:25:02.541470] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-06T21:25:03.025570] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-06T21:25:03.833456] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-06T21:25:03.854815] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T21:25:03.989244] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T21:25:04.625537] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-06T21:25:05.425514] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-06T21:25:05.821422] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T21:25:06.225570] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-06T21:25:06.552427] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-06T21:25:06.922350] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T21:25:06.954698] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T21:25:07.025611] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-06T21:25:07.825544] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-06T21:25:07.888130] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T21:25:08.625580] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-06T21:25:09.425520] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-06T21:25:09.601297] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-06T21:25:10.225579] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-06T21:25:10.331704] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T21:25:10.368832] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T21:25:11.025533] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-06T21:25:11.639128] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T21:25:11.641169] [INFO ] [REMOTE ] SCD: Full fetch complete (16526 records). [2025-10-06T21:25:11.641275] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-06T21:25:11.826906] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-06T21:25:12.045882] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-06T21:25:12.046023] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-06T21:25:12.046947] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-06T21:25:12.047044] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-06T21:25:12.048197] [DEBUG] [LOCAL ] SCD: Trimmed 16526 records to 12993 (keeping 200 days of data) [2025-10-06T21:25:12.163461] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-06T21:25:12.174362] [DEBUG] [LOCAL ] SCD: Primary data saved (12993 records). [2025-10-06T21:25:12.185085] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-06T21:25:12.185687] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SCD took 19.4s. Estimated remaining: 1h 9m 4s. Rate: 7.1 symbols/min [2025-10-06T21:25:12.359282] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:25:12.377472] [DEBUG] [LOCAL ] SCL: Loaded 15145 existing records from primary storage. [2025-10-06T21:25:12.377787] [INFO ] [MAIN ] SCL: Loaded 15145 existing records. [2025-10-06T21:25:12.581973] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:25:12.582311] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-06T21:25:12.582376] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-06T21:25:12.582601] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-06T21:25:12.582700] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-06T21:25:12.630841] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-06T21:25:12.946754] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:25:13.425598] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-06T21:25:13.523168] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T21:25:14.225538] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-06T21:25:14.885574] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-06T21:25:15.025517] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-06T21:25:15.187842] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T21:25:15.825545] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-06T21:25:15.949582] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-06T21:25:16.625555] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-06T21:25:16.989755] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-06T21:25:17.109940] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-06T21:25:17.425533] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-06T21:25:18.225512] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-06T21:25:18.548058] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-06T21:25:18.629378] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-06T21:25:19.025554] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-06T21:25:19.184916] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-06T21:25:19.825497] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-06T21:25:20.625503] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-06T21:25:20.677509] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T21:25:20.758611] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T21:25:21.425554] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-06T21:25:22.234916] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-06T21:25:22.240667] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T21:25:22.520465] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-06T21:25:23.025544] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-06T21:25:23.825535] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-06T21:25:24.032280] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T21:25:24.118931] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T21:25:24.625534] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-06T21:25:25.425545] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-06T21:25:25.613479] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-06T21:25:25.674580] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T21:25:26.225594] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-06T21:25:26.609154] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T21:25:26.611937] [INFO ] [REMOTE ] SCI: Full fetch complete (67376 records). [2025-10-06T21:25:26.612046] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-06T21:25:27.002449] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-06T21:25:27.002555] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-06T21:25:27.003742] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-06T21:25:27.003808] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-06T21:25:27.005581] [DEBUG] [LOCAL ] SCI: Trimmed 67376 records to 46518 (keeping 200 days of data) [2025-10-06T21:25:27.069427] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-06T21:25:27.310247] [DEBUG] [LOCAL ] SCI: Primary data saved (46518 records). [2025-10-06T21:25:27.310406] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-06T21:25:27.310502] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCI took 34.5s. Estimated remaining: 1h 8m 57s. Rate: 7.1 symbols/min [2025-10-06T21:25:27.475279] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:25:27.503000] [DEBUG] [LOCAL ] SCM: Loaded 20092 existing records from primary storage. [2025-10-06T21:25:27.503410] [INFO ] [MAIN ] SCM: Loaded 20092 existing records. [2025-10-06T21:25:27.677585] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:25:27.677824] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-06T21:25:27.677871] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-06T21:25:27.678129] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-06T21:25:27.678187] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-06T21:25:27.841730] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-06T21:25:28.034093] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:25:28.269751] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-06T21:25:28.431049] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-06T21:25:28.501200] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T21:25:28.505836] [INFO ] [REMOTE ] SCCO: Full fetch complete (71055 records). [2025-10-06T21:25:28.506035] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-06T21:25:28.626375] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-06T21:25:28.927126] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-06T21:25:28.927246] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-06T21:25:28.928504] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-06T21:25:28.928571] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-06T21:25:28.930068] [DEBUG] [LOCAL ] SCCO: Trimmed 71055 records to 49525 (keeping 200 days of data) [2025-10-06T21:25:29.235184] [DEBUG] [LOCAL ] SCCO: Primary data saved (49525 records). [2025-10-06T21:25:29.235364] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-06T21:25:29.235502] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCCO took 36.4s. Estimated remaining: 1h 8m 47s. Rate: 7.1 symbols/min [2025-10-06T21:25:29.401937] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:25:29.425507] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-06T21:25:29.445910] [DEBUG] [LOCAL ] SCS: Loaded 44100 existing records from primary storage. [2025-10-06T21:25:29.446260] [INFO ] [MAIN ] SCS: Loaded 44100 existing records. [2025-10-06T21:25:29.572919] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T21:25:29.637613] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:25:29.637885] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-06T21:25:29.637944] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-06T21:25:29.638375] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-06T21:25:29.638455] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-06T21:25:29.979440] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:25:30.225495] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-06T21:25:30.703776] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T21:25:31.025537] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-06T21:25:31.785076] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T21:25:31.825477] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-06T21:25:32.625560] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-06T21:25:32.967435] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-06T21:25:33.261420] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T21:25:33.425522] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-06T21:25:33.479363] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T21:25:34.225569] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-06T21:25:34.479436] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T21:25:35.025533] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-06T21:25:35.825544] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-06T21:25:36.073491] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T21:25:36.199729] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-06T21:25:36.625555] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-06T21:25:37.043180] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-06T21:25:37.425586] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-06T21:25:38.129832] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T21:25:38.133033] [INFO ] [REMOTE ] SCHW: Full fetch complete (77704 records). [2025-10-06T21:25:38.133138] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-06T21:25:38.231971] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-06T21:25:38.512151] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-06T21:25:38.556238] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-06T21:25:38.556352] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-06T21:25:38.557838] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-06T21:25:38.557915] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-06T21:25:38.559693] [DEBUG] [LOCAL ] SCHW: Trimmed 77704 records to 53685 (keeping 200 days of data) [2025-10-06T21:25:38.904801] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-10-06T21:25:38.904991] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-06T21:25:38.905088] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCHW took 46.1s. Estimated remaining: 1h 8m 39s. Rate: 7.1 symbols/min [2025-10-06T21:25:39.030738] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-06T21:25:39.080336] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:25:39.110819] [DEBUG] [LOCAL ] SD: Loaded 29193 existing records from primary storage. [2025-10-06T21:25:39.111147] [INFO ] [MAIN ] SD: Loaded 29193 existing records. [2025-10-06T21:25:39.286124] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:25:39.286356] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-06T21:25:39.286404] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-06T21:25:39.286664] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-06T21:25:39.286727] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-06T21:25:39.639702] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:25:39.825491] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-06T21:25:40.143590] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T21:25:40.258041] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T21:25:40.625541] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-06T21:25:41.141147] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T21:25:41.425562] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-06T21:25:42.135702] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T21:25:42.225510] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-06T21:25:42.238007] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T21:25:42.239485] [INFO ] [REMOTE ] SCL: Full fetch complete (21408 records). [2025-10-06T21:25:42.239559] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-06T21:25:42.607521] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-06T21:25:42.607663] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-06T21:25:42.608467] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-06T21:25:42.608541] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-06T21:25:42.609532] [DEBUG] [LOCAL ] SCL: Trimmed 21408 records to 14883 (keeping 200 days of data) [2025-10-06T21:25:42.704449] [DEBUG] [LOCAL ] SCL: Primary data saved (14883 records). [2025-10-06T21:25:42.704631] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-06T21:25:42.704767] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCL took 30.5s. Estimated remaining: 1h 8m 29s. Rate: 7.1 symbols/min [2025-10-06T21:25:42.872591] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:25:42.886165] [DEBUG] [LOCAL ] SDHC: Loaded 10487 existing records from primary storage. [2025-10-06T21:25:42.886426] [INFO ] [MAIN ] SDHC: Loaded 10487 existing records. [2025-10-06T21:25:43.034195] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-06T21:25:43.068906] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:25:43.069117] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-06T21:25:43.069170] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-06T21:25:43.069419] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-06T21:25:43.069480] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-06T21:25:43.426992] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:25:43.527615] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T21:25:43.825522] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-06T21:25:43.893343] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T21:25:44.625557] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-06T21:25:44.814088] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T21:25:45.425509] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-06T21:25:45.702878] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-06T21:25:46.225572] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-06T21:25:46.586879] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T21:25:47.025494] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-06T21:25:47.244847] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T21:25:47.825502] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-06T21:25:47.964497] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-06T21:25:48.625535] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-06T21:25:48.961048] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T21:25:49.425505] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-06T21:25:49.459038] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T21:25:50.225680] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-06T21:25:50.504833] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T21:25:51.025602] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-06T21:25:51.563949] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T21:25:51.825609] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-06T21:25:52.101971] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T21:25:52.625595] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-06T21:25:53.413094] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T21:25:53.425468] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-06T21:25:54.004224] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T21:25:54.225539] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-06T21:25:54.887838] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T21:25:55.025619] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-06T21:25:55.757918] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T21:25:55.825477] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-06T21:25:56.138270] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T21:25:56.627447] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-06T21:25:56.631053] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T21:25:57.425553] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-06T21:25:57.519587] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-06T21:25:57.521505] [INFO ] [REMOTE ] SCM: Full fetch complete (28614 records). [2025-10-06T21:25:57.521584] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-06T21:25:57.904461] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-06T21:25:57.904572] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-06T21:25:57.905511] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-06T21:25:57.905575] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-06T21:25:57.906419] [DEBUG] [LOCAL ] SCM: Trimmed 28614 records to 19758 (keeping 200 days of data) [2025-10-06T21:25:58.032666] [DEBUG] [LOCAL ] SCM: Primary data saved (19758 records). [2025-10-06T21:25:58.032860] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-06T21:25:58.032970] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCM took 30.7s. Estimated remaining: 1h 8m 23s. Rate: 7.1 symbols/min [2025-10-06T21:25:58.206482] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:25:58.222912] [DEBUG] [LOCAL ] SDHY: Loaded 10731 existing records from primary storage. [2025-10-06T21:25:58.223194] [INFO ] [MAIN ] SDHY: Loaded 10731 existing records. [2025-10-06T21:25:58.234520] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-06T21:25:58.413954] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:25:58.414232] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-06T21:25:58.414283] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-06T21:25:58.414571] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-06T21:25:58.414632] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-06T21:25:58.787786] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:25:59.025586] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-06T21:25:59.066869] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T21:25:59.309871] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T21:25:59.825516] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-06T21:25:59.989303] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T21:26:00.625565] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-06T21:26:00.637376] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T21:26:01.425580] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-06T21:26:02.025311] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T21:26:02.172143] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T21:26:02.225562] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-06T21:26:03.025632] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-06T21:26:03.787548] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-06T21:26:03.825523] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-06T21:26:04.625568] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-06T21:26:05.425566] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-06T21:26:06.593523] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (4.37 seconds). [2025-10-06T21:26:06.596876] [INFO ] [REMOTE ] SCS: Full fetch complete (60926 records). [2025-10-06T21:26:06.597022] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-06T21:26:06.935920] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-10-06T21:26:06.955819] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-06T21:26:07.046515] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-06T21:26:07.046627] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-06T21:26:07.048263] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-06T21:26:07.048341] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-06T21:26:07.050169] [DEBUG] [LOCAL ] SCS: Trimmed 60926 records to 43586 (keeping 200 days of data) [2025-10-06T21:26:07.290036] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-06T21:26:07.294858] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-06T21:26:07.368582] [DEBUG] [LOCAL ] SCS: Primary data saved (43586 records). [2025-10-06T21:26:07.368825] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-06T21:26:07.368950] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SCS took 38.1s. Estimated remaining: 1h 8m 14s. Rate: 7.1 symbols/min [2025-10-06T21:26:07.557089] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:26:07.599267] [DEBUG] [LOCAL ] SDRL: Loaded 42190 existing records from primary storage. [2025-10-06T21:26:07.599732] [INFO ] [MAIN ] SDRL: Loaded 42190 existing records. [2025-10-06T21:26:07.796058] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:26:07.796705] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-06T21:26:07.796773] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-06T21:26:07.797448] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-06T21:26:07.797528] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-06T21:26:08.168380] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-06T21:26:08.135881] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T21:26:08.218964] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:26:08.214291] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-06T21:26:08.625616] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-06T21:26:09.174152] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T21:26:09.425542] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-06T21:26:10.230590] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-06T21:26:10.248836] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T21:26:11.025506] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-06T21:26:11.202581] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (4.25 seconds). [2025-10-06T21:26:11.517509] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T21:26:11.825564] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-06T21:26:12.287012] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-10-06T21:26:12.539913] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-06T21:26:12.625518] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-06T21:26:12.741913] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T21:26:13.292291] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T21:26:13.425510] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-06T21:26:14.225511] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-06T21:26:15.013227] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-06T21:26:15.030698] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-06T21:26:15.048617] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T21:26:15.825573] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-06T21:26:16.179196] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-06T21:26:16.625634] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-06T21:26:17.428307] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-06T21:26:17.432743] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-06T21:26:17.473501] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T21:26:18.225523] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-06T21:26:18.501518] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T21:26:18.504141] [INFO ] [REMOTE ] SD: Full fetch complete (41143 records). [2025-10-06T21:26:18.504243] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-06T21:26:18.879140] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T21:26:18.907813] [INFO ] [REMOTE ] SDHC: Full fetch complete (17176 records). [2025-10-06T21:26:18.914951] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-06T21:26:18.932802] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-06T21:26:18.932937] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-06T21:26:18.934379] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-06T21:26:18.940274] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-06T21:26:19.030776] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-06T21:26:19.063122] [DEBUG] [LOCAL ] SD: Trimmed 41143 records to 28759 (keeping 200 days of data) [2025-10-06T21:26:19.501056] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-06T21:26:19.501889] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-06T21:26:19.502518] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-06T21:26:19.503566] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-06T21:26:19.507913] [DEBUG] [LOCAL ] SDHC: Trimmed 17176 records to 10336 (keeping 200 days of data) [2025-10-06T21:26:19.603834] [DEBUG] [LOCAL ] SDHC: Primary data saved (10336 records). [2025-10-06T21:26:19.605028] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-06T21:26:19.605742] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SDHC took 36.9s. Estimated remaining: 1h 8m 7s. Rate: 7.1 symbols/min [2025-10-06T21:26:19.861714] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-06T21:26:19.861040] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:26:19.882859] [DEBUG] [LOCAL ] SD: Primary data saved (28759 records). [2025-10-06T21:26:19.883169] [INFO ] [MAIN ] SD: Full history saved. [2025-10-06T21:26:19.883289] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SD took 41.0s. Estimated remaining: 1h 7m 56s. Rate: 7.1 symbols/min [2025-10-06T21:26:20.083980] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:26:20.110203] [DEBUG] [LOCAL ] SE: Loaded 54129 existing records from primary storage. [2025-10-06T21:26:20.111158] [INFO ] [MAIN ] SE: Loaded 54129 existing records. [2025-10-06T21:26:20.320701] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:26:20.321233] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-06T21:26:20.321297] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-06T21:26:20.332688] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-06T21:26:20.332969] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-06T21:26:20.463868] [DEBUG] [LOCAL ] SEE: Loaded 48990 existing records from primary storage. [2025-10-06T21:26:20.480795] [INFO ] [MAIN ] SEE: Loaded 48990 existing records. [2025-10-06T21:26:20.747530] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T21:26:20.894781] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:26:20.876090] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-06T21:26:20.910316] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-06T21:26:20.941160] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-06T21:26:21.060628] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:26:21.053018] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-06T21:26:21.061582] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-06T21:26:21.069839] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-06T21:26:21.430712] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-06T21:26:21.465671] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:26:21.946269] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T21:26:22.225543] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-06T21:26:22.813819] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T21:26:22.815059] [INFO ] [REMOTE ] SDHY: Full fetch complete (15736 records). [2025-10-06T21:26:22.815130] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-06T21:26:23.030768] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-06T21:26:23.204183] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-06T21:26:23.204369] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-06T21:26:23.205086] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-06T21:26:23.205269] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-06T21:26:23.206425] [DEBUG] [LOCAL ] SDHY: Trimmed 15736 records to 10632 (keeping 200 days of data) [2025-10-06T21:26:23.290606] [DEBUG] [LOCAL ] SDHY: Primary data saved (10632 records). [2025-10-06T21:26:23.290855] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-06T21:26:23.291004] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SDHY took 25.3s. Estimated remaining: 1h 7m 47s. Rate: 7.1 symbols/min [2025-10-06T21:26:23.486773] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-06T21:26:23.533208] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:26:23.551569] [DEBUG] [LOCAL ] SEG: Loaded 13766 existing records from primary storage. [2025-10-06T21:26:23.551933] [INFO ] [MAIN ] SEG: Loaded 13766 existing records. [2025-10-06T21:26:23.741483] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:26:23.741797] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-06T21:26:23.741857] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-06T21:26:23.742042] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-06T21:26:23.742099] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-06T21:26:23.830876] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-06T21:26:24.095155] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:26:24.625559] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-06T21:26:24.669935] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T21:26:25.067458] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T21:26:25.425604] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-06T21:26:26.225525] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-06T21:26:26.578921] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-06T21:26:26.655322] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T21:26:27.025547] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-06T21:26:27.825516] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-06T21:26:27.867239] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T21:26:28.613155] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-06T21:26:28.625476] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-06T21:26:28.931168] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T21:26:29.425514] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-06T21:26:29.505842] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T21:26:30.225556] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-06T21:26:31.025553] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-06T21:26:31.162065] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T21:26:31.603397] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-06T21:26:31.825592] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-06T21:26:32.625561] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-06T21:26:32.695761] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T21:26:33.294304] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T21:26:33.425541] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-06T21:26:34.225526] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-06T21:26:34.760360] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-06T21:26:34.998709] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T21:26:35.025498] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-06T21:26:35.825517] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-06T21:26:35.953926] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T21:26:36.519917] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T21:26:36.625479] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-06T21:26:36.797806] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T21:26:37.425550] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-06T21:26:37.527892] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T21:26:37.530376] [INFO ] [REMOTE ] SDRL: Full fetch complete (61695 records). [2025-10-06T21:26:37.530476] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-06T21:26:37.906508] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-06T21:26:37.906609] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-06T21:26:37.907631] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-06T21:26:37.907715] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-06T21:26:37.909084] [DEBUG] [LOCAL ] SDRL: Trimmed 61695 records to 41480 (keeping 200 days of data) [2025-10-06T21:26:38.150810] [DEBUG] [LOCAL ] SDRL: Primary data saved (41480 records). [2025-10-06T21:26:38.150986] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-06T21:26:38.151077] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SDRL took 30.8s. Estimated remaining: 1h 7m 40s. Rate: 7.1 symbols/min [2025-10-06T21:26:38.225722] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-06T21:26:38.330001] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:26:38.376779] [DEBUG] [LOCAL ] SEI: Loaded 50431 existing records from primary storage. [2025-10-06T21:26:38.377284] [INFO ] [MAIN ] SEI: Loaded 50431 existing records. [2025-10-06T21:26:38.500955] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-06T21:26:38.584501] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:26:38.584838] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-06T21:26:38.584902] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-06T21:26:38.585135] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-06T21:26:38.585193] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-06T21:26:38.929600] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:26:39.025524] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-06T21:26:39.825548] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-06T21:26:40.551814] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-06T21:26:40.625509] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-06T21:26:40.689660] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T21:26:40.853545] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T21:26:41.425525] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-06T21:26:42.225547] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-06T21:26:42.303203] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T21:26:42.734865] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-06T21:26:43.025591] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-06T21:26:43.477067] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T21:26:43.825582] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-06T21:26:44.625535] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-06T21:26:45.181410] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-06T21:26:45.257792] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T21:26:45.425511] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-06T21:26:45.499550] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-06T21:26:46.225598] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-06T21:26:46.953482] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T21:26:47.025580] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-06T21:26:47.164406] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-06T21:26:47.825815] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-06T21:26:48.597960] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-06T21:26:48.625555] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-06T21:26:48.912921] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T21:26:49.425606] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-06T21:26:49.995798] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T21:26:49.997085] [INFO ] [REMOTE ] SEG: Full fetch complete (19843 records). [2025-10-06T21:26:49.997521] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-06T21:26:50.230901] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-06T21:26:50.386331] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-06T21:26:50.386475] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-06T21:26:50.387051] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-06T21:26:50.387142] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-06T21:26:50.388282] [DEBUG] [LOCAL ] SEG: Trimmed 19843 records to 13325 (keeping 200 days of data) [2025-10-06T21:26:50.476522] [DEBUG] [LOCAL ] SEG: Primary data saved (13325 records). [2025-10-06T21:26:50.476768] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-06T21:26:50.476901] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SEG took 27.2s. Estimated remaining: 1h 7m 32s. Rate: 7.1 symbols/min [2025-10-06T21:26:50.631541] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-06T21:26:50.691395] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:26:50.738862] [DEBUG] [LOCAL ] SEM: Loaded 43391 existing records from primary storage. [2025-10-06T21:26:50.739220] [INFO ] [MAIN ] SEM: Loaded 43391 existing records. [2025-10-06T21:26:50.919768] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:26:50.920068] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-06T21:26:50.920119] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-06T21:26:50.920409] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-06T21:26:50.920468] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-06T21:26:51.030689] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-06T21:26:51.281519] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:26:51.830697] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-06T21:26:51.853571] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T21:26:52.625531] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-06T21:26:52.852907] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T21:26:53.171477] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T21:26:53.425580] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-06T21:26:54.225556] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-06T21:26:54.584611] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T21:26:55.010177] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T21:26:55.025477] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-06T21:26:55.825550] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-06T21:26:55.950531] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T21:26:56.044312] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T21:26:56.625521] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-06T21:26:57.326045] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-06T21:26:57.425599] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-06T21:26:57.787514] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-06T21:26:58.225584] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-06T21:26:59.010387] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T21:26:59.025481] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-06T21:26:59.825551] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-06T21:26:59.864888] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-06T21:26:59.868481] [INFO ] [REMOTE ] SE: Full fetch complete (77081 records). [2025-10-06T21:26:59.868735] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-06T21:27:00.306012] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-06T21:27:00.306108] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-06T21:27:00.307756] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-06T21:27:00.307834] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-06T21:27:00.309870] [DEBUG] [LOCAL ] SE: Trimmed 77081 records to 53346 (keeping 200 days of data) [2025-10-06T21:27:00.633529] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-06T21:27:00.681804] [DEBUG] [LOCAL ] SE: Primary data saved (53346 records). [2025-10-06T21:27:00.682090] [INFO ] [MAIN ] SE: Full history saved. [2025-10-06T21:27:00.682220] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SE took 41.1s. Estimated remaining: 1h 7m 24s. Rate: 7.1 symbols/min [2025-10-06T21:27:00.859062] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:27:00.892427] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-06T21:27:00.938723] [DEBUG] [LOCAL ] SEMR: Loaded 42290 existing records from primary storage. [2025-10-06T21:27:00.939133] [INFO ] [MAIN ] SEMR: Loaded 42290 existing records. [2025-10-06T21:27:01.116235] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:27:01.116553] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-06T21:27:01.116710] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-06T21:27:01.116959] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-06T21:27:01.117019] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-06T21:27:01.430926] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-06T21:27:01.488295] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:27:01.701106] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-06T21:27:01.986601] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T21:27:02.225540] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-06T21:27:03.025516] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-06T21:27:03.124225] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T21:27:03.480238] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T21:27:03.825558] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-06T21:27:04.625558] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-06T21:27:04.901359] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-06T21:27:05.083817] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T21:27:05.087034] [INFO ] [REMOTE ] SEE: Full fetch complete (69759 records). [2025-10-06T21:27:05.087152] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-06T21:27:05.435782] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-06T21:27:05.500235] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-06T21:27:05.500466] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-06T21:27:05.502484] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-06T21:27:05.502566] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-06T21:27:05.504663] [DEBUG] [LOCAL ] SEE: Trimmed 69759 records to 48238 (keeping 200 days of data) [2025-10-06T21:27:05.821168] [DEBUG] [LOCAL ] SEE: Primary data saved (48238 records). [2025-10-06T21:27:05.821349] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-06T21:27:05.821450] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SEE took 45.9s. Estimated remaining: 1h 7m 15s. Rate: 7.1 symbols/min [2025-10-06T21:27:06.004419] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:27:06.062285] [DEBUG] [LOCAL ] SES: Loaded 52336 existing records from primary storage. [2025-10-06T21:27:06.062758] [INFO ] [MAIN ] SES: Loaded 52336 existing records. [2025-10-06T21:27:06.230774] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-06T21:27:06.264487] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:27:06.266016] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-06T21:27:06.266078] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-06T21:27:06.266325] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-06T21:27:06.266386] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-06T21:27:06.668527] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:27:06.702454] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-06T21:27:06.928135] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T21:27:07.025555] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-06T21:27:07.825518] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-06T21:27:08.084828] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T21:27:08.156879] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T21:27:08.625549] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-06T21:27:09.425515] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-06T21:27:09.883364] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-06T21:27:10.225580] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-06T21:27:10.449535] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T21:27:11.025612] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-06T21:27:11.224137] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T21:27:11.825550] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-06T21:27:12.603603] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T21:27:12.625479] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-06T21:27:12.824881] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-06T21:27:13.357774] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T21:27:13.360838] [INFO ] [REMOTE ] SEI: Full fetch complete (70036 records). [2025-10-06T21:27:13.361001] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-06T21:27:13.435047] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-06T21:27:13.762665] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-06T21:27:13.762826] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-06T21:27:13.764167] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-06T21:27:13.764255] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-06T21:27:13.766011] [DEBUG] [LOCAL ] SEI: Trimmed 70036 records to 49660 (keeping 200 days of data) [2025-10-06T21:27:14.083886] [DEBUG] [LOCAL ] SEI: Primary data saved (49660 records). [2025-10-06T21:27:14.084091] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-06T21:27:14.084190] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEI took 35.9s. Estimated remaining: 1h 7m 7s. Rate: 7.1 symbols/min [2025-10-06T21:27:14.227871] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-06T21:27:14.288959] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:27:14.292524] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T21:27:14.344394] [DEBUG] [LOCAL ] SF: Loaded 42143 existing records from primary storage. [2025-10-06T21:27:14.344782] [INFO ] [MAIN ] SF: Loaded 42143 existing records. [2025-10-06T21:27:14.527274] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:27:14.527799] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-06T21:27:14.527888] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-06T21:27:14.528201] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-06T21:27:14.528288] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-06T21:27:14.949711] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:27:14.973971] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-06T21:27:15.025524] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-06T21:27:15.825597] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-06T21:27:16.498858] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T21:27:16.605473] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-06T21:27:16.625468] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-06T21:27:17.260194] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T21:27:17.425588] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-06T21:27:18.225616] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-06T21:27:18.854034] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-06T21:27:18.923186] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T21:27:19.025533] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-06T21:27:19.358194] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T21:27:19.825549] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-06T21:27:20.625620] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-06T21:27:21.360696] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T21:27:21.399532] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-06T21:27:21.425468] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-06T21:27:22.076687] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T21:27:22.225513] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-06T21:27:23.025547] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-06T21:27:23.508943] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T21:27:23.511837] [INFO ] [REMOTE ] SEM: Full fetch complete (61500 records). [2025-10-06T21:27:23.511988] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-06T21:27:23.829431] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-06T21:27:23.913855] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-06T21:27:23.914149] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-06T21:27:23.915325] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-06T21:27:23.915408] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-06T21:27:23.927438] [DEBUG] [LOCAL ] SEM: Trimmed 61500 records to 42846 (keeping 200 days of data) [2025-10-06T21:27:23.947664] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-06T21:27:24.215842] [DEBUG] [LOCAL ] SEM: Primary data saved (42846 records). [2025-10-06T21:27:24.216016] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-06T21:27:24.216101] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEM took 33.7s. Estimated remaining: 1h 6m 58s. Rate: 7.1 symbols/min [2025-10-06T21:27:24.387383] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:27:24.394580] [DEBUG] [LOCAL ] SFB: Loaded 4170 existing records from primary storage. [2025-10-06T21:27:24.394837] [INFO ] [MAIN ] SFB: Loaded 4170 existing records. [2025-10-06T21:27:24.574851] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:27:24.575325] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-06T21:27:24.575412] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-06T21:27:24.575730] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-06T21:27:24.575795] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-06T21:27:24.633139] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-06T21:27:24.894669] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-06T21:27:24.981824] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:27:25.425593] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-06T21:27:25.555072] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T21:27:25.991438] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-06T21:27:26.225501] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-06T21:27:26.845098] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T21:27:26.925634] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-06T21:27:27.025498] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-06T21:27:27.825537] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-06T21:27:28.625600] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-06T21:27:29.111333] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-06T21:27:29.235454] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-06T21:27:29.322563] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T21:27:29.425505] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-06T21:27:30.034552] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T21:27:30.225577] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-06T21:27:31.025720] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-06T21:27:31.825723] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-06T21:27:31.890481] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T21:27:32.200328] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-06T21:27:32.625569] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-06T21:27:33.131126] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-06T21:27:33.425543] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-06T21:27:34.007621] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-06T21:27:34.186074] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T21:27:34.225511] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-06T21:27:35.025601] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-06T21:27:35.445244] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T21:27:35.448557] [INFO ] [REMOTE ] SEMR: Full fetch complete (59510 records). [2025-10-06T21:27:35.448752] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-06T21:27:35.828381] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-06T21:27:35.878215] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-06T21:27:35.878318] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-06T21:27:35.879781] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-06T21:27:35.879854] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-06T21:27:35.881359] [DEBUG] [LOCAL ] SEMR: Trimmed 59510 records to 41760 (keeping 200 days of data) [2025-10-06T21:27:36.131457] [DEBUG] [LOCAL ] SEMR: Primary data saved (41760 records). [2025-10-06T21:27:36.131632] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-06T21:27:36.131774] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEMR took 35.4s. Estimated remaining: 1h 6m 51s. Rate: 7.1 symbols/min [2025-10-06T21:27:36.309924] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:27:36.333832] [DEBUG] [LOCAL ] SFBS: Loaded 21398 existing records from primary storage. [2025-10-06T21:27:36.334225] [INFO ] [MAIN ] SFBS: Loaded 21398 existing records. [2025-10-06T21:27:36.523125] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:27:36.523623] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-06T21:27:36.523737] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-06T21:27:36.524187] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-06T21:27:36.524254] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-06T21:27:36.631922] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-06T21:27:36.963635] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T21:27:36.985588] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:27:37.369530] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T21:27:37.425627] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-06T21:27:38.006288] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-06T21:27:38.165852] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-06T21:27:38.225531] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-06T21:27:39.025579] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-06T21:27:39.825515] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-06T21:27:40.066357] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T21:27:40.135226] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-06T21:27:40.139388] [INFO ] [REMOTE ] SES: Full fetch complete (75374 records). [2025-10-06T21:27:40.139618] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-06T21:27:40.629023] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-06T21:27:40.649128] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-06T21:27:40.649282] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-06T21:27:40.650819] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-06T21:27:40.651080] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-06T21:27:40.652816] [DEBUG] [LOCAL ] SES: Trimmed 75374 records to 51560 (keeping 200 days of data) [2025-10-06T21:27:40.960279] [DEBUG] [LOCAL ] SES: Primary data saved (51560 records). [2025-10-06T21:27:40.960485] [INFO ] [MAIN ] SES: Full history saved. [2025-10-06T21:27:40.960607] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SES took 35.1s. Estimated remaining: 1h 6m 42s. Rate: 7.1 symbols/min [2025-10-06T21:27:41.133921] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:27:41.134280] [DEBUG] [LOCAL ] SFL: No existing data file found in primary storage. [2025-10-06T21:27:41.134392] [WARN ] [MAIN ] SFL: No existing data found, performing full refresh instead. [2025-10-06T21:27:41.134815] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-06T21:27:41.134879] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-06T21:27:41.134974] [DEBUG] [LOCAL ] SFL: No primary data file found to delete. [2025-10-06T21:27:41.135037] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-06T21:27:41.337016] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T21:27:41.428883] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-06T21:27:41.545252] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:27:41.788049] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T21:27:42.147494] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T21:27:42.225597] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-06T21:27:43.025535] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-06T21:27:43.268854] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T21:27:43.825535] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-06T21:27:44.514704] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T21:27:44.625571] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-06T21:27:44.983758] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-06T21:27:45.425634] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-06T21:27:46.164477] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T21:27:46.225498] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-06T21:27:46.691027] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T21:27:46.874072] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-06T21:27:47.025535] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-06T21:27:47.825568] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-06T21:27:48.075024] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T21:27:48.246389] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-06T21:27:48.247446] [INFO ] [REMOTE ] SFB: Full fetch complete (5824 records). [2025-10-06T21:27:48.247564] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-06T21:27:48.632431] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-06T21:27:48.631983] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-06T21:27:48.632703] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-06T21:27:48.633040] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-06T21:27:48.633119] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-06T21:27:48.634934] [DEBUG] [LOCAL ] SFB: Trimmed 5824 records to 4152 (keeping 200 days of data) [2025-10-06T21:27:48.663469] [DEBUG] [LOCAL ] SFB: Primary data saved (4152 records). [2025-10-06T21:27:48.663621] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-06T21:27:48.663764] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SFB took 24.4s. Estimated remaining: 1h 6m 33s. Rate: 7.1 symbols/min [2025-10-06T21:27:48.840757] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:27:48.901306] [DEBUG] [LOCAL ] SG: Loaded 54228 existing records from primary storage. [2025-10-06T21:27:48.901782] [INFO ] [MAIN ] SG: Loaded 54228 existing records. [2025-10-06T21:27:49.080892] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:27:49.081192] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-06T21:27:49.081250] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-06T21:27:49.081625] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-06T21:27:49.081725] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-06T21:27:49.431906] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:27:49.432045] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-06T21:27:49.799272] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T21:27:50.225596] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-06T21:27:50.915137] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T21:27:51.025588] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-06T21:27:51.313038] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T21:27:51.825571] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-06T21:27:52.625562] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-06T21:27:52.894633] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-06T21:27:53.408756] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T21:27:53.425475] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-06T21:27:53.743008] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T21:27:54.225604] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-06T21:27:55.018533] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T21:27:55.026516] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-06T21:27:55.623477] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-06T21:27:55.825502] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-06T21:27:56.231763] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T21:27:56.234453] [INFO ] [REMOTE ] SF: Full fetch complete (59981 records). [2025-10-06T21:27:56.234550] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-06T21:27:56.627701] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-06T21:27:56.629577] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-06T21:27:56.629729] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-06T21:27:56.631172] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-06T21:27:56.631390] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-06T21:27:56.633224] [DEBUG] [LOCAL ] SF: Trimmed 59981 records to 41566 (keeping 200 days of data) [2025-10-06T21:27:56.913823] [DEBUG] [LOCAL ] SF: Primary data saved (41566 records). [2025-10-06T21:27:56.913978] [INFO ] [MAIN ] SF: Full history saved. [2025-10-06T21:27:56.914075] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SF took 42.8s. Estimated remaining: 1h 6m 24s. Rate: 7.1 symbols/min [2025-10-06T21:27:57.105839] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:27:57.152422] [DEBUG] [LOCAL ] SGHC: Loaded 46831 existing records from primary storage. [2025-10-06T21:27:57.152874] [INFO ] [MAIN ] SGHC: Loaded 46831 existing records. [2025-10-06T21:27:57.338541] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:27:57.338914] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-06T21:27:57.339001] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-06T21:27:57.339342] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-06T21:27:57.339406] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-06T21:27:57.435544] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-06T21:27:57.739364] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T21:27:57.762668] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:27:58.225637] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-06T21:27:58.532468] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-06T21:27:58.593713] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-06T21:27:59.025584] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-06T21:27:59.825551] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-06T21:27:59.991266] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T21:28:00.130938] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-06T21:28:00.625548] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-06T21:28:01.378741] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T21:28:01.423545] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T21:28:01.425304] [INFO ] [REMOTE ] SFBS: Full fetch complete (30347 records). [2025-10-06T21:28:01.425391] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-06T21:28:01.425484] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-06T21:28:01.811291] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-06T21:28:01.811401] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-06T21:28:01.812231] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-06T21:28:01.812297] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-06T21:28:01.813229] [DEBUG] [LOCAL ] SFBS: Trimmed 30347 records to 21134 (keeping 200 days of data) [2025-10-06T21:28:01.959172] [DEBUG] [LOCAL ] SFBS: Primary data saved (21134 records). [2025-10-06T21:28:01.959338] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-06T21:28:01.959425] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SFBS took 25.8s. Estimated remaining: 1h 6m 15s. Rate: 7.1 symbols/min [2025-10-06T21:28:02.126508] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:28:02.126751] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-06T21:28:02.126797] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-06T21:28:02.126910] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-06T21:28:02.126952] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-06T21:28:02.126992] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-06T21:28:02.127025] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-06T21:28:02.230736] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-06T21:28:02.512659] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:28:02.968641] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T21:28:03.025507] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-06T21:28:03.244085] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:28:03.244510] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-06T21:28:03.244605] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:28:03.244691] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-06T21:28:03.244745] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:28:03.244789] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-06T21:28:03.244856] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-06T21:28:03.244893] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-06T21:28:03.244959] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-06T21:28:03.245040] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SGI took 1.3s. Estimated remaining: 1h 6m 5s. Rate: 7.1 symbols/min [2025-10-06T21:28:03.423985] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:28:03.434915] [DEBUG] [LOCAL ] SGU: Loaded 6770 existing records from primary storage. [2025-10-06T21:28:03.435195] [INFO ] [MAIN ] SGU: Loaded 6770 existing records. [2025-10-06T21:28:03.634784] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:28:03.635416] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-06T21:28:03.635479] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-06T21:28:03.635977] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-06T21:28:03.636040] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-06T21:28:03.827615] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-06T21:28:04.045437] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:28:04.051435] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T21:28:04.625537] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-06T21:28:05.250119] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T21:28:05.425557] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-06T21:28:06.225611] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-06T21:28:06.350547] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T21:28:06.933211] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T21:28:07.025585] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-06T21:28:07.626715] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-06T21:28:07.811627] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T21:28:07.825472] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-06T21:28:08.625567] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-06T21:28:09.317141] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-06T21:28:09.425561] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-06T21:28:09.724428] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T21:28:09.813856] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-06T21:28:10.225551] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-06T21:28:11.025545] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-06T21:28:11.659616] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-06T21:28:11.825554] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-06T21:28:12.152278] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-06T21:28:12.625593] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-06T21:28:13.330909] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T21:28:13.425541] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-06T21:28:14.221474] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T21:28:14.230238] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-06T21:28:15.025521] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-06T21:28:15.075910] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-06T21:28:15.133430] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T21:28:15.825556] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-06T21:28:16.582493] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T21:28:16.625560] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-06T21:28:17.247821] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-06T21:28:17.425556] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-06T21:28:17.853564] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-06T21:28:18.225538] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-06T21:28:18.892057] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T21:28:19.025498] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-06T21:28:19.129831] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T21:28:19.825555] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-06T21:28:20.625555] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-06T21:28:20.946715] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-06T21:28:21.069156] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T21:28:21.425576] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-06T21:28:22.204415] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-06T21:28:22.225479] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-06T21:28:23.025495] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-06T21:28:23.453105] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-06T21:28:23.474205] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T21:28:23.477189] [INFO ] [REMOTE ] SFL: Full fetch complete (65623 records). [2025-10-06T21:28:23.477337] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-06T21:28:23.837559] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-06T21:28:23.860184] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-06T21:28:23.860296] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-06T21:28:23.861678] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-06T21:28:23.861749] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-06T21:28:23.863526] [DEBUG] [LOCAL ] SFL: Trimmed 65623 records to 45117 (keeping 200 days of data) [2025-10-06T21:28:24.145633] [DEBUG] [LOCAL ] SFL: Primary data saved (45117 records). [2025-10-06T21:28:24.146121] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-06T21:28:24.146245] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SFL took 43.2s. Estimated remaining: 1h 5m 59s. Rate: 7.1 symbols/min [2025-10-06T21:28:24.323199] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:28:24.360085] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-06T21:28:24.405219] [DEBUG] [LOCAL ] SHAK: Loaded 49652 existing records from primary storage. [2025-10-06T21:28:24.405627] [INFO ] [MAIN ] SHAK: Loaded 49652 existing records. [2025-10-06T21:28:24.591488] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:28:24.591855] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-06T21:28:24.591915] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-06T21:28:24.592512] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-06T21:28:24.592574] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-06T21:28:24.635398] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-06T21:28:24.988550] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:28:25.425541] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-06T21:28:25.475440] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T21:28:25.578052] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-06T21:28:25.582858] [INFO ] [REMOTE ] SG: Full fetch complete (77303 records). [2025-10-06T21:28:25.583047] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-06T21:28:25.994211] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-06T21:28:25.994337] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-06T21:28:25.996010] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-06T21:28:25.996124] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-06T21:28:25.998446] [DEBUG] [LOCAL ] SG: Trimmed 77303 records to 53460 (keeping 200 days of data) [2025-10-06T21:28:26.225612] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-06T21:28:26.344479] [DEBUG] [LOCAL ] SG: Primary data saved (53460 records). [2025-10-06T21:28:26.344729] [INFO ] [MAIN ] SG: Full history saved. [2025-10-06T21:28:26.346178] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SG took 37.7s. Estimated remaining: 1h 5m 49s. Rate: 7.1 symbols/min [2025-10-06T21:28:26.531008] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:28:26.562211] [DEBUG] [LOCAL ] SHCO: Loaded 26144 existing records from primary storage. [2025-10-06T21:28:26.562536] [INFO ] [MAIN ] SHCO: Loaded 26144 existing records. [2025-10-06T21:28:26.761142] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:28:26.761406] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-06T21:28:26.761459] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-06T21:28:26.761731] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-06T21:28:26.761793] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-06T21:28:27.032178] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-06T21:28:27.069773] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T21:28:27.175199] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:28:27.283254] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T21:28:27.825594] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-06T21:28:28.589276] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T21:28:28.625490] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-06T21:28:28.934838] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-06T21:28:29.425594] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-06T21:28:30.225568] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-06T21:28:30.305609] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T21:28:30.561486] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T21:28:31.025604] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-06T21:28:31.733918] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-06T21:28:31.825530] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-06T21:28:31.869033] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T21:28:32.625691] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-06T21:28:32.929146] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T21:28:33.022527] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-06T21:28:33.023870] [INFO ] [REMOTE ] SGU: Full fetch complete (9014 records). [2025-10-06T21:28:33.023950] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-06T21:28:33.431190] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-06T21:28:33.440625] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-06T21:28:33.440763] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-06T21:28:33.441189] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-06T21:28:33.441258] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-06T21:28:33.441825] [DEBUG] [LOCAL ] SGU: Trimmed 9014 records to 6656 (keeping 200 days of data) [2025-10-06T21:28:33.490417] [DEBUG] [LOCAL ] SGU: Primary data saved (6656 records). [2025-10-06T21:28:33.490632] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-06T21:28:33.490793] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SGU took 30.2s. Estimated remaining: 1h 5m 41s. Rate: 7.1 symbols/min [2025-10-06T21:28:33.687740] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:28:33.747382] [DEBUG] [LOCAL ] SHEL: Loaded 54451 existing records from primary storage. [2025-10-06T21:28:33.747834] [INFO ] [MAIN ] SHEL: Loaded 54451 existing records. [2025-10-06T21:28:33.935952] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:28:33.936362] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-06T21:28:33.936428] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-06T21:28:33.936735] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-06T21:28:33.936795] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-06T21:28:34.232119] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-06T21:28:34.321909] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:28:35.025554] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-06T21:28:35.383120] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-06T21:28:35.825542] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-06T21:28:36.047315] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T21:28:36.625565] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-06T21:28:37.047106] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-06T21:28:37.133947] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T21:28:37.425560] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-06T21:28:37.946316] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T21:28:38.225554] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-06T21:28:39.025482] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-06T21:28:39.293614] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T21:28:39.347196] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T21:28:39.825574] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-06T21:28:40.395847] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T21:28:40.398906] [INFO ] [REMOTE ] SGHC: Full fetch complete (63993 records). [2025-10-06T21:28:40.399091] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-06T21:28:40.630724] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-06T21:28:40.783245] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-06T21:28:40.783426] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-06T21:28:40.784747] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-06T21:28:40.784876] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-06T21:28:40.786608] [DEBUG] [LOCAL ] SGHC: Trimmed 63993 records to 46270 (keeping 200 days of data) [2025-10-06T21:28:41.064130] [DEBUG] [LOCAL ] SGHC: Primary data saved (46270 records). [2025-10-06T21:28:41.064305] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-06T21:28:41.064398] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SGHC took 44.2s. Estimated remaining: 1h 5m 32s. Rate: 7.1 symbols/min [2025-10-06T21:28:41.231159] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:28:41.259083] [DEBUG] [LOCAL ] SHG: Loaded 26900 existing records from primary storage. [2025-10-06T21:28:41.259420] [INFO ] [MAIN ] SHG: Loaded 26900 existing records. [2025-10-06T21:28:41.431046] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-06T21:28:41.436308] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:28:41.436917] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-06T21:28:41.437690] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-06T21:28:41.438000] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-06T21:28:41.438059] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-06T21:28:41.840589] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:28:41.868567] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T21:28:41.898425] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-06T21:28:42.225618] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-06T21:28:43.025595] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-06T21:28:43.462901] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-06T21:28:43.597268] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T21:28:43.700015] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T21:28:43.825555] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-06T21:28:44.625566] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-06T21:28:44.728324] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-06T21:28:45.425513] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-06T21:28:46.225504] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-06T21:28:46.444196] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T21:28:47.025695] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-06T21:28:47.474510] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T21:28:47.714285] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-06T21:28:47.825549] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-06T21:28:48.428567] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T21:28:48.625528] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-06T21:28:48.861177] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T21:28:49.425552] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-06T21:28:50.031746] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T21:28:50.225575] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-06T21:28:51.025511] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-06T21:28:51.556592] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-06T21:28:51.825600] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-06T21:28:51.933824] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-06T21:28:51.969885] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-06T21:28:52.625539] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-06T21:28:53.425509] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-06T21:28:53.803534] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-06T21:28:53.972317] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-06T21:28:54.225530] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-06T21:28:55.025531] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-06T21:28:55.062857] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T21:28:55.560514] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T21:28:55.825546] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-06T21:28:55.897612] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T21:28:55.899530] [INFO ] [REMOTE ] SHCO: Full fetch complete (37978 records). [2025-10-06T21:28:55.899618] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-06T21:28:56.267391] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-06T21:28:56.267509] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-06T21:28:56.268701] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-06T21:28:56.268766] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-06T21:28:56.269723] [DEBUG] [LOCAL ] SHCO: Trimmed 37978 records to 25527 (keeping 200 days of data) [2025-10-06T21:28:56.414112] [DEBUG] [LOCAL ] SHCO: Primary data saved (25527 records). [2025-10-06T21:28:56.414286] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-06T21:28:56.414380] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SHCO took 30.1s. Estimated remaining: 1h 5m 25s. Rate: 7.1 symbols/min [2025-10-06T21:28:56.580517] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:28:56.628861] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-06T21:28:56.631171] [DEBUG] [LOCAL ] SHO: Loaded 50371 existing records from primary storage. [2025-10-06T21:28:56.631536] [INFO ] [MAIN ] SHO: Loaded 50371 existing records. [2025-10-06T21:28:56.810262] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:28:56.810515] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-06T21:28:56.810563] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-06T21:28:56.810854] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-06T21:28:56.810913] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-06T21:28:57.135778] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T21:28:57.202018] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:28:57.425558] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-06T21:28:58.225570] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-06T21:28:58.526623] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T21:28:58.675765] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T21:28:59.025578] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-06T21:28:59.103051] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T21:28:59.825551] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-06T21:29:00.625570] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-06T21:29:01.099286] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-06T21:29:01.218318] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-06T21:29:01.221223] [INFO ] [REMOTE ] SHAK: Full fetch complete (70583 records). [2025-10-06T21:29:01.221333] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-06T21:29:01.432208] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-06T21:29:01.670973] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-06T21:29:01.671147] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-06T21:29:01.672942] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-06T21:29:01.673035] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-06T21:29:01.682772] [DEBUG] [LOCAL ] SHAK: Trimmed 70583 records to 48933 (keeping 200 days of data) [2025-10-06T21:29:01.700724] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T21:29:02.019462] [DEBUG] [LOCAL ] SHAK: Primary data saved (48933 records). [2025-10-06T21:29:02.019629] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-06T21:29:02.019766] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHAK took 37.9s. Estimated remaining: 1h 5m 16s. Rate: 7.1 symbols/min [2025-10-06T21:29:02.194431] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:29:02.201796] [DEBUG] [LOCAL ] SHOC: Loaded 3520 existing records from primary storage. [2025-10-06T21:29:02.202055] [INFO ] [MAIN ] SHOC: Loaded 3520 existing records. [2025-10-06T21:29:02.233427] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-06T21:29:02.398772] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:29:02.399068] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-06T21:29:02.399127] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-06T21:29:02.399307] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-06T21:29:02.399367] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-06T21:29:02.759844] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:29:03.025592] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-06T21:29:03.319706] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-06T21:29:03.820556] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T21:29:03.829725] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-06T21:29:03.877484] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-06T21:29:04.625569] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-06T21:29:05.425497] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-06T21:29:05.747794] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T21:29:05.889632] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-06T21:29:06.225558] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-06T21:29:07.025561] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-06T21:29:07.429334] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-06T21:29:07.774558] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-06T21:29:07.825573] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-06T21:29:08.402604] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-06T21:29:08.597249] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T21:29:08.625581] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-06T21:29:09.358962] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T21:29:09.425683] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-06T21:29:10.100077] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-06T21:29:10.225538] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-06T21:29:11.025588] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-06T21:29:11.825540] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-06T21:29:12.003965] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-06T21:29:12.007213] [INFO ] [REMOTE ] SHEL: Full fetch complete (77694 records). [2025-10-06T21:29:12.007364] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-06T21:29:12.413262] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-06T21:29:12.413412] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-06T21:29:12.415042] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-06T21:29:12.415210] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-06T21:29:12.416956] [DEBUG] [LOCAL ] SHEL: Trimmed 77694 records to 53672 (keeping 200 days of data) [2025-10-06T21:29:12.644454] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-06T21:29:12.688734] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T21:29:12.720928] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T21:29:12.724821] [INFO ] [REMOTE ] SHG: Full fetch complete (40989 records). [2025-10-06T21:29:12.725439] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-06T21:29:13.195617] [DEBUG] [LOCAL ] SHEL: Primary data saved (53672 records). [2025-10-06T21:29:13.201668] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-06T21:29:13.201822] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHEL took 39.7s. Estimated remaining: 1h 5m 8s. Rate: 7.1 symbols/min [2025-10-06T21:29:13.417815] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-06T21:29:13.428961] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-06T21:29:13.428867] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-06T21:29:13.430686] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-06T21:29:13.447594] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-06T21:29:13.503130] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:29:13.504496] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T21:29:13.504733] [DEBUG] [LOCAL ] SHG: Trimmed 40989 records to 26257 (keeping 200 days of data) [2025-10-06T21:29:13.693073] [DEBUG] [LOCAL ] SHW: Loaded 51050 existing records from primary storage. [2025-10-06T21:29:13.694430] [INFO ] [MAIN ] SHW: Loaded 51050 existing records. [2025-10-06T21:29:13.818393] [DEBUG] [LOCAL ] SHG: Primary data saved (26257 records). [2025-10-06T21:29:13.828883] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-06T21:29:13.841972] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SHG took 32.8s. Estimated remaining: 1h 4m 58s. Rate: 7.1 symbols/min [2025-10-06T21:29:13.952494] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:29:13.987288] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-06T21:29:13.989566] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-06T21:29:13.989903] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-06T21:29:14.000424] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-06T21:29:14.159562] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:29:14.159805] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-06T21:29:14.159878] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-06T21:29:14.160034] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-06T21:29:14.165703] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-06T21:29:14.181127] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-06T21:29:14.186312] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-06T21:29:14.230599] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-06T21:29:14.678511] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:29:14.788228] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:29:14.886448] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-06T21:29:15.025499] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-06T21:29:15.126701] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T21:29:15.825538] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-06T21:29:16.038994] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:29:16.039426] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-06T21:29:16.039521] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:29:16.039568] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-06T21:29:16.039628] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:29:16.039720] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-06T21:29:16.039821] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-06T21:29:16.039888] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-06T21:29:16.039950] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-06T21:29:16.040021] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SI took 2.2s. Estimated remaining: 1h 4m 48s. Rate: 7.1 symbols/min [2025-10-06T21:29:16.204713] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:29:16.245364] [DEBUG] [LOCAL ] SID: Loaded 42878 existing records from primary storage. [2025-10-06T21:29:16.245755] [INFO ] [MAIN ] SID: Loaded 42878 existing records. [2025-10-06T21:29:16.420686] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:29:16.420974] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-06T21:29:16.421084] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-06T21:29:16.421317] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-06T21:29:16.421373] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-06T21:29:16.630756] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-06T21:29:16.784817] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:29:16.852764] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T21:29:17.288906] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-06T21:29:17.425544] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-06T21:29:18.225552] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-06T21:29:19.025606] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-06T21:29:19.158696] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T21:29:19.830607] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-06T21:29:19.843300] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T21:29:20.406836] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-06T21:29:20.625538] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-06T21:29:20.694402] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T21:29:21.425539] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-06T21:29:21.991729] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-06T21:29:22.230679] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-06T21:29:22.247006] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T21:29:23.025699] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-06T21:29:23.825501] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-06T21:29:23.895229] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T21:29:24.625585] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-06T21:29:24.932506] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T21:29:25.128963] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-06T21:29:25.181020] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-06T21:29:25.425633] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-06T21:29:26.225812] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-06T21:29:26.621081] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-06T21:29:26.622278] [INFO ] [REMOTE ] SHOC: Full fetch complete (7246 records). [2025-10-06T21:29:26.622362] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-06T21:29:26.988217] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-06T21:29:26.988389] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-06T21:29:26.988687] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-06T21:29:26.988751] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-06T21:29:26.989146] [DEBUG] [LOCAL ] SHOC: Trimmed 7246 records to 3381 (keeping 200 days of data) [2025-10-06T21:29:27.010571] [DEBUG] [LOCAL ] SHOC: Primary data saved (3381 records). [2025-10-06T21:29:27.010708] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-06T21:29:27.010821] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SHOC took 25.0s. Estimated remaining: 1h 4m 40s. Rate: 7.1 symbols/min [2025-10-06T21:29:27.031193] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-06T21:29:27.186942] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:29:27.243498] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T21:29:27.270381] [DEBUG] [LOCAL ] SIG: Loaded 46801 existing records from primary storage. [2025-10-06T21:29:27.270806] [INFO ] [MAIN ] SIG: Loaded 46801 existing records. [2025-10-06T21:29:27.446203] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:29:27.446562] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-06T21:29:27.446614] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-06T21:29:27.447006] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-06T21:29:27.447065] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-06T21:29:27.830063] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-06T21:29:27.834566] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:29:28.625541] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-06T21:29:28.763282] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T21:29:29.403004] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T21:29:29.425479] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-06T21:29:30.225504] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-06T21:29:30.473948] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-06T21:29:30.949673] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T21:29:31.025471] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-06T21:29:31.456594] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T21:29:31.825531] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-06T21:29:32.636756] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-06T21:29:32.640584] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T21:29:33.425542] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-06T21:29:33.493842] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T21:29:34.165610] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T21:29:34.225499] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-06T21:29:34.824144] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T21:29:35.025569] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-06T21:29:35.825513] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-06T21:29:35.949704] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T21:29:36.362124] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-06T21:29:36.625555] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-06T21:29:37.087972] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T21:29:37.090857] [INFO ] [REMOTE ] SHO: Full fetch complete (71022 records). [2025-10-06T21:29:37.090999] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-06T21:29:37.435962] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-06T21:29:37.496957] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-06T21:29:37.497052] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-06T21:29:37.498790] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-06T21:29:37.498882] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-06T21:29:37.501180] [DEBUG] [LOCAL ] SHO: Trimmed 71022 records to 49635 (keeping 200 days of data) [2025-10-06T21:29:37.841724] [DEBUG] [LOCAL ] SHO: Primary data saved (49635 records). [2025-10-06T21:29:37.841941] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-06T21:29:37.842089] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHO took 41.4s. Estimated remaining: 1h 4m 32s. Rate: 7.1 symbols/min [2025-10-06T21:29:38.028502] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:29:38.057448] [DEBUG] [LOCAL ] SII: Loaded 23889 existing records from primary storage. [2025-10-06T21:29:38.057900] [INFO ] [MAIN ] SII: Loaded 23889 existing records. [2025-10-06T21:29:38.226924] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-06T21:29:38.310255] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:29:38.311121] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-06T21:29:38.311564] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-06T21:29:38.322272] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-06T21:29:38.322377] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-06T21:29:38.426475] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T21:29:38.750570] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:29:39.025604] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-06T21:29:39.150559] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T21:29:39.825520] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-06T21:29:39.923158] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T21:29:40.144824] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T21:29:40.625563] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-06T21:29:41.425618] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-06T21:29:41.429288] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T21:29:42.225561] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-06T21:29:42.591426] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-06T21:29:42.629891] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T21:29:43.025576] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-06T21:29:43.050103] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T21:29:43.825555] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-06T21:29:43.946676] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T21:29:43.949466] [INFO ] [REMOTE ] SID: Full fetch complete (60801 records). [2025-10-06T21:29:43.949590] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-06T21:29:44.338290] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-06T21:29:44.338399] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-06T21:29:44.343050] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-06T21:29:44.343121] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-06T21:29:44.344672] [DEBUG] [LOCAL ] SID: Trimmed 60801 records to 42284 (keeping 200 days of data) [2025-10-06T21:29:44.465172] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-06T21:29:44.611024] [DEBUG] [LOCAL ] SID: Primary data saved (42284 records). [2025-10-06T21:29:44.611278] [INFO ] [MAIN ] SID: Full history saved. [2025-10-06T21:29:44.611386] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SID took 28.6s. Estimated remaining: 1h 4m 23s. Rate: 7.1 symbols/min [2025-10-06T21:29:44.633410] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-06T21:29:44.786742] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:29:44.818244] [DEBUG] [LOCAL ] SILA: Loaded 31215 existing records from primary storage. [2025-10-06T21:29:44.818620] [INFO ] [MAIN ] SILA: Loaded 31215 existing records. [2025-10-06T21:29:44.994229] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:29:44.994536] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-06T21:29:44.994587] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-06T21:29:44.994805] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-06T21:29:44.994863] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-06T21:29:45.387245] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:29:45.425571] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-06T21:29:46.225558] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-06T21:29:46.453276] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T21:29:46.613860] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-06T21:29:47.025608] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-06T21:29:47.825539] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-06T21:29:47.937354] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T21:29:48.328197] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T21:29:48.625610] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-06T21:29:48.754409] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T21:29:49.425538] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-06T21:29:50.210606] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T21:29:50.225474] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-06T21:29:51.025563] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-06T21:29:51.196683] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T21:29:51.832148] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-06T21:29:51.853025] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T21:29:52.113313] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-06T21:29:52.625546] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-06T21:29:53.287598] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T21:29:53.290741] [INFO ] [REMOTE ] SHW: Full fetch complete (73008 records). [2025-10-06T21:29:53.290879] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-06T21:29:53.430684] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-06T21:29:53.699070] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-06T21:29:53.699197] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-06T21:29:53.700551] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-06T21:29:53.700861] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-06T21:29:53.722552] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T21:29:53.724722] [DEBUG] [LOCAL ] SHW: Trimmed 73008 records to 50294 (keeping 200 days of data) [2025-10-06T21:29:54.047625] [DEBUG] [LOCAL ] SHW: Primary data saved (50294 records). [2025-10-06T21:29:54.047856] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-06T21:29:54.047956] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SHW took 40.8s. Estimated remaining: 1h 4m 15s. Rate: 7.1 symbols/min [2025-10-06T21:29:54.219312] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:29:54.225557] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-06T21:29:54.260927] [DEBUG] [LOCAL ] SITC: Loaded 42184 existing records from primary storage. [2025-10-06T21:29:54.261320] [INFO ] [MAIN ] SITC: Loaded 42184 existing records. [2025-10-06T21:29:54.438671] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:29:54.438982] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-06T21:29:54.439060] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-06T21:29:54.439320] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-06T21:29:54.439397] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-06T21:29:54.787713] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:29:55.025513] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-06T21:29:55.148709] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T21:29:55.208630] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T21:29:55.825576] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-06T21:29:56.576033] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T21:29:56.625480] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-06T21:29:56.907434] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T21:29:57.425541] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-06T21:29:58.116683] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T21:29:58.225495] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-06T21:29:58.530458] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-06T21:29:59.025548] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-06T21:29:59.612137] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T21:29:59.825491] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-06T21:30:00.216734] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T21:30:00.625581] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-06T21:30:01.245908] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-06T21:30:01.425595] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-06T21:30:02.225520] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-06T21:30:02.323243] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T21:30:02.925342] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T21:30:03.025495] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-06T21:30:03.181369] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T21:30:03.183102] [INFO ] [REMOTE ] SII: Full fetch complete (30339 records). [2025-10-06T21:30:03.183179] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-06T21:30:03.572921] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-06T21:30:03.573107] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-06T21:30:03.573923] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-06T21:30:03.573987] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-06T21:30:03.574829] [DEBUG] [LOCAL ] SII: Trimmed 30339 records to 23694 (keeping 200 days of data) [2025-10-06T21:30:03.720767] [DEBUG] [LOCAL ] SII: Primary data saved (23694 records). [2025-10-06T21:30:03.720932] [INFO ] [MAIN ] SII: Full history saved. [2025-10-06T21:30:03.721019] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SII took 25.9s. Estimated remaining: 1h 4m 7s. Rate: 7.1 symbols/min [2025-10-06T21:30:03.830738] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-06T21:30:03.896020] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:30:03.933097] [DEBUG] [LOCAL ] SITE: Loaded 35569 existing records from primary storage. [2025-10-06T21:30:03.933399] [INFO ] [MAIN ] SITE: Loaded 35569 existing records. [2025-10-06T21:30:04.113867] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:30:04.114148] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-06T21:30:04.114196] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-06T21:30:04.114463] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-06T21:30:04.114521] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-06T21:30:04.496927] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:30:04.561989] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-06T21:30:04.625551] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-06T21:30:05.425569] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-06T21:30:05.594444] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T21:30:05.994882] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T21:30:06.225562] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-06T21:30:06.408740] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T21:30:07.025543] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-06T21:30:07.639877] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T21:30:07.825552] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-06T21:30:08.260378] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T21:30:08.625546] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-06T21:30:09.385238] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T21:30:09.425528] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-06T21:30:09.820305] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-06T21:30:10.225547] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-06T21:30:11.025598] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-06T21:30:11.082513] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T21:30:11.654220] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-06T21:30:11.825562] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-06T21:30:12.617489] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T21:30:12.627927] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-06T21:30:13.425537] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-06T21:30:13.490612] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T21:30:14.041141] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T21:30:14.225522] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-06T21:30:15.033303] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-06T21:30:15.038002] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-06T21:30:15.075893] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T21:30:15.825581] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-06T21:30:16.625519] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-06T21:30:16.783197] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T21:30:17.411630] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T21:30:17.425478] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-06T21:30:17.870221] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-06T21:30:18.225614] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-06T21:30:18.873780] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T21:30:19.025503] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-06T21:30:19.505335] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T21:30:19.508038] [INFO ] [REMOTE ] SIG: Full fetch complete (67964 records). [2025-10-06T21:30:19.508161] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-06T21:30:19.830792] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-06T21:30:19.910868] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-06T21:30:19.910990] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-06T21:30:19.912446] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-06T21:30:19.912531] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-06T21:30:19.914076] [DEBUG] [LOCAL ] SIG: Trimmed 67964 records to 45999 (keeping 200 days of data) [2025-10-06T21:30:20.204143] [DEBUG] [LOCAL ] SIG: Primary data saved (45999 records). [2025-10-06T21:30:20.204404] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-06T21:30:20.204519] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SIG took 53.2s. Estimated remaining: 1h 4m 0s. Rate: 7.1 symbols/min [2025-10-06T21:30:20.430214] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T21:30:20.625608] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-06T21:30:20.895853] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T21:30:20.897927] [INFO ] [REMOTE ] SILA: Full fetch complete (44843 records). [2025-10-06T21:30:20.898074] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-06T21:30:21.281576] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-06T21:30:21.281726] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-06T21:30:21.282742] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-06T21:30:21.282812] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-06T21:30:21.283994] [DEBUG] [LOCAL ] SILA: Trimmed 44843 records to 30652 (keeping 200 days of data) [2025-10-06T21:30:21.431023] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-06T21:30:21.471458] [DEBUG] [LOCAL ] SILA: Primary data saved (30652 records). [2025-10-06T21:30:21.471701] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-06T21:30:21.471815] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SILA took 36.9s. Estimated remaining: 1h 3m 50s. Rate: 7.1 symbols/min [2025-10-06T21:30:22.138512] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T21:30:22.225477] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-06T21:30:23.013586] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T21:30:23.025481] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-06T21:30:23.604698] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T21:30:23.825524] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-06T21:30:24.653070] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T21:30:24.663120] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-06T21:30:24.859720] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-06T21:30:25.425589] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-06T21:30:25.880380] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T21:30:25.883245] [INFO ] [REMOTE ] SITC: Full fetch complete (60783 records). [2025-10-06T21:30:25.883394] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-06T21:30:26.284248] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-06T21:30:26.284604] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-06T21:30:26.285773] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-06T21:30:26.285839] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-06T21:30:26.287425] [DEBUG] [LOCAL ] SITC: Trimmed 60783 records to 41598 (keeping 200 days of data) [2025-10-06T21:30:26.542878] [DEBUG] [LOCAL ] SITC: Primary data saved (41598 records). [2025-10-06T21:30:26.543524] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-06T21:30:26.543845] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-06T21:30:26.543620] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SITC took 32.5s. Estimated remaining: 1h 3m 41s. Rate: 7.1 symbols/min [2025-10-06T21:30:26.546671] [INFO ] [REMOTE ] SITE: Full fetch complete (49851 records). [2025-10-06T21:30:26.546751] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-06T21:30:26.922052] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-06T21:30:26.922168] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-06T21:30:26.923191] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-06T21:30:26.923261] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-06T21:30:26.924576] [DEBUG] [LOCAL ] SITE: Trimmed 49851 records to 35180 (keeping 200 days of data) [2025-10-06T21:30:27.142900] [DEBUG] [LOCAL ] SITE: Primary data saved (35180 records). [2025-10-06T21:30:27.143095] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-06T21:30:27.143290] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITE took 23.4s. Estimated remaining: 1h 3m 31s. Rate: 7.1 symbols/min [2025-10-06T21:30:27.889317] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:30:27.832108] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:30:27.962275] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:30:27.966848] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:30:27.980186] [DEBUG] [LOCAL ] SKIL: Loaded 6547 existing records from primary storage. [2025-10-06T21:30:27.980626] [INFO ] [MAIN ] SKIL: Loaded 6547 existing records. [2025-10-06T21:30:28.167776] [DEBUG] [LOCAL ] SJT: Loaded 22695 existing records from primary storage. [2025-10-06T21:30:28.191615] [INFO ] [MAIN ] SJT: Loaded 22695 existing records. [2025-10-06T21:30:28.235635] [DEBUG] [LOCAL ] SKE: Loaded 36657 existing records from primary storage. [2025-10-06T21:30:28.248266] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:30:28.269019] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-06T21:30:28.285516] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-06T21:30:28.298389] [INFO ] [MAIN ] SKE: Loaded 36657 existing records. [2025-10-06T21:30:28.308220] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-06T21:30:28.318801] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-06T21:30:28.406196] [DEBUG] [LOCAL ] SJM: Loaded 50853 existing records from primary storage. [2025-10-06T21:30:28.453882] [INFO ] [MAIN ] SJM: Loaded 50853 existing records. [2025-10-06T21:30:28.972320] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:30:28.977353] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:30:29.058892] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-06T21:30:29.047536] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-06T21:30:29.075631] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-06T21:30:29.082082] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-06T21:30:29.103399] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-06T21:30:29.135280] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-06T21:30:29.140717] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-06T21:30:29.135111] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:30:29.151725] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-06T21:30:29.140952] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-06T21:30:29.168329] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-06T21:30:29.239735] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-06T21:30:29.239858] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-06T21:30:29.528458] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:30:29.559723] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-06T21:30:30.317931] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:30:30.333323] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-06T21:30:30.383189] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:30:30.408720] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:30:30.409529] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-06T21:30:30.411551] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-06T21:30:30.457158] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T21:30:30.460304] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-06T21:30:31.314337] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T21:30:31.317033] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-06T21:30:31.648756] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T21:30:31.654901] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-06T21:30:31.735493] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T21:30:31.749119] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-06T21:30:31.825501] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-06T21:30:32.179047] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T21:30:32.625552] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-06T21:30:32.660849] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T21:30:33.042253] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T21:30:33.344136] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T21:30:33.425549] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-06T21:30:34.225569] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-06T21:30:34.809805] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T21:30:35.025606] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-06T21:30:35.427592] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T21:30:35.684191] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-06T21:30:35.825579] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-06T21:30:36.625713] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-06T21:30:36.959431] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T21:30:37.425610] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-06T21:30:37.573176] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-06T21:30:38.225709] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-06T21:30:38.726957] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-06T21:30:39.025511] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-06T21:30:39.132184] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T21:30:39.825562] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-06T21:30:40.118005] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T21:30:40.625535] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-06T21:30:41.430684] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-06T21:30:41.445671] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T21:30:42.015069] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T21:30:42.225568] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-06T21:30:42.742615] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T21:30:42.755345] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-06T21:30:43.025559] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-06T21:30:43.825508] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-06T21:30:44.371177] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-06T21:30:44.602673] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T21:30:44.625473] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-06T21:30:45.264251] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T21:30:45.425527] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-06T21:30:46.156171] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T21:30:46.225508] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-06T21:30:46.829870] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T21:30:46.831073] [INFO ] [REMOTE ] SKIL: Full fetch complete (10052 records). [2025-10-06T21:30:46.831145] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-06T21:30:47.032495] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-06T21:30:47.192155] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-06T21:30:47.192261] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-06T21:30:47.192532] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-06T21:30:47.192572] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-06T21:30:47.193041] [DEBUG] [LOCAL ] SKIL: Trimmed 10052 records to 6442 (keeping 200 days of data) [2025-10-06T21:30:47.230716] [DEBUG] [LOCAL ] SKIL: Primary data saved (6442 records). [2025-10-06T21:30:47.230848] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-06T21:30:47.230937] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SKIL took 20.1s. Estimated remaining: 1h 3m 25s. Rate: 7.1 symbols/min [2025-10-06T21:30:47.403987] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:30:47.419404] [DEBUG] [LOCAL ] SKLZ: Loaded 11895 existing records from primary storage. [2025-10-06T21:30:47.419746] [INFO ] [MAIN ] SKLZ: Loaded 11895 existing records. [2025-10-06T21:30:47.598626] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:30:47.598958] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-06T21:30:47.599057] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-06T21:30:47.599287] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-06T21:30:47.599345] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-06T21:30:47.833317] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-06T21:30:47.971294] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:30:48.306414] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-06T21:30:48.625572] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-06T21:30:49.425516] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-06T21:30:49.735466] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T21:30:49.791265] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T21:30:50.225488] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-06T21:30:50.375329] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-06T21:30:51.025555] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-06T21:30:51.825551] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-06T21:30:52.050919] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T21:30:52.093523] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T21:30:52.625489] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-06T21:30:53.037564] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T21:30:53.426624] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-06T21:30:53.427875] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T21:30:54.225577] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-06T21:30:54.813470] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-06T21:30:54.960548] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T21:30:55.025508] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-06T21:30:55.825528] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-06T21:30:56.456969] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T21:30:56.625522] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-06T21:30:56.691140] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T21:30:56.692757] [INFO ] [REMOTE ] SJT: Full fetch complete (32018 records). [2025-10-06T21:30:56.692867] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-06T21:30:57.080686] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-06T21:30:57.080808] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-06T21:30:57.082269] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-06T21:30:57.082350] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-06T21:30:57.083535] [DEBUG] [LOCAL ] SJT: Trimmed 32018 records to 22376 (keeping 200 days of data) [2025-10-06T21:30:57.218976] [DEBUG] [LOCAL ] SJT: Primary data saved (22376 records). [2025-10-06T21:30:57.219139] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-06T21:30:57.219237] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SJT took 30.1s. Estimated remaining: 1h 3m 17s. Rate: 7.1 symbols/min [2025-10-06T21:30:57.394941] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:30:57.432601] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-06T21:30:57.436083] [DEBUG] [LOCAL ] SKM: Loaded 35367 existing records from primary storage. [2025-10-06T21:30:57.436580] [INFO ] [MAIN ] SKM: Loaded 35367 existing records. [2025-10-06T21:30:57.624404] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:30:57.624750] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-06T21:30:57.624809] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-06T21:30:57.625071] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-06T21:30:57.625127] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-06T21:30:57.997544] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:30:58.225507] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-06T21:30:58.257393] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T21:30:58.300980] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-06T21:30:59.025542] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-06T21:30:59.567519] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T21:30:59.825505] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-06T21:31:00.625514] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-06T21:31:01.033148] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T21:31:01.077477] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-06T21:31:01.425537] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-06T21:31:01.851990] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T21:31:02.225566] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-06T21:31:02.925502] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T21:31:03.025515] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-06T21:31:03.108786] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T21:31:03.825536] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-06T21:31:04.080339] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T21:31:04.083563] [INFO ] [REMOTE ] SKE: Full fetch complete (50804 records). [2025-10-06T21:31:04.083955] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-06T21:31:04.468164] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-06T21:31:04.468263] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-06T21:31:04.469306] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-06T21:31:04.469371] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-06T21:31:04.470494] [DEBUG] [LOCAL ] SKE: Trimmed 50804 records to 36125 (keeping 200 days of data) [2025-10-06T21:31:04.639017] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-06T21:31:04.701273] [DEBUG] [LOCAL ] SKE: Primary data saved (36125 records). [2025-10-06T21:31:04.701491] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-06T21:31:04.701634] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SKE took 37.6s. Estimated remaining: 1h 3m 8s. Rate: 7.1 symbols/min [2025-10-06T21:31:04.872691] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:31:04.932717] [DEBUG] [LOCAL ] SKT: Loaded 43120 existing records from primary storage. [2025-10-06T21:31:04.933122] [INFO ] [MAIN ] SKT: Loaded 43120 existing records. [2025-10-06T21:31:05.111662] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:31:05.111926] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-06T21:31:05.111975] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-06T21:31:05.112207] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-06T21:31:05.112265] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-06T21:31:05.448245] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-06T21:31:05.479787] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:31:05.489919] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T21:31:05.669298] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T21:31:06.225534] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-06T21:31:06.690250] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T21:31:06.936989] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-06T21:31:07.025557] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-06T21:31:07.825527] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-06T21:31:08.353918] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T21:31:08.357138] [INFO ] [REMOTE ] SJM: Full fetch complete (72115 records). [2025-10-06T21:31:08.357305] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-06T21:31:08.630744] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-06T21:31:08.761708] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-06T21:31:08.761827] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-06T21:31:08.763214] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-06T21:31:08.763281] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-06T21:31:08.764850] [DEBUG] [LOCAL ] SJM: Trimmed 72115 records to 50126 (keeping 200 days of data) [2025-10-06T21:31:09.087346] [DEBUG] [LOCAL ] SJM: Primary data saved (50126 records). [2025-10-06T21:31:09.087535] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-06T21:31:09.087669] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SJM took 41.9s. Estimated remaining: 1h 2m 59s. Rate: 7.1 symbols/min [2025-10-06T21:31:09.265146] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:31:09.312062] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T21:31:09.337295] [DEBUG] [LOCAL ] SKY: Loaded 38237 existing records from primary storage. [2025-10-06T21:31:09.337899] [INFO ] [MAIN ] SKY: Loaded 38237 existing records. [2025-10-06T21:31:09.430716] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-06T21:31:09.548694] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:31:09.549004] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-06T21:31:09.549052] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-06T21:31:09.549339] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-06T21:31:09.549397] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-06T21:31:09.915541] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:31:09.959753] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T21:31:10.225550] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-06T21:31:10.927740] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T21:31:11.025597] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-06T21:31:11.038883] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-06T21:31:11.825526] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-06T21:31:12.588940] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T21:31:12.625524] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-06T21:31:12.870966] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-06T21:31:13.425602] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-06T21:31:14.069029] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T21:31:14.225591] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-06T21:31:14.995471] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T21:31:15.025500] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-06T21:31:15.255319] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T21:31:15.825542] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-06T21:31:16.391901] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T21:31:16.625510] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-06T21:31:17.425581] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-06T21:31:18.175171] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T21:31:18.225520] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-06T21:31:19.034031] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-06T21:31:19.035972] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T21:31:19.825549] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-06T21:31:19.909038] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-06T21:31:20.099367] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T21:31:20.625560] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-06T21:31:20.767503] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (4.94 seconds). [2025-10-06T21:31:21.359365] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T21:31:21.425488] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-06T21:31:22.047962] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-06T21:31:22.049279] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18711 records). [2025-10-06T21:31:22.049382] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-06T21:31:22.227812] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-06T21:31:22.430679] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-06T21:31:22.430796] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-06T21:31:22.442380] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-06T21:31:22.462491] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-06T21:31:22.466293] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T21:31:22.478083] [DEBUG] [LOCAL ] SKLZ: Trimmed 18711 records to 11641 (keeping 200 days of data) [2025-10-06T21:31:22.548038] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11641 records). [2025-10-06T21:31:22.548239] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-06T21:31:22.548334] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKLZ took 35.3s. Estimated remaining: 1h 2m 52s. Rate: 7.1 symbols/min [2025-10-06T21:31:22.718127] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:31:22.737491] [DEBUG] [LOCAL ] SKYH: Loaded 16789 existing records from primary storage. [2025-10-06T21:31:22.737791] [INFO ] [MAIN ] SKYH: Loaded 16789 existing records. [2025-10-06T21:31:22.911769] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:31:22.912000] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-06T21:31:22.912049] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-06T21:31:22.912296] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-06T21:31:22.912356] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-06T21:31:23.029309] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-06T21:31:23.288074] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:31:23.785047] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T21:31:23.825522] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-06T21:31:24.508718] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T21:31:24.625543] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-06T21:31:25.327959] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-06T21:31:25.425592] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-06T21:31:26.217399] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T21:31:26.226621] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-06T21:31:26.839926] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T21:31:27.025626] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-06T21:31:27.491013] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T21:31:27.825544] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-06T21:31:28.302499] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T21:31:28.625590] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-06T21:31:29.329349] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T21:31:29.360018] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T21:31:29.425539] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-06T21:31:30.225580] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-06T21:31:30.773334] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T21:31:30.982295] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T21:31:31.025555] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-06T21:31:31.825540] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-06T21:31:32.105496] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T21:31:32.625585] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-06T21:31:33.270586] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T21:31:33.425544] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-06T21:31:33.585933] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T21:31:33.588056] [INFO ] [REMOTE ] SKM: Full fetch complete (48266 records). [2025-10-06T21:31:33.588153] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-06T21:31:33.972342] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-06T21:31:33.972466] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-06T21:31:33.973484] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-06T21:31:33.973551] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-06T21:31:33.974990] [DEBUG] [LOCAL ] SKM: Trimmed 48266 records to 34925 (keeping 200 days of data) [2025-10-06T21:31:34.189330] [DEBUG] [LOCAL ] SKM: Primary data saved (34925 records). [2025-10-06T21:31:34.189494] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-06T21:31:34.189594] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SKM took 37.0s. Estimated remaining: 1h 2m 44s. Rate: 7.1 symbols/min [2025-10-06T21:31:34.232530] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-06T21:31:34.364230] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:31:34.416749] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-10-06T21:31:34.417198] [INFO ] [MAIN ] SLB: Loaded 54477 existing records. [2025-10-06T21:31:34.594595] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:31:34.594855] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-06T21:31:34.594902] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-06T21:31:34.595180] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-06T21:31:34.595238] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-06T21:31:34.703938] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T21:31:34.722900] [INFO ] [REMOTE ] SKT: Full fetch complete (60505 records). [2025-10-06T21:31:34.733430] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-06T21:31:35.032218] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-06T21:31:35.298501] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:31:35.466076] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-06T21:31:35.466272] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-06T21:31:35.467519] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-06T21:31:35.467609] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-06T21:31:35.481402] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-06T21:31:35.486858] [DEBUG] [LOCAL ] SKT: Trimmed 60505 records to 42500 (keeping 200 days of data) [2025-10-06T21:31:35.748003] [DEBUG] [LOCAL ] SKT: Primary data saved (42500 records). [2025-10-06T21:31:35.748163] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-06T21:31:35.748246] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKT took 31.0s. Estimated remaining: 1h 2m 34s. Rate: 7.1 symbols/min [2025-10-06T21:31:35.830733] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-06T21:31:35.920207] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:31:35.956578] [DEBUG] [LOCAL ] SLF: Loaded 39218 existing records from primary storage. [2025-10-06T21:31:35.956988] [INFO ] [MAIN ] SLF: Loaded 39218 existing records. [2025-10-06T21:31:36.132876] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:31:36.133179] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-06T21:31:36.133230] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-06T21:31:36.133471] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-06T21:31:36.133531] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-06T21:31:36.499892] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:31:36.625544] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-06T21:31:36.678515] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T21:31:37.425600] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-06T21:31:38.027551] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-06T21:31:38.061221] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T21:31:38.225532] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-06T21:31:38.446782] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T21:31:39.025567] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-06T21:31:39.664827] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T21:31:39.825496] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-06T21:31:40.625473] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-06T21:31:40.789356] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T21:31:41.039431] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-06T21:31:41.425570] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-06T21:31:42.060772] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T21:31:42.225598] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-06T21:31:42.934502] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T21:31:43.025548] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-06T21:31:43.755399] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T21:31:43.825506] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-06T21:31:44.459808] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T21:31:44.625533] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-06T21:31:45.412267] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T21:31:45.425455] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-06T21:31:46.225505] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-06T21:31:46.255780] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T21:31:46.565609] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T21:31:47.025555] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-06T21:31:47.207811] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T21:31:47.825573] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-06T21:31:48.625553] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-06T21:31:48.918502] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T21:31:49.299240] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T21:31:49.425582] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-06T21:31:50.104257] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T21:31:50.225525] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-06T21:31:50.907559] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T21:31:51.025546] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-06T21:31:51.599746] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T21:31:51.825575] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-06T21:31:52.216398] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T21:31:52.219142] [INFO ] [REMOTE ] SKY: Full fetch complete (54450 records). [2025-10-06T21:31:52.219291] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-06T21:31:52.615038] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-06T21:31:52.615145] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-06T21:31:52.616226] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-06T21:31:52.616296] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-06T21:31:52.617570] [DEBUG] [LOCAL ] SKY: Trimmed 54450 records to 37908 (keeping 200 days of data) [2025-10-06T21:31:52.625523] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-06T21:31:52.849836] [DEBUG] [LOCAL ] SKY: Primary data saved (37908 records). [2025-10-06T21:31:52.850008] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-06T21:31:52.850096] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKY took 43.8s. Estimated remaining: 1h 2m 27s. Rate: 7.1 symbols/min [2025-10-06T21:31:53.023407] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:31:53.064500] [DEBUG] [LOCAL ] SLG: Loaded 45832 existing records from primary storage. [2025-10-06T21:31:53.064902] [INFO ] [MAIN ] SLG: Loaded 45832 existing records. [2025-10-06T21:31:53.244408] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:31:53.244829] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-06T21:31:53.244933] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-06T21:31:53.245251] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-06T21:31:53.245310] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-06T21:31:53.426628] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-06T21:31:53.481408] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T21:31:53.638307] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:31:54.225530] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-06T21:31:54.466537] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-06T21:31:54.647723] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-06T21:31:55.025571] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-06T21:31:55.664008] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T21:31:55.825540] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-06T21:31:56.608719] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T21:31:56.625469] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-06T21:31:56.927463] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T21:31:56.929967] [INFO ] [REMOTE ] SLF: Full fetch complete (56305 records). [2025-10-06T21:31:56.930070] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-06T21:31:57.323432] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-06T21:31:57.323527] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-06T21:31:57.324556] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-06T21:31:57.324621] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-06T21:31:57.325887] [DEBUG] [LOCAL ] SLF: Trimmed 56305 records to 38714 (keeping 200 days of data) [2025-10-06T21:31:57.426495] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-06T21:31:57.574204] [DEBUG] [LOCAL ] SLF: Primary data saved (38714 records). [2025-10-06T21:31:57.574388] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-06T21:31:57.574478] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SLF took 21.8s. Estimated remaining: 1h 2m 18s. Rate: 7.1 symbols/min [2025-10-06T21:31:57.764330] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:31:57.761178] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-06T21:31:57.808631] [DEBUG] [LOCAL ] SLGN: Loaded 41038 existing records from primary storage. [2025-10-06T21:31:57.809085] [INFO ] [MAIN ] SLGN: Loaded 41038 existing records. [2025-10-06T21:31:57.995213] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:31:57.995497] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-06T21:31:57.995553] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-06T21:31:57.995845] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-06T21:31:57.995914] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-06T21:31:58.236114] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-06T21:31:58.371381] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:31:59.025507] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-06T21:31:59.076725] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T21:31:59.078230] [INFO ] [REMOTE ] SKYH: Full fetch complete (22299 records). [2025-10-06T21:31:59.078310] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-06T21:31:59.504379] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-06T21:31:59.504669] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-06T21:31:59.505289] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-06T21:31:59.505380] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-06T21:31:59.531928] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-06T21:31:59.532082] [DEBUG] [LOCAL ] SKYH: Trimmed 22299 records to 16590 (keeping 200 days of data) [2025-10-06T21:31:59.642421] [DEBUG] [LOCAL ] SKYH: Primary data saved (16590 records). [2025-10-06T21:31:59.642624] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-06T21:31:59.642770] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SKYH took 37.1s. Estimated remaining: 1h 2m 8s. Rate: 7.1 symbols/min [2025-10-06T21:31:59.813821] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:31:59.814101] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-06T21:31:59.814157] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-06T21:31:59.814280] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-06T21:31:59.814321] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-06T21:31:59.814361] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-06T21:31:59.814393] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-06T21:31:59.835436] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-06T21:32:00.185513] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:32:00.625552] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-06T21:32:01.270588] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-06T21:32:01.400913] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T21:32:01.425497] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-06T21:32:02.094161] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T21:32:02.225543] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-06T21:32:02.899760] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T21:32:03.025552] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-06T21:32:03.825499] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-06T21:32:03.913172] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T21:32:04.416204] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T21:32:04.625584] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-06T21:32:05.425556] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-06T21:32:05.724576] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T21:32:05.769747] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-06T21:32:06.225504] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-06T21:32:06.398293] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T21:32:06.472243] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-06T21:32:07.025557] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-06T21:32:07.420001] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-06T21:32:07.825561] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-06T21:32:08.625536] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-06T21:32:08.978039] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-06T21:32:09.431842] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-06T21:32:09.451100] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T21:32:10.225550] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-06T21:32:11.025499] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-06T21:32:11.105852] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T21:32:11.578599] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-06T21:32:11.825487] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-06T21:32:12.232161] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-06T21:32:12.625730] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-06T21:32:13.350421] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T21:32:13.425533] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-06T21:32:14.051475] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T21:32:14.225549] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-06T21:32:15.025508] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-06T21:32:15.102689] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T21:32:15.371129] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-06T21:32:15.825546] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-06T21:32:16.482705] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-06T21:32:16.625544] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-06T21:32:16.904681] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-06T21:32:17.264733] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T21:32:17.425544] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-06T21:32:18.225542] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-06T21:32:18.488737] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-06T21:32:19.025545] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-06T21:32:19.102356] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T21:32:19.349486] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-06T21:32:19.825610] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-06T21:32:20.625556] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-06T21:32:21.116819] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-06T21:32:21.393214] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T21:32:21.425477] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-06T21:32:22.225544] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-06T21:32:23.025591] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-06T21:32:23.177360] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-06T21:32:23.308919] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-06T21:32:23.309623] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1052 records). [2025-10-06T21:32:23.309717] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-06T21:32:23.505163] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-06T21:32:23.505403] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:32:23.505479] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:32:23.505569] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-06T21:32:23.505661] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-06T21:32:23.505766] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-06T21:32:23.505845] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-06T21:32:23.505939] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLNZ took 23.9s. Estimated remaining: 1h 2m 3s. Rate: 7.1 symbols/min [2025-10-06T21:32:23.691451] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:32:23.745210] [DEBUG] [LOCAL ] SLQT: Loaded 44168 existing records from primary storage. [2025-10-06T21:32:23.745671] [INFO ] [MAIN ] SLQT: Loaded 44168 existing records. [2025-10-06T21:32:23.827760] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-06T21:32:23.962246] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:32:23.962784] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-06T21:32:23.963181] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-06T21:32:23.963789] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-06T21:32:23.963858] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-06T21:32:24.377113] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-06T21:32:24.374762] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:32:24.625564] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-06T21:32:25.135909] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T21:32:25.425564] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-06T21:32:26.225507] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-06T21:32:26.691346] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-06T21:32:27.033159] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-06T21:32:27.051027] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T21:32:27.261673] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T21:32:27.825544] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-06T21:32:28.625509] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-06T21:32:28.762870] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-06T21:32:28.766093] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-10-06T21:32:28.766260] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-06T21:32:29.210473] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-06T21:32:29.210779] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-06T21:32:29.212200] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-06T21:32:29.212297] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-06T21:32:29.214060] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 53697 (keeping 200 days of data) [2025-10-06T21:32:29.337683] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T21:32:29.437452] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-06T21:32:29.603292] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-10-06T21:32:29.603479] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-06T21:32:29.603586] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLB took 55.4s. Estimated remaining: 1h 1m 54s. Rate: 7.1 symbols/min [2025-10-06T21:32:29.783080] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:32:29.812771] [DEBUG] [LOCAL ] SLVM: Loaded 28511 existing records from primary storage. [2025-10-06T21:32:29.813133] [INFO ] [MAIN ] SLVM: Loaded 28511 existing records. [2025-10-06T21:32:30.038789] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:32:30.041967] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-06T21:32:30.042059] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-06T21:32:30.044578] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-06T21:32:30.044524] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T21:32:30.048085] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-06T21:32:30.236392] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-06T21:32:30.429282] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:32:30.570933] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T21:32:30.573473] [INFO ] [REMOTE ] SLG: Full fetch complete (64995 records). [2025-10-06T21:32:30.573610] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-06T21:32:30.954032] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-06T21:32:30.954124] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-06T21:32:30.955216] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-06T21:32:30.955281] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-06T21:32:30.956712] [DEBUG] [LOCAL ] SLG: Trimmed 64995 records to 45223 (keeping 200 days of data) [2025-10-06T21:32:31.043932] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-06T21:32:31.241139] [DEBUG] [LOCAL ] SLG: Primary data saved (45223 records). [2025-10-06T21:32:31.241305] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-06T21:32:31.241388] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLG took 38.4s. Estimated remaining: 1h 1m 44s. Rate: 7.1 symbols/min [2025-10-06T21:32:31.409629] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:32:31.458153] [DEBUG] [LOCAL ] SM: Loaded 53098 existing records from primary storage. [2025-10-06T21:32:31.458569] [INFO ] [MAIN ] SM: Loaded 53098 existing records. [2025-10-06T21:32:31.647266] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:32:31.648385] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-06T21:32:31.648472] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-06T21:32:31.649367] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-06T21:32:31.649436] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-06T21:32:31.761278] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-06T21:32:31.790294] [INFO ] [REMOTE ] SLGN: Full fetch complete (58656 records). [2025-10-06T21:32:31.814022] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-06T21:32:31.839942] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-06T21:32:32.227616] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:32:32.457594] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-06T21:32:32.457718] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-06T21:32:32.458794] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-06T21:32:32.458860] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-06T21:32:32.460058] [DEBUG] [LOCAL ] SLGN: Trimmed 58656 records to 40550 (keeping 200 days of data) [2025-10-06T21:32:32.633769] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-06T21:32:32.722823] [DEBUG] [LOCAL ] SLGN: Primary data saved (40550 records). [2025-10-06T21:32:32.722990] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-06T21:32:32.723077] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLGN took 35.1s. Estimated remaining: 1h 1m 34s. Rate: 7.1 symbols/min [2025-10-06T21:32:32.924419] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:32:32.924900] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-06T21:32:32.925330] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-06T21:32:32.925474] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-06T21:32:32.925520] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-06T21:32:32.925563] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-06T21:32:32.925596] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-06T21:32:32.932692] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T21:32:33.266375] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-06T21:32:33.360388] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:32:33.425508] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-06T21:32:34.225510] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-06T21:32:34.434552] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T21:32:34.561731] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T21:32:35.025562] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-06T21:32:35.812880] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T21:32:35.825470] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-06T21:32:36.196599] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T21:32:36.625552] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-06T21:32:36.841059] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:32:36.841452] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-06T21:32:36.841546] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:32:36.841599] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-06T21:32:36.841631] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:32:36.841723] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-06T21:32:36.841795] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-06T21:32:36.841830] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-06T21:32:36.841868] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-06T21:32:36.841917] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SMA took 4.1s. Estimated remaining: 1h 1m 25s. Rate: 7.1 symbols/min [2025-10-06T21:32:37.015397] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:32:37.028897] [DEBUG] [LOCAL ] SMBK: Loaded 8281 existing records from primary storage. [2025-10-06T21:32:37.029212] [INFO ] [MAIN ] SMBK: Loaded 8281 existing records. [2025-10-06T21:32:37.213615] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:32:37.213906] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-06T21:32:37.213984] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-06T21:32:37.214194] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-06T21:32:37.214253] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-06T21:32:37.429321] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-06T21:32:37.594750] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:32:37.621745] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T21:32:38.225586] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-06T21:32:38.849621] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T21:32:39.025562] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-06T21:32:39.436601] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-06T21:32:39.825547] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-06T21:32:40.397683] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T21:32:40.625571] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-06T21:32:41.358841] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T21:32:41.425564] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-06T21:32:42.225523] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-06T21:32:42.334895] [DEBUG] [REMOTE ] SMBK: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-06T21:32:42.335238] [WARN ] [REMOTE ] SMBK: No data returned for month 2024-12 [2025-10-06T21:32:42.335347] [FATAL] [REMOTE ] SMBK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:32:42.335419] [FATAL] [MAIN ] SMBK: Failed to fetch primary data. [2025-10-06T21:32:42.335887] [WARN ] [MAIN ] SMBK: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:32:42.336096] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-06T21:32:42.336196] [DEBUG] [LOCAL ] SMBK: No primary data file found to delete. [2025-10-06T21:32:42.336238] [INFO ] [LOCAL ] SMBK: Starting deletion of derivative data. [2025-10-06T21:32:42.336577] [DEBUG] [LOCAL ] SMBK: Deleted derivative data file. [2025-10-06T21:32:42.336738] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SMBK took 5.5s. Estimated remaining: 1h 1m 16s. Rate: 7.1 symbols/min [2025-10-06T21:32:42.559089] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:32:42.565346] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-06T21:32:42.586747] [DEBUG] [LOCAL ] SMC: Loaded 11572 existing records from primary storage. [2025-10-06T21:32:42.587038] [INFO ] [MAIN ] SMC: Loaded 11572 existing records. [2025-10-06T21:32:42.774111] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:32:42.774569] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-06T21:32:42.774684] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-06T21:32:42.775003] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-06T21:32:42.775064] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-06T21:32:43.030804] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-06T21:32:43.153935] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T21:32:43.205975] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:32:43.825578] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-06T21:32:44.625546] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-06T21:32:44.688808] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-06T21:32:44.788832] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T21:32:45.425540] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-06T21:32:46.225586] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-06T21:32:46.368365] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T21:32:47.032709] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-06T21:32:47.034809] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T21:32:47.262426] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T21:32:47.825531] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-06T21:32:48.427938] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T21:32:48.625575] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-06T21:32:49.319122] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T21:32:49.425524] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-06T21:32:50.225544] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-06T21:32:50.476212] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-06T21:32:50.509445] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T21:32:50.512553] [INFO ] [REMOTE ] SLQT: Full fetch complete (63925 records). [2025-10-06T21:32:50.512761] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-06T21:32:50.911876] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-06T21:32:50.912001] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-06T21:32:50.913198] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-06T21:32:50.913321] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-06T21:32:50.914816] [DEBUG] [LOCAL ] SLQT: Trimmed 63925 records to 43497 (keeping 200 days of data) [2025-10-06T21:32:51.025876] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-06T21:32:51.158583] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-06T21:32:51.212783] [DEBUG] [LOCAL ] SLQT: Primary data saved (43497 records). [2025-10-06T21:32:51.212960] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-06T21:32:51.213053] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SLQT took 27.7s. Estimated remaining: 1h 1m 7s. Rate: 7.1 symbols/min [2025-10-06T21:32:51.379177] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:32:51.425019] [DEBUG] [LOCAL ] SMFG: Loaded 48805 existing records from primary storage. [2025-10-06T21:32:51.425374] [INFO ] [MAIN ] SMFG: Loaded 48805 existing records. [2025-10-06T21:32:51.603330] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:32:51.603611] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-06T21:32:51.603686] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-06T21:32:51.603934] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-06T21:32:51.603996] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-06T21:32:51.830852] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-06T21:32:51.955317] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:32:52.625511] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-06T21:32:52.726285] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T21:32:52.812723] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T21:32:53.425513] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-06T21:32:53.706905] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T21:32:54.225537] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-06T21:32:54.991389] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T21:32:55.030804] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-06T21:32:55.038640] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T21:32:55.825560] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-06T21:32:56.194510] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T21:32:56.625506] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-06T21:32:56.747882] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-06T21:32:57.425539] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-06T21:32:57.952790] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T21:32:58.225557] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-06T21:32:58.956198] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T21:32:59.025508] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-06T21:32:59.619819] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T21:32:59.825533] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-06T21:33:00.541037] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T21:33:00.625541] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-06T21:33:01.381748] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-06T21:33:01.425557] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-06T21:33:01.562918] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-06T21:33:02.126443] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T21:33:02.128740] [INFO ] [REMOTE ] SLVM: Full fetch complete (40131 records). [2025-10-06T21:33:02.128846] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-06T21:33:02.229988] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-06T21:33:02.513298] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-06T21:33:02.513418] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-06T21:33:02.514297] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-06T21:33:02.514360] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-06T21:33:02.515201] [DEBUG] [LOCAL ] SLVM: Trimmed 40131 records to 28017 (keeping 200 days of data) [2025-10-06T21:33:02.691483] [DEBUG] [LOCAL ] SLVM: Primary data saved (28017 records). [2025-10-06T21:33:02.691664] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-06T21:33:02.691786] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SLVM took 33.1s. Estimated remaining: 1h 0m 59s. Rate: 7.1 symbols/min [2025-10-06T21:33:02.860311] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:33:02.902287] [DEBUG] [LOCAL ] SMG: Loaded 44276 existing records from primary storage. [2025-10-06T21:33:02.902637] [INFO ] [MAIN ] SMG: Loaded 44276 existing records. [2025-10-06T21:33:03.039855] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-06T21:33:03.084495] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:33:03.084899] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-06T21:33:03.084952] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-06T21:33:03.085905] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-06T21:33:03.085970] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-06T21:33:03.469764] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:33:03.825498] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-06T21:33:03.938097] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T21:33:03.981496] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T21:33:04.625620] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-06T21:33:05.347740] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T21:33:05.421427] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-06T21:33:05.425487] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-06T21:33:06.225632] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-06T21:33:07.025704] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-06T21:33:07.046075] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T21:33:07.191505] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T21:33:07.825568] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-06T21:33:08.625534] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-06T21:33:08.791779] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T21:33:08.789611] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T21:33:09.425619] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-06T21:33:10.027994] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T21:33:10.029466] [INFO ] [REMOTE ] SMC: Full fetch complete (16433 records). [2025-10-06T21:33:10.029539] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-06T21:33:10.233463] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-06T21:33:10.407736] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-06T21:33:10.407853] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-06T21:33:10.408346] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-06T21:33:10.408477] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-06T21:33:10.409252] [DEBUG] [LOCAL ] SMC: Trimmed 16433 records to 11311 (keeping 200 days of data) [2025-10-06T21:33:10.489712] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-06T21:33:10.515658] [DEBUG] [LOCAL ] SMC: Primary data saved (11311 records). [2025-10-06T21:33:10.515795] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-06T21:33:10.515874] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SMC took 28.2s. Estimated remaining: 1h 0m 51s. Rate: 7.1 symbols/min [2025-10-06T21:33:10.683259] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:33:10.699025] [DEBUG] [LOCAL ] SMHI: Loaded 13294 existing records from primary storage. [2025-10-06T21:33:10.699291] [INFO ] [MAIN ] SMHI: Loaded 13294 existing records. [2025-10-06T21:33:10.874186] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:33:10.874481] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-06T21:33:10.874558] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-06T21:33:10.874810] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-06T21:33:10.874875] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-06T21:33:11.045942] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-06T21:33:11.236279] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:33:11.825542] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-06T21:33:11.876295] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T21:33:12.625565] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-06T21:33:12.687251] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T21:33:13.425550] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-06T21:33:13.709491] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-06T21:33:14.225492] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-06T21:33:14.260877] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T21:33:14.664793] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T21:33:15.025568] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-06T21:33:15.442023] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T21:33:15.445170] [INFO ] [REMOTE ] SM: Full fetch complete (75438 records). [2025-10-06T21:33:15.445321] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-06T21:33:15.835444] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-06T21:33:15.863190] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-06T21:33:15.863312] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-06T21:33:15.865220] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-06T21:33:15.865440] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-06T21:33:15.867885] [DEBUG] [LOCAL ] SM: Trimmed 75438 records to 52319 (keeping 200 days of data) [2025-10-06T21:33:16.221006] [DEBUG] [LOCAL ] SM: Primary data saved (52319 records). [2025-10-06T21:33:16.221231] [INFO ] [MAIN ] SM: Full history saved. [2025-10-06T21:33:16.221346] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SM took 45.0s. Estimated remaining: 1h 0m 42s. Rate: 7.1 symbols/min [2025-10-06T21:33:16.406939] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:33:16.432042] [DEBUG] [LOCAL ] SMP: Loaded 19514 existing records from primary storage. [2025-10-06T21:33:16.432406] [INFO ] [MAIN ] SMP: Loaded 19514 existing records. [2025-10-06T21:33:16.629183] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-06T21:33:16.629058] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:33:16.629839] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-06T21:33:16.630962] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-06T21:33:16.631423] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-06T21:33:16.631503] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-06T21:33:17.057190] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T21:33:17.073158] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-06T21:33:17.111618] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:33:17.425561] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-06T21:33:18.171678] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T21:33:18.225554] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-06T21:33:19.025553] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-06T21:33:19.276993] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T21:33:19.508670] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T21:33:19.825547] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-06T21:33:20.000774] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T21:33:20.625529] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-06T21:33:21.430602] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-06T21:33:21.445023] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T21:33:22.225501] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-06T21:33:22.259690] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T21:33:22.349625] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T21:33:23.025555] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-06T21:33:23.452899] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T21:33:23.825545] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-06T21:33:24.567880] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T21:33:24.625476] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-06T21:33:24.709509] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T21:33:25.425581] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-06T21:33:26.115557] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T21:33:26.225520] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-06T21:33:26.536281] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T21:33:27.025605] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-06T21:33:27.282877] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T21:33:27.825549] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-06T21:33:28.388599] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T21:33:28.391538] [INFO ] [REMOTE ] SMFG: Full fetch complete (69004 records). [2025-10-06T21:33:28.391705] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-06T21:33:28.630688] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-06T21:33:28.780372] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-06T21:33:28.806867] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-06T21:33:28.806986] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-06T21:33:28.808371] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-06T21:33:28.808469] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-06T21:33:28.810334] [DEBUG] [LOCAL ] SMFG: Trimmed 69004 records to 48122 (keeping 200 days of data) [2025-10-06T21:33:29.119124] [DEBUG] [LOCAL ] SMFG: Primary data saved (48122 records). [2025-10-06T21:33:29.119333] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-06T21:33:29.119422] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMFG took 37.9s. Estimated remaining: 1h 0m 34s. Rate: 7.1 symbols/min [2025-10-06T21:33:29.311100] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:33:29.375940] [DEBUG] [LOCAL ] SMR: Loaded 54577 existing records from primary storage. [2025-10-06T21:33:29.376346] [INFO ] [MAIN ] SMR: Loaded 54577 existing records. [2025-10-06T21:33:29.434056] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-06T21:33:29.566031] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:33:29.566352] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-06T21:33:29.566421] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-06T21:33:29.567120] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-06T21:33:29.567179] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-06T21:33:29.962636] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:33:29.964390] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-06T21:33:30.225583] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-06T21:33:31.025489] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-06T21:33:31.057617] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T21:33:31.396405] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T21:33:31.825568] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-06T21:33:32.625499] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-06T21:33:33.268787] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T21:33:33.425480] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-06T21:33:33.656984] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-06T21:33:33.876089] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T21:33:34.225588] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-06T21:33:34.352120] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T21:33:34.354514] [INFO ] [REMOTE ] SMG: Full fetch complete (62665 records). [2025-10-06T21:33:34.354610] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-06T21:33:34.777029] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-06T21:33:34.777254] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-06T21:33:34.778845] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-06T21:33:34.778916] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-06T21:33:34.780858] [DEBUG] [LOCAL ] SMG: Trimmed 62665 records to 43667 (keeping 200 days of data) [2025-10-06T21:33:35.027014] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-06T21:33:35.055786] [DEBUG] [LOCAL ] SMG: Primary data saved (43667 records). [2025-10-06T21:33:35.056028] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-06T21:33:35.056213] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMG took 32.4s. Estimated remaining: 1h 0m 25s. Rate: 7.1 symbols/min [2025-10-06T21:33:35.236555] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:33:35.278747] [DEBUG] [LOCAL ] SMRT: Loaded 44495 existing records from primary storage. [2025-10-06T21:33:35.279206] [INFO ] [MAIN ] SMRT: Loaded 44495 existing records. [2025-10-06T21:33:35.462447] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:33:35.462852] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-06T21:33:35.462903] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-06T21:33:35.463570] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-06T21:33:35.463630] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-06T21:33:35.823744] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:33:35.825552] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-06T21:33:36.062440] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T21:33:36.458009] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-06T21:33:36.625530] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-06T21:33:36.705556] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T21:33:37.425543] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-06T21:33:38.145469] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T21:33:38.225544] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-06T21:33:38.247698] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-06T21:33:39.025566] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-06T21:33:39.307920] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T21:33:39.825570] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-06T21:33:40.625522] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-06T21:33:40.658977] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-06T21:33:41.425566] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-06T21:33:41.590450] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-06T21:33:41.924478] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-06T21:33:41.939012] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-06T21:33:42.225525] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-06T21:33:42.794108] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T21:33:42.795320] [INFO ] [REMOTE ] SMHI: Full fetch complete (22685 records). [2025-10-06T21:33:42.795417] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-06T21:33:43.033750] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-06T21:33:43.203574] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-06T21:33:43.203705] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-06T21:33:43.204406] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-06T21:33:43.204489] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-06T21:33:43.205299] [DEBUG] [LOCAL ] SMHI: Trimmed 22685 records to 13105 (keeping 200 days of data) [2025-10-06T21:33:43.293544] [DEBUG] [LOCAL ] SMHI: Primary data saved (13105 records). [2025-10-06T21:33:43.293795] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-06T21:33:43.293933] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMHI took 32.8s. Estimated remaining: 1h 0m 17s. Rate: 7.1 symbols/min [2025-10-06T21:33:43.506403] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:33:43.543144] [DEBUG] [LOCAL ] SMWB: Loaded 32764 existing records from primary storage. [2025-10-06T21:33:43.543464] [INFO ] [MAIN ] SMWB: Loaded 32764 existing records. [2025-10-06T21:33:43.742460] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:33:43.742743] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-06T21:33:43.742798] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-06T21:33:43.743149] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-06T21:33:43.743208] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-06T21:33:43.830713] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-06T21:33:44.136947] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:33:44.493576] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T21:33:44.579960] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-06T21:33:44.625475] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-06T21:33:45.425512] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-06T21:33:45.620963] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T21:33:46.225586] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-06T21:33:46.953128] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T21:33:47.025488] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-06T21:33:47.593342] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T21:33:47.825535] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-06T21:33:48.624328] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T21:33:48.633462] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-06T21:33:48.823688] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-06T21:33:49.425588] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-06T21:33:49.541782] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-06T21:33:49.543150] [INFO ] [REMOTE ] SMP: Full fetch complete (26215 records). [2025-10-06T21:33:49.543224] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-06T21:33:49.930547] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-06T21:33:49.930718] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-06T21:33:49.932042] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-06T21:33:49.932126] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-06T21:33:49.933165] [DEBUG] [LOCAL ] SMP: Trimmed 26215 records to 19113 (keeping 200 days of data) [2025-10-06T21:33:50.064589] [DEBUG] [LOCAL ] SMP: Primary data saved (19113 records). [2025-10-06T21:33:50.064806] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-06T21:33:50.064918] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMP took 33.8s. Estimated remaining: 1h 0m 8s. Rate: 7.1 symbols/min [2025-10-06T21:33:50.225948] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-06T21:33:50.249331] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:33:50.305406] [DEBUG] [LOCAL ] SN: Loaded 50488 existing records from primary storage. [2025-10-06T21:33:50.306001] [INFO ] [MAIN ] SN: Loaded 50488 existing records. [2025-10-06T21:33:50.501400] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:33:50.501711] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-06T21:33:50.501771] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-06T21:33:50.502047] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-06T21:33:50.502105] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-06T21:33:50.887077] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:33:50.912132] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T21:33:51.025559] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-06T21:33:51.825570] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-06T21:33:51.892602] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T21:33:52.625535] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-06T21:33:52.681762] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T21:33:52.845086] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T21:33:53.425549] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-06T21:33:54.225534] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-06T21:33:54.276100] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T21:33:55.025517] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-06T21:33:55.825520] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-06T21:33:55.863170] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-06T21:33:55.901757] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T21:33:56.450151] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-06T21:33:56.625562] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-06T21:33:57.432205] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-06T21:33:57.438926] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T21:33:58.225597] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-06T21:33:58.882874] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T21:33:59.025535] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-06T21:33:59.206011] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-06T21:33:59.825519] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-06T21:33:59.876143] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T21:34:00.495887] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T21:34:00.625553] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-06T21:34:01.425739] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-06T21:34:02.225571] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-06T21:34:02.434944] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T21:34:02.491522] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T21:34:02.599272] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-06T21:34:03.025570] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-06T21:34:03.610086] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T21:34:03.825567] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-06T21:34:04.625704] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-06T21:34:04.976152] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-06T21:34:04.980963] [INFO ] [REMOTE ] SMRT: Full fetch complete (62097 records). [2025-10-06T21:34:04.981327] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-06T21:34:05.438031] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-06T21:34:05.461151] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-06T21:34:05.461329] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-06T21:34:05.462623] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-06T21:34:05.463061] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-06T21:34:05.464561] [DEBUG] [LOCAL ] SMRT: Trimmed 62097 records to 43940 (keeping 200 days of data) [2025-10-06T21:34:05.695497] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-06T21:34:05.760214] [DEBUG] [LOCAL ] SMRT: Primary data saved (43940 records). [2025-10-06T21:34:05.760379] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-06T21:34:05.761462] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMRT took 30.7s. Estimated remaining: 1h 0m 1s. Rate: 7.1 symbols/min [2025-10-06T21:34:05.928065] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:34:05.961191] [DEBUG] [LOCAL ] SNA: Loaded 26187 existing records from primary storage. [2025-10-06T21:34:05.961515] [INFO ] [MAIN ] SNA: Loaded 26187 existing records. [2025-10-06T21:34:06.143795] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:34:06.144159] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-06T21:34:06.144217] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-06T21:34:06.144458] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-06T21:34:06.144515] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-06T21:34:06.235897] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-06T21:34:06.510618] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:34:06.540770] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T21:34:06.902078] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T21:34:07.025539] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-06T21:34:07.825589] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-06T21:34:08.421054] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-06T21:34:08.625534] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-06T21:34:08.835723] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-06T21:34:09.331000] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T21:34:09.425546] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-06T21:34:09.921844] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-06T21:34:10.225539] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-06T21:34:11.025565] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-06T21:34:11.119447] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T21:34:11.461685] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T21:34:11.825589] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-06T21:34:12.625562] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-06T21:34:12.751350] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T21:34:12.753278] [INFO ] [REMOTE ] SMWB: Full fetch complete (49543 records). [2025-10-06T21:34:12.753395] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-06T21:34:13.131229] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-06T21:34:13.131328] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-06T21:34:13.132392] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-06T21:34:13.132458] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-06T21:34:13.133677] [DEBUG] [LOCAL ] SMWB: Trimmed 49543 records to 32296 (keeping 200 days of data) [2025-10-06T21:34:13.314518] [DEBUG] [LOCAL ] SMWB: Primary data saved (32296 records). [2025-10-06T21:34:13.314710] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-06T21:34:13.314809] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMWB took 30.0s. Estimated remaining: 59m 52s. Rate: 7.1 symbols/min [2025-10-06T21:34:13.430685] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-06T21:34:13.485302] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:34:13.534261] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-10-06T21:34:13.534755] [INFO ] [MAIN ] SNAP: Loaded 54576 existing records. [2025-10-06T21:34:13.717604] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:34:13.717864] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-06T21:34:13.717912] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-06T21:34:13.718130] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-06T21:34:13.718190] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-06T21:34:14.100740] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:34:14.119993] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T21:34:14.225502] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-06T21:34:15.025558] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-06T21:34:15.171251] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-06T21:34:15.232097] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T21:34:15.498989] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (4.47 seconds). [2025-10-06T21:34:15.825525] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-06T21:34:16.625597] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-06T21:34:17.406160] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-06T21:34:17.425472] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-06T21:34:17.595261] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T21:34:18.225521] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-06T21:34:19.025559] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-06T21:34:19.423058] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-06T21:34:19.733018] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-06T21:34:19.825524] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-06T21:34:19.955529] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T21:34:20.625559] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-06T21:34:21.425632] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-06T21:34:22.037546] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-06T21:34:22.070368] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T21:34:22.073959] [INFO ] [REMOTE ] SN: Full fetch complete (71117 records). [2025-10-06T21:34:22.074157] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-06T21:34:22.230710] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-06T21:34:22.494598] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-06T21:34:22.494725] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-06T21:34:22.495907] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-06T21:34:22.496013] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-06T21:34:22.497425] [DEBUG] [LOCAL ] SN: Trimmed 71117 records to 49897 (keeping 200 days of data) [2025-10-06T21:34:22.807028] [DEBUG] [LOCAL ] SN: Primary data saved (49897 records). [2025-10-06T21:34:22.807279] [INFO ] [MAIN ] SN: Full history saved. [2025-10-06T21:34:22.807401] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SN took 32.7s. Estimated remaining: 59m 44s. Rate: 7.1 symbols/min [2025-10-06T21:34:22.985126] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:34:22.992229] [DEBUG] [LOCAL ] SNDA: Loaded 4571 existing records from primary storage. [2025-10-06T21:34:22.992447] [INFO ] [MAIN ] SNDA: Loaded 4571 existing records. [2025-10-06T21:34:23.170959] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:34:23.171269] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-06T21:34:23.171317] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-06T21:34:23.171535] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-06T21:34:23.171592] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-06T21:34:23.529547] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:34:23.529977] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-06T21:34:23.737703] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-06T21:34:23.741710] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-10-06T21:34:23.741918] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-06T21:34:24.215569] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-06T21:34:24.215741] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-06T21:34:24.217776] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-06T21:34:24.217892] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-06T21:34:24.228178] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-06T21:34:24.231617] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-06T21:34:24.233292] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 53798 (keeping 200 days of data) [2025-10-06T21:34:24.655508] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-06T21:34:24.660429] [DEBUG] [LOCAL ] SMR: Primary data saved (53798 records). [2025-10-06T21:34:24.672981] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-06T21:34:24.674849] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SMR took 55.6s. Estimated remaining: 59m 34s. Rate: 7.1 symbols/min [2025-10-06T21:34:24.715954] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-06T21:34:24.880316] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:34:24.929587] [DEBUG] [LOCAL ] SNDR: Loaded 41416 existing records from primary storage. [2025-10-06T21:34:24.930046] [INFO ] [MAIN ] SNDR: Loaded 41416 existing records. [2025-10-06T21:34:25.082239] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (6.06 seconds). [2025-10-06T21:34:25.181526] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:34:25.181927] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-06T21:34:25.181986] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-06T21:34:25.182434] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-06T21:34:25.182522] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-06T21:34:25.430685] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-06T21:34:25.577509] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-06T21:34:25.604297] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:34:26.225568] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-06T21:34:26.919525] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T21:34:27.025530] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-06T21:34:27.224068] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-06T21:34:27.673880] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T21:34:27.825552] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-06T21:34:28.194853] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-06T21:34:28.477137] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-06T21:34:28.625545] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-06T21:34:29.425567] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-06T21:34:30.098351] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T21:34:30.225504] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-06T21:34:31.025546] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-06T21:34:31.640408] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T21:34:31.755578] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-06T21:34:31.775025] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T21:34:31.825554] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-06T21:34:32.538917] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-06T21:34:32.625584] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-06T21:34:33.425569] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-06T21:34:33.794036] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T21:34:34.225592] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-06T21:34:35.025561] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-06T21:34:35.740804] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T21:34:35.801094] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T21:34:35.825467] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-06T21:34:36.284826] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.86 seconds). [2025-10-06T21:34:36.391614] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-06T21:34:36.625576] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-06T21:34:37.425598] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-06T21:34:37.997546] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T21:34:38.225523] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-06T21:34:38.901934] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T21:34:39.025515] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-06T21:34:39.100562] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T21:34:39.825749] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-06T21:34:40.625556] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-06T21:34:41.263196] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-06T21:34:41.301031] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T21:34:41.425567] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-06T21:34:41.486566] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-06T21:34:42.225525] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-06T21:34:42.514498] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T21:34:43.025540] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-06T21:34:43.825615] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-06T21:34:44.426477] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-06T21:34:44.636359] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-06T21:34:44.663833] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-06T21:34:44.682843] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T21:34:45.425550] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-06T21:34:45.845455] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T21:34:46.225531] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-06T21:34:47.025596] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-06T21:34:47.726294] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T21:34:47.825525] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-06T21:34:47.926418] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T21:34:47.930234] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-06T21:34:48.625541] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-06T21:34:49.137945] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T21:34:49.425608] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-06T21:34:49.904516] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T21:34:49.905401] [INFO ] [REMOTE ] SNDA: Full fetch complete (7900 records). [2025-10-06T21:34:49.905476] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-06T21:34:50.239768] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-06T21:34:50.293361] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-06T21:34:50.293474] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-06T21:34:50.293779] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-06T21:34:50.293844] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-06T21:34:50.294670] [DEBUG] [LOCAL ] SNDA: Trimmed 7900 records to 4441 (keeping 200 days of data) [2025-10-06T21:34:50.325949] [DEBUG] [LOCAL ] SNDA: Primary data saved (4441 records). [2025-10-06T21:34:50.326179] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-06T21:34:50.326341] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SNDA took 27.5s. Estimated remaining: 59m 30s. Rate: 7.1 symbols/min [2025-10-06T21:34:50.510437] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:34:50.559150] [DEBUG] [LOCAL ] SNN: Loaded 44843 existing records from primary storage. [2025-10-06T21:34:50.559546] [INFO ] [MAIN ] SNN: Loaded 44843 existing records. [2025-10-06T21:34:50.767629] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:34:50.768056] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-06T21:34:50.768163] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-06T21:34:50.768691] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-06T21:34:50.768754] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-06T21:34:50.890106] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-06T21:34:50.935762] [INFO ] [REMOTE ] SNAP: Full fetch complete (77934 records). [2025-10-06T21:34:50.955284] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-06T21:34:51.031959] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-06T21:34:51.417363] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:34:51.662097] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-06T21:34:51.661953] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T21:34:51.662284] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-06T21:34:51.664405] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-06T21:34:51.666882] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-06T21:34:51.668421] [INFO ] [REMOTE ] SNDR: Full fetch complete (59411 records). [2025-10-06T21:34:51.668905] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-06T21:34:51.704196] [DEBUG] [LOCAL ] SNAP: Trimmed 77934 records to 53796 (keeping 200 days of data) [2025-10-06T21:34:51.834977] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-06T21:34:52.122863] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T21:34:52.143984] [INFO ] [REMOTE ] SNA: Full fetch complete (38784 records). [2025-10-06T21:34:52.145681] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-06T21:34:52.343396] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-06T21:34:52.356420] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-06T21:34:52.366850] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-06T21:34:52.370706] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-06T21:34:52.465332] [DEBUG] [LOCAL ] SNDR: Trimmed 59411 records to 40957 (keeping 200 days of data) [2025-10-06T21:34:52.792386] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-06T21:34:52.793083] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-06T21:34:52.795437] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-06T21:34:52.796099] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-06T21:34:52.894266] [DEBUG] [LOCAL ] SNA: Trimmed 38784 records to 25712 (keeping 200 days of data) [2025-10-06T21:34:53.332542] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T21:34:53.377150] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-06T21:34:53.423822] [DEBUG] [LOCAL ] SNA: Primary data saved (25712 records). [2025-10-06T21:34:53.428350] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-06T21:34:53.428631] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SNA took 47.7s. Estimated remaining: 59m 20s. Rate: 7.1 symbols/min [2025-10-06T21:34:53.503014] [DEBUG] [LOCAL ] SNDR: Primary data saved (40957 records). [2025-10-06T21:34:53.554345] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-06T21:34:53.561283] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SNDR took 28.9s. Estimated remaining: 59m 10s. Rate: 7.1 symbols/min [2025-10-06T21:34:53.623154] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-10-06T21:34:53.658247] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-06T21:34:53.677887] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNAP took 40.4s. Estimated remaining: 58m 60s. Rate: 7.1 symbols/min [2025-10-06T21:34:53.733905] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:34:53.956167] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:34:54.029303] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:34:54.107366] [DEBUG] [LOCAL ] SNOW: Loaded 54371 existing records from primary storage. [2025-10-06T21:34:54.108738] [INFO ] [MAIN ] SNOW: Loaded 54371 existing records. [2025-10-06T21:34:54.193408] [DEBUG] [LOCAL ] SNV: Loaded 49620 existing records from primary storage. [2025-10-06T21:34:54.228517] [DEBUG] [LOCAL ] SNX: Loaded 40653 existing records from primary storage. [2025-10-06T21:34:54.217254] [INFO ] [MAIN ] SNV: Loaded 49620 existing records. [2025-10-06T21:34:54.250285] [INFO ] [MAIN ] SNX: Loaded 40653 existing records. [2025-10-06T21:34:54.601857] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:34:54.623217] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-06T21:34:54.629893] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-06T21:34:54.661356] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-06T21:34:54.671989] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-06T21:34:54.839307] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:34:54.906453] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:34:54.939468] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-06T21:34:54.939880] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-06T21:34:54.917087] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-06T21:34:54.940532] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-06T21:34:54.940685] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-06T21:34:54.941419] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-06T21:34:54.946919] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-06T21:34:54.985757] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-06T21:34:55.372616] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-06T21:34:55.453806] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-06T21:34:55.723935] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:34:55.802455] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-06T21:34:56.078314] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:34:56.099924] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:34:56.100457] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-06T21:34:56.100199] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-06T21:34:57.110560] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T21:34:57.118911] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-06T21:34:57.357838] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-06T21:34:57.425537] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-06T21:34:57.550703] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T21:34:57.936827] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-06T21:34:58.225537] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-06T21:34:58.657477] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T21:34:58.759169] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T21:34:59.025574] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-06T21:34:59.825534] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-06T21:35:00.407150] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-06T21:35:00.625569] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-06T21:35:00.717926] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T21:35:01.415126] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T21:35:01.425470] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-06T21:35:02.225527] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-06T21:35:02.953595] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-06T21:35:03.025582] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-06T21:35:03.332236] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T21:35:03.825529] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-06T21:35:03.863535] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T21:35:04.625563] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-06T21:35:04.757101] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T21:35:05.425533] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-06T21:35:05.511419] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T21:35:06.225524] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-06T21:35:06.778558] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-06T21:35:07.025613] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-06T21:35:07.717258] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-06T21:35:07.790822] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T21:35:07.825501] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-06T21:35:08.625523] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-06T21:35:08.745284] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T21:35:09.425601] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-06T21:35:10.225595] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-06T21:35:10.440721] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T21:35:10.679414] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-10-06T21:35:11.025515] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-06T21:35:11.064417] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T21:35:11.825600] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-06T21:35:12.625503] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-06T21:35:12.750868] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-06T21:35:13.271166] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T21:35:13.425552] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-06T21:35:14.225605] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-06T21:35:14.295435] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T21:35:14.406109] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (4.18 seconds). [2025-10-06T21:35:14.680313] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T21:35:15.025533] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-06T21:35:15.719305] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T21:35:15.825534] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-06T21:35:16.213112] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T21:35:16.215680] [INFO ] [REMOTE ] SNN: Full fetch complete (63060 records). [2025-10-06T21:35:16.215818] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-06T21:35:16.610085] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-06T21:35:16.610223] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-06T21:35:16.611369] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-06T21:35:16.611471] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-06T21:35:16.612982] [DEBUG] [LOCAL ] SNN: Trimmed 63060 records to 44125 (keeping 200 days of data) [2025-10-06T21:35:16.666260] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-06T21:35:16.894620] [DEBUG] [LOCAL ] SNN: Primary data saved (44125 records). [2025-10-06T21:35:16.894874] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-06T21:35:16.895013] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SNN took 26.6s. Estimated remaining: 58m 54s. Rate: 7.1 symbols/min [2025-10-06T21:35:17.067772] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:35:17.118956] [DEBUG] [LOCAL ] SO: Loaded 54386 existing records from primary storage. [2025-10-06T21:35:17.119335] [INFO ] [MAIN ] SO: Loaded 54386 existing records. [2025-10-06T21:35:17.297616] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:35:17.297925] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-06T21:35:17.298027] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-06T21:35:17.298345] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-06T21:35:17.298404] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-06T21:35:17.434606] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-06T21:35:17.506443] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T21:35:17.709335] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:35:18.225523] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-06T21:35:19.025501] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-06T21:35:19.187590] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-06T21:35:19.819774] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-06T21:35:19.828590] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-06T21:35:19.998164] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T21:35:20.422757] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T21:35:20.625564] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-06T21:35:21.425540] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-06T21:35:21.947897] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T21:35:21.951417] [INFO ] [REMOTE ] SNX: Full fetch complete (57270 records). [2025-10-06T21:35:21.951539] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-06T21:35:22.229470] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-06T21:35:22.352199] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-06T21:35:22.352398] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-06T21:35:22.353494] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-06T21:35:22.353579] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-06T21:35:22.382922] [DEBUG] [LOCAL ] SNX: Trimmed 57270 records to 40138 (keeping 200 days of data) [2025-10-06T21:35:22.385387] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-06T21:35:22.651830] [DEBUG] [LOCAL ] SNX: Primary data saved (40138 records). [2025-10-06T21:35:22.651999] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-06T21:35:22.652079] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNX took 29.0s. Estimated remaining: 58m 45s. Rate: 7.1 symbols/min [2025-10-06T21:35:22.831275] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:35:22.871141] [DEBUG] [LOCAL ] SOBO: Loaded 40076 existing records from primary storage. [2025-10-06T21:35:22.871530] [INFO ] [MAIN ] SOBO: Loaded 40076 existing records. [2025-10-06T21:35:23.028595] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-06T21:35:23.070484] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:35:23.071089] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-06T21:35:23.071305] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-06T21:35:23.071670] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-06T21:35:23.071780] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-06T21:35:23.399354] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-06T21:35:23.488314] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:35:23.825509] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-06T21:35:24.120163] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-06T21:35:24.625542] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-06T21:35:25.425551] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-06T21:35:25.487555] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-06T21:35:25.598981] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T21:35:25.816606] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-06T21:35:26.225523] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-06T21:35:26.833082] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T21:35:27.025594] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-06T21:35:27.755508] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T21:35:27.825549] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-06T21:35:28.620422] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T21:35:28.629123] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-06T21:35:29.425605] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-06T21:35:29.910231] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-06T21:35:30.225532] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-06T21:35:30.838162] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T21:35:31.025559] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-06T21:35:31.751288] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (3.12 seconds). [2025-10-06T21:35:31.825589] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-06T21:35:32.545382] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T21:35:32.596272] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-06T21:35:32.625474] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-06T21:35:33.160545] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T21:35:33.163562] [INFO ] [REMOTE ] SNV: Full fetch complete (71261 records). [2025-10-06T21:35:33.163718] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-06T21:35:33.430747] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-06T21:35:33.576823] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-06T21:35:33.576940] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-06T21:35:33.579095] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-06T21:35:33.579174] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-06T21:35:33.581567] [DEBUG] [LOCAL ] SNV: Trimmed 71261 records to 48866 (keeping 200 days of data) [2025-10-06T21:35:33.917409] [DEBUG] [LOCAL ] SNV: Primary data saved (48866 records). [2025-10-06T21:35:33.917591] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-06T21:35:33.917708] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNV took 40.3s. Estimated remaining: 58m 37s. Rate: 7.1 symbols/min [2025-10-06T21:35:34.085115] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:35:34.141765] [DEBUG] [LOCAL ] SOC: Loaded 51206 existing records from primary storage. [2025-10-06T21:35:34.142810] [INFO ] [MAIN ] SOC: Loaded 51206 existing records. [2025-10-06T21:35:34.234478] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-06T21:35:34.335509] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:35:34.335853] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-06T21:35:34.335914] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-06T21:35:34.336196] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-06T21:35:34.336273] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-06T21:35:34.519136] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-06T21:35:34.580599] [INFO ] [REMOTE ] SNOW: Full fetch complete (77652 records). [2025-10-06T21:35:34.606457] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-06T21:35:34.902557] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:35:35.030341] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-06T21:35:35.148087] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-06T21:35:35.148207] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-06T21:35:35.149670] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-06T21:35:35.149771] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-06T21:35:35.151596] [DEBUG] [LOCAL ] SNOW: Trimmed 77652 records to 53593 (keeping 200 days of data) [2025-10-06T21:35:35.408822] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-06T21:35:35.529178] [DEBUG] [LOCAL ] SNOW: Primary data saved (53593 records). [2025-10-06T21:35:35.529351] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-06T21:35:35.529452] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SNOW took 42.1s. Estimated remaining: 58m 27s. Rate: 7.1 symbols/min [2025-10-06T21:35:35.704891] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:35:35.713321] [DEBUG] [LOCAL ] SOJC: Loaded 5079 existing records from primary storage. [2025-10-06T21:35:35.713570] [INFO ] [MAIN ] SOJC: Loaded 5079 existing records. [2025-10-06T21:35:35.828379] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-06T21:35:35.922639] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:35:35.925699] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T21:35:35.925897] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-06T21:35:35.926060] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-06T21:35:35.935839] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-06T21:35:35.936145] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-06T21:35:36.289547] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:35:36.322608] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T21:35:36.625560] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-06T21:35:37.425503] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-06T21:35:38.222136] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-06T21:35:38.230743] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-06T21:35:38.993570] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-06T21:35:39.030582] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-06T21:35:39.042353] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T21:35:39.311753] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (3.48 seconds). [2025-10-06T21:35:39.690771] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-06T21:35:39.825524] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-06T21:35:40.625552] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-06T21:35:41.132720] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T21:35:41.196938] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-06T21:35:41.425543] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-06T21:35:42.225550] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-06T21:35:43.025575] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-06T21:35:43.323912] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-06T21:35:43.832041] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-06T21:35:43.851634] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T21:35:44.550449] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T21:35:44.625493] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-06T21:35:45.425531] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-06T21:35:45.854142] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-06T21:35:46.159828] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-06T21:35:46.225488] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-06T21:35:46.337270] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T21:35:47.025572] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-06T21:35:47.825549] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-06T21:35:48.103056] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T21:35:48.477212] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T21:35:48.625487] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-06T21:35:48.675608] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-06T21:35:49.425610] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-06T21:35:49.957474] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-06T21:35:50.162491] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T21:35:50.225560] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-06T21:35:51.025591] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-06T21:35:51.671826] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-06T21:35:51.825551] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-06T21:35:52.625524] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-06T21:35:53.160349] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-10-06T21:35:53.277751] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-06T21:35:53.425520] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-06T21:35:54.225535] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-06T21:35:54.807923] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (2.98 seconds). [2025-10-06T21:35:54.855768] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-06T21:35:54.866162] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T21:35:55.025573] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-06T21:35:55.638675] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-06T21:35:55.825542] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-06T21:35:56.307195] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T21:35:56.308070] [INFO ] [REMOTE ] SOJC: Full fetch complete (7718 records). [2025-10-06T21:35:56.308141] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-06T21:35:56.630750] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-06T21:35:56.699228] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-06T21:35:56.699326] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-06T21:35:56.699668] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-06T21:35:56.699732] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-06T21:35:56.700214] [DEBUG] [LOCAL ] SOJC: Trimmed 7718 records to 4991 (keeping 200 days of data) [2025-10-06T21:35:56.730740] [DEBUG] [LOCAL ] SOJC: Primary data saved (4991 records). [2025-10-06T21:35:56.730854] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-06T21:35:56.730942] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SOJC took 21.2s. Estimated remaining: 58m 22s. Rate: 7.1 symbols/min [2025-10-06T21:35:57.147095] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-06T21:35:57.151721] [INFO ] [REMOTE ] SO: Full fetch complete (77594 records). [2025-10-06T21:35:57.151889] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-06T21:35:57.430615] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-06T21:35:57.547009] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-06T21:35:57.547115] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-06T21:35:57.548313] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-06T21:35:57.548380] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-06T21:35:57.550026] [DEBUG] [LOCAL ] SO: Trimmed 77594 records to 53607 (keeping 200 days of data) [2025-10-06T21:35:57.883033] [DEBUG] [LOCAL ] SO: Primary data saved (53607 records). [2025-10-06T21:35:57.883215] [INFO ] [MAIN ] SO: Full history saved. [2025-10-06T21:35:57.883305] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SO took 41.0s. Estimated remaining: 58m 12s. Rate: 7.1 symbols/min [2025-10-06T21:35:58.225592] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-06T21:35:58.621876] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T21:35:58.624518] [INFO ] [REMOTE ] SOBO: Full fetch complete (58393 records). [2025-10-06T21:35:58.624615] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-06T21:35:59.017074] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-06T21:35:59.017167] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-06T21:35:59.018163] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-06T21:35:59.018227] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-06T21:35:59.019444] [DEBUG] [LOCAL ] SOBO: Trimmed 58393 records to 39388 (keeping 200 days of data) [2025-10-06T21:35:59.267698] [DEBUG] [LOCAL ] SOBO: Primary data saved (39388 records). [2025-10-06T21:35:59.267898] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-06T21:35:59.267991] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SOBO took 36.6s. Estimated remaining: 58m 2s. Rate: 7.1 symbols/min [2025-10-06T21:35:59.925590] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T21:35:59.937222] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-06T21:36:01.783761] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-06T21:36:01.795384] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-06T21:36:03.536409] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-06T21:36:03.547157] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-06T21:36:05.480263] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-06T21:36:05.492435] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-06T21:36:07.069792] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-06T21:36:07.073716] [INFO ] [REMOTE ] SOC: Full fetch complete (71707 records). [2025-10-06T21:36:07.073951] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-06T21:36:07.483664] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-06T21:36:07.483799] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-06T21:36:07.484972] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-06T21:36:07.485043] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-06T21:36:07.486928] [DEBUG] [LOCAL ] SOC: Trimmed 71707 records to 50526 (keeping 200 days of data) [2025-10-06T21:36:07.802198] [DEBUG] [LOCAL ] SOC: Primary data saved (50526 records). [2025-10-06T21:36:07.802391] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-06T21:36:07.802528] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 33.9s. Estimated remaining: 57m 53s. Rate: 7.1 symbols/min [2025-10-06T21:36:08.471758] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:36:08.517872] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:36:08.560787] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:36:08.563732] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:36:08.564436] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-06T21:36:08.564729] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-06T21:36:08.564882] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-06T21:36:08.564942] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-06T21:36:08.565124] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-06T21:36:08.565168] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-06T21:36:08.683677] [DEBUG] [LOCAL ] SOJE: Loaded 9451 existing records from primary storage. [2025-10-06T21:36:08.699602] [INFO ] [MAIN ] SOJE: Loaded 9451 existing records. [2025-10-06T21:36:08.694269] [DEBUG] [LOCAL ] SOJD: Loaded 13256 existing records from primary storage. [2025-10-06T21:36:08.748714] [DEBUG] [LOCAL ] SOL: Loaded 13504 existing records from primary storage. [2025-10-06T21:36:08.789550] [INFO ] [MAIN ] SOJD: Loaded 13256 existing records. [2025-10-06T21:36:08.912548] [INFO ] [MAIN ] SOL: Loaded 13504 existing records. [2025-10-06T21:36:09.231298] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:36:09.298422] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-06T21:36:09.379334] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-06T21:36:09.496768] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:36:09.504310] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:36:09.504589] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-06T21:36:09.500918] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:36:09.505325] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-06T21:36:09.505473] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-06T21:36:09.505046] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-06T21:36:09.504851] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-06T21:36:09.506783] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-06T21:36:09.506690] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-06T21:36:09.506893] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-06T21:36:09.518248] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-06T21:36:09.536849] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-06T21:36:09.547391] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-06T21:36:09.774527] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:36:09.858036] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-06T21:36:09.910800] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:36:09.965683] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-06T21:36:10.075250] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:36:10.118136] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-06T21:36:10.137581] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-06T21:36:10.204023] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-06T21:36:10.218611] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-06T21:36:10.248974] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJF took 2.4s. Estimated remaining: 57m 44s. Rate: 7.1 symbols/min [2025-10-06T21:36:10.832188] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:36:10.863849] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:36:10.896731] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-06T21:36:10.896273] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:36:10.892740] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:36:10.898044] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-06T21:36:10.897362] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-06T21:36:10.945230] [DEBUG] [LOCAL ] SOLV: Loaded 44593 existing records from primary storage. [2025-10-06T21:36:10.945625] [INFO ] [MAIN ] SOLV: Loaded 44593 existing records. [2025-10-06T21:36:11.128037] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:36:11.128374] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-06T21:36:11.128426] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-06T21:36:11.128835] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-06T21:36:11.128895] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-06T21:36:11.487575] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:36:11.487970] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-06T21:36:11.964803] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T21:36:11.969632] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-06T21:36:12.048524] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T21:36:12.053696] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-06T21:36:12.096925] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-06T21:36:12.101908] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-06T21:36:12.747891] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T21:36:12.750790] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-06T21:36:13.053611] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T21:36:13.062999] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-06T21:36:13.096427] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T21:36:13.100118] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-06T21:36:13.157275] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-06T21:36:13.162421] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-06T21:36:13.474219] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-06T21:36:13.476794] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-06T21:36:13.648945] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-06T21:36:13.652683] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-06T21:36:14.096007] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T21:36:14.099377] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-06T21:36:14.415776] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T21:36:14.419022] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-06T21:36:14.571927] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-06T21:36:14.615068] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T21:36:15.026186] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-06T21:36:15.026119] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-06T21:36:15.199505] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T21:36:15.825501] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-06T21:36:15.968263] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-06T21:36:16.625562] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-06T21:36:16.757309] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T21:36:17.425556] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-06T21:36:17.561479] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T21:36:18.225566] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-06T21:36:19.025584] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-06T21:36:19.051813] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T21:36:19.825498] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-06T21:36:19.878878] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T21:36:20.062478] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-06T21:36:20.625498] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-06T21:36:20.950145] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-06T21:36:21.425560] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-06T21:36:21.475874] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-06T21:36:21.954388] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-06T21:36:22.225544] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-06T21:36:23.025621] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-06T21:36:23.825581] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-06T21:36:23.896097] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T21:36:23.996919] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-06T21:36:24.625543] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-06T21:36:24.804542] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T21:36:25.425550] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-06T21:36:26.225575] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-06T21:36:26.316323] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T21:36:26.388121] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T21:36:26.970968] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T21:36:27.025627] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-06T21:36:27.767241] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T21:36:27.825544] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-06T21:36:28.553976] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T21:36:28.625596] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-06T21:36:29.425562] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-06T21:36:30.230920] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-06T21:36:30.250190] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T21:36:30.270355] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T21:36:31.025547] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-06T21:36:31.191600] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-06T21:36:31.825561] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-06T21:36:31.832133] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T21:36:31.834233] [INFO ] [REMOTE ] SOL: Full fetch complete (21439 records). [2025-10-06T21:36:31.834317] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-06T21:36:32.245671] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-06T21:36:32.246058] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-06T21:36:32.246746] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-06T21:36:32.246827] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-06T21:36:32.248084] [DEBUG] [LOCAL ] SOL: Trimmed 21439 records to 12968 (keeping 200 days of data) [2025-10-06T21:36:32.329049] [DEBUG] [LOCAL ] SOL: Primary data saved (12968 records). [2025-10-06T21:36:32.329231] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-06T21:36:32.329334] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOL took 24.5s. Estimated remaining: 57m 38s. Rate: 7.1 symbols/min [2025-10-06T21:36:32.514027] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:36:32.514241] [DEBUG] [LOCAL ] SON: No existing data file found in primary storage. [2025-10-06T21:36:32.514281] [WARN ] [MAIN ] SON: No existing data found, performing full refresh instead. [2025-10-06T21:36:32.514539] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-06T21:36:32.514582] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-06T21:36:32.514627] [DEBUG] [LOCAL ] SON: No primary data file found to delete. [2025-10-06T21:36:32.514702] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-06T21:36:32.630860] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-06T21:36:32.837673] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-06T21:36:32.934296] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:36:33.425554] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-06T21:36:34.225589] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-06T21:36:34.662255] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-06T21:36:34.716143] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-06T21:36:34.717456] [INFO ] [REMOTE ] SOJD: Full fetch complete (19681 records). [2025-10-06T21:36:34.717546] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-06T21:36:35.029585] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-06T21:36:35.113590] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-06T21:36:35.113785] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-06T21:36:35.114864] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-06T21:36:35.115002] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-06T21:36:35.140444] [DEBUG] [LOCAL ] SOJD: Trimmed 19681 records to 13021 (keeping 200 days of data) [2025-10-06T21:36:35.143137] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T21:36:35.238926] [DEBUG] [LOCAL ] SOJD: Primary data saved (13021 records). [2025-10-06T21:36:35.239111] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-06T21:36:35.239219] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJD took 27.4s. Estimated remaining: 57m 28s. Rate: 7.1 symbols/min [2025-10-06T21:36:35.430944] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:36:35.495180] [DEBUG] [LOCAL ] SONY: Loaded 54137 existing records from primary storage. [2025-10-06T21:36:35.495624] [INFO ] [MAIN ] SONY: Loaded 54137 existing records. [2025-10-06T21:36:35.681828] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:36:35.682089] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-06T21:36:35.682137] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-06T21:36:35.682697] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-06T21:36:35.682765] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-06T21:36:35.834081] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-06T21:36:36.086970] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:36:36.480410] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T21:36:36.481612] [INFO ] [REMOTE ] SOJE: Full fetch complete (14204 records). [2025-10-06T21:36:36.481714] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-06T21:36:36.631851] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-06T21:36:36.805779] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T21:36:36.901169] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-06T21:36:36.901270] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-06T21:36:36.901832] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-06T21:36:36.901896] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-06T21:36:36.902685] [DEBUG] [LOCAL ] SOJE: Trimmed 14204 records to 9191 (keeping 200 days of data) [2025-10-06T21:36:36.966784] [DEBUG] [LOCAL ] SOJE: Primary data saved (9191 records). [2025-10-06T21:36:36.967331] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-06T21:36:36.967535] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOJE took 29.2s. Estimated remaining: 57m 19s. Rate: 7.1 symbols/min [2025-10-06T21:36:37.142209] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:36:37.148302] [DEBUG] [LOCAL ] SOR: Loaded 2899 existing records from primary storage. [2025-10-06T21:36:37.148531] [INFO ] [MAIN ] SOR: Loaded 2899 existing records. [2025-10-06T21:36:37.326272] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:36:37.326583] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-06T21:36:37.326638] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-06T21:36:37.326889] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-06T21:36:37.326948] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-06T21:36:37.430610] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-06T21:36:37.723440] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:36:38.225500] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-06T21:36:38.255220] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T21:36:38.744308] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-06T21:36:39.025533] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-06T21:36:39.488889] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-06T21:36:39.825534] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-06T21:36:40.504600] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T21:36:40.625522] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-06T21:36:41.221808] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T21:36:41.423699] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T21:36:41.433017] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-06T21:36:42.225587] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-06T21:36:42.746727] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-06T21:36:43.025534] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-06T21:36:43.154541] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T21:36:43.825595] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-06T21:36:44.625562] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-06T21:36:44.846785] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T21:36:45.426272] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-06T21:36:45.426414] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-06T21:36:45.711945] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T21:36:46.225543] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-06T21:36:47.025513] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-06T21:36:47.075105] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T21:36:47.580829] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-06T21:36:47.825511] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-06T21:36:48.078160] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T21:36:48.625588] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-06T21:36:49.026565] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T21:36:49.029542] [INFO ] [REMOTE ] SOLV: Full fetch complete (63341 records). [2025-10-06T21:36:49.029693] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-06T21:36:49.436030] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-06T21:36:49.432224] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-06T21:36:49.436322] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-06T21:36:49.437934] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-06T21:36:49.438106] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-06T21:36:49.441364] [DEBUG] [LOCAL ] SOLV: Trimmed 63341 records to 44006 (keeping 200 days of data) [2025-10-06T21:36:49.724809] [DEBUG] [LOCAL ] SOLV: Primary data saved (44006 records). [2025-10-06T21:36:49.724975] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-06T21:36:49.725099] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOLV took 39.4s. Estimated remaining: 57m 11s. Rate: 7.1 symbols/min [2025-10-06T21:36:49.907360] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:36:49.920747] [DEBUG] [LOCAL ] SOS: Loaded 8947 existing records from primary storage. [2025-10-06T21:36:49.921100] [INFO ] [MAIN ] SOS: Loaded 8947 existing records. [2025-10-06T21:36:50.113385] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:36:50.113801] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-06T21:36:50.113862] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-06T21:36:50.114041] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-06T21:36:50.114099] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-06T21:36:50.227875] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-06T21:36:50.497511] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-06T21:36:50.551903] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:36:51.025543] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-06T21:36:51.110213] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-06T21:36:51.554919] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-06T21:36:51.825540] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-06T21:36:52.430590] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-06T21:36:52.491911] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-06T21:36:52.625588] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-06T21:36:53.425551] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-06T21:36:54.225590] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-06T21:36:54.752797] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-06T21:36:54.759507] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-06T21:36:55.025583] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-06T21:36:55.591675] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-06T21:36:55.825546] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-06T21:36:56.625593] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-06T21:36:56.637937] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T21:36:56.995531] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-06T21:36:57.425542] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-06T21:36:58.064346] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-06T21:36:58.225524] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-06T21:36:58.411038] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T21:36:58.766451] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-06T21:36:59.025617] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-06T21:36:59.825552] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-06T21:37:00.506609] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T21:37:00.625616] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-06T21:37:01.425494] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-06T21:37:01.910223] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-06T21:37:01.981556] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-06T21:37:02.225497] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-06T21:37:02.342492] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T21:37:02.565838] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-06T21:37:03.025587] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-06T21:37:03.825539] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-06T21:37:04.319037] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-06T21:37:04.579868] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T21:37:04.582743] [INFO ] [REMOTE ] SON: Full fetch complete (62429 records). [2025-10-06T21:37:04.582846] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-06T21:37:04.630661] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-06T21:37:04.998295] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-06T21:37:04.998407] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-06T21:37:04.999986] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-06T21:37:05.000059] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-06T21:37:05.001802] [DEBUG] [LOCAL ] SON: Trimmed 62429 records to 43043 (keeping 200 days of data) [2025-10-06T21:37:05.280877] [DEBUG] [LOCAL ] SON: Primary data saved (43043 records). [2025-10-06T21:37:05.281043] [INFO ] [MAIN ] SON: Full history saved. [2025-10-06T21:37:05.281127] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SON took 33.0s. Estimated remaining: 57m 4s. Rate: 7.1 symbols/min [2025-10-06T21:37:05.431471] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-06T21:37:05.469541] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:37:05.521055] [DEBUG] [LOCAL ] SPB: Loaded 34451 existing records from primary storage. [2025-10-06T21:37:05.521460] [INFO ] [MAIN ] SPB: Loaded 34451 existing records. [2025-10-06T21:37:05.718340] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:37:05.718633] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-06T21:37:05.718719] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-06T21:37:05.719087] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-06T21:37:05.719151] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-06T21:37:06.029143] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-06T21:37:06.186852] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:37:06.225512] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-06T21:37:06.606595] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T21:37:06.607477] [INFO ] [REMOTE ] SOR: Full fetch complete (4384 records). [2025-10-06T21:37:06.607552] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-06T21:37:06.995670] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-06T21:37:06.995779] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-06T21:37:06.995951] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-06T21:37:06.995990] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-06T21:37:06.996339] [DEBUG] [LOCAL ] SOR: Trimmed 4384 records to 2872 (keeping 200 days of data) [2025-10-06T21:37:07.014563] [DEBUG] [LOCAL ] SOR: Primary data saved (2872 records). [2025-10-06T21:37:07.014681] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-06T21:37:07.014781] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SOR took 30.0s. Estimated remaining: 56m 54s. Rate: 7.1 symbols/min [2025-10-06T21:37:07.027794] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-06T21:37:07.190795] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:37:07.245291] [DEBUG] [LOCAL ] SPCE: Loaded 50695 existing records from primary storage. [2025-10-06T21:37:07.245885] [INFO ] [MAIN ] SPCE: Loaded 50695 existing records. [2025-10-06T21:37:07.431276] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:37:07.431565] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-06T21:37:07.431614] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-06T21:37:07.431873] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-06T21:37:07.431929] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-06T21:37:07.777519] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (3.15 seconds). [2025-10-06T21:37:07.848824] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-06T21:37:07.854732] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:37:08.372806] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T21:37:08.461915] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-06T21:37:08.625544] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-06T21:37:09.425566] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-06T21:37:09.889164] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-06T21:37:10.225495] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-06T21:37:10.660772] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-06T21:37:11.025489] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-06T21:37:11.042701] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-06T21:37:11.825493] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-06T21:37:12.186532] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T21:37:12.625566] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-06T21:37:13.348375] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T21:37:13.425526] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-06T21:37:13.757576] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-06T21:37:14.225542] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-06T21:37:14.767787] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T21:37:15.025554] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-06T21:37:15.825540] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-06T21:37:15.858912] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-06T21:37:15.862329] [INFO ] [REMOTE ] SONY: Full fetch complete (77232 records). [2025-10-06T21:37:15.862455] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-06T21:37:16.281859] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-06T21:37:16.281959] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-06T21:37:16.283192] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-06T21:37:16.283276] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-06T21:37:16.284923] [DEBUG] [LOCAL ] SONY: Trimmed 77232 records to 53364 (keeping 200 days of data) [2025-10-06T21:37:16.609962] [DEBUG] [LOCAL ] SONY: Primary data saved (53364 records). [2025-10-06T21:37:16.610186] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-06T21:37:16.610352] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SONY took 41.4s. Estimated remaining: 56m 46s. Rate: 7.1 symbols/min [2025-10-06T21:37:16.631975] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-06T21:37:16.817603] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:37:16.830496] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T21:37:16.847721] [DEBUG] [LOCAL ] SPE: Loaded 6406 existing records from primary storage. [2025-10-06T21:37:16.847976] [INFO ] [MAIN ] SPE: Loaded 6406 existing records. [2025-10-06T21:37:17.026209] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:37:17.026534] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-06T21:37:17.026608] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-06T21:37:17.026881] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-06T21:37:17.026940] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-06T21:37:17.344572] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T21:37:17.427359] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-06T21:37:17.427259] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:37:18.100993] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-06T21:37:18.225607] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-06T21:37:19.025560] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-06T21:37:19.279456] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-06T21:37:19.355522] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T21:37:19.757748] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-06T21:37:19.825535] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-06T21:37:20.625551] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-06T21:37:20.815097] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T21:37:21.425614] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-06T21:37:22.068971] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T21:37:22.225491] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-06T21:37:22.454001] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T21:37:22.456054] [INFO ] [REMOTE ] SOS: Full fetch complete (11155 records). [2025-10-06T21:37:22.456190] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-06T21:37:22.830408] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-06T21:37:22.830512] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-06T21:37:22.830893] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-06T21:37:22.830960] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-06T21:37:22.831566] [DEBUG] [LOCAL ] SOS: Trimmed 11155 records to 8998 (keeping 200 days of data) [2025-10-06T21:37:22.897342] [DEBUG] [LOCAL ] SOS: Primary data saved (8998 records). [2025-10-06T21:37:22.897618] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-06T21:37:22.897791] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SOS took 33.2s. Estimated remaining: 56m 37s. Rate: 7.1 symbols/min [2025-10-06T21:37:23.039162] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-06T21:37:23.073158] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:37:23.081771] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T21:37:23.132417] [DEBUG] [LOCAL ] SPG: Loaded 51014 existing records from primary storage. [2025-10-06T21:37:23.132878] [INFO ] [MAIN ] SPG: Loaded 51014 existing records. [2025-10-06T21:37:23.324176] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:37:23.324462] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-06T21:37:23.324514] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-06T21:37:23.324785] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-06T21:37:23.324846] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-06T21:37:23.714465] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:37:23.825540] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-06T21:37:24.527204] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-06T21:37:24.625566] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-06T21:37:25.027990] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T21:37:25.425550] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-06T21:37:26.225525] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-06T21:37:26.346032] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T21:37:27.025539] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-06T21:37:27.397184] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-06T21:37:27.686090] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-06T21:37:27.825513] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-06T21:37:27.983721] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T21:37:28.617730] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T21:37:28.625491] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-06T21:37:29.425521] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-06T21:37:30.225499] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-06T21:37:30.296838] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T21:37:30.439024] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T21:37:31.025535] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-06T21:37:31.825513] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-06T21:37:32.226635] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-06T21:37:32.261687] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-06T21:37:32.462677] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-06T21:37:32.625549] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-06T21:37:33.425576] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-06T21:37:34.225551] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-06T21:37:34.898181] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-06T21:37:35.025547] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-06T21:37:35.137353] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T21:37:35.816897] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-06T21:37:35.825469] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-06T21:37:36.287837] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T21:37:36.288838] [INFO ] [REMOTE ] SPE: Full fetch complete (10007 records). [2025-10-06T21:37:36.288961] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-06T21:37:36.630702] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-06T21:37:36.658556] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-06T21:37:36.658967] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-06T21:37:36.659247] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-06T21:37:36.659313] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-06T21:37:36.660196] [DEBUG] [LOCAL ] SPE: Trimmed 10007 records to 6283 (keeping 200 days of data) [2025-10-06T21:37:36.700888] [DEBUG] [LOCAL ] SPE: Primary data saved (6283 records). [2025-10-06T21:37:36.701066] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-06T21:37:36.701158] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SPE took 20.1s. Estimated remaining: 56m 30s. Rate: 7.1 symbols/min [2025-10-06T21:37:36.869684] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:37:36.915117] [DEBUG] [LOCAL ] SPGI: Loaded 46480 existing records from primary storage. [2025-10-06T21:37:36.915505] [INFO ] [MAIN ] SPGI: Loaded 46480 existing records. [2025-10-06T21:37:37.086054] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (4.46 seconds). [2025-10-06T21:37:37.139997] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:37:37.140271] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-06T21:37:37.140321] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-06T21:37:37.140581] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-06T21:37:37.140672] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-06T21:37:37.430919] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-06T21:37:37.506026] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:37:38.225547] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-06T21:37:38.795853] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-06T21:37:39.025505] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-06T21:37:39.212992] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T21:37:39.825496] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-06T21:37:39.923889] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T21:37:40.625556] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-06T21:37:40.918075] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T21:37:41.425500] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-06T21:37:41.774714] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T21:37:42.225562] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-06T21:37:43.035621] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-06T21:37:43.054424] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-06T21:37:43.450587] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-06T21:37:43.693020] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T21:37:43.825530] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-06T21:37:44.442597] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T21:37:44.625616] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-06T21:37:45.425553] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-06T21:37:45.572001] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T21:37:45.883417] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T21:37:46.225581] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-06T21:37:47.025513] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-06T21:37:47.091704] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-06T21:37:47.094790] [INFO ] [REMOTE ] SPCE: Full fetch complete (72393 records). [2025-10-06T21:37:47.094925] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-06T21:37:47.216604] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-06T21:37:47.261838] [INFO ] [REMOTE ] SPB: Full fetch complete (47517 records). [2025-10-06T21:37:47.281372] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-06T21:37:47.684291] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-06T21:37:47.684406] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-06T21:37:47.685694] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-06T21:37:47.695407] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-06T21:37:47.803998] [DEBUG] [LOCAL ] SPCE: Trimmed 72393 records to 49925 (keeping 200 days of data) [2025-10-06T21:37:47.853197] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-06T21:37:47.894910] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-06T21:37:47.895749] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-06T21:37:47.896752] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-06T21:37:47.896890] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-06T21:37:47.899328] [DEBUG] [LOCAL ] SPB: Trimmed 47517 records to 34161 (keeping 200 days of data) [2025-10-06T21:37:48.428262] [DEBUG] [LOCAL ] SPB: Primary data saved (34161 records). [2025-10-06T21:37:48.428404] [DEBUG] [LOCAL ] SPCE: Primary data saved (49925 records). [2025-10-06T21:37:48.428916] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-06T21:37:48.428806] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-06T21:37:48.429091] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPB took 43.1s. Estimated remaining: 56m 22s. Rate: 7.1 symbols/min [2025-10-06T21:37:48.429520] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPCE took 41.4s. Estimated remaining: 56m 12s. Rate: 7.1 symbols/min [2025-10-06T21:37:48.763368] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:37:48.818985] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:37:48.844442] [DEBUG] [LOCAL ] SPH: Loaded 17666 existing records from primary storage. [2025-10-06T21:37:48.844788] [INFO ] [MAIN ] SPH: Loaded 17666 existing records. [2025-10-06T21:37:49.055273] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:37:49.056317] [DEBUG] [LOCAL ] SPHR: Loaded 40745 existing records from primary storage. [2025-10-06T21:37:49.056784] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-06T21:37:49.057015] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-06T21:37:49.056950] [INFO ] [MAIN ] SPHR: Loaded 40745 existing records. [2025-10-06T21:37:49.077964] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-06T21:37:49.078201] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-06T21:37:49.456227] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:37:49.457022] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-06T21:37:49.496598] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-06T21:37:49.581158] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-06T21:37:49.591709] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-06T21:37:49.592881] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-06T21:37:49.698768] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-06T21:37:49.758402] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:37:49.773168] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-06T21:37:50.021376] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-06T21:37:50.125024] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:37:50.225566] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-06T21:37:50.864057] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-06T21:37:51.025631] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-06T21:37:51.601810] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T21:37:51.825625] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-06T21:37:51.981232] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-06T21:37:52.007147] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T21:37:52.625530] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-06T21:37:53.425589] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-06T21:37:53.482414] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-06T21:37:53.827058] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T21:37:54.225627] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-06T21:37:54.674817] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T21:37:54.677803] [INFO ] [REMOTE ] SPG: Full fetch complete (71994 records). [2025-10-06T21:37:54.677924] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-06T21:37:55.036210] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-06T21:37:55.080221] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-06T21:37:55.081076] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-06T21:37:55.082723] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-06T21:37:55.082811] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-06T21:37:55.084489] [DEBUG] [LOCAL ] SPG: Trimmed 71994 records to 50257 (keeping 200 days of data) [2025-10-06T21:37:55.228460] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T21:37:55.477331] [DEBUG] [LOCAL ] SPG: Primary data saved (50257 records). [2025-10-06T21:37:55.477553] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-06T21:37:55.477713] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPG took 32.6s. Estimated remaining: 56m 3s. Rate: 7.1 symbols/min [2025-10-06T21:37:55.665934] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:37:55.709470] [DEBUG] [LOCAL ] SPIR: Loaded 37723 existing records from primary storage. [2025-10-06T21:37:55.709957] [INFO ] [MAIN ] SPIR: Loaded 37723 existing records. [2025-10-06T21:37:55.830560] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-06T21:37:55.915754] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:37:55.916045] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-06T21:37:55.916165] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-06T21:37:55.916464] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-06T21:37:55.916524] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-06T21:37:56.313501] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:37:56.477243] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T21:37:56.625556] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-06T21:37:57.425576] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-06T21:37:57.560613] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T21:37:58.225515] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-06T21:37:58.903110] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T21:37:59.025491] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-06T21:37:59.318225] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-06T21:37:59.825505] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-06T21:37:59.985145] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T21:38:00.343879] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-06T21:38:00.625534] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-06T21:38:01.425510] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-06T21:38:02.009160] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-06T21:38:02.225586] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-06T21:38:02.272750] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T21:38:03.025564] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-06T21:38:03.825510] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-06T21:38:04.041524] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-06T21:38:04.440495] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T21:38:04.625503] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-06T21:38:04.951217] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T21:38:05.007513] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-06T21:38:05.425550] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-06T21:38:06.230606] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-06T21:38:06.245601] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T21:38:07.025596] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-06T21:38:07.110541] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T21:38:07.825519] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-06T21:38:08.093003] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T21:38:08.327236] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-06T21:38:08.625603] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-06T21:38:09.425536] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-06T21:38:09.540326] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T21:38:10.069035] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T21:38:10.225546] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-06T21:38:11.025630] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-06T21:38:11.332408] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T21:38:11.825503] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-06T21:38:12.064360] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-06T21:38:12.625522] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-06T21:38:13.060828] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-06T21:38:13.078478] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T21:38:13.081426] [INFO ] [REMOTE ] SPGI: Full fetch complete (67021 records). [2025-10-06T21:38:13.081541] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-06T21:38:13.429540] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-06T21:38:13.476769] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-06T21:38:13.476927] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-06T21:38:13.484309] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-06T21:38:13.491475] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-06T21:38:13.493014] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T21:38:13.499266] [DEBUG] [LOCAL ] SPGI: Trimmed 67021 records to 45769 (keeping 200 days of data) [2025-10-06T21:38:13.790321] [DEBUG] [LOCAL ] SPGI: Primary data saved (45769 records). [2025-10-06T21:38:13.790492] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-06T21:38:13.791386] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPGI took 37.1s. Estimated remaining: 55m 57s. Rate: 7.1 symbols/min [2025-10-06T21:38:13.958305] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:38:13.967522] [DEBUG] [LOCAL ] SPMC: Loaded 5451 existing records from primary storage. [2025-10-06T21:38:13.967811] [INFO ] [MAIN ] SPMC: Loaded 5451 existing records. [2025-10-06T21:38:14.142477] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:38:14.142739] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-06T21:38:14.142798] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-06T21:38:14.142994] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-06T21:38:14.143052] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-06T21:38:14.231738] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-06T21:38:14.497287] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:38:14.999882] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T21:38:15.025555] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-06T21:38:15.195788] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T21:38:15.825552] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-06T21:38:16.508872] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T21:38:16.625610] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-06T21:38:16.883408] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T21:38:17.241081] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-06T21:38:17.425518] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-06T21:38:18.000628] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-06T21:38:18.225551] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-06T21:38:19.025563] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-06T21:38:19.554813] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-06T21:38:19.825570] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-06T21:38:20.595982] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T21:38:20.625490] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-06T21:38:20.781097] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-06T21:38:21.425622] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-06T21:38:21.869232] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T21:38:21.871722] [INFO ] [REMOTE ] SPIR: Full fetch complete (53071 records). [2025-10-06T21:38:21.871922] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-06T21:38:22.182267] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T21:38:22.232476] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-06T21:38:22.275926] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-06T21:38:22.276013] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-06T21:38:22.277045] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-06T21:38:22.277109] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-06T21:38:22.278272] [DEBUG] [LOCAL ] SPIR: Trimmed 53071 records to 37153 (keeping 200 days of data) [2025-10-06T21:38:22.502614] [DEBUG] [LOCAL ] SPIR: Primary data saved (37153 records). [2025-10-06T21:38:22.502817] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-06T21:38:22.502905] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPIR took 27.0s. Estimated remaining: 55m 48s. Rate: 7.1 symbols/min [2025-10-06T21:38:22.670639] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:38:22.670851] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-06T21:38:22.670888] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-06T21:38:22.671005] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-06T21:38:22.671047] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-06T21:38:22.671086] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-06T21:38:22.671117] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-06T21:38:23.036404] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-06T21:38:23.043189] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T21:38:23.042104] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:38:23.825530] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-06T21:38:24.545520] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T21:38:24.591776] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-06T21:38:24.625534] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-06T21:38:25.237466] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-06T21:38:25.425525] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-06T21:38:25.632829] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:38:25.633164] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-06T21:38:25.633257] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:38:25.633408] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-06T21:38:25.633476] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:38:25.633549] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-06T21:38:25.633617] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-06T21:38:25.633685] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-06T21:38:25.633776] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-06T21:38:25.633846] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPME took 3.1s. Estimated remaining: 55m 39s. Rate: 7.1 symbols/min [2025-10-06T21:38:25.812019] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:38:25.854892] [DEBUG] [LOCAL ] SPNT: Loaded 35308 existing records from primary storage. [2025-10-06T21:38:25.855324] [INFO ] [MAIN ] SPNT: Loaded 35308 existing records. [2025-10-06T21:38:26.038262] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:38:26.038575] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-06T21:38:26.038631] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-06T21:38:26.039047] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-06T21:38:26.039110] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-06T21:38:26.230834] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-06T21:38:26.432622] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:38:26.929426] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-06T21:38:27.025537] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-06T21:38:27.679506] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T21:38:27.680907] [INFO ] [REMOTE ] SPH: Full fetch complete (28201 records). [2025-10-06T21:38:27.680990] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-06T21:38:27.833611] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-06T21:38:28.092581] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-06T21:38:28.092715] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-06T21:38:28.093738] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-06T21:38:28.093809] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-06T21:38:28.095057] [DEBUG] [LOCAL ] SPH: Trimmed 28201 records to 17090 (keeping 200 days of data) [2025-10-06T21:38:28.209674] [DEBUG] [LOCAL ] SPH: Primary data saved (17090 records). [2025-10-06T21:38:28.209869] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-06T21:38:28.209990] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPH took 39.8s. Estimated remaining: 55m 29s. Rate: 7.1 symbols/min [2025-10-06T21:38:28.399342] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:38:28.453314] [DEBUG] [LOCAL ] SPOT: Loaded 51295 existing records from primary storage. [2025-10-06T21:38:28.453717] [INFO ] [MAIN ] SPOT: Loaded 51295 existing records. [2025-10-06T21:38:28.625579] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-06T21:38:28.629172] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:38:28.630834] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-06T21:38:28.630890] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-06T21:38:28.631218] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-06T21:38:28.631277] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-06T21:38:28.997629] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:38:29.321245] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T21:38:29.425547] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-06T21:38:30.101445] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T21:38:30.225519] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-06T21:38:31.025584] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-06T21:38:31.425137] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-06T21:38:31.486519] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-06T21:38:31.665731] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-06T21:38:31.825533] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-06T21:38:32.422187] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T21:38:32.625567] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-06T21:38:33.268602] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T21:38:33.425541] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-06T21:38:34.225564] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-06T21:38:34.787076] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-06T21:38:35.025554] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-06T21:38:35.835292] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-06T21:38:35.841029] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T21:38:36.378045] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-06T21:38:36.625577] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-06T21:38:37.031009] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-06T21:38:37.031986] [INFO ] [REMOTE ] SPMC: Full fetch complete (8113 records). [2025-10-06T21:38:37.032060] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-06T21:38:37.386497] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-06T21:38:37.386590] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-06T21:38:37.386835] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-06T21:38:37.386897] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-06T21:38:37.387304] [DEBUG] [LOCAL ] SPMC: Trimmed 8113 records to 5327 (keeping 200 days of data) [2025-10-06T21:38:37.419151] [DEBUG] [LOCAL ] SPMC: Primary data saved (5327 records). [2025-10-06T21:38:37.419240] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-06T21:38:37.419314] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPMC took 23.6s. Estimated remaining: 55m 21s. Rate: 7.1 symbols/min [2025-10-06T21:38:37.432035] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-06T21:38:37.594315] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:38:37.639499] [DEBUG] [LOCAL ] SPR: Loaded 41819 existing records from primary storage. [2025-10-06T21:38:37.639900] [INFO ] [MAIN ] SPR: Loaded 41819 existing records. [2025-10-06T21:38:37.822857] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:38:37.823161] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-06T21:38:37.823263] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-06T21:38:37.823702] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-06T21:38:37.823867] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-06T21:38:38.008638] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-06T21:38:38.233956] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-06T21:38:38.241535] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:38:39.025540] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-06T21:38:39.140341] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T21:38:39.825548] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-06T21:38:40.379825] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T21:38:40.382564] [INFO ] [REMOTE ] SPHR: Full fetch complete (57917 records). [2025-10-06T21:38:40.382760] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-06T21:38:40.633333] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-06T21:38:40.782472] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-06T21:38:40.797284] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-06T21:38:40.810024] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-06T21:38:40.808958] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-06T21:38:40.819276] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-06T21:38:40.821101] [DEBUG] [LOCAL ] SPHR: Trimmed 57917 records to 40196 (keeping 200 days of data) [2025-10-06T21:38:41.052738] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T21:38:41.087371] [DEBUG] [LOCAL ] SPHR: Primary data saved (40196 records). [2025-10-06T21:38:41.087545] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-06T21:38:41.087632] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPHR took 52.6s. Estimated remaining: 55m 11s. Rate: 7.1 symbols/min [2025-10-06T21:38:41.264415] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:38:41.264719] [DEBUG] [LOCAL ] SPRU: No existing data file found in primary storage. [2025-10-06T21:38:41.264777] [WARN ] [MAIN ] SPRU: No existing data found, performing full refresh instead. [2025-10-06T21:38:41.264953] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-06T21:38:41.265015] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-06T21:38:41.265067] [DEBUG] [LOCAL ] SPRU: No primary data file found to delete. [2025-10-06T21:38:41.265100] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-06T21:38:41.437584] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-06T21:38:41.644509] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:38:41.966439] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-06T21:38:42.225549] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-06T21:38:43.025556] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-06T21:38:43.553757] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-06T21:38:43.599524] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-06T21:38:43.776545] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-06T21:38:43.825481] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-06T21:38:44.625566] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-06T21:38:45.261198] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T21:38:45.425568] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-06T21:38:46.225535] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-06T21:38:46.978317] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T21:38:47.025485] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-06T21:38:47.098865] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-06T21:38:47.686215] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T21:38:47.825493] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-06T21:38:48.393427] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T21:38:48.625540] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-06T21:38:49.213384] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T21:38:49.245510] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T21:38:49.425520] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-06T21:38:50.225602] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-06T21:38:51.025545] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-06T21:38:51.588186] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-06T21:38:51.832983] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-06T21:38:51.838570] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T21:38:51.958673] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-06T21:38:52.625540] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-06T21:38:52.886072] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T21:38:52.888332] [INFO ] [REMOTE ] SPNT: Full fetch complete (49029 records). [2025-10-06T21:38:52.888453] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-06T21:38:53.266424] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-06T21:38:53.266521] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-06T21:38:53.267502] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-06T21:38:53.267566] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-06T21:38:53.268804] [DEBUG] [LOCAL ] SPNT: Trimmed 49029 records to 34818 (keeping 200 days of data) [2025-10-06T21:38:53.442690] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-06T21:38:53.470083] [DEBUG] [LOCAL ] SPNT: Primary data saved (34818 records). [2025-10-06T21:38:53.470220] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-06T21:38:53.470302] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPNT took 27.8s. Estimated remaining: 55m 4s. Rate: 7.1 symbols/min [2025-10-06T21:38:53.651115] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:38:53.676877] [DEBUG] [LOCAL ] SPXC: Loaded 23726 existing records from primary storage. [2025-10-06T21:38:53.677210] [INFO ] [MAIN ] SPXC: Loaded 23726 existing records. [2025-10-06T21:38:53.856631] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:38:53.856899] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-06T21:38:53.856946] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-06T21:38:53.857136] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-06T21:38:53.857194] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-06T21:38:54.123961] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-06T21:38:54.233141] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:38:54.228285] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-06T21:38:54.261277] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T21:38:55.025537] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-06T21:38:55.825532] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-06T21:38:56.623212] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-06T21:38:56.633034] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-06T21:38:56.932308] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-06T21:38:56.985123] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-06T21:38:57.382860] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T21:38:57.425478] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-06T21:38:58.225554] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-06T21:38:59.025638] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-06T21:38:59.653723] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T21:38:59.784196] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-06T21:38:59.825585] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-06T21:39:00.236995] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T21:39:00.625563] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-06T21:39:01.425625] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-06T21:39:01.857399] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-06T21:39:02.115576] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-06T21:39:02.225526] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-06T21:39:03.025591] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-06T21:39:03.343345] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-06T21:39:03.772602] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T21:39:03.825485] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-06T21:39:04.262445] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-06T21:39:04.625547] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-06T21:39:04.933603] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-06T21:39:05.324663] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-06T21:39:05.425529] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-06T21:39:06.225551] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-06T21:39:06.238045] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T21:39:07.025579] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-06T21:39:07.825548] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-06T21:39:07.923119] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T21:39:08.141249] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T21:39:08.625522] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-06T21:39:08.965122] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T21:39:09.425608] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-06T21:39:09.529946] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T21:39:10.225563] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-06T21:39:10.511036] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T21:39:11.025605] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-06T21:39:11.825535] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-06T21:39:12.625609] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-06T21:39:13.530079] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-06T21:39:13.533221] [INFO ] [REMOTE ] SPOT: Full fetch complete (73716 records). [2025-10-06T21:39:13.533357] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-06T21:39:13.852510] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T21:39:13.907331] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-06T21:39:13.959135] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-06T21:39:13.959235] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-06T21:39:13.960794] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-06T21:39:13.961069] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-06T21:39:13.963114] [DEBUG] [LOCAL ] SPOT: Trimmed 73716 records to 50495 (keeping 200 days of data) [2025-10-06T21:39:14.203009] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (3.98 seconds). [2025-10-06T21:39:14.205777] [INFO ] [REMOTE ] SPRU: Full fetch complete (11825 records). [2025-10-06T21:39:14.206377] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-06T21:39:14.617978] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-06T21:39:14.618364] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-06T21:39:14.618911] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-06T21:39:14.618996] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-06T21:39:14.621102] [DEBUG] [LOCAL ] SPRU: Trimmed 11825 records to 9368 (keeping 200 days of data) [2025-10-06T21:39:14.754600] [DEBUG] [LOCAL ] SPRU: Primary data saved (9368 records). [2025-10-06T21:39:14.755637] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-06T21:39:14.756212] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPRU took 33.7s. Estimated remaining: 54m 58s. Rate: 7.1 symbols/min [2025-10-06T21:39:14.926607] [DEBUG] [LOCAL ] SPOT: Primary data saved (50495 records). [2025-10-06T21:39:14.935129] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-06T21:39:14.942412] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPOT took 46.7s. Estimated remaining: 54m 48s. Rate: 7.1 symbols/min [2025-10-06T21:39:14.973861] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:39:15.143491] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:39:15.150178] [DEBUG] [LOCAL ] SPXX: Loaded 9387 existing records from primary storage. [2025-10-06T21:39:15.162539] [INFO ] [MAIN ] SPXX: Loaded 9387 existing records. [2025-10-06T21:39:15.169064] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T21:39:15.227021] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-06T21:39:15.397380] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:39:15.410216] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-06T21:39:15.412228] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-06T21:39:15.413328] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-06T21:39:15.413408] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-06T21:39:15.413287] [DEBUG] [LOCAL ] SQM: Loaded 49334 existing records from primary storage. [2025-10-06T21:39:15.472711] [INFO ] [MAIN ] SQM: Loaded 49334 existing records. [2025-10-06T21:39:15.756563] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (4.73 seconds). [2025-10-06T21:39:15.862346] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:39:15.891866] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-06T21:39:15.892071] [INFO ] [REMOTE ] SPR: Full fetch complete (60118 records). [2025-10-06T21:39:15.892197] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-06T21:39:15.897485] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-06T21:39:15.917176] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-06T21:39:15.960426] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-06T21:39:16.166839] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:39:16.236681] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-06T21:39:16.867677] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:39:16.873303] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T21:39:16.873984] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-06T21:39:16.874142] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-06T21:39:16.879511] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-06T21:39:16.882428] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-06T21:39:16.882962] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-06T21:39:16.883115] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-06T21:39:16.886139] [DEBUG] [LOCAL ] SPR: Trimmed 60118 records to 41111 (keeping 200 days of data) [2025-10-06T21:39:17.114949] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-06T21:39:17.162622] [DEBUG] [LOCAL ] SPR: Primary data saved (41111 records). [2025-10-06T21:39:17.162821] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-06T21:39:17.162922] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPR took 39.7s. Estimated remaining: 54m 38s. Rate: 7.1 symbols/min [2025-10-06T21:39:17.334945] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:39:17.364329] [DEBUG] [LOCAL ] SQNS: Loaded 26708 existing records from primary storage. [2025-10-06T21:39:17.364718] [INFO ] [MAIN ] SQNS: Loaded 26708 existing records. [2025-10-06T21:39:17.435624] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-06T21:39:17.569017] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:39:17.569273] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-06T21:39:17.569323] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-06T21:39:17.569606] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-06T21:39:17.569699] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-06T21:39:17.971831] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:39:18.109107] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T21:39:18.179347] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-06T21:39:18.225479] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-06T21:39:18.982090] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T21:39:19.033775] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-06T21:39:19.039988] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-06T21:39:19.825498] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-06T21:39:20.226520] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T21:39:20.625606] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-06T21:39:21.425500] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-06T21:39:21.483540] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T21:39:21.590977] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T21:39:22.182323] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T21:39:22.225475] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-06T21:39:23.025520] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-06T21:39:23.055718] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-06T21:39:23.825527] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-06T21:39:23.847374] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T21:39:23.849207] [INFO ] [REMOTE ] SPXC: Full fetch complete (34272 records). [2025-10-06T21:39:23.849287] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-06T21:39:24.215676] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-06T21:39:24.215774] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-06T21:39:24.216382] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-06T21:39:24.216451] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-06T21:39:24.217277] [DEBUG] [LOCAL ] SPXC: Trimmed 34272 records to 23358 (keeping 200 days of data) [2025-10-06T21:39:24.359011] [DEBUG] [LOCAL ] SPXC: Primary data saved (23358 records). [2025-10-06T21:39:24.359194] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-06T21:39:24.359289] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPXC took 30.9s. Estimated remaining: 54m 29s. Rate: 7.1 symbols/min [2025-10-06T21:39:24.530787] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:39:24.567756] [DEBUG] [LOCAL ] SR: Loaded 33250 existing records from primary storage. [2025-10-06T21:39:24.568142] [INFO ] [MAIN ] SR: Loaded 33250 existing records. [2025-10-06T21:39:24.630583] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-06T21:39:24.657693] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T21:39:24.790250] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:39:24.790487] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-06T21:39:24.790534] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-06T21:39:24.790793] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-06T21:39:24.790857] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-06T21:39:25.142775] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:39:25.425529] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-06T21:39:26.225510] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-06T21:39:26.259817] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T21:39:26.326279] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T21:39:26.992054] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T21:39:27.025534] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-06T21:39:27.825491] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-06T21:39:28.292479] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-06T21:39:28.421843] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T21:39:28.625539] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-06T21:39:29.425523] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-06T21:39:29.465698] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T21:39:30.225522] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-06T21:39:30.233838] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T21:39:31.025544] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-06T21:39:31.825558] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-06T21:39:31.922754] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T21:39:32.293937] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-06T21:39:32.597339] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-06T21:39:32.625487] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-06T21:39:33.406490] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-06T21:39:33.425468] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-06T21:39:34.215452] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T21:39:34.216992] [INFO ] [REMOTE ] SPXX: Full fetch complete (13191 records). [2025-10-06T21:39:34.217065] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-06T21:39:34.230615] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-06T21:39:34.583571] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-06T21:39:34.583699] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-06T21:39:34.584054] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-06T21:39:34.584096] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-06T21:39:34.584548] [DEBUG] [LOCAL ] SPXX: Trimmed 13191 records to 9334 (keeping 200 days of data) [2025-10-06T21:39:34.641858] [DEBUG] [LOCAL ] SPXX: Primary data saved (9334 records). [2025-10-06T21:39:34.642029] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-06T21:39:34.642119] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXX took 19.9s. Estimated remaining: 54m 21s. Rate: 7.1 symbols/min [2025-10-06T21:39:34.808007] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:39:34.865608] [DEBUG] [LOCAL ] SRE: Loaded 54200 existing records from primary storage. [2025-10-06T21:39:34.866027] [INFO ] [MAIN ] SRE: Loaded 54200 existing records. [2025-10-06T21:39:35.034155] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-06T21:39:35.069767] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:39:35.070947] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-06T21:39:35.071012] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-06T21:39:35.071334] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-06T21:39:35.071399] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-06T21:39:35.468954] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:39:35.825510] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-06T21:39:36.073870] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T21:39:36.530965] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T21:39:36.625508] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-06T21:39:36.641823] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-06T21:39:37.425547] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-06T21:39:38.233393] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-06T21:39:38.243127] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T21:39:38.244622] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T21:39:39.025572] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-06T21:39:39.632250] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T21:39:39.778618] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T21:39:39.825494] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-06T21:39:40.625560] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-06T21:39:40.799260] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T21:39:41.425565] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-06T21:39:42.003154] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T21:39:42.225619] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-06T21:39:43.025563] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-06T21:39:43.179540] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T21:39:43.804251] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T21:39:43.825491] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-06T21:39:44.331319] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T21:39:44.625557] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-06T21:39:45.425520] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-06T21:39:45.508906] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T21:39:46.225530] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-06T21:39:46.933461] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-06T21:39:47.025536] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-06T21:39:47.326778] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-06T21:39:47.825516] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-06T21:39:47.938459] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T21:39:48.083250] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-06T21:39:48.625557] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-06T21:39:49.425529] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-06T21:39:49.529668] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T21:39:50.042265] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T21:39:50.225574] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-06T21:39:50.967344] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T21:39:51.025548] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-06T21:39:51.162330] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T21:39:51.825551] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-06T21:39:52.625704] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-06T21:39:52.835047] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-06T21:39:53.425508] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-06T21:39:53.687912] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T21:39:54.179844] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T21:39:54.182892] [INFO ] [REMOTE ] SQM: Full fetch complete (69042 records). [2025-10-06T21:39:54.183027] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-06T21:39:54.230805] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-06T21:39:54.674569] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-06T21:39:54.674722] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-06T21:39:54.675866] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-06T21:39:54.675930] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-06T21:39:54.677701] [DEBUG] [LOCAL ] SQM: Trimmed 69042 records to 48603 (keeping 200 days of data) [2025-10-06T21:39:54.978462] [DEBUG] [LOCAL ] SQM: Primary data saved (48603 records). [2025-10-06T21:39:54.978671] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-06T21:39:54.978799] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SQM took 40.0s. Estimated remaining: 54m 15s. Rate: 7.1 symbols/min [2025-10-06T21:39:55.031927] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-06T21:39:55.177064] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:39:55.192101] [DEBUG] [LOCAL ] SREA: Loaded 10524 existing records from primary storage. [2025-10-06T21:39:55.192360] [INFO ] [MAIN ] SREA: Loaded 10524 existing records. [2025-10-06T21:39:55.327580] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-06T21:39:55.364332] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T21:39:55.425945] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:39:55.426525] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-06T21:39:55.426577] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-06T21:39:55.426704] [INFO ] [REMOTE ] SR: Full fetch complete (46242 records). [2025-10-06T21:39:55.426813] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-06T21:39:55.426888] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-06T21:39:55.426783] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-06T21:39:55.832760] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-06T21:39:56.127452] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:39:56.189666] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-06T21:39:56.189777] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-06T21:39:56.190706] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-06T21:39:56.190767] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-06T21:39:56.191830] [DEBUG] [LOCAL ] SR: Trimmed 46242 records to 32753 (keeping 200 days of data) [2025-10-06T21:39:56.425204] [DEBUG] [LOCAL ] SR: Primary data saved (32753 records). [2025-10-06T21:39:56.425601] [INFO ] [MAIN ] SR: Full history saved. [2025-10-06T21:39:56.425867] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SR took 32.1s. Estimated remaining: 54m 5s. Rate: 7.1 symbols/min [2025-10-06T21:39:56.559022] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T21:39:56.634499] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-06T21:39:56.672247] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:39:56.718277] [DEBUG] [LOCAL ] SRFM: Loaded 37523 existing records from primary storage. [2025-10-06T21:39:56.718723] [INFO ] [MAIN ] SRFM: Loaded 37523 existing records. [2025-10-06T21:39:56.914351] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:39:56.914610] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-06T21:39:56.914696] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-06T21:39:56.914987] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-06T21:39:56.915047] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-06T21:39:57.302814] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:39:57.425521] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-06T21:39:57.592170] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T21:39:57.846431] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-06T21:39:58.225587] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-06T21:39:58.324880] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-06T21:39:58.326630] [INFO ] [REMOTE ] SQNS: Full fetch complete (32334 records). [2025-10-06T21:39:58.326745] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-06T21:39:58.697964] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-06T21:39:58.698063] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-06T21:39:58.698903] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-06T21:39:58.698971] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-06T21:39:58.699869] [DEBUG] [LOCAL ] SQNS: Trimmed 32334 records to 26701 (keeping 200 days of data) [2025-10-06T21:39:58.858449] [DEBUG] [LOCAL ] SQNS: Primary data saved (26701 records). [2025-10-06T21:39:58.858680] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-06T21:39:58.858817] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SQNS took 41.7s. Estimated remaining: 53m 56s. Rate: 7.1 symbols/min [2025-10-06T21:39:59.030334] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-06T21:39:59.030188] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:39:59.045309] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T21:39:59.060952] [DEBUG] [LOCAL ] SRG: Loaded 15721 existing records from primary storage. [2025-10-06T21:39:59.061259] [INFO ] [MAIN ] SRG: Loaded 15721 existing records. [2025-10-06T21:39:59.245443] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:39:59.245760] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-06T21:39:59.245821] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-06T21:39:59.246054] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-06T21:39:59.246129] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-06T21:39:59.608084] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:39:59.825544] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-06T21:40:00.625498] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-06T21:40:00.913086] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-06T21:40:01.075943] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T21:40:01.407371] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T21:40:01.425562] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-06T21:40:02.225497] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-06T21:40:02.288900] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-06T21:40:03.025522] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-06T21:40:03.825512] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-06T21:40:03.993834] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T21:40:04.331231] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-06T21:40:04.626434] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-06T21:40:04.628457] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-06T21:40:05.425595] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-06T21:40:06.225494] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-06T21:40:06.459205] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T21:40:07.025530] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-06T21:40:07.204140] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-06T21:40:07.308265] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T21:40:07.825563] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-06T21:40:08.420009] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T21:40:08.625560] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-06T21:40:08.957024] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T21:40:09.425527] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-06T21:40:09.513311] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T21:40:10.225578] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-06T21:40:11.025580] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-06T21:40:11.065156] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T21:40:11.144051] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T21:40:11.825520] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-06T21:40:12.293216] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-06T21:40:12.597635] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T21:40:12.625469] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-06T21:40:13.384630] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-06T21:40:13.425519] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-06T21:40:14.144308] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-06T21:40:14.225543] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-06T21:40:15.025514] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-06T21:40:15.340835] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T21:40:15.502571] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T21:40:15.507084] [INFO ] [REMOTE ] SRE: Full fetch complete (77295 records). [2025-10-06T21:40:15.507252] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-06T21:40:15.830698] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-06T21:40:15.914460] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-06T21:40:15.914568] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-06T21:40:15.915821] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-06T21:40:15.915896] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-06T21:40:15.917542] [DEBUG] [LOCAL ] SRE: Trimmed 77295 records to 53416 (keeping 200 days of data) [2025-10-06T21:40:16.267926] [DEBUG] [LOCAL ] SRE: Primary data saved (53416 records). [2025-10-06T21:40:16.268109] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-06T21:40:16.268202] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SRE took 41.6s. Estimated remaining: 53m 49s. Rate: 7.1 symbols/min [2025-10-06T21:40:16.455508] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:40:16.487227] [DEBUG] [LOCAL ] SRI: Loaded 27468 existing records from primary storage. [2025-10-06T21:40:16.487611] [INFO ] [MAIN ] SRI: Loaded 27468 existing records. [2025-10-06T21:40:16.638106] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-06T21:40:16.683249] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:40:16.683806] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-06T21:40:16.683869] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-06T21:40:16.684211] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-06T21:40:16.684270] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-06T21:40:16.898352] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T21:40:17.105211] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:40:17.425537] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-06T21:40:17.677251] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T21:40:18.190867] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T21:40:18.225482] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-06T21:40:18.776018] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T21:40:18.777743] [INFO ] [REMOTE ] SREA: Full fetch complete (15554 records). [2025-10-06T21:40:18.777814] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-06T21:40:19.030811] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-06T21:40:19.145039] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-06T21:40:19.145128] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-06T21:40:19.145506] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-06T21:40:19.145547] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-06T21:40:19.146061] [DEBUG] [LOCAL ] SREA: Trimmed 15554 records to 10272 (keeping 200 days of data) [2025-10-06T21:40:19.209854] [DEBUG] [LOCAL ] SREA: Primary data saved (10272 records). [2025-10-06T21:40:19.210022] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-06T21:40:19.210129] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SREA took 24.2s. Estimated remaining: 53m 39s. Rate: 7.1 symbols/min [2025-10-06T21:40:19.378272] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:40:19.378512] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-06T21:40:19.378679] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-06T21:40:19.378806] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-06T21:40:19.378848] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-06T21:40:19.378888] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-06T21:40:19.378920] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-06T21:40:19.734886] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:40:19.825499] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-06T21:40:20.077144] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-06T21:40:20.305048] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-06T21:40:20.625549] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-06T21:40:21.425499] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-06T21:40:21.748068] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-06T21:40:22.225537] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-06T21:40:22.881159] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T21:40:23.025568] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-06T21:40:23.825526] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-06T21:40:23.864176] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T21:40:23.960586] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T21:40:24.385203] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T21:40:24.625526] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-06T21:40:24.923332] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-06T21:40:25.425534] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-06T21:40:26.225501] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-06T21:40:26.595479] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-06T21:40:27.025555] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-06T21:40:27.115324] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T21:40:27.396336] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-06T21:40:27.825535] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-06T21:40:28.625508] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-06T21:40:28.749704] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T21:40:29.425531] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-06T21:40:30.225591] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-06T21:40:30.628757] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-06T21:40:30.745177] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T21:40:31.025512] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-06T21:40:31.105954] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-06T21:40:31.825514] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-06T21:40:32.358739] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-06T21:40:32.625524] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-06T21:40:33.303989] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-06T21:40:33.305273] [INFO ] [REMOTE ] SRG: Full fetch complete (24369 records). [2025-10-06T21:40:33.305410] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-06T21:40:33.430589] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-06T21:40:33.718663] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-06T21:40:33.718787] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-06T21:40:33.719393] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-06T21:40:33.719435] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-06T21:40:33.720088] [DEBUG] [LOCAL ] SRG: Trimmed 24369 records to 15472 (keeping 200 days of data) [2025-10-06T21:40:33.807881] [DEBUG] [LOCAL ] SRG: Primary data saved (15472 records). [2025-10-06T21:40:33.808054] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-06T21:40:33.808143] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SRG took 34.9s. Estimated remaining: 53m 32s. Rate: 7.1 symbols/min [2025-10-06T21:40:33.977412] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:40:34.010417] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-06T21:40:34.024742] [DEBUG] [LOCAL ] SRV: Loaded 7463 existing records from primary storage. [2025-10-06T21:40:34.024983] [INFO ] [MAIN ] SRV: Loaded 7463 existing records. [2025-10-06T21:40:34.196871] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:40:34.197135] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-06T21:40:34.197186] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-06T21:40:34.197438] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-06T21:40:34.197496] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-06T21:40:34.230668] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-06T21:40:34.559513] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:40:34.694242] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-06T21:40:35.025539] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-06T21:40:35.825535] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-06T21:40:35.833496] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T21:40:36.297454] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-06T21:40:36.625583] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-06T21:40:37.054346] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-06T21:40:37.120254] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-06T21:40:37.425559] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-06T21:40:38.192208] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T21:40:38.225462] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-06T21:40:39.017861] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-06T21:40:39.025467] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-06T21:40:39.801212] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T21:40:39.825472] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-06T21:40:40.625494] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-06T21:40:40.651736] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-06T21:40:41.425604] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-06T21:40:41.830340] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-06T21:40:42.225492] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-06T21:40:42.518622] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-06T21:40:42.521768] [INFO ] [REMOTE ] SRFM: Full fetch complete (49748 records). [2025-10-06T21:40:42.521917] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-06T21:40:42.626573] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-06T21:40:42.902874] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-06T21:40:42.902986] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-06T21:40:42.903970] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-06T21:40:42.904035] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-06T21:40:42.905328] [DEBUG] [LOCAL ] SRFM: Trimmed 49748 records to 37346 (keeping 200 days of data) [2025-10-06T21:40:43.025735] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-06T21:40:43.133171] [DEBUG] [LOCAL ] SRFM: Primary data saved (37346 records). [2025-10-06T21:40:43.133351] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-06T21:40:43.133453] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRFM took 46.7s. Estimated remaining: 53m 24s. Rate: 7.1 symbols/min [2025-10-06T21:40:43.299311] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:40:43.340619] [DEBUG] [LOCAL ] SSB: Loaded 43234 existing records from primary storage. [2025-10-06T21:40:43.341043] [INFO ] [MAIN ] SSB: Loaded 43234 existing records. [2025-10-06T21:40:43.514618] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:40:43.514992] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-06T21:40:43.515039] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-06T21:40:43.515700] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-06T21:40:43.515764] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-06T21:40:43.830700] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-06T21:40:43.876377] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:40:44.029743] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T21:40:44.233001] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-06T21:40:44.625631] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-06T21:40:45.425626] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-06T21:40:46.043907] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T21:40:46.225561] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-06T21:40:46.592334] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-06T21:40:46.979533] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T21:40:47.025555] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-06T21:40:47.825559] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-06T21:40:48.114126] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-06T21:40:48.114941] [INFO ] [REMOTE ] SRL: Full fetch complete (1970 records). [2025-10-06T21:40:48.115015] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-06T21:40:48.299606] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-06T21:40:48.299894] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:40:48.299980] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:40:48.300082] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-06T21:40:48.300153] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-06T21:40:48.300190] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-06T21:40:48.300253] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-06T21:40:48.300345] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRL took 29.1s. Estimated remaining: 53m 15s. Rate: 7.1 symbols/min [2025-10-06T21:40:48.479395] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:40:48.505298] [DEBUG] [LOCAL ] SSD: Loaded 22774 existing records from primary storage. [2025-10-06T21:40:48.505605] [INFO ] [MAIN ] SSD: Loaded 22774 existing records. [2025-10-06T21:40:48.630682] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-06T21:40:48.699716] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:40:48.700295] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-06T21:40:48.700362] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-06T21:40:48.700602] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-06T21:40:48.700712] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-06T21:40:49.065060] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-06T21:40:49.158180] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:40:49.425573] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-06T21:40:49.517466] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-06T21:40:50.225550] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-06T21:40:50.563912] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T21:40:51.025555] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-06T21:40:51.599130] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T21:40:51.825515] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-06T21:40:51.884303] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T21:40:52.625542] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-06T21:40:53.410838] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T21:40:53.425473] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-06T21:40:53.734254] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T21:40:54.225548] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-06T21:40:54.970134] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T21:40:55.025513] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-06T21:40:55.080043] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T21:40:55.825594] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-06T21:40:56.151195] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T21:40:56.625530] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-06T21:40:56.960741] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T21:40:57.364963] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-06T21:40:57.425488] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-06T21:40:58.225509] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-06T21:40:58.453585] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-06T21:40:58.973317] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-06T21:40:59.025526] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-06T21:40:59.825551] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-06T21:41:00.169705] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-06T21:41:00.590261] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-06T21:41:00.625493] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-06T21:41:01.222450] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T21:41:01.223441] [INFO ] [REMOTE ] SRV: Full fetch complete (11528 records). [2025-10-06T21:41:01.223517] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-06T21:41:01.435730] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-06T21:41:01.630074] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-06T21:41:01.630183] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-06T21:41:01.630546] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-06T21:41:01.630592] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-06T21:41:01.631362] [DEBUG] [LOCAL ] SRV: Trimmed 11528 records to 7343 (keeping 200 days of data) [2025-10-06T21:41:01.681730] [DEBUG] [LOCAL ] SRV: Primary data saved (7343 records). [2025-10-06T21:41:01.681929] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-06T21:41:01.682027] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRV took 27.9s. Estimated remaining: 53m 7s. Rate: 7.1 symbols/min [2025-10-06T21:41:01.860918] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:41:01.898324] [DEBUG] [LOCAL ] SSL: Loaded 41734 existing records from primary storage. [2025-10-06T21:41:01.898705] [INFO ] [MAIN ] SSL: Loaded 41734 existing records. [2025-10-06T21:41:02.076385] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:41:02.076819] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-06T21:41:02.076925] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-06T21:41:02.077254] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-06T21:41:02.077319] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-06T21:41:02.237742] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-06T21:41:02.393792] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T21:41:02.448447] [INFO ] [REMOTE ] SRI: Full fetch complete (40961 records). [2025-10-06T21:41:02.458024] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-06T21:41:02.479831] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:41:02.912938] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-06T21:41:02.913088] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-06T21:41:02.914537] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-06T21:41:02.914605] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-06T21:41:02.916295] [DEBUG] [LOCAL ] SRI: Trimmed 40961 records to 26878 (keeping 200 days of data) [2025-10-06T21:41:03.025892] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-06T21:41:03.088183] [DEBUG] [LOCAL ] SRI: Primary data saved (26878 records). [2025-10-06T21:41:03.088387] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-06T21:41:03.088534] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRI took 46.8s. Estimated remaining: 52m 57s. Rate: 7.1 symbols/min [2025-10-06T21:41:03.270400] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:41:03.286303] [DEBUG] [LOCAL ] SST: Loaded 12007 existing records from primary storage. [2025-10-06T21:41:03.286615] [INFO ] [MAIN ] SST: Loaded 12007 existing records. [2025-10-06T21:41:03.467326] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:41:03.467580] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-06T21:41:03.467629] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-06T21:41:03.467925] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-06T21:41:03.467982] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-06T21:41:03.854780] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-06T21:41:03.854624] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:41:03.929206] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T21:41:04.625582] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-06T21:41:04.696847] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T21:41:04.719368] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-06T21:41:05.238126] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-06T21:41:05.425542] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-06T21:41:06.225550] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-06T21:41:07.025563] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-06T21:41:07.083522] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T21:41:07.277687] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T21:41:07.825535] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-06T21:41:08.570635] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T21:41:08.625563] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-06T21:41:09.018349] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T21:41:09.425491] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-06T21:41:09.797602] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-06T21:41:10.225619] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-06T21:41:10.779244] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T21:41:11.025555] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-06T21:41:11.427303] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-06T21:41:11.825521] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-06T21:41:12.504077] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T21:41:12.625485] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-06T21:41:12.991466] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T21:41:13.425532] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-06T21:41:14.224924] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T21:41:14.226676] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-06T21:41:14.227838] [INFO ] [REMOTE ] SSD: Full fetch complete (32421 records). [2025-10-06T21:41:14.227937] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-06T21:41:14.374469] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T21:41:14.646786] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-06T21:41:14.646881] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-06T21:41:14.647597] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-06T21:41:14.647677] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-06T21:41:14.648868] [DEBUG] [LOCAL ] SSD: Trimmed 32421 records to 22478 (keeping 200 days of data) [2025-10-06T21:41:14.795404] [DEBUG] [LOCAL ] SSD: Primary data saved (22478 records). [2025-10-06T21:41:14.795552] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-06T21:41:14.795634] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SSD took 26.5s. Estimated remaining: 52m 50s. Rate: 7.1 symbols/min [2025-10-06T21:41:14.968225] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:41:14.995922] [DEBUG] [LOCAL ] SSTK: Loaded 26287 existing records from primary storage. [2025-10-06T21:41:14.996249] [INFO ] [MAIN ] SSTK: Loaded 26287 existing records. [2025-10-06T21:41:15.027716] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-06T21:41:15.172299] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T21:41:15.199418] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:41:15.199749] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-06T21:41:15.199808] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-06T21:41:15.200062] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-06T21:41:15.200122] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-06T21:41:15.551107] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:41:15.825537] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-06T21:41:16.625510] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-06T21:41:16.681311] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T21:41:16.747719] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-06T21:41:17.425538] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-06T21:41:18.222714] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T21:41:18.231803] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-06T21:41:18.752360] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-06T21:41:19.025495] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-06T21:41:19.056465] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T21:41:19.825568] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-06T21:41:20.625517] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-06T21:41:20.691751] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-06T21:41:21.311775] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T21:41:21.425533] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-06T21:41:21.882824] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T21:41:22.225539] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-06T21:41:22.255838] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-06T21:41:23.025560] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-06T21:41:23.825529] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-06T21:41:23.875516] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T21:41:24.131811] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T21:41:24.625534] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-06T21:41:25.168376] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T21:41:25.425552] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-06T21:41:26.225591] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-06T21:41:26.277202] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T21:41:26.667495] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-06T21:41:27.025588] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-06T21:41:27.685806] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T21:41:27.825495] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-06T21:41:27.867235] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-06T21:41:28.625577] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-06T21:41:29.012773] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T21:41:29.015343] [INFO ] [REMOTE ] SSB: Full fetch complete (61362 records). [2025-10-06T21:41:29.015469] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-06T21:41:29.402901] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-06T21:41:29.403419] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-06T21:41:29.404634] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-06T21:41:29.404723] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-06T21:41:29.406137] [DEBUG] [LOCAL ] SSB: Trimmed 61362 records to 42698 (keeping 200 days of data) [2025-10-06T21:41:29.459733] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-06T21:41:29.680464] [DEBUG] [LOCAL ] SSB: Primary data saved (42698 records). [2025-10-06T21:41:29.680629] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-06T21:41:29.680767] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SSB took 46.5s. Estimated remaining: 52m 42s. Rate: 7.1 symbols/min [2025-10-06T21:41:30.049106] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-06T21:41:30.064310] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T21:41:30.225529] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-06T21:41:31.025556] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-06T21:41:31.209543] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T21:41:31.476477] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-06T21:41:31.825545] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-06T21:41:32.625497] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-06T21:41:32.924501] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T21:41:33.087422] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T21:41:33.088719] [INFO ] [REMOTE ] SST: Full fetch complete (18754 records). [2025-10-06T21:41:33.088824] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-06T21:41:33.448033] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-06T21:41:33.459381] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-06T21:41:33.459440] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-06T21:41:33.459936] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-06T21:41:33.460004] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-06T21:41:33.460728] [DEBUG] [LOCAL ] SST: Trimmed 18754 records to 11840 (keeping 200 days of data) [2025-10-06T21:41:33.529678] [DEBUG] [LOCAL ] SST: Primary data saved (11840 records). [2025-10-06T21:41:33.529848] [INFO ] [MAIN ] SST: Full history saved. [2025-10-06T21:41:33.529939] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SST took 30.4s. Estimated remaining: 52m 33s. Rate: 7.1 symbols/min [2025-10-06T21:41:34.225584] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-06T21:41:35.091924] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T21:41:35.102733] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-06T21:41:35.419076] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T21:41:35.825591] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-06T21:41:36.295691] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-06T21:41:36.298358] [INFO ] [REMOTE ] SSL: Full fetch complete (60039 records). [2025-10-06T21:41:36.298504] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-06T21:41:36.694409] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-06T21:41:36.694509] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-06T21:41:36.695707] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-06T21:41:36.695776] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-06T21:41:36.697179] [DEBUG] [LOCAL ] SSL: Trimmed 60039 records to 41242 (keeping 200 days of data) [2025-10-06T21:41:36.914049] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T21:41:36.922511] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-06T21:41:36.958876] [DEBUG] [LOCAL ] SSL: Primary data saved (41242 records). [2025-10-06T21:41:36.959048] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-06T21:41:36.959190] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SSL took 35.3s. Estimated remaining: 52m 24s. Rate: 7.1 symbols/min [2025-10-06T21:41:38.136793] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T21:41:38.146969] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-06T21:41:38.988706] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T21:41:38.990555] [INFO ] [REMOTE ] SSTK: Full fetch complete (41863 records). [2025-10-06T21:41:38.990673] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-06T21:41:39.390161] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-06T21:41:39.390259] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-06T21:41:39.391423] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-06T21:41:39.391507] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-06T21:41:39.392833] [DEBUG] [LOCAL ] SSTK: Trimmed 41863 records to 25655 (keeping 200 days of data) [2025-10-06T21:41:39.557209] [DEBUG] [LOCAL ] SSTK: Primary data saved (25655 records). [2025-10-06T21:41:39.557420] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-06T21:41:39.557529] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SSTK took 24.8s. Estimated remaining: 52m 14s. Rate: 7.1 symbols/min [2025-10-06T21:41:40.197380] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:41:40.256624] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:41:40.301010] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:41:40.342357] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:41:40.357803] [DEBUG] [LOCAL ] STC: Loaded 17664 existing records from primary storage. [2025-10-06T21:41:40.358186] [INFO ] [MAIN ] STC: Loaded 17664 existing records. [2025-10-06T21:41:40.599727] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:41:40.600095] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-06T21:41:40.600161] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-06T21:41:40.600463] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-06T21:41:40.614493] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-06T21:41:40.647085] [DEBUG] [LOCAL ] ST: Loaded 50469 existing records from primary storage. [2025-10-06T21:41:40.657483] [DEBUG] [LOCAL ] STE: Loaded 35887 existing records from primary storage. [2025-10-06T21:41:40.682939] [INFO ] [MAIN ] ST: Loaded 50469 existing records. [2025-10-06T21:41:40.682816] [INFO ] [MAIN ] STE: Loaded 35887 existing records. [2025-10-06T21:41:40.917450] [DEBUG] [LOCAL ] STAG: Loaded 50828 existing records from primary storage. [2025-10-06T21:41:40.949083] [INFO ] [MAIN ] STAG: Loaded 50828 existing records. [2025-10-06T21:41:41.205519] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:41:41.281921] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-06T21:41:41.329944] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-06T21:41:41.335385] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:41:41.359767] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-06T21:41:41.394330] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-06T21:41:41.399611] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-06T21:41:41.394425] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-06T21:41:41.486790] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-06T21:41:41.544215] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:41:41.577668] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-06T21:41:41.627412] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:41:41.622221] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-06T21:41:41.646338] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-06T21:41:41.670012] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-06T21:41:41.688323] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-06T21:41:41.721013] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-06T21:41:42.438562] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:41:42.512900] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-06T21:41:42.548347] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:41:42.560902] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-06T21:41:42.630506] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:41:42.631094] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-06T21:41:42.757770] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-06T21:41:42.761922] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-06T21:41:43.856291] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T21:41:43.860787] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-06T21:41:43.981182] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T21:41:43.991260] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-06T21:41:44.019438] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T21:41:44.026852] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-06T21:41:44.181586] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T21:41:44.625508] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-06T21:41:44.864124] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-06T21:41:45.425520] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-06T21:41:45.520129] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T21:41:45.762225] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T21:41:46.046418] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T21:41:46.138252] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-06T21:41:46.225549] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-06T21:41:47.025541] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-06T21:41:47.254465] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-06T21:41:47.825558] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-06T21:41:48.563291] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T21:41:48.625487] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-06T21:41:49.415232] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T21:41:49.425421] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-06T21:41:50.165860] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T21:41:50.225479] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-06T21:41:51.025563] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-06T21:41:51.130078] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T21:41:51.282276] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T21:41:51.825553] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-06T21:41:52.625566] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-06T21:41:52.677021] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T21:41:53.425495] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-06T21:41:53.647935] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T21:41:53.715448] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T21:41:54.225540] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-06T21:41:54.986333] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T21:41:55.025524] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-06T21:41:55.825597] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-06T21:41:55.887047] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T21:41:56.552340] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T21:41:56.600381] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T21:41:56.625481] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-06T21:41:57.425529] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-06T21:41:57.616443] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T21:41:58.225627] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-06T21:41:58.847330] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T21:41:59.025554] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-06T21:41:59.745284] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-06T21:41:59.825565] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-06T21:42:00.625599] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-06T21:42:00.844318] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T21:42:01.315242] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T21:42:01.425510] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-06T21:42:01.715166] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T21:42:02.225599] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-06T21:42:02.834044] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T21:42:03.025546] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-06T21:42:03.456712] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-06T21:42:03.459113] [INFO ] [REMOTE ] STE: Full fetch complete (50639 records). [2025-10-06T21:42:03.459227] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-06T21:42:03.827268] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-06T21:42:03.886691] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-06T21:42:03.886830] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-06T21:42:03.889394] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-06T21:42:03.889721] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-06T21:42:03.891527] [DEBUG] [LOCAL ] STE: Trimmed 50639 records to 35488 (keeping 200 days of data) [2025-10-06T21:42:04.024498] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T21:42:04.182613] [DEBUG] [LOCAL ] STE: Primary data saved (35488 records). [2025-10-06T21:42:04.182841] [INFO ] [MAIN ] STE: Full history saved. [2025-10-06T21:42:04.182957] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STE took 24.6s. Estimated remaining: 52m 9s. Rate: 7.1 symbols/min [2025-10-06T21:42:04.366380] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:42:04.392628] [DEBUG] [LOCAL ] STEL: Loaded 23455 existing records from primary storage. [2025-10-06T21:42:04.392992] [INFO ] [MAIN ] STEL: Loaded 23455 existing records. [2025-10-06T21:42:04.643084] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-06T21:42:04.649917] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:42:04.651857] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-06T21:42:04.651948] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-06T21:42:04.652508] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-06T21:42:04.652573] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-06T21:42:05.061790] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:42:05.430787] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-06T21:42:05.447458] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T21:42:06.225500] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-06T21:42:06.410288] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T21:42:06.478022] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T21:42:07.025556] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-06T21:42:07.825574] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-06T21:42:07.832179] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T21:42:07.833965] [INFO ] [REMOTE ] STC: Full fetch complete (25782 records). [2025-10-06T21:42:07.834156] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-06T21:42:08.179613] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T21:42:08.278918] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-06T21:42:08.279025] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-06T21:42:08.279699] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-06T21:42:08.279772] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-06T21:42:08.280444] [DEBUG] [LOCAL ] STC: Trimmed 25782 records to 17440 (keeping 200 days of data) [2025-10-06T21:42:08.397315] [DEBUG] [LOCAL ] STC: Primary data saved (17440 records). [2025-10-06T21:42:08.397545] [INFO ] [MAIN ] STC: Full history saved. [2025-10-06T21:42:08.397722] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. STC took 28.8s. Estimated remaining: 51m 59s. Rate: 7.1 symbols/min [2025-10-06T21:42:08.579305] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:42:08.623244] [DEBUG] [LOCAL ] STEM: Loaded 39914 existing records from primary storage. [2025-10-06T21:42:08.623748] [INFO ] [MAIN ] STEM: Loaded 39914 existing records. [2025-10-06T21:42:08.635135] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-06T21:42:08.846417] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:42:08.846993] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-06T21:42:08.847055] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-06T21:42:08.847349] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-06T21:42:08.847408] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-06T21:42:08.978256] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T21:42:09.222113] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:42:09.425534] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-06T21:42:10.225562] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-06T21:42:10.584572] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-06T21:42:11.025489] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-06T21:42:11.269558] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-06T21:42:11.493218] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-06T21:42:11.825535] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-06T21:42:12.625532] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-06T21:42:12.885190] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T21:42:12.911132] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-06T21:42:13.425536] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-06T21:42:14.225554] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-06T21:42:14.274352] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T21:42:15.034665] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-06T21:42:15.040865] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T21:42:15.825546] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-06T21:42:16.282398] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-06T21:42:16.625517] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-06T21:42:16.760410] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-06T21:42:17.425495] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-06T21:42:17.520514] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T21:42:18.131702] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T21:42:18.134685] [INFO ] [REMOTE ] STAG: Full fetch complete (72198 records). [2025-10-06T21:42:18.134795] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-06T21:42:18.235544] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-06T21:42:18.534245] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-06T21:42:18.534342] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-06T21:42:18.535463] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-06T21:42:18.535526] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-06T21:42:18.536929] [DEBUG] [LOCAL ] STAG: Trimmed 72198 records to 50094 (keeping 200 days of data) [2025-10-06T21:42:18.852350] [DEBUG] [LOCAL ] STAG: Primary data saved (50094 records). [2025-10-06T21:42:18.852531] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-06T21:42:18.852621] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. STAG took 39.3s. Estimated remaining: 51m 51s. Rate: 7.1 symbols/min [2025-10-06T21:42:19.028194] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:42:19.026533] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-06T21:42:19.052794] [DEBUG] [LOCAL ] STEW: Loaded 16303 existing records from primary storage. [2025-10-06T21:42:19.053058] [INFO ] [MAIN ] STEW: Loaded 16303 existing records. [2025-10-06T21:42:19.244063] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:42:19.244454] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-06T21:42:19.244514] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-06T21:42:19.244766] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-06T21:42:19.244825] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-06T21:42:19.617307] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-06T21:42:19.673776] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-06T21:42:19.673070] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:42:19.678051] [INFO ] [REMOTE ] ST: Full fetch complete (71947 records). [2025-10-06T21:42:19.678151] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-06T21:42:19.835399] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-06T21:42:20.093758] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-06T21:42:20.093874] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-06T21:42:20.095233] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-06T21:42:20.095304] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-06T21:42:20.096912] [DEBUG] [LOCAL ] ST: Trimmed 71947 records to 49761 (keeping 200 days of data) [2025-10-06T21:42:20.362777] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-06T21:42:20.469945] [DEBUG] [LOCAL ] ST: Primary data saved (49761 records). [2025-10-06T21:42:20.470125] [INFO ] [MAIN ] ST: Full history saved. [2025-10-06T21:42:20.470249] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. ST took 40.9s. Estimated remaining: 51m 42s. Rate: 7.1 symbols/min [2025-10-06T21:42:20.634034] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-06T21:42:20.636739] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:42:20.637666] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-06T21:42:20.637728] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-06T21:42:20.637842] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-06T21:42:20.637884] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-06T21:42:20.637923] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-06T21:42:20.637954] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-06T21:42:20.995493] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:42:21.413885] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T21:42:21.425471] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-06T21:42:21.676235] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T21:42:22.225546] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-06T21:42:22.575311] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-06T21:42:23.025558] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-06T21:42:23.223364] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T21:42:23.825528] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-06T21:42:23.887941] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T21:42:24.625517] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-06T21:42:24.883441] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-06T21:42:25.386985] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T21:42:25.425540] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-06T21:42:26.225504] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-06T21:42:26.456885] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T21:42:27.025621] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-06T21:42:27.521390] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-06T21:42:27.825484] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-06T21:42:28.014602] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T21:42:28.625578] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-06T21:42:28.872014] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-06T21:42:28.957269] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-06T21:42:29.425611] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-06T21:42:29.784856] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-06T21:42:30.225595] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-06T21:42:31.025626] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-06T21:42:31.825746] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-06T21:42:31.892756] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T21:42:31.948909] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T21:42:32.625493] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-06T21:42:32.829706] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T21:42:33.425573] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-06T21:42:33.766782] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-06T21:42:34.225497] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-06T21:42:34.340021] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T21:42:34.787351] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T21:42:35.025563] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-06T21:42:35.825515] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-06T21:42:36.136967] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-06T21:42:36.182758] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-06T21:42:36.625721] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-06T21:42:37.425544] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-06T21:42:38.157230] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T21:42:38.225578] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-06T21:42:38.511043] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T21:42:39.011403] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-06T21:42:39.025459] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-06T21:42:39.504077] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-06T21:42:39.825532] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-06T21:42:40.625532] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-06T21:42:41.177604] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T21:42:41.425491] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-06T21:42:41.569322] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T21:42:41.876015] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-06T21:42:42.225565] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-06T21:42:43.025533] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-06T21:42:43.294322] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T21:42:43.825501] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-06T21:42:44.044273] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T21:42:44.625531] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-06T21:42:45.085149] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T21:42:45.087484] [INFO ] [REMOTE ] STEM: Full fetch complete (61932 records). [2025-10-06T21:42:45.087576] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-06T21:42:45.433109] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-06T21:42:45.478961] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-06T21:42:45.487239] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-06T21:42:45.490436] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T21:42:45.489987] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-06T21:42:45.490765] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-06T21:42:45.495804] [DEBUG] [LOCAL ] STEM: Trimmed 61932 records to 39194 (keeping 200 days of data) [2025-10-06T21:42:45.722108] [DEBUG] [LOCAL ] STEM: Primary data saved (39194 records). [2025-10-06T21:42:45.722268] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-06T21:42:45.722375] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STEM took 37.3s. Estimated remaining: 51m 36s. Rate: 7.1 symbols/min [2025-10-06T21:42:45.889122] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:42:45.900521] [DEBUG] [LOCAL ] STK: Loaded 9573 existing records from primary storage. [2025-10-06T21:42:45.900796] [INFO ] [MAIN ] STK: Loaded 9573 existing records. [2025-10-06T21:42:46.078720] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:42:46.078973] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-06T21:42:46.079059] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-06T21:42:46.079267] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-06T21:42:46.079323] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-06T21:42:46.228392] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-06T21:42:46.431042] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T21:42:46.463974] [INFO ] [REMOTE ] STEL: Full fetch complete (32129 records). [2025-10-06T21:42:46.468137] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:42:46.468364] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-06T21:42:47.020608] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-06T21:42:47.020774] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-06T21:42:47.021857] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-06T21:42:47.021934] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-06T21:42:47.023183] [DEBUG] [LOCAL ] STEL: Trimmed 32129 records to 23004 (keeping 200 days of data) [2025-10-06T21:42:47.025581] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-06T21:42:47.160325] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T21:42:47.239572] [DEBUG] [LOCAL ] STEL: Primary data saved (23004 records). [2025-10-06T21:42:47.239797] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-06T21:42:47.239907] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEL took 43.1s. Estimated remaining: 51m 27s. Rate: 7.1 symbols/min [2025-10-06T21:42:47.429228] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-06T21:42:47.429093] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:42:47.430477] [INFO ] [REMOTE ] STG: Full fetch complete (2497 records). [2025-10-06T21:42:47.430934] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-06T21:42:47.635720] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-06T21:42:47.636037] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:42:47.636122] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:42:47.636204] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-06T21:42:47.636281] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-06T21:42:47.636324] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-06T21:42:47.636467] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-06T21:42:47.636563] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STG took 27.2s. Estimated remaining: 51m 17s. Rate: 7.1 symbols/min [2025-10-06T21:42:47.808981] [DEBUG] [LOCAL ] STLA: Loaded 54321 existing records from primary storage. [2025-10-06T21:42:47.828158] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-06T21:42:47.865805] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:42:47.866258] [INFO ] [MAIN ] STLA: Loaded 54321 existing records. [2025-10-06T21:42:48.076451] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:42:48.076760] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-06T21:42:48.076816] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-06T21:42:48.077063] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-06T21:42:48.077128] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-06T21:42:48.373363] [DEBUG] [LOCAL ] STM: Loaded 54355 existing records from primary storage. [2025-10-06T21:42:48.400716] [INFO ] [MAIN ] STM: Loaded 54355 existing records. [2025-10-06T21:42:48.599996] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:42:48.639705] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-06T21:42:48.681059] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:42:48.682466] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-06T21:42:48.682588] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-06T21:42:48.682871] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-06T21:42:48.682930] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-06T21:42:48.785048] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T21:42:49.063287] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:42:49.380502] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T21:42:49.382151] [INFO ] [REMOTE ] STEW: Full fetch complete (21833 records). [2025-10-06T21:42:49.382257] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-06T21:42:49.430635] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-06T21:42:49.769286] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-06T21:42:49.769410] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-06T21:42:49.770077] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-06T21:42:49.770145] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-06T21:42:49.771091] [DEBUG] [LOCAL ] STEW: Trimmed 21833 records to 16142 (keeping 200 days of data) [2025-10-06T21:42:49.899194] [DEBUG] [LOCAL ] STEW: Primary data saved (16142 records). [2025-10-06T21:42:49.899368] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-06T21:42:49.899459] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STEW took 31.0s. Estimated remaining: 51m 7s. Rate: 7.1 symbols/min [2025-10-06T21:42:50.106927] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:42:50.133922] [DEBUG] [LOCAL ] STN: Loaded 23107 existing records from primary storage. [2025-10-06T21:42:50.134227] [INFO ] [MAIN ] STN: Loaded 23107 existing records. [2025-10-06T21:42:50.231719] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-06T21:42:50.314142] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:42:50.314397] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-06T21:42:50.314447] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-06T21:42:50.314692] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-06T21:42:50.314755] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-06T21:42:50.671791] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:42:51.025554] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-06T21:42:51.693299] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-06T21:42:51.825531] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-06T21:42:52.096874] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T21:42:52.228750] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-06T21:42:52.625586] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-06T21:42:53.425537] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-06T21:42:53.765702] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T21:42:53.879961] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-06T21:42:54.225538] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-06T21:42:55.025501] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-06T21:42:55.436517] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-06T21:42:55.825705] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-06T21:42:56.008103] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T21:42:56.143843] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T21:42:56.590963] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T21:42:56.625540] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-06T21:42:57.425597] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-06T21:42:57.729370] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T21:42:58.225546] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-06T21:42:59.025516] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-06T21:42:59.035197] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-06T21:42:59.704007] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-06T21:42:59.825594] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-06T21:43:00.625514] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-06T21:43:00.704716] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-06T21:43:01.140353] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-06T21:43:01.425528] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-06T21:43:02.225611] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-06T21:43:02.922399] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-06T21:43:03.025528] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-06T21:43:03.378148] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T21:43:03.593478] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-06T21:43:03.825506] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-06T21:43:04.625542] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-06T21:43:05.020793] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T21:43:05.269019] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-06T21:43:05.425512] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-06T21:43:06.225495] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-06T21:43:06.790734] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-06T21:43:07.025524] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-06T21:43:07.323068] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T21:43:07.389902] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-06T21:43:07.825500] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-06T21:43:07.948982] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-06T21:43:08.625603] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-06T21:43:08.969456] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T21:43:09.425531] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-06T21:43:10.225494] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-06T21:43:10.581119] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-06T21:43:10.894235] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-06T21:43:11.025529] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-06T21:43:11.819466] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T21:43:11.825471] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-06T21:43:12.334054] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-06T21:43:12.565958] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T21:43:12.625516] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-06T21:43:13.355230] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T21:43:13.425548] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-06T21:43:14.164298] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T21:43:14.225476] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-06T21:43:15.025510] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-06T21:43:15.097828] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-06T21:43:15.825571] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-06T21:43:16.625753] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-06T21:43:16.888536] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-06T21:43:17.164827] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-06T21:43:17.252974] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T21:43:17.254162] [INFO ] [REMOTE ] STK: Full fetch complete (14123 records). [2025-10-06T21:43:17.254234] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-06T21:43:17.432550] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-06T21:43:17.629092] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-06T21:43:17.629184] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-06T21:43:17.629578] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-06T21:43:17.629620] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-06T21:43:17.630134] [DEBUG] [LOCAL ] STK: Trimmed 14123 records to 9525 (keeping 200 days of data) [2025-10-06T21:43:17.689617] [DEBUG] [LOCAL ] STK: Primary data saved (9525 records). [2025-10-06T21:43:17.689809] [INFO ] [MAIN ] STK: Full history saved. [2025-10-06T21:43:17.689902] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STK took 32.0s. Estimated remaining: 51m 2s. Rate: 7.1 symbols/min [2025-10-06T21:43:17.859515] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:43:17.901879] [DEBUG] [LOCAL ] STNG: Loaded 44344 existing records from primary storage. [2025-10-06T21:43:17.902248] [INFO ] [MAIN ] STNG: Loaded 44344 existing records. [2025-10-06T21:43:18.102964] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:43:18.103981] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-06T21:43:18.104052] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-06T21:43:18.104831] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-06T21:43:18.104936] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-06T21:43:18.231137] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-06T21:43:18.487398] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:43:19.025553] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-06T21:43:19.197919] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T21:43:19.199495] [INFO ] [REMOTE ] STN: Full fetch complete (32419 records). [2025-10-06T21:43:19.199577] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-06T21:43:19.615064] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-06T21:43:19.615339] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-06T21:43:19.616394] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-06T21:43:19.616474] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-06T21:43:19.631493] [DEBUG] [LOCAL ] STN: Trimmed 32419 records to 22823 (keeping 200 days of data) [2025-10-06T21:43:19.716084] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-06T21:43:19.822069] [DEBUG] [LOCAL ] STN: Primary data saved (22823 records). [2025-10-06T21:43:19.822242] [INFO ] [MAIN ] STN: Full history saved. [2025-10-06T21:43:19.822352] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STN took 29.9s. Estimated remaining: 50m 52s. Rate: 7.1 symbols/min [2025-10-06T21:43:19.833758] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-06T21:43:19.995797] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:43:20.009716] [DEBUG] [LOCAL ] STRV: Loaded 11517 existing records from primary storage. [2025-10-06T21:43:20.009995] [INFO ] [MAIN ] STRV: Loaded 11517 existing records. [2025-10-06T21:43:20.189256] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:43:20.189555] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-06T21:43:20.189634] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-06T21:43:20.189958] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-06T21:43:20.190042] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-06T21:43:20.579890] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:43:20.605092] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T21:43:20.625481] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-06T21:43:21.340320] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-06T21:43:21.425493] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-06T21:43:21.711469] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-06T21:43:22.079930] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-06T21:43:22.225560] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-06T21:43:23.025573] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-06T21:43:23.825553] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-06T21:43:24.396121] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-06T21:43:24.625588] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-06T21:43:24.696414] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-06T21:43:25.026701] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-06T21:43:25.425595] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-06T21:43:26.225552] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-06T21:43:26.417535] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-06T21:43:26.421106] [INFO ] [REMOTE ] STLA: Full fetch complete (77534 records). [2025-10-06T21:43:26.421312] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-06T21:43:26.840892] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-06T21:43:26.841007] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-06T21:43:26.842375] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-06T21:43:26.842455] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-06T21:43:26.844421] [DEBUG] [LOCAL ] STLA: Trimmed 77534 records to 53551 (keeping 200 days of data) [2025-10-06T21:43:27.031909] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-06T21:43:27.194940] [DEBUG] [LOCAL ] STLA: Primary data saved (53551 records). [2025-10-06T21:43:27.195124] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-06T21:43:27.196205] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STLA took 40.0s. Estimated remaining: 50m 44s. Rate: 7.1 symbols/min [2025-10-06T21:43:27.384533] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:43:27.449792] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-06T21:43:27.481480] [DEBUG] [LOCAL ] STT: Loaded 51691 existing records from primary storage. [2025-10-06T21:43:27.481916] [INFO ] [MAIN ] STT: Loaded 51691 existing records. [2025-10-06T21:43:27.668785] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:43:27.669186] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-06T21:43:27.669255] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-06T21:43:27.669849] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-06T21:43:27.669906] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-06T21:43:27.846517] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-06T21:43:28.050265] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:43:28.062166] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T21:43:28.083577] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T21:43:28.625550] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-06T21:43:29.425612] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-06T21:43:29.529250] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-06T21:43:29.533150] [INFO ] [REMOTE ] STM: Full fetch complete (77526 records). [2025-10-06T21:43:29.533309] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-06T21:43:29.941105] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-06T21:43:29.941301] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-06T21:43:29.943049] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-06T21:43:29.943203] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-06T21:43:29.945343] [DEBUG] [LOCAL ] STM: Trimmed 77526 records to 53574 (keeping 200 days of data) [2025-10-06T21:43:30.097444] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T21:43:30.225537] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-06T21:43:30.342874] [DEBUG] [LOCAL ] STM: Primary data saved (53574 records). [2025-10-06T21:43:30.343081] [INFO ] [MAIN ] STM: Full history saved. [2025-10-06T21:43:30.343181] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STM took 42.7s. Estimated remaining: 50m 34s. Rate: 7.1 symbols/min [2025-10-06T21:43:30.518691] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:43:30.518913] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-06T21:43:30.518951] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-06T21:43:30.519073] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-06T21:43:30.519113] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-06T21:43:30.519153] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-06T21:43:30.519185] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-06T21:43:30.877963] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:43:30.971436] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T21:43:31.025495] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-06T21:43:31.271143] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:43:31.271516] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-06T21:43:31.271630] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:43:31.271720] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-06T21:43:31.271785] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:43:31.271857] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-06T21:43:31.272022] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-06T21:43:31.272078] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-06T21:43:31.272120] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-06T21:43:31.272168] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STUB took 0.9s. Estimated remaining: 50m 25s. Rate: 7.1 symbols/min [2025-10-06T21:43:31.439565] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:43:31.479202] [DEBUG] [LOCAL ] STVN: Loaded 26608 existing records from primary storage. [2025-10-06T21:43:31.479527] [INFO ] [MAIN ] STVN: Loaded 26608 existing records. [2025-10-06T21:43:31.655078] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:43:31.655339] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-06T21:43:31.655391] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-06T21:43:31.655600] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-06T21:43:31.655699] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-06T21:43:31.831702] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-06T21:43:32.024348] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:43:32.088982] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T21:43:32.625590] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-06T21:43:33.425507] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-06T21:43:33.500664] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T21:43:33.957829] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-06T21:43:34.225574] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-06T21:43:35.015156] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T21:43:35.025476] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-06T21:43:35.476859] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T21:43:35.825589] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-06T21:43:36.501918] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T21:43:36.625488] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-06T21:43:36.999622] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T21:43:37.425525] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-06T21:43:38.226857] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T21:43:38.225727] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-06T21:43:38.602414] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T21:43:39.025593] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-06T21:43:39.303188] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-06T21:43:39.825551] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-06T21:43:40.625559] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-06T21:43:40.673434] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T21:43:40.694887] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T21:43:41.425503] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-06T21:43:41.771003] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T21:43:42.225576] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-06T21:43:43.004629] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T21:43:43.025485] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-06T21:43:43.480033] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T21:43:43.825551] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-06T21:43:44.505782] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-06T21:43:44.567715] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T21:43:44.625579] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-06T21:43:45.425539] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-06T21:43:46.225531] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-06T21:43:46.286067] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T21:43:47.011591] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-06T21:43:47.025473] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-06T21:43:47.170012] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T21:43:47.825505] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-06T21:43:47.837275] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T21:43:48.625544] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-06T21:43:48.915585] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T21:43:49.384924] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-06T21:43:49.425474] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-06T21:43:50.204245] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-06T21:43:50.225491] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-06T21:43:50.784736] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T21:43:50.786266] [INFO ] [REMOTE ] STRV: Full fetch complete (18053 records). [2025-10-06T21:43:50.786353] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-06T21:43:51.030692] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-06T21:43:51.183943] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-06T21:43:51.184030] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-06T21:43:51.184426] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-06T21:43:51.184485] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-06T21:43:51.185031] [DEBUG] [LOCAL ] STRV: Trimmed 18053 records to 11323 (keeping 200 days of data) [2025-10-06T21:43:51.255131] [DEBUG] [LOCAL ] STRV: Primary data saved (11323 records). [2025-10-06T21:43:51.255286] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-06T21:43:51.255369] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STRV took 31.4s. Estimated remaining: 50m 18s. Rate: 7.1 symbols/min [2025-10-06T21:43:51.424520] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:43:51.476175] [DEBUG] [LOCAL ] STWD: Loaded 52646 existing records from primary storage. [2025-10-06T21:43:51.476566] [INFO ] [MAIN ] STWD: Loaded 52646 existing records. [2025-10-06T21:43:51.655315] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:43:51.655663] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-06T21:43:51.655728] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-06T21:43:51.655968] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-06T21:43:51.656024] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-06T21:43:51.832384] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-06T21:43:52.026179] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:43:52.625560] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-06T21:43:52.947314] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-06T21:43:53.327477] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-06T21:43:53.425570] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-06T21:43:54.225524] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-06T21:43:54.336737] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T21:43:55.025555] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-06T21:43:55.205782] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T21:43:55.529831] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-06T21:43:55.825542] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-06T21:43:56.625557] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-06T21:43:56.785049] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T21:43:57.425533] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-06T21:43:57.434002] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T21:43:57.436167] [INFO ] [REMOTE ] STVN: Full fetch complete (39276 records). [2025-10-06T21:43:57.436259] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-06T21:43:57.631486] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T21:43:57.862355] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-06T21:43:57.862448] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-06T21:43:57.863317] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-06T21:43:57.863379] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-06T21:43:57.864311] [DEBUG] [LOCAL ] STVN: Trimmed 39276 records to 26428 (keeping 200 days of data) [2025-10-06T21:43:58.015285] [DEBUG] [LOCAL ] STVN: Primary data saved (26428 records). [2025-10-06T21:43:58.015452] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-06T21:43:58.015536] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STVN took 26.7s. Estimated remaining: 50m 9s. Rate: 7.1 symbols/min [2025-10-06T21:43:58.186425] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:43:58.190201] [DEBUG] [LOCAL ] STXD: Loaded 1298 existing records from primary storage. [2025-10-06T21:43:58.190345] [INFO ] [MAIN ] STXD: Loaded 1298 existing records. [2025-10-06T21:43:58.232101] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-06T21:43:58.372050] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:43:58.372319] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-06T21:43:58.372377] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-06T21:43:58.372562] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-06T21:43:58.372621] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-06T21:43:58.728745] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:43:59.025541] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-06T21:43:59.147796] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T21:43:59.333310] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-06T21:43:59.495863] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T21:43:59.498253] [INFO ] [REMOTE ] STNG: Full fetch complete (64363 records). [2025-10-06T21:43:59.498357] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-06T21:43:59.830846] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-06T21:43:59.887233] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-06T21:43:59.887327] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-06T21:43:59.888461] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-06T21:43:59.888526] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-06T21:43:59.889896] [DEBUG] [LOCAL ] STNG: Trimmed 64363 records to 43684 (keeping 200 days of data) [2025-10-06T21:44:00.152955] [DEBUG] [LOCAL ] STNG: Primary data saved (43684 records). [2025-10-06T21:44:00.153114] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-06T21:44:00.153201] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STNG took 42.5s. Estimated remaining: 49m 60s. Rate: 7.1 symbols/min [2025-10-06T21:44:00.325916] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:44:00.330797] [DEBUG] [LOCAL ] STXE: Loaded 2216 existing records from primary storage. [2025-10-06T21:44:00.331023] [INFO ] [MAIN ] STXE: Loaded 2216 existing records. [2025-10-06T21:44:00.513858] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:44:00.514081] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-06T21:44:00.514124] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-06T21:44:00.514257] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-06T21:44:00.514294] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-06T21:44:00.630677] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-06T21:44:00.876056] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:44:01.187049] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T21:44:01.425508] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-06T21:44:01.867237] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T21:44:01.872501] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-06T21:44:02.225535] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-06T21:44:03.025544] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-06T21:44:03.517830] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-06T21:44:03.521309] [INFO ] [REMOTE ] STT: Full fetch complete (74336 records). [2025-10-06T21:44:03.521450] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-06T21:44:03.827546] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-06T21:44:04.004213] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-06T21:44:04.004433] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-06T21:44:04.006557] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-06T21:44:04.006672] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-06T21:44:04.010137] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T21:44:04.022570] [DEBUG] [LOCAL ] STT: Trimmed 74336 records to 50958 (keeping 200 days of data) [2025-10-06T21:44:04.358731] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-06T21:44:04.384264] [DEBUG] [LOCAL ] STT: Primary data saved (50958 records). [2025-10-06T21:44:04.384467] [INFO ] [MAIN ] STT: Full history saved. [2025-10-06T21:44:04.384590] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STT took 37.2s. Estimated remaining: 49m 51s. Rate: 7.1 symbols/min [2025-10-06T21:44:04.563829] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:44:04.570150] [DEBUG] [LOCAL ] STXG: Loaded 2533 existing records from primary storage. [2025-10-06T21:44:04.570402] [INFO ] [MAIN ] STXG: Loaded 2533 existing records. [2025-10-06T21:44:04.630860] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-06T21:44:04.767326] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:44:04.767625] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-06T21:44:04.767712] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-06T21:44:04.767903] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-06T21:44:04.767962] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-06T21:44:05.182874] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:44:05.425544] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-06T21:44:06.060589] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-06T21:44:06.225533] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-06T21:44:06.328628] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T21:44:06.680508] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-06T21:44:07.025587] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-06T21:44:07.455099] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-06T21:44:07.825564] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-06T21:44:08.179393] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-06T21:44:08.625539] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-06T21:44:09.425565] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-06T21:44:09.905983] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-06T21:44:10.225538] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-06T21:44:10.262447] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T21:44:10.796987] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-06T21:44:11.025554] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-06T21:44:11.606386] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-06T21:44:11.825563] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-06T21:44:12.186871] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-06T21:44:12.625594] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-06T21:44:13.425543] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-06T21:44:14.048828] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-06T21:44:14.225556] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-06T21:44:14.454186] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T21:44:14.713785] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-06T21:44:15.025588] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-06T21:44:15.496842] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-06T21:44:15.825617] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-06T21:44:16.413636] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-06T21:44:16.625567] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-06T21:44:16.963277] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-06T21:44:17.425588] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-06T21:44:18.225595] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-06T21:44:18.804856] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-06T21:44:19.025503] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-06T21:44:19.292595] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-06T21:44:19.332826] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-06T21:44:19.825545] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-06T21:44:20.207669] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-06T21:44:20.625554] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-06T21:44:21.425533] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-06T21:44:21.700756] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-06T21:44:21.701499] [INFO ] [REMOTE ] STXD: Full fetch complete (2036 records). [2025-10-06T21:44:21.701572] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-06T21:44:22.070207] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-06T21:44:22.070303] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-06T21:44:22.070409] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-06T21:44:22.070484] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-06T21:44:22.070891] [DEBUG] [LOCAL ] STXD: Trimmed 2036 records to 1275 (keeping 200 days of data) [2025-10-06T21:44:22.079160] [DEBUG] [LOCAL ] STXD: Primary data saved (1275 records). [2025-10-06T21:44:22.079220] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-06T21:44:22.079288] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STXD took 24.1s. Estimated remaining: 49m 44s. Rate: 7.1 symbols/min [2025-10-06T21:44:22.228554] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-06T21:44:22.254810] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:44:22.259154] [DEBUG] [LOCAL ] STXK: Loaded 1503 existing records from primary storage. [2025-10-06T21:44:22.259351] [INFO ] [MAIN ] STXK: Loaded 1503 existing records. [2025-10-06T21:44:22.456689] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T21:44:22.469714] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:44:22.480249] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-06T21:44:22.480460] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-06T21:44:22.481011] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-06T21:44:22.481078] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-06T21:44:22.739791] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-06T21:44:22.880201] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:44:23.025521] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-06T21:44:23.475242] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-06T21:44:23.825531] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-06T21:44:24.420082] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-06T21:44:24.625564] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-06T21:44:25.087604] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-06T21:44:25.425533] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-06T21:44:25.874583] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-06T21:44:26.225565] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-06T21:44:26.669731] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-06T21:44:27.025543] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-06T21:44:27.825542] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-06T21:44:28.280232] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-06T21:44:28.625513] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-06T21:44:28.735784] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T21:44:29.076539] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-06T21:44:29.425544] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-06T21:44:29.904179] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-06T21:44:30.225568] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-06T21:44:31.025541] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-06T21:44:31.469852] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-06T21:44:31.830748] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-06T21:44:31.871473] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T21:44:32.361799] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-06T21:44:32.625586] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-06T21:44:33.240707] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-06T21:44:33.425505] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-06T21:44:33.960509] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-06T21:44:34.225551] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-06T21:44:34.659752] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-06T21:44:35.025567] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-06T21:44:35.408290] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T21:44:35.409449] [INFO ] [REMOTE ] STXE: Full fetch complete (3621 records). [2025-10-06T21:44:35.409525] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-06T21:44:35.768720] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-06T21:44:35.768813] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-06T21:44:35.768946] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-06T21:44:35.768984] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-06T21:44:35.769388] [DEBUG] [LOCAL ] STXE: Trimmed 3621 records to 2119 (keeping 200 days of data) [2025-10-06T21:44:35.782318] [DEBUG] [LOCAL ] STXE: Primary data saved (2119 records). [2025-10-06T21:44:35.782382] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-06T21:44:35.782450] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STXE took 35.6s. Estimated remaining: 49m 36s. Rate: 7.1 symbols/min [2025-10-06T21:44:35.835510] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-06T21:44:35.958717] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:44:35.958977] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-06T21:44:35.959018] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-06T21:44:35.959155] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-06T21:44:35.959198] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-06T21:44:35.959240] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-06T21:44:35.959274] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-06T21:44:36.260825] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-06T21:44:36.351250] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:44:36.625547] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-06T21:44:37.067463] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-06T21:44:37.425599] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-06T21:44:37.860866] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-06T21:44:38.225532] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-06T21:44:39.025573] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-06T21:44:39.530813] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-06T21:44:39.825511] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-06T21:44:39.996203] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T21:44:40.300363] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-06T21:44:40.625586] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-06T21:44:40.915776] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-06T21:44:40.916862] [INFO ] [REMOTE ] STXK: Full fetch complete (2400 records). [2025-10-06T21:44:40.916951] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-06T21:44:41.337350] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-06T21:44:41.337571] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-06T21:44:41.337764] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-06T21:44:41.337829] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-06T21:44:41.338346] [DEBUG] [LOCAL ] STXK: Trimmed 2400 records to 1497 (keeping 200 days of data) [2025-10-06T21:44:41.348459] [DEBUG] [LOCAL ] STXK: Primary data saved (1497 records). [2025-10-06T21:44:41.348528] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-06T21:44:41.348685] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STXK took 19.3s. Estimated remaining: 49m 27s. Rate: 7.1 symbols/min [2025-10-06T21:44:41.430802] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-06T21:44:41.533063] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:44:41.540697] [DEBUG] [LOCAL ] STXT: Loaded 2568 existing records from primary storage. [2025-10-06T21:44:41.541002] [INFO ] [MAIN ] STXT: Loaded 2568 existing records. [2025-10-06T21:44:41.729436] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:44:41.729792] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-06T21:44:41.729855] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-06T21:44:41.730142] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-06T21:44:41.730205] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-06T21:44:42.109629] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:44:42.225551] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-06T21:44:42.563852] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-06T21:44:42.863799] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T21:44:42.866912] [INFO ] [REMOTE ] STWD: Full fetch complete (75182 records). [2025-10-06T21:44:42.867099] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-06T21:44:43.043313] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-06T21:44:43.262907] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-06T21:44:43.263060] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-06T21:44:43.264302] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-06T21:44:43.264379] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-06T21:44:43.265901] [DEBUG] [LOCAL ] STWD: Trimmed 75182 records to 51917 (keeping 200 days of data) [2025-10-06T21:44:43.600417] [DEBUG] [LOCAL ] STWD: Primary data saved (51917 records). [2025-10-06T21:44:43.600566] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-06T21:44:43.600678] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STWD took 52.3s. Estimated remaining: 49m 18s. Rate: 7.1 symbols/min [2025-10-06T21:44:43.696751] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-06T21:44:43.777441] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:44:43.777629] [DEBUG] [LOCAL ] STXV: No existing data file found in primary storage. [2025-10-06T21:44:43.777703] [WARN ] [MAIN ] STXV: No existing data found, performing full refresh instead. [2025-10-06T21:44:43.777837] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-06T21:44:43.777893] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-06T21:44:43.777937] [DEBUG] [LOCAL ] STXV: No primary data file found to delete. [2025-10-06T21:44:43.777969] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-06T21:44:43.830749] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-06T21:44:44.131769] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:44:44.332705] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-06T21:44:44.625560] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-06T21:44:45.101109] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-06T21:44:45.425564] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-06T21:44:45.810515] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T21:44:45.811294] [INFO ] [REMOTE ] STXG: Full fetch complete (4151 records). [2025-10-06T21:44:45.811363] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-06T21:44:46.198502] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-06T21:44:46.198601] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-06T21:44:46.198849] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-06T21:44:46.198915] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-06T21:44:46.199302] [DEBUG] [LOCAL ] STXG: Trimmed 4151 records to 2476 (keeping 200 days of data) [2025-10-06T21:44:46.215036] [DEBUG] [LOCAL ] STXG: Primary data saved (2476 records). [2025-10-06T21:44:46.215116] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-06T21:44:46.215201] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXG took 41.8s. Estimated remaining: 49m 8s. Rate: 7.1 symbols/min [2025-10-06T21:44:46.230635] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-06T21:44:46.389936] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:44:46.451299] [DEBUG] [LOCAL ] STZ: Loaded 53064 existing records from primary storage. [2025-10-06T21:44:46.451757] [INFO ] [MAIN ] STZ: Loaded 53064 existing records. [2025-10-06T21:44:46.630477] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:44:46.630770] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-06T21:44:46.630825] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-06T21:44:46.631192] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-06T21:44:46.631260] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-06T21:44:46.719912] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-06T21:44:47.004730] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:44:47.025477] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-06T21:44:47.825577] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-06T21:44:48.202581] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-06T21:44:48.625558] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-06T21:44:48.813858] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T21:44:49.060170] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-06T21:44:49.425584] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-06T21:44:50.030746] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T21:44:50.225513] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-06T21:44:50.715386] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-06T21:44:51.025555] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-06T21:44:51.446926] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-06T21:44:51.825564] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-06T21:44:52.277408] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-06T21:44:52.625562] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-06T21:44:53.102661] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-06T21:44:53.425503] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-06T21:44:54.225548] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-06T21:44:54.586185] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-06T21:44:55.025542] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-06T21:44:55.128281] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T21:44:55.450823] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-06T21:44:55.825535] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-06T21:44:56.332972] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-06T21:44:56.625545] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-06T21:44:57.088025] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-06T21:44:57.425540] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-06T21:44:57.784408] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-06T21:44:58.225552] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-06T21:44:59.025545] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-06T21:44:59.550373] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-06T21:44:59.825542] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-06T21:45:00.231347] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-06T21:45:00.389785] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-06T21:45:00.625579] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-06T21:45:01.058311] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T21:45:01.425578] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-06T21:45:01.867420] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-06T21:45:02.225549] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-06T21:45:02.679496] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-06T21:45:03.025557] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-06T21:45:03.528255] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-06T21:45:03.825541] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-06T21:45:04.187939] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-06T21:45:04.625583] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-06T21:45:05.218611] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T21:45:05.219588] [INFO ] [REMOTE ] STXT: Full fetch complete (3943 records). [2025-10-06T21:45:05.219689] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-06T21:45:05.434527] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-06T21:45:05.615319] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-06T21:45:05.615429] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-06T21:45:05.615692] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-06T21:45:05.615758] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-06T21:45:05.616315] [DEBUG] [LOCAL ] STXT: Trimmed 3943 records to 2508 (keeping 200 days of data) [2025-10-06T21:45:05.634801] [DEBUG] [LOCAL ] STXT: Primary data saved (2508 records). [2025-10-06T21:45:05.634985] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-06T21:45:05.635131] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXT took 24.3s. Estimated remaining: 49m 2s. Rate: 7.1 symbols/min [2025-10-06T21:45:05.823749] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:45:05.888703] [DEBUG] [LOCAL ] SU: Loaded 54223 existing records from primary storage. [2025-10-06T21:45:05.889474] [INFO ] [MAIN ] SU: Loaded 54223 existing records. [2025-10-06T21:45:05.963514] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-06T21:45:06.089774] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:45:06.090084] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-06T21:45:06.090135] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-06T21:45:06.090397] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-06T21:45:06.090457] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-06T21:45:06.230719] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-06T21:45:06.484084] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:45:06.800526] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-06T21:45:07.025583] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-06T21:45:07.396882] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-06T21:45:07.825537] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-06T21:45:08.175362] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-06T21:45:08.625526] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-06T21:45:08.978351] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-06T21:45:09.425604] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-06T21:45:09.861482] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-06T21:45:10.225550] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-06T21:45:10.554930] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-06T21:45:10.555831] [INFO ] [REMOTE ] STXM: Full fetch complete (1431 records). [2025-10-06T21:45:10.555909] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-06T21:45:10.750740] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-06T21:45:10.750963] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:45:10.751033] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:45:10.751108] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-06T21:45:10.751211] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-06T21:45:10.751269] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-06T21:45:10.751316] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-06T21:45:10.751378] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXM took 35.0s. Estimated remaining: 48m 53s. Rate: 7.1 symbols/min [2025-10-06T21:45:10.931944] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:45:10.986413] [DEBUG] [LOCAL ] SUI: Loaded 42248 existing records from primary storage. [2025-10-06T21:45:10.986933] [INFO ] [MAIN ] SUI: Loaded 42248 existing records. [2025-10-06T21:45:11.030740] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-06T21:45:11.179043] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:45:11.179333] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-06T21:45:11.179392] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-06T21:45:11.179720] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-06T21:45:11.179802] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-06T21:45:11.539619] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:45:11.825553] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-06T21:45:12.625593] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-06T21:45:13.161157] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-06T21:45:13.202092] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T21:45:13.425547] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-06T21:45:14.166406] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T21:45:14.225504] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-06T21:45:15.025499] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-06T21:45:15.402100] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-06T21:45:15.437666] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T21:45:15.790506] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T21:45:15.825468] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-06T21:45:16.625543] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-06T21:45:16.898332] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-06T21:45:16.899120] [INFO ] [REMOTE ] STXV: Full fetch complete (2603 records). [2025-10-06T21:45:16.899192] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-06T21:45:17.264034] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-06T21:45:17.264127] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-06T21:45:17.264233] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-06T21:45:17.264270] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-06T21:45:17.264597] [DEBUG] [LOCAL ] STXV: Trimmed 2603 records to 1556 (keeping 200 days of data) [2025-10-06T21:45:17.274613] [DEBUG] [LOCAL ] STXV: Primary data saved (1556 records). [2025-10-06T21:45:17.274703] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-06T21:45:17.274775] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STXV took 33.7s. Estimated remaining: 48m 44s. Rate: 7.1 symbols/min [2025-10-06T21:45:17.428140] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-06T21:45:17.448588] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:45:17.488802] [DEBUG] [LOCAL ] SUN: Loaded 38153 existing records from primary storage. [2025-10-06T21:45:17.489144] [INFO ] [MAIN ] SUN: Loaded 38153 existing records. [2025-10-06T21:45:17.669837] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:45:17.686302] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-06T21:45:17.693101] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-06T21:45:17.696152] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-06T21:45:17.696595] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-06T21:45:17.730016] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-06T21:45:18.068745] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:45:18.225549] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-06T21:45:18.691216] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T21:45:19.025538] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-06T21:45:19.675528] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T21:45:19.825562] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-06T21:45:20.625483] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-06T21:45:21.141037] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-06T21:45:21.304896] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-06T21:45:21.425548] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-06T21:45:22.146829] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T21:45:22.225512] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-06T21:45:22.829259] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T21:45:23.025525] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-06T21:45:23.700303] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T21:45:23.825560] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-06T21:45:24.630819] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-06T21:45:24.648784] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T21:45:25.425583] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-06T21:45:25.692992] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T21:45:26.225536] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-06T21:45:26.469336] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-06T21:45:27.019923] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T21:45:27.027935] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-06T21:45:27.371690] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T21:45:27.825551] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-06T21:45:28.625570] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-06T21:45:29.282689] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-06T21:45:29.432240] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-06T21:45:29.455487] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T21:45:30.225556] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-06T21:45:30.458847] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T21:45:31.025541] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-06T21:45:31.467108] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-06T21:45:31.825529] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-06T21:45:31.978703] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T21:45:32.625518] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-06T21:45:32.853724] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T21:45:33.425548] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-06T21:45:33.715436] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T21:45:33.777218] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-06T21:45:34.225566] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-06T21:45:35.025506] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-06T21:45:35.348117] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-06T21:45:35.379613] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-06T21:45:35.496451] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T21:45:35.499720] [INFO ] [REMOTE ] STZ: Full fetch complete (75895 records). [2025-10-06T21:45:35.499844] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-06T21:45:35.836405] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-06T21:45:35.894580] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-06T21:45:35.894690] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-06T21:45:35.895863] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-06T21:45:35.895925] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-06T21:45:35.897830] [DEBUG] [LOCAL ] STZ: Trimmed 75895 records to 52309 (keeping 200 days of data) [2025-10-06T21:45:36.242253] [DEBUG] [LOCAL ] STZ: Primary data saved (52309 records). [2025-10-06T21:45:36.242415] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-06T21:45:36.242502] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. STZ took 50.0s. Estimated remaining: 48m 37s. Rate: 7.1 symbols/min [2025-10-06T21:45:36.407562] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:45:36.452599] [DEBUG] [LOCAL ] SUPV: Loaded 48056 existing records from primary storage. [2025-10-06T21:45:36.452983] [INFO ] [MAIN ] SUPV: Loaded 48056 existing records. [2025-10-06T21:45:36.636873] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-06T21:45:36.642243] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:45:36.644121] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-06T21:45:36.644301] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-06T21:45:36.644961] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-06T21:45:36.645020] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-06T21:45:36.997842] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:45:37.425504] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-06T21:45:37.746800] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-06T21:45:38.225527] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-06T21:45:38.393507] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T21:45:38.819481] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T21:45:39.025538] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-06T21:45:39.825510] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-06T21:45:40.046525] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T21:45:40.529765] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T21:45:40.625570] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-06T21:45:41.425498] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-06T21:45:41.539954] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T21:45:42.091159] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-06T21:45:42.225541] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-06T21:45:42.784517] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T21:45:42.787548] [INFO ] [REMOTE ] SU: Full fetch complete (77386 records). [2025-10-06T21:45:42.787689] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-06T21:45:43.030744] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-06T21:45:43.203392] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-06T21:45:43.203481] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-06T21:45:43.204670] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-06T21:45:43.204737] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-06T21:45:43.206243] [DEBUG] [LOCAL ] SU: Trimmed 77386 records to 53436 (keeping 200 days of data) [2025-10-06T21:45:43.559568] [DEBUG] [LOCAL ] SU: Primary data saved (53436 records). [2025-10-06T21:45:43.560394] [INFO ] [MAIN ] SU: Full history saved. [2025-10-06T21:45:43.561398] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. SU took 37.9s. Estimated remaining: 48m 29s. Rate: 7.1 symbols/min [2025-10-06T21:45:43.561258] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-06T21:45:43.739034] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:45:43.781971] [DEBUG] [LOCAL ] SUZ: Loaded 46242 existing records from primary storage. [2025-10-06T21:45:43.782390] [INFO ] [MAIN ] SUZ: Loaded 46242 existing records. [2025-10-06T21:45:43.830715] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-06T21:45:43.967516] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:45:43.967775] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-06T21:45:43.967828] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-06T21:45:43.968110] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-06T21:45:43.968168] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-06T21:45:44.321893] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:45:44.349361] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T21:45:44.351953] [INFO ] [REMOTE ] SUI: Full fetch complete (60860 records). [2025-10-06T21:45:44.352088] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-06T21:45:44.630717] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-06T21:45:44.754616] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-06T21:45:44.754755] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-06T21:45:44.755975] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-06T21:45:44.756041] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-06T21:45:44.757355] [DEBUG] [LOCAL ] SUI: Trimmed 60860 records to 41603 (keeping 200 days of data) [2025-10-06T21:45:45.022298] [DEBUG] [LOCAL ] SUI: Primary data saved (41603 records). [2025-10-06T21:45:45.022478] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-06T21:45:45.023077] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. SUI took 34.3s. Estimated remaining: 48m 19s. Rate: 7.1 symbols/min [2025-10-06T21:45:45.195546] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:45:45.238247] [DEBUG] [LOCAL ] SVV: Loaded 40338 existing records from primary storage. [2025-10-06T21:45:45.238601] [INFO ] [MAIN ] SVV: Loaded 40338 existing records. [2025-10-06T21:45:45.426041] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-06T21:45:45.425946] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:45:45.427348] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-06T21:45:45.427459] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-06T21:45:45.427835] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-06T21:45:45.428050] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-06T21:45:45.628499] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T21:45:45.830714] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:45:46.225574] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-06T21:45:46.385794] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T21:45:46.987131] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T21:45:47.025505] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-06T21:45:47.775601] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T21:45:47.825570] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-06T21:45:48.391569] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T21:45:48.625502] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-06T21:45:48.673499] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-06T21:45:49.425538] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-06T21:45:49.937469] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T21:45:50.225557] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-06T21:45:50.493766] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T21:45:50.496332] [INFO ] [REMOTE ] SUN: Full fetch complete (55183 records). [2025-10-06T21:45:50.496477] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-06T21:45:50.878101] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-06T21:45:50.878225] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-06T21:45:50.879267] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-06T21:45:50.879333] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-06T21:45:50.880536] [DEBUG] [LOCAL ] SUN: Trimmed 55183 records to 37773 (keeping 200 days of data) [2025-10-06T21:45:51.046798] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-06T21:45:51.112900] [DEBUG] [LOCAL ] SUN: Primary data saved (37773 records). [2025-10-06T21:45:51.113084] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-06T21:45:51.113191] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUN took 33.8s. Estimated remaining: 48m 10s. Rate: 7.1 symbols/min [2025-10-06T21:45:51.297175] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:45:51.355463] [DEBUG] [LOCAL ] SW: Loaded 53942 existing records from primary storage. [2025-10-06T21:45:51.355940] [INFO ] [MAIN ] SW: Loaded 53942 existing records. [2025-10-06T21:45:51.558839] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:45:51.559498] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-06T21:45:51.559691] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-06T21:45:51.560098] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-06T21:45:51.560243] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-06T21:45:51.758057] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T21:45:51.830727] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-06T21:45:51.989534] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:45:52.583408] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T21:45:52.625523] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-06T21:45:53.425593] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-06T21:45:53.477754] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T21:45:54.227947] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-06T21:45:54.231593] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T21:45:54.757514] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T21:45:55.025544] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-06T21:45:55.825500] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-06T21:45:56.069945] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-06T21:45:56.333734] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-06T21:45:56.625538] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-06T21:45:57.249234] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T21:45:57.425518] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-06T21:45:58.022523] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T21:45:58.225575] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-06T21:45:58.905928] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T21:45:59.025537] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-06T21:45:59.825537] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-06T21:45:59.916104] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T21:46:00.623088] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T21:46:00.633775] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-06T21:46:01.425578] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-06T21:46:01.498339] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T21:46:02.158105] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-06T21:46:02.225564] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-06T21:46:03.025550] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-06T21:46:03.075405] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T21:46:03.740773] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T21:46:03.825540] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-06T21:46:04.625583] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-06T21:46:04.766362] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T21:46:04.863120] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T21:46:05.425518] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-06T21:46:06.225578] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-06T21:46:06.321843] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T21:46:06.964872] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T21:46:07.025520] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-06T21:46:07.825486] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-06T21:46:07.916037] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T21:46:08.311273] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T21:46:08.625537] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-06T21:46:09.425496] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-06T21:46:09.642054] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T21:46:10.202543] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T21:46:10.225487] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-06T21:46:10.738730] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-06T21:46:11.025543] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-06T21:46:11.825506] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-06T21:46:11.933769] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T21:46:12.379062] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T21:46:12.382584] [INFO ] [REMOTE ] SUPV: Full fetch complete (68433 records). [2025-10-06T21:46:12.382882] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-06T21:46:12.635127] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-06T21:46:12.779490] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-06T21:46:12.779581] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-06T21:46:12.780699] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-06T21:46:12.780775] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-06T21:46:12.782686] [DEBUG] [LOCAL ] SUPV: Trimmed 68433 records to 47383 (keeping 200 days of data) [2025-10-06T21:46:13.048324] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-06T21:46:13.105022] [DEBUG] [LOCAL ] SUPV: Primary data saved (47383 records). [2025-10-06T21:46:13.105190] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-06T21:46:13.105288] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SUPV took 36.9s. Estimated remaining: 48m 4s. Rate: 7.1 symbols/min [2025-10-06T21:46:13.270753] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:46:13.320383] [DEBUG] [LOCAL ] SWK: Loaded 53135 existing records from primary storage. [2025-10-06T21:46:13.320789] [INFO ] [MAIN ] SWK: Loaded 53135 existing records. [2025-10-06T21:46:13.433833] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-06T21:46:13.530681] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:46:13.530937] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-06T21:46:13.530992] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-06T21:46:13.531267] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-06T21:46:13.531325] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-06T21:46:13.895974] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:46:14.173848] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T21:46:14.225529] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-06T21:46:14.631260] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-06T21:46:15.025598] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-06T21:46:15.310537] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T21:46:15.313166] [INFO ] [REMOTE ] SUZ: Full fetch complete (66647 records). [2025-10-06T21:46:15.313292] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-06T21:46:15.704929] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-06T21:46:15.705037] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-06T21:46:15.706337] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-06T21:46:15.706417] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-06T21:46:15.707888] [DEBUG] [LOCAL ] SUZ: Trimmed 66647 records to 45512 (keeping 200 days of data) [2025-10-06T21:46:15.870066] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-06T21:46:15.984234] [DEBUG] [LOCAL ] SUZ: Primary data saved (45512 records). [2025-10-06T21:46:15.984420] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-06T21:46:15.984534] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SUZ took 32.4s. Estimated remaining: 47m 55s. Rate: 7.1 symbols/min [2025-10-06T21:46:16.161261] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:46:16.193543] [DEBUG] [LOCAL ] SWX: Loaded 31444 existing records from primary storage. [2025-10-06T21:46:16.193942] [INFO ] [MAIN ] SWX: Loaded 31444 existing records. [2025-10-06T21:46:16.384024] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:46:16.384301] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-06T21:46:16.384350] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-06T21:46:16.384561] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-06T21:46:16.384618] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-06T21:46:16.633014] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-06T21:46:16.756343] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:46:16.885502] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T21:46:17.142472] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T21:46:17.145060] [INFO ] [REMOTE ] SVV: Full fetch complete (56489 records). [2025-10-06T21:46:17.145168] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-06T21:46:17.431433] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-06T21:46:17.527837] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-06T21:46:17.527932] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-06T21:46:17.529042] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-06T21:46:17.529107] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-06T21:46:17.530342] [DEBUG] [LOCAL ] SVV: Trimmed 56489 records to 39823 (keeping 200 days of data) [2025-10-06T21:46:17.776204] [DEBUG] [LOCAL ] SVV: Primary data saved (39823 records). [2025-10-06T21:46:17.776477] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-06T21:46:17.776625] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SVV took 32.8s. Estimated remaining: 47m 45s. Rate: 7.1 symbols/min [2025-10-06T21:46:17.964118] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:46:17.974039] [DEBUG] [LOCAL ] SWZ: Loaded 6092 existing records from primary storage. [2025-10-06T21:46:17.974341] [INFO ] [MAIN ] SWZ: Loaded 6092 existing records. [2025-10-06T21:46:18.176043] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:46:18.176374] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-06T21:46:18.176429] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-06T21:46:18.176706] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-06T21:46:18.176768] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-06T21:46:18.231753] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-06T21:46:18.581451] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:46:18.620102] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-06T21:46:19.025497] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-06T21:46:19.300585] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-06T21:46:19.403610] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T21:46:19.690968] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-06T21:46:19.825556] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-06T21:46:20.625606] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-06T21:46:21.407847] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T21:46:21.425485] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-06T21:46:21.906368] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T21:46:22.225524] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-06T21:46:23.025503] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-06T21:46:23.305347] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T21:46:23.825505] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-06T21:46:23.983894] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T21:46:24.102128] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T21:46:24.431277] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T21:46:24.625570] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-06T21:46:25.219445] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-06T21:46:25.425505] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-06T21:46:26.097413] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-06T21:46:26.225560] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-06T21:46:27.025538] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-06T21:46:27.687308] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T21:46:27.825542] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-06T21:46:28.625519] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-06T21:46:29.012054] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T21:46:29.200398] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T21:46:29.425627] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-06T21:46:30.225532] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-06T21:46:30.370435] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T21:46:30.393143] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-06T21:46:31.025553] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-06T21:46:31.825557] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-06T21:46:32.127454] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T21:46:32.625512] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-06T21:46:32.841514] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T21:46:33.208249] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T21:46:33.244426] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-06T21:46:33.425518] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-06T21:46:34.225579] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-06T21:46:34.837180] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-06T21:46:35.025610] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-06T21:46:35.604288] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T21:46:35.825555] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-06T21:46:35.927360] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T21:46:36.433759] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-06T21:46:36.625548] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-06T21:46:37.431375] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-06T21:46:37.432320] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-06T21:46:38.225590] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-06T21:46:38.889978] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T21:46:39.025543] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-06T21:46:39.825676] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-06T21:46:39.963560] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T21:46:40.291261] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-06T21:46:40.625537] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-06T21:46:41.425491] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-06T21:46:41.756875] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-06T21:46:41.798245] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T21:46:41.898536] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T21:46:41.902947] [INFO ] [REMOTE ] SW: Full fetch complete (76810 records). [2025-10-06T21:46:41.903254] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-06T21:46:42.230614] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-06T21:46:42.313768] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-06T21:46:42.313856] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-06T21:46:42.315041] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-06T21:46:42.315122] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-06T21:46:42.316596] [DEBUG] [LOCAL ] SW: Trimmed 76810 records to 53169 (keeping 200 days of data) [2025-10-06T21:46:42.636728] [DEBUG] [LOCAL ] SW: Primary data saved (53169 records). [2025-10-06T21:46:42.636883] [INFO ] [MAIN ] SW: Full history saved. [2025-10-06T21:46:42.636970] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SW took 51.5s. Estimated remaining: 47m 39s. Rate: 7.1 symbols/min [2025-10-06T21:46:42.805118] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:46:42.846509] [DEBUG] [LOCAL ] SXC: Loaded 42071 existing records from primary storage. [2025-10-06T21:46:42.846907] [INFO ] [MAIN ] SXC: Loaded 42071 existing records. [2025-10-06T21:46:42.913810] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-06T21:46:43.031091] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-06T21:46:43.037000] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:46:43.038140] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-06T21:46:43.038197] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-06T21:46:43.038507] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-06T21:46:43.038569] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-06T21:46:43.399052] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:46:43.825542] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-06T21:46:44.138461] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T21:46:44.140500] [INFO ] [REMOTE ] SWX: Full fetch complete (44057 records). [2025-10-06T21:46:44.140580] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-06T21:46:44.548311] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-06T21:46:44.548432] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-06T21:46:44.549362] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-06T21:46:44.549424] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-06T21:46:44.550460] [DEBUG] [LOCAL ] SWX: Trimmed 44057 records to 31186 (keeping 200 days of data) [2025-10-06T21:46:44.642688] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-06T21:46:44.746972] [DEBUG] [LOCAL ] SWX: Primary data saved (31186 records). [2025-10-06T21:46:44.747135] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-06T21:46:44.747257] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SWX took 28.8s. Estimated remaining: 47m 30s. Rate: 7.1 symbols/min [2025-10-06T21:46:44.919109] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:46:44.933118] [DEBUG] [LOCAL ] SXI: Loaded 11760 existing records from primary storage. [2025-10-06T21:46:44.933380] [INFO ] [MAIN ] SXI: Loaded 11760 existing records. [2025-10-06T21:46:45.131843] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:46:45.132114] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-06T21:46:45.132323] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-06T21:46:45.132611] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-06T21:46:45.132701] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-06T21:46:45.426259] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-06T21:46:45.536566] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-06T21:46:45.534434] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:46:45.951553] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T21:46:45.952625] [INFO ] [REMOTE ] SWZ: Full fetch complete (8144 records). [2025-10-06T21:46:45.952726] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-06T21:46:46.225933] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-06T21:46:46.357375] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-06T21:46:46.357517] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-06T21:46:46.357918] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-06T21:46:46.357984] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-06T21:46:46.359157] [DEBUG] [LOCAL ] SWZ: Trimmed 8144 records to 6036 (keeping 200 days of data) [2025-10-06T21:46:46.396725] [DEBUG] [LOCAL ] SWZ: Primary data saved (6036 records). [2025-10-06T21:46:46.396900] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-06T21:46:46.397021] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SWZ took 28.6s. Estimated remaining: 47m 20s. Rate: 7.1 symbols/min [2025-10-06T21:46:46.573669] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:46:46.609793] [DEBUG] [LOCAL ] SXT: Loaded 29985 existing records from primary storage. [2025-10-06T21:46:46.610239] [INFO ] [MAIN ] SXT: Loaded 29985 existing records. [2025-10-06T21:46:46.810974] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:46:46.811325] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-06T21:46:46.811490] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-06T21:46:46.812331] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-06T21:46:46.812431] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-06T21:46:46.958022] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-06T21:46:46.976140] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-06T21:46:47.032010] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-06T21:46:47.264546] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:46:47.802699] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T21:46:47.825469] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-06T21:46:48.625531] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-06T21:46:48.657783] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T21:46:49.425535] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-06T21:46:49.986542] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T21:46:50.147731] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-06T21:46:50.225488] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-06T21:46:51.025592] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-06T21:46:51.684418] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-06T21:46:51.825513] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-06T21:46:52.009131] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-06T21:46:52.625534] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-06T21:46:53.425504] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-06T21:46:53.490111] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T21:46:53.548884] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-06T21:46:54.225560] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-06T21:46:54.872326] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T21:46:54.875354] [INFO ] [REMOTE ] SWK: Full fetch complete (75324 records). [2025-10-06T21:46:54.876174] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-06T21:46:55.034065] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-06T21:46:55.335729] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-06T21:46:55.336732] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-06T21:46:55.336248] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-06T21:46:55.341970] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-06T21:46:55.342635] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-06T21:46:55.344034] [DEBUG] [LOCAL ] SWK: Trimmed 75324 records to 52429 (keeping 200 days of data) [2025-10-06T21:46:55.697325] [DEBUG] [LOCAL ] SWK: Primary data saved (52429 records). [2025-10-06T21:46:55.697514] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-06T21:46:55.698727] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SWK took 42.6s. Estimated remaining: 47m 12s. Rate: 7.1 symbols/min [2025-10-06T21:46:55.826876] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-06T21:46:55.879198] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:46:55.886720] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T21:46:55.948034] [DEBUG] [LOCAL ] SYF: Loaded 54222 existing records from primary storage. [2025-10-06T21:46:55.948455] [INFO ] [MAIN ] SYF: Loaded 54222 existing records. [2025-10-06T21:46:56.151059] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:46:56.151397] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-06T21:46:56.151454] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-06T21:46:56.151854] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-06T21:46:56.151918] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-06T21:46:56.516034] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:46:56.625596] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-06T21:46:56.878953] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T21:46:57.425530] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-06T21:46:58.225565] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-06T21:46:58.436188] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T21:46:58.488883] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T21:46:59.025540] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-06T21:46:59.529443] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-06T21:46:59.820007] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-06T21:46:59.825467] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-06T21:47:00.625557] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-06T21:47:00.759572] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-06T21:47:01.425701] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-06T21:47:02.149677] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T21:47:02.225517] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-06T21:47:03.025505] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-06T21:47:03.288735] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T21:47:03.764880] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T21:47:03.825466] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-06T21:47:04.232168] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-06T21:47:04.625577] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-06T21:47:05.411397] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T21:47:05.425476] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-06T21:47:05.946796] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T21:47:06.225541] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-06T21:47:06.658352] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T21:47:07.025548] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-06T21:47:07.825504] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-06T21:47:08.077489] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T21:47:08.469319] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T21:47:08.487512] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-06T21:47:08.625531] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-06T21:47:09.425489] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-06T21:47:09.819426] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T21:47:10.225616] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-06T21:47:10.553785] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T21:47:11.025610] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-06T21:47:11.825508] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-06T21:47:11.921855] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-06T21:47:12.053369] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T21:47:12.625571] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-06T21:47:12.995830] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T21:47:12.998473] [INFO ] [REMOTE ] SXC: Full fetch complete (61123 records). [2025-10-06T21:47:12.998593] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-06T21:47:13.415316] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-06T21:47:13.415444] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-06T21:47:13.416837] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-06T21:47:13.416905] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-06T21:47:13.418490] [DEBUG] [LOCAL ] SXC: Trimmed 61123 records to 41383 (keeping 200 days of data) [2025-10-06T21:47:13.472375] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-06T21:47:13.681206] [DEBUG] [LOCAL ] SXC: Primary data saved (41383 records). [2025-10-06T21:47:13.681383] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-06T21:47:13.681505] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SXC took 31.0s. Estimated remaining: 47m 5s. Rate: 7.1 symbols/min [2025-10-06T21:47:13.757269] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T21:47:14.225598] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-06T21:47:14.686662] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T21:47:14.688878] [INFO ] [REMOTE ] SXI: Full fetch complete (15002 records). [2025-10-06T21:47:14.689203] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-06T21:47:15.031780] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-06T21:47:15.068084] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-06T21:47:15.068180] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-06T21:47:15.068828] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-06T21:47:15.068987] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-06T21:47:15.070303] [DEBUG] [LOCAL ] SXI: Trimmed 15002 records to 11660 (keeping 200 days of data) [2025-10-06T21:47:15.178193] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T21:47:15.206002] [DEBUG] [LOCAL ] SXI: Primary data saved (11660 records). [2025-10-06T21:47:15.206237] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-06T21:47:15.206392] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXI took 30.5s. Estimated remaining: 46m 55s. Rate: 7.1 symbols/min [2025-10-06T21:47:15.825759] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-06T21:47:16.611975] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T21:47:16.625494] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-06T21:47:17.933015] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-06T21:47:17.939577] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-06T21:47:18.070312] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-06T21:47:18.225551] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-06T21:47:19.301733] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-06T21:47:19.308862] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-06T21:47:19.976782] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T21:47:19.988665] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-06T21:47:20.434986] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T21:47:20.437421] [INFO ] [REMOTE ] SXT: Full fetch complete (38857 records). [2025-10-06T21:47:20.437519] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-06T21:47:20.813434] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-06T21:47:20.813532] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-06T21:47:20.814387] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-06T21:47:20.814453] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-06T21:47:20.815448] [DEBUG] [LOCAL ] SXT: Trimmed 38857 records to 29788 (keeping 200 days of data) [2025-10-06T21:47:21.005927] [DEBUG] [LOCAL ] SXT: Primary data saved (29788 records). [2025-10-06T21:47:21.006095] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-06T21:47:21.006203] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SXT took 34.6s. Estimated remaining: 46m 47s. Rate: 7.1 symbols/min [2025-10-06T21:47:21.761199] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-06T21:47:21.773168] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-06T21:47:23.587834] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T21:47:23.599494] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-06T21:47:24.064805] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T21:47:24.067935] [INFO ] [REMOTE ] SYF: Full fetch complete (77329 records). [2025-10-06T21:47:24.068080] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-06T21:47:24.468531] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-06T21:47:24.468628] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-06T21:47:24.469917] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-06T21:47:24.469982] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-06T21:47:24.471456] [DEBUG] [LOCAL ] SYF: Trimmed 77329 records to 53443 (keeping 200 days of data) [2025-10-06T21:47:24.803459] [DEBUG] [LOCAL ] SYF: Primary data saved (53443 records). [2025-10-06T21:47:24.803631] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-06T21:47:24.804845] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. SYF took 29.1s. Estimated remaining: 46m 37s. Rate: 7.1 symbols/min [2025-10-06T21:47:25.410149] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:47:25.545015] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:47:25.565051] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:47:25.599431] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:47:25.669549] [DEBUG] [LOCAL ] SYK: Loaded 47617 existing records from primary storage. [2025-10-06T21:47:25.670371] [INFO ] [MAIN ] SYK: Loaded 47617 existing records. [2025-10-06T21:47:25.855379] [DEBUG] [LOCAL ] TAC: Loaded 43221 existing records from primary storage. [2025-10-06T21:47:25.892031] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-10-06T21:47:25.872063] [DEBUG] [LOCAL ] SYY: Loaded 53996 existing records from primary storage. [2025-10-06T21:47:25.885911] [INFO ] [MAIN ] TAC: Loaded 43221 existing records. [2025-10-06T21:47:25.908162] [INFO ] [MAIN ] T: Loaded 54578 existing records. [2025-10-06T21:47:25.914408] [INFO ] [MAIN ] SYY: Loaded 53996 existing records. [2025-10-06T21:47:25.999079] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:47:26.140570] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-06T21:47:26.207110] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-06T21:47:26.248002] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-06T21:47:26.295591] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-06T21:47:26.475816] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:47:26.495764] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:47:26.526057] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-06T21:47:26.526264] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-06T21:47:26.525871] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:47:26.546034] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-06T21:47:26.570992] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-06T21:47:26.571287] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-06T21:47:26.571239] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-06T21:47:26.576873] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-06T21:47:26.597905] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-06T21:47:26.571464] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-06T21:47:26.598144] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-06T21:47:26.610196] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-06T21:47:26.615605] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-06T21:47:27.860570] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:47:27.967982] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-06T21:47:28.059797] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:47:28.088792] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-06T21:47:28.220920] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:47:28.222705] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-06T21:47:28.251158] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:47:28.251744] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-06T21:47:29.860287] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-06T21:47:29.869636] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-06T21:47:29.941613] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T21:47:29.951245] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-06T21:47:30.009587] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-06T21:47:30.020137] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-06T21:47:30.820227] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-10-06T21:47:30.831107] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-06T21:47:31.592073] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T21:47:31.602190] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-06T21:47:31.690629] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T21:47:31.700951] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-06T21:47:31.844146] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T21:47:31.855033] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-06T21:47:32.923735] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-06T21:47:32.934545] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-06T21:47:32.960296] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-06T21:47:32.970065] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-06T21:47:33.512715] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T21:47:33.522918] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-06T21:47:33.559618] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T21:47:33.570482] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-06T21:47:34.526310] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T21:47:34.536084] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-06T21:47:34.845946] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T21:47:35.025584] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-06T21:47:35.397254] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T21:47:35.460376] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-06T21:47:35.827443] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-06T21:47:35.830244] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-06T21:47:36.625546] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-06T21:47:37.098969] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-06T21:47:37.425630] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-06T21:47:37.425487] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T21:47:38.009589] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T21:47:38.225559] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-06T21:47:39.025544] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-06T21:47:39.447640] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-06T21:47:39.825538] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-06T21:47:40.625559] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-06T21:47:40.780095] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-06T21:47:40.818960] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-06T21:47:41.425518] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-06T21:47:41.500770] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T21:47:41.897545] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-06T21:47:42.225558] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-06T21:47:43.025540] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-06T21:47:43.825547] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-06T21:47:43.912873] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-06T21:47:43.962618] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T21:47:44.572123] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T21:47:44.625501] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-06T21:47:45.425499] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-06T21:47:45.629618] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-06T21:47:46.225580] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-06T21:47:46.578817] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-06T21:47:47.022192] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T21:47:47.031781] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-06T21:47:47.825494] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-06T21:47:48.032342] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T21:47:48.625532] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-06T21:47:48.927817] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T21:47:49.425551] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-06T21:47:49.948835] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T21:47:50.225561] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-06T21:47:50.381964] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-06T21:47:50.785341] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T21:47:51.025613] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-06T21:47:51.484946] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T21:47:51.488087] [INFO ] [REMOTE ] TAC: Full fetch complete (63955 records). [2025-10-06T21:47:51.488228] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-06T21:47:51.830691] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-06T21:47:51.933592] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-06T21:47:51.933713] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-06T21:47:51.934781] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-06T21:47:51.934848] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-06T21:47:51.936298] [DEBUG] [LOCAL ] TAC: Trimmed 63955 records to 42564 (keeping 200 days of data) [2025-10-06T21:47:52.198408] [DEBUG] [LOCAL ] TAC: Primary data saved (42564 records). [2025-10-06T21:47:52.198572] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-06T21:47:52.198685] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. TAC took 27.4s. Estimated remaining: 46m 32s. Rate: 7.1 symbols/min [2025-10-06T21:47:52.362796] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:47:52.412598] [DEBUG] [LOCAL ] TAK: Loaded 50548 existing records from primary storage. [2025-10-06T21:47:52.413011] [INFO ] [MAIN ] TAK: Loaded 50548 existing records. [2025-10-06T21:47:52.605537] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:47:52.605948] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-06T21:47:52.606013] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-06T21:47:52.606355] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-06T21:47:52.606417] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-06T21:47:52.639538] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-06T21:47:52.982686] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:47:53.433825] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-06T21:47:53.460084] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-06T21:47:53.940995] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-06T21:47:54.225548] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-06T21:47:54.278957] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T21:47:55.025530] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-06T21:47:55.092903] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T21:47:55.825577] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-06T21:47:56.281608] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T21:47:56.284895] [INFO ] [REMOTE ] SYK: Full fetch complete (68920 records). [2025-10-06T21:47:56.285014] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-06T21:47:56.626594] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-06T21:47:56.755235] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-06T21:47:56.754477] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-06T21:47:56.766100] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-06T21:47:56.768354] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-06T21:47:56.768829] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-06T21:47:56.771090] [DEBUG] [LOCAL ] SYK: Trimmed 68920 records to 46889 (keeping 200 days of data) [2025-10-06T21:47:56.913676] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T21:47:57.127330] [DEBUG] [LOCAL ] SYK: Primary data saved (46889 records). [2025-10-06T21:47:57.127488] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-06T21:47:57.127579] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYK took 32.3s. Estimated remaining: 46m 23s. Rate: 7.1 symbols/min [2025-10-06T21:47:57.294219] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:47:57.345788] [DEBUG] [LOCAL ] TAL: Loaded 52687 existing records from primary storage. [2025-10-06T21:47:57.346169] [INFO ] [MAIN ] TAL: Loaded 52687 existing records. [2025-10-06T21:47:57.434097] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-06T21:47:57.528009] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:47:57.528276] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-06T21:47:57.528353] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-06T21:47:57.528619] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-06T21:47:57.528712] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-06T21:47:57.881387] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:47:57.944484] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T21:47:57.947597] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-10-06T21:47:57.947743] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-06T21:47:58.227960] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-06T21:47:58.358169] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-06T21:47:58.358454] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-06T21:47:58.360599] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-06T21:47:58.360723] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-06T21:47:58.362532] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 53798 (keeping 200 days of data) [2025-10-06T21:47:58.510455] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T21:47:58.746570] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-10-06T21:47:58.759237] [INFO ] [MAIN ] T: Full history saved. [2025-10-06T21:47:58.759670] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. T took 34.0s. Estimated remaining: 46m 13s. Rate: 7.1 symbols/min [2025-10-06T21:47:58.760955] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T21:47:58.852233] [INFO ] [REMOTE ] SYY: Full fetch complete (76978 records). [2025-10-06T21:47:58.879434] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-06T21:47:59.041141] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-06T21:47:59.068553] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:47:59.447787] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-06T21:47:59.447959] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-06T21:47:59.449891] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-06T21:47:59.452202] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-06T21:47:59.452049] [DEBUG] [LOCAL ] TALO: Loaded 51515 existing records from primary storage. [2025-10-06T21:47:59.453099] [INFO ] [MAIN ] TALO: Loaded 51515 existing records. [2025-10-06T21:47:59.559986] [DEBUG] [LOCAL ] SYY: Trimmed 76978 records to 53232 (keeping 200 days of data) [2025-10-06T21:47:59.750350] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:47:59.757677] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-06T21:47:59.759680] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-06T21:47:59.764738] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-06T21:47:59.766826] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-06T21:47:59.829307] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-06T21:48:00.430229] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:48:00.430366] [DEBUG] [LOCAL ] SYY: Primary data saved (53232 records). [2025-10-06T21:48:00.430774] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-06T21:48:00.431212] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. SYY took 35.6s. Estimated remaining: 46m 4s. Rate: 7.1 symbols/min [2025-10-06T21:48:00.603568] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:48:00.632555] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-06T21:48:00.655934] [DEBUG] [LOCAL ] TAP: Loaded 53666 existing records from primary storage. [2025-10-06T21:48:00.656329] [INFO ] [MAIN ] TAP: Loaded 53666 existing records. [2025-10-06T21:48:00.836933] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:48:00.837307] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-06T21:48:00.837416] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-06T21:48:00.838107] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-06T21:48:00.838169] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-06T21:48:01.228164] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-06T21:48:01.244404] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:48:01.425543] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-06T21:48:01.638529] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T21:48:02.226453] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-06T21:48:02.226366] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-06T21:48:03.025490] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-06T21:48:03.056042] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T21:48:03.825516] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-06T21:48:03.902589] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T21:48:04.625580] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-06T21:48:04.686978] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T21:48:05.425549] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-06T21:48:05.591243] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T21:48:06.225562] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-06T21:48:06.513832] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T21:48:06.853431] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-06T21:48:07.025563] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-06T21:48:07.825543] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-06T21:48:07.885890] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T21:48:08.625504] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-06T21:48:08.754247] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T21:48:09.425533] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-06T21:48:09.510211] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T21:48:09.973518] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T21:48:10.225539] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-06T21:48:11.025577] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-06T21:48:11.368045] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T21:48:11.825549] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-06T21:48:12.018760] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T21:48:12.487540] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T21:48:12.625539] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-06T21:48:13.425524] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-06T21:48:13.590368] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T21:48:14.225592] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-06T21:48:14.451781] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T21:48:15.025508] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-06T21:48:15.341762] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T21:48:15.780501] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T21:48:15.825515] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-06T21:48:16.625577] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-06T21:48:16.751936] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T21:48:17.425602] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-06T21:48:17.746825] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-06T21:48:18.225565] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-06T21:48:18.517869] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-06T21:48:19.025564] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-06T21:48:19.071465] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T21:48:19.527223] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T21:48:19.825584] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-06T21:48:20.625503] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-06T21:48:20.873739] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T21:48:21.425512] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-06T21:48:21.598497] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T21:48:22.225520] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-06T21:48:22.479068] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T21:48:23.025516] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-06T21:48:23.074085] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T21:48:23.825553] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-06T21:48:23.986365] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T21:48:24.625539] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-06T21:48:25.015986] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-06T21:48:25.425560] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-06T21:48:25.706000] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T21:48:26.225549] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-06T21:48:26.261477] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T21:48:26.764109] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T21:48:27.028177] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-06T21:48:27.031921] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-06T21:48:27.825547] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-06T21:48:28.625529] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-06T21:48:28.805335] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T21:48:29.183444] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T21:48:29.425531] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-06T21:48:29.951798] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T21:48:29.954777] [INFO ] [REMOTE ] TAK: Full fetch complete (71680 records). [2025-10-06T21:48:29.954911] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-06T21:48:30.230880] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-06T21:48:30.358978] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-06T21:48:30.359101] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-06T21:48:30.360282] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-06T21:48:30.360351] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-06T21:48:30.362232] [DEBUG] [LOCAL ] TAK: Trimmed 71680 records to 49941 (keeping 200 days of data) [2025-10-06T21:48:30.689941] [DEBUG] [LOCAL ] TAK: Primary data saved (49941 records). [2025-10-06T21:48:30.690155] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-06T21:48:30.690306] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAK took 38.5s. Estimated remaining: 45m 59s. Rate: 7.1 symbols/min [2025-10-06T21:48:30.878576] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:48:30.880056] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T21:48:30.884050] [INFO ] [REMOTE ] TAL: Full fetch complete (75530 records). [2025-10-06T21:48:30.884193] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-06T21:48:31.011440] [DEBUG] [LOCAL ] TBB: Loaded 11836 existing records from primary storage. [2025-10-06T21:48:31.027323] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-06T21:48:31.022120] [INFO ] [MAIN ] TBB: Loaded 11836 existing records. [2025-10-06T21:48:31.534483] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:48:31.553485] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-06T21:48:31.554048] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-06T21:48:31.553870] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-06T21:48:31.563382] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-06T21:48:31.563260] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-06T21:48:31.564520] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T21:48:31.564919] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-06T21:48:31.565254] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-06T21:48:31.568789] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-06T21:48:31.583407] [INFO ] [REMOTE ] TAP: Full fetch complete (76157 records). [2025-10-06T21:48:31.595611] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-06T21:48:31.615616] [DEBUG] [LOCAL ] TAL: Trimmed 75530 records to 51886 (keeping 200 days of data) [2025-10-06T21:48:32.378438] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:48:32.409526] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-06T21:48:32.475830] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-06T21:48:32.476588] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-06T21:48:32.478721] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-06T21:48:32.479166] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-06T21:48:32.487191] [DEBUG] [LOCAL ] TAP: Trimmed 76157 records to 52911 (keeping 200 days of data) [2025-10-06T21:48:32.922112] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T21:48:32.964475] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-06T21:48:32.993144] [DEBUG] [LOCAL ] TAP: Primary data saved (52911 records). [2025-10-06T21:48:32.997590] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-06T21:48:32.998481] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TAP took 32.6s. Estimated remaining: 45m 49s. Rate: 7.1 symbols/min [2025-10-06T21:48:33.235465] [DEBUG] [LOCAL ] TAL: Primary data saved (51886 records). [2025-10-06T21:48:33.250027] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-06T21:48:33.250976] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TAL took 36.1s. Estimated remaining: 45m 40s. Rate: 7.1 symbols/min [2025-10-06T21:48:33.252756] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:48:33.432542] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:48:33.442270] [DEBUG] [LOCAL ] TBI: No existing data file found in primary storage. [2025-10-06T21:48:33.442411] [WARN ] [MAIN ] TBI: No existing data found, performing full refresh instead. [2025-10-06T21:48:33.442662] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-06T21:48:33.442733] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-06T21:48:33.443037] [DEBUG] [LOCAL ] TBI: No primary data file found to delete. [2025-10-06T21:48:33.443092] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-06T21:48:33.566264] [DEBUG] [LOCAL ] TBBB: Loaded 36157 existing records from primary storage. [2025-10-06T21:48:33.578326] [INFO ] [MAIN ] TBBB: Loaded 36157 existing records. [2025-10-06T21:48:33.595600] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-06T21:48:33.660439] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-06T21:48:34.066358] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:48:34.080078] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-06T21:48:34.080197] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-06T21:48:34.108357] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:48:34.109047] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-06T21:48:34.109154] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-06T21:48:34.227630] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-06T21:48:34.236375] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T21:48:34.280371] [INFO ] [REMOTE ] TALO: Full fetch complete (73292 records). [2025-10-06T21:48:34.284039] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-06T21:48:34.719508] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:48:34.876894] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T21:48:34.949664] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-06T21:48:34.949810] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-06T21:48:34.951151] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-06T21:48:34.951243] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-06T21:48:34.953463] [DEBUG] [LOCAL ] TALO: Trimmed 73292 records to 50811 (keeping 200 days of data) [2025-10-06T21:48:35.035708] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-06T21:48:35.261715] [DEBUG] [LOCAL ] TALO: Primary data saved (50811 records). [2025-10-06T21:48:35.261889] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-06T21:48:35.262004] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TALO took 36.5s. Estimated remaining: 45m 30s. Rate: 7.1 symbols/min [2025-10-06T21:48:35.444514] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T21:48:35.468671] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:48:35.468887] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-06T21:48:35.468933] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-06T21:48:35.469051] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-06T21:48:35.469095] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-06T21:48:35.469136] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-06T21:48:35.469169] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-06T21:48:35.659375] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T21:48:35.825785] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-06T21:48:35.845251] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:48:36.625596] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-06T21:48:37.192171] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T21:48:37.394280] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-06T21:48:37.425475] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-06T21:48:38.225561] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-06T21:48:38.275856] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-06T21:48:39.025492] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-06T21:48:39.326592] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T21:48:39.825533] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-06T21:48:39.874284] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T21:48:40.169294] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-06T21:48:40.625577] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-06T21:48:41.389848] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-06T21:48:41.425512] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-06T21:48:41.756181] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-06T21:48:42.225591] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-06T21:48:42.574888] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-06T21:48:43.025507] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-06T21:48:43.825538] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-06T21:48:44.564925] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T21:48:44.625516] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-06T21:48:44.793835] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T21:48:45.425517] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-06T21:48:45.494393] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-06T21:48:46.225555] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-06T21:48:46.442915] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T21:48:47.025550] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-06T21:48:47.082501] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T21:48:47.296446] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-06T21:48:47.825538] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-06T21:48:48.579979] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T21:48:48.625568] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-06T21:48:49.249704] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-06T21:48:49.250796] [INFO ] [REMOTE ] TBB: Full fetch complete (17430 records). [2025-10-06T21:48:49.250871] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-06T21:48:49.430724] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-06T21:48:49.625759] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-06T21:48:49.625867] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-06T21:48:49.626301] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-06T21:48:49.626342] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-06T21:48:49.627178] [DEBUG] [LOCAL ] TBB: Trimmed 17430 records to 11690 (keeping 200 days of data) [2025-10-06T21:48:49.699511] [DEBUG] [LOCAL ] TBB: Primary data saved (11690 records). [2025-10-06T21:48:49.699697] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-06T21:48:49.699815] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TBB took 19.0s. Estimated remaining: 45m 23s. Rate: 7.1 symbols/min [2025-10-06T21:48:49.873228] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:48:49.875599] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-06T21:48:49.883052] [DEBUG] [LOCAL ] TBN: Loaded 3742 existing records from primary storage. [2025-10-06T21:48:49.883237] [INFO ] [MAIN ] TBN: Loaded 3742 existing records. [2025-10-06T21:48:50.061440] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:48:50.061746] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-06T21:48:50.061802] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-06T21:48:50.061990] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-06T21:48:50.062049] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-06T21:48:50.237174] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-06T21:48:50.425400] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:48:51.025590] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-06T21:48:51.449209] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-06T21:48:51.564969] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-06T21:48:51.825546] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-06T21:48:52.625600] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-06T21:48:53.237314] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T21:48:53.425600] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-06T21:48:53.836411] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T21:48:54.075560] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-06T21:48:54.225536] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-06T21:48:55.025589] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-06T21:48:55.594456] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T21:48:55.629873] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T21:48:55.825517] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-06T21:48:56.625576] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-06T21:48:56.971291] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-06T21:48:57.312337] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T21:48:57.425503] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-06T21:48:58.225587] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-06T21:48:58.556403] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-06T21:48:58.959788] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T21:48:59.025478] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-06T21:48:59.825538] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-06T21:49:00.450320] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T21:49:00.625620] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-06T21:49:00.969241] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T21:49:00.984847] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-06T21:49:01.425602] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-06T21:49:02.008937] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-06T21:49:02.225557] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-06T21:49:02.655519] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-06T21:49:03.025565] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-06T21:49:03.825586] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-06T21:49:04.517106] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T21:49:04.625547] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-06T21:49:04.971035] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-06T21:49:05.072397] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-06T21:49:05.425599] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-06T21:49:05.894175] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-06T21:49:06.225587] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-06T21:49:06.930820] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-06T21:49:07.025544] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-06T21:49:07.825549] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-06T21:49:08.044733] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T21:49:08.625581] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-06T21:49:09.180195] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-06T21:49:09.205088] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T21:49:09.425537] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-06T21:49:09.964867] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T21:49:10.225501] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-06T21:49:10.583623] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-06T21:49:11.025545] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-06T21:49:11.755405] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T21:49:11.825569] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-06T21:49:12.570667] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-06T21:49:12.573515] [INFO ] [REMOTE ] TBN: Full fetch complete (5639 records). [2025-10-06T21:49:12.573838] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-06T21:49:12.630730] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-06T21:49:13.034759] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-06T21:49:13.034843] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-06T21:49:13.035003] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-06T21:49:13.035042] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-06T21:49:13.035401] [DEBUG] [LOCAL ] TBN: Trimmed 5639 records to 3788 (keeping 200 days of data) [2025-10-06T21:49:13.057360] [DEBUG] [LOCAL ] TBN: Primary data saved (3788 records). [2025-10-06T21:49:13.057433] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-06T21:49:13.057503] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TBN took 23.4s. Estimated remaining: 45m 17s. Rate: 7.1 symbols/min [2025-10-06T21:49:13.225489] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:49:13.225731] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-06T21:49:13.225785] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-06T21:49:13.225896] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-06T21:49:13.225936] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-06T21:49:13.225976] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-06T21:49:13.226007] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-06T21:49:13.431626] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-06T21:49:13.583919] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:49:13.590013] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T21:49:13.592124] [INFO ] [REMOTE ] TBI: Full fetch complete (31774 records). [2025-10-06T21:49:13.592218] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-06T21:49:13.979250] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-06T21:49:13.979341] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-06T21:49:13.980099] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-06T21:49:13.980162] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-06T21:49:13.981028] [DEBUG] [LOCAL ] TBI: Trimmed 31774 records to 22537 (keeping 200 days of data) [2025-10-06T21:49:14.107800] [DEBUG] [LOCAL ] TBI: Primary data saved (22537 records). [2025-10-06T21:49:14.107953] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-06T21:49:14.108030] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBI took 40.9s. Estimated remaining: 45m 7s. Rate: 7.1 symbols/min [2025-10-06T21:49:14.230725] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-06T21:49:14.279215] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:49:14.279486] [DEBUG] [LOCAL ] TCBX: No existing data file found in primary storage. [2025-10-06T21:49:14.279543] [WARN ] [MAIN ] TCBX: No existing data found, performing full refresh instead. [2025-10-06T21:49:14.279681] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-06T21:49:14.279736] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-06T21:49:14.279780] [DEBUG] [LOCAL ] TCBX: No primary data file found to delete. [2025-10-06T21:49:14.279813] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-06T21:49:14.641927] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:49:14.879862] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-06T21:49:14.900745] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-06T21:49:15.025566] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2024-12. [2025-10-06T21:49:15.825523] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-06T21:49:15.882756] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-06T21:49:16.625573] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-06T21:49:16.948943] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-06T21:49:16.951192] [INFO ] [REMOTE ] TBBB: Full fetch complete (51439 records). [2025-10-06T21:49:16.951280] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-06T21:49:17.332837] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-06T21:49:17.332931] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-06T21:49:17.333879] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-06T21:49:17.333945] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-06T21:49:17.335080] [DEBUG] [LOCAL ] TBBB: Trimmed 51439 records to 35724 (keeping 200 days of data) [2025-10-06T21:49:17.425528] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-06T21:49:17.529856] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T21:49:17.561400] [DEBUG] [LOCAL ] TBBB: Primary data saved (35724 records). [2025-10-06T21:49:17.561554] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-06T21:49:17.561664] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TBBB took 44.6s. Estimated remaining: 44m 58s. Rate: 7.1 symbols/min [2025-10-06T21:49:17.630480] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:49:17.660332] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-06T21:49:17.662885] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:49:17.662979] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-06T21:49:17.668686] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:49:17.679057] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-06T21:49:17.684291] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-06T21:49:17.705636] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-06T21:49:17.714131] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-06T21:49:17.719076] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TCAI took 4.7s. Estimated remaining: 44m 48s. Rate: 7.1 symbols/min [2025-10-06T21:49:17.737922] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:49:17.911060] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:49:17.951551] [DEBUG] [LOCAL ] TD: Loaded 53053 existing records from primary storage. [2025-10-06T21:49:17.952128] [INFO ] [MAIN ] TD: Loaded 53053 existing records. [2025-10-06T21:49:18.158221] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:49:18.158598] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-06T21:49:18.158714] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-06T21:49:18.159842] [DEBUG] [LOCAL ] TDC: Loaded 47312 existing records from primary storage. [2025-10-06T21:49:18.160233] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-06T21:49:18.160191] [INFO ] [MAIN ] TDC: Loaded 47312 existing records. [2025-10-06T21:49:18.160342] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-06T21:49:18.237112] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-06T21:49:18.613586] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:49:18.663635] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-06T21:49:18.674022] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-06T21:49:18.698409] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-06T21:49:18.718081] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-06T21:49:18.802572] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:49:19.030603] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-06T21:49:19.098204] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:49:19.234380] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-06T21:49:19.825522] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-06T21:49:20.625602] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-06T21:49:20.915164] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-06T21:49:20.915879] [INFO ] [REMOTE ] TBLU: Full fetch complete (1174 records). [2025-10-06T21:49:20.915946] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-06T21:49:21.063295] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-06T21:49:21.137410] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-06T21:49:21.137563] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-06T21:49:21.137630] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-06T21:49:21.137717] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-06T21:49:21.137781] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-06T21:49:21.137865] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-06T21:49:21.137927] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-06T21:49:21.137994] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TBLU took 45.9s. Estimated remaining: 44m 39s. Rate: 7.1 symbols/min [2025-10-06T21:49:21.311178] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:49:21.349155] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T21:49:21.366399] [DEBUG] [LOCAL ] TDF: Loaded 6491 existing records from primary storage. [2025-10-06T21:49:21.366681] [INFO ] [MAIN ] TDF: Loaded 6491 existing records. [2025-10-06T21:49:21.430749] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-06T21:49:21.541625] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:49:21.541822] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-06T21:49:21.541869] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-06T21:49:21.542054] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-06T21:49:21.542111] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-06T21:49:21.884045] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:49:22.225543] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-06T21:49:22.375771] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-06T21:49:23.025532] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-06T21:49:23.144326] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T21:49:23.825511] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-06T21:49:23.895922] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-06T21:49:24.577011] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T21:49:24.625486] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-06T21:49:25.396684] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-06T21:49:25.425482] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-06T21:49:25.981964] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-06T21:49:26.225551] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-06T21:49:26.987732] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-06T21:49:27.025585] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-06T21:49:27.825550] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-06T21:49:28.504966] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-06T21:49:28.625560] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-06T21:49:28.891125] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-06T21:49:29.387519] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T21:49:29.425471] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-06T21:49:30.200704] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T21:49:30.225482] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-06T21:49:31.025517] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-06T21:49:31.044089] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-06T21:49:31.825535] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-06T21:49:32.514744] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T21:49:32.625486] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-06T21:49:33.425494] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-06T21:49:33.486059] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T21:49:34.039140] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T21:49:34.040250] [INFO ] [REMOTE ] TCBX: Full fetch complete (15907 records). [2025-10-06T21:49:34.040320] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-06T21:49:34.230189] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-06T21:49:34.444517] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-06T21:49:34.444698] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-06T21:49:34.445083] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-06T21:49:34.445326] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-06T21:49:34.446982] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-06T21:49:34.456795] [DEBUG] [LOCAL ] TCBX: Trimmed 15907 records to 10223 (keeping 200 days of data) [2025-10-06T21:49:34.517404] [DEBUG] [LOCAL ] TCBX: Primary data saved (10223 records). [2025-10-06T21:49:34.517553] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-06T21:49:34.517630] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TCBX took 20.4s. Estimated remaining: 44m 31s. Rate: 7.1 symbols/min [2025-10-06T21:49:34.690952] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:49:34.714626] [DEBUG] [LOCAL ] TDG: Loaded 22334 existing records from primary storage. [2025-10-06T21:49:34.714920] [INFO ] [MAIN ] TDG: Loaded 22334 existing records. [2025-10-06T21:49:34.894557] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:49:34.894792] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-06T21:49:34.894841] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-06T21:49:34.895036] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-06T21:49:34.895093] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-06T21:49:35.034223] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-06T21:49:35.261919] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:49:35.825498] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-06T21:49:36.151804] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-06T21:49:36.587955] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T21:49:36.589861] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T21:49:36.625485] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-06T21:49:37.347130] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T21:49:37.425555] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-06T21:49:38.024034] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T21:49:38.225509] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-06T21:49:38.849789] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-06T21:49:39.025526] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-06T21:49:39.825531] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-06T21:49:40.625527] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-06T21:49:41.243684] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-06T21:49:41.430673] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-06T21:49:41.443489] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T21:49:41.577060] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-06T21:49:42.225514] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-06T21:49:42.294481] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-06T21:49:43.025593] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-06T21:49:43.727050] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T21:49:43.725869] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T21:49:43.737263] [INFO ] [REMOTE ] TDF: Full fetch complete (10431 records). [2025-10-06T21:49:43.737666] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-06T21:49:43.833169] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-06T21:49:44.100418] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-06T21:49:44.100497] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-06T21:49:44.100785] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-06T21:49:44.100846] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-06T21:49:44.101277] [DEBUG] [LOCAL ] TDF: Trimmed 10431 records to 6274 (keeping 200 days of data) [2025-10-06T21:49:44.144355] [DEBUG] [LOCAL ] TDF: Primary data saved (6274 records). [2025-10-06T21:49:44.144670] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-06T21:49:44.144785] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TDF took 23.0s. Estimated remaining: 44m 23s. Rate: 7.1 symbols/min [2025-10-06T21:49:44.312159] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:49:44.363332] [DEBUG] [LOCAL ] TDOC: Loaded 54125 existing records from primary storage. [2025-10-06T21:49:44.363755] [INFO ] [MAIN ] TDOC: Loaded 54125 existing records. [2025-10-06T21:49:44.560308] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:49:44.560613] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-06T21:49:44.560691] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-06T21:49:44.561053] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-06T21:49:44.561111] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-06T21:49:44.634107] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-06T21:49:44.915206] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:49:45.380411] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T21:49:45.425484] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-06T21:49:45.848233] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-06T21:49:46.225589] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-06T21:49:47.025561] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-06T21:49:47.104446] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T21:49:47.392525] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-06T21:49:47.825541] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-06T21:49:48.625559] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-06T21:49:48.934189] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T21:49:49.425503] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-06T21:49:49.712326] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T21:49:50.231116] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-06T21:49:50.244423] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T21:49:50.656036] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-06T21:49:51.025559] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-06T21:49:51.825514] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-06T21:49:51.922263] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T21:49:51.988247] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T21:49:52.625538] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-06T21:49:53.430635] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-06T21:49:53.450683] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T21:49:54.225513] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-06T21:49:54.469527] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T21:49:55.025598] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-06T21:49:55.426883] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-06T21:49:55.446286] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T21:49:55.449955] [INFO ] [REMOTE ] TDC: Full fetch complete (67099 records). [2025-10-06T21:49:55.450139] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-06T21:49:55.831392] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-06T21:49:55.855262] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-06T21:49:55.855374] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-06T21:49:55.856539] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-06T21:49:55.856768] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-06T21:49:55.858815] [DEBUG] [LOCAL ] TDC: Trimmed 67099 records to 46567 (keeping 200 days of data) [2025-10-06T21:49:56.154320] [DEBUG] [LOCAL ] TDC: Primary data saved (46567 records). [2025-10-06T21:49:56.154525] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-06T21:49:56.154671] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TDC took 38.4s. Estimated remaining: 44m 15s. Rate: 7.1 symbols/min [2025-10-06T21:49:56.336612] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:49:56.356228] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T21:49:56.402538] [DEBUG] [LOCAL ] TDS: Loaded 43412 existing records from primary storage. [2025-10-06T21:49:56.402968] [INFO ] [MAIN ] TDS: Loaded 43412 existing records. [2025-10-06T21:49:56.578058] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:49:56.578304] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-06T21:49:56.578352] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-06T21:49:56.578595] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-06T21:49:56.578684] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-06T21:49:56.632580] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-06T21:49:56.932861] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:49:57.425538] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-06T21:49:57.683933] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T21:49:58.225545] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-06T21:49:58.590804] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-06T21:49:58.736186] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-06T21:49:59.025547] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-06T21:49:59.610399] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-06T21:49:59.825547] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-06T21:50:00.125051] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T21:50:00.625625] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-06T21:50:01.425529] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-06T21:50:02.102783] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-06T21:50:02.200202] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T21:50:02.229620] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-06T21:50:02.235679] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T21:50:03.025593] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-06T21:50:03.652989] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T21:50:03.825540] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-06T21:50:04.625529] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-06T21:50:05.177141] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-06T21:50:05.224577] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-06T21:50:05.425536] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-06T21:50:05.798409] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-06T21:50:05.800177] [INFO ] [REMOTE ] TDG: Full fetch complete (32023 records). [2025-10-06T21:50:05.800252] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-06T21:50:06.215525] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-06T21:50:06.234837] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-06T21:50:06.224239] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-06T21:50:06.240005] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-06T21:50:06.240694] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-06T21:50:06.243137] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T21:50:06.253674] [DEBUG] [LOCAL ] TDG: Trimmed 32023 records to 22087 (keeping 200 days of data) [2025-10-06T21:50:06.406866] [DEBUG] [LOCAL ] TDG: Primary data saved (22087 records). [2025-10-06T21:50:06.407031] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-06T21:50:06.407158] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TDG took 31.9s. Estimated remaining: 44m 7s. Rate: 7.1 symbols/min [2025-10-06T21:50:06.577526] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:50:06.620553] [DEBUG] [LOCAL ] TDW: Loaded 45933 existing records from primary storage. [2025-10-06T21:50:06.620936] [INFO ] [MAIN ] TDW: Loaded 45933 existing records. [2025-10-06T21:50:06.801789] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:50:06.802042] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-06T21:50:06.802090] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-06T21:50:06.802408] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-06T21:50:06.802495] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-06T21:50:07.036869] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-06T21:50:07.152609] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:50:07.725703] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T21:50:07.728960] [INFO ] [REMOTE ] TD: Full fetch complete (75796 records). [2025-10-06T21:50:07.729083] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-06T21:50:07.830703] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-06T21:50:08.129971] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-06T21:50:08.130063] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-06T21:50:08.131362] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-06T21:50:08.131432] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-06T21:50:08.132994] [DEBUG] [LOCAL ] TD: Trimmed 75796 records to 52331 (keeping 200 days of data) [2025-10-06T21:50:08.450899] [DEBUG] [LOCAL ] TD: Primary data saved (52331 records). [2025-10-06T21:50:08.451050] [INFO ] [MAIN ] TD: Full history saved. [2025-10-06T21:50:08.451149] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TD took 50.9s. Estimated remaining: 43m 57s. Rate: 7.1 symbols/min [2025-10-06T21:50:08.621499] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:50:08.625528] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-06T21:50:08.645462] [DEBUG] [LOCAL ] TDY: Loaded 22797 existing records from primary storage. [2025-10-06T21:50:08.645808] [INFO ] [MAIN ] TDY: Loaded 22797 existing records. [2025-10-06T21:50:08.827126] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:50:08.827496] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-06T21:50:08.827546] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-06T21:50:08.827775] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-06T21:50:08.827832] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-06T21:50:09.197288] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:50:09.233286] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-06T21:50:09.425502] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-06T21:50:09.623140] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T21:50:10.233321] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-06T21:50:10.238078] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T21:50:11.025509] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-06T21:50:11.482578] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-06T21:50:11.505830] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T21:50:11.825522] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-06T21:50:12.625518] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-06T21:50:12.725621] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T21:50:12.941166] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T21:50:13.425566] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-06T21:50:14.100014] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-06T21:50:14.225491] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-06T21:50:15.025510] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-06T21:50:15.241581] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-06T21:50:15.825567] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-06T21:50:15.906020] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T21:50:16.101581] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T21:50:16.625502] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-06T21:50:17.244774] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T21:50:17.425521] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-06T21:50:18.206937] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T21:50:18.225483] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-06T21:50:19.025537] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-06T21:50:19.293270] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T21:50:19.673772] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T21:50:19.825622] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-06T21:50:20.293485] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-06T21:50:20.625580] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-06T21:50:21.425601] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-06T21:50:21.653119] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T21:50:22.230882] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-06T21:50:22.243861] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T21:50:22.359093] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T21:50:23.025529] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-06T21:50:23.829019] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-06T21:50:23.836033] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-06T21:50:24.625563] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-06T21:50:24.678275] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T21:50:25.031847] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T21:50:25.425515] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-06T21:50:26.225545] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-06T21:50:26.514594] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T21:50:26.705696] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-06T21:50:27.025591] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-06T21:50:27.777059] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T21:50:27.825478] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-06T21:50:28.629698] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-06T21:50:28.635793] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T21:50:28.961702] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T21:50:28.964318] [INFO ] [REMOTE ] TDS: Full fetch complete (61710 records). [2025-10-06T21:50:28.964417] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-06T21:50:29.343189] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-06T21:50:29.343282] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-06T21:50:29.344310] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-06T21:50:29.344375] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-06T21:50:29.345674] [DEBUG] [LOCAL ] TDS: Trimmed 61710 records to 42760 (keeping 200 days of data) [2025-10-06T21:50:29.436451] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-06T21:50:29.617887] [DEBUG] [LOCAL ] TDS: Primary data saved (42760 records). [2025-10-06T21:50:29.618022] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-06T21:50:29.618099] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDS took 33.5s. Estimated remaining: 43m 51s. Rate: 7.1 symbols/min [2025-10-06T21:50:29.795077] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:50:29.795409] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-06T21:50:29.795552] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-06T21:50:29.795760] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-06T21:50:29.795802] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-06T21:50:29.795843] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-06T21:50:29.795874] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-06T21:50:30.001695] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-06T21:50:30.185887] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:50:30.225468] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-06T21:50:30.436327] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:50:30.436560] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-06T21:50:30.436666] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:50:30.436725] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-06T21:50:30.436785] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:50:30.436855] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-06T21:50:30.436917] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-06T21:50:30.436952] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-06T21:50:30.437003] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-06T21:50:30.437071] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TE took 0.8s. Estimated remaining: 43m 41s. Rate: 7.1 symbols/min [2025-10-06T21:50:30.600580] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:50:30.610999] [DEBUG] [LOCAL ] TEAF: Loaded 7714 existing records from primary storage. [2025-10-06T21:50:30.611213] [INFO ] [MAIN ] TEAF: Loaded 7714 existing records. [2025-10-06T21:50:30.783054] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:50:30.783259] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-06T21:50:30.783305] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-06T21:50:30.783504] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-06T21:50:30.783559] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-06T21:50:31.031327] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-06T21:50:31.139097] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:50:31.498555] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-06T21:50:31.825509] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-06T21:50:32.099516] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T21:50:32.625560] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-06T21:50:33.425480] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-06T21:50:33.780591] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T21:50:33.818215] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T21:50:34.225540] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-06T21:50:34.564505] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-06T21:50:34.566358] [INFO ] [REMOTE ] TDY: Full fetch complete (32067 records). [2025-10-06T21:50:34.566480] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-06T21:50:34.965666] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-06T21:50:34.965942] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-06T21:50:34.966889] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-06T21:50:34.967047] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-06T21:50:35.000269] [DEBUG] [LOCAL ] TDY: Trimmed 32067 records to 22512 (keeping 200 days of data) [2025-10-06T21:50:35.005027] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T21:50:35.053866] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-06T21:50:35.158520] [DEBUG] [LOCAL ] TDY: Primary data saved (22512 records). [2025-10-06T21:50:35.158721] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-06T21:50:35.158841] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDY took 26.7s. Estimated remaining: 43m 32s. Rate: 7.1 symbols/min [2025-10-06T21:50:35.334845] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:50:35.385585] [DEBUG] [LOCAL ] TECK: Loaded 54210 existing records from primary storage. [2025-10-06T21:50:35.386121] [INFO ] [MAIN ] TECK: Loaded 54210 existing records. [2025-10-06T21:50:35.563143] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:50:35.563415] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-06T21:50:35.563462] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-06T21:50:35.563768] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-06T21:50:35.563825] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-06T21:50:35.833616] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-06T21:50:35.929728] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:50:36.625508] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-06T21:50:36.784714] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-06T21:50:36.787918] [INFO ] [REMOTE ] TDOC: Full fetch complete (77292 records). [2025-10-06T21:50:36.788056] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-06T21:50:37.212427] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-06T21:50:37.212562] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-06T21:50:37.213860] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-06T21:50:37.213927] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-06T21:50:37.215717] [DEBUG] [LOCAL ] TDOC: Trimmed 77292 records to 53348 (keeping 200 days of data) [2025-10-06T21:50:37.427214] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-06T21:50:37.445318] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-06T21:50:37.565415] [DEBUG] [LOCAL ] TDOC: Primary data saved (53348 records). [2025-10-06T21:50:37.565590] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-06T21:50:37.565707] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TDOC took 53.4s. Estimated remaining: 43m 23s. Rate: 7.1 symbols/min [2025-10-06T21:50:37.739251] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:50:37.775289] [DEBUG] [LOCAL ] TEF: Loaded 37912 existing records from primary storage. [2025-10-06T21:50:37.775626] [INFO ] [MAIN ] TEF: Loaded 37912 existing records. [2025-10-06T21:50:37.954080] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:50:37.954538] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-06T21:50:37.954664] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-06T21:50:37.955024] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-06T21:50:37.955135] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-06T21:50:38.209415] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-06T21:50:38.230662] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-06T21:50:38.325383] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:50:38.371122] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T21:50:38.678518] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-06T21:50:39.025528] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-06T21:50:39.825533] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-06T21:50:40.304222] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T21:50:40.306737] [INFO ] [REMOTE ] TDW: Full fetch complete (67058 records). [2025-10-06T21:50:40.306840] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-06T21:50:40.639158] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-06T21:50:40.697473] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-06T21:50:40.697579] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-06T21:50:40.698864] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-06T21:50:40.698930] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-06T21:50:40.700322] [DEBUG] [LOCAL ] TDW: Trimmed 67058 records to 45112 (keeping 200 days of data) [2025-10-06T21:50:40.971827] [DEBUG] [LOCAL ] TDW: Primary data saved (45112 records). [2025-10-06T21:50:40.972000] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-06T21:50:40.972092] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TDW took 34.6s. Estimated remaining: 43m 14s. Rate: 7.1 symbols/min [2025-10-06T21:50:41.149526] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:50:41.175530] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T21:50:41.201382] [DEBUG] [LOCAL ] TEI: Loaded 21500 existing records from primary storage. [2025-10-06T21:50:41.201731] [INFO ] [MAIN ] TEI: Loaded 21500 existing records. [2025-10-06T21:50:41.373205] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:50:41.373451] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-06T21:50:41.373498] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-06T21:50:41.373753] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-06T21:50:41.373855] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-06T21:50:41.434793] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-06T21:50:41.726568] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:50:42.055600] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T21:50:42.225526] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-06T21:50:42.460396] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T21:50:42.946980] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-06T21:50:43.025495] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-06T21:50:43.825513] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-06T21:50:44.460813] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T21:50:44.625551] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-06T21:50:44.741727] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T21:50:45.425521] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-06T21:50:46.181042] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T21:50:46.225561] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-06T21:50:46.385258] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-06T21:50:47.025554] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-06T21:50:47.145156] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-06T21:50:47.618334] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-06T21:50:47.825579] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-06T21:50:48.625593] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-06T21:50:48.955107] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T21:50:49.425534] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-06T21:50:50.182588] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T21:50:50.202404] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-06T21:50:50.225479] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-06T21:50:51.025575] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-06T21:50:51.825512] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-06T21:50:51.880132] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T21:50:52.077292] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-06T21:50:52.541923] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-06T21:50:52.625524] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-06T21:50:53.425553] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-06T21:50:53.961053] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T21:50:54.066999] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T21:50:54.225533] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-06T21:50:55.025601] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-06T21:50:55.824424] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-06T21:50:55.826015] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T21:50:55.826124] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-06T21:50:56.625530] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-06T21:50:56.853379] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-06T21:50:57.180801] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T21:50:57.181893] [INFO ] [REMOTE ] TEAF: Full fetch complete (10016 records). [2025-10-06T21:50:57.181968] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-06T21:50:57.433396] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-06T21:50:57.568584] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-06T21:50:57.568694] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-06T21:50:57.568990] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-06T21:50:57.569051] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-06T21:50:57.569756] [DEBUG] [LOCAL ] TEAF: Trimmed 10016 records to 7509 (keeping 200 days of data) [2025-10-06T21:50:57.616923] [DEBUG] [LOCAL ] TEAF: Primary data saved (7509 records). [2025-10-06T21:50:57.617083] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-06T21:50:57.617172] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEAF took 27.2s. Estimated remaining: 43m 6s. Rate: 7.1 symbols/min [2025-10-06T21:50:57.787180] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:50:57.844945] [DEBUG] [LOCAL ] TEL: Loaded 51844 existing records from primary storage. [2025-10-06T21:50:57.845308] [INFO ] [MAIN ] TEL: Loaded 51844 existing records. [2025-10-06T21:50:58.043867] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:50:58.044132] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-06T21:50:58.044181] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-06T21:50:58.044628] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-06T21:50:58.044719] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-06T21:50:58.236575] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-06T21:50:58.402070] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:50:59.025497] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-06T21:50:59.077961] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T21:50:59.825510] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-06T21:51:00.207408] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-06T21:51:00.532639] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-06T21:51:00.625474] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-06T21:51:00.795829] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T21:51:01.425551] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-06T21:51:02.225492] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-06T21:51:02.346929] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T21:51:02.927759] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T21:51:03.025490] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-06T21:51:03.714371] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T21:51:03.825483] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-06T21:51:03.944165] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-06T21:51:04.625510] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-06T21:51:05.425502] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-06T21:51:05.733262] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-06T21:51:06.013203] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T21:51:06.225531] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-06T21:51:07.025550] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-06T21:51:07.106819] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T21:51:07.270019] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T21:51:07.825531] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-06T21:51:08.220319] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-06T21:51:08.625626] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-06T21:51:09.244001] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T21:51:09.425538] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-06T21:51:10.225543] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-06T21:51:10.490129] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T21:51:10.816282] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T21:51:11.025523] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-06T21:51:11.276444] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-06T21:51:11.825525] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-06T21:51:12.243074] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T21:51:12.245601] [INFO ] [REMOTE ] TEF: Full fetch complete (54879 records). [2025-10-06T21:51:12.245732] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-06T21:51:12.631101] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-06T21:51:12.631851] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-06T21:51:12.632669] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-06T21:51:12.633692] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-06T21:51:12.633861] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-06T21:51:12.635084] [DEBUG] [LOCAL ] TEF: Trimmed 54879 records to 37269 (keeping 200 days of data) [2025-10-06T21:51:12.850533] [DEBUG] [LOCAL ] TEF: Primary data saved (37269 records). [2025-10-06T21:51:12.850725] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-06T21:51:12.850825] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TEF took 35.3s. Estimated remaining: 42m 59s. Rate: 7.1 symbols/min [2025-10-06T21:51:13.017871] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:51:13.049151] [DEBUG] [LOCAL ] TEN: Loaded 31002 existing records from primary storage. [2025-10-06T21:51:13.049501] [INFO ] [MAIN ] TEN: Loaded 31002 existing records. [2025-10-06T21:51:13.292952] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:51:13.293291] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-06T21:51:13.293383] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-06T21:51:13.293623] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-06T21:51:13.293716] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-06T21:51:13.433627] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-06T21:51:13.688613] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:51:13.775811] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-06T21:51:13.806141] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-06T21:51:14.225615] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-06T21:51:15.025518] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-06T21:51:15.320984] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T21:51:15.485843] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-06T21:51:15.825527] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-06T21:51:16.416795] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-06T21:51:16.625564] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-06T21:51:17.425529] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-06T21:51:17.704467] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-06T21:51:18.180204] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T21:51:18.183771] [INFO ] [REMOTE ] TECK: Full fetch complete (77312 records). [2025-10-06T21:51:18.183928] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-06T21:51:18.230859] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-06T21:51:18.300203] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T21:51:18.345329] [INFO ] [REMOTE ] TEI: Full fetch complete (30639 records). [2025-10-06T21:51:18.366995] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-06T21:51:18.872545] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-06T21:51:18.901809] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-06T21:51:18.905632] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-06T21:51:18.906088] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-06T21:51:18.965334] [DEBUG] [LOCAL ] TECK: Trimmed 77312 records to 53440 (keeping 200 days of data) [2025-10-06T21:51:18.995149] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-06T21:51:18.995225] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-06T21:51:18.995539] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-06T21:51:18.995578] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-06T21:51:19.048005] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-06T21:51:19.085208] [DEBUG] [LOCAL ] TEI: Trimmed 30639 records to 21220 (keeping 200 days of data) [2025-10-06T21:51:19.263842] [DEBUG] [LOCAL ] TEI: Primary data saved (21220 records). [2025-10-06T21:51:19.267780] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-06T21:51:19.267978] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TEI took 38.3s. Estimated remaining: 42m 50s. Rate: 7.1 symbols/min [2025-10-06T21:51:19.549925] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:51:19.576261] [DEBUG] [LOCAL ] TEO: Loaded 22391 existing records from primary storage. [2025-10-06T21:51:19.577407] [INFO ] [MAIN ] TEO: Loaded 22391 existing records. [2025-10-06T21:51:19.767559] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T21:51:19.797309] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:51:19.799057] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-06T21:51:19.801531] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-06T21:51:19.802723] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-06T21:51:19.803224] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-06T21:51:19.835298] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-06T21:51:20.252705] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:51:20.278624] [DEBUG] [LOCAL ] TECK: Primary data saved (53440 records). [2025-10-06T21:51:20.278873] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-06T21:51:20.278989] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TECK took 45.1s. Estimated remaining: 42m 41s. Rate: 7.1 symbols/min [2025-10-06T21:51:20.471341] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:51:20.539678] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T21:51:20.571232] [DEBUG] [LOCAL ] TEVA: Loaded 54412 existing records from primary storage. [2025-10-06T21:51:20.571612] [INFO ] [MAIN ] TEVA: Loaded 54412 existing records. [2025-10-06T21:51:20.632837] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-06T21:51:20.750114] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:51:20.750368] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-06T21:51:20.750427] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-06T21:51:20.750886] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-06T21:51:20.750953] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-06T21:51:21.109325] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:51:21.124294] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T21:51:21.425590] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-06T21:51:21.812006] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T21:51:22.225544] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-06T21:51:23.025541] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-06T21:51:23.428505] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-06T21:51:23.480971] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T21:51:23.825542] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-06T21:51:24.532607] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T21:51:24.625586] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-06T21:51:25.270372] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T21:51:25.425532] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-06T21:51:26.225572] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-06T21:51:26.463883] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T21:51:26.808768] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-06T21:51:27.025538] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-06T21:51:27.825511] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-06T21:51:28.108855] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-06T21:51:28.252172] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T21:51:28.625495] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-06T21:51:28.861204] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T21:51:29.425507] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-06T21:51:30.225556] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-06T21:51:30.645970] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-06T21:51:30.772059] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T21:51:31.025567] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-06T21:51:31.825507] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-06T21:51:31.893227] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T21:51:32.140741] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T21:51:32.625539] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-06T21:51:33.125183] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-06T21:51:33.425484] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-06T21:51:33.812305] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-06T21:51:34.225540] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-06T21:51:35.025494] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-06T21:51:35.434281] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-06T21:51:35.482780] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T21:51:35.514027] [INFO ] [REMOTE ] TEL: Full fetch complete (73458 records). [2025-10-06T21:51:35.517080] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-06T21:51:35.552543] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-06T21:51:35.830711] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-06T21:51:35.917690] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-06T21:51:35.917790] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-06T21:51:35.918865] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-06T21:51:35.918928] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-06T21:51:35.920605] [DEBUG] [LOCAL ] TEL: Trimmed 73458 records to 51119 (keeping 200 days of data) [2025-10-06T21:51:36.281944] [DEBUG] [LOCAL ] TEL: Primary data saved (51119 records). [2025-10-06T21:51:36.282175] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-06T21:51:36.282295] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEL took 38.7s. Estimated remaining: 42m 33s. Rate: 7.1 symbols/min [2025-10-06T21:51:36.469527] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:51:36.518989] [DEBUG] [LOCAL ] TEX: Loaded 44788 existing records from primary storage. [2025-10-06T21:51:36.519443] [INFO ] [MAIN ] TEX: Loaded 44788 existing records. [2025-10-06T21:51:36.630819] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-06T21:51:36.722023] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:51:36.722304] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-06T21:51:36.722355] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-06T21:51:36.723001] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-06T21:51:36.723062] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-06T21:51:37.098781] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:51:37.157920] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T21:51:37.315603] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-06T21:51:37.425495] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-06T21:51:38.225574] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-06T21:51:38.845070] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T21:51:39.025557] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-06T21:51:39.724388] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T21:51:39.825545] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-06T21:51:40.625504] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-06T21:51:40.791734] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-06T21:51:40.793476] [INFO ] [REMOTE ] TEN: Full fetch complete (44031 records). [2025-10-06T21:51:40.793551] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-06T21:51:41.198943] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-06T21:51:41.215434] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-06T21:51:41.240605] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-06T21:51:41.244035] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-06T21:51:41.248634] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-06T21:51:41.260487] [DEBUG] [LOCAL ] TEN: Trimmed 44031 records to 30442 (keeping 200 days of data) [2025-10-06T21:51:41.435667] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-06T21:51:41.457475] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-06T21:51:41.482484] [DEBUG] [LOCAL ] TEN: Primary data saved (30442 records). [2025-10-06T21:51:41.482740] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-06T21:51:41.482877] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEN took 28.6s. Estimated remaining: 42m 24s. Rate: 7.1 symbols/min [2025-10-06T21:51:41.655517] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:51:41.708784] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-10-06T21:51:41.709169] [INFO ] [MAIN ] TFC: Loaded 54447 existing records. [2025-10-06T21:51:41.883996] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:51:41.884257] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-06T21:51:41.884306] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-06T21:51:41.884948] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-06T21:51:41.885008] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-06T21:51:42.233043] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-06T21:51:42.243085] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:51:42.773357] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T21:51:43.025514] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-06T21:51:43.367475] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-06T21:51:43.825570] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-06T21:51:44.588709] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T21:51:44.625555] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-06T21:51:45.411049] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T21:51:45.425470] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-06T21:51:46.225516] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-06T21:51:46.445028] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T21:51:46.870499] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-06T21:51:47.025505] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-06T21:51:47.556622] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T21:51:47.825534] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-06T21:51:48.625497] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-06T21:51:48.675441] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T21:51:48.773354] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T21:51:48.775079] [INFO ] [REMOTE ] TEO: Full fetch complete (32566 records). [2025-10-06T21:51:48.775158] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-06T21:51:49.151122] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-06T21:51:49.151230] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-06T21:51:49.152512] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-06T21:51:49.152579] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-06T21:51:49.153701] [DEBUG] [LOCAL ] TEO: Trimmed 32566 records to 22228 (keeping 200 days of data) [2025-10-06T21:51:49.300343] [DEBUG] [LOCAL ] TEO: Primary data saved (22228 records). [2025-10-06T21:51:49.300730] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-06T21:51:49.300843] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEO took 30.0s. Estimated remaining: 42m 16s. Rate: 7.1 symbols/min [2025-10-06T21:51:49.430746] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-06T21:51:49.485365] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:51:49.525213] [DEBUG] [LOCAL ] TFII: Loaded 34124 existing records from primary storage. [2025-10-06T21:51:49.525577] [INFO ] [MAIN ] TFII: Loaded 34124 existing records. [2025-10-06T21:51:49.715852] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:51:49.716171] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-06T21:51:49.716223] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-06T21:51:49.716552] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-06T21:51:49.716611] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-06T21:51:50.095946] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:51:50.225579] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-06T21:51:50.839228] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-06T21:51:51.025553] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-06T21:51:51.125491] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-06T21:51:51.494403] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T21:51:51.825743] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-06T21:51:52.625579] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-06T21:51:52.944742] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T21:51:53.016190] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-06T21:51:53.425592] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-06T21:51:54.225590] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-06T21:51:54.394415] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T21:51:55.025539] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-06T21:51:55.545185] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-06T21:51:55.825499] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-06T21:51:56.123092] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T21:51:56.229006] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T21:51:56.625502] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-06T21:51:57.102860] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T21:51:57.425599] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-06T21:51:58.193572] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T21:51:58.225496] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-06T21:51:59.025515] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-06T21:51:59.379147] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T21:51:59.786836] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T21:51:59.825478] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-06T21:52:00.625484] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-06T21:52:00.877620] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-06T21:52:01.266858] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T21:52:01.425612] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-06T21:52:02.225591] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-06T21:52:02.320094] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-06T21:52:02.378617] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T21:52:03.025552] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-06T21:52:03.825483] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-06T21:52:04.188128] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T21:52:04.602275] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T21:52:04.625484] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-06T21:52:05.125798] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-06T21:52:05.425587] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-06T21:52:06.062680] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T21:52:06.225564] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-06T21:52:07.025637] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-06T21:52:07.337234] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-06T21:52:07.825541] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-06T21:52:07.970870] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-06T21:52:07.974301] [INFO ] [REMOTE ] TEVA: Full fetch complete (77708 records). [2025-10-06T21:52:07.974443] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-06T21:52:08.298798] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T21:52:08.333023] [INFO ] [REMOTE ] TEX: Full fetch complete (64621 records). [2025-10-06T21:52:08.348576] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-06T21:52:08.531877] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-06T21:52:08.542448] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-06T21:52:08.548963] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-06T21:52:08.554168] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-06T21:52:08.613360] [DEBUG] [LOCAL ] TEVA: Trimmed 77708 records to 53633 (keeping 200 days of data) [2025-10-06T21:52:08.626472] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-06T21:52:08.920704] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-06T21:52:08.921419] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-06T21:52:08.922924] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-06T21:52:08.923019] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-06T21:52:08.926882] [DEBUG] [LOCAL ] TEX: Trimmed 64621 records to 44084 (keeping 200 days of data) [2025-10-06T21:52:09.448758] [DEBUG] [LOCAL ] TEX: Primary data saved (44084 records). [2025-10-06T21:52:09.451020] [DEBUG] [LOCAL ] TEVA: Primary data saved (53633 records). [2025-10-06T21:52:09.450953] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-06T21:52:09.451152] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-06T21:52:09.451277] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEX took 33.2s. Estimated remaining: 42m 9s. Rate: 7.1 symbols/min [2025-10-06T21:52:09.456813] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TEVA took 49.2s. Estimated remaining: 41m 59s. Rate: 7.1 symbols/min [2025-10-06T21:52:09.839730] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:52:09.841300] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:52:09.882309] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-06T21:52:09.896050] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-06T21:52:09.931899] [DEBUG] [LOCAL ] TFIN: Loaded 23791 existing records from primary storage. [2025-10-06T21:52:09.947385] [INFO ] [MAIN ] TFIN: Loaded 23791 existing records. [2025-10-06T21:52:09.962587] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-06T21:52:10.074298] [DEBUG] [LOCAL ] TFPM: Loaded 38599 existing records from primary storage. [2025-10-06T21:52:10.077118] [INFO ] [MAIN ] TFPM: Loaded 38599 existing records. [2025-10-06T21:52:10.234668] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-06T21:52:10.257905] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:52:10.308364] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-06T21:52:10.311241] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-06T21:52:10.333056] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-06T21:52:10.338524] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:52:10.334941] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-06T21:52:10.393351] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-06T21:52:10.402423] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-06T21:52:10.419545] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-06T21:52:10.441942] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-06T21:52:11.077347] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:52:11.091448] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-06T21:52:11.116627] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:52:11.711839] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T21:52:11.825604] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-06T21:52:11.933201] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-06T21:52:12.042755] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-06T21:52:12.625577] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-06T21:52:13.053097] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-06T21:52:13.425518] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-06T21:52:14.225518] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-06T21:52:14.265341] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T21:52:14.559119] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T21:52:15.025475] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-06T21:52:15.198903] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T21:52:15.825543] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-06T21:52:16.352540] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T21:52:16.625532] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-06T21:52:16.827374] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-06T21:52:17.425496] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-06T21:52:17.881742] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-06T21:52:18.225556] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-06T21:52:18.554365] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T21:52:19.025540] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-06T21:52:19.680435] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T21:52:19.825513] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-06T21:52:20.625502] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-06T21:52:20.994988] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-06T21:52:21.343535] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T21:52:21.425475] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-06T21:52:21.579630] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T21:52:21.581634] [INFO ] [REMOTE ] TFII: Full fetch complete (47960 records). [2025-10-06T21:52:21.581736] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-06T21:52:21.984393] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-06T21:52:21.984491] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-06T21:52:21.985443] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-06T21:52:21.985510] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-06T21:52:21.986565] [DEBUG] [LOCAL ] TFII: Trimmed 47960 records to 33524 (keeping 200 days of data) [2025-10-06T21:52:22.193797] [DEBUG] [LOCAL ] TFII: Primary data saved (33524 records). [2025-10-06T21:52:22.193953] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-06T21:52:22.194051] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFII took 32.9s. Estimated remaining: 41m 51s. Rate: 7.1 symbols/min [2025-10-06T21:52:22.225818] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-06T21:52:22.364152] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:52:22.404010] [DEBUG] [LOCAL ] TFX: Loaded 37698 existing records from primary storage. [2025-10-06T21:52:22.404322] [INFO ] [MAIN ] TFX: Loaded 37698 existing records. [2025-10-06T21:52:22.579912] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:52:22.580183] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-06T21:52:22.580236] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-06T21:52:22.580431] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-06T21:52:22.580488] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-06T21:52:22.935129] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:52:22.957085] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T21:52:23.025542] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-06T21:52:23.423765] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T21:52:23.825511] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-06T21:52:24.504401] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T21:52:24.625528] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-06T21:52:25.314568] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T21:52:25.425544] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-06T21:52:26.151696] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-06T21:52:26.225533] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-06T21:52:26.996021] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T21:52:27.025600] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-06T21:52:27.825493] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-06T21:52:27.912711] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T21:52:28.293403] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T21:52:28.296520] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-10-06T21:52:28.296675] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-06T21:52:28.635688] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-06T21:52:28.700004] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-06T21:52:28.700249] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-06T21:52:28.723138] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-06T21:52:28.724905] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T21:52:28.724022] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-06T21:52:28.734494] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 53667 (keeping 200 days of data) [2025-10-06T21:52:29.065540] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-10-06T21:52:29.065740] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-06T21:52:29.065871] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TFC took 47.6s. Estimated remaining: 41m 43s. Rate: 7.1 symbols/min [2025-10-06T21:52:29.242984] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:52:29.255479] [DEBUG] [LOCAL ] TG: Loaded 10546 existing records from primary storage. [2025-10-06T21:52:29.255784] [INFO ] [MAIN ] TG: Loaded 10546 existing records. [2025-10-06T21:52:29.430764] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-06T21:52:29.434977] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:52:29.436353] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-06T21:52:29.436437] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-06T21:52:29.436665] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-06T21:52:29.436744] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-06T21:52:29.828097] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:52:30.007278] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T21:52:30.011014] [INFO ] [REMOTE ] TFPM: Full fetch complete (51571 records). [2025-10-06T21:52:30.011330] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-06T21:52:30.231724] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-06T21:52:30.451377] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T21:52:30.477989] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-06T21:52:30.478139] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-06T21:52:30.480771] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-06T21:52:30.480886] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-06T21:52:30.482775] [DEBUG] [LOCAL ] TFPM: Trimmed 51571 records to 38273 (keeping 200 days of data) [2025-10-06T21:52:30.761966] [DEBUG] [LOCAL ] TFPM: Primary data saved (38273 records). [2025-10-06T21:52:30.762194] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-06T21:52:30.762307] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TFPM took 21.3s. Estimated remaining: 41m 33s. Rate: 7.1 symbols/min [2025-10-06T21:52:30.952498] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:52:30.952863] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-06T21:52:30.952930] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-06T21:52:30.953102] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-06T21:52:30.953194] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-06T21:52:30.953248] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-06T21:52:30.953283] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-06T21:52:31.025764] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-06T21:52:31.280422] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-06T21:52:31.395956] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:52:31.825529] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-06T21:52:32.467563] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-06T21:52:32.625518] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-06T21:52:32.826225] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:52:32.826580] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-06T21:52:32.826723] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:52:32.826772] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-06T21:52:32.826807] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:52:32.826846] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-06T21:52:32.826909] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-06T21:52:32.826943] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-06T21:52:32.826999] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-06T21:52:32.827070] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TGE took 2.1s. Estimated remaining: 41m 24s. Rate: 7.1 symbols/min [2025-10-06T21:52:32.902692] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T21:52:33.425612] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-06T21:52:34.225555] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-06T21:52:35.035729] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-06T21:52:35.053737] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T21:52:35.441443] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T21:52:35.825551] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-06T21:52:35.882526] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T21:52:36.625632] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-06T21:52:36.952513] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-06T21:52:37.425711] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-06T21:52:38.069973] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T21:52:38.225734] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-06T21:52:38.505332] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-06T21:52:39.025558] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-06T21:52:39.531112] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T21:52:39.825570] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-06T21:52:39.852620] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T21:52:39.854585] [INFO ] [REMOTE ] TFIN: Full fetch complete (31433 records). [2025-10-06T21:52:39.854683] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-06T21:52:40.235558] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-06T21:52:40.235712] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-06T21:52:40.236369] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-06T21:52:40.236412] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-06T21:52:40.237474] [DEBUG] [LOCAL ] TFIN: Trimmed 31433 records to 23423 (keeping 200 days of data) [2025-10-06T21:52:40.375377] [DEBUG] [LOCAL ] TFIN: Primary data saved (23423 records). [2025-10-06T21:52:40.375531] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-06T21:52:40.375619] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TFIN took 30.9s. Estimated remaining: 41m 15s. Rate: 7.1 symbols/min [2025-10-06T21:52:40.625538] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-06T21:52:41.372235] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T21:52:41.372547] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T21:52:41.425487] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-06T21:52:42.231126] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-06T21:52:42.233467] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T21:52:43.025548] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-06T21:52:43.526840] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T21:52:43.827878] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-06T21:52:43.831381] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T21:52:44.625577] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-06T21:52:45.320614] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T21:52:45.386851] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-06T21:52:45.425474] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-06T21:52:46.204668] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-06T21:52:46.225532] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-06T21:52:46.984589] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T21:52:47.025543] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-06T21:52:47.825558] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-06T21:52:47.905002] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T21:52:48.625565] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-06T21:52:48.926522] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-06T21:52:48.929224] [INFO ] [REMOTE ] TFX: Full fetch complete (54663 records). [2025-10-06T21:52:48.929320] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-06T21:52:49.265711] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T21:52:49.358421] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-06T21:52:49.358565] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-06T21:52:49.360030] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-06T21:52:49.360113] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-06T21:52:49.362142] [DEBUG] [LOCAL ] TFX: Trimmed 54663 records to 36998 (keeping 200 days of data) [2025-10-06T21:52:49.429583] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-06T21:52:49.601568] [DEBUG] [LOCAL ] TFX: Primary data saved (36998 records). [2025-10-06T21:52:49.601820] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-06T21:52:49.601931] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TFX took 27.4s. Estimated remaining: 41m 7s. Rate: 7.1 symbols/min [2025-10-06T21:52:50.081860] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T21:52:50.083157] [INFO ] [REMOTE ] TG: Full fetch complete (15052 records). [2025-10-06T21:52:50.083232] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-06T21:52:50.466605] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-06T21:52:50.466737] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-06T21:52:50.467186] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-06T21:52:50.467227] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-06T21:52:50.467970] [DEBUG] [LOCAL ] TG: Trimmed 15052 records to 10390 (keeping 200 days of data) [2025-10-06T21:52:50.531620] [DEBUG] [LOCAL ] TG: Primary data saved (10390 records). [2025-10-06T21:52:50.531852] [INFO ] [MAIN ] TG: Full history saved. [2025-10-06T21:52:50.531956] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TG took 21.5s. Estimated remaining: 40m 58s. Rate: 7.1 symbols/min [2025-10-06T21:52:51.134494] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:52:51.130545] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:52:51.236823] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:52:51.285328] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:52:51.335752] [DEBUG] [LOCAL ] TGLS: Loaded 28366 existing records from primary storage. [2025-10-06T21:52:51.336250] [DEBUG] [LOCAL ] TGS: Loaded 33439 existing records from primary storage. [2025-10-06T21:52:51.337139] [INFO ] [MAIN ] TGLS: Loaded 28366 existing records. [2025-10-06T21:52:51.337346] [INFO ] [MAIN ] TGS: Loaded 33439 existing records. [2025-10-06T21:52:51.714446] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:52:51.745950] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-06T21:52:51.747868] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-06T21:52:51.786681] [DEBUG] [LOCAL ] TGNA: Loaded 49393 existing records from primary storage. [2025-10-06T21:52:51.770180] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:52:51.786911] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-06T21:52:51.787959] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-10-06T21:52:51.788511] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-06T21:52:51.793854] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-06T21:52:51.800378] [INFO ] [MAIN ] TGT: Loaded 54558 existing records. [2025-10-06T21:52:51.788417] [INFO ] [MAIN ] TGNA: Loaded 49393 existing records. [2025-10-06T21:52:51.810011] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-06T21:52:51.854828] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-06T21:52:51.868601] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-06T21:52:52.616527] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:52:52.644128] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:52:52.671122] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-06T21:52:52.682093] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-06T21:52:52.700257] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-06T21:52:52.700126] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-06T21:52:52.765950] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-06T21:52:52.785700] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-06T21:52:52.801505] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-06T21:52:52.791146] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-06T21:52:53.039244] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:52:53.120013] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-06T21:52:53.326430] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:52:53.419400] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-06T21:52:53.769092] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:52:53.795769] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-06T21:52:53.832861] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:52:53.833506] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-06T21:52:54.499430] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T21:52:54.505095] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-06T21:52:54.736583] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T21:52:54.742903] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-06T21:52:55.497071] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T21:52:55.506789] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-06T21:52:55.745289] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T21:52:55.825515] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-06T21:52:55.870635] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T21:52:56.107842] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-06T21:52:56.625548] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-06T21:52:57.109401] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T21:52:57.180411] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T21:52:57.425543] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-06T21:52:57.971980] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T21:52:58.225589] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-06T21:52:59.027881] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-06T21:52:59.031225] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T21:52:59.825510] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-06T21:53:00.307848] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-06T21:53:00.445570] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T21:53:00.625564] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-06T21:53:01.270450] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T21:53:01.425566] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-06T21:53:02.011449] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T21:53:02.225617] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-06T21:53:02.823020] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T21:53:03.025567] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-06T21:53:03.825553] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-06T21:53:03.860025] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T21:53:04.462709] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-06T21:53:04.625611] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-06T21:53:05.415859] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T21:53:05.425468] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-06T21:53:05.798026] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T21:53:06.225564] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-06T21:53:06.277528] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-06T21:53:07.025589] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-06T21:53:07.458875] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T21:53:07.825566] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-06T21:53:08.625500] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-06T21:53:08.855863] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T21:53:09.180232] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-06T21:53:09.425538] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-06T21:53:09.588713] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T21:53:10.225487] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-06T21:53:10.632066] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T21:53:11.025600] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-06T21:53:11.825497] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-06T21:53:11.948515] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T21:53:12.625575] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-06T21:53:13.156102] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T21:53:13.435067] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-06T21:53:13.455910] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-06T21:53:14.225495] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-06T21:53:14.335281] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T21:53:14.941845] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-06T21:53:15.025544] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-06T21:53:15.825515] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-06T21:53:16.200232] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T21:53:16.202963] [INFO ] [REMOTE ] TGS: Full fetch complete (47993 records). [2025-10-06T21:53:16.203065] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-06T21:53:16.591517] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-06T21:53:16.591723] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-06T21:53:16.592866] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-06T21:53:16.592948] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-06T21:53:16.594150] [DEBUG] [LOCAL ] TGS: Trimmed 47993 records to 32864 (keeping 200 days of data) [2025-10-06T21:53:16.662378] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-06T21:53:16.712611] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-06T21:53:16.834416] [DEBUG] [LOCAL ] TGS: Primary data saved (32864 records). [2025-10-06T21:53:16.834579] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-06T21:53:16.834691] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGS took 26.3s. Estimated remaining: 40m 52s. Rate: 7.1 symbols/min [2025-10-06T21:53:17.043200] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:53:17.090878] [DEBUG] [LOCAL ] THC: Loaded 48248 existing records from primary storage. [2025-10-06T21:53:17.091291] [INFO ] [MAIN ] THC: Loaded 48248 existing records. [2025-10-06T21:53:17.276160] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:53:17.276581] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-06T21:53:17.276723] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-06T21:53:17.276966] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-06T21:53:17.277149] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-06T21:53:17.407568] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T21:53:17.427929] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-06T21:53:17.677430] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T21:53:17.683816] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:53:17.684253] [INFO ] [REMOTE ] TGLS: Full fetch complete (40577 records). [2025-10-06T21:53:17.684335] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-06T21:53:18.137202] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-06T21:53:18.137354] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-06T21:53:18.138347] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-06T21:53:18.138434] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-06T21:53:18.139453] [DEBUG] [LOCAL ] TGLS: Trimmed 40577 records to 27798 (keeping 200 days of data) [2025-10-06T21:53:18.237489] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-06T21:53:18.337611] [DEBUG] [LOCAL ] TGLS: Primary data saved (27798 records). [2025-10-06T21:53:18.337792] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-06T21:53:18.337885] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGLS took 27.8s. Estimated remaining: 40m 42s. Rate: 7.1 symbols/min [2025-10-06T21:53:18.543566] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:53:18.569551] [DEBUG] [LOCAL ] THG: Loaded 21946 existing records from primary storage. [2025-10-06T21:53:18.569880] [INFO ] [MAIN ] THG: Loaded 21946 existing records. [2025-10-06T21:53:18.779462] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:53:18.779746] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-06T21:53:18.779806] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-06T21:53:18.780048] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-06T21:53:18.780105] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-06T21:53:19.038998] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-06T21:53:19.129528] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:53:19.825503] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-06T21:53:20.030935] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-06T21:53:20.132164] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-06T21:53:20.625503] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-06T21:53:20.922928] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-06T21:53:20.982597] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T21:53:21.425584] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-06T21:53:22.225540] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-06T21:53:23.025621] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-06T21:53:23.123552] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-06T21:53:23.502491] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-06T21:53:23.556818] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T21:53:23.825536] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-06T21:53:24.625589] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-06T21:53:24.690804] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T21:53:25.001787] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-06T21:53:25.425551] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-06T21:53:26.225585] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-06T21:53:27.017159] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-06T21:53:27.028326] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-06T21:53:27.087286] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T21:53:27.825487] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-06T21:53:27.922563] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T21:53:28.136003] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T21:53:28.625542] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-06T21:53:29.425569] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-06T21:53:30.000247] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-06T21:53:30.070817] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-06T21:53:30.225508] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-06T21:53:31.025588] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-06T21:53:31.174776] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T21:53:31.825599] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-06T21:53:32.090315] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T21:53:32.093934] [INFO ] [REMOTE ] TGNA: Full fetch complete (69988 records). [2025-10-06T21:53:32.094135] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-06T21:53:32.524785] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-06T21:53:32.524933] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-06T21:53:32.526753] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-06T21:53:32.526884] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-06T21:53:32.529398] [DEBUG] [LOCAL ] TGNA: Trimmed 69988 records to 48647 (keeping 200 days of data) [2025-10-06T21:53:32.632532] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-06T21:53:32.689182] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-06T21:53:32.723348] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T21:53:32.928842] [DEBUG] [LOCAL ] TGNA: Primary data saved (48647 records). [2025-10-06T21:53:32.929070] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-06T21:53:32.929204] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGNA took 42.4s. Estimated remaining: 40m 35s. Rate: 7.1 symbols/min [2025-10-06T21:53:33.106805] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:53:33.112396] [DEBUG] [LOCAL ] THIR: Loaded 2246 existing records from primary storage. [2025-10-06T21:53:33.112608] [INFO ] [MAIN ] THIR: Loaded 2246 existing records. [2025-10-06T21:53:33.298847] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:53:33.299251] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-06T21:53:33.299312] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-06T21:53:33.299529] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-06T21:53:33.299595] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-06T21:53:33.430765] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-06T21:53:33.689255] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:53:34.225618] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-06T21:53:34.318278] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T21:53:34.390455] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (0.16 seconds). [2025-10-06T21:53:34.394001] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-10-06T21:53:34.394148] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-06T21:53:34.738899] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-06T21:53:34.846148] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-06T21:53:34.846264] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-06T21:53:34.848305] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-06T21:53:34.848395] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-06T21:53:34.850517] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 53778 (keeping 200 days of data) [2025-10-06T21:53:35.051283] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-06T21:53:35.242198] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-10-06T21:53:35.242410] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-06T21:53:35.242517] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 44.7s. Estimated remaining: 40m 25s. Rate: 7.1 symbols/min [2025-10-06T21:53:35.425930] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:53:35.431179] [DEBUG] [LOCAL ] THLV: Loaded 1560 existing records from primary storage. [2025-10-06T21:53:35.431439] [INFO ] [MAIN ] THLV: Loaded 1560 existing records. [2025-10-06T21:53:35.616231] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:53:35.616491] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-06T21:53:35.616541] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-06T21:53:35.616760] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-06T21:53:35.616818] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-06T21:53:35.831800] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-06T21:53:36.002953] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:53:36.240224] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T21:53:36.625502] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-06T21:53:36.955938] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-06T21:53:37.425503] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-06T21:53:37.703681] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-06T21:53:38.225611] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-06T21:53:38.481043] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T21:53:38.539339] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-06T21:53:39.025608] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-06T21:53:39.292461] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-06T21:53:39.825555] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-06T21:53:40.178584] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-06T21:53:40.625598] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-06T21:53:41.049138] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-06T21:53:41.425607] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-06T21:53:41.780295] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-06T21:53:42.225601] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-06T21:53:42.655717] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-06T21:53:43.025595] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-06T21:53:43.637924] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-06T21:53:43.825537] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-06T21:53:44.282445] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-06T21:53:44.625578] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-06T21:53:45.084310] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-06T21:53:45.425577] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-06T21:53:46.225511] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-06T21:53:46.443574] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T21:53:46.650493] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-06T21:53:47.025548] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-06T21:53:47.416879] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-06T21:53:47.825534] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-06T21:53:48.285101] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-06T21:53:48.625534] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-06T21:53:49.068101] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-06T21:53:49.425561] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-06T21:53:49.855606] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-06T21:53:50.225561] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-06T21:53:50.563828] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-06T21:53:51.025598] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-06T21:53:51.451859] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T21:53:51.825556] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-06T21:53:52.198293] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-06T21:53:52.625544] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-06T21:53:52.914681] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-06T21:53:52.915410] [INFO ] [REMOTE ] THLV: Full fetch complete (2639 records). [2025-10-06T21:53:52.915478] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-06T21:53:53.294934] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-06T21:53:53.295059] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-06T21:53:53.295279] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-06T21:53:53.295334] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-06T21:53:53.295829] [DEBUG] [LOCAL ] THLV: Trimmed 2639 records to 1539 (keeping 200 days of data) [2025-10-06T21:53:53.305703] [DEBUG] [LOCAL ] THLV: Primary data saved (1539 records). [2025-10-06T21:53:53.305823] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-06T21:53:53.305917] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THLV took 18.1s. Estimated remaining: 40m 18s. Rate: 7.1 symbols/min [2025-10-06T21:53:53.430710] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-06T21:53:53.529610] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:53:53.577985] [DEBUG] [LOCAL ] THO: Loaded 42481 existing records from primary storage. [2025-10-06T21:53:53.578430] [INFO ] [MAIN ] THO: Loaded 42481 existing records. [2025-10-06T21:53:53.768499] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:53:53.768872] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-06T21:53:53.768990] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-06T21:53:53.769238] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-06T21:53:53.769283] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-06T21:53:54.157276] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:53:54.225513] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-06T21:53:55.025580] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-06T21:53:55.249025] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T21:53:55.769492] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T21:53:55.825472] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-06T21:53:55.893678] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T21:53:55.896580] [INFO ] [REMOTE ] THG: Full fetch complete (31160 records). [2025-10-06T21:53:55.896706] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-06T21:53:56.279954] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-06T21:53:56.280056] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-06T21:53:56.281066] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-06T21:53:56.281132] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-06T21:53:56.282073] [DEBUG] [LOCAL ] THG: Trimmed 31160 records to 21672 (keeping 200 days of data) [2025-10-06T21:53:56.428021] [DEBUG] [LOCAL ] THG: Primary data saved (21672 records). [2025-10-06T21:53:56.428191] [INFO ] [MAIN ] THG: Full history saved. [2025-10-06T21:53:56.428288] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THG took 38.1s. Estimated remaining: 40m 9s. Rate: 7.1 symbols/min [2025-10-06T21:53:56.611634] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:53:56.630497] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-06T21:53:56.643859] [DEBUG] [LOCAL ] THQ: Loaded 25426 existing records from primary storage. [2025-10-06T21:53:56.644208] [INFO ] [MAIN ] THQ: Loaded 25426 existing records. [2025-10-06T21:53:56.835023] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:53:56.835296] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-06T21:53:56.835348] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-06T21:53:56.835605] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-06T21:53:56.835685] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-06T21:53:57.209758] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:53:57.368982] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T21:53:57.425629] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-06T21:53:58.225514] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-06T21:53:58.491027] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T21:53:58.520420] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-06T21:53:59.025554] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-06T21:53:59.632322] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T21:53:59.825535] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-06T21:54:00.380828] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T21:54:00.593909] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T21:54:00.625539] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-06T21:54:01.425611] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-06T21:54:01.802317] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-06T21:54:02.225556] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-06T21:54:02.737151] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-06T21:54:03.025561] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-06T21:54:03.138047] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T21:54:03.825515] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-06T21:54:04.370600] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T21:54:04.371507] [INFO ] [REMOTE ] THIR: Full fetch complete (2792 records). [2025-10-06T21:54:04.371582] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-06T21:54:04.626538] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-06T21:54:04.813631] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-06T21:54:04.813827] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-06T21:54:04.814095] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-06T21:54:04.814315] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-06T21:54:04.816101] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T21:54:04.825895] [DEBUG] [LOCAL ] THIR: Trimmed 2792 records to 2258 (keeping 200 days of data) [2025-10-06T21:54:04.840967] [DEBUG] [LOCAL ] THIR: Primary data saved (2258 records). [2025-10-06T21:54:04.841073] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-06T21:54:04.841167] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THIR took 31.9s. Estimated remaining: 40m 1s. Rate: 7.1 symbols/min [2025-10-06T21:54:05.017039] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:54:05.042564] [DEBUG] [LOCAL ] THR: Loaded 20079 existing records from primary storage. [2025-10-06T21:54:05.043039] [INFO ] [MAIN ] THR: Loaded 20079 existing records. [2025-10-06T21:54:05.235200] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:54:05.235484] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-06T21:54:05.235545] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-06T21:54:05.235787] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-06T21:54:05.235845] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-06T21:54:05.434037] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-06T21:54:05.647077] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:54:05.696531] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T21:54:06.225592] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-06T21:54:06.951521] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T21:54:07.025505] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-06T21:54:07.238024] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-06T21:54:07.825560] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-06T21:54:08.489923] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-06T21:54:08.625960] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-06T21:54:08.632043] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T21:54:09.425525] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-06T21:54:09.747762] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T21:54:10.225605] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-06T21:54:11.005105] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T21:54:11.025493] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-06T21:54:11.178174] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T21:54:11.825578] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-06T21:54:12.623852] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T21:54:12.632418] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-06T21:54:12.785445] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T21:54:12.788018] [INFO ] [REMOTE ] THC: Full fetch complete (69070 records). [2025-10-06T21:54:12.788145] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-06T21:54:13.182722] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-06T21:54:13.182837] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-06T21:54:13.183996] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-06T21:54:13.184061] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-06T21:54:13.185429] [DEBUG] [LOCAL ] THC: Trimmed 69070 records to 47514 (keeping 200 days of data) [2025-10-06T21:54:13.425787] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-06T21:54:13.495067] [DEBUG] [LOCAL ] THC: Primary data saved (47514 records). [2025-10-06T21:54:13.495253] [INFO ] [MAIN ] THC: Full history saved. [2025-10-06T21:54:13.495348] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THC took 56.7s. Estimated remaining: 39m 52s. Rate: 7.1 symbols/min [2025-10-06T21:54:13.670065] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:54:13.708263] [DEBUG] [LOCAL ] THS: Loaded 38862 existing records from primary storage. [2025-10-06T21:54:13.711884] [INFO ] [MAIN ] THS: Loaded 38862 existing records. [2025-10-06T21:54:13.866301] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-06T21:54:13.910976] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:54:13.911225] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-06T21:54:13.911281] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-06T21:54:13.911550] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-06T21:54:13.911608] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-06T21:54:14.230712] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-06T21:54:14.271386] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:54:14.936679] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T21:54:15.025473] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-06T21:54:15.193585] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-06T21:54:15.825541] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-06T21:54:16.625614] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-06T21:54:16.672169] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T21:54:16.905981] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T21:54:17.425601] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-06T21:54:17.963485] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T21:54:18.225509] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-06T21:54:18.454385] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-06T21:54:19.025547] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-06T21:54:19.245515] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-06T21:54:19.825512] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-06T21:54:20.143384] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-06T21:54:20.625576] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-06T21:54:21.147147] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T21:54:21.149458] [INFO ] [REMOTE ] THO: Full fetch complete (60207 records). [2025-10-06T21:54:21.149555] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-06T21:54:21.430683] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-06T21:54:21.552072] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-06T21:54:21.552455] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-06T21:54:21.553725] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-06T21:54:21.553792] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-06T21:54:21.555295] [DEBUG] [LOCAL ] THO: Trimmed 60207 records to 41813 (keeping 200 days of data) [2025-10-06T21:54:21.787340] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T21:54:21.852355] [DEBUG] [LOCAL ] THO: Primary data saved (41813 records). [2025-10-06T21:54:21.852528] [INFO ] [MAIN ] THO: Full history saved. [2025-10-06T21:54:21.852637] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THO took 28.5s. Estimated remaining: 39m 44s. Rate: 7.1 symbols/min [2025-10-06T21:54:22.033530] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:54:22.056394] [DEBUG] [LOCAL ] THW: Loaded 19744 existing records from primary storage. [2025-10-06T21:54:22.056763] [INFO ] [MAIN ] THW: Loaded 19744 existing records. [2025-10-06T21:54:22.235236] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-06T21:54:22.241606] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:54:22.242910] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-06T21:54:22.242965] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-06T21:54:22.243433] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-06T21:54:22.243494] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-06T21:54:22.645772] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:54:22.772683] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T21:54:22.943559] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-06T21:54:23.025479] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-06T21:54:23.825548] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-06T21:54:24.094444] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T21:54:24.625533] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-06T21:54:25.338333] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T21:54:25.425481] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-06T21:54:25.728747] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T21:54:26.225552] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-06T21:54:26.865063] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T21:54:27.025545] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-06T21:54:27.639444] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T21:54:27.825498] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-06T21:54:28.124413] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T21:54:28.625578] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-06T21:54:29.078418] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T21:54:29.425539] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-06T21:54:30.132086] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-06T21:54:30.225504] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-06T21:54:30.754928] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-06T21:54:31.025527] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-06T21:54:31.657275] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-06T21:54:31.660793] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-06T21:54:31.669939] [INFO ] [REMOTE ] THR: Full fetch complete (28717 records). [2025-10-06T21:54:31.670084] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-06T21:54:31.843024] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-06T21:54:32.051148] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-06T21:54:32.051273] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-06T21:54:32.052157] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-06T21:54:32.052224] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-06T21:54:32.053472] [DEBUG] [LOCAL ] THR: Trimmed 28717 records to 19831 (keeping 200 days of data) [2025-10-06T21:54:32.176006] [DEBUG] [LOCAL ] THR: Primary data saved (19831 records). [2025-10-06T21:54:32.176195] [INFO ] [MAIN ] THR: Full history saved. [2025-10-06T21:54:32.176292] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THR took 27.3s. Estimated remaining: 39m 35s. Rate: 7.1 symbols/min [2025-10-06T21:54:32.344114] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:54:32.344297] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-06T21:54:32.344333] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-06T21:54:32.344450] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-06T21:54:32.344491] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-06T21:54:32.344530] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-06T21:54:32.344560] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-06T21:54:32.630739] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-06T21:54:32.702355] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:54:32.921243] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-06T21:54:33.425552] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-06T21:54:33.761869] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T21:54:34.225569] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-06T21:54:34.544613] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-06T21:54:35.025559] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-06T21:54:35.271505] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T21:54:35.825549] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-06T21:54:36.544077] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T21:54:36.625504] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-06T21:54:36.928141] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T21:54:37.425634] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-06T21:54:37.663113] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:54:37.663489] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-06T21:54:37.663674] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:54:37.663757] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-06T21:54:37.663823] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:54:37.663906] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-06T21:54:37.664044] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-06T21:54:37.664122] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-06T21:54:37.664210] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-06T21:54:37.664296] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. TIC took 5.5s. Estimated remaining: 39m 27s. Rate: 7.1 symbols/min [2025-10-06T21:54:37.888696] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:54:37.940978] [DEBUG] [LOCAL ] TIMB: Loaded 36490 existing records from primary storage. [2025-10-06T21:54:37.941341] [INFO ] [MAIN ] TIMB: Loaded 36490 existing records. [2025-10-06T21:54:38.124361] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:54:38.124744] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-06T21:54:38.124828] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-06T21:54:38.125097] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-06T21:54:38.125175] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-06T21:54:38.226126] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-06T21:54:38.332587] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T21:54:38.547576] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:54:39.025508] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-06T21:54:39.162686] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T21:54:39.164710] [INFO ] [REMOTE ] THQ: Full fetch complete (35202 records). [2025-10-06T21:54:39.164808] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-06T21:54:39.528174] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-06T21:54:39.528265] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-06T21:54:39.529044] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-06T21:54:39.529110] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-06T21:54:39.530007] [DEBUG] [LOCAL ] THQ: Trimmed 35202 records to 25145 (keeping 200 days of data) [2025-10-06T21:54:39.685384] [DEBUG] [LOCAL ] THQ: Primary data saved (25145 records). [2025-10-06T21:54:39.685534] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-06T21:54:39.685637] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. THQ took 43.3s. Estimated remaining: 39m 17s. Rate: 7.1 symbols/min [2025-10-06T21:54:39.830614] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-06T21:54:39.856903] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:54:39.863589] [DEBUG] [LOCAL ] TISI: Loaded 3792 existing records from primary storage. [2025-10-06T21:54:39.863975] [INFO ] [MAIN ] TISI: Loaded 3792 existing records. [2025-10-06T21:54:40.053843] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:54:40.067383] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-06T21:54:40.067571] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-06T21:54:40.069252] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-06T21:54:40.069186] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T21:54:40.069410] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-06T21:54:40.431354] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:54:40.625520] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-06T21:54:41.155298] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T21:54:41.157952] [INFO ] [REMOTE ] THS: Full fetch complete (54249 records). [2025-10-06T21:54:41.158075] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-06T21:54:41.430783] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-06T21:54:41.532865] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-06T21:54:41.532951] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-06T21:54:41.533986] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-06T21:54:41.534062] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-06T21:54:41.535202] [DEBUG] [LOCAL ] THS: Trimmed 54249 records to 38439 (keeping 200 days of data) [2025-10-06T21:54:41.762331] [DEBUG] [LOCAL ] THS: Primary data saved (38439 records). [2025-10-06T21:54:41.762496] [INFO ] [MAIN ] THS: Full history saved. [2025-10-06T21:54:41.762615] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. THS took 28.3s. Estimated remaining: 39m 8s. Rate: 7.1 symbols/min [2025-10-06T21:54:41.931508] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:54:41.963133] [DEBUG] [LOCAL ] TIXT: Loaded 32057 existing records from primary storage. [2025-10-06T21:54:41.963431] [INFO ] [MAIN ] TIXT: Loaded 32057 existing records. [2025-10-06T21:54:42.135778] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-06T21:54:42.158253] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:54:42.173199] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-06T21:54:42.175695] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-06T21:54:42.176094] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-06T21:54:42.176572] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-06T21:54:42.177536] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T21:54:42.251756] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-06T21:54:42.557031] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:54:43.025484] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-06T21:54:43.335447] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-06T21:54:43.346777] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-06T21:54:43.825541] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-06T21:54:44.289687] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-06T21:54:44.625551] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-06T21:54:45.254400] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-06T21:54:45.425509] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-06T21:54:46.225532] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-06T21:54:46.234380] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T21:54:47.025592] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-06T21:54:47.542866] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-06T21:54:47.764843] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T21:54:47.825479] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-06T21:54:48.407999] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T21:54:48.625518] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-06T21:54:49.071038] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-06T21:54:49.425540] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-06T21:54:50.214838] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-06T21:54:50.225476] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-06T21:54:51.025583] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-06T21:54:51.470241] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-06T21:54:51.825567] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-06T21:54:52.283747] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-06T21:54:52.517075] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T21:54:52.625537] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-06T21:54:53.425610] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-06T21:54:53.889529] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-06T21:54:54.016464] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T21:54:54.225540] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-06T21:54:55.025533] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-06T21:54:55.676536] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T21:54:55.825529] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-06T21:54:56.175891] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T21:54:56.625546] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-06T21:54:56.895253] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T21:54:57.002732] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T21:54:57.004082] [INFO ] [REMOTE ] TISI: Full fetch complete (4933 records). [2025-10-06T21:54:57.004190] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-06T21:54:57.399457] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-06T21:54:57.399573] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-06T21:54:57.399840] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-06T21:54:57.399906] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-06T21:54:57.400449] [DEBUG] [LOCAL ] TISI: Trimmed 4933 records to 3590 (keeping 200 days of data) [2025-10-06T21:54:57.424129] [DEBUG] [LOCAL ] TISI: Primary data saved (3590 records). [2025-10-06T21:54:57.424310] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-06T21:54:57.424414] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. TISI took 17.7s. Estimated remaining: 39m 1s. Rate: 7.1 symbols/min [2025-10-06T21:54:57.429954] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-06T21:54:57.617048] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:54:57.679988] [DEBUG] [LOCAL ] TJX: Loaded 54448 existing records from primary storage. [2025-10-06T21:54:57.680437] [INFO ] [MAIN ] TJX: Loaded 54448 existing records. [2025-10-06T21:54:57.881568] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:54:57.881871] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-06T21:54:57.881925] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-06T21:54:57.882231] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-06T21:54:57.882291] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-06T21:54:58.229122] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-06T21:54:58.262708] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:54:58.284131] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-06T21:54:59.025576] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-06T21:54:59.755610] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T21:54:59.830832] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-06T21:54:59.831898] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-06T21:54:59.835068] [INFO ] [REMOTE ] THW: Full fetch complete (29354 records). [2025-10-06T21:54:59.835186] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-06T21:55:00.238558] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-06T21:55:00.238698] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-06T21:55:00.239785] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-06T21:55:00.239863] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-06T21:55:00.240807] [DEBUG] [LOCAL ] THW: Trimmed 29354 records to 19586 (keeping 200 days of data) [2025-10-06T21:55:00.365005] [DEBUG] [LOCAL ] THW: Primary data saved (19586 records). [2025-10-06T21:55:00.365202] [INFO ] [MAIN ] THW: Full history saved. [2025-10-06T21:55:00.365303] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. THW took 38.5s. Estimated remaining: 38m 51s. Rate: 7.1 symbols/min [2025-10-06T21:55:00.549616] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:55:00.593393] [DEBUG] [LOCAL ] TK: Loaded 39948 existing records from primary storage. [2025-10-06T21:55:00.593895] [INFO ] [MAIN ] TK: Loaded 39948 existing records. [2025-10-06T21:55:00.630832] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-06T21:55:00.811470] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:55:00.812163] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-06T21:55:00.812236] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-06T21:55:00.812537] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-06T21:55:00.812603] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-06T21:55:01.308824] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-06T21:55:01.403420] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:55:01.425543] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-06T21:55:02.225558] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-06T21:55:02.713473] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-06T21:55:02.921738] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T21:55:03.025587] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-06T21:55:03.060068] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T21:55:03.825548] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-06T21:55:04.436394] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T21:55:04.625562] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-06T21:55:05.292751] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T21:55:05.383638] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-06T21:55:05.425475] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-06T21:55:06.225553] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-06T21:55:07.025585] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-06T21:55:07.185308] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-06T21:55:07.257962] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-06T21:55:07.825572] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-06T21:55:08.389758] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T21:55:08.625539] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-06T21:55:09.292083] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T21:55:09.425571] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-06T21:55:10.211472] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-06T21:55:10.225501] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-06T21:55:10.866834] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T21:55:11.025563] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-06T21:55:11.422454] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T21:55:11.825557] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-06T21:55:12.589548] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T21:55:12.625525] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-06T21:55:12.948499] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-06T21:55:13.425536] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-06T21:55:14.145393] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T21:55:14.225554] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-06T21:55:14.730331] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T21:55:15.025539] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-06T21:55:15.804379] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T21:55:15.825482] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-06T21:55:16.625523] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-06T21:55:16.710308] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T21:55:17.394041] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T21:55:17.425506] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-06T21:55:17.929938] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T21:55:18.225588] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-06T21:55:19.025498] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-06T21:55:19.091522] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T21:55:19.333408] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T21:55:19.335783] [INFO ] [REMOTE ] TIXT: Full fetch complete (46083 records). [2025-10-06T21:55:19.335871] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-06T21:55:19.704310] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-06T21:55:19.704405] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-06T21:55:19.705674] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-06T21:55:19.705757] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-06T21:55:19.707011] [DEBUG] [LOCAL ] TIXT: Trimmed 46083 records to 31721 (keeping 200 days of data) [2025-10-06T21:55:19.825713] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-06T21:55:19.913954] [DEBUG] [LOCAL ] TIXT: Primary data saved (31721 records). [2025-10-06T21:55:19.914076] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-06T21:55:19.914162] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. TIXT took 38.2s. Estimated remaining: 38m 44s. Rate: 7.1 symbols/min [2025-10-06T21:55:20.079261] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:55:20.116207] [DEBUG] [LOCAL ] TKC: Loaded 39672 existing records from primary storage. [2025-10-06T21:55:20.116511] [INFO ] [MAIN ] TKC: Loaded 39672 existing records. [2025-10-06T21:55:20.292202] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:55:20.292445] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-06T21:55:20.292493] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-06T21:55:20.292773] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-06T21:55:20.292837] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-06T21:55:20.646246] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:55:20.625478] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-06T21:55:20.813986] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T21:55:20.842388] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T21:55:21.425566] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-06T21:55:22.079427] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T21:55:22.225528] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-06T21:55:23.025510] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-06T21:55:23.314464] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T21:55:23.502545] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T21:55:23.825564] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-06T21:55:23.919288] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T21:55:24.625549] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-06T21:55:24.768162] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T21:55:24.770462] [INFO ] [REMOTE ] TIMB: Full fetch complete (54020 records). [2025-10-06T21:55:24.770565] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-06T21:55:25.193113] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-06T21:55:25.193232] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-06T21:55:25.195048] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-06T21:55:25.195116] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-06T21:55:25.196546] [DEBUG] [LOCAL ] TIMB: Trimmed 54020 records to 35773 (keeping 200 days of data) [2025-10-06T21:55:25.428167] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-06T21:55:25.446929] [DEBUG] [LOCAL ] TIMB: Primary data saved (35773 records). [2025-10-06T21:55:25.447150] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-06T21:55:25.447261] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TIMB took 47.8s. Estimated remaining: 38m 36s. Rate: 7.1 symbols/min [2025-10-06T21:55:25.639514] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:55:25.692040] [DEBUG] [LOCAL ] TKO: Loaded 44733 existing records from primary storage. [2025-10-06T21:55:25.692465] [INFO ] [MAIN ] TKO: Loaded 44733 existing records. [2025-10-06T21:55:25.885611] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:55:25.886034] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-06T21:55:25.886101] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-06T21:55:25.886419] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-06T21:55:25.886478] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-06T21:55:26.142385] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-06T21:55:26.230609] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-06T21:55:26.294227] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:55:26.443736] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T21:55:26.446942] [INFO ] [REMOTE ] TK: Full fetch complete (56502 records). [2025-10-06T21:55:26.447035] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-06T21:55:26.820553] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-06T21:55:26.820691] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-06T21:55:26.821714] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-06T21:55:26.821779] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-06T21:55:26.823120] [DEBUG] [LOCAL ] TK: Trimmed 56502 records to 39303 (keeping 200 days of data) [2025-10-06T21:55:27.027668] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-06T21:55:27.054146] [DEBUG] [LOCAL ] TK: Primary data saved (39303 records). [2025-10-06T21:55:27.054346] [INFO ] [MAIN ] TK: Full history saved. [2025-10-06T21:55:27.054461] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TK took 26.7s. Estimated remaining: 38m 26s. Rate: 7.1 symbols/min [2025-10-06T21:55:27.221399] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:55:27.259869] [DEBUG] [LOCAL ] TKR: Loaded 40606 existing records from primary storage. [2025-10-06T21:55:27.260215] [INFO ] [MAIN ] TKR: Loaded 40606 existing records. [2025-10-06T21:55:27.396279] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T21:55:27.462096] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:55:27.462399] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-06T21:55:27.462507] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-06T21:55:27.462780] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-06T21:55:27.462837] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-06T21:55:27.807612] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:55:27.825467] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-06T21:55:28.591358] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T21:55:28.625501] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-06T21:55:29.352740] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T21:55:29.425600] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-06T21:55:30.043315] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T21:55:30.225535] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-06T21:55:31.025592] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-06T21:55:31.465223] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-06T21:55:31.558684] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T21:55:31.825511] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-06T21:55:32.489591] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T21:55:32.625539] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-06T21:55:33.425535] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-06T21:55:33.571773] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T21:55:33.776085] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T21:55:34.225563] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-06T21:55:34.862748] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T21:55:35.025535] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-06T21:55:35.809239] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T21:55:35.825467] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-06T21:55:36.507733] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T21:55:36.625556] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-06T21:55:37.425525] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-06T21:55:37.580093] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T21:55:38.192313] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T21:55:38.225472] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-06T21:55:38.958407] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T21:55:39.025579] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-06T21:55:39.825501] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-06T21:55:40.163328] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-06T21:55:40.454049] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T21:55:40.625549] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-06T21:55:41.352744] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T21:55:41.425475] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-06T21:55:42.225512] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-06T21:55:42.314257] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T21:55:42.954905] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-06T21:55:43.025584] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-06T21:55:43.649809] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T21:55:43.825517] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-06T21:55:44.221618] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T21:55:44.625591] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-06T21:55:45.200255] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T21:55:45.425511] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-06T21:55:46.225559] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-06T21:55:46.275134] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T21:55:46.437777] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T21:55:46.440460] [INFO ] [REMOTE ] TKC: Full fetch complete (52529 records). [2025-10-06T21:55:46.440559] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-06T21:55:46.837207] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-06T21:55:46.837291] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-06T21:55:46.838264] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-06T21:55:46.838325] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-06T21:55:46.839437] [DEBUG] [LOCAL ] TKC: Trimmed 52529 records to 39044 (keeping 200 days of data) [2025-10-06T21:55:47.034611] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-06T21:55:47.069611] [DEBUG] [LOCAL ] TKC: Primary data saved (39044 records). [2025-10-06T21:55:47.069794] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-06T21:55:47.069937] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TKC took 27.2s. Estimated remaining: 38m 19s. Rate: 7.1 symbols/min [2025-10-06T21:55:47.234675] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:55:47.273621] [DEBUG] [LOCAL ] TLK: Loaded 39755 existing records from primary storage. [2025-10-06T21:55:47.273973] [INFO ] [MAIN ] TLK: Loaded 39755 existing records. [2025-10-06T21:55:47.446090] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:55:47.446319] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-06T21:55:47.446367] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-06T21:55:47.446677] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-06T21:55:47.446737] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-06T21:55:47.799968] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:55:47.825465] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-06T21:55:48.189976] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T21:55:48.529929] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T21:55:48.625506] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-06T21:55:49.351994] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T21:55:49.425496] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-06T21:55:49.773419] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T21:55:50.225546] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-06T21:55:50.855049] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T21:55:51.025542] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-06T21:55:51.825511] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-06T21:55:52.036143] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T21:55:52.344924] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-06T21:55:52.625576] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-06T21:55:53.000313] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T21:55:53.079584] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T21:55:53.082637] [INFO ] [REMOTE ] TJX: Full fetch complete (77681 records). [2025-10-06T21:55:53.082769] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-06T21:55:53.430743] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-06T21:55:53.482399] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-06T21:55:53.482496] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-06T21:55:53.483711] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-06T21:55:53.483779] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-06T21:55:53.485541] [DEBUG] [LOCAL ] TJX: Trimmed 77681 records to 53668 (keeping 200 days of data) [2025-10-06T21:55:53.861605] [DEBUG] [LOCAL ] TJX: Primary data saved (53668 records). [2025-10-06T21:55:53.861834] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-06T21:55:53.861971] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TJX took 56.4s. Estimated remaining: 38m 11s. Rate: 7.1 symbols/min [2025-10-06T21:55:54.120204] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:55:54.147216] [DEBUG] [LOCAL ] TLYS: Loaded 16659 existing records from primary storage. [2025-10-06T21:55:54.147621] [INFO ] [MAIN ] TLYS: Loaded 16659 existing records. [2025-10-06T21:55:54.233928] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-06T21:55:54.421377] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:55:54.421729] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-06T21:55:54.421796] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-06T21:55:54.422049] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-06T21:55:54.422113] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-06T21:55:54.919534] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:55:55.025549] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-06T21:55:55.182207] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T21:55:55.822896] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T21:55:55.826318] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-06T21:55:56.341296] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-06T21:55:56.430036] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-06T21:55:56.625502] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-06T21:55:56.814288] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (0.19 seconds). [2025-10-06T21:55:56.820356] [INFO ] [REMOTE ] TKO: Full fetch complete (64832 records). [2025-10-06T21:55:56.820529] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-06T21:55:57.206580] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-06T21:55:57.206727] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-06T21:55:57.207813] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-06T21:55:57.207876] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-06T21:55:57.209264] [DEBUG] [LOCAL ] TKO: Trimmed 64832 records to 43958 (keeping 200 days of data) [2025-10-06T21:55:57.441809] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-06T21:55:57.506542] [DEBUG] [LOCAL ] TKO: Primary data saved (43958 records). [2025-10-06T21:55:57.506726] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-06T21:55:57.506825] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TKO took 32.1s. Estimated remaining: 38m 1s. Rate: 7.1 symbols/min [2025-10-06T21:55:57.673309] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:55:57.711963] [DEBUG] [LOCAL ] TM: Loaded 36801 existing records from primary storage. [2025-10-06T21:55:57.712306] [INFO ] [MAIN ] TM: Loaded 36801 existing records. [2025-10-06T21:55:57.885363] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:55:57.885584] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-06T21:55:57.885630] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-06T21:55:57.886029] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-06T21:55:57.886087] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-06T21:55:58.238523] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-06T21:55:58.243830] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:55:58.927079] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T21:55:59.025480] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-06T21:55:59.822970] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-06T21:55:59.830555] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-06T21:56:00.208290] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T21:56:00.210634] [INFO ] [REMOTE ] TKR: Full fetch complete (57767 records). [2025-10-06T21:56:00.210763] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-06T21:56:00.589208] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-06T21:56:00.589316] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-06T21:56:00.590399] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-06T21:56:00.590471] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-06T21:56:00.591728] [DEBUG] [LOCAL ] TKR: Trimmed 57767 records to 39996 (keeping 200 days of data) [2025-10-06T21:56:00.646308] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-06T21:56:00.846600] [DEBUG] [LOCAL ] TKR: Primary data saved (39996 records). [2025-10-06T21:56:00.846807] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-06T21:56:00.846923] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKR took 33.8s. Estimated remaining: 37m 52s. Rate: 7.1 symbols/min [2025-10-06T21:56:01.029568] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:56:01.081303] [DEBUG] [LOCAL ] TME: Loaded 53971 existing records from primary storage. [2025-10-06T21:56:01.081690] [INFO ] [MAIN ] TME: Loaded 53971 existing records. [2025-10-06T21:56:01.270791] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:56:01.271157] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-06T21:56:01.271424] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-06T21:56:01.271957] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-06T21:56:01.272046] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-06T21:56:01.427748] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-06T21:56:01.484411] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T21:56:01.669708] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:56:01.849313] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T21:56:02.225578] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-06T21:56:02.419202] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T21:56:03.025608] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-06T21:56:03.825499] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-06T21:56:03.957011] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T21:56:04.625534] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-06T21:56:04.814791] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T21:56:05.243587] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T21:56:05.415580] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T21:56:05.425462] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-06T21:56:06.201210] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T21:56:06.225526] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-06T21:56:07.015477] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-06T21:56:07.025484] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-06T21:56:07.825498] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-06T21:56:07.868182] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-06T21:56:08.625542] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-06T21:56:09.425532] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-06T21:56:09.624724] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T21:56:10.083944] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T21:56:10.137906] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-06T21:56:10.225482] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-06T21:56:11.025503] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-06T21:56:11.267818] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T21:56:11.825569] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-06T21:56:12.523542] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T21:56:12.625481] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-06T21:56:12.887103] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-06T21:56:13.425530] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-06T21:56:14.225569] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-06T21:56:14.329933] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T21:56:14.934509] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T21:56:15.025542] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-06T21:56:15.825548] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-06T21:56:16.492101] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-06T21:56:16.615723] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T21:56:16.625467] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-06T21:56:16.641260] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T21:56:17.425553] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-06T21:56:17.749165] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-06T21:56:17.751588] [INFO ] [REMOTE ] TLK: Full fetch complete (57308 records). [2025-10-06T21:56:17.751710] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-06T21:56:18.138888] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-06T21:56:18.139345] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-06T21:56:18.140794] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-06T21:56:18.140869] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-06T21:56:18.142259] [DEBUG] [LOCAL ] TLK: Trimmed 57308 records to 38913 (keeping 200 days of data) [2025-10-06T21:56:18.229449] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-06T21:56:18.379759] [DEBUG] [LOCAL ] TLK: Primary data saved (38913 records). [2025-10-06T21:56:18.379937] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-06T21:56:18.380029] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TLK took 31.3s. Estimated remaining: 37m 45s. Rate: 7.1 symbols/min [2025-10-06T21:56:18.552035] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:56:18.602104] [DEBUG] [LOCAL ] TMHC: Loaded 45995 existing records from primary storage. [2025-10-06T21:56:18.602566] [INFO ] [MAIN ] TMHC: Loaded 45995 existing records. [2025-10-06T21:56:18.797147] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:56:18.797513] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-06T21:56:18.797565] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-06T21:56:18.798608] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-06T21:56:18.798754] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-06T21:56:19.034358] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-06T21:56:19.196514] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:56:19.411639] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T21:56:19.825486] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-06T21:56:19.953906] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-06T21:56:20.043677] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T21:56:20.625542] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-06T21:56:21.425525] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-06T21:56:21.756028] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-06T21:56:22.225512] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-06T21:56:22.312289] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T21:56:23.028092] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-06T21:56:23.033227] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T21:56:23.825525] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-06T21:56:24.010253] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T21:56:24.625500] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-06T21:56:24.788200] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T21:56:25.158824] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T21:56:25.160348] [INFO ] [REMOTE ] TLYS: Full fetch complete (21726 records). [2025-10-06T21:56:25.162230] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T21:56:25.162460] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-06T21:56:25.430749] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-06T21:56:25.548202] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-06T21:56:25.548288] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-06T21:56:25.548880] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-06T21:56:25.548942] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-06T21:56:25.549631] [DEBUG] [LOCAL ] TLYS: Trimmed 21726 records to 16492 (keeping 200 days of data) [2025-10-06T21:56:25.646250] [DEBUG] [LOCAL ] TLYS: Primary data saved (16492 records). [2025-10-06T21:56:25.646400] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-06T21:56:25.646483] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TLYS took 31.8s. Estimated remaining: 37m 36s. Rate: 7.1 symbols/min [2025-10-06T21:56:25.816733] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:56:25.866482] [DEBUG] [LOCAL ] TMO: Loaded 53122 existing records from primary storage. [2025-10-06T21:56:25.866867] [INFO ] [MAIN ] TMO: Loaded 53122 existing records. [2025-10-06T21:56:26.044105] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:56:26.044290] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-06T21:56:26.044336] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-06T21:56:26.044539] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-06T21:56:26.044594] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-06T21:56:26.230827] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-06T21:56:26.397146] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:56:27.025621] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-06T21:56:27.056031] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T21:56:27.825531] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-06T21:56:28.162491] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-06T21:56:28.625499] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-06T21:56:28.884685] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-06T21:56:29.425555] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-06T21:56:29.654525] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T21:56:30.227350] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-06T21:56:30.235559] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T21:56:31.035381] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-06T21:56:31.040504] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T21:56:31.717894] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T21:56:31.825536] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-06T21:56:32.625555] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-06T21:56:33.036562] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-06T21:56:33.425515] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-06T21:56:33.663513] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-06T21:56:33.720080] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T21:56:34.225560] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-06T21:56:35.025507] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-06T21:56:35.063720] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T21:56:35.385518] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T21:56:35.388575] [INFO ] [REMOTE ] TM: Full fetch complete (52788 records). [2025-10-06T21:56:35.388732] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-06T21:56:35.775933] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-06T21:56:35.776026] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-06T21:56:35.777008] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-06T21:56:35.777073] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-06T21:56:35.778263] [DEBUG] [LOCAL ] TM: Trimmed 52788 records to 36326 (keeping 200 days of data) [2025-10-06T21:56:35.836461] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-06T21:56:36.018472] [DEBUG] [LOCAL ] TM: Primary data saved (36326 records). [2025-10-06T21:56:36.018686] [INFO ] [MAIN ] TM: Full history saved. [2025-10-06T21:56:36.018800] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TM took 38.5s. Estimated remaining: 37m 28s. Rate: 7.1 symbols/min [2025-10-06T21:56:36.186916] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:56:36.204813] [DEBUG] [LOCAL ] TNC: Loaded 15048 existing records from primary storage. [2025-10-06T21:56:36.205077] [INFO ] [MAIN ] TNC: Loaded 15048 existing records. [2025-10-06T21:56:36.407476] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:56:36.407764] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-06T21:56:36.407838] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-06T21:56:36.408091] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-06T21:56:36.408165] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-06T21:56:36.626376] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-06T21:56:36.774885] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:56:37.001370] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-06T21:56:37.425498] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-06T21:56:37.540997] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T21:56:38.071302] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T21:56:38.225515] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-06T21:56:38.492742] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-06T21:56:39.025558] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-06T21:56:39.756678] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T21:56:39.825487] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-06T21:56:40.441692] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T21:56:40.444714] [INFO ] [REMOTE ] TME: Full fetch complete (76922 records). [2025-10-06T21:56:40.444950] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-06T21:56:40.633484] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-06T21:56:40.829252] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-06T21:56:40.829340] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-06T21:56:40.830509] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-06T21:56:40.830593] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-06T21:56:40.832197] [DEBUG] [LOCAL ] TME: Trimmed 76922 records to 53181 (keeping 200 days of data) [2025-10-06T21:56:41.157606] [DEBUG] [LOCAL ] TME: Primary data saved (53181 records). [2025-10-06T21:56:41.157790] [INFO ] [MAIN ] TME: Full history saved. [2025-10-06T21:56:41.157882] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TME took 40.3s. Estimated remaining: 37m 19s. Rate: 7.1 symbols/min [2025-10-06T21:56:41.326898] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:56:41.356914] [DEBUG] [LOCAL ] TNET: Loaded 28898 existing records from primary storage. [2025-10-06T21:56:41.357225] [INFO ] [MAIN ] TNET: Loaded 28898 existing records. [2025-10-06T21:56:41.430842] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-06T21:56:41.569029] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:56:41.564660] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T21:56:41.572505] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-06T21:56:41.572754] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-06T21:56:41.578529] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-06T21:56:41.578796] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-06T21:56:41.688172] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T21:56:41.945636] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:56:42.225552] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-06T21:56:43.025554] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-06T21:56:43.528844] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-06T21:56:43.825483] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-06T21:56:43.894749] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-06T21:56:43.924859] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T21:56:44.625557] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-06T21:56:45.425574] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-06T21:56:45.737905] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-06T21:56:45.775330] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-06T21:56:46.225534] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-06T21:56:46.811475] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T21:56:47.025635] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-06T21:56:47.558624] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T21:56:47.825545] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-06T21:56:48.626500] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-06T21:56:48.629370] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T21:56:49.223872] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T21:56:49.425517] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-06T21:56:49.772468] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-06T21:56:50.225556] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-06T21:56:51.025560] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-06T21:56:51.213851] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T21:56:51.709872] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T21:56:51.825479] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-06T21:56:52.027559] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T21:56:52.030124] [INFO ] [REMOTE ] TMHC: Full fetch complete (65938 records). [2025-10-06T21:56:52.030269] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-06T21:56:52.410705] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-06T21:56:52.410809] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-06T21:56:52.411856] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-06T21:56:52.411918] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-06T21:56:52.413151] [DEBUG] [LOCAL ] TMHC: Trimmed 65938 records to 45310 (keeping 200 days of data) [2025-10-06T21:56:52.626806] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-06T21:56:52.678987] [DEBUG] [LOCAL ] TMHC: Primary data saved (45310 records). [2025-10-06T21:56:52.679123] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-06T21:56:52.679207] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TMHC took 34.3s. Estimated remaining: 37m 11s. Rate: 7.1 symbols/min [2025-10-06T21:56:52.853920] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:56:52.854138] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-06T21:56:52.854194] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-06T21:56:52.854333] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-06T21:56:52.854401] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-06T21:56:52.854458] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-06T21:56:52.854495] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-06T21:56:53.198810] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-06T21:56:53.233423] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:56:53.425484] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-06T21:56:53.731851] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-06T21:56:54.225523] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-06T21:56:54.288240] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-06T21:56:55.025493] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-06T21:56:55.325226] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-06T21:56:55.825527] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-06T21:56:56.342977] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T21:56:56.490716] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-06T21:56:56.625504] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-06T21:56:57.425549] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-06T21:56:57.635083] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T21:56:57.635553] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-06T21:56:57.635670] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T21:56:57.635763] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-06T21:56:57.635828] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T21:56:57.635914] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-06T21:56:57.636078] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-06T21:56:57.636193] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-06T21:56:57.636279] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-06T21:56:57.636372] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TNGY took 5.0s. Estimated remaining: 37m 2s. Rate: 7.1 symbols/min [2025-10-06T21:56:57.810207] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:56:57.851019] [DEBUG] [LOCAL ] TNK: Loaded 35616 existing records from primary storage. [2025-10-06T21:56:57.851335] [INFO ] [MAIN ] TNK: Loaded 35616 existing records. [2025-10-06T21:56:57.996345] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-06T21:56:58.055035] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:56:58.055217] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-06T21:56:58.055263] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-06T21:56:58.055476] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-06T21:56:58.055533] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-06T21:56:58.225557] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-06T21:56:58.407106] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:56:59.025526] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-06T21:56:59.271922] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-06T21:56:59.825519] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-06T21:57:00.406595] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-06T21:57:00.625510] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-06T21:57:01.425486] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-06T21:57:01.891159] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-06T21:57:01.998579] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-06T21:57:02.225591] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-06T21:57:02.994094] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T21:57:03.025539] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-06T21:57:03.092695] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-06T21:57:03.825536] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-06T21:57:04.625607] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-06T21:57:04.778164] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T21:57:04.923580] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-06T21:57:05.425501] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-06T21:57:05.480582] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-06T21:57:05.482449] [INFO ] [REMOTE ] TNET: Full fetch complete (41625 records). [2025-10-06T21:57:05.482535] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-06T21:57:05.855343] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-06T21:57:05.855433] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-06T21:57:05.856381] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-06T21:57:05.856460] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-06T21:57:05.857456] [DEBUG] [LOCAL ] TNET: Trimmed 41625 records to 28367 (keeping 200 days of data) [2025-10-06T21:57:06.036036] [DEBUG] [LOCAL ] TNET: Primary data saved (28367 records). [2025-10-06T21:57:06.036219] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-06T21:57:06.036348] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TNET took 24.9s. Estimated remaining: 36m 54s. Rate: 7.1 symbols/min [2025-10-06T21:57:06.181096] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-06T21:57:06.233628] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-06T21:57:06.238026] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:57:06.279859] [DEBUG] [LOCAL ] TNL: Loaded 42274 existing records from primary storage. [2025-10-06T21:57:06.280197] [INFO ] [MAIN ] TNL: Loaded 42274 existing records. [2025-10-06T21:57:06.453984] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:57:06.454241] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-06T21:57:06.454287] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-06T21:57:06.454493] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-06T21:57:06.454550] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-06T21:57:06.817039] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:57:07.025566] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-06T21:57:07.752066] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T21:57:07.825565] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-06T21:57:08.506530] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T21:57:08.625528] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-06T21:57:09.330073] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T21:57:09.425514] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-06T21:57:10.225557] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-06T21:57:10.564072] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-06T21:57:10.875150] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-06T21:57:11.025519] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-06T21:57:11.717023] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T21:57:11.825508] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-06T21:57:12.430245] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T21:57:12.625548] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-06T21:57:13.290263] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T21:57:13.291536] [INFO ] [REMOTE ] TNC: Full fetch complete (22781 records). [2025-10-06T21:57:13.291613] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-06T21:57:13.427057] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-06T21:57:13.497205] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T21:57:13.707264] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-06T21:57:13.707349] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-06T21:57:13.707906] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-06T21:57:13.707968] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-06T21:57:13.708692] [DEBUG] [LOCAL ] TNC: Trimmed 22781 records to 14740 (keeping 200 days of data) [2025-10-06T21:57:13.807144] [DEBUG] [LOCAL ] TNC: Primary data saved (14740 records). [2025-10-06T21:57:13.807331] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-06T21:57:13.807432] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TNC took 37.8s. Estimated remaining: 36m 45s. Rate: 7.1 symbols/min [2025-10-06T21:57:13.987447] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:57:14.049950] [DEBUG] [LOCAL ] TOL: Loaded 51534 existing records from primary storage. [2025-10-06T21:57:14.050359] [INFO ] [MAIN ] TOL: Loaded 51534 existing records. [2025-10-06T21:57:14.224794] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:57:14.225000] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-06T21:57:14.225046] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-06T21:57:14.225409] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-06T21:57:14.225466] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-06T21:57:14.225506] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-06T21:57:14.581979] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:57:14.769010] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-06T21:57:14.772211] [INFO ] [REMOTE ] TMO: Full fetch complete (75505 records). [2025-10-06T21:57:14.772333] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-06T21:57:15.040267] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-06T21:57:15.190713] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-06T21:57:15.197611] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-06T21:57:15.210790] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-06T21:57:15.212281] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T21:57:15.211466] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-06T21:57:15.222049] [DEBUG] [LOCAL ] TMO: Trimmed 75505 records to 52412 (keeping 200 days of data) [2025-10-06T21:57:15.559921] [DEBUG] [LOCAL ] TMO: Primary data saved (52412 records). [2025-10-06T21:57:15.560089] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-06T21:57:15.560176] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TMO took 49.9s. Estimated remaining: 36m 36s. Rate: 7.1 symbols/min [2025-10-06T21:57:15.729337] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:57:15.783419] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-10-06T21:57:15.783832] [INFO ] [MAIN ] TOST: Loaded 54461 existing records. [2025-10-06T21:57:15.830823] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-06T21:57:15.964082] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:57:15.964350] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-06T21:57:15.964397] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-06T21:57:15.964699] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-06T21:57:15.964757] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-06T21:57:16.339466] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:57:16.625547] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-06T21:57:16.941754] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T21:57:17.224095] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T21:57:17.425555] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-06T21:57:18.225550] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-06T21:57:18.571136] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-06T21:57:19.025513] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-06T21:57:19.234832] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-06T21:57:19.295804] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T21:57:19.825552] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-06T21:57:20.625489] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-06T21:57:21.050171] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-06T21:57:21.425517] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-06T21:57:21.598867] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T21:57:22.223546] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T21:57:22.232546] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-06T21:57:23.025512] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-06T21:57:23.233801] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T21:57:23.825495] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-06T21:57:24.162899] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-06T21:57:24.618279] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T21:57:24.627470] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-06T21:57:25.425501] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-06T21:57:25.458239] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T21:57:26.016703] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T21:57:26.225515] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-06T21:57:26.798439] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-06T21:57:27.025544] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-06T21:57:27.825506] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-06T21:57:28.072156] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-06T21:57:28.170440] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T21:57:28.172505] [INFO ] [REMOTE ] TNK: Full fetch complete (51815 records). [2025-10-06T21:57:28.172595] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-06T21:57:28.553782] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-06T21:57:28.554341] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-06T21:57:28.556131] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-06T21:57:28.556202] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-06T21:57:28.559141] [DEBUG] [LOCAL ] TNK: Trimmed 51815 records to 35140 (keeping 200 days of data) [2025-10-06T21:57:28.650821] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-06T21:57:28.791497] [DEBUG] [LOCAL ] TNK: Primary data saved (35140 records). [2025-10-06T21:57:28.791738] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-06T21:57:28.791917] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNK took 31.2s. Estimated remaining: 36m 28s. Rate: 7.1 symbols/min [2025-10-06T21:57:28.975549] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:57:29.006027] [DEBUG] [LOCAL ] TPB: Loaded 25596 existing records from primary storage. [2025-10-06T21:57:29.006380] [INFO ] [MAIN ] TPB: Loaded 25596 existing records. [2025-10-06T21:57:29.200633] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:57:29.200955] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-06T21:57:29.201012] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-06T21:57:29.201278] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-06T21:57:29.201339] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-06T21:57:29.437603] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-06T21:57:29.581986] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:57:29.702196] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-06T21:57:29.800257] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T21:57:30.225551] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-06T21:57:31.032853] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-06T21:57:31.038834] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T21:57:31.327131] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T21:57:31.825543] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-06T21:57:32.625558] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-06T21:57:32.945026] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T21:57:32.986853] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-06T21:57:33.425544] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-06T21:57:34.225493] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-06T21:57:34.598070] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-06T21:57:35.025539] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-06T21:57:35.370607] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-06T21:57:35.748288] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T21:57:35.825473] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-06T21:57:36.625502] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-06T21:57:36.701232] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T21:57:37.430598] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-06T21:57:37.442016] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T21:57:37.476119] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-06T21:57:38.225611] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-06T21:57:39.025625] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-06T21:57:39.643375] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-06T21:57:39.761214] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-06T21:57:39.825479] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-06T21:57:40.548182] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T21:57:40.625578] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-06T21:57:41.383826] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T21:57:41.425498] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-06T21:57:41.755209] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T21:57:42.225549] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-06T21:57:42.296338] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T21:57:42.299368] [INFO ] [REMOTE ] TNL: Full fetch complete (59040 records). [2025-10-06T21:57:42.299490] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-06T21:57:42.730374] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-06T21:57:42.730519] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-06T21:57:42.732490] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-06T21:57:42.732558] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-06T21:57:42.734169] [DEBUG] [LOCAL ] TNL: Trimmed 59040 records to 41732 (keeping 200 days of data) [2025-10-06T21:57:43.020691] [DEBUG] [LOCAL ] TNL: Primary data saved (41732 records). [2025-10-06T21:57:43.020875] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-06T21:57:43.020974] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TNL took 37.0s. Estimated remaining: 36m 21s. Rate: 7.1 symbols/min [2025-10-06T21:57:43.032259] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-06T21:57:43.207838] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:57:43.249940] [DEBUG] [LOCAL ] TPC: Loaded 39333 existing records from primary storage. [2025-10-06T21:57:43.255684] [INFO ] [MAIN ] TPC: Loaded 39333 existing records. [2025-10-06T21:57:43.294438] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T21:57:43.441106] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:57:43.441320] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-06T21:57:43.441369] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-06T21:57:43.441704] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-06T21:57:43.441761] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-06T21:57:43.794066] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:57:43.825504] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-06T21:57:44.360632] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-06T21:57:44.365629] [INFO ] [REMOTE ] TOL: Full fetch complete (73703 records). [2025-10-06T21:57:44.365932] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-06T21:57:44.630922] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-06T21:57:44.771950] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-06T21:57:44.772044] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-06T21:57:44.773343] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-06T21:57:44.773410] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-06T21:57:44.775204] [DEBUG] [LOCAL ] TOL: Trimmed 73703 records to 50761 (keeping 200 days of data) [2025-10-06T21:57:45.143112] [DEBUG] [LOCAL ] TOL: Primary data saved (50761 records). [2025-10-06T21:57:45.143340] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-06T21:57:45.143525] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TOL took 31.3s. Estimated remaining: 36m 11s. Rate: 7.1 symbols/min [2025-10-06T21:57:45.335586] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:57:45.386426] [DEBUG] [LOCAL ] TPH: Loaded 45572 existing records from primary storage. [2025-10-06T21:57:45.386861] [INFO ] [MAIN ] TPH: Loaded 45572 existing records. [2025-10-06T21:57:45.431943] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-06T21:57:45.576450] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:57:45.577086] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-06T21:57:45.577144] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-06T21:57:45.577414] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-06T21:57:45.577474] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-06T21:57:46.059637] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:57:46.066766] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-06T21:57:46.092433] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-06T21:57:46.225486] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-06T21:57:46.901222] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-06T21:57:47.025495] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-06T21:57:47.401789] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T21:57:47.825523] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-06T21:57:48.237346] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-06T21:57:48.625565] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-06T21:57:49.361052] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-06T21:57:49.425489] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-06T21:57:49.533697] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-06T21:57:50.225635] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-06T21:57:50.522129] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T21:57:51.025602] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-06T21:57:51.254519] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T21:57:51.825559] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-06T21:57:52.625501] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-06T21:57:52.993617] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-06T21:57:53.313961] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T21:57:53.425544] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-06T21:57:54.024005] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-06T21:57:54.225561] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-06T21:57:55.032765] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-06T21:57:55.038272] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T21:57:55.519147] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T21:57:55.522758] [INFO ] [REMOTE ] TOST: Full fetch complete (77699 records). [2025-10-06T21:57:55.522937] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-06T21:57:55.838065] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-06T21:57:56.086782] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-06T21:57:56.086924] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-06T21:57:56.088634] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-06T21:57:56.088742] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-06T21:57:56.090710] [DEBUG] [LOCAL ] TOST: Trimmed 77699 records to 53682 (keeping 200 days of data) [2025-10-06T21:57:56.460547] [DEBUG] [LOCAL ] TOST: Primary data saved (53682 records). [2025-10-06T21:57:56.460932] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-06T21:57:56.461036] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TOST took 40.9s. Estimated remaining: 36m 3s. Rate: 7.1 symbols/min [2025-10-06T21:57:56.667367] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:57:56.667438] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-06T21:57:56.669448] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T21:57:56.670227] [DEBUG] [LOCAL ] TPL: No existing data file found in primary storage. [2025-10-06T21:57:56.678127] [WARN ] [MAIN ] TPL: No existing data found, performing full refresh instead. [2025-10-06T21:57:56.678991] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-06T21:57:56.679225] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-06T21:57:56.679706] [DEBUG] [LOCAL ] TPL: No primary data file found to delete. [2025-10-06T21:57:56.679769] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-06T21:57:57.051589] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:57:57.425509] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-06T21:57:57.602392] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T21:57:57.980180] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T21:57:58.225534] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-06T21:57:58.548439] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T21:57:59.025503] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-06T21:57:59.287846] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T21:57:59.290518] [INFO ] [REMOTE ] TPB: Full fetch complete (35386 records). [2025-10-06T21:57:59.290610] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-06T21:57:59.704982] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-06T21:57:59.705095] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-06T21:57:59.705878] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-06T21:57:59.705943] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-06T21:57:59.706793] [DEBUG] [LOCAL ] TPB: Trimmed 35386 records to 25415 (keeping 200 days of data) [2025-10-06T21:57:59.825822] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-06T21:57:59.884911] [DEBUG] [LOCAL ] TPB: Primary data saved (25415 records). [2025-10-06T21:57:59.885078] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-06T21:57:59.885172] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TPB took 31.1s. Estimated remaining: 35m 54s. Rate: 7.1 symbols/min [2025-10-06T21:58:00.061237] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:58:00.123603] [DEBUG] [LOCAL ] TPR: Loaded 54234 existing records from primary storage. [2025-10-06T21:58:00.124089] [INFO ] [MAIN ] TPR: Loaded 54234 existing records. [2025-10-06T21:58:00.327985] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:58:00.328435] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-06T21:58:00.328498] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-06T21:58:00.328923] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-06T21:58:00.328984] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-06T21:58:00.636747] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-06T21:58:00.729416] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:58:00.732068] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T21:58:01.418547] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T21:58:01.426964] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-06T21:58:01.845928] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-06T21:58:02.225542] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-06T21:58:03.025542] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-06T21:58:03.096057] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T21:58:03.644863] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-06T21:58:03.825561] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-06T21:58:03.973024] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T21:58:04.625584] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-06T21:58:05.352986] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-06T21:58:05.425548] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-06T21:58:05.854129] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-06T21:58:06.225581] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-06T21:58:07.025495] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-06T21:58:07.238262] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-06T21:58:07.239490] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T21:58:07.825551] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-06T21:58:08.625577] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-06T21:58:08.786455] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T21:58:08.814996] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T21:58:09.425569] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-06T21:58:09.881523] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T21:58:10.225562] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-06T21:58:10.496161] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T21:58:11.025570] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-06T21:58:11.702938] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T21:58:11.825564] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-06T21:58:12.625599] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-06T21:58:12.629111] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T21:58:13.367463] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T21:58:13.425512] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-06T21:58:14.213681] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T21:58:14.225471] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-06T21:58:14.688016] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T21:58:14.691078] [INFO ] [REMOTE ] TPH: Full fetch complete (64914 records). [2025-10-06T21:58:14.691264] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-06T21:58:15.033225] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-06T21:58:15.095205] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-06T21:58:15.095535] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-06T21:58:15.097149] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-06T21:58:15.097217] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-06T21:58:15.098856] [DEBUG] [LOCAL ] TPH: Trimmed 64914 records to 44873 (keeping 200 days of data) [2025-10-06T21:58:15.199107] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T21:58:15.378623] [DEBUG] [LOCAL ] TPH: Primary data saved (44873 records). [2025-10-06T21:58:15.378800] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-06T21:58:15.378893] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPH took 30.2s. Estimated remaining: 35m 47s. Rate: 7.1 symbols/min [2025-10-06T21:58:15.825534] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-06T21:58:16.178074] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T21:58:16.180686] [INFO ] [REMOTE ] TPC: Full fetch complete (55364 records). [2025-10-06T21:58:16.180783] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-06T21:58:16.590172] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-06T21:58:16.590269] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-06T21:58:16.591266] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-06T21:58:16.591331] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-06T21:58:16.592673] [DEBUG] [LOCAL ] TPC: Trimmed 55364 records to 38891 (keeping 200 days of data) [2025-10-06T21:58:16.639901] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-06T21:58:16.802846] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-06T21:58:16.840297] [DEBUG] [LOCAL ] TPC: Primary data saved (38891 records). [2025-10-06T21:58:16.840500] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-06T21:58:16.840600] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPC took 33.8s. Estimated remaining: 35m 37s. Rate: 7.1 symbols/min [2025-10-06T21:58:17.425555] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-06T21:58:18.552469] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T21:58:18.566996] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T21:58:18.583260] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-06T21:58:19.025699] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-06T21:58:19.962512] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-06T21:58:19.965673] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-06T21:58:20.394452] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T21:58:20.625567] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-06T21:58:20.770738] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-06T21:58:21.425618] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-06T21:58:21.710221] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-06T21:58:21.711431] [INFO ] [REMOTE ] TPL: Full fetch complete (17726 records). [2025-10-06T21:58:21.711575] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-06T21:58:22.115531] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-06T21:58:22.115609] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-06T21:58:22.116003] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-06T21:58:22.116063] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-06T21:58:22.116601] [DEBUG] [LOCAL ] TPL: Trimmed 17726 records to 12376 (keeping 200 days of data) [2025-10-06T21:58:22.197028] [DEBUG] [LOCAL ] TPL: Primary data saved (12376 records). [2025-10-06T21:58:22.197182] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-06T21:58:22.197259] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPL took 25.7s. Estimated remaining: 35m 29s. Rate: 7.1 symbols/min [2025-10-06T21:58:22.432693] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T21:58:22.444061] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-06T21:58:24.309911] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-06T21:58:24.321426] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-06T21:58:26.328176] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-06T21:58:26.340660] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-06T21:58:28.336123] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-06T21:58:28.348887] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-06T21:58:30.170046] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T21:58:30.181946] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-06T21:58:31.650893] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-06T21:58:31.654476] [INFO ] [REMOTE ] TPR: Full fetch complete (77413 records). [2025-10-06T21:58:31.654661] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-06T21:58:32.120911] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-06T21:58:32.121035] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-06T21:58:32.122693] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-06T21:58:32.122789] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-06T21:58:32.124995] [DEBUG] [LOCAL ] TPR: Trimmed 77413 records to 53453 (keeping 200 days of data) [2025-10-06T21:58:32.492859] [DEBUG] [LOCAL ] TPR: Primary data saved (53453 records). [2025-10-06T21:58:32.493072] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-06T21:58:32.493178] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 32.6s. Estimated remaining: 35m 20s. Rate: 7.1 symbols/min [2025-10-06T21:58:33.182776] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:58:33.214553] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:58:33.323983] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:58:33.330602] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:58:33.351484] [DEBUG] [LOCAL ] TPZ: Loaded 4989 existing records from primary storage. [2025-10-06T21:58:33.352169] [INFO ] [MAIN ] TPZ: Loaded 4989 existing records. [2025-10-06T21:58:33.426479] [DEBUG] [LOCAL ] TPYP: Loaded 8005 existing records from primary storage. [2025-10-06T21:58:33.442720] [INFO ] [MAIN ] TPYP: Loaded 8005 existing records. [2025-10-06T21:58:33.442238] [DEBUG] [LOCAL ] TR: Loaded 18821 existing records from primary storage. [2025-10-06T21:58:33.462033] [INFO ] [MAIN ] TR: Loaded 18821 existing records. [2025-10-06T21:58:33.716591] [DEBUG] [LOCAL ] TPVG: Loaded 27322 existing records from primary storage. [2025-10-06T21:58:33.754822] [INFO ] [MAIN ] TPVG: Loaded 27322 existing records. [2025-10-06T21:58:33.835980] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:58:33.885835] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-06T21:58:33.987208] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-06T21:58:34.088141] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-06T21:58:34.057824] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:58:34.109944] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-06T21:58:34.139755] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:58:34.177396] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-06T21:58:34.135772] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-06T21:58:34.213882] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-06T21:58:34.240950] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-06T21:58:34.252125] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-06T21:58:34.251969] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-06T21:58:34.375747] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-06T21:58:34.380237] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:58:34.424117] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-06T21:58:34.413258] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-06T21:58:34.440225] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-06T21:58:34.578607] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-06T21:58:34.650671] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-06T21:58:35.609821] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:58:35.662921] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-06T21:58:35.769164] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:58:35.793820] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-06T21:58:35.793032] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:58:35.812053] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-06T21:58:35.888801] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:58:35.889246] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-06T21:58:36.456145] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-06T21:58:36.458684] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-06T21:58:36.606795] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-06T21:58:36.609875] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-06T21:58:36.686306] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T21:58:36.689821] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-06T21:58:37.010814] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-06T21:58:37.019322] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-06T21:58:37.340585] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T21:58:37.344029] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-06T21:58:37.440812] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T21:58:37.444226] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-06T21:58:37.637343] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T21:58:37.641340] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-06T21:58:37.989382] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T21:58:37.995565] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-06T21:58:38.037148] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-06T21:58:38.039667] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-06T21:58:38.206383] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T21:58:38.209367] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-06T21:58:38.259484] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-06T21:58:38.263212] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-06T21:58:38.779717] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T21:58:38.782941] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-06T21:58:38.905732] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-06T21:58:38.906889] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-06T21:58:38.995301] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-06T21:58:39.025553] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-06T21:58:39.491331] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-06T21:58:39.582846] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-06T21:58:39.825540] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-06T21:58:40.430838] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-06T21:58:40.625559] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-06T21:58:41.189703] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-06T21:58:41.425560] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-06T21:58:42.225557] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-06T21:58:42.424630] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-06T21:58:43.025587] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-06T21:58:43.612170] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T21:58:43.825509] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-06T21:58:43.868798] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-06T21:58:44.625539] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-06T21:58:45.215011] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-06T21:58:45.352292] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T21:58:45.425522] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-06T21:58:46.225565] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-06T21:58:46.587481] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T21:58:47.025541] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-06T21:58:47.278229] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T21:58:47.576327] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-06T21:58:47.825582] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-06T21:58:48.252320] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T21:58:48.625611] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-06T21:58:49.243877] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-06T21:58:49.425562] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-06T21:58:50.225490] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-06T21:58:50.620770] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T21:58:50.680033] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-06T21:58:51.025594] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-06T21:58:51.825546] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-06T21:58:52.020400] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T21:58:52.625521] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-06T21:58:52.968685] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T21:58:53.079606] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T21:58:53.080758] [INFO ] [REMOTE ] TPZ: Full fetch complete (9209 records). [2025-10-06T21:58:53.080905] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-06T21:58:53.439032] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-06T21:58:53.489896] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-06T21:58:53.490018] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-06T21:58:53.490401] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-06T21:58:53.490466] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-06T21:58:53.491370] [DEBUG] [LOCAL ] TPZ: Trimmed 9209 records to 4838 (keeping 200 days of data) [2025-10-06T21:58:53.526385] [DEBUG] [LOCAL ] TPZ: Primary data saved (4838 records). [2025-10-06T21:58:53.526580] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-06T21:58:53.526709] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPZ took 21.0s. Estimated remaining: 35m 13s. Rate: 7.1 symbols/min [2025-10-06T21:58:53.771695] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:58:53.787683] [DEBUG] [LOCAL ] TRAK: Loaded 9541 existing records from primary storage. [2025-10-06T21:58:53.787985] [INFO ] [MAIN ] TRAK: Loaded 9541 existing records. [2025-10-06T21:58:54.028135] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:58:54.028459] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-06T21:58:54.028515] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-06T21:58:54.028782] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-06T21:58:54.028841] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-06T21:58:54.230898] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-06T21:58:54.294302] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T21:58:54.422436] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:58:55.025668] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-06T21:58:55.596952] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-06T21:58:55.825496] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-06T21:58:56.157917] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-06T21:58:56.625547] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-06T21:58:56.769876] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T21:58:57.351559] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T21:58:57.425553] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-06T21:58:58.225555] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-06T21:58:58.250438] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T21:58:59.025559] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-06T21:58:59.232369] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T21:58:59.234394] [INFO ] [REMOTE ] TPVG: Full fetch complete (40142 records). [2025-10-06T21:58:59.234476] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-06T21:58:59.623278] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-06T21:58:59.623399] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-06T21:58:59.625108] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-06T21:58:59.625178] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-06T21:58:59.626739] [DEBUG] [LOCAL ] TPVG: Trimmed 40142 records to 26934 (keeping 200 days of data) [2025-10-06T21:58:59.803984] [DEBUG] [LOCAL ] TPVG: Primary data saved (26934 records). [2025-10-06T21:58:59.804234] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-06T21:58:59.804356] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TPVG took 27.3s. Estimated remaining: 35m 5s. Rate: 7.1 symbols/min [2025-10-06T21:58:59.837099] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-06T21:58:59.989307] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:59:00.009946] [DEBUG] [LOCAL ] TRC: Loaded 15954 existing records from primary storage. [2025-10-06T21:59:00.010287] [INFO ] [MAIN ] TRC: Loaded 15954 existing records. [2025-10-06T21:59:00.150503] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T21:59:00.221049] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:59:00.221318] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-06T21:59:00.221367] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-06T21:59:00.221597] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-06T21:59:00.221703] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-06T21:59:00.613568] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:59:00.625521] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-06T21:59:00.685501] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T21:59:01.156378] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-06T21:59:01.157547] [INFO ] [REMOTE ] TPYP: Full fetch complete (12536 records). [2025-10-06T21:59:01.157628] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-06T21:59:01.430775] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-06T21:59:01.572885] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-06T21:59:01.573033] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-06T21:59:01.573520] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-06T21:59:01.573597] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-06T21:59:01.574358] [DEBUG] [LOCAL ] TPYP: Trimmed 12536 records to 7900 (keeping 200 days of data) [2025-10-06T21:59:01.630717] [DEBUG] [LOCAL ] TPYP: Primary data saved (7900 records). [2025-10-06T21:59:01.630927] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-06T21:59:01.631048] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TPYP took 29.1s. Estimated remaining: 34m 55s. Rate: 7.1 symbols/min [2025-10-06T21:59:01.825071] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:59:01.879922] [DEBUG] [LOCAL ] TREX: Loaded 50660 existing records from primary storage. [2025-10-06T21:59:01.880349] [INFO ] [MAIN ] TREX: Loaded 50660 existing records. [2025-10-06T21:59:02.072085] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:59:02.072407] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-06T21:59:02.072498] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-06T21:59:02.072822] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-06T21:59:02.072890] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-06T21:59:02.234575] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-06T21:59:02.481022] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:59:02.501458] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-06T21:59:03.025543] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-06T21:59:03.037850] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T21:59:03.825545] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-06T21:59:04.546963] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T21:59:04.625502] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-06T21:59:04.680596] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-06T21:59:05.425532] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-06T21:59:05.950573] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T21:59:05.991408] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-06T21:59:06.225539] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-06T21:59:07.025550] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-06T21:59:07.782217] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T21:59:07.825496] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-06T21:59:07.891176] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T21:59:07.892779] [INFO ] [REMOTE ] TR: Full fetch complete (25316 records). [2025-10-06T21:59:07.892858] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-06T21:59:08.298409] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-06T21:59:08.298547] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-06T21:59:08.299792] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-06T21:59:08.299862] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-06T21:59:08.300960] [DEBUG] [LOCAL ] TR: Trimmed 25316 records to 18711 (keeping 200 days of data) [2025-10-06T21:59:08.422295] [DEBUG] [LOCAL ] TR: Primary data saved (18711 records). [2025-10-06T21:59:08.422505] [INFO ] [MAIN ] TR: Full history saved. [2025-10-06T21:59:08.422611] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TR took 35.9s. Estimated remaining: 34m 47s. Rate: 7.1 symbols/min [2025-10-06T21:59:08.600731] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:59:08.637265] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-06T21:59:08.663012] [DEBUG] [LOCAL ] TRGP: Loaded 51445 existing records from primary storage. [2025-10-06T21:59:08.663444] [INFO ] [MAIN ] TRGP: Loaded 51445 existing records. [2025-10-06T21:59:08.846074] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:59:08.846383] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-06T21:59:08.846434] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-06T21:59:08.846746] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-06T21:59:08.846805] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-06T21:59:09.223094] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:59:09.425505] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-06T21:59:09.564197] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T21:59:09.565158] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T21:59:09.968762] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-06T21:59:10.225558] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-06T21:59:11.025518] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-06T21:59:11.738943] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-06T21:59:11.825499] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-06T21:59:12.021266] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T21:59:12.625590] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-06T21:59:13.396469] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T21:59:13.425532] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-06T21:59:13.568828] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-06T21:59:13.979244] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-06T21:59:14.225599] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-06T21:59:15.025532] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-06T21:59:15.817515] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-06T21:59:15.825484] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-06T21:59:15.955461] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T21:59:16.605406] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-06T21:59:16.625474] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-06T21:59:17.410489] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-06T21:59:17.425473] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-06T21:59:18.078304] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T21:59:18.079856] [INFO ] [REMOTE ] TRAK: Full fetch complete (13492 records). [2025-10-06T21:59:18.079929] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-06T21:59:18.235568] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-06T21:59:18.471138] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-06T21:59:18.471240] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-06T21:59:18.471730] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-06T21:59:18.471899] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-06T21:59:18.472516] [DEBUG] [LOCAL ] TRAK: Trimmed 13492 records to 9451 (keeping 200 days of data) [2025-10-06T21:59:18.537146] [DEBUG] [LOCAL ] TRAK: Primary data saved (9451 records). [2025-10-06T21:59:18.537342] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-06T21:59:18.537449] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TRAK took 25.0s. Estimated remaining: 34m 38s. Rate: 7.1 symbols/min [2025-10-06T21:59:18.725003] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:59:18.767623] [DEBUG] [LOCAL ] TRN: Loaded 37474 existing records from primary storage. [2025-10-06T21:59:18.768034] [INFO ] [MAIN ] TRN: Loaded 37474 existing records. [2025-10-06T21:59:18.954515] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:59:18.954811] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-06T21:59:18.954862] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-06T21:59:18.955222] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-06T21:59:18.955281] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-06T21:59:19.031420] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-06T21:59:19.324850] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:59:19.825512] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-06T21:59:19.872908] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T21:59:20.625530] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-06T21:59:20.726795] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T21:59:20.776781] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-06T21:59:21.425557] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-06T21:59:22.225720] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-06T21:59:22.280181] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T21:59:22.417394] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T21:59:23.025503] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-06T21:59:23.061541] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-06T21:59:23.825597] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-06T21:59:24.625557] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-06T21:59:24.735008] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T21:59:24.799126] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T21:59:25.425700] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-06T21:59:26.229740] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-06T21:59:26.236312] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T21:59:26.883697] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-06T21:59:27.025597] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-06T21:59:27.825911] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-06T21:59:27.965024] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T21:59:28.327878] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-06T21:59:28.625572] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-06T21:59:29.322049] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T21:59:29.425529] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-06T21:59:30.225565] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-06T21:59:30.270050] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T21:59:30.309433] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T21:59:31.025590] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-06T21:59:31.724952] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-06T21:59:31.781217] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T21:59:31.825485] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-06T21:59:32.625513] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-06T21:59:32.804984] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-06T21:59:33.425545] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-06T21:59:34.001820] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T21:59:34.004964] [INFO ] [REMOTE ] TREX: Full fetch complete (71095 records). [2025-10-06T21:59:34.005133] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-06T21:59:34.242433] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-06T21:59:34.402743] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T21:59:34.462362] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-06T21:59:34.462461] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-06T21:59:34.463559] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-06T21:59:34.463630] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-06T21:59:34.465025] [DEBUG] [LOCAL ] TREX: Trimmed 71095 records to 49941 (keeping 200 days of data) [2025-10-06T21:59:34.761135] [DEBUG] [LOCAL ] TREX: Primary data saved (49941 records). [2025-10-06T21:59:34.761324] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-06T21:59:34.761434] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TREX took 33.1s. Estimated remaining: 34m 31s. Rate: 7.1 symbols/min [2025-10-06T21:59:34.946239] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:59:34.989169] [DEBUG] [LOCAL ] TRNO: Loaded 44565 existing records from primary storage. [2025-10-06T21:59:34.989541] [INFO ] [MAIN ] TRNO: Loaded 44565 existing records. [2025-10-06T21:59:35.031955] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-06T21:59:35.173959] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:59:35.174349] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-06T21:59:35.174405] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-06T21:59:35.174742] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-06T21:59:35.174812] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-06T21:59:35.555902] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:59:35.725686] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T21:59:35.825486] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-06T21:59:36.600697] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T21:59:36.625475] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-06T21:59:37.425574] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-06T21:59:37.492848] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T21:59:37.962785] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-06T21:59:38.122439] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T21:59:38.123773] [INFO ] [REMOTE ] TRC: Full fetch complete (22022 records). [2025-10-06T21:59:38.123884] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-06T21:59:38.230760] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-06T21:59:38.497529] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-06T21:59:38.497663] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-06T21:59:38.498276] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-06T21:59:38.498410] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-06T21:59:38.499663] [DEBUG] [LOCAL ] TRC: Trimmed 22022 records to 15620 (keeping 200 days of data) [2025-10-06T21:59:38.596861] [DEBUG] [LOCAL ] TRC: Primary data saved (15620 records). [2025-10-06T21:59:38.597035] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-06T21:59:38.597129] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TRC took 38.8s. Estimated remaining: 34m 22s. Rate: 7.1 symbols/min [2025-10-06T21:59:38.775134] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:59:38.833734] [DEBUG] [LOCAL ] TROX: Loaded 52644 existing records from primary storage. [2025-10-06T21:59:38.834195] [INFO ] [MAIN ] TROX: Loaded 52644 existing records. [2025-10-06T21:59:39.018559] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:59:39.018840] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-06T21:59:39.018889] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-06T21:59:39.019222] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-06T21:59:39.019280] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-06T21:59:39.030690] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-06T21:59:39.382211] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:59:39.825512] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-06T21:59:39.907110] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T21:59:40.625626] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-06T21:59:40.682955] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-06T21:59:40.920528] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T21:59:41.425586] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-06T21:59:41.998476] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-06T21:59:42.225601] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-06T21:59:42.981944] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T21:59:43.025511] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-06T21:59:43.660573] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T21:59:43.825536] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-06T21:59:44.625498] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-06T21:59:44.792258] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T21:59:45.296830] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T21:59:45.425514] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-06T21:59:46.092269] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T21:59:46.225498] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-06T21:59:46.899587] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T21:59:47.025550] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-06T21:59:47.327289] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T21:59:47.591577] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T21:59:47.594592] [INFO ] [REMOTE ] TRGP: Full fetch complete (73522 records). [2025-10-06T21:59:47.594749] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-06T21:59:47.830740] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-06T21:59:47.999581] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-06T21:59:47.999708] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-06T21:59:48.001032] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-06T21:59:48.001098] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-06T21:59:48.002634] [DEBUG] [LOCAL ] TRGP: Trimmed 73522 records to 50742 (keeping 200 days of data) [2025-10-06T21:59:48.331448] [DEBUG] [LOCAL ] TRGP: Primary data saved (50742 records). [2025-10-06T21:59:48.331613] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-06T21:59:48.331751] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRGP took 39.9s. Estimated remaining: 34m 14s. Rate: 7.1 symbols/min [2025-10-06T21:59:48.542377] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:59:48.590857] [DEBUG] [LOCAL ] TRP: Loaded 52867 existing records from primary storage. [2025-10-06T21:59:48.591230] [INFO ] [MAIN ] TRP: Loaded 52867 existing records. [2025-10-06T21:59:48.633420] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-06T21:59:48.782538] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:59:48.782824] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-06T21:59:48.782874] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-06T21:59:48.783163] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-06T21:59:48.783222] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-06T21:59:49.145337] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:59:49.274221] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T21:59:49.423344] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T21:59:49.425484] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-06T21:59:49.425710] [INFO ] [REMOTE ] TRN: Full fetch complete (52853 records). [2025-10-06T21:59:49.426547] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-06T21:59:49.804967] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-06T21:59:49.805050] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-06T21:59:49.805999] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-06T21:59:49.806061] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-06T21:59:49.807169] [DEBUG] [LOCAL ] TRN: Trimmed 52853 records to 36817 (keeping 200 days of data) [2025-10-06T21:59:50.033353] [DEBUG] [LOCAL ] TRN: Primary data saved (36817 records). [2025-10-06T21:59:50.033518] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-06T21:59:50.033609] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRN took 31.5s. Estimated remaining: 34m 4s. Rate: 7.1 symbols/min [2025-10-06T21:59:50.201362] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T21:59:50.234922] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-06T21:59:50.237424] [DEBUG] [LOCAL ] TRTX: Loaded 38021 existing records from primary storage. [2025-10-06T21:59:50.237695] [INFO ] [MAIN ] TRTX: Loaded 38021 existing records. [2025-10-06T21:59:50.415930] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T21:59:50.416113] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-06T21:59:50.416159] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-06T21:59:50.416357] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-06T21:59:50.416396] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-06T21:59:50.778389] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T21:59:50.850971] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-06T21:59:51.025517] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-06T21:59:51.825515] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-06T21:59:52.147595] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T21:59:52.484803] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T21:59:52.625547] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-06T21:59:52.941930] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T21:59:53.425568] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-06T21:59:53.549536] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-06T21:59:54.225551] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-06T21:59:55.025495] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-06T21:59:55.143370] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T21:59:55.825505] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-06T21:59:55.905957] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T21:59:56.319174] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-06T21:59:56.625542] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-06T21:59:57.191317] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-06T21:59:57.425552] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-06T21:59:58.225590] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-06T21:59:58.378130] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T21:59:58.865171] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T21:59:59.025535] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-06T21:59:59.826212] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-06T21:59:59.833796] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T22:00:00.514922] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T22:00:00.625498] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-06T22:00:01.425510] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-06T22:00:01.471414] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T22:00:02.230618] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-06T22:00:02.251612] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T22:00:02.897208] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T22:00:03.025555] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-06T22:00:03.825536] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-06T22:00:04.006535] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T22:00:04.610133] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T22:00:04.625550] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-06T22:00:05.201478] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T22:00:05.425535] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-06T22:00:06.225551] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-06T22:00:06.305559] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T22:00:07.025542] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-06T22:00:07.239692] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T22:00:07.825531] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-06T22:00:08.002788] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T22:00:08.402834] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T22:00:08.625555] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-06T22:00:09.425510] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-06T22:00:09.707829] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T22:00:10.108298] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T22:00:10.225558] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-06T22:00:11.025575] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-06T22:00:11.381782] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T22:00:11.384229] [INFO ] [REMOTE ] TRTX: Full fetch complete (53406 records). [2025-10-06T22:00:11.384345] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-06T22:00:11.805269] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-06T22:00:11.805457] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-06T22:00:11.806490] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-06T22:00:11.806606] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-06T22:00:11.809536] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-06T22:00:11.822587] [DEBUG] [LOCAL ] TRTX: Trimmed 53406 records to 37492 (keeping 200 days of data) [2025-10-06T22:00:11.873768] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-06T22:00:12.048773] [DEBUG] [LOCAL ] TRTX: Primary data saved (37492 records). [2025-10-06T22:00:12.048945] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-06T22:00:12.049035] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRTX took 22.0s. Estimated remaining: 33m 58s. Rate: 7.1 symbols/min [2025-10-06T22:00:12.214497] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:00:12.263075] [DEBUG] [LOCAL ] TRU: Loaded 52018 existing records from primary storage. [2025-10-06T22:00:12.263434] [INFO ] [MAIN ] TRU: Loaded 52018 existing records. [2025-10-06T22:00:12.441479] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:00:12.441786] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-06T22:00:12.441839] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-06T22:00:12.442093] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-06T22:00:12.442150] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-06T22:00:12.634161] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-06T22:00:12.812772] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:00:12.850294] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T22:00:13.425550] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-06T22:00:13.498497] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T22:00:14.225591] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-06T22:00:14.445683] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-06T22:00:15.025525] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-06T22:00:15.199907] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T22:00:15.524128] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-06T22:00:15.825528] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-06T22:00:16.625510] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-06T22:00:16.844361] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-06T22:00:17.425569] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-06T22:00:17.475133] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-06T22:00:18.114406] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T22:00:18.116961] [INFO ] [REMOTE ] TRNO: Full fetch complete (63584 records). [2025-10-06T22:00:18.117055] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-06T22:00:18.230750] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-06T22:00:18.502710] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-06T22:00:18.502818] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-06T22:00:18.503884] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-06T22:00:18.503949] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-06T22:00:18.505384] [DEBUG] [LOCAL ] TRNO: Trimmed 63584 records to 43997 (keeping 200 days of data) [2025-10-06T22:00:18.788850] [DEBUG] [LOCAL ] TRNO: Primary data saved (43997 records). [2025-10-06T22:00:18.789036] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-06T22:00:18.789146] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TRNO took 44.0s. Estimated remaining: 33m 49s. Rate: 7.1 symbols/min [2025-10-06T22:00:18.965432] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:00:19.013458] [DEBUG] [LOCAL ] TRV: Loaded 48438 existing records from primary storage. [2025-10-06T22:00:19.013852] [INFO ] [MAIN ] TRV: Loaded 48438 existing records. [2025-10-06T22:00:19.030844] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-06T22:00:19.201669] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:00:19.202137] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-06T22:00:19.202216] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-06T22:00:19.202541] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-06T22:00:19.202696] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-06T22:00:19.433512] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-06T22:00:19.624846] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:00:19.825509] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-06T22:00:19.985566] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T22:00:20.561843] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-06T22:00:20.565155] [INFO ] [REMOTE ] TROX: Full fetch complete (73285 records). [2025-10-06T22:00:20.565325] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-06T22:00:20.630722] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-06T22:00:20.963995] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-06T22:00:20.964107] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-06T22:00:20.965387] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-06T22:00:20.965457] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-06T22:00:20.967472] [DEBUG] [LOCAL ] TROX: Trimmed 73285 records to 51930 (keeping 200 days of data) [2025-10-06T22:00:21.286210] [DEBUG] [LOCAL ] TROX: Primary data saved (51930 records). [2025-10-06T22:00:21.286351] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-06T22:00:21.286442] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TROX took 42.7s. Estimated remaining: 33m 40s. Rate: 7.1 symbols/min [2025-10-06T22:00:21.485405] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T22:00:21.435374] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-06T22:00:21.483912] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:00:21.549759] [DEBUG] [LOCAL ] TS: Loaded 52451 existing records from primary storage. [2025-10-06T22:00:21.550150] [INFO ] [MAIN ] TS: Loaded 52451 existing records. [2025-10-06T22:00:21.729937] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:00:21.730197] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-06T22:00:21.730245] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-06T22:00:21.730827] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-06T22:00:21.730885] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-06T22:00:22.098861] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:00:22.225493] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-06T22:00:22.372283] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T22:00:23.025519] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-06T22:00:23.264215] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-06T22:00:23.825501] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-06T22:00:23.941470] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T22:00:24.625510] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-06T22:00:24.780282] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T22:00:25.315315] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T22:00:25.425538] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-06T22:00:26.063785] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T22:00:26.225580] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-06T22:00:27.000541] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T22:00:27.025527] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-06T22:00:27.825490] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-06T22:00:27.924988] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T22:00:28.625493] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-06T22:00:28.709614] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T22:00:29.425601] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-06T22:00:29.634923] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-06T22:00:29.954856] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-06T22:00:30.225536] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-06T22:00:31.025498] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-06T22:00:31.444108] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-06T22:00:31.835228] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-06T22:00:31.857230] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T22:00:32.116896] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T22:00:32.119911] [INFO ] [REMOTE ] TRP: Full fetch complete (75562 records). [2025-10-06T22:00:32.120038] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-06T22:00:32.510604] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-06T22:00:32.510738] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-06T22:00:32.511927] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-06T22:00:32.511992] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-06T22:00:32.513614] [DEBUG] [LOCAL ] TRP: Trimmed 75562 records to 52121 (keeping 200 days of data) [2025-10-06T22:00:32.625584] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-06T22:00:32.839859] [DEBUG] [LOCAL ] TRP: Primary data saved (52121 records). [2025-10-06T22:00:32.840042] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-06T22:00:32.840152] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRP took 44.5s. Estimated remaining: 33m 32s. Rate: 7.1 symbols/min [2025-10-06T22:00:33.005813] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:00:33.034833] [DEBUG] [LOCAL ] TSE: Loaded 28482 existing records from primary storage. [2025-10-06T22:00:33.035129] [INFO ] [MAIN ] TSE: Loaded 28482 existing records. [2025-10-06T22:00:33.220739] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:00:33.221711] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-06T22:00:33.221917] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-06T22:00:33.222202] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-06T22:00:33.222306] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-06T22:00:33.432557] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-06T22:00:33.510424] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T22:00:33.641320] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:00:34.226708] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-06T22:00:34.453694] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-06T22:00:35.025567] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-06T22:00:35.435111] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-06T22:00:35.539260] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T22:00:35.825545] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-06T22:00:36.384449] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T22:00:36.625607] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-06T22:00:37.425507] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-06T22:00:37.740621] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T22:00:37.855232] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-06T22:00:38.225563] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-06T22:00:38.839130] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T22:00:39.025554] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-06T22:00:39.660458] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T22:00:39.663467] [INFO ] [REMOTE ] TRU: Full fetch complete (73537 records). [2025-10-06T22:00:39.663609] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-06T22:00:39.833761] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-06T22:00:40.049991] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-06T22:00:40.050081] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-06T22:00:40.051273] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-06T22:00:40.051339] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-06T22:00:40.052766] [DEBUG] [LOCAL ] TRU: Trimmed 73537 records to 51302 (keeping 200 days of data) [2025-10-06T22:00:40.379409] [DEBUG] [LOCAL ] TRU: Primary data saved (51302 records). [2025-10-06T22:00:40.379750] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-06T22:00:40.379961] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRU took 28.3s. Estimated remaining: 33m 23s. Rate: 7.1 symbols/min [2025-10-06T22:00:40.554587] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:00:40.594923] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T22:00:40.609671] [DEBUG] [LOCAL ] TSI: Loaded 7412 existing records from primary storage. [2025-10-06T22:00:40.610455] [INFO ] [MAIN ] TSI: Loaded 7412 existing records. [2025-10-06T22:00:40.631173] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-06T22:00:40.793199] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:00:40.793468] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-06T22:00:40.793519] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-06T22:00:40.793704] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-06T22:00:40.793762] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-06T22:00:41.171440] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:00:41.173571] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-06T22:00:41.425559] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-06T22:00:41.988609] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-06T22:00:42.225567] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-06T22:00:42.532302] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-06T22:00:43.025533] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-06T22:00:43.591490] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T22:00:43.825536] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-06T22:00:44.487688] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-06T22:00:44.625590] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-06T22:00:44.687871] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T22:00:45.425579] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-06T22:00:46.225518] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-06T22:00:46.596208] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T22:00:46.672203] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-06T22:00:47.025546] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-06T22:00:47.138899] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-06T22:00:47.825573] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-06T22:00:48.337851] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T22:00:48.625545] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-06T22:00:49.425491] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-06T22:00:49.601342] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T22:00:49.906395] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T22:00:50.225600] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-06T22:00:50.881221] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-06T22:00:51.025586] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-06T22:00:51.151692] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T22:00:51.154814] [INFO ] [REMOTE ] TS: Full fetch complete (74564 records). [2025-10-06T22:00:51.154990] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-06T22:00:51.543272] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-06T22:00:51.543356] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-06T22:00:51.544476] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-06T22:00:51.544554] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-06T22:00:51.546174] [DEBUG] [LOCAL ] TS: Trimmed 74564 records to 51681 (keeping 200 days of data) [2025-10-06T22:00:51.840345] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-06T22:00:51.866272] [DEBUG] [LOCAL ] TS: Primary data saved (51681 records). [2025-10-06T22:00:51.866450] [INFO ] [MAIN ] TS: Full history saved. [2025-10-06T22:00:51.866544] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TS took 30.6s. Estimated remaining: 33m 15s. Rate: 7.1 symbols/min [2025-10-06T22:00:52.037779] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:00:52.076429] [DEBUG] [LOCAL ] TSLX: Loaded 35786 existing records from primary storage. [2025-10-06T22:00:52.076783] [INFO ] [MAIN ] TSLX: Loaded 35786 existing records. [2025-10-06T22:00:52.251153] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:00:52.251398] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-06T22:00:52.251445] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-06T22:00:52.251788] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-06T22:00:52.251854] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-06T22:00:52.635866] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-06T22:00:52.664741] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:00:52.763066] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-06T22:00:52.818049] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T22:00:53.425541] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-06T22:00:53.540579] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-06T22:00:54.225547] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-06T22:00:55.025516] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-06T22:00:55.272100] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-06T22:00:55.452484] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T22:00:55.825547] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-06T22:00:56.300630] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T22:00:56.625513] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-06T22:00:56.682382] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-06T22:00:57.364417] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T22:00:57.425475] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-06T22:00:58.061171] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-06T22:00:58.225547] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-06T22:00:59.025518] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-06T22:00:59.074361] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-06T22:00:59.075933] [INFO ] [REMOTE ] TSE: Full fetch complete (40891 records). [2025-10-06T22:00:59.076015] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-06T22:00:59.456225] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-06T22:00:59.456324] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-06T22:00:59.457198] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-06T22:00:59.457263] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-06T22:00:59.458338] [DEBUG] [LOCAL ] TSE: Trimmed 40891 records to 28026 (keeping 200 days of data) [2025-10-06T22:00:59.621633] [DEBUG] [LOCAL ] TSE: Primary data saved (28026 records). [2025-10-06T22:00:59.621835] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-06T22:00:59.621951] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TSE took 26.8s. Estimated remaining: 33m 6s. Rate: 7.1 symbols/min [2025-10-06T22:00:59.795835] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:00:59.826598] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-06T22:00:59.867469] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T22:00:59.876176] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-10-06T22:00:59.876624] [INFO ] [MAIN ] TSM: Loaded 54599 existing records. [2025-10-06T22:01:00.053101] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:01:00.053342] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-06T22:01:00.053388] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-06T22:01:00.053627] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-06T22:01:00.053717] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-06T22:01:00.423680] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:01:00.580811] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T22:01:00.625487] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-06T22:01:01.407992] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-06T22:01:01.425509] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-06T22:01:02.225586] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-06T22:01:02.255905] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-06T22:01:03.025550] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-06T22:01:03.825533] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-06T22:01:04.283175] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-06T22:01:04.377055] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T22:01:04.625533] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-06T22:01:05.013699] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-10-06T22:01:05.425543] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-06T22:01:06.022414] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-06T22:01:06.024274] [INFO ] [REMOTE ] TSI: Full fetch complete (13390 records). [2025-10-06T22:01:06.024449] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-06T22:01:06.230620] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-06T22:01:06.427875] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-06T22:01:06.428036] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-06T22:01:06.428804] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-06T22:01:06.428994] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-06T22:01:06.429930] [DEBUG] [LOCAL ] TSI: Trimmed 13390 records to 7300 (keeping 200 days of data) [2025-10-06T22:01:06.479610] [DEBUG] [LOCAL ] TSI: Primary data saved (7300 records). [2025-10-06T22:01:06.480170] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-06T22:01:06.480322] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TSI took 26.1s. Estimated remaining: 32m 58s. Rate: 7.1 symbols/min [2025-10-06T22:01:06.572784] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T22:01:06.734274] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:01:06.795904] [DEBUG] [LOCAL ] TSN: Loaded 53681 existing records from primary storage. [2025-10-06T22:01:06.796481] [INFO ] [MAIN ] TSN: Loaded 53681 existing records. [2025-10-06T22:01:06.991353] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:01:06.991638] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-06T22:01:06.991724] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-06T22:01:06.992238] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-06T22:01:06.992299] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-06T22:01:07.030831] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-06T22:01:07.381425] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:01:07.825534] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-06T22:01:08.581095] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T22:01:08.625472] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-06T22:01:08.756008] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-06T22:01:09.429685] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-06T22:01:09.436877] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-06T22:01:10.225560] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-06T22:01:10.313524] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T22:01:11.025542] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-06T22:01:11.491059] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T22:01:11.493713] [INFO ] [REMOTE ] TRV: Full fetch complete (69687 records). [2025-10-06T22:01:11.493818] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-06T22:01:11.844427] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-06T22:01:11.889932] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-06T22:01:11.890077] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-06T22:01:11.891377] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-06T22:01:11.891506] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-06T22:01:11.916722] [DEBUG] [LOCAL ] TRV: Trimmed 69687 records to 47616 (keeping 200 days of data) [2025-10-06T22:01:11.920378] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T22:01:12.079912] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-10-06T22:01:12.272928] [DEBUG] [LOCAL ] TRV: Primary data saved (47616 records). [2025-10-06T22:01:12.273101] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-06T22:01:12.273843] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TRV took 53.5s. Estimated remaining: 32m 49s. Rate: 7.1 symbols/min [2025-10-06T22:01:12.439018] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:01:12.454050] [DEBUG] [LOCAL ] TSQ: Loaded 12138 existing records from primary storage. [2025-10-06T22:01:12.454297] [INFO ] [MAIN ] TSQ: Loaded 12138 existing records. [2025-10-06T22:01:12.628154] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-06T22:01:12.628072] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:01:12.629546] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-06T22:01:12.629602] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-06T22:01:12.629811] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-06T22:01:12.629869] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-06T22:01:12.982056] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:01:13.425534] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-06T22:01:13.641180] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-06T22:01:14.225550] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-06T22:01:14.259793] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-06T22:01:15.025579] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-06T22:01:15.627460] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (3.00 seconds). [2025-10-06T22:01:15.748019] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T22:01:15.815892] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T22:01:15.825467] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-06T22:01:16.606405] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-06T22:01:16.625490] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-06T22:01:17.425544] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-06T22:01:18.068125] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T22:01:18.225532] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-06T22:01:19.025563] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-06T22:01:19.825503] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-06T22:01:20.018544] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T22:01:20.060490] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-06T22:01:20.273876] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-10-06T22:01:20.625534] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-06T22:01:21.297937] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-06T22:01:21.425565] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-06T22:01:21.457384] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-06T22:01:22.225543] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-06T22:01:23.025557] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-06T22:01:23.340480] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T22:01:23.600106] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-06T22:01:23.820292] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T22:01:23.825462] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-06T22:01:24.625495] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-06T22:01:24.862767] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-06T22:01:25.425592] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-06T22:01:26.225598] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-06T22:01:27.025567] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-06T22:01:27.187511] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T22:01:27.312528] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-06T22:01:27.701575] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T22:01:27.716882] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-06T22:01:27.825506] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-06T22:01:28.625500] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-06T22:01:28.899153] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T22:01:28.902094] [INFO ] [REMOTE ] TSLX: Full fetch complete (49604 records). [2025-10-06T22:01:28.902209] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-06T22:01:29.279601] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-06T22:01:29.279715] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-06T22:01:29.280659] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-06T22:01:29.280727] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-06T22:01:29.281885] [DEBUG] [LOCAL ] TSLX: Trimmed 49604 records to 35340 (keeping 200 days of data) [2025-10-06T22:01:29.445808] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-06T22:01:29.501152] [DEBUG] [LOCAL ] TSLX: Primary data saved (35340 records). [2025-10-06T22:01:29.501285] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-06T22:01:29.501370] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSLX took 37.6s. Estimated remaining: 32m 42s. Rate: 7.1 symbols/min [2025-10-06T22:01:29.668286] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:01:29.718095] [DEBUG] [LOCAL ] TT: Loaded 48324 existing records from primary storage. [2025-10-06T22:01:29.718575] [INFO ] [MAIN ] TT: Loaded 48324 existing records. [2025-10-06T22:01:29.894698] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:01:29.894925] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-06T22:01:29.894977] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-06T22:01:29.895247] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-06T22:01:29.895304] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-06T22:01:30.234886] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-06T22:01:30.257972] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:01:31.029565] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-06T22:01:31.031129] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T22:01:31.394216] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-06T22:01:31.457692] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-10-06T22:01:31.825559] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-06T22:01:32.625506] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-06T22:01:32.753897] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T22:01:33.390058] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-06T22:01:33.425480] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-06T22:01:34.225542] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-06T22:01:34.266103] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T22:01:34.267152] [INFO ] [REMOTE ] TSQ: Full fetch complete (16478 records). [2025-10-06T22:01:34.267221] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-06T22:01:34.646977] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-06T22:01:34.647181] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-06T22:01:34.647586] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-06T22:01:34.647822] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-06T22:01:34.649107] [DEBUG] [LOCAL ] TSQ: Trimmed 16478 records to 11828 (keeping 200 days of data) [2025-10-06T22:01:34.732417] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-06T22:01:34.772147] [DEBUG] [LOCAL ] TSQ: Primary data saved (11828 records). [2025-10-06T22:01:34.772273] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-06T22:01:34.772385] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSQ took 22.5s. Estimated remaining: 32m 33s. Rate: 7.1 symbols/min [2025-10-06T22:01:34.938891] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:01:34.939102] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-06T22:01:34.939145] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-06T22:01:34.939285] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-06T22:01:34.939362] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-06T22:01:34.939422] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-06T22:01:34.939455] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-06T22:01:35.030675] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-06T22:01:35.297850] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:01:35.825489] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-06T22:01:36.039213] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T22:01:36.039572] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-06T22:01:36.039709] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:01:36.039800] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-06T22:01:36.039902] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:01:36.040012] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-06T22:01:36.040097] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-06T22:01:36.040134] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-06T22:01:36.040218] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-06T22:01:36.040290] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TTAM took 1.3s. Estimated remaining: 32m 24s. Rate: 7.1 symbols/min [2025-10-06T22:01:36.220569] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:01:36.250794] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-06T22:01:36.298252] [DEBUG] [LOCAL ] TTC: Loaded 42669 existing records from primary storage. [2025-10-06T22:01:36.298622] [INFO ] [MAIN ] TTC: Loaded 42669 existing records. [2025-10-06T22:01:36.478712] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:01:36.478922] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-06T22:01:36.478968] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-06T22:01:36.479203] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-06T22:01:36.479263] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-06T22:01:36.632318] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-06T22:01:36.851097] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:01:36.883184] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T22:01:37.425542] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-06T22:01:38.225543] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-06T22:01:38.972714] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T22:01:39.025510] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-06T22:01:39.449294] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-06T22:01:39.825512] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-06T22:01:40.402041] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-06T22:01:40.590735] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T22:01:40.625479] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-06T22:01:41.425563] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-06T22:01:42.225512] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-06T22:01:42.427703] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T22:01:42.654876] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-06T22:01:43.007749] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-06T22:01:43.025559] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-06T22:01:43.825506] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-06T22:01:44.101412] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-06T22:01:44.625540] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-06T22:01:45.288893] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-06T22:01:45.291999] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-10-06T22:01:45.292176] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-06T22:01:45.427705] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-06T22:01:45.728509] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-06T22:01:45.739219] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-06T22:01:45.740441] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-06T22:01:45.740745] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-06T22:01:45.742945] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T22:01:45.754932] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 53819 (keeping 200 days of data) [2025-10-06T22:01:46.110981] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-10-06T22:01:46.111156] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-06T22:01:46.111280] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSM took 46.5s. Estimated remaining: 32m 15s. Rate: 7.1 symbols/min [2025-10-06T22:01:46.230614] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-06T22:01:46.296847] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:01:46.354819] [DEBUG] [LOCAL ] TTE: Loaded 52372 existing records from primary storage. [2025-10-06T22:01:46.355226] [INFO ] [MAIN ] TTE: Loaded 52372 existing records. [2025-10-06T22:01:46.558158] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:01:46.558710] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-06T22:01:46.558811] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-06T22:01:46.559142] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-06T22:01:46.559205] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-06T22:01:46.675154] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-06T22:01:46.979524] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:01:47.025503] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-06T22:01:47.164168] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T22:01:47.505884] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T22:01:47.508959] [INFO ] [REMOTE ] TSN: Full fetch complete (76356 records). [2025-10-06T22:01:47.509067] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-06T22:01:47.829665] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-06T22:01:47.912670] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-06T22:01:47.912857] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-06T22:01:47.914385] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-06T22:01:47.914475] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-06T22:01:47.916438] [DEBUG] [LOCAL ] TSN: Trimmed 76356 records to 52935 (keeping 200 days of data) [2025-10-06T22:01:48.039808] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T22:01:48.288865] [DEBUG] [LOCAL ] TSN: Primary data saved (52935 records). [2025-10-06T22:01:48.289045] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-06T22:01:48.289133] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TSN took 41.8s. Estimated remaining: 32m 6s. Rate: 7.1 symbols/min [2025-10-06T22:01:48.504982] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:01:48.549158] [DEBUG] [LOCAL ] TTI: Loaded 46351 existing records from primary storage. [2025-10-06T22:01:48.549502] [INFO ] [MAIN ] TTI: Loaded 46351 existing records. [2025-10-06T22:01:48.630731] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-06T22:01:48.728392] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:01:48.728663] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-06T22:01:48.728727] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-06T22:01:48.728955] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-06T22:01:48.729012] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-06T22:01:49.092971] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:01:49.425558] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-06T22:01:49.819336] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-06T22:01:50.225557] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-06T22:01:50.344086] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T22:01:50.956833] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T22:01:51.025583] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-06T22:01:51.825562] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-06T22:01:51.945729] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T22:01:52.619770] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T22:01:52.628874] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-06T22:01:53.425549] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-06T22:01:53.740390] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-06T22:01:54.225565] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-06T22:01:54.401203] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T22:01:54.771353] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T22:01:55.025573] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-06T22:01:55.825533] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-06T22:01:55.887387] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-06T22:01:56.334059] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-06T22:01:56.625521] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-06T22:01:57.353913] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T22:01:57.425522] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-06T22:01:58.225519] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-06T22:01:58.363818] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T22:01:59.032888] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-06T22:01:59.049409] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-06T22:01:59.514101] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T22:01:59.517230] [INFO ] [REMOTE ] TT: Full fetch complete (69812 records). [2025-10-06T22:01:59.517342] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-06T22:01:59.826018] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-06T22:01:59.923894] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-06T22:01:59.924033] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-06T22:01:59.925188] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-06T22:01:59.925269] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-06T22:01:59.927223] [DEBUG] [LOCAL ] TT: Trimmed 69812 records to 47541 (keeping 200 days of data) [2025-10-06T22:02:00.049253] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T22:02:00.274583] [DEBUG] [LOCAL ] TT: Primary data saved (47541 records). [2025-10-06T22:02:00.274803] [INFO ] [MAIN ] TT: Full history saved. [2025-10-06T22:02:00.274956] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TT took 30.8s. Estimated remaining: 31m 58s. Rate: 7.1 symbols/min [2025-10-06T22:02:00.446436] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:02:00.498966] [DEBUG] [LOCAL ] TU: Loaded 50545 existing records from primary storage. [2025-10-06T22:02:00.499382] [INFO ] [MAIN ] TU: Loaded 50545 existing records. [2025-10-06T22:02:00.640858] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-06T22:02:00.683855] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:02:00.684082] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-06T22:02:00.684132] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-06T22:02:00.684367] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-06T22:02:00.684846] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-06T22:02:01.051904] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:02:01.425504] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-06T22:02:01.615393] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-06T22:02:02.225534] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-06T22:02:02.655119] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T22:02:03.025485] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-06T22:02:03.356005] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-06T22:02:03.727509] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T22:02:03.825560] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-06T22:02:04.625520] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-06T22:02:04.704347] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T22:02:05.394386] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T22:02:05.425485] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-06T22:02:06.225587] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-06T22:02:06.256849] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T22:02:06.942987] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T22:02:07.025547] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-06T22:02:07.830723] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-06T22:02:07.845991] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-06T22:02:08.230960] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T22:02:08.233729] [INFO ] [REMOTE ] TTC: Full fetch complete (62208 records). [2025-10-06T22:02:08.233921] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-06T22:02:08.631050] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-06T22:02:08.631228] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-06T22:02:08.630527] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-06T22:02:08.632599] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-06T22:02:08.632957] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-06T22:02:08.634985] [DEBUG] [LOCAL ] TTC: Trimmed 62208 records to 42038 (keeping 200 days of data) [2025-10-06T22:02:08.892438] [DEBUG] [LOCAL ] TTC: Primary data saved (42038 records). [2025-10-06T22:02:08.892585] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-06T22:02:08.892688] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TTC took 32.9s. Estimated remaining: 31m 50s. Rate: 7.1 symbols/min [2025-10-06T22:02:09.059977] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:02:09.103052] [DEBUG] [LOCAL ] TUYA: Loaded 46846 existing records from primary storage. [2025-10-06T22:02:09.103395] [INFO ] [MAIN ] TUYA: Loaded 46846 existing records. [2025-10-06T22:02:09.279309] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:02:09.279611] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-06T22:02:09.279689] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-06T22:02:09.279960] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-06T22:02:09.280019] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-06T22:02:09.426602] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-06T22:02:09.642599] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:02:09.673792] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T22:02:10.225597] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-06T22:02:10.486860] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T22:02:11.034424] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-06T22:02:11.040918] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T22:02:11.665995] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T22:02:11.825582] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-06T22:02:12.625504] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-06T22:02:12.941923] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-06T22:02:13.345058] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T22:02:13.425490] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-06T22:02:14.233992] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-06T22:02:14.240457] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T22:02:15.025554] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-06T22:02:15.242492] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-06T22:02:15.311713] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-06T22:02:15.825524] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-06T22:02:16.187919] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-06T22:02:16.625575] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-06T22:02:17.425528] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-06T22:02:17.864165] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-06T22:02:17.905562] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T22:02:17.908522] [INFO ] [REMOTE ] TTE: Full fetch complete (74985 records). [2025-10-06T22:02:17.908682] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-06T22:02:18.230618] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-06T22:02:18.303676] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-06T22:02:18.303780] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-06T22:02:18.305073] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-06T22:02:18.305142] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-06T22:02:18.306830] [DEBUG] [LOCAL ] TTE: Trimmed 74985 records to 51598 (keeping 200 days of data) [2025-10-06T22:02:18.645575] [DEBUG] [LOCAL ] TTE: Primary data saved (51598 records). [2025-10-06T22:02:18.645782] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-06T22:02:18.645910] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTE took 32.5s. Estimated remaining: 31m 41s. Rate: 7.1 symbols/min [2025-10-06T22:02:18.816254] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:02:18.869438] [DEBUG] [LOCAL ] TV: Loaded 43081 existing records from primary storage. [2025-10-06T22:02:18.869948] [INFO ] [MAIN ] TV: Loaded 43081 existing records. [2025-10-06T22:02:19.030760] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-06T22:02:19.061120] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:02:19.062131] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-06T22:02:19.062435] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-06T22:02:19.062824] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-06T22:02:19.062920] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-06T22:02:19.436963] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-06T22:02:19.456751] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:02:19.825518] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-06T22:02:20.046450] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-06T22:02:20.625489] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-06T22:02:20.830524] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T22:02:21.381176] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T22:02:21.425515] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-06T22:02:22.069301] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-06T22:02:22.225564] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-06T22:02:23.028018] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-06T22:02:23.031468] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T22:02:23.665858] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T22:02:23.825551] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-06T22:02:24.615027] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T22:02:24.625479] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-06T22:02:25.425562] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-06T22:02:25.721029] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T22:02:25.923725] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T22:02:25.926512] [INFO ] [REMOTE ] TTI: Full fetch complete (65520 records). [2025-10-06T22:02:25.926604] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-06T22:02:26.231609] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-06T22:02:26.337125] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-06T22:02:26.337226] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-06T22:02:26.338405] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-06T22:02:26.338482] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-06T22:02:26.339998] [DEBUG] [LOCAL ] TTI: Trimmed 65520 records to 45750 (keeping 200 days of data) [2025-10-06T22:02:26.605538] [DEBUG] [LOCAL ] TTI: Primary data saved (45750 records). [2025-10-06T22:02:26.605727] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-06T22:02:26.605833] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TTI took 38.3s. Estimated remaining: 31m 33s. Rate: 7.1 symbols/min [2025-10-06T22:02:26.789705] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:02:26.795513] [DEBUG] [LOCAL ] TVC: Loaded 3363 existing records from primary storage. [2025-10-06T22:02:26.795726] [INFO ] [MAIN ] TVC: Loaded 3363 existing records. [2025-10-06T22:02:26.977096] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:02:26.977488] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-06T22:02:26.977714] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-06T22:02:26.978017] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-06T22:02:26.978078] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-06T22:02:27.041398] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-06T22:02:27.380464] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T22:02:27.384356] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:02:27.825520] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-06T22:02:27.879299] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T22:02:28.533241] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-06T22:02:28.625505] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-06T22:02:29.425549] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-06T22:02:29.632787] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T22:02:30.174748] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T22:02:30.225489] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-06T22:02:31.025566] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-06T22:02:31.138739] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T22:02:31.515509] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T22:02:31.747140] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-06T22:02:31.825561] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-06T22:02:32.419917] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-06T22:02:32.625526] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-06T22:02:33.425542] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-06T22:02:34.024837] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T22:02:34.209532] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T22:02:34.225497] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-06T22:02:35.025560] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-06T22:02:35.634293] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-06T22:02:35.825585] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-06T22:02:36.003033] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T22:02:36.625595] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-06T22:02:37.203609] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-06T22:02:37.425543] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-06T22:02:37.497673] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T22:02:38.043628] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-06T22:02:38.225863] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-06T22:02:39.025547] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-06T22:02:39.830632] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-06T22:02:39.845331] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T22:02:40.352779] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-06T22:02:40.625523] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-06T22:02:41.425513] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-06T22:02:41.481203] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T22:02:41.908403] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T22:02:41.911265] [INFO ] [REMOTE ] TUYA: Full fetch complete (65954 records). [2025-10-06T22:02:41.911415] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-06T22:02:42.096876] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T22:02:42.230768] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-06T22:02:42.317789] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-06T22:02:42.317874] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-06T22:02:42.319030] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-06T22:02:42.319142] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-06T22:02:42.320598] [DEBUG] [LOCAL ] TUYA: Trimmed 65954 records to 46148 (keeping 200 days of data) [2025-10-06T22:02:42.587479] [DEBUG] [LOCAL ] TUYA: Primary data saved (46148 records). [2025-10-06T22:02:42.587790] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-06T22:02:42.587936] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TUYA took 33.7s. Estimated remaining: 31m 25s. Rate: 7.1 symbols/min [2025-10-06T22:02:42.756488] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:02:42.761858] [DEBUG] [LOCAL ] TVE: Loaded 2809 existing records from primary storage. [2025-10-06T22:02:42.762033] [INFO ] [MAIN ] TVE: Loaded 2809 existing records. [2025-10-06T22:02:42.861728] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-06T22:02:42.940662] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:02:42.940900] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-06T22:02:42.940948] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-06T22:02:42.941172] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-06T22:02:42.941229] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-06T22:02:43.030617] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-06T22:02:43.288781] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:02:43.570829] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T22:02:43.825546] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-06T22:02:44.625529] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-06T22:02:45.330608] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T22:02:45.425503] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-06T22:02:46.225505] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-06T22:02:46.307534] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T22:02:46.892926] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-06T22:02:46.957403] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-06T22:02:47.025549] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-06T22:02:47.533907] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-06T22:02:47.825537] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-06T22:02:48.625552] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-06T22:02:49.206517] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-06T22:02:49.311252] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-06T22:02:49.425541] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-06T22:02:50.225555] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-06T22:02:50.868588] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T22:02:51.025523] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-06T22:02:51.586519] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-06T22:02:51.589523] [INFO ] [REMOTE ] TU: Full fetch complete (72809 records). [2025-10-06T22:02:51.589674] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-06T22:02:51.825912] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-06T22:02:51.985781] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-06T22:02:51.985975] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-06T22:02:51.987186] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-06T22:02:51.987311] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-06T22:02:51.989326] [DEBUG] [LOCAL ] TU: Trimmed 72809 records to 49840 (keeping 200 days of data) [2025-10-06T22:02:52.097888] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-06T22:02:52.104236] [INFO ] [REMOTE ] TV: Full fetch complete (61719 records). [2025-10-06T22:02:52.105232] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-06T22:02:52.333247] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T22:02:52.354055] [INFO ] [REMOTE ] TVC: Full fetch complete (5474 records). [2025-10-06T22:02:52.398767] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-06T22:02:52.630483] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-06T22:02:52.692398] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-06T22:02:52.718862] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-06T22:02:52.790805] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-06T22:02:52.815699] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-06T22:02:52.888946] [DEBUG] [LOCAL ] TV: Trimmed 61719 records to 42263 (keeping 200 days of data) [2025-10-06T22:02:53.037802] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-06T22:02:53.066195] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-06T22:02:53.066775] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-06T22:02:53.067412] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-06T22:02:53.069978] [DEBUG] [LOCAL ] TVC: Trimmed 5474 records to 3311 (keeping 200 days of data) [2025-10-06T22:02:53.156271] [DEBUG] [LOCAL ] TVC: Primary data saved (3311 records). [2025-10-06T22:02:53.167156] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-06T22:02:53.198439] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TVC took 26.6s. Estimated remaining: 31m 17s. Rate: 7.1 symbols/min [2025-10-06T22:02:53.336090] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-06T22:02:53.398080] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:02:53.428858] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-06T22:02:53.450162] [DEBUG] [LOCAL ] TWI: Loaded 34741 existing records from primary storage. [2025-10-06T22:02:53.452407] [INFO ] [MAIN ] TWI: Loaded 34741 existing records. [2025-10-06T22:02:53.754575] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:02:53.756582] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-06T22:02:53.757046] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-06T22:02:53.759332] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-06T22:02:53.760749] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-06T22:02:54.079537] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-06T22:02:54.230475] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-06T22:02:54.278136] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:02:54.316156] [DEBUG] [LOCAL ] TU: Primary data saved (49840 records). [2025-10-06T22:02:54.316993] [INFO ] [MAIN ] TU: Full history saved. [2025-10-06T22:02:54.317783] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TU took 54.0s. Estimated remaining: 31m 8s. Rate: 7.1 symbols/min [2025-10-06T22:02:54.407393] [DEBUG] [LOCAL ] TV: Primary data saved (42263 records). [2025-10-06T22:02:54.415069] [INFO ] [MAIN ] TV: Full history saved. [2025-10-06T22:02:54.415242] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TV took 35.8s. Estimated remaining: 30m 58s. Rate: 7.1 symbols/min [2025-10-06T22:02:54.698284] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:02:54.679967] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:02:54.706426] [DEBUG] [LOCAL ] TWN: Loaded 3275 existing records from primary storage. [2025-10-06T22:02:54.706768] [INFO ] [MAIN ] TWN: Loaded 3275 existing records. [2025-10-06T22:02:54.875964] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-06T22:02:54.913106] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:02:54.916082] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-06T22:02:54.916162] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-06T22:02:54.916321] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-06T22:02:54.916379] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-06T22:02:55.035014] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-06T22:02:55.064438] [DEBUG] [LOCAL ] TWLO: Loaded 53490 existing records from primary storage. [2025-10-06T22:02:55.090323] [INFO ] [MAIN ] TWLO: Loaded 53490 existing records. [2025-10-06T22:02:55.430233] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:02:55.445944] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-06T22:02:55.461703] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-06T22:02:55.482839] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-06T22:02:55.492888] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-06T22:02:55.581567] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:02:55.832849] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-06T22:02:55.939997] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:02:56.365631] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-06T22:02:56.625493] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-06T22:02:56.723479] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-06T22:02:57.195488] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-06T22:02:57.425523] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-06T22:02:57.530891] [DEBUG] [REMOTE ] TWI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-06T22:02:57.531164] [WARN ] [REMOTE ] TWI: No data returned for month 2025-01 [2025-10-06T22:02:57.531252] [FATAL] [REMOTE ] TWI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:02:57.531331] [FATAL] [MAIN ] TWI: Failed to fetch primary data. [2025-10-06T22:02:57.531393] [WARN ] [MAIN ] TWI: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:02:57.531463] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-06T22:02:57.531527] [DEBUG] [LOCAL ] TWI: No primary data file found to delete. [2025-10-06T22:02:57.531561] [INFO ] [LOCAL ] TWI: Starting deletion of derivative data. [2025-10-06T22:02:57.531806] [DEBUG] [LOCAL ] TWI: Deleted derivative data file. [2025-10-06T22:02:57.531894] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TWI took 4.3s. Estimated remaining: 30m 49s. Rate: 7.1 symbols/min [2025-10-06T22:02:57.697860] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:02:57.752105] [DEBUG] [LOCAL ] TWO: Loaded 49084 existing records from primary storage. [2025-10-06T22:02:57.752567] [INFO ] [MAIN ] TWO: Loaded 49084 existing records. [2025-10-06T22:02:57.943919] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:02:57.944186] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-06T22:02:57.944240] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-06T22:02:57.944469] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-06T22:02:57.944528] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-06T22:02:58.230592] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-06T22:02:58.302998] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:02:58.810086] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-06T22:02:59.025534] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-06T22:02:59.603620] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-06T22:02:59.825491] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-06T22:03:00.420513] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-06T22:03:00.625575] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-06T22:03:01.425585] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-06T22:03:02.002294] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-06T22:03:02.225515] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-06T22:03:02.639206] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-06T22:03:02.672782] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-06T22:03:03.025580] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-06T22:03:03.675953] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-06T22:03:03.825504] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-06T22:03:04.223714] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-06T22:03:04.224469] [INFO ] [REMOTE ] TVE: Full fetch complete (4404 records). [2025-10-06T22:03:04.224538] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-06T22:03:04.590264] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-06T22:03:04.590350] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-06T22:03:04.590484] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-06T22:03:04.590523] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-06T22:03:04.590923] [DEBUG] [LOCAL ] TVE: Trimmed 4404 records to 2786 (keeping 200 days of data) [2025-10-06T22:03:04.608202] [DEBUG] [LOCAL ] TVE: Primary data saved (2786 records). [2025-10-06T22:03:04.608280] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-06T22:03:04.608373] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TVE took 22.0s. Estimated remaining: 30m 41s. Rate: 7.1 symbols/min [2025-10-06T22:03:04.630706] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-06T22:03:04.785783] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:03:04.785965] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-06T22:03:04.786005] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-06T22:03:04.786116] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-06T22:03:04.786158] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-06T22:03:04.786201] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-06T22:03:04.786234] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-06T22:03:05.158087] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:03:05.425583] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-06T22:03:06.086933] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-06T22:03:06.225548] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-06T22:03:06.293934] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T22:03:06.433086] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T22:03:06.433453] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-06T22:03:06.433552] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:03:06.433599] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-06T22:03:06.433725] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:03:06.433802] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-06T22:03:06.433870] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-06T22:03:06.433908] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-06T22:03:06.433955] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-06T22:03:06.434002] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWOD took 1.8s. Estimated remaining: 30m 32s. Rate: 7.1 symbols/min [2025-10-06T22:03:06.613626] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:03:06.636802] [DEBUG] [LOCAL ] TX: Loaded 23810 existing records from primary storage. [2025-10-06T22:03:06.637082] [INFO ] [MAIN ] TX: Loaded 23810 existing records. [2025-10-06T22:03:06.821366] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:03:06.821603] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-06T22:03:06.821698] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-06T22:03:06.821921] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-06T22:03:06.821983] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-06T22:03:07.034507] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-06T22:03:07.202144] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:03:07.706397] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-06T22:03:07.825502] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-06T22:03:08.625538] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-06T22:03:08.994113] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-06T22:03:09.425536] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-06T22:03:10.225563] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-06T22:03:10.416233] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T22:03:10.702461] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-06T22:03:11.025533] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-06T22:03:11.825599] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-06T22:03:11.904448] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-06T22:03:12.625597] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-06T22:03:12.776357] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T22:03:13.082513] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T22:03:13.425593] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-06T22:03:13.887510] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T22:03:14.017313] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-06T22:03:14.225589] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-06T22:03:14.675051] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-06T22:03:15.025553] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-06T22:03:15.825528] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-06T22:03:16.345526] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-06T22:03:16.625500] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-06T22:03:16.754199] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T22:03:17.166621] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T22:03:17.425554] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-06T22:03:18.225597] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-06T22:03:19.025571] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-06T22:03:19.415054] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-06T22:03:19.825477] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-06T22:03:19.862192] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T22:03:20.256421] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-06T22:03:20.259597] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-06T22:03:20.625511] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-06T22:03:21.039008] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-06T22:03:21.039951] [INFO ] [REMOTE ] TWN: Full fetch complete (5414 records). [2025-10-06T22:03:21.040020] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-06T22:03:21.431684] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-06T22:03:21.455744] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-06T22:03:21.455801] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-06T22:03:21.455954] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-06T22:03:21.456031] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-06T22:03:21.456402] [DEBUG] [LOCAL ] TWN: Trimmed 5414 records to 3201 (keeping 200 days of data) [2025-10-06T22:03:21.476685] [DEBUG] [LOCAL ] TWN: Primary data saved (3201 records). [2025-10-06T22:03:21.476815] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-06T22:03:21.476898] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWN took 27.1s. Estimated remaining: 30m 24s. Rate: 7.1 symbols/min [2025-10-06T22:03:21.645370] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:03:21.686930] [DEBUG] [LOCAL ] TXNM: Loaded 44016 existing records from primary storage. [2025-10-06T22:03:21.687290] [INFO ] [MAIN ] TXNM: Loaded 44016 existing records. [2025-10-06T22:03:21.860059] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:03:21.860299] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-06T22:03:21.860347] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-06T22:03:21.860555] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-06T22:03:21.860612] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-06T22:03:22.212730] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:03:22.225471] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-06T22:03:22.585011] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T22:03:23.025535] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-06T22:03:23.787538] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T22:03:23.825493] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-06T22:03:24.184560] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-06T22:03:24.625556] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-06T22:03:25.425550] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-06T22:03:25.486812] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-06T22:03:25.553894] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-06T22:03:26.225553] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-06T22:03:27.025582] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-06T22:03:27.380949] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-06T22:03:27.411019] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T22:03:27.825560] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-06T22:03:28.625631] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-06T22:03:29.095725] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-06T22:03:29.425497] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-06T22:03:29.773847] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-06T22:03:29.869729] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-06T22:03:30.225565] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-06T22:03:31.025539] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-06T22:03:31.180508] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T22:03:31.825521] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-06T22:03:32.182387] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-06T22:03:32.298150] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-06T22:03:32.625500] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-06T22:03:33.425510] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-06T22:03:33.455463] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T22:03:34.225497] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-06T22:03:34.725230] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-06T22:03:34.750373] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T22:03:35.025521] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-06T22:03:35.825494] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-06T22:03:36.003434] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-06T22:03:36.605308] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T22:03:36.607574] [INFO ] [REMOTE ] TX: Full fetch complete (35835 records). [2025-10-06T22:03:36.607680] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-06T22:03:36.630688] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-06T22:03:37.011156] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-06T22:03:37.011263] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-06T22:03:37.012031] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-06T22:03:37.012119] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-06T22:03:37.024088] [DEBUG] [LOCAL ] TX: Trimmed 35835 records to 23453 (keeping 200 days of data) [2025-10-06T22:03:37.044292] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-06T22:03:37.197978] [DEBUG] [LOCAL ] TX: Primary data saved (23453 records). [2025-10-06T22:03:37.198829] [INFO ] [MAIN ] TX: Full history saved. [2025-10-06T22:03:37.199046] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TX took 30.8s. Estimated remaining: 30m 16s. Rate: 7.1 symbols/min [2025-10-06T22:03:37.371783] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:03:37.393398] [DEBUG] [LOCAL ] TXO: Loaded 19183 existing records from primary storage. [2025-10-06T22:03:37.393738] [INFO ] [MAIN ] TXO: Loaded 19183 existing records. [2025-10-06T22:03:37.435724] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-06T22:03:37.577504] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:03:37.577760] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-06T22:03:37.577810] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-06T22:03:37.578259] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-06T22:03:37.578317] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-06T22:03:37.927210] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:03:38.050762] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-06T22:03:38.225553] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-06T22:03:39.025506] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-06T22:03:39.092893] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-06T22:03:39.095979] [INFO ] [REMOTE ] TWLO: Full fetch complete (76461 records). [2025-10-06T22:03:39.096081] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-06T22:03:39.479133] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-06T22:03:39.479233] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-06T22:03:39.480459] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-06T22:03:39.480527] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-06T22:03:39.482217] [DEBUG] [LOCAL ] TWLO: Trimmed 76461 records to 52735 (keeping 200 days of data) [2025-10-06T22:03:39.811491] [DEBUG] [LOCAL ] TWLO: Primary data saved (52735 records). [2025-10-06T22:03:39.811690] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-06T22:03:39.811793] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TWLO took 45.5s. Estimated remaining: 30m 7s. Rate: 7.1 symbols/min [2025-10-06T22:03:39.825475] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-06T22:03:39.878839] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T22:03:39.965243] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T22:03:40.625578] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-06T22:03:41.425513] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-06T22:03:41.740966] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-06T22:03:42.215686] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T22:03:42.225482] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-06T22:03:42.309372] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T22:03:43.025606] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-06T22:03:43.823109] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T22:03:43.832516] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-06T22:03:44.625538] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-06T22:03:44.851002] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T22:03:44.852458] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-06T22:03:45.425499] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-06T22:03:46.107604] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-06T22:03:46.229526] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-06T22:03:46.233884] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T22:03:47.025551] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-06T22:03:47.124117] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T22:03:47.825588] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-06T22:03:48.511827] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T22:03:48.625512] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-06T22:03:48.927701] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T22:03:49.425543] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-06T22:03:49.573795] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T22:03:49.577480] [INFO ] [REMOTE ] TXNM: Full fetch complete (62784 records). [2025-10-06T22:03:49.577804] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-06T22:03:49.967270] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-06T22:03:49.967396] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-06T22:03:49.968599] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-06T22:03:49.968713] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-06T22:03:49.970232] [DEBUG] [LOCAL ] TXNM: Trimmed 62784 records to 43375 (keeping 200 days of data) [2025-10-06T22:03:50.229297] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-06T22:03:50.241350] [DEBUG] [LOCAL ] TXNM: Primary data saved (43375 records). [2025-10-06T22:03:50.241528] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-06T22:03:50.241622] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TXNM took 28.8s. Estimated remaining: 29m 59s. Rate: 7.1 symbols/min [2025-10-06T22:03:51.189043] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T22:03:51.203977] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-06T22:03:51.413872] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-06T22:03:51.825575] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-06T22:03:52.658154] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T22:03:52.662002] [INFO ] [REMOTE ] TWO: Full fetch complete (69119 records). [2025-10-06T22:03:52.662160] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-06T22:03:52.990772] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-06T22:03:53.013813] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-06T22:03:53.112945] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-06T22:03:53.113067] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-06T22:03:53.115438] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-06T22:03:53.115514] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-06T22:03:53.117541] [DEBUG] [LOCAL ] TWO: Trimmed 69119 records to 48448 (keeping 200 days of data) [2025-10-06T22:03:53.446347] [DEBUG] [LOCAL ] TWO: Primary data saved (48448 records). [2025-10-06T22:03:53.446543] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-06T22:03:53.446675] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TWO took 55.9s. Estimated remaining: 29m 50s. Rate: 7.1 symbols/min [2025-10-06T22:03:54.097256] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-06T22:03:54.104443] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-06T22:03:55.312014] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T22:03:55.316478] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-06T22:03:56.187884] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T22:03:56.189792] [INFO ] [REMOTE ] TXO: Full fetch complete (26406 records). [2025-10-06T22:03:56.189878] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-06T22:03:56.587937] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-06T22:03:56.588047] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-06T22:03:56.589275] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-06T22:03:56.589348] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-06T22:03:56.590367] [DEBUG] [LOCAL ] TXO: Trimmed 26406 records to 19114 (keeping 200 days of data) [2025-10-06T22:03:56.727716] [DEBUG] [LOCAL ] TXO: Primary data saved (19114 records). [2025-10-06T22:03:56.727956] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-06T22:03:56.728069] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TXO took 19.5s. Estimated remaining: 29m 41s. Rate: 7.1 symbols/min [2025-10-06T22:03:57.364054] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:03:57.414914] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:03:57.527308] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:03:57.552217] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:03:57.568425] [DEBUG] [LOCAL ] TY: Loaded 7611 existing records from primary storage. [2025-10-06T22:03:57.569521] [INFO ] [MAIN ] TY: Loaded 7611 existing records. [2025-10-06T22:03:57.638276] [DEBUG] [LOCAL ] TYG: Loaded 14306 existing records from primary storage. [2025-10-06T22:03:57.682868] [INFO ] [MAIN ] TYG: Loaded 14306 existing records. [2025-10-06T22:03:57.823237] [DEBUG] [LOCAL ] TYL: Loaded 22473 existing records from primary storage. [2025-10-06T22:03:57.859295] [INFO ] [MAIN ] TYL: Loaded 22473 existing records. [2025-10-06T22:03:57.872859] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:03:57.937427] [DEBUG] [LOCAL ] TXT: Loaded 50433 existing records from primary storage. [2025-10-06T22:03:57.953421] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-06T22:03:57.985236] [INFO ] [MAIN ] TXT: Loaded 50433 existing records. [2025-10-06T22:03:57.974611] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-06T22:03:58.094156] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-06T22:03:58.158977] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:03:58.171832] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-06T22:03:58.155400] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-06T22:03:58.214626] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-06T22:03:58.351672] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-06T22:03:58.351906] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-06T22:03:58.358396] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:03:58.427464] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-06T22:03:58.457840] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-06T22:03:58.508604] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-06T22:03:58.574321] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-06T22:03:58.708915] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:03:58.755315] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-06T22:03:58.783496] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-06T22:03:58.805608] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-06T22:03:58.828963] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-06T22:03:59.681236] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:03:59.723475] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-06T22:03:59.873463] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:03:59.920761] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:03:59.930070] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-06T22:03:59.930615] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-06T22:04:00.024638] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:04:00.025124] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-06T22:04:00.725243] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-06T22:04:00.728083] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-06T22:04:00.885977] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-06T22:04:00.889666] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-06T22:04:01.068911] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T22:04:01.073387] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-06T22:04:01.538302] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T22:04:01.540863] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-06T22:04:01.830212] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-06T22:04:01.840729] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-06T22:04:01.871362] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-06T22:04:02.090131] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T22:04:02.225556] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-06T22:04:02.315569] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-06T22:04:03.025578] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-06T22:04:03.281535] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T22:04:03.436785] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-06T22:04:03.493065] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-06T22:04:03.825544] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-06T22:04:04.625559] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-06T22:04:05.005128] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T22:04:05.425521] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-06T22:04:05.564984] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T22:04:06.225520] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-06T22:04:06.744751] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-06T22:04:07.025524] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-06T22:04:07.074884] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T22:04:07.825524] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-06T22:04:08.239132] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-06T22:04:08.625600] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-06T22:04:08.742346] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-06T22:04:09.425593] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-06T22:04:09.770221] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T22:04:09.932717] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-06T22:04:10.225573] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-06T22:04:10.970496] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T22:04:11.025540] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-06T22:04:11.825501] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-06T22:04:12.279054] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T22:04:12.625583] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-06T22:04:13.425490] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-06T22:04:13.650807] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T22:04:13.827361] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-06T22:04:14.225584] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-06T22:04:14.493944] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-06T22:04:15.025706] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-06T22:04:15.761472] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T22:04:15.825526] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-06T22:04:16.002723] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T22:04:16.591910] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T22:04:16.625520] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-06T22:04:17.220036] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T22:04:17.425549] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-06T22:04:18.225550] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-06T22:04:18.281930] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-06T22:04:18.953010] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T22:04:19.025613] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-06T22:04:19.825548] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-06T22:04:20.486548] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T22:04:20.625604] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-06T22:04:20.718917] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-06T22:04:21.425578] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-06T22:04:21.810365] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T22:04:21.812110] [INFO ] [REMOTE ] TYL: Full fetch complete (31412 records). [2025-10-06T22:04:21.812188] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-06T22:04:22.184009] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-06T22:04:22.184090] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-06T22:04:22.184728] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-06T22:04:22.184839] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-06T22:04:22.185547] [DEBUG] [LOCAL ] TYL: Trimmed 31412 records to 22200 (keeping 200 days of data) [2025-10-06T22:04:22.236614] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-06T22:04:22.324663] [DEBUG] [LOCAL ] TYL: Primary data saved (22200 records). [2025-10-06T22:04:22.324809] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-06T22:04:22.324893] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TYL took 25.6s. Estimated remaining: 29m 34s. Rate: 7.1 symbols/min [2025-10-06T22:04:22.495557] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:04:22.525431] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T22:04:22.579822] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-10-06T22:04:22.580160] [INFO ] [MAIN ] U: Loaded 54579 existing records. [2025-10-06T22:04:22.755197] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:04:22.755418] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-06T22:04:22.755465] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-06T22:04:22.755691] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-06T22:04:22.755748] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-06T22:04:23.027269] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-06T22:04:23.121753] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:04:23.132417] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-06T22:04:23.534398] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T22:04:23.535304] [INFO ] [REMOTE ] TY: Full fetch complete (11579 records). [2025-10-06T22:04:23.535373] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-06T22:04:23.830733] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-06T22:04:23.899306] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-06T22:04:23.899396] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-06T22:04:23.899855] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-06T22:04:23.899940] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-06T22:04:23.900721] [DEBUG] [LOCAL ] TY: Trimmed 11579 records to 7552 (keeping 200 days of data) [2025-10-06T22:04:23.957027] [DEBUG] [LOCAL ] TY: Primary data saved (7552 records). [2025-10-06T22:04:23.957193] [INFO ] [MAIN ] TY: Full history saved. [2025-10-06T22:04:23.957284] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TY took 27.2s. Estimated remaining: 29m 25s. Rate: 7.1 symbols/min [2025-10-06T22:04:24.133073] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:04:24.184461] [DEBUG] [LOCAL ] UA: Loaded 51215 existing records from primary storage. [2025-10-06T22:04:24.184946] [INFO ] [MAIN ] UA: Loaded 51215 existing records. [2025-10-06T22:04:24.361248] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:04:24.361538] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-06T22:04:24.361596] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-06T22:04:24.361953] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-06T22:04:24.362011] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-06T22:04:24.634153] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-06T22:04:24.721042] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:04:25.430696] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-06T22:04:25.456383] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T22:04:26.225565] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-06T22:04:26.855546] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-06T22:04:27.025570] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-06T22:04:27.170017] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-06T22:04:27.825506] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-06T22:04:28.065745] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T22:04:28.625552] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-06T22:04:29.100349] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-06T22:04:29.313251] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T22:04:29.425541] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-06T22:04:30.225499] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-06T22:04:30.339826] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T22:04:30.926477] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T22:04:31.025569] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-06T22:04:31.825551] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-06T22:04:32.509673] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-06T22:04:32.625474] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-06T22:04:32.815152] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T22:04:33.425508] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-06T22:04:33.616153] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T22:04:33.711538] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T22:04:34.037851] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T22:04:34.044777] [INFO ] [REMOTE ] TXT: Full fetch complete (72292 records). [2025-10-06T22:04:34.044956] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-06T22:04:34.227391] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-06T22:04:34.448376] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-06T22:04:34.448476] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-06T22:04:34.449620] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-06T22:04:34.449705] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-06T22:04:34.451225] [DEBUG] [LOCAL ] TXT: Trimmed 72292 records to 49722 (keeping 200 days of data) [2025-10-06T22:04:34.761735] [DEBUG] [LOCAL ] TXT: Primary data saved (49722 records). [2025-10-06T22:04:34.761882] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-06T22:04:34.761969] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TXT took 38.0s. Estimated remaining: 29m 17s. Rate: 7.1 symbols/min [2025-10-06T22:04:34.935518] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:04:34.991787] [DEBUG] [LOCAL ] UAA: Loaded 54287 existing records from primary storage. [2025-10-06T22:04:34.992186] [INFO ] [MAIN ] UAA: Loaded 54287 existing records. [2025-10-06T22:04:35.035092] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-06T22:04:35.172451] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:04:35.172718] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-06T22:04:35.172795] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-06T22:04:35.173259] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-06T22:04:35.173337] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-06T22:04:35.526544] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:04:35.825489] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-06T22:04:36.102499] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-06T22:04:36.625537] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-06T22:04:36.750923] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T22:04:37.023789] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T22:04:37.425601] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-06T22:04:38.225553] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-06T22:04:38.388761] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T22:04:38.870204] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T22:04:39.025512] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-06T22:04:39.825525] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-06T22:04:40.393361] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-06T22:04:40.434240] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-06T22:04:40.435549] [INFO ] [REMOTE ] TYG: Full fetch complete (22448 records). [2025-10-06T22:04:40.435630] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-06T22:04:40.634470] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-06T22:04:40.876859] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-06T22:04:40.877194] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-06T22:04:40.886691] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-06T22:04:40.887508] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-06T22:04:40.887902] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-06T22:04:40.889260] [DEBUG] [LOCAL ] TYG: Trimmed 22448 records to 13929 (keeping 200 days of data) [2025-10-06T22:04:40.975519] [DEBUG] [LOCAL ] TYG: Primary data saved (13929 records). [2025-10-06T22:04:40.975710] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-06T22:04:40.975810] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TYG took 44.2s. Estimated remaining: 29m 8s. Rate: 7.1 symbols/min [2025-10-06T22:04:41.141899] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:04:41.150234] [DEBUG] [LOCAL ] UAN: Loaded 5475 existing records from primary storage. [2025-10-06T22:04:41.150460] [INFO ] [MAIN ] UAN: Loaded 5475 existing records. [2025-10-06T22:04:41.348869] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:04:41.349115] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-06T22:04:41.349165] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-06T22:04:41.349346] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-06T22:04:41.349406] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-06T22:04:41.432237] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-06T22:04:41.742624] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:04:42.225540] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-06T22:04:42.967816] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T22:04:43.025474] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-06T22:04:43.111456] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-06T22:04:43.186686] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T22:04:43.763801] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-06T22:04:43.825477] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-06T22:04:44.625524] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-06T22:04:45.261844] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-06T22:04:45.425539] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-06T22:04:46.160453] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-06T22:04:46.225475] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-06T22:04:47.025560] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-06T22:04:47.208101] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T22:04:47.649150] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-06T22:04:47.825559] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-06T22:04:48.625491] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-06T22:04:48.709191] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-06T22:04:48.726767] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T22:04:49.425549] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-06T22:04:50.225508] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-06T22:04:50.413761] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T22:04:50.946283] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T22:04:51.025535] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-06T22:04:51.671757] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-06T22:04:51.825535] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-06T22:04:52.346149] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-06T22:04:52.625553] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-06T22:04:52.883719] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T22:04:53.213429] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T22:04:53.425532] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-06T22:04:53.857679] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-06T22:04:54.225534] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-06T22:04:54.814063] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-06T22:04:55.025593] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-06T22:04:55.825543] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-06T22:04:56.625510] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-06T22:04:56.879941] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T22:04:57.425545] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-06T22:04:58.225563] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-06T22:04:58.281422] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-06T22:04:58.514562] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T22:04:58.678775] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T22:04:58.679617] [INFO ] [REMOTE ] UAN: Full fetch complete (8132 records). [2025-10-06T22:04:58.679722] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-06T22:04:59.035203] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-06T22:04:59.043876] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-06T22:04:59.045639] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-06T22:04:59.045976] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-06T22:04:59.046022] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-06T22:04:59.046496] [DEBUG] [LOCAL ] UAN: Trimmed 8132 records to 5444 (keeping 200 days of data) [2025-10-06T22:04:59.081282] [DEBUG] [LOCAL ] UAN: Primary data saved (5444 records). [2025-10-06T22:04:59.081387] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-06T22:04:59.081473] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. UAN took 18.1s. Estimated remaining: 29m 1s. Rate: 7.1 symbols/min [2025-10-06T22:04:59.251631] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:04:59.305701] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-10-06T22:04:59.306188] [INFO ] [MAIN ] UBER: Loaded 54586 existing records. [2025-10-06T22:04:59.511628] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:04:59.514601] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-06T22:04:59.514725] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-06T22:04:59.515327] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-06T22:04:59.515391] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-06T22:04:59.516516] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-06T22:04:59.830776] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-06T22:04:59.889880] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:05:00.625528] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-06T22:05:00.994087] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-06T22:05:00.997119] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-10-06T22:05:00.997223] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-06T22:05:01.423161] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-06T22:05:01.423357] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-06T22:05:01.424870] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-06T22:05:01.425023] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-06T22:05:01.425529] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-06T22:05:01.427840] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 53799 (keeping 200 days of data) [2025-10-06T22:05:01.676995] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-06T22:05:01.823580] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-10-06T22:05:01.823789] [INFO ] [MAIN ] U: Full history saved. [2025-10-06T22:05:01.823893] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. U took 39.5s. Estimated remaining: 28m 52s. Rate: 7.1 symbols/min [2025-10-06T22:05:02.019391] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:05:02.070969] [DEBUG] [LOCAL ] UBS: Loaded 53142 existing records from primary storage. [2025-10-06T22:05:02.071386] [INFO ] [MAIN ] UBS: Loaded 53142 existing records. [2025-10-06T22:05:02.230739] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-06T22:05:02.290212] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:05:02.290679] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-06T22:05:02.290792] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-06T22:05:02.291017] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-06T22:05:02.291086] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-06T22:05:02.697455] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:05:02.768011] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T22:05:02.771138] [INFO ] [REMOTE ] UA: Full fetch complete (72980 records). [2025-10-06T22:05:02.771283] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-06T22:05:03.033182] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-06T22:05:03.046112] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-06T22:05:03.226049] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-06T22:05:03.226131] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-06T22:05:03.227262] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-06T22:05:03.227330] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-06T22:05:03.228956] [DEBUG] [LOCAL ] UA: Trimmed 72980 records to 50458 (keeping 200 days of data) [2025-10-06T22:05:03.540115] [DEBUG] [LOCAL ] UA: Primary data saved (50458 records). [2025-10-06T22:05:03.540267] [INFO ] [MAIN ] UA: Full history saved. [2025-10-06T22:05:03.540354] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. UA took 39.6s. Estimated remaining: 28m 43s. Rate: 7.1 symbols/min [2025-10-06T22:05:03.717580] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:05:03.752071] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T22:05:03.793321] [DEBUG] [LOCAL ] UCB: Loaded 38420 existing records from primary storage. [2025-10-06T22:05:03.793624] [INFO ] [MAIN ] UCB: Loaded 38420 existing records. [2025-10-06T22:05:03.830612] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-06T22:05:03.981496] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:05:03.981855] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-06T22:05:03.981925] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-06T22:05:03.982190] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-06T22:05:03.982248] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-06T22:05:04.385056] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:05:04.625517] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-06T22:05:04.908161] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-06T22:05:05.425608] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-06T22:05:06.008929] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-06T22:05:06.225569] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-06T22:05:06.992374] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-06T22:05:07.025474] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-06T22:05:07.147357] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T22:05:07.825540] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-06T22:05:08.046003] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T22:05:08.625570] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-06T22:05:09.248018] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-06T22:05:09.425584] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-06T22:05:09.629311] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T22:05:09.701510] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-06T22:05:10.225602] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-06T22:05:11.025614] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-06T22:05:11.353738] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-06T22:05:11.786809] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T22:05:11.825497] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-06T22:05:12.625545] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-06T22:05:12.836320] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T22:05:13.425504] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-06T22:05:13.551593] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-06T22:05:14.225546] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-06T22:05:14.492714] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T22:05:14.918770] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T22:05:15.025555] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-06T22:05:15.825533] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-06T22:05:16.625511] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-06T22:05:16.913744] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T22:05:17.251972] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-06T22:05:17.255202] [INFO ] [REMOTE ] UAA: Full fetch complete (77485 records). [2025-10-06T22:05:17.255361] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-06T22:05:17.432151] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-06T22:05:17.666086] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-06T22:05:17.666181] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-06T22:05:17.667386] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-06T22:05:17.667456] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-06T22:05:17.669379] [DEBUG] [LOCAL ] UAA: Trimmed 77485 records to 53509 (keeping 200 days of data) [2025-10-06T22:05:17.978780] [DEBUG] [LOCAL ] UAA: Primary data saved (53509 records). [2025-10-06T22:05:17.978942] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-06T22:05:17.979957] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. UAA took 43.2s. Estimated remaining: 28m 35s. Rate: 7.1 symbols/min [2025-10-06T22:05:18.152511] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:05:18.205433] [DEBUG] [LOCAL ] UDR: Loaded 52605 existing records from primary storage. [2025-10-06T22:05:18.205840] [INFO ] [MAIN ] UDR: Loaded 52605 existing records. [2025-10-06T22:05:18.417679] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:05:18.420886] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T22:05:18.418942] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-06T22:05:18.421108] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-06T22:05:18.430316] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-06T22:05:18.430501] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-06T22:05:18.461015] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-06T22:05:18.793273] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:05:18.827143] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T22:05:19.025514] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-06T22:05:19.774242] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T22:05:19.825501] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-06T22:05:20.625481] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-06T22:05:20.625420] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T22:05:21.273083] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T22:05:21.425519] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-06T22:05:22.225588] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-06T22:05:23.676351] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T22:05:23.684906] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-06T22:05:29.215460] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (14.99 seconds). [2025-10-06T22:05:29.227070] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-06T22:05:31.840166] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-06T22:05:31.855200] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-06T22:05:34.280082] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-06T22:05:34.291010] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-06T22:05:36.914340] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-06T22:05:36.926253] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-06T22:05:39.380598] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-06T22:05:39.392052] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-06T22:05:41.906837] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-06T22:05:41.918327] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-06T22:05:42.378852] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T22:05:42.381974] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-10-06T22:05:42.382105] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-06T22:05:42.785032] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-06T22:05:42.785122] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-06T22:05:42.786284] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-06T22:05:42.786371] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-06T22:05:42.787964] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 53806 (keeping 200 days of data) [2025-10-06T22:05:43.116355] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-10-06T22:05:43.116525] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-06T22:05:43.116620] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UBER took 44.0s. Estimated remaining: 28m 28s. Rate: 7.1 symbols/min [2025-10-06T22:05:43.282973] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:05:43.327674] [DEBUG] [LOCAL ] UE: Loaded 43284 existing records from primary storage. [2025-10-06T22:05:43.328040] [INFO ] [MAIN ] UE: Loaded 43284 existing records. [2025-10-06T22:05:43.505616] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:05:43.505929] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-06T22:05:43.505983] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-06T22:05:43.506202] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-06T22:05:43.506264] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-06T22:05:43.874390] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:05:43.874759] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-06T22:05:45.360767] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T22:05:45.369603] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-06T22:05:46.788132] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-06T22:05:46.797003] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-06T22:05:48.189623] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-06T22:05:48.197410] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-06T22:05:49.712504] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T22:05:49.721563] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-06T22:05:51.221015] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T22:05:51.231058] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-06T22:05:52.611893] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-06T22:05:52.623696] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-06T22:05:54.091747] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-06T22:05:54.100570] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-06T22:05:55.620437] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-06T22:05:55.630184] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-06T22:05:57.151991] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T22:05:57.161719] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-06T22:06:38.616315] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (77.99 seconds). [2025-10-06T22:06:38.626671] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-06T22:06:39.967542] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-06T22:06:39.978732] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-06T22:06:40.560559] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (79.14 seconds). [2025-10-06T22:06:40.572795] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-06T22:06:41.417288] [DEBUG] [REMOTE ] UCB: Error fetching primary data for 2025-08: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-10-06T22:06:41.417600] [WARN ] [REMOTE ] UCB: No data returned for month 2025-08 [2025-10-06T22:06:41.417750] [FATAL] [REMOTE ] UCB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:06:41.417812] [FATAL] [MAIN ] UCB: Failed to fetch primary data. [2025-10-06T22:06:41.417846] [WARN ] [MAIN ] UCB: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:06:41.417888] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-06T22:06:41.418041] [DEBUG] [LOCAL ] UCB: No primary data file found to delete. [2025-10-06T22:06:41.418102] [INFO ] [LOCAL ] UCB: Starting deletion of derivative data. [2025-10-06T22:06:41.418482] [DEBUG] [LOCAL ] UCB: Deleted derivative data file. [2025-10-06T22:06:41.418565] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UCB took 1m 38s. Estimated remaining: 28m 24s. Rate: 7.1 symbols/min [2025-10-06T22:06:41.615347] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:06:41.652944] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T22:06:41.658134] [DEBUG] [LOCAL ] UFI: Loaded 8258 existing records from primary storage. [2025-10-06T22:06:41.669946] [INFO ] [MAIN ] UFI: Loaded 8258 existing records. [2025-10-06T22:06:41.722383] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-06T22:06:41.893302] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:06:41.894169] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-06T22:06:41.894256] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-06T22:06:41.894685] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-06T22:06:41.894757] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-06T22:06:42.049329] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (44.89 seconds). [2025-10-06T22:06:42.153384] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-06T22:06:42.361719] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:06:42.362461] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-06T22:06:42.398376] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T22:06:42.411387] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-06T22:06:43.263484] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T22:06:43.266953] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-06T22:06:43.302086] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T22:06:43.314793] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-06T22:06:43.381292] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T22:06:43.384145] [INFO ] [REMOTE ] UE: Full fetch complete (61344 records). [2025-10-06T22:06:43.384313] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-06T22:06:43.806796] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-06T22:06:43.807096] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-06T22:06:43.809557] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-06T22:06:43.816187] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-06T22:06:43.817267] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-06T22:06:43.820041] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-06T22:06:43.835506] [DEBUG] [LOCAL ] UE: Trimmed 61344 records to 42666 (keeping 200 days of data) [2025-10-06T22:06:43.856964] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T22:06:43.961388] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-06T22:06:44.140970] [DEBUG] [LOCAL ] UE: Primary data saved (42666 records). [2025-10-06T22:06:44.141177] [INFO ] [MAIN ] UE: Full history saved. [2025-10-06T22:06:44.141300] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UE took 1m 1s. Estimated remaining: 28m 15s. Rate: 7.1 symbols/min [2025-10-06T22:06:44.313912] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:06:44.362087] [DEBUG] [LOCAL ] UGI: Loaded 51249 existing records from primary storage. [2025-10-06T22:06:44.362432] [INFO ] [MAIN ] UGI: Loaded 51249 existing records. [2025-10-06T22:06:44.542843] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:06:44.543223] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-06T22:06:44.543295] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-06T22:06:44.550170] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T22:06:44.550207] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-06T22:06:44.550351] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-06T22:06:44.553306] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-06T22:06:44.927849] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:06:44.944120] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-06T22:06:44.957417] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T22:06:44.968878] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-06T22:06:45.262049] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T22:06:45.264978] [INFO ] [REMOTE ] UBS: Full fetch complete (75705 records). [2025-10-06T22:06:45.265081] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-06T22:06:45.375537] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-06T22:06:45.399562] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-06T22:06:45.671802] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-06T22:06:45.671888] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-06T22:06:45.673033] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-06T22:06:45.673097] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-06T22:06:45.674572] [DEBUG] [LOCAL ] UBS: Trimmed 75705 records to 52358 (keeping 200 days of data) [2025-10-06T22:06:45.981466] [DEBUG] [LOCAL ] UBS: Primary data saved (52358 records). [2025-10-06T22:06:45.981616] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-06T22:06:45.981735] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UBS took 1m 44s. Estimated remaining: 28m 6s. Rate: 7.1 symbols/min [2025-10-06T22:06:46.148116] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:06:46.188157] [DEBUG] [LOCAL ] UGP: Loaded 43607 existing records from primary storage. [2025-10-06T22:06:46.188503] [INFO ] [MAIN ] UGP: Loaded 43607 existing records. [2025-10-06T22:06:46.370218] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:06:46.370580] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-06T22:06:46.370697] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-06T22:06:46.378335] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-06T22:06:46.379560] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-06T22:06:46.379123] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-06T22:06:46.406553] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-06T22:06:46.779443] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:06:46.780031] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-06T22:06:46.851862] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T22:06:46.867614] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-06T22:06:46.872832] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T22:06:46.887201] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-06T22:06:47.065731] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-06T22:06:47.068464] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-06T22:06:47.566343] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-06T22:06:47.568591] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-06T22:06:48.258845] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-06T22:06:48.262492] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-06T22:06:48.343033] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-06T22:06:48.352811] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-06T22:06:48.442375] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T22:06:48.453146] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-06T22:06:48.596668] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T22:06:48.607455] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-06T22:06:49.066109] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T22:06:49.068625] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-06T22:06:49.603733] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-06T22:06:49.607691] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-06T22:06:49.799682] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T22:06:49.811257] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-06T22:06:50.038229] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T22:06:50.049059] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-06T22:06:50.217584] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T22:06:50.233217] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-06T22:06:50.233521] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T22:06:50.236464] [INFO ] [REMOTE ] UFI: Full fetch complete (12489 records). [2025-10-06T22:06:50.236581] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-06T22:06:50.615619] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-06T22:06:50.615733] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-06T22:06:50.616075] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-06T22:06:50.616115] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-06T22:06:50.616557] [DEBUG] [LOCAL ] UFI: Trimmed 12489 records to 8150 (keeping 200 days of data) [2025-10-06T22:06:50.660721] [DEBUG] [LOCAL ] UFI: Primary data saved (8150 records). [2025-10-06T22:06:50.660874] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-06T22:06:50.660966] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UFI took 9.2s. Estimated remaining: 27m 57s. Rate: 7.1 symbols/min [2025-10-06T22:06:50.854791] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:06:50.874562] [DEBUG] [LOCAL ] UHAL: Loaded 16799 existing records from primary storage. [2025-10-06T22:06:50.874875] [INFO ] [MAIN ] UHAL: Loaded 16799 existing records. [2025-10-06T22:06:51.052605] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:06:51.052931] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-06T22:06:51.052981] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-06T22:06:51.053179] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-06T22:06:51.053238] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-06T22:06:51.443015] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:06:51.443362] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-06T22:06:51.572386] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-06T22:06:51.584589] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-06T22:06:51.664478] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T22:06:51.674020] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-06T22:06:51.760575] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T22:06:51.771298] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-06T22:06:52.067566] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-06T22:06:52.071129] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-06T22:06:52.335513] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T22:06:52.347614] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-06T22:06:52.684858] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T22:06:52.690698] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-06T22:06:52.809182] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T22:06:52.813393] [INFO ] [REMOTE ] UDR: Full fetch complete (74662 records). [2025-10-06T22:06:52.813521] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-06T22:06:53.223326] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-06T22:06:53.223593] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-06T22:06:53.224871] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-06T22:06:53.225023] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-06T22:06:53.243899] [DEBUG] [LOCAL ] UDR: Trimmed 74662 records to 51872 (keeping 200 days of data) [2025-10-06T22:06:53.260949] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T22:06:53.338785] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-06T22:06:53.427243] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T22:06:53.447535] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-06T22:06:53.561968] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-06T22:06:53.568033] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-06T22:06:53.688382] [DEBUG] [LOCAL ] UDR: Primary data saved (51872 records). [2025-10-06T22:06:53.688547] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-06T22:06:53.689896] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UDR took 1m 36s. Estimated remaining: 27m 48s. Rate: 7.1 symbols/min [2025-10-06T22:06:53.872424] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:06:53.919168] [DEBUG] [LOCAL ] UHS: Loaded 41412 existing records from primary storage. [2025-10-06T22:06:53.919489] [INFO ] [MAIN ] UHS: Loaded 41412 existing records. [2025-10-06T22:06:54.097096] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:06:54.097297] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-06T22:06:54.097380] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-06T22:06:54.097613] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-06T22:06:54.097705] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-06T22:06:54.450638] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:06:54.451020] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-06T22:06:54.605205] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-06T22:06:54.609142] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-06T22:06:54.689362] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T22:06:54.698305] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-06T22:06:55.209471] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T22:06:55.221218] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-06T22:06:55.615238] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T22:06:55.624961] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T22:06:55.625637] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-06T22:06:55.631415] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-06T22:06:56.021889] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T22:06:56.031027] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-06T22:06:56.575482] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T22:06:56.579535] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-06T22:06:56.922928] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T22:06:56.933416] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-06T22:06:57.217039] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T22:06:57.224726] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-06T22:06:57.279942] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-06T22:06:57.290393] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-06T22:06:57.676174] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T22:06:57.680327] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-06T22:06:58.607763] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T22:06:58.618218] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-06T22:06:58.780502] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-06T22:06:58.792391] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-06T22:06:58.906589] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T22:06:58.907399] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-06T22:06:58.923499] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-06T22:06:58.924036] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-06T22:06:59.918975] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-06T22:06:59.939050] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-06T22:06:59.940259] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T22:06:59.945358] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-06T22:07:00.444194] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T22:07:00.456148] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-06T22:07:00.595662] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-06T22:07:00.606263] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-06T22:07:01.068143] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-06T22:07:01.073695] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-06T22:07:01.742884] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T22:07:01.757288] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-06T22:07:01.898039] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T22:07:01.899949] [INFO ] [REMOTE ] UHAL: Full fetch complete (23220 records). [2025-10-06T22:07:01.900039] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-06T22:07:02.088306] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T22:07:02.213419] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-06T22:07:02.425286] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T22:07:02.468951] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-06T22:07:02.469080] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-06T22:07:02.469941] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-06T22:07:02.470618] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-06T22:07:02.470504] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-06T22:07:02.473020] [DEBUG] [LOCAL ] UHAL: Trimmed 23220 records to 16673 (keeping 200 days of data) [2025-10-06T22:07:02.584454] [DEBUG] [LOCAL ] UHAL: Primary data saved (16673 records). [2025-10-06T22:07:02.584841] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-06T22:07:02.584968] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UHAL took 11.9s. Estimated remaining: 27m 40s. Rate: 7.1 symbols/min [2025-10-06T22:07:02.828045] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:02.837259] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T22:07:02.841275] [INFO ] [REMOTE ] UGP: Full fetch complete (62195 records). [2025-10-06T22:07:02.841502] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-06T22:07:02.944569] [DEBUG] [LOCAL ] UHT: Loaded 10056 existing records from primary storage. [2025-10-06T22:07:02.970111] [INFO ] [MAIN ] UHT: Loaded 10056 existing records. [2025-10-06T22:07:03.373196] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:03.402818] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-06T22:07:03.403049] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-06T22:07:03.414388] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-06T22:07:03.414537] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-06T22:07:03.635313] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-06T22:07:03.645878] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-06T22:07:03.688370] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-06T22:07:03.725164] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T22:07:03.745715] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-06T22:07:03.804257] [INFO ] [REMOTE ] UGI: Full fetch complete (73335 records). [2025-10-06T22:07:03.843187] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-06T22:07:03.855285] [DEBUG] [LOCAL ] UGP: Trimmed 62195 records to 42832 (keeping 200 days of data) [2025-10-06T22:07:04.114212] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:04.131193] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-06T22:07:04.242281] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-06T22:07:04.338400] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-06T22:07:04.555490] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-06T22:07:04.555629] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-06T22:07:04.557845] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-06T22:07:04.557978] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-06T22:07:04.561346] [DEBUG] [LOCAL ] UGI: Trimmed 73335 records to 50537 (keeping 200 days of data) [2025-10-06T22:07:05.007917] [DEBUG] [LOCAL ] UGP: Primary data saved (42832 records). [2025-10-06T22:07:05.008708] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-06T22:07:05.008858] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UGP took 19.0s. Estimated remaining: 27m 31s. Rate: 7.1 symbols/min [2025-10-06T22:07:05.228633] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:05.231077] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T22:07:05.236197] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-06T22:07:05.261691] [DEBUG] [LOCAL ] UGI: Primary data saved (50537 records). [2025-10-06T22:07:05.261935] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-06T22:07:05.262336] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UGI took 21.1s. Estimated remaining: 27m 22s. Rate: 7.1 symbols/min [2025-10-06T22:07:05.262239] [DEBUG] [LOCAL ] UI: Loaded 13318 existing records from primary storage. [2025-10-06T22:07:05.309430] [INFO ] [MAIN ] UI: Loaded 13318 existing records. [2025-10-06T22:07:05.599596] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:05.641147] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:05.642131] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-06T22:07:05.642260] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-06T22:07:05.642515] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-06T22:07:05.642576] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-06T22:07:05.999614] [DEBUG] [LOCAL ] UIS: Loaded 37532 existing records from primary storage. [2025-10-06T22:07:06.000413] [INFO ] [MAIN ] UIS: Loaded 37532 existing records. [2025-10-06T22:07:06.198792] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:06.211890] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-06T22:07:06.225410] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T22:07:06.261502] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-06T22:07:06.310578] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:06.335807] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-06T22:07:06.339117] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-06T22:07:06.340019] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-06T22:07:06.340098] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-06T22:07:06.347086] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-06T22:07:06.463072] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-06T22:07:06.744037] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:06.744490] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-06T22:07:07.061407] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-06T22:07:07.064497] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-06T22:07:07.146607] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T22:07:07.149456] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-06T22:07:07.899407] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-06T22:07:07.903014] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-06T22:07:08.103820] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T22:07:08.107524] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-06T22:07:08.182210] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T22:07:08.191771] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-06T22:07:08.244920] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T22:07:08.252814] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-06T22:07:08.604974] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T22:07:08.608081] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-06T22:07:09.037266] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-06T22:07:09.040553] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-06T22:07:09.394049] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T22:07:09.396818] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-06T22:07:09.515379] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-06T22:07:09.523044] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-06T22:07:09.663784] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T22:07:09.672388] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-06T22:07:09.816561] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T22:07:09.819903] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-06T22:07:10.196239] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T22:07:10.199107] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-06T22:07:10.392513] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-06T22:07:10.402017] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-06T22:07:10.618498] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-06T22:07:10.620939] [INFO ] [REMOTE ] UHS: Full fetch complete (58347 records). [2025-10-06T22:07:10.621022] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-06T22:07:10.953485] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-06T22:07:11.019436] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-06T22:07:11.085027] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-06T22:07:11.088087] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-06T22:07:11.093091] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-06T22:07:11.095731] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-06T22:07:11.094339] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T22:07:11.097010] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-06T22:07:11.096593] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-06T22:07:11.106269] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-06T22:07:11.108667] [DEBUG] [LOCAL ] UHS: Trimmed 58347 records to 40758 (keeping 200 days of data) [2025-10-06T22:07:11.370157] [DEBUG] [LOCAL ] UHS: Primary data saved (40758 records). [2025-10-06T22:07:11.370331] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-06T22:07:11.370429] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHS took 17.7s. Estimated remaining: 27m 13s. Rate: 7.1 symbols/min [2025-10-06T22:07:11.543382] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:11.602287] [DEBUG] [LOCAL ] UL: Loaded 53843 existing records from primary storage. [2025-10-06T22:07:11.602698] [INFO ] [MAIN ] UL: Loaded 53843 existing records. [2025-10-06T22:07:11.819043] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:11.819389] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-06T22:07:11.819502] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-06T22:07:11.828967] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-06T22:07:11.829158] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-06T22:07:11.842948] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-06T22:07:11.892970] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-06T22:07:11.960962] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T22:07:11.989484] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-06T22:07:12.245725] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:12.246837] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-06T22:07:12.652381] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T22:07:12.661720] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-06T22:07:12.674399] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-06T22:07:12.679283] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-06T22:07:12.694090] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T22:07:12.697188] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-06T22:07:13.172335] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T22:07:13.173479] [INFO ] [REMOTE ] UHT: Full fetch complete (14994 records). [2025-10-06T22:07:13.173565] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-06T22:07:13.544022] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-06T22:07:13.544251] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-06T22:07:13.544740] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-06T22:07:13.544863] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-06T22:07:13.545437] [DEBUG] [LOCAL ] UHT: Trimmed 14994 records to 9990 (keeping 200 days of data) [2025-10-06T22:07:13.611913] [DEBUG] [LOCAL ] UHT: Primary data saved (9990 records). [2025-10-06T22:07:13.612368] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-06T22:07:13.612761] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UHT took 11.0s. Estimated remaining: 27m 4s. Rate: 7.1 symbols/min [2025-10-06T22:07:13.702705] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T22:07:13.736090] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-06T22:07:13.821023] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:13.853991] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-06T22:07:13.864542] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-06T22:07:13.905243] [DEBUG] [LOCAL ] ULS: Loaded 39966 existing records from primary storage. [2025-10-06T22:07:13.905700] [INFO ] [MAIN ] ULS: Loaded 39966 existing records. [2025-10-06T22:07:14.100633] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:14.101213] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-06T22:07:14.101297] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-06T22:07:14.101972] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-06T22:07:14.102181] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-06T22:07:14.312697] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-06T22:07:14.368316] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-06T22:07:14.523512] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:14.524015] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-06T22:07:14.603193] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T22:07:14.610132] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-06T22:07:15.381771] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T22:07:15.390315] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-06T22:07:15.820831] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T22:07:15.825813] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-06T22:07:16.108905] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T22:07:16.119840] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-06T22:07:16.391349] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-06T22:07:16.410895] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-06T22:07:16.646454] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T22:07:16.648699] [INFO ] [REMOTE ] UI: Full fetch complete (18631 records). [2025-10-06T22:07:16.648836] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-06T22:07:17.109475] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T22:07:17.164992] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-06T22:07:17.241033] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-06T22:07:17.241124] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-06T22:07:17.241600] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-06T22:07:17.241692] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-06T22:07:17.242488] [DEBUG] [LOCAL ] UI: Trimmed 18631 records to 13266 (keeping 200 days of data) [2025-10-06T22:07:17.330319] [DEBUG] [LOCAL ] UI: Primary data saved (13266 records). [2025-10-06T22:07:17.330483] [INFO ] [MAIN ] UI: Full history saved. [2025-10-06T22:07:17.330597] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UI took 12.3s. Estimated remaining: 26m 55s. Rate: 7.1 symbols/min [2025-10-06T22:07:17.529123] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T22:07:17.540903] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-06T22:07:17.540437] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:17.592733] [DEBUG] [LOCAL ] UMC: Loaded 53480 existing records from primary storage. [2025-10-06T22:07:17.593204] [INFO ] [MAIN ] UMC: Loaded 53480 existing records. [2025-10-06T22:07:17.773223] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:17.773443] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-06T22:07:17.773489] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-06T22:07:17.773766] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-06T22:07:17.773825] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-06T22:07:18.181125] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:18.181887] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-06T22:07:18.219796] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T22:07:18.232253] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-06T22:07:18.305819] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T22:07:18.313783] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-06T22:07:18.873701] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T22:07:18.884913] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-06T22:07:19.557735] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T22:07:19.566984] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-06T22:07:20.081376] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T22:07:20.092588] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-06T22:07:20.128894] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T22:07:20.140907] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-06T22:07:20.310598] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-06T22:07:20.318580] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-06T22:07:20.693554] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-06T22:07:20.701209] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-06T22:07:21.600217] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-06T22:07:21.609978] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-06T22:07:21.868381] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T22:07:21.871472] [INFO ] [REMOTE ] UIS: Full fetch complete (51931 records). [2025-10-06T22:07:21.871814] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-06T22:07:22.279670] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-06T22:07:22.344272] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-06T22:07:22.345884] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-06T22:07:22.348017] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-06T22:07:22.346619] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-06T22:07:22.349456] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-06T22:07:22.351698] [DEBUG] [LOCAL ] UIS: Trimmed 51931 records to 37035 (keeping 200 days of data) [2025-10-06T22:07:22.500200] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-06T22:07:22.516536] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-06T22:07:22.651270] [DEBUG] [LOCAL ] UIS: Primary data saved (37035 records). [2025-10-06T22:07:22.651432] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-06T22:07:22.651522] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UIS took 17.4s. Estimated remaining: 26m 46s. Rate: 7.1 symbols/min [2025-10-06T22:07:22.849423] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:22.890660] [DEBUG] [LOCAL ] UMH: Loaded 34124 existing records from primary storage. [2025-10-06T22:07:22.891061] [INFO ] [MAIN ] UMH: Loaded 34124 existing records. [2025-10-06T22:07:23.083791] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:23.084275] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-06T22:07:23.084385] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-06T22:07:23.084914] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-06T22:07:23.084978] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-06T22:07:23.286565] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T22:07:23.392802] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-06T22:07:23.566061] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:23.566867] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-06T22:07:24.034165] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T22:07:24.047008] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-06T22:07:24.145121] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T22:07:24.156125] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-06T22:07:24.560342] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T22:07:24.568134] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-06T22:07:24.918680] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T22:07:24.927151] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-06T22:07:25.399266] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T22:07:25.410222] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-06T22:07:25.457757] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-06T22:07:25.464930] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-06T22:07:25.898535] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T22:07:25.909952] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-06T22:07:26.218248] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T22:07:26.223964] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-06T22:07:26.358707] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T22:07:26.367235] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-06T22:07:27.145085] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T22:07:27.159747] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-06T22:07:27.414550] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-06T22:07:27.431230] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-06T22:07:27.575798] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-06T22:07:27.585416] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-06T22:07:27.658822] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T22:07:27.669964] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-06T22:07:28.726627] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T22:07:28.740132] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-06T22:07:28.820074] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T22:07:28.832958] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-06T22:07:28.991902] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T22:07:29.000618] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-06T22:07:29.055813] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-06T22:07:29.064193] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-06T22:07:30.192007] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T22:07:30.194745] [INFO ] [REMOTE ] ULS: Full fetch complete (54274 records). [2025-10-06T22:07:30.195579] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-06T22:07:30.315464] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-06T22:07:30.433728] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-06T22:07:30.785112] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-06T22:07:30.808580] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-06T22:07:30.831083] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-06T22:07:30.834805] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-06T22:07:30.838327] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-06T22:07:30.832089] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-06T22:07:30.838589] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-06T22:07:30.853041] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-06T22:07:30.855004] [DEBUG] [LOCAL ] ULS: Trimmed 54274 records to 39399 (keeping 200 days of data) [2025-10-06T22:07:31.104868] [DEBUG] [LOCAL ] ULS: Primary data saved (39399 records). [2025-10-06T22:07:31.105034] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-06T22:07:31.105121] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. ULS took 17.5s. Estimated remaining: 26m 38s. Rate: 7.1 symbols/min [2025-10-06T22:07:31.274687] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:31.290876] [DEBUG] [LOCAL ] UNF: Loaded 12204 existing records from primary storage. [2025-10-06T22:07:31.291131] [INFO ] [MAIN ] UNF: Loaded 12204 existing records. [2025-10-06T22:07:31.471955] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:31.472207] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-06T22:07:31.472254] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-06T22:07:31.472442] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-06T22:07:31.472500] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-06T22:07:31.841555] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:31.842051] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-06T22:07:32.006957] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T22:07:32.122493] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-06T22:07:32.362207] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-06T22:07:32.366178] [INFO ] [REMOTE ] UL: Full fetch complete (76892 records). [2025-10-06T22:07:32.366409] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-06T22:07:32.639446] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T22:07:32.700451] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-06T22:07:32.894196] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-06T22:07:32.894352] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-06T22:07:32.896820] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-06T22:07:32.896908] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-06T22:07:32.899311] [DEBUG] [LOCAL ] UL: Trimmed 76892 records to 53070 (keeping 200 days of data) [2025-10-06T22:07:32.958038] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-06T22:07:33.280175] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-06T22:07:33.314328] [DEBUG] [LOCAL ] UL: Primary data saved (53070 records). [2025-10-06T22:07:33.314568] [INFO ] [MAIN ] UL: Full history saved. [2025-10-06T22:07:33.315763] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. UL took 21.9s. Estimated remaining: 26m 29s. Rate: 7.1 symbols/min [2025-10-06T22:07:33.506017] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:33.554276] [DEBUG] [LOCAL ] UNFI: Loaded 42709 existing records from primary storage. [2025-10-06T22:07:33.554723] [INFO ] [MAIN ] UNFI: Loaded 42709 existing records. [2025-10-06T22:07:33.743602] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:33.736722] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-06T22:07:33.744134] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-06T22:07:33.745412] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-06T22:07:33.746297] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-06T22:07:33.746422] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-06T22:07:34.121125] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:34.522588] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-06T22:07:34.795035] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T22:07:34.868756] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-06T22:07:35.322596] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-06T22:07:35.670017] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T22:07:36.122531] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-06T22:07:36.922538] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-06T22:07:36.926186] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T22:07:37.483222] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T22:07:37.722557] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-06T22:07:38.055615] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T22:07:38.522552] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-06T22:07:38.983702] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T22:07:39.322536] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-06T22:07:39.928869] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T22:07:40.122556] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-06T22:07:40.676120] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-06T22:07:40.923201] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-06T22:07:40.923120] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-06T22:07:41.722509] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-06T22:07:41.860148] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T22:07:42.522568] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-06T22:07:43.125071] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T22:07:43.128100] [INFO ] [REMOTE ] UMC: Full fetch complete (76583 records). [2025-10-06T22:07:43.128208] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-06T22:07:43.329488] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-06T22:07:43.527852] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-06T22:07:43.527991] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-06T22:07:43.529538] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-06T22:07:43.529636] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-06T22:07:43.531332] [DEBUG] [LOCAL ] UMC: Trimmed 76583 records to 52712 (keeping 200 days of data) [2025-10-06T22:07:43.631026] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T22:07:43.858489] [DEBUG] [LOCAL ] UMC: Primary data saved (52712 records). [2025-10-06T22:07:43.858625] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-06T22:07:43.858758] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMC took 26.5s. Estimated remaining: 26m 21s. Rate: 7.1 symbols/min [2025-10-06T22:07:44.031248] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:44.084117] [DEBUG] [LOCAL ] UNH: Loaded 54575 existing records from primary storage. [2025-10-06T22:07:44.084494] [INFO ] [MAIN ] UNH: Loaded 54575 existing records. [2025-10-06T22:07:44.127771] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-06T22:07:44.266269] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:44.266519] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-06T22:07:44.266587] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-06T22:07:44.266840] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-06T22:07:44.266897] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-06T22:07:44.631571] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:44.761382] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T22:07:44.922518] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-06T22:07:45.301614] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T22:07:45.304228] [INFO ] [REMOTE ] UMH: Full fetch complete (46814 records). [2025-10-06T22:07:45.304381] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-06T22:07:45.728305] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-06T22:07:45.731222] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-06T22:07:45.732446] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-06T22:07:45.734391] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-06T22:07:45.734577] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-06T22:07:45.736062] [DEBUG] [LOCAL ] UMH: Trimmed 46814 records to 33730 (keeping 200 days of data) [2025-10-06T22:07:45.968146] [DEBUG] [LOCAL ] UMH: Primary data saved (33730 records). [2025-10-06T22:07:45.968408] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-06T22:07:45.968567] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UMH took 23.3s. Estimated remaining: 26m 12s. Rate: 7.1 symbols/min [2025-10-06T22:07:46.164672] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:46.216197] [DEBUG] [LOCAL ] UNM: Loaded 49114 existing records from primary storage. [2025-10-06T22:07:46.216760] [INFO ] [MAIN ] UNM: Loaded 49114 existing records. [2025-10-06T22:07:46.400561] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-06T22:07:46.453989] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:46.454924] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-06T22:07:46.454987] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-06T22:07:46.455299] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-06T22:07:46.455361] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-06T22:07:46.529234] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-06T22:07:46.857586] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:47.322561] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-06T22:07:47.336859] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-06T22:07:48.122538] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-06T22:07:48.160321] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-06T22:07:48.907089] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T22:07:48.922505] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-06T22:07:49.722519] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-06T22:07:49.760317] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-06T22:07:49.868814] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T22:07:50.522538] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-06T22:07:51.295299] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T22:07:51.322479] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-06T22:07:51.890468] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-06T22:07:52.091212] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-06T22:07:52.122568] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-06T22:07:52.922511] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-06T22:07:53.722553] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-06T22:07:53.759958] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T22:07:54.522566] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-06T22:07:54.575131] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-06T22:07:54.748823] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-06T22:07:55.322551] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-06T22:07:56.122495] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-06T22:07:56.227776] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T22:07:56.922503] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-06T22:07:57.472391] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-06T22:07:57.569464] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T22:07:57.570820] [INFO ] [REMOTE ] UNF: Full fetch complete (17374 records). [2025-10-06T22:07:57.570897] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-06T22:07:57.726178] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-06T22:07:58.035392] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T22:07:58.032182] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-06T22:07:58.044485] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-06T22:07:58.045438] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-06T22:07:58.045535] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-06T22:07:58.046681] [DEBUG] [LOCAL ] UNF: Trimmed 17374 records to 12103 (keeping 200 days of data) [2025-10-06T22:07:58.132053] [DEBUG] [LOCAL ] UNF: Primary data saved (12103 records). [2025-10-06T22:07:58.132263] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-06T22:07:58.132368] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UNF took 27.0s. Estimated remaining: 26m 3s. Rate: 7.1 symbols/min [2025-10-06T22:07:58.314613] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:07:58.321850] [DEBUG] [LOCAL ] UNMA: Loaded 3553 existing records from primary storage. [2025-10-06T22:07:58.322118] [INFO ] [MAIN ] UNMA: Loaded 3553 existing records. [2025-10-06T22:07:58.502830] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:07:58.503112] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-06T22:07:58.503166] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-06T22:07:58.503341] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-06T22:07:58.503403] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-06T22:07:58.534281] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-06T22:07:58.908566] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:07:58.954688] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-06T22:07:59.322544] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-06T22:07:59.932250] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-06T22:08:00.122602] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-06T22:08:00.922554] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-06T22:08:00.953786] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T22:08:01.342316] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-06T22:08:01.722532] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-06T22:08:02.325856] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T22:08:02.522560] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-06T22:08:03.322569] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-06T22:08:03.895918] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-06T22:08:04.095399] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T22:08:04.122499] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-06T22:08:04.225088] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-06T22:08:04.922542] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-06T22:08:05.304291] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-06T22:08:05.307484] [INFO ] [REMOTE ] UNFI: Full fetch complete (59377 records). [2025-10-06T22:08:05.307767] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-06T22:08:05.562461] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-06T22:08:05.728374] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-06T22:08:05.730689] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-06T22:08:05.730830] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-06T22:08:05.732519] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-06T22:08:05.732744] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-06T22:08:05.734708] [DEBUG] [LOCAL ] UNFI: Trimmed 59377 records to 42224 (keeping 200 days of data) [2025-10-06T22:08:06.009558] [DEBUG] [LOCAL ] UNFI: Primary data saved (42224 records). [2025-10-06T22:08:06.009868] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-06T22:08:06.010033] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNFI took 32.7s. Estimated remaining: 25m 55s. Rate: 7.1 symbols/min [2025-10-06T22:08:06.191525] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:08:06.254596] [DEBUG] [LOCAL ] UNP: Loaded 54045 existing records from primary storage. [2025-10-06T22:08:06.255077] [INFO ] [MAIN ] UNP: Loaded 54045 existing records. [2025-10-06T22:08:06.446413] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:08:06.446780] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-06T22:08:06.446855] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-06T22:08:06.447197] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-06T22:08:06.447267] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-06T22:08:06.527745] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-06T22:08:06.841472] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:08:07.188026] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-06T22:08:07.322538] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-06T22:08:07.571844] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-06T22:08:08.122533] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-06T22:08:08.922623] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-06T22:08:09.457898] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-06T22:08:09.722611] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-06T22:08:09.829051] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T22:08:10.105871] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-06T22:08:10.123326] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-06T22:08:10.522558] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-06T22:08:11.322561] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-06T22:08:12.122520] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-06T22:08:12.922555] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-06T22:08:13.116697] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T22:08:13.370417] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-06T22:08:13.497366] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-06T22:08:13.729626] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-06T22:08:13.756512] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T22:08:14.522557] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-06T22:08:15.083047] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T22:08:15.322543] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-06T22:08:15.623067] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T22:08:16.122550] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-06T22:08:16.804851] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-06T22:08:16.922545] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-06T22:08:17.722528] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-06T22:08:17.910533] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T22:08:18.295850] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-06T22:08:18.534113] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-06T22:08:18.541557] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T22:08:18.948584] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-06T22:08:18.949518] [INFO ] [REMOTE ] UNMA: Full fetch complete (5752 records). [2025-10-06T22:08:18.949594] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-06T22:08:19.327559] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-06T22:08:19.353549] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-06T22:08:19.353700] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-06T22:08:19.353965] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-06T22:08:19.354037] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-06T22:08:19.354480] [DEBUG] [LOCAL ] UNMA: Trimmed 5752 records to 3501 (keeping 200 days of data) [2025-10-06T22:08:19.377983] [DEBUG] [LOCAL ] UNMA: Primary data saved (3501 records). [2025-10-06T22:08:19.378070] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-06T22:08:19.378168] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNMA took 21.2s. Estimated remaining: 25m 47s. Rate: 7.1 symbols/min [2025-10-06T22:08:19.545966] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:08:19.588957] [DEBUG] [LOCAL ] UP: Loaded 43915 existing records from primary storage. [2025-10-06T22:08:19.589325] [INFO ] [MAIN ] UP: Loaded 43915 existing records. [2025-10-06T22:08:19.764090] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:08:19.764312] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-06T22:08:19.764358] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-06T22:08:19.764633] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-06T22:08:19.764729] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-06T22:08:20.110412] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:08:20.122478] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-06T22:08:20.922573] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-06T22:08:21.227440] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T22:08:21.693636] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T22:08:21.722521] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-06T22:08:22.522601] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-06T22:08:23.254893] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-06T22:08:23.322537] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-06T22:08:23.831558] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-10-06T22:08:23.880563] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-06T22:08:24.122550] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-06T22:08:24.667907] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-06T22:08:24.922534] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-06T22:08:25.175348] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T22:08:25.178027] [INFO ] [REMOTE ] UNM: Full fetch complete (69944 records). [2025-10-06T22:08:25.178140] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-06T22:08:25.602787] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-06T22:08:25.602922] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-06T22:08:25.604122] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-06T22:08:25.604188] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-06T22:08:25.605907] [DEBUG] [LOCAL ] UNM: Trimmed 69944 records to 48326 (keeping 200 days of data) [2025-10-06T22:08:25.722606] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-06T22:08:25.934873] [DEBUG] [LOCAL ] UNM: Primary data saved (48326 records). [2025-10-06T22:08:25.935037] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-06T22:08:25.935126] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNM took 40.0s. Estimated remaining: 25m 38s. Rate: 7.1 symbols/min [2025-10-06T22:08:26.106160] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:08:26.157236] [DEBUG] [LOCAL ] UPS: Loaded 54492 existing records from primary storage. [2025-10-06T22:08:26.157597] [INFO ] [MAIN ] UPS: Loaded 54492 existing records. [2025-10-06T22:08:26.338365] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:08:26.338798] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-06T22:08:26.338854] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-06T22:08:26.339090] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-06T22:08:26.339147] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-06T22:08:26.530016] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-06T22:08:26.673162] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T22:08:26.761423] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:08:27.322584] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-06T22:08:28.122497] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-06T22:08:28.533022] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-10-06T22:08:28.683711] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-06T22:08:28.922483] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-06T22:08:29.341088] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-06T22:08:29.457181] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-06T22:08:29.722593] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-06T22:08:30.522510] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-06T22:08:30.859299] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-06T22:08:31.322507] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-06T22:08:31.356976] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T22:08:32.122494] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-06T22:08:32.535445] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-06T22:08:32.922533] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-06T22:08:33.141398] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-06T22:08:33.210752] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-06T22:08:33.722568] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-06T22:08:34.177190] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T22:08:34.180242] [INFO ] [REMOTE ] UNH: Full fetch complete (77866 records). [2025-10-06T22:08:34.180353] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-06T22:08:34.532626] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-06T22:08:34.582580] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-06T22:08:34.582703] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-06T22:08:34.583897] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-06T22:08:34.583962] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-06T22:08:34.585538] [DEBUG] [LOCAL ] UNH: Trimmed 77866 records to 53801 (keeping 200 days of data) [2025-10-06T22:08:34.927884] [DEBUG] [LOCAL ] UNH: Primary data saved (53801 records). [2025-10-06T22:08:34.928041] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-06T22:08:34.928759] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNH took 51.1s. Estimated remaining: 25m 30s. Rate: 7.1 symbols/min [2025-10-06T22:08:35.100839] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:08:35.131470] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-06T22:08:35.176430] [DEBUG] [LOCAL ] URI: Loaded 36051 existing records from primary storage. [2025-10-06T22:08:35.176769] [INFO ] [MAIN ] URI: Loaded 36051 existing records. [2025-10-06T22:08:35.331232] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-06T22:08:35.362690] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:08:35.363052] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-06T22:08:35.363101] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-06T22:08:35.363744] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-06T22:08:35.363803] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-06T22:08:35.717595] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:08:36.122548] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-06T22:08:36.374697] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T22:08:36.922491] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-06T22:08:37.058115] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T22:08:37.724295] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-06T22:08:37.729387] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T22:08:38.522488] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-06T22:08:39.003096] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-06T22:08:39.322506] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-06T22:08:39.436064] [DEBUG] [REMOTE ] URI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-06T22:08:39.436451] [WARN ] [REMOTE ] URI: No data returned for month 2025-01 [2025-10-06T22:08:39.436545] [FATAL] [REMOTE ] URI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:08:39.436705] [FATAL] [MAIN ] URI: Failed to fetch primary data. [2025-10-06T22:08:39.436775] [WARN ] [MAIN ] URI: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:08:39.436847] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-06T22:08:39.436914] [DEBUG] [LOCAL ] URI: No primary data file found to delete. [2025-10-06T22:08:39.436948] [INFO ] [LOCAL ] URI: Starting deletion of derivative data. [2025-10-06T22:08:39.437216] [DEBUG] [LOCAL ] URI: Deleted derivative data file. [2025-10-06T22:08:39.437310] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. URI took 4.5s. Estimated remaining: 25m 21s. Rate: 7.1 symbols/min [2025-10-06T22:08:39.650717] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:08:39.693032] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-06T22:08:39.738949] [DEBUG] [LOCAL ] USA: Loaded 36520 existing records from primary storage. [2025-10-06T22:08:39.739293] [INFO ] [MAIN ] USA: Loaded 36520 existing records. [2025-10-06T22:08:39.934399] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:08:39.934691] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-06T22:08:39.934751] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-06T22:08:39.935019] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-06T22:08:39.935076] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-06T22:08:40.129092] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-06T22:08:40.306233] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:08:40.332163] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-06T22:08:40.922598] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-06T22:08:41.722554] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-06T22:08:42.522556] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-06T22:08:42.572296] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-06T22:08:42.882566] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-06T22:08:43.093058] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-06T22:08:43.322564] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-06T22:08:44.122560] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-06T22:08:44.432321] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-06T22:08:44.444605] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-06T22:08:44.450600] [INFO ] [REMOTE ] UNP: Full fetch complete (76914 records). [2025-10-06T22:08:44.451036] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-06T22:08:44.884230] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-06T22:08:44.884334] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-06T22:08:44.885595] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-06T22:08:44.885685] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-06T22:08:44.887301] [DEBUG] [LOCAL ] UNP: Trimmed 76914 records to 53295 (keeping 200 days of data) [2025-10-06T22:08:44.943331] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-06T22:08:45.259871] [DEBUG] [LOCAL ] UNP: Primary data saved (53295 records). [2025-10-06T22:08:45.260062] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-06T22:08:45.261283] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. UNP took 39.3s. Estimated remaining: 25m 12s. Rate: 7.1 symbols/min [2025-10-06T22:08:45.439837] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:08:45.464880] [DEBUG] [LOCAL ] USAC: Loaded 22441 existing records from primary storage. [2025-10-06T22:08:45.465175] [INFO ] [MAIN ] USAC: Loaded 22441 existing records. [2025-10-06T22:08:45.649269] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:08:45.649752] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-06T22:08:45.649859] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-06T22:08:45.650122] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-06T22:08:45.650186] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-06T22:08:45.739017] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-06T22:08:45.962134] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-06T22:08:46.070439] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:08:46.091816] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-06T22:08:46.522568] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-06T22:08:47.322527] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-06T22:08:47.471374] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-06T22:08:47.474881] [INFO ] [REMOTE ] UP: Full fetch complete (62519 records). [2025-10-06T22:08:47.475019] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-06T22:08:47.899138] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-06T22:08:47.899246] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-06T22:08:47.900837] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-06T22:08:47.900910] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-06T22:08:47.902675] [DEBUG] [LOCAL ] UP: Trimmed 62519 records to 43406 (keeping 200 days of data) [2025-10-06T22:08:48.127205] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-06T22:08:48.181672] [DEBUG] [LOCAL ] UP: Primary data saved (43406 records). [2025-10-06T22:08:48.181876] [INFO ] [MAIN ] UP: Full history saved. [2025-10-06T22:08:48.181986] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. UP took 28.8s. Estimated remaining: 25m 4s. Rate: 7.1 symbols/min [2025-10-06T22:08:48.365178] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:08:48.425315] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-10-06T22:08:48.425839] [INFO ] [MAIN ] USB: Loaded 54468 existing records. [2025-10-06T22:08:48.662985] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:08:48.666925] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-06T22:08:48.667093] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-06T22:08:48.677508] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-06T22:08:48.685989] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-06T22:08:48.696353] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-06T22:08:48.727192] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T22:08:48.927627] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-06T22:08:49.102636] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:08:49.238454] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-06T22:08:49.722552] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-06T22:08:50.511239] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-06T22:08:50.522478] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-06T22:08:51.322506] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-06T22:08:51.471137] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T22:08:51.644840] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T22:08:52.122571] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-06T22:08:52.178223] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-06T22:08:52.922587] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-06T22:08:53.722589] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-06T22:08:54.041125] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T22:08:54.041904] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-06T22:08:54.522578] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-06T22:08:55.322562] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-06T22:08:55.929822] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T22:08:56.017782] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-06T22:08:56.122543] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-06T22:08:56.737403] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T22:08:56.922569] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-06T22:08:57.179565] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T22:08:57.722584] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-06T22:08:58.294282] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T22:08:58.522519] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-06T22:08:59.322529] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-06T22:08:59.643546] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-06T22:09:00.122626] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-06T22:09:00.788256] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-06T22:09:00.922490] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-06T22:09:01.100006] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-06T22:09:01.722560] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-06T22:09:02.212107] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-06T22:09:02.522630] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-06T22:09:03.171142] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T22:09:03.322521] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-06T22:09:03.443608] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-06T22:09:03.469002] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-06T22:09:04.122598] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-06T22:09:04.851129] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-06T22:09:04.922606] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-06T22:09:05.266937] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T22:09:05.722557] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-06T22:09:06.522488] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-06T22:09:06.847939] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-06T22:09:06.918869] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-06T22:09:07.322568] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-06T22:09:07.382166] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T22:09:07.385037] [INFO ] [REMOTE ] USA: Full fetch complete (52069 records). [2025-10-06T22:09:07.385168] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-06T22:09:07.780625] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-06T22:09:07.780820] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-06T22:09:07.781910] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-06T22:09:07.781979] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-06T22:09:07.783369] [DEBUG] [LOCAL ] USA: Trimmed 52069 records to 35963 (keeping 200 days of data) [2025-10-06T22:09:07.888837] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-06T22:09:07.900046] [INFO ] [REMOTE ] UPS: Full fetch complete (77755 records). [2025-10-06T22:09:07.901869] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-06T22:09:08.123731] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-06T22:09:08.355452] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-06T22:09:08.355904] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-06T22:09:08.358804] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-06T22:09:08.360036] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-06T22:09:08.399908] [DEBUG] [LOCAL ] UPS: Trimmed 77755 records to 53714 (keeping 200 days of data) [2025-10-06T22:09:08.591231] [DEBUG] [LOCAL ] USA: Primary data saved (35963 records). [2025-10-06T22:09:08.592540] [INFO ] [MAIN ] USA: Full history saved. [2025-10-06T22:09:08.593044] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. USA took 29.2s. Estimated remaining: 24m 56s. Rate: 7.1 symbols/min [2025-10-06T22:09:08.781947] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:09:08.924778] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-06T22:09:08.928689] [DEBUG] [LOCAL ] USFD: Loaded 51948 existing records from primary storage. [2025-10-06T22:09:08.929623] [INFO ] [MAIN ] USFD: Loaded 51948 existing records. [2025-10-06T22:09:09.128266] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:09:09.129529] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-06T22:09:09.129882] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-06T22:09:09.131146] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-06T22:09:09.133066] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-06T22:09:09.570923] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:09:09.599136] [DEBUG] [LOCAL ] UPS: Primary data saved (53714 records). [2025-10-06T22:09:09.599319] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-06T22:09:09.599421] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. UPS took 43.7s. Estimated remaining: 24m 47s. Rate: 7.1 symbols/min [2025-10-06T22:09:09.724135] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-06T22:09:09.777198] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:09:09.797633] [DEBUG] [LOCAL ] USNA: Loaded 18037 existing records from primary storage. [2025-10-06T22:09:09.798126] [INFO ] [MAIN ] USNA: Loaded 18037 existing records. [2025-10-06T22:09:09.994335] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:09:10.000583] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-06T22:09:10.008613] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-06T22:09:10.010094] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T22:09:10.010259] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-06T22:09:10.010738] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-06T22:09:10.193511] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-06T22:09:10.481385] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:09:10.522695] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-06T22:09:11.219161] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T22:09:11.322516] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-06T22:09:11.508383] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-06T22:09:12.122560] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-06T22:09:12.922511] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-06T22:09:12.995129] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T22:09:13.222948] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-06T22:09:13.722518] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-06T22:09:13.900346] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T22:09:14.522625] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-06T22:09:15.336269] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-06T22:09:15.342500] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T22:09:15.364827] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T22:09:16.122499] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-06T22:09:16.274853] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T22:09:16.276351] [INFO ] [REMOTE ] USAC: Full fetch complete (35330 records). [2025-10-06T22:09:16.276424] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-06T22:09:16.657744] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-06T22:09:16.657833] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-06T22:09:16.658599] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-06T22:09:16.658693] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-06T22:09:16.659551] [DEBUG] [LOCAL ] USAC: Trimmed 35330 records to 21843 (keeping 200 days of data) [2025-10-06T22:09:16.809304] [DEBUG] [LOCAL ] USAC: Primary data saved (21843 records). [2025-10-06T22:09:16.809460] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-06T22:09:16.809553] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USAC took 31.5s. Estimated remaining: 24m 38s. Rate: 7.1 symbols/min [2025-10-06T22:09:16.927610] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-06T22:09:16.989712] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:09:17.009850] [DEBUG] [LOCAL ] USPH: Loaded 17051 existing records from primary storage. [2025-10-06T22:09:17.010133] [INFO ] [MAIN ] USPH: Loaded 17051 existing records. [2025-10-06T22:09:17.191629] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:09:17.191993] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-06T22:09:17.192167] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-06T22:09:17.192369] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-06T22:09:17.192427] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-06T22:09:17.334116] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-06T22:09:17.607828] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:09:17.722555] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-06T22:09:18.522556] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-06T22:09:18.703951] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-06T22:09:18.706098] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-06T22:09:19.322590] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-06T22:09:20.122630] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-06T22:09:20.214856] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-06T22:09:20.314521] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T22:09:20.922588] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-06T22:09:21.722490] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-06T22:09:21.843694] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T22:09:22.522498] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-06T22:09:22.544536] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-06T22:09:22.833509] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-06T22:09:23.322545] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-06T22:09:24.122523] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-06T22:09:24.222428] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T22:09:24.242283] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T22:09:24.922516] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-06T22:09:25.235607] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-06T22:09:25.722525] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-06T22:09:26.522548] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-06T22:09:26.827088] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T22:09:27.287678] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T22:09:27.322482] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-06T22:09:27.340996] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-06T22:09:28.122546] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-06T22:09:28.599109] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T22:09:28.602988] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-10-06T22:09:28.603155] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-06T22:09:28.927784] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-06T22:09:29.043561] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-06T22:09:29.043802] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-06T22:09:29.046987] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-06T22:09:29.047127] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-06T22:09:29.080534] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 53688 (keeping 200 days of data) [2025-10-06T22:09:29.088568] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-06T22:09:29.458715] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-10-06T22:09:29.458903] [INFO ] [MAIN ] USB: Full history saved. [2025-10-06T22:09:29.459022] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USB took 41.3s. Estimated remaining: 24m 30s. Rate: 7.1 symbols/min [2025-10-06T22:09:29.722496] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-06T22:09:29.954559] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-06T22:09:30.522534] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-06T22:09:31.322542] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-06T22:09:31.527068] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T22:09:31.597600] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T22:09:32.122560] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-06T22:09:32.291439] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-06T22:09:32.674003] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T22:09:32.922627] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-06T22:09:33.722515] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-06T22:09:33.947451] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-06T22:09:34.522499] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-06T22:09:34.671924] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-06T22:09:35.317934] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-06T22:09:35.322462] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-06T22:09:36.122508] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-06T22:09:36.320749] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T22:09:36.922555] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-06T22:09:37.724788] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-06T22:09:37.744361] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-06T22:09:38.115131] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-06T22:09:38.436618] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-06T22:09:38.438313] [INFO ] [REMOTE ] USNA: Full fetch complete (26556 records). [2025-10-06T22:09:38.438456] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-06T22:09:38.527725] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-06T22:09:38.843092] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-06T22:09:38.843231] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-06T22:09:38.843882] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-06T22:09:38.843963] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-06T22:09:38.844753] [DEBUG] [LOCAL ] USNA: Trimmed 26556 records to 17731 (keeping 200 days of data) [2025-10-06T22:09:38.951716] [DEBUG] [LOCAL ] USNA: Primary data saved (17731 records). [2025-10-06T22:09:38.951908] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-06T22:09:38.952022] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USNA took 29.4s. Estimated remaining: 24m 22s. Rate: 7.1 symbols/min [2025-10-06T22:09:39.322566] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-06T22:09:39.548037] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-06T22:09:40.122569] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-06T22:09:40.688921] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T22:09:40.692594] [INFO ] [REMOTE ] USFD: Full fetch complete (74034 records). [2025-10-06T22:09:40.692790] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-06T22:09:41.126947] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T22:09:41.126486] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-06T22:09:41.127265] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-06T22:09:41.133055] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-06T22:09:41.133738] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-06T22:09:41.134485] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-06T22:09:41.136970] [DEBUG] [LOCAL ] USFD: Trimmed 74034 records to 51207 (keeping 200 days of data) [2025-10-06T22:09:41.472165] [DEBUG] [LOCAL ] USFD: Primary data saved (51207 records). [2025-10-06T22:09:41.472366] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-06T22:09:41.472475] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USFD took 32.9s. Estimated remaining: 24m 13s. Rate: 7.1 symbols/min [2025-10-06T22:09:41.964726] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-06T22:09:41.966579] [INFO ] [REMOTE ] USPH: Full fetch complete (22861 records). [2025-10-06T22:09:41.966697] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-06T22:09:42.343576] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-06T22:09:42.343697] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-06T22:09:42.344568] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-06T22:09:42.344619] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-06T22:09:42.345396] [DEBUG] [LOCAL ] USPH: Trimmed 22861 records to 16926 (keeping 200 days of data) [2025-10-06T22:09:42.461280] [DEBUG] [LOCAL ] USPH: Primary data saved (16926 records). [2025-10-06T22:09:42.461489] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-06T22:09:42.461588] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USPH took 25.7s. Estimated remaining: 24m 4s. Rate: 7.1 symbols/min [2025-10-06T22:09:43.127581] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:09:43.287867] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:09:43.330439] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:09:43.369295] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:09:43.392359] [DEBUG] [LOCAL ] UTL: Loaded 11543 existing records from primary storage. [2025-10-06T22:09:43.409343] [INFO ] [MAIN ] UTL: Loaded 11543 existing records. [2025-10-06T22:09:43.571429] [DEBUG] [LOCAL ] UTZ: Loaded 45390 existing records from primary storage. [2025-10-06T22:09:43.572392] [DEBUG] [LOCAL ] UTF: Loaded 29987 existing records from primary storage. [2025-10-06T22:09:43.595848] [INFO ] [MAIN ] UTZ: Loaded 45390 existing records. [2025-10-06T22:09:43.631208] [INFO ] [MAIN ] UTF: Loaded 29987 existing records. [2025-10-06T22:09:43.646861] [DEBUG] [LOCAL ] UTI: Loaded 41039 existing records from primary storage. [2025-10-06T22:09:43.746306] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:09:43.756771] [INFO ] [MAIN ] UTI: Loaded 41039 existing records. [2025-10-06T22:09:43.841005] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-06T22:09:43.841190] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-06T22:09:43.878806] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-06T22:09:43.946144] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-06T22:09:44.327379] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:09:44.432449] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:09:44.444450] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-06T22:09:44.460123] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-06T22:09:44.527916] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:09:44.535813] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-06T22:09:44.523694] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-06T22:09:44.536200] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-06T22:09:44.546391] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-06T22:09:44.546773] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-06T22:09:44.560985] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-06T22:09:44.546548] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-06T22:09:44.561154] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-06T22:09:44.566626] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-06T22:09:44.589086] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-06T22:09:45.263999] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:09:45.297038] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-06T22:09:45.783161] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:09:45.784269] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-06T22:09:45.945749] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:09:45.968627] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-06T22:09:45.968220] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:09:45.970054] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-06T22:09:46.399353] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T22:09:46.402151] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-06T22:09:47.218226] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-06T22:09:47.224487] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-06T22:09:47.285138] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T22:09:47.293500] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-06T22:09:47.303265] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T22:09:47.322477] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-06T22:09:47.427950] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T22:09:48.094229] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-06T22:09:48.117171] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-06T22:09:48.122766] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-06T22:09:48.745760] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-06T22:09:48.922565] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-06T22:09:49.727896] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-06T22:09:49.745947] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T22:09:50.113570] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-06T22:09:50.522689] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-06T22:09:51.106033] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T22:09:51.151551] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-06T22:09:51.322543] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-06T22:09:52.122558] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-06T22:09:52.135817] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T22:09:52.922561] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-06T22:09:53.663875] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T22:09:53.722492] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-06T22:09:54.059146] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T22:09:54.522636] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-06T22:09:55.312504] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T22:09:55.322464] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-06T22:09:56.122513] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-06T22:09:56.147877] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T22:09:56.922499] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-06T22:09:56.967067] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T22:09:56.967573] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T22:09:57.722548] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-06T22:09:58.286584] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-06T22:09:58.522550] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-06T22:09:59.176108] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T22:09:59.322508] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-06T22:09:59.529430] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-06T22:10:00.122599] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-06T22:10:00.933400] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-06T22:10:00.935945] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T22:10:00.974258] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-06T22:10:01.722551] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-06T22:10:02.522512] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-06T22:10:02.562535] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-06T22:10:02.785063] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-06T22:10:03.322540] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-06T22:10:03.811481] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T22:10:04.122549] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-06T22:10:04.922549] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-06T22:10:05.096102] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T22:10:05.736448] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-06T22:10:05.740167] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T22:10:06.237849] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T22:10:06.522570] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-06T22:10:06.738033] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T22:10:07.322553] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-06T22:10:08.122509] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-06T22:10:08.282072] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T22:10:08.490866] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T22:10:08.922512] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-06T22:10:09.274096] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-06T22:10:09.666527] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T22:10:09.668568] [INFO ] [REMOTE ] UTL: Full fetch complete (15566 records). [2025-10-06T22:10:09.668713] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-06T22:10:09.727722] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-06T22:10:10.044183] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-06T22:10:10.044273] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-06T22:10:10.044556] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-06T22:10:10.044623] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-06T22:10:10.045171] [DEBUG] [LOCAL ] UTL: Trimmed 15566 records to 11483 (keeping 200 days of data) [2025-10-06T22:10:10.111444] [DEBUG] [LOCAL ] UTL: Primary data saved (11483 records). [2025-10-06T22:10:10.111578] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-06T22:10:10.111684] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 27.6s. Estimated remaining: 23m 57s. Rate: 7.1 symbols/min [2025-10-06T22:10:10.277342] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:10:10.299219] [DEBUG] [LOCAL ] UVE: Loaded 22153 existing records from primary storage. [2025-10-06T22:10:10.299502] [INFO ] [MAIN ] UVE: Loaded 22153 existing records. [2025-10-06T22:10:10.476741] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:10:10.476978] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-06T22:10:10.477026] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-06T22:10:10.477222] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-06T22:10:10.477279] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-06T22:10:10.530399] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-06T22:10:10.824379] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:10:11.322504] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-06T22:10:11.412062] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T22:10:12.081550] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T22:10:12.122600] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-06T22:10:12.906708] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-06T22:10:12.922678] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-06T22:10:13.690168] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-06T22:10:13.722518] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-06T22:10:13.960483] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T22:10:14.522598] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-06T22:10:15.037133] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T22:10:15.039780] [INFO ] [REMOTE ] UTI: Full fetch complete (58463 records). [2025-10-06T22:10:15.039872] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-06T22:10:15.329016] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-06T22:10:15.469832] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-06T22:10:15.469964] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-06T22:10:15.471272] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-06T22:10:15.471339] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-06T22:10:15.472632] [DEBUG] [LOCAL ] UTI: Trimmed 58463 records to 40526 (keeping 200 days of data) [2025-10-06T22:10:15.721019] [DEBUG] [LOCAL ] UTI: Primary data saved (40526 records). [2025-10-06T22:10:15.721286] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-06T22:10:15.721385] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTI took 33.2s. Estimated remaining: 23m 48s. Rate: 7.1 symbols/min [2025-10-06T22:10:15.900219] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:10:15.928477] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-06T22:10:15.957544] [DEBUG] [LOCAL ] UVV: Loaded 22830 existing records from primary storage. [2025-10-06T22:10:15.957879] [INFO ] [MAIN ] UVV: Loaded 22830 existing records. [2025-10-06T22:10:16.128069] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-06T22:10:16.142220] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:10:16.142544] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-06T22:10:16.142595] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-06T22:10:16.142841] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-06T22:10:16.142897] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-06T22:10:16.521403] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:10:16.582780] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T22:10:16.585983] [INFO ] [REMOTE ] UTF: Full fetch complete (42433 records). [2025-10-06T22:10:16.586137] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-06T22:10:16.928937] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-06T22:10:16.985851] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-06T22:10:16.985964] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-06T22:10:16.987795] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-06T22:10:16.988077] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-06T22:10:16.989621] [DEBUG] [LOCAL ] UTF: Trimmed 42433 records to 29779 (keeping 200 days of data) [2025-10-06T22:10:17.193970] [DEBUG] [LOCAL ] UTF: Primary data saved (29779 records). [2025-10-06T22:10:17.194154] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-06T22:10:17.194253] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTF took 34.7s. Estimated remaining: 23m 39s. Rate: 7.1 symbols/min [2025-10-06T22:10:17.383365] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:10:17.446978] [DEBUG] [LOCAL ] UWMC: Loaded 53552 existing records from primary storage. [2025-10-06T22:10:17.447472] [INFO ] [MAIN ] UWMC: Loaded 53552 existing records. [2025-10-06T22:10:17.644366] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:10:17.645020] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-06T22:10:17.645086] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-06T22:10:17.645334] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-06T22:10:17.645393] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-06T22:10:17.725620] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-06T22:10:17.916293] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T22:10:18.024219] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-06T22:10:18.108991] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:10:18.522550] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-06T22:10:18.856438] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-06T22:10:19.322555] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-06T22:10:19.535042] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T22:10:19.538820] [INFO ] [REMOTE ] UTZ: Full fetch complete (64398 records). [2025-10-06T22:10:19.539179] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-06T22:10:19.965423] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-06T22:10:19.965551] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-06T22:10:19.967390] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-06T22:10:19.967492] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-06T22:10:19.969689] [DEBUG] [LOCAL ] UTZ: Trimmed 64398 records to 44696 (keeping 200 days of data) [2025-10-06T22:10:20.169113] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-06T22:10:20.283435] [DEBUG] [LOCAL ] UTZ: Primary data saved (44696 records). [2025-10-06T22:10:20.283637] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-06T22:10:20.283784] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTZ took 37.8s. Estimated remaining: 23m 31s. Rate: 7.1 symbols/min [2025-10-06T22:10:20.429691] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-06T22:10:20.489571] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:10:20.501766] [DEBUG] [LOCAL ] UZD: Loaded 6490 existing records from primary storage. [2025-10-06T22:10:20.502128] [INFO ] [MAIN ] UZD: Loaded 6490 existing records. [2025-10-06T22:10:20.706125] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:10:20.706906] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-06T22:10:20.706970] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-06T22:10:20.707456] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-06T22:10:20.707519] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-06T22:10:20.927797] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-06T22:10:21.089050] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:10:21.722510] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-06T22:10:21.999767] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-06T22:10:22.056920] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-06T22:10:22.468460] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-06T22:10:22.522547] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-06T22:10:23.322558] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-06T22:10:23.654435] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T22:10:24.122489] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-06T22:10:24.503678] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-06T22:10:24.922595] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-06T22:10:25.634073] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-06T22:10:25.722489] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-06T22:10:25.829853] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T22:10:26.324421] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T22:10:26.522540] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-06T22:10:27.195930] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-06T22:10:27.322528] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-06T22:10:28.122544] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-06T22:10:28.345295] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-06T22:10:28.688552] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-06T22:10:28.922550] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-06T22:10:29.722498] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-06T22:10:30.096112] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T22:10:30.150149] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-06T22:10:30.522596] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-06T22:10:31.127740] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-06T22:10:31.322565] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-06T22:10:31.823090] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-06T22:10:32.122638] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-06T22:10:32.922570] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-06T22:10:33.233016] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T22:10:33.722542] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-06T22:10:34.164239] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-06T22:10:34.230423] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-06T22:10:34.522614] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-06T22:10:35.322498] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-06T22:10:35.398615] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T22:10:36.122525] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-06T22:10:36.424943] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T22:10:36.778490] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-06T22:10:36.922556] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-06T22:10:37.722553] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-06T22:10:38.185558] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T22:10:38.522567] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-06T22:10:39.322520] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-06T22:10:39.358150] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T22:10:39.634450] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T22:10:40.122553] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-06T22:10:40.165290] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-06T22:10:40.922546] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-06T22:10:41.420385] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-06T22:10:41.722579] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-06T22:10:42.473159] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T22:10:42.522506] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-06T22:10:42.811795] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-06T22:10:43.322558] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-06T22:10:44.122512] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-06T22:10:44.321971] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T22:10:44.434367] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-06T22:10:44.471627] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-06T22:10:44.472438] [INFO ] [REMOTE ] UZD: Full fetch complete (9413 records). [2025-10-06T22:10:44.472506] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-06T22:10:44.867378] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-06T22:10:44.867482] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-06T22:10:44.867748] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-06T22:10:44.867808] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-06T22:10:44.868280] [DEBUG] [LOCAL ] UZD: Trimmed 9413 records to 6429 (keeping 200 days of data) [2025-10-06T22:10:44.911549] [DEBUG] [LOCAL ] UZD: Primary data saved (6429 records). [2025-10-06T22:10:44.911741] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-06T22:10:44.911859] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UZD took 24.6s. Estimated remaining: 23m 23s. Rate: 7.1 symbols/min [2025-10-06T22:10:44.928868] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-06T22:10:45.079919] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:10:45.093576] [DEBUG] [LOCAL ] UZE: Loaded 7503 existing records from primary storage. [2025-10-06T22:10:45.093842] [INFO ] [MAIN ] UZE: Loaded 7503 existing records. [2025-10-06T22:10:45.265969] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:10:45.266169] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-06T22:10:45.266213] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-06T22:10:45.266451] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-06T22:10:45.266508] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-06T22:10:45.618557] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:10:45.722516] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-06T22:10:46.116893] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T22:10:46.463831] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T22:10:46.522506] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-06T22:10:47.211827] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-06T22:10:47.322516] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-06T22:10:48.122505] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-06T22:10:48.180546] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T22:10:48.182192] [INFO ] [REMOTE ] UVV: Full fetch complete (30094 records). [2025-10-06T22:10:48.182264] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-06T22:10:48.565480] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-06T22:10:48.565566] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-06T22:10:48.566213] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-06T22:10:48.566273] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-06T22:10:48.567026] [DEBUG] [LOCAL ] UVV: Trimmed 30094 records to 22592 (keeping 200 days of data) [2025-10-06T22:10:48.700507] [DEBUG] [LOCAL ] UVV: Primary data saved (22592 records). [2025-10-06T22:10:48.700682] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-06T22:10:48.700791] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UVV took 33.0s. Estimated remaining: 23m 15s. Rate: 7.1 symbols/min [2025-10-06T22:10:48.867813] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:10:48.876903] [DEBUG] [LOCAL ] UZF: Loaded 6524 existing records from primary storage. [2025-10-06T22:10:48.877122] [INFO ] [MAIN ] UZF: Loaded 6524 existing records. [2025-10-06T22:10:48.930458] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-06T22:10:49.056369] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:10:49.056617] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-06T22:10:49.056694] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-06T22:10:49.056868] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-06T22:10:49.056932] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-06T22:10:49.414337] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:10:49.604502] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-06T22:10:49.722514] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-06T22:10:50.013751] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T22:10:50.511630] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T22:10:50.513383] [INFO ] [REMOTE ] UVE: Full fetch complete (30105 records). [2025-10-06T22:10:50.513456] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-06T22:10:50.527711] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-06T22:10:50.886055] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-06T22:10:50.886145] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-06T22:10:50.886793] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-06T22:10:50.886896] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-06T22:10:50.887676] [DEBUG] [LOCAL ] UVE: Trimmed 30105 records to 21954 (keeping 200 days of data) [2025-10-06T22:10:51.021174] [DEBUG] [LOCAL ] UVE: Primary data saved (21954 records). [2025-10-06T22:10:51.021329] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-06T22:10:51.021417] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UVE took 40.9s. Estimated remaining: 23m 6s. Rate: 7.1 symbols/min [2025-10-06T22:10:51.211075] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:10:51.265744] [DEBUG] [LOCAL ] V: Loaded 54535 existing records from primary storage. [2025-10-06T22:10:51.266083] [INFO ] [MAIN ] V: Loaded 54535 existing records. [2025-10-06T22:10:51.328183] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-06T22:10:51.375625] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T22:10:51.456315] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:10:51.456575] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-06T22:10:51.456624] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-06T22:10:51.456942] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-06T22:10:51.456998] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-06T22:10:51.840881] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:10:52.122558] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-06T22:10:52.824530] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-06T22:10:52.922514] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-06T22:10:53.536219] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T22:10:53.722520] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-06T22:10:54.133535] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-06T22:10:54.320226] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-06T22:10:54.522547] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-06T22:10:55.305409] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T22:10:55.322477] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-06T22:10:56.122535] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-06T22:10:56.221567] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-06T22:10:56.829346] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-06T22:10:56.922506] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-06T22:10:57.655483] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T22:10:57.722479] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-06T22:10:58.207848] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-06T22:10:58.522534] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-06T22:10:59.322554] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-06T22:10:59.912151] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-06T22:11:00.122546] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-06T22:11:00.247084] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T22:11:00.525547] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-06T22:11:00.922562] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-06T22:11:01.722520] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-06T22:11:02.390764] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-06T22:11:02.522563] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-06T22:11:03.090877] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-06T22:11:03.094988] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-06T22:11:03.322543] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-06T22:11:03.889454] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-06T22:11:04.122548] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-06T22:11:04.922618] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-06T22:11:05.594616] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-06T22:11:05.722535] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-06T22:11:06.459837] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-06T22:11:06.522529] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-06T22:11:06.586384] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-06T22:11:06.913467] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-06T22:11:06.914339] [INFO ] [REMOTE ] UZF: Full fetch complete (8838 records). [2025-10-06T22:11:06.914407] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-06T22:11:07.273551] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-10-06T22:11:07.273635] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-10-06T22:11:07.273894] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-10-06T22:11:07.273937] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-10-06T22:11:07.274359] [DEBUG] [LOCAL ] UZF: Trimmed 8838 records to 6382 (keeping 200 days of data) [2025-10-06T22:11:07.311734] [DEBUG] [LOCAL ] UZF: Primary data saved (6382 records). [2025-10-06T22:11:07.311852] [INFO ] [MAIN ] UZF: Full history saved. [2025-10-06T22:11:07.311942] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UZF took 18.6s. Estimated remaining: 22m 58s. Rate: 7.1 symbols/min [2025-10-06T22:11:07.327794] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-06T22:11:07.482682] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:11:07.522073] [DEBUG] [LOCAL ] VAC: Loaded 34838 existing records from primary storage. [2025-10-06T22:11:07.522406] [INFO ] [MAIN ] VAC: Loaded 34838 existing records. [2025-10-06T22:11:07.726108] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:11:07.726398] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-06T22:11:07.726466] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-06T22:11:07.726744] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-06T22:11:07.726802] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-06T22:11:08.100269] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:11:08.122513] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-06T22:11:08.303955] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-06T22:11:08.922557] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-06T22:11:09.582688] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-06T22:11:09.722494] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-06T22:11:10.043010] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-06T22:11:10.135018] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-06T22:11:10.135906] [INFO ] [REMOTE ] UZE: Full fetch complete (10054 records). [2025-10-06T22:11:10.136002] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-06T22:11:10.488171] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-06T22:11:10.488260] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-06T22:11:10.488551] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-06T22:11:10.488611] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-06T22:11:10.489090] [DEBUG] [LOCAL ] UZE: Trimmed 10054 records to 7430 (keeping 200 days of data) [2025-10-06T22:11:10.527362] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-06T22:11:10.541813] [DEBUG] [LOCAL ] UZE: Primary data saved (7430 records). [2025-10-06T22:11:10.542036] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-06T22:11:10.542143] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UZE took 25.6s. Estimated remaining: 22m 49s. Rate: 7.1 symbols/min [2025-10-06T22:11:10.709896] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:11:10.762375] [DEBUG] [LOCAL ] VAL: Loaded 51032 existing records from primary storage. [2025-10-06T22:11:10.762784] [INFO ] [MAIN ] VAL: Loaded 51032 existing records. [2025-10-06T22:11:10.953550] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:11:10.953825] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-06T22:11:10.953908] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-06T22:11:10.954178] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-06T22:11:10.954235] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-06T22:11:11.323218] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-06T22:11:11.327188] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:11:12.122546] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-06T22:11:12.878845] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-06T22:11:12.922519] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-06T22:11:13.324665] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-06T22:11:13.469595] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-06T22:11:13.722509] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-06T22:11:14.522502] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-06T22:11:14.825119] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-06T22:11:15.026891] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-06T22:11:15.322569] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-06T22:11:15.906689] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-06T22:11:15.909836] [INFO ] [REMOTE ] UWMC: Full fetch complete (75640 records). [2025-10-06T22:11:15.909958] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-06T22:11:16.128406] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-06T22:11:16.325250] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-06T22:11:16.325341] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-06T22:11:16.326514] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-06T22:11:16.326580] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-06T22:11:16.328077] [DEBUG] [LOCAL ] UWMC: Trimmed 75640 records to 52835 (keeping 200 days of data) [2025-10-06T22:11:16.648775] [DEBUG] [LOCAL ] UWMC: Primary data saved (52835 records). [2025-10-06T22:11:16.648940] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-06T22:11:16.649035] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UWMC took 59.5s. Estimated remaining: 22m 40s. Rate: 7.1 symbols/min [2025-10-06T22:11:16.836738] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:11:16.892086] [DEBUG] [LOCAL ] VALE: Loaded 54473 existing records from primary storage. [2025-10-06T22:11:16.892621] [INFO ] [MAIN ] VALE: Loaded 54473 existing records. [2025-10-06T22:11:16.926696] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-06T22:11:17.097007] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:11:17.097629] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-06T22:11:17.097728] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-06T22:11:17.114087] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-06T22:11:17.127931] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-06T22:11:17.192853] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-06T22:11:17.556462] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:11:17.722571] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-06T22:11:18.204039] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T22:11:18.497295] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-06T22:11:18.522507] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-06T22:11:19.322537] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-06T22:11:19.630020] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T22:11:19.898217] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T22:11:20.122537] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-06T22:11:20.922549] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-06T22:11:21.001720] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T22:11:21.108374] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T22:11:21.722532] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-06T22:11:22.522548] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-06T22:11:23.107404] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-06T22:11:23.181609] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T22:11:23.322540] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-06T22:11:24.122511] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-06T22:11:24.200856] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T22:11:24.849982] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T22:11:24.922489] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-06T22:11:25.722536] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-06T22:11:26.090077] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-06T22:11:26.298800] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-06T22:11:26.522532] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-06T22:11:27.322549] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-06T22:11:28.008942] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-06T22:11:28.123494] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-06T22:11:28.126761] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-06T22:11:28.922555] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-06T22:11:29.075128] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T22:11:29.150447] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T22:11:29.722585] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-06T22:11:30.522558] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-06T22:11:30.944703] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-06T22:11:31.036112] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T22:11:31.322561] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-06T22:11:32.122496] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-06T22:11:32.266899] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T22:11:32.298543] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-06T22:11:32.300613] [INFO ] [REMOTE ] VAC: Full fetch complete (48439 records). [2025-10-06T22:11:32.300750] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-06T22:11:32.674036] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-06T22:11:32.674125] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-06T22:11:32.675045] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-06T22:11:32.675106] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-06T22:11:32.676192] [DEBUG] [LOCAL ] VAC: Trimmed 48439 records to 34336 (keeping 200 days of data) [2025-10-06T22:11:32.892746] [DEBUG] [LOCAL ] VAC: Primary data saved (34336 records). [2025-10-06T22:11:32.892907] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-06T22:11:32.892993] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. VAC took 25.6s. Estimated remaining: 22m 32s. Rate: 7.1 symbols/min [2025-10-06T22:11:32.927761] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-06T22:11:33.067598] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:11:33.075803] [DEBUG] [LOCAL ] VATE: Loaded 5385 existing records from primary storage. [2025-10-06T22:11:33.076028] [INFO ] [MAIN ] VATE: Loaded 5385 existing records. [2025-10-06T22:11:33.255404] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:11:33.255692] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-06T22:11:33.255753] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-06T22:11:33.256105] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-06T22:11:33.256164] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-06T22:11:33.610186] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:11:33.722504] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-06T22:11:33.870922] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T22:11:34.315755] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T22:11:34.522535] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-06T22:11:34.975521] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-06T22:11:35.322550] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-06T22:11:35.799554] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T22:11:36.122535] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-06T22:11:36.922514] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-06T22:11:36.964610] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-06T22:11:37.312078] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-06T22:11:37.722527] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-06T22:11:38.522524] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-06T22:11:38.559560] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T22:11:38.822138] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T22:11:39.322594] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-06T22:11:39.783207] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T22:11:39.786440] [INFO ] [REMOTE ] V: Full fetch complete (77821 records). [2025-10-06T22:11:39.786583] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-06T22:11:40.123524] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-06T22:11:40.198180] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-06T22:11:40.198449] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-06T22:11:40.200201] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-06T22:11:40.200285] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-06T22:11:40.202404] [DEBUG] [LOCAL ] V: Trimmed 77821 records to 53754 (keeping 200 days of data) [2025-10-06T22:11:40.236061] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T22:11:40.626663] [DEBUG] [LOCAL ] V: Primary data saved (53754 records). [2025-10-06T22:11:40.626840] [INFO ] [MAIN ] V: Full history saved. [2025-10-06T22:11:40.627774] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. V took 49.6s. Estimated remaining: 22m 24s. Rate: 7.1 symbols/min [2025-10-06T22:11:40.797153] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:11:40.808124] [DEBUG] [LOCAL ] VBF: Loaded 7065 existing records from primary storage. [2025-10-06T22:11:40.808415] [INFO ] [MAIN ] VBF: Loaded 7065 existing records. [2025-10-06T22:11:40.905916] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-06T22:11:40.927579] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-06T22:11:41.006024] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:11:41.006441] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-06T22:11:41.006504] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-06T22:11:41.006699] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-06T22:11:41.006800] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-06T22:11:41.357559] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:11:41.722588] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-06T22:11:42.522559] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-06T22:11:42.959707] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-06T22:11:43.328088] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-06T22:11:43.331836] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T22:11:43.367172] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T22:11:44.122558] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-06T22:11:44.746566] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T22:11:44.922592] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-06T22:11:45.722549] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-06T22:11:46.522595] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-06T22:11:46.919321] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-06T22:11:47.311604] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-06T22:11:47.322460] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-06T22:11:47.452106] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (4.12 seconds). [2025-10-06T22:11:47.786129] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-06T22:11:47.825964] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-06T22:11:48.122527] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-06T22:11:48.771618] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-06T22:11:48.922532] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-06T22:11:49.722532] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-06T22:11:50.362509] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-06T22:11:50.522509] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-06T22:11:50.626263] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T22:11:51.150126] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-06T22:11:51.322550] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-06T22:11:52.122574] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-06T22:11:52.845063] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-06T22:11:52.922511] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-06T22:11:52.998281] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T22:11:53.722590] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-06T22:11:54.456557] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T22:11:54.522528] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-06T22:11:54.888820] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-06T22:11:55.322635] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-06T22:11:55.787004] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T22:11:55.789950] [INFO ] [REMOTE ] VAL: Full fetch complete (73216 records). [2025-10-06T22:11:55.790083] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-06T22:11:55.972913] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-06T22:11:56.131850] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-06T22:11:56.192873] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-06T22:11:56.192965] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-06T22:11:56.194278] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-06T22:11:56.194345] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-06T22:11:56.196052] [DEBUG] [LOCAL ] VAL: Trimmed 73216 records to 50256 (keeping 200 days of data) [2025-10-06T22:11:56.495762] [DEBUG] [LOCAL ] VAL: Primary data saved (50256 records). [2025-10-06T22:11:56.496005] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-06T22:11:56.496127] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VAL took 46.0s. Estimated remaining: 22m 16s. Rate: 7.1 symbols/min [2025-10-06T22:11:56.674676] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:11:56.692478] [DEBUG] [LOCAL ] VCV: Loaded 13836 existing records from primary storage. [2025-10-06T22:11:56.692811] [INFO ] [MAIN ] VCV: Loaded 13836 existing records. [2025-10-06T22:11:56.873483] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:11:56.873892] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-06T22:11:56.873940] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-06T22:11:56.874130] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-06T22:11:56.874187] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-06T22:11:56.928531] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-06T22:11:57.014123] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T22:11:57.308103] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:11:57.631153] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-06T22:11:57.722623] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-06T22:11:58.462826] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-06T22:11:58.522513] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-06T22:11:59.322560] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-06T22:11:59.875499] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T22:11:59.876677] [INFO ] [REMOTE ] VBF: Full fetch complete (10482 records). [2025-10-06T22:11:59.876771] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-06T22:12:00.127678] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-06T22:12:00.275553] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-06T22:12:00.275792] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-06T22:12:00.276093] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-06T22:12:00.276195] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-06T22:12:00.276953] [DEBUG] [LOCAL ] VBF: Trimmed 10482 records to 6830 (keeping 200 days of data) [2025-10-06T22:12:00.357543] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T22:12:00.389745] [DEBUG] [LOCAL ] VBF: Primary data saved (6830 records). [2025-10-06T22:12:00.389982] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-06T22:12:00.390106] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VBF took 19.8s. Estimated remaining: 22m 7s. Rate: 7.1 symbols/min [2025-10-06T22:12:00.559431] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:12:00.610144] [DEBUG] [LOCAL ] VEEV: Loaded 47751 existing records from primary storage. [2025-10-06T22:12:00.610489] [INFO ] [MAIN ] VEEV: Loaded 47751 existing records. [2025-10-06T22:12:00.785636] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:12:00.785892] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-06T22:12:00.785939] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-06T22:12:00.786173] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-06T22:12:00.786230] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-06T22:12:00.933096] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-06T22:12:01.177254] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:12:01.492381] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-06T22:12:01.678578] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T22:12:01.722624] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-06T22:12:02.522541] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-06T22:12:03.035416] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T22:12:03.036368] [INFO ] [REMOTE ] VATE: Full fetch complete (10513 records). [2025-10-06T22:12:03.036502] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-06T22:12:03.170288] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T22:12:03.205671] [INFO ] [REMOTE ] VALE: Full fetch complete (77763 records). [2025-10-06T22:12:03.246038] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-06T22:12:03.332046] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-06T22:12:03.635112] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-06T22:12:03.659031] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-06T22:12:03.721071] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-06T22:12:03.737401] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-06T22:12:03.758904] [DEBUG] [LOCAL ] VATE: Trimmed 10513 records to 5258 (keeping 200 days of data) [2025-10-06T22:12:03.886850] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-06T22:12:03.887298] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-06T22:12:03.888901] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-06T22:12:03.889294] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-06T22:12:03.893317] [DEBUG] [LOCAL ] VALE: Trimmed 77763 records to 53693 (keeping 200 days of data) [2025-10-06T22:12:03.896908] [DEBUG] [LOCAL ] VATE: Primary data saved (5258 records). [2025-10-06T22:12:03.896993] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-06T22:12:03.897084] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VATE took 31.0s. Estimated remaining: 21m 58s. Rate: 7.1 symbols/min [2025-10-06T22:12:04.127357] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-06T22:12:04.161537] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:12:04.182728] [DEBUG] [LOCAL ] VEL: Loaded 12926 existing records from primary storage. [2025-10-06T22:12:04.183516] [INFO ] [MAIN ] VEL: Loaded 12926 existing records. [2025-10-06T22:12:04.379462] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:12:04.380410] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-06T22:12:04.381067] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-06T22:12:04.381735] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-06T22:12:04.382564] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-06T22:12:04.870134] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:12:04.941895] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-06T22:12:04.979637] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T22:12:05.008529] [DEBUG] [LOCAL ] VALE: Primary data saved (53693 records). [2025-10-06T22:12:05.008761] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-06T22:12:05.008899] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VALE took 48.4s. Estimated remaining: 21m 49s. Rate: 7.1 symbols/min [2025-10-06T22:12:05.186614] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:12:05.239292] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-06T22:12:05.265435] [DEBUG] [LOCAL ] VET: Loaded 44583 existing records from primary storage. [2025-10-06T22:12:05.265894] [INFO ] [MAIN ] VET: Loaded 44583 existing records. [2025-10-06T22:12:05.441104] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:12:05.441331] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-06T22:12:05.441382] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-06T22:12:05.441614] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-06T22:12:05.441713] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-06T22:12:05.603374] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-06T22:12:05.726519] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-06T22:12:05.805826] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:12:06.522538] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-06T22:12:06.531171] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-06T22:12:07.322557] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-06T22:12:08.036951] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-06T22:12:08.127707] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-06T22:12:08.142890] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-06T22:12:08.922556] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-06T22:12:09.181354] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T22:12:09.722533] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-06T22:12:10.427635] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-06T22:12:10.522577] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-06T22:12:11.319238] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-06T22:12:11.327947] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-06T22:12:11.366832] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-06T22:12:11.925221] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T22:12:12.122593] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-06T22:12:12.922538] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-06T22:12:12.955612] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-06T22:12:13.722521] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-06T22:12:13.865409] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-06T22:12:14.522576] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-06T22:12:15.325515] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-06T22:12:15.335712] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T22:12:15.518716] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-06T22:12:16.122559] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-06T22:12:16.783907] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T22:12:16.795282] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-06T22:12:16.922546] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-06T22:12:17.722536] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-06T22:12:17.734498] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-06T22:12:18.522542] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-06T22:12:19.282749] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-06T22:12:19.322539] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-06T22:12:19.341850] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-06T22:12:20.122571] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-06T22:12:20.913459] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T22:12:20.923301] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-06T22:12:21.722516] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-06T22:12:21.883588] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T22:12:21.919582] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-06T22:12:22.522570] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-06T22:12:23.074262] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T22:12:23.322575] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-06T22:12:23.341814] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-06T22:12:24.122566] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-06T22:12:24.922535] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-06T22:12:25.113559] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T22:12:25.119573] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T22:12:25.722524] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-06T22:12:26.372814] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T22:12:26.374257] [INFO ] [REMOTE ] VEL: Full fetch complete (17169 records). [2025-10-06T22:12:26.374371] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-06T22:12:26.524185] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-06T22:12:26.841428] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-06T22:12:26.861350] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-06T22:12:26.861473] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-06T22:12:26.862359] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-06T22:12:26.862440] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-06T22:12:26.863354] [DEBUG] [LOCAL ] VEL: Trimmed 17169 records to 12584 (keeping 200 days of data) [2025-10-06T22:12:26.943357] [DEBUG] [LOCAL ] VEL: Primary data saved (12584 records). [2025-10-06T22:12:26.943559] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-06T22:12:26.943682] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VEL took 23.0s. Estimated remaining: 21m 42s. Rate: 7.1 symbols/min [2025-10-06T22:12:27.177371] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:12:27.229230] [DEBUG] [LOCAL ] VFC: Loaded 54390 existing records from primary storage. [2025-10-06T22:12:27.229599] [INFO ] [MAIN ] VFC: Loaded 54390 existing records. [2025-10-06T22:12:27.327041] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-06T22:12:27.405466] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:12:27.405723] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-06T22:12:27.405781] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-06T22:12:27.406019] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-06T22:12:27.406077] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-06T22:12:27.753930] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:12:28.122569] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-06T22:12:28.335331] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-06T22:12:28.917477] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-06T22:12:28.926955] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-06T22:12:29.722538] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-06T22:12:29.887172] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T22:12:29.973549] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-06T22:12:30.522555] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-06T22:12:31.322508] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-06T22:12:31.434677] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-06T22:12:31.703629] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-06T22:12:32.122603] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-06T22:12:32.885790] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T22:12:32.922472] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-06T22:12:33.171292] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-06T22:12:33.722521] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-06T22:12:34.432877] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T22:12:34.461936] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T22:12:34.463222] [INFO ] [REMOTE ] VCV: Full fetch complete (19294 records). [2025-10-06T22:12:34.463301] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-06T22:12:34.529003] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-06T22:12:34.866460] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-06T22:12:34.866579] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-06T22:12:34.867479] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-06T22:12:34.867547] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-06T22:12:34.868273] [DEBUG] [LOCAL ] VCV: Trimmed 19294 records to 13605 (keeping 200 days of data) [2025-10-06T22:12:34.963777] [DEBUG] [LOCAL ] VCV: Primary data saved (13605 records). [2025-10-06T22:12:34.963966] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-06T22:12:34.964068] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VCV took 38.5s. Estimated remaining: 21m 33s. Rate: 7.1 symbols/min [2025-10-06T22:12:35.148762] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:12:35.149046] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-06T22:12:35.149088] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-06T22:12:35.149225] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-06T22:12:35.149267] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-06T22:12:35.149308] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-06T22:12:35.149344] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-06T22:12:35.335843] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-06T22:12:35.525206] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:12:36.122590] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-06T22:12:36.344481] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T22:12:36.345406] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-06T22:12:36.345701] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:12:36.345785] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-06T22:12:36.345851] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:12:36.345927] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-06T22:12:36.346011] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-06T22:12:36.346117] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-06T22:12:36.346189] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-06T22:12:36.346313] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VG took 1.4s. Estimated remaining: 21m 25s. Rate: 7.1 symbols/min [2025-10-06T22:12:36.531396] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:12:36.560790] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-06T22:12:36.563717] [DEBUG] [LOCAL ] VGI: Loaded 5198 existing records from primary storage. [2025-10-06T22:12:36.573004] [INFO ] [MAIN ] VGI: Loaded 5198 existing records. [2025-10-06T22:12:36.748612] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:12:36.748916] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-06T22:12:36.748976] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-06T22:12:36.749145] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-06T22:12:36.749201] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-06T22:12:36.923231] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-06T22:12:37.125787] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:12:37.244804] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-06T22:12:37.722547] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-06T22:12:38.327965] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-06T22:12:38.522537] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-06T22:12:38.700240] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T22:12:38.985196] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-06T22:12:39.322562] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-06T22:12:40.122544] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-06T22:12:40.693880] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T22:12:40.696812] [INFO ] [REMOTE ] VEEV: Full fetch complete (68216 records). [2025-10-06T22:12:40.696940] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-06T22:12:40.794843] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-06T22:12:40.932281] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-06T22:12:41.102931] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-06T22:12:41.103018] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-06T22:12:41.104134] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-06T22:12:41.104198] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-06T22:12:41.105623] [DEBUG] [LOCAL ] VEEV: Trimmed 68216 records to 47135 (keeping 200 days of data) [2025-10-06T22:12:41.397055] [DEBUG] [LOCAL ] VEEV: Primary data saved (47135 records). [2025-10-06T22:12:41.397240] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-06T22:12:41.397355] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VEEV took 41.0s. Estimated remaining: 21m 16s. Rate: 7.1 symbols/min [2025-10-06T22:12:41.564070] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:12:41.586453] [DEBUG] [LOCAL ] VGM: Loaded 18537 existing records from primary storage. [2025-10-06T22:12:41.586796] [INFO ] [MAIN ] VGM: Loaded 18537 existing records. [2025-10-06T22:12:41.738034] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-06T22:12:41.784401] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:12:41.784803] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-06T22:12:41.784878] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-06T22:12:41.785221] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-06T22:12:41.785280] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-06T22:12:42.142256] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:12:42.408608] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-06T22:12:42.522590] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-06T22:12:42.681170] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-06T22:12:43.201965] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-06T22:12:43.322563] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-06T22:12:44.122512] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-06T22:12:44.358682] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-06T22:12:44.922566] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-06T22:12:45.722498] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-06T22:12:45.815672] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T22:12:46.069127] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-06T22:12:46.133345] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T22:12:46.522552] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-06T22:12:47.322497] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-06T22:12:47.409247] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-06T22:12:48.122536] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-06T22:12:48.706634] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T22:12:48.922498] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-06T22:12:49.321024] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-06T22:12:49.722499] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-06T22:12:49.913796] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-06T22:12:50.522595] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-06T22:12:50.922185] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T22:12:50.924974] [INFO ] [REMOTE ] VET: Full fetch complete (64612 records). [2025-10-06T22:12:50.925074] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-06T22:12:51.324450] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-06T22:12:51.325067] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-06T22:12:51.326270] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-06T22:12:51.330241] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-06T22:12:51.330463] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-06T22:12:51.333152] [DEBUG] [LOCAL ] VET: Trimmed 64612 records to 43963 (keeping 200 days of data) [2025-10-06T22:12:51.639361] [DEBUG] [LOCAL ] VET: Primary data saved (43963 records). [2025-10-06T22:12:51.639579] [INFO ] [MAIN ] VET: Full history saved. [2025-10-06T22:12:51.639738] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VET took 46.6s. Estimated remaining: 21m 8s. Rate: 7.1 symbols/min [2025-10-06T22:12:51.841546] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:12:51.848318] [DEBUG] [LOCAL ] VHI: Loaded 2805 existing records from primary storage. [2025-10-06T22:12:51.848558] [INFO ] [MAIN ] VHI: Loaded 2805 existing records. [2025-10-06T22:12:52.036448] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:12:52.036764] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-06T22:12:52.036822] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-06T22:12:52.037073] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-06T22:12:52.037135] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-06T22:12:52.131698] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-06T22:12:52.370680] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-06T22:12:52.430985] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:12:52.508237] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-06T22:12:52.773861] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-06T22:12:52.922494] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-06T22:12:53.647340] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T22:12:53.722496] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-06T22:12:54.522558] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-06T22:12:55.147663] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-06T22:12:55.322511] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-06T22:12:55.641629] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-06T22:12:56.122496] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-06T22:12:56.153146] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-06T22:12:56.922577] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-06T22:12:57.541563] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T22:12:57.722529] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-06T22:12:58.214343] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-06T22:12:58.218528] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-06T22:12:58.522529] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-06T22:12:59.113600] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-06T22:12:59.322509] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-06T22:12:59.722606] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-06T22:13:00.122557] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-06T22:13:00.920218] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-06T22:13:00.924403] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-06T22:13:01.677632] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T22:13:01.722495] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-06T22:13:02.522550] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-06T22:13:02.893420] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-06T22:13:02.894352] [INFO ] [REMOTE ] VGI: Full fetch complete (7684 records). [2025-10-06T22:13:02.894435] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-06T22:13:03.262236] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-06T22:13:03.262432] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-06T22:13:03.262800] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-06T22:13:03.262915] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-06T22:13:03.263930] [DEBUG] [LOCAL ] VGI: Trimmed 7684 records to 5152 (keeping 200 days of data) [2025-10-06T22:13:03.325370] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-06T22:13:03.332071] [DEBUG] [LOCAL ] VGI: Primary data saved (5152 records). [2025-10-06T22:13:03.332201] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-06T22:13:03.332352] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VGI took 27.0s. Estimated remaining: 20m 59s. Rate: 7.1 symbols/min [2025-10-06T22:13:03.368884] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T22:13:03.523332] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:13:03.523586] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-06T22:13:03.523676] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-06T22:13:03.523803] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-06T22:13:03.523865] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-06T22:13:03.523941] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-06T22:13:03.523988] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-06T22:13:03.882431] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:13:03.933767] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-06T22:13:04.122556] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-06T22:13:04.356784] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T22:13:04.357221] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-06T22:13:04.357336] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:13:04.357389] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-06T22:13:04.357451] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:13:04.357526] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-06T22:13:04.357611] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-06T22:13:04.357695] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-06T22:13:04.357793] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-06T22:13:04.357868] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VIA took 1.0s. Estimated remaining: 20m 50s. Rate: 7.1 symbols/min [2025-10-06T22:13:04.534484] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:13:04.592515] [DEBUG] [LOCAL ] VICI: Loaded 54427 existing records from primary storage. [2025-10-06T22:13:04.592996] [INFO ] [MAIN ] VICI: Loaded 54427 existing records. [2025-10-06T22:13:04.765373] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:13:04.765602] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-06T22:13:04.765674] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-06T22:13:04.765967] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-06T22:13:04.766025] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-06T22:13:04.928254] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-06T22:13:05.172920] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:13:05.722546] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-06T22:13:06.102828] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T22:13:06.307724] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-06T22:13:06.522638] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-06T22:13:07.322518] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-06T22:13:08.122513] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-06T22:13:08.622861] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-06T22:13:08.922556] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-06T22:13:09.186163] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-06T22:13:09.313972] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-06T22:13:09.722559] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-06T22:13:10.522609] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-06T22:13:10.607627] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-06T22:13:10.670682] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-06T22:13:11.322589] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-06T22:13:12.023858] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T22:13:12.027038] [INFO ] [REMOTE ] VFC: Full fetch complete (77590 records). [2025-10-06T22:13:12.027191] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-06T22:13:12.128373] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-06T22:13:12.441235] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-06T22:13:12.441337] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-06T22:13:12.442540] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-06T22:13:12.442609] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-06T22:13:12.444298] [DEBUG] [LOCAL ] VFC: Trimmed 77590 records to 53607 (keeping 200 days of data) [2025-10-06T22:13:12.779746] [DEBUG] [LOCAL ] VFC: Primary data saved (53607 records). [2025-10-06T22:13:12.779928] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-06T22:13:12.780026] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VFC took 45.8s. Estimated remaining: 20m 42s. Rate: 7.1 symbols/min [2025-10-06T22:13:12.925250] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-06T22:13:12.958117] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:13:13.011243] [DEBUG] [LOCAL ] VIK: Loaded 53248 existing records from primary storage. [2025-10-06T22:13:13.011667] [INFO ] [MAIN ] VIK: Loaded 53248 existing records. [2025-10-06T22:13:13.196702] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:13:13.197088] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-06T22:13:13.197210] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-06T22:13:13.210285] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-06T22:13:13.220994] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-06T22:13:13.294324] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-06T22:13:13.295933] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T22:13:13.514479] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T22:13:13.685964] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:13:13.722493] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-06T22:13:14.522548] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-06T22:13:15.294573] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-06T22:13:15.296122] [INFO ] [REMOTE ] VGM: Full fetch complete (26248 records). [2025-10-06T22:13:15.296195] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-06T22:13:15.327628] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-06T22:13:15.686810] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-06T22:13:15.696905] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-06T22:13:15.703511] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-06T22:13:15.714201] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-06T22:13:15.716570] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-06T22:13:15.726938] [DEBUG] [LOCAL ] VGM: Trimmed 26248 records to 18356 (keeping 200 days of data) [2025-10-06T22:13:15.842562] [DEBUG] [LOCAL ] VGM: Primary data saved (18356 records). [2025-10-06T22:13:15.842745] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-06T22:13:15.842870] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VGM took 34.4s. Estimated remaining: 20m 33s. Rate: 7.1 symbols/min [2025-10-06T22:13:15.952489] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-06T22:13:16.021636] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:13:16.076138] [DEBUG] [LOCAL ] VIPS: Loaded 52064 existing records from primary storage. [2025-10-06T22:13:16.076513] [INFO ] [MAIN ] VIPS: Loaded 52064 existing records. [2025-10-06T22:13:16.129063] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-06T22:13:16.256784] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:13:16.257030] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-06T22:13:16.257077] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-06T22:13:16.257345] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-06T22:13:16.257403] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-06T22:13:16.625216] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:13:16.922540] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-06T22:13:17.722546] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-06T22:13:17.868131] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T22:13:18.522510] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-06T22:13:18.872878] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-06T22:13:19.322550] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-06T22:13:19.378829] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T22:13:20.122527] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-06T22:13:20.188509] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T22:13:20.922573] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-06T22:13:21.259089] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-06T22:13:21.257466] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-06T22:13:21.722486] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-06T22:13:21.825026] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-06T22:13:22.522519] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-06T22:13:23.322497] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-06T22:13:23.639740] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-06T22:13:24.122527] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-06T22:13:24.306187] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T22:13:24.922513] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-06T22:13:25.124037] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T22:13:25.722498] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-06T22:13:25.950856] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-06T22:13:26.310724] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T22:13:26.522623] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-06T22:13:27.322570] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-06T22:13:27.511019] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-06T22:13:27.640852] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-06T22:13:27.641616] [INFO ] [REMOTE ] VHI: Full fetch complete (4430 records). [2025-10-06T22:13:27.641712] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-06T22:13:28.043549] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-06T22:13:28.043702] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-06T22:13:28.044058] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-06T22:13:28.044125] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-06T22:13:28.044552] [DEBUG] [LOCAL ] VHI: Trimmed 4430 records to 2741 (keeping 200 days of data) [2025-10-06T22:13:28.064876] [DEBUG] [LOCAL ] VHI: Primary data saved (2741 records). [2025-10-06T22:13:28.065065] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-06T22:13:28.065175] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VHI took 36.4s. Estimated remaining: 20m 25s. Rate: 7.1 symbols/min [2025-10-06T22:13:28.128907] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-06T22:13:28.255392] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:13:28.288220] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T22:13:28.344983] [DEBUG] [LOCAL ] VIRT: Loaded 47345 existing records from primary storage. [2025-10-06T22:13:28.345344] [INFO ] [MAIN ] VIRT: Loaded 47345 existing records. [2025-10-06T22:13:28.530907] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:13:28.531276] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-06T22:13:28.531413] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-06T22:13:28.531975] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-06T22:13:28.532035] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-06T22:13:28.882936] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:13:28.922508] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-06T22:13:29.722549] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-06T22:13:29.972406] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-06T22:13:30.416407] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T22:13:30.522569] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-06T22:13:31.322559] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-06T22:13:31.430419] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T22:13:32.122572] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-06T22:13:32.160539] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T22:13:32.888923] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-06T22:13:32.922495] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-06T22:13:33.722505] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-06T22:13:33.838885] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T22:13:34.522514] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-06T22:13:34.605733] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T22:13:35.178084] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T22:13:35.322557] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-06T22:13:36.122672] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-06T22:13:36.125083] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T22:13:36.929041] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-06T22:13:36.935484] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T22:13:37.722492] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-06T22:13:37.849232] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T22:13:38.522507] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-06T22:13:38.993961] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-06T22:13:39.322527] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-06T22:13:39.415089] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-06T22:13:40.122551] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-06T22:13:40.341472] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T22:13:40.922504] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-06T22:13:41.031926] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T22:13:41.472161] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T22:13:41.722611] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-06T22:13:42.522502] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-06T22:13:42.938464] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-06T22:13:42.958768] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T22:13:42.963355] [INFO ] [REMOTE ] VIPS: Full fetch complete (74580 records). [2025-10-06T22:13:42.963606] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-06T22:13:43.330491] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-06T22:13:43.385948] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-06T22:13:43.386059] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-06T22:13:43.388227] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-06T22:13:43.388377] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-06T22:13:43.391042] [DEBUG] [LOCAL ] VIPS: Trimmed 74580 records to 51264 (keeping 200 days of data) [2025-10-06T22:13:43.724916] [DEBUG] [LOCAL ] VIPS: Primary data saved (51264 records). [2025-10-06T22:13:43.725091] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-06T22:13:43.725280] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VIPS took 27.9s. Estimated remaining: 20m 17s. Rate: 7.1 symbols/min [2025-10-06T22:13:43.911750] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:13:43.973409] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T22:13:44.000201] [DEBUG] [LOCAL ] VIST: Loaded 46677 existing records from primary storage. [2025-10-06T22:13:44.000608] [INFO ] [MAIN ] VIST: Loaded 46677 existing records. [2025-10-06T22:13:44.127767] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-06T22:13:44.195236] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:13:44.195499] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-06T22:13:44.195549] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-06T22:13:44.195813] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-06T22:13:44.195890] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-06T22:13:44.591837] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:13:44.613281] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T22:13:44.616706] [INFO ] [REMOTE ] VIK: Full fetch complete (75890 records). [2025-10-06T22:13:44.616863] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-06T22:13:44.926201] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-06T22:13:45.025415] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-06T22:13:45.025516] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-06T22:13:45.027598] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-06T22:13:45.027693] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-06T22:13:45.029614] [DEBUG] [LOCAL ] VIK: Trimmed 75890 records to 52458 (keeping 200 days of data) [2025-10-06T22:13:45.362283] [DEBUG] [LOCAL ] VIK: Primary data saved (52458 records). [2025-10-06T22:13:45.362536] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-06T22:13:45.362669] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VIK took 32.6s. Estimated remaining: 20m 8s. Rate: 7.1 symbols/min [2025-10-06T22:13:45.544788] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:13:45.592348] [DEBUG] [LOCAL ] VIV: Loaded 45605 existing records from primary storage. [2025-10-06T22:13:45.592769] [INFO ] [MAIN ] VIV: Loaded 45605 existing records. [2025-10-06T22:13:45.735332] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-06T22:13:45.778733] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:13:45.780036] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-06T22:13:45.780122] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-06T22:13:45.780367] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-06T22:13:45.780424] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-06T22:13:46.158218] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:13:46.238285] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-06T22:13:46.522531] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-06T22:13:46.625292] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-06T22:13:46.907489] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-06T22:13:46.911158] [INFO ] [REMOTE ] VICI: Full fetch complete (77658 records). [2025-10-06T22:13:46.911341] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-06T22:13:47.323013] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-06T22:13:47.322593] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-06T22:13:47.324052] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-06T22:13:47.325780] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-06T22:13:47.326019] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-06T22:13:47.329042] [DEBUG] [LOCAL ] VICI: Trimmed 77658 records to 53647 (keeping 200 days of data) [2025-10-06T22:13:47.719003] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-06T22:13:47.749789] [DEBUG] [LOCAL ] VICI: Primary data saved (53647 records). [2025-10-06T22:13:47.750015] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-06T22:13:47.751067] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VICI took 43.4s. Estimated remaining: 19m 59s. Rate: 7.1 symbols/min [2025-10-06T22:13:47.937994] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:13:47.958904] [DEBUG] [LOCAL ] VKQ: Loaded 17986 existing records from primary storage. [2025-10-06T22:13:47.959201] [INFO ] [MAIN ] VKQ: Loaded 17986 existing records. [2025-10-06T22:13:48.126971] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-06T22:13:48.148266] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:13:48.148553] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-06T22:13:48.150047] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-06T22:13:48.150307] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-06T22:13:48.150366] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-06T22:13:48.527823] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:13:48.759940] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T22:13:48.922552] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-06T22:13:49.468601] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T22:13:49.722582] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-06T22:13:49.889550] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T22:13:50.522587] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-06T22:13:51.322501] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-06T22:13:51.362922] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T22:13:52.124337] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-06T22:13:52.130475] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T22:13:52.231803] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T22:13:52.922543] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-06T22:13:53.722499] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-06T22:13:53.797417] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-06T22:13:53.875883] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T22:13:54.522539] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-06T22:13:55.261884] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T22:13:55.322549] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-06T22:13:56.122517] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-06T22:13:56.188614] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T22:13:56.631254] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T22:13:56.634541] [INFO ] [REMOTE ] VIRT: Full fetch complete (67171 records). [2025-10-06T22:13:56.634732] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-06T22:13:56.927581] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-06T22:13:57.071094] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-06T22:13:57.081216] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-06T22:13:57.084116] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-06T22:13:57.083685] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-06T22:13:57.088370] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-06T22:13:57.090367] [DEBUG] [LOCAL ] VIRT: Trimmed 67171 records to 46743 (keeping 200 days of data) [2025-10-06T22:13:57.409227] [DEBUG] [LOCAL ] VIRT: Primary data saved (46743 records). [2025-10-06T22:13:57.409400] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-06T22:13:57.409498] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIRT took 29.3s. Estimated remaining: 19m 51s. Rate: 7.1 symbols/min [2025-10-06T22:13:57.586892] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:13:57.620287] [DEBUG] [LOCAL ] VLN: Loaded 29562 existing records from primary storage. [2025-10-06T22:13:57.620764] [INFO ] [MAIN ] VLN: Loaded 29562 existing records. [2025-10-06T22:13:57.724513] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-06T22:13:57.810973] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:13:57.811254] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-06T22:13:57.811307] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-06T22:13:57.811587] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-06T22:13:57.811687] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-06T22:13:58.194970] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:13:58.522594] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-06T22:13:58.665057] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-06T22:13:59.259041] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-06T22:13:59.322563] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-06T22:13:59.664430] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-06T22:14:00.122590] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-06T22:14:00.336933] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-06T22:14:00.922562] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-06T22:14:01.534537] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T22:14:01.722559] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-06T22:14:02.522550] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-06T22:14:02.604601] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-06T22:14:02.660961] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T22:14:03.322539] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-06T22:14:03.491436] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T22:14:04.122608] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-06T22:14:04.769257] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-06T22:14:04.922596] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-06T22:14:05.366349] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-06T22:14:05.722543] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-06T22:14:05.985502] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T22:14:06.522573] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-06T22:14:07.244298] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T22:14:07.322575] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-06T22:14:08.028853] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T22:14:08.031533] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T22:14:08.122593] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-06T22:14:08.922517] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-06T22:14:09.722517] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-06T22:14:09.798015] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-06T22:14:09.851197] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-06T22:14:10.522548] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-06T22:14:11.315987] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T22:14:11.325579] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-06T22:14:11.376311] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T22:14:12.122525] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-06T22:14:12.312085] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-06T22:14:12.922490] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-06T22:14:13.319155] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-06T22:14:13.722549] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-06T22:14:13.925711] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-06T22:14:14.522539] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-06T22:14:15.177380] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T22:14:15.322548] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-06T22:14:16.122508] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-06T22:14:16.317483] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T22:14:16.916108] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T22:14:16.924493] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-06T22:14:17.105731] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T22:14:17.722540] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-06T22:14:18.522556] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-06T22:14:18.626928] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T22:14:18.742086] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T22:14:19.322549] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-06T22:14:19.389298] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T22:14:19.391259] [INFO ] [REMOTE ] VKQ: Full fetch complete (24745 records). [2025-10-06T22:14:19.391431] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-06T22:14:19.820028] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-06T22:14:19.820170] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-06T22:14:19.821251] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-06T22:14:19.821372] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-06T22:14:19.822995] [DEBUG] [LOCAL ] VKQ: Trimmed 24745 records to 17502 (keeping 200 days of data) [2025-10-06T22:14:19.961578] [DEBUG] [LOCAL ] VKQ: Primary data saved (17502 records). [2025-10-06T22:14:19.961798] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-06T22:14:19.961906] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VKQ took 32.2s. Estimated remaining: 19m 43s. Rate: 7.1 symbols/min [2025-10-06T22:14:20.128948] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-06T22:14:20.164625] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:14:20.234260] [DEBUG] [LOCAL ] VLO: Loaded 53849 existing records from primary storage. [2025-10-06T22:14:20.234713] [INFO ] [MAIN ] VLO: Loaded 53849 existing records. [2025-10-06T22:14:20.425600] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:14:20.426084] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-06T22:14:20.426147] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-06T22:14:20.426424] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-06T22:14:20.426483] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-06T22:14:20.598634] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-06T22:14:20.669270] [INFO ] [REMOTE ] VLN: Full fetch complete (43224 records). [2025-10-06T22:14:20.695372] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-06T22:14:20.951637] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-06T22:14:20.955760] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:14:21.234277] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-06T22:14:21.234388] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-06T22:14:21.235885] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-06T22:14:21.235952] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-06T22:14:21.237361] [DEBUG] [LOCAL ] VLN: Trimmed 43224 records to 29417 (keeping 200 days of data) [2025-10-06T22:14:21.418279] [DEBUG] [LOCAL ] VLN: Primary data saved (29417 records). [2025-10-06T22:14:21.418543] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-06T22:14:21.418683] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VLN took 24.0s. Estimated remaining: 19m 34s. Rate: 7.1 symbols/min [2025-10-06T22:14:21.605147] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:14:21.645705] [DEBUG] [LOCAL ] VLRS: Loaded 40965 existing records from primary storage. [2025-10-06T22:14:21.646187] [INFO ] [MAIN ] VLRS: Loaded 40965 existing records. [2025-10-06T22:14:21.726483] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-06T22:14:21.873927] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:14:21.876804] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-06T22:14:21.877041] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-06T22:14:21.878552] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-06T22:14:21.878597] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-06T22:14:21.887932] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-06T22:14:22.272791] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:14:22.317668] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T22:14:22.322777] [INFO ] [REMOTE ] VIST: Full fetch complete (66811 records). [2025-10-06T22:14:22.322967] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-06T22:14:22.527672] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-06T22:14:22.724855] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-06T22:14:22.724954] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-06T22:14:22.726184] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-06T22:14:22.726250] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-06T22:14:22.727857] [DEBUG] [LOCAL ] VIST: Trimmed 66811 records to 46052 (keeping 200 days of data) [2025-10-06T22:14:23.005703] [DEBUG] [LOCAL ] VIST: Primary data saved (46052 records). [2025-10-06T22:14:23.005887] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-06T22:14:23.005986] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VIST took 39.3s. Estimated remaining: 19m 25s. Rate: 7.1 symbols/min [2025-10-06T22:14:23.180584] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:14:23.188074] [DEBUG] [LOCAL ] VLT: Loaded 4577 existing records from primary storage. [2025-10-06T22:14:23.188290] [INFO ] [MAIN ] VLT: Loaded 4577 existing records. [2025-10-06T22:14:23.329270] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-06T22:14:23.372132] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:14:23.373067] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-06T22:14:23.373124] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-06T22:14:23.373326] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-06T22:14:23.373383] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-06T22:14:23.809817] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:14:23.846344] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-06T22:14:24.122589] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-06T22:14:24.313863] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T22:14:24.844058] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T22:14:24.922618] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-06T22:14:25.722595] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-06T22:14:26.012158] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T22:14:26.160851] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T22:14:26.522561] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-06T22:14:27.030113] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T22:14:27.322548] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-06T22:14:27.931695] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-06T22:14:28.122615] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-06T22:14:28.304623] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-06T22:14:28.922499] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-06T22:14:29.722510] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-06T22:14:29.835141] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T22:14:30.171945] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T22:14:30.174888] [INFO ] [REMOTE ] VIV: Full fetch complete (64591 records). [2025-10-06T22:14:30.175043] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-06T22:14:30.527777] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-06T22:14:30.597342] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-06T22:14:30.597430] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-06T22:14:30.598577] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-06T22:14:30.598665] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-06T22:14:30.600058] [DEBUG] [LOCAL ] VIV: Trimmed 64591 records to 44822 (keeping 200 days of data) [2025-10-06T22:14:30.875058] [DEBUG] [LOCAL ] VIV: Primary data saved (44822 records). [2025-10-06T22:14:30.875219] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-06T22:14:30.875309] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VIV took 45.5s. Estimated remaining: 19m 17s. Rate: 7.1 symbols/min [2025-10-06T22:14:31.057760] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:14:31.106344] [DEBUG] [LOCAL ] VLTO: Loaded 46686 existing records from primary storage. [2025-10-06T22:14:31.106852] [INFO ] [MAIN ] VLTO: Loaded 46686 existing records. [2025-10-06T22:14:31.326542] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T22:14:31.323748] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-06T22:14:31.333823] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:14:31.343784] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-06T22:14:31.344158] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-06T22:14:31.344505] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-06T22:14:31.344568] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-06T22:14:31.473140] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-06T22:14:31.720224] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:14:32.122552] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-06T22:14:32.922508] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-06T22:14:33.365553] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-06T22:14:33.368550] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-06T22:14:33.691314] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-06T22:14:33.722624] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-06T22:14:34.522569] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-06T22:14:35.150926] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-06T22:14:35.322585] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-06T22:14:35.720332] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-06T22:14:36.074853] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-06T22:14:36.122554] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-06T22:14:36.700145] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-06T22:14:36.922563] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-06T22:14:37.722599] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-06T22:14:38.522569] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-06T22:14:38.896926] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-06T22:14:39.050725] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-06T22:14:39.326133] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-06T22:14:39.330144] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T22:14:40.122584] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-06T22:14:40.899619] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T22:14:40.922571] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-06T22:14:41.510791] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T22:14:41.722595] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-06T22:14:41.799692] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T22:14:42.319190] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T22:14:42.522585] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-06T22:14:43.322545] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-06T22:14:44.122533] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-06T22:14:44.261137] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-06T22:14:44.767008] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T22:14:44.922595] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-06T22:14:45.237119] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-06T22:14:45.722558] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-06T22:14:46.423891] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-06T22:14:46.522476] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-06T22:14:47.322561] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-06T22:14:47.325208] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T22:14:47.981938] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-06T22:14:48.122486] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-06T22:14:48.922545] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-06T22:14:49.076278] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T22:14:49.338227] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-06T22:14:49.339195] [INFO ] [REMOTE ] VLT: Full fetch complete (7505 records). [2025-10-06T22:14:49.339265] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-06T22:14:49.713198] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-06T22:14:49.713371] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-06T22:14:49.713687] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-06T22:14:49.713885] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-06T22:14:49.722550] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-06T22:14:49.737121] [DEBUG] [LOCAL ] VLT: Trimmed 7505 records to 4567 (keeping 200 days of data) [2025-10-06T22:14:49.741381] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-06T22:14:49.778659] [DEBUG] [LOCAL ] VLT: Primary data saved (4567 records). [2025-10-06T22:14:49.778799] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-06T22:14:49.778911] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLT took 26.8s. Estimated remaining: 19m 9s. Rate: 7.1 symbols/min [2025-10-06T22:14:49.945569] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:14:49.988966] [DEBUG] [LOCAL ] VMC: Loaded 43854 existing records from primary storage. [2025-10-06T22:14:49.989295] [INFO ] [MAIN ] VMC: Loaded 43854 existing records. [2025-10-06T22:14:50.166602] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:14:50.166896] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-06T22:14:50.166948] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-06T22:14:50.167262] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-06T22:14:50.167321] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-06T22:14:50.522750] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-06T22:14:50.525808] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:14:51.322540] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-06T22:14:51.808915] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-06T22:14:52.122632] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-06T22:14:52.207108] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T22:14:52.593402] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T22:14:52.596537] [INFO ] [REMOTE ] VLO: Full fetch complete (76921 records). [2025-10-06T22:14:52.596666] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-06T22:14:52.918422] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T22:14:52.927736] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-06T22:14:53.026557] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-06T22:14:53.026668] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-06T22:14:53.027917] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-06T22:14:53.027979] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-06T22:14:53.029490] [DEBUG] [LOCAL ] VLO: Trimmed 76921 records to 53078 (keeping 200 days of data) [2025-10-06T22:14:53.362705] [DEBUG] [LOCAL ] VLO: Primary data saved (53078 records). [2025-10-06T22:14:53.362874] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-06T22:14:53.364088] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLO took 33.4s. Estimated remaining: 19m 0s. Rate: 7.1 symbols/min [2025-10-06T22:14:53.530103] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:14:53.550790] [DEBUG] [LOCAL ] VMI: Loaded 15568 existing records from primary storage. [2025-10-06T22:14:53.551058] [INFO ] [MAIN ] VMI: Loaded 15568 existing records. [2025-10-06T22:14:53.723916] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:14:53.724109] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-06T22:14:53.725798] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-06T22:14:53.725879] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-06T22:14:53.726123] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-06T22:14:53.726184] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-06T22:14:54.081862] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:14:54.522543] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-06T22:14:54.692195] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-06T22:14:55.322538] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-06T22:14:55.518472] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-06T22:14:55.836512] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T22:14:56.122509] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-06T22:14:56.210165] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-06T22:14:56.922598] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-06T22:14:57.734078] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-06T22:14:57.736749] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T22:14:58.248621] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-06T22:14:58.522517] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-06T22:14:58.639453] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T22:14:59.322547] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-06T22:14:59.655890] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-06T22:14:59.658244] [INFO ] [REMOTE ] VLRS: Full fetch complete (58531 records). [2025-10-06T22:14:59.658329] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-06T22:15:00.088072] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-06T22:15:00.088188] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-06T22:15:00.089398] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-06T22:15:00.089468] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-06T22:15:00.090909] [DEBUG] [LOCAL ] VLRS: Trimmed 58531 records to 40255 (keeping 200 days of data) [2025-10-06T22:15:00.142915] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-06T22:15:00.217125] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-06T22:15:00.361279] [DEBUG] [LOCAL ] VLRS: Primary data saved (40255 records). [2025-10-06T22:15:00.361437] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-06T22:15:00.361525] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLRS took 38.9s. Estimated remaining: 18m 52s. Rate: 7.1 symbols/min [2025-10-06T22:15:00.922552] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-06T22:15:01.722617] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-06T22:15:01.797463] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-06T22:15:02.065256] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-06T22:15:02.522551] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-06T22:15:03.002794] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T22:15:03.322549] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-06T22:15:04.122514] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-06T22:15:04.409142] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-06T22:15:04.490799] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-06T22:15:04.922546] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-06T22:15:05.722509] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-06T22:15:05.881722] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T22:15:05.906722] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-06T22:15:06.522568] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-06T22:15:07.322545] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-06T22:15:07.533880] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-06T22:15:07.592248] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-06T22:15:08.122568] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-06T22:15:08.911919] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-06T22:15:08.922463] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-06T22:15:09.722575] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-06T22:15:09.754906] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-06T22:15:10.522498] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-06T22:15:10.626195] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T22:15:10.770260] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-06T22:15:11.322532] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-06T22:15:11.779061] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T22:15:11.782117] [INFO ] [REMOTE ] VLTO: Full fetch complete (66953 records). [2025-10-06T22:15:11.782305] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-06T22:15:12.086887] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-06T22:15:12.133111] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-06T22:15:12.218375] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-06T22:15:12.218480] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-06T22:15:12.219660] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-06T22:15:12.219727] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-06T22:15:12.221163] [DEBUG] [LOCAL ] VLTO: Trimmed 66953 records to 46078 (keeping 200 days of data) [2025-10-06T22:15:12.516289] [DEBUG] [LOCAL ] VLTO: Primary data saved (46078 records). [2025-10-06T22:15:12.516450] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-06T22:15:12.516535] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VLTO took 41.6s. Estimated remaining: 18m 44s. Rate: 7.1 symbols/min [2025-10-06T22:15:12.922539] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-06T22:15:13.165318] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-06T22:15:13.722617] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-06T22:15:14.529239] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-06T22:15:14.539353] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-06T22:15:14.746903] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-06T22:15:15.322553] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-06T22:15:16.020013] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-06T22:15:16.021354] [INFO ] [REMOTE ] VMI: Full fetch complete (21243 records). [2025-10-06T22:15:16.021440] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-06T22:15:16.341163] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T22:15:16.406043] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-06T22:15:16.436027] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-06T22:15:16.436097] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-06T22:15:16.436538] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-06T22:15:16.436576] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-06T22:15:16.437180] [DEBUG] [LOCAL ] VMI: Trimmed 21243 records to 15475 (keeping 200 days of data) [2025-10-06T22:15:16.537755] [DEBUG] [LOCAL ] VMI: Primary data saved (15475 records). [2025-10-06T22:15:16.537915] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-06T22:15:16.538001] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VMI took 23.2s. Estimated remaining: 18m 35s. Rate: 7.1 symbols/min [2025-10-06T22:15:17.922815] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T22:15:17.931832] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-06T22:15:18.375919] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-06T22:15:18.378461] [INFO ] [REMOTE ] VMC: Full fetch complete (62470 records). [2025-10-06T22:15:18.378552] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-06T22:15:18.776690] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-06T22:15:18.776783] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-06T22:15:18.777840] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-06T22:15:18.777901] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-06T22:15:18.779231] [DEBUG] [LOCAL ] VMC: Trimmed 62470 records to 43049 (keeping 200 days of data) [2025-10-06T22:15:19.048993] [DEBUG] [LOCAL ] VMC: Primary data saved (43049 records). [2025-10-06T22:15:19.049146] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-06T22:15:19.050280] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMC took 29.3s. Estimated remaining: 18m 26s. Rate: 7.1 symbols/min [2025-10-06T22:15:19.713677] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:15:19.778448] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:15:19.800321] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:15:19.823277] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:15:19.836922] [DEBUG] [LOCAL ] VNCE: Loaded 8345 existing records from primary storage. [2025-10-06T22:15:19.837296] [INFO ] [MAIN ] VNCE: Loaded 8345 existing records. [2025-10-06T22:15:19.943747] [DEBUG] [LOCAL ] VMO: Loaded 21385 existing records from primary storage. [2025-10-06T22:15:19.965981] [INFO ] [MAIN ] VMO: Loaded 21385 existing records. [2025-10-06T22:15:20.118806] [DEBUG] [LOCAL ] VNT: Loaded 44165 existing records from primary storage. [2025-10-06T22:15:20.183832] [INFO ] [MAIN ] VNT: Loaded 44165 existing records. [2025-10-06T22:15:20.187068] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:15:20.194231] [DEBUG] [LOCAL ] VNO: Loaded 49511 existing records from primary storage. [2025-10-06T22:15:20.233086] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-06T22:15:20.217280] [INFO ] [MAIN ] VNO: Loaded 49511 existing records. [2025-10-06T22:15:20.257079] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-06T22:15:20.323960] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-06T22:15:20.403267] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-06T22:15:20.795319] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:15:20.791289] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:15:20.814983] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-06T22:15:20.834611] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-06T22:15:20.829371] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-06T22:15:20.881132] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-06T22:15:20.886768] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-06T22:15:20.896209] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-06T22:15:20.886696] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-06T22:15:20.963952] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:15:20.996725] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-06T22:15:21.066152] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-06T22:15:21.115205] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-06T22:15:21.215369] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-06T22:15:21.269679] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-06T22:15:21.755347] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:15:21.850463] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-06T22:15:22.183158] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:15:22.257539] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-06T22:15:22.257263] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:15:22.258128] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-06T22:15:22.338330] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:15:22.338687] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-06T22:15:23.093719] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-06T22:15:23.098457] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-06T22:15:23.178975] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-06T22:15:23.184328] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-06T22:15:23.722126] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T22:15:23.730492] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-06T22:15:24.109152] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T22:15:24.119395] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-06T22:15:24.169337] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-06T22:15:24.174910] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-06T22:15:24.203882] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-06T22:15:24.898334] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-06T22:15:24.922473] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-06T22:15:25.090375] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-06T22:15:25.617080] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-06T22:15:25.722485] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-06T22:15:25.786527] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T22:15:26.329937] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-06T22:15:26.522626] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-06T22:15:27.322558] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-06T22:15:28.092020] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-06T22:15:28.122481] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-06T22:15:28.427127] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T22:15:28.922546] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-06T22:15:29.722558] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-06T22:15:29.938022] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T22:15:30.400211] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-06T22:15:30.463541] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T22:15:30.522503] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-06T22:15:31.322573] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-06T22:15:32.122514] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-06T22:15:32.223070] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T22:15:32.388452] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-06T22:15:32.922609] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-06T22:15:33.722514] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-06T22:15:33.754540] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-06T22:15:34.122587] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-06T22:15:34.522526] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-06T22:15:35.322552] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-06T22:15:35.586612] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T22:15:36.122554] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-06T22:15:36.133852] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-06T22:15:36.188439] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-06T22:15:36.922637] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-06T22:15:37.722582] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-06T22:15:37.881506] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T22:15:37.925180] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-06T22:15:38.184738] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-06T22:15:38.522568] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-06T22:15:39.322600] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-06T22:15:40.122746] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-06T22:15:40.122661] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T22:15:40.663769] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-06T22:15:40.839554] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T22:15:40.922473] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-06T22:15:41.722558] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-06T22:15:42.496208] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-06T22:15:42.522474] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-06T22:15:42.792937] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T22:15:43.322539] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-06T22:15:43.427780] [DEBUG] [REMOTE ] VMO: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-06T22:15:43.428030] [WARN ] [REMOTE ] VMO: No data returned for month 2025-07 [2025-10-06T22:15:43.428120] [FATAL] [REMOTE ] VMO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:15:43.428201] [FATAL] [MAIN ] VMO: Failed to fetch primary data. [2025-10-06T22:15:43.428237] [WARN ] [MAIN ] VMO: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:15:43.428275] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-06T22:15:43.428379] [DEBUG] [LOCAL ] VMO: No primary data file found to delete. [2025-10-06T22:15:43.428435] [INFO ] [LOCAL ] VMO: Starting deletion of derivative data. [2025-10-06T22:15:43.429148] [DEBUG] [LOCAL ] VMO: Deleted derivative data file. [2025-10-06T22:15:43.429242] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VMO took 24.4s. Estimated remaining: 18m 19s. Rate: 7.1 symbols/min [2025-10-06T22:15:43.601536] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:15:43.612699] [DEBUG] [LOCAL ] VOC: Loaded 9030 existing records from primary storage. [2025-10-06T22:15:43.612932] [INFO ] [MAIN ] VOC: Loaded 9030 existing records. [2025-10-06T22:15:43.799960] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:15:43.800213] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-06T22:15:43.800261] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-06T22:15:43.800421] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-06T22:15:43.800478] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-06T22:15:44.131763] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-06T22:15:44.271546] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:15:44.317233] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T22:15:44.922612] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-06T22:15:45.585082] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-06T22:15:45.722509] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-06T22:15:45.775308] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T22:15:46.522596] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-06T22:15:47.322517] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-06T22:15:47.471623] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-06T22:15:47.663998] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T22:15:47.665788] [INFO ] [REMOTE ] VNCE: Full fetch complete (16311 records). [2025-10-06T22:15:47.665867] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-06T22:15:48.087926] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-06T22:15:48.088010] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-06T22:15:48.088437] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-06T22:15:48.088498] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-06T22:15:48.089007] [DEBUG] [LOCAL ] VNCE: Trimmed 16311 records to 8381 (keeping 200 days of data) [2025-10-06T22:15:48.125739] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-06T22:15:48.136257] [DEBUG] [LOCAL ] VNCE: Primary data saved (8381 records). [2025-10-06T22:15:48.136368] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-06T22:15:48.136450] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VNCE took 29.1s. Estimated remaining: 18m 10s. Rate: 7.1 symbols/min [2025-10-06T22:15:48.309483] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:15:48.351990] [DEBUG] [LOCAL ] VOYA: Loaded 43096 existing records from primary storage. [2025-10-06T22:15:48.352349] [INFO ] [MAIN ] VOYA: Loaded 43096 existing records. [2025-10-06T22:15:48.530083] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:15:48.530341] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-06T22:15:48.530388] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-06T22:15:48.530624] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-06T22:15:48.530717] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-06T22:15:48.882863] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T22:15:48.921439] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:15:48.922470] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-06T22:15:49.722580] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-06T22:15:49.809222] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T22:15:50.472726] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T22:15:50.514881] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-06T22:15:50.522466] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-06T22:15:51.322516] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-06T22:15:51.381353] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-06T22:15:52.122543] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-06T22:15:52.918771] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T22:15:52.925182] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-06T22:15:52.935888] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-06T22:15:53.722564] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-06T22:15:54.522552] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-06T22:15:54.579364] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-06T22:15:54.616021] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-06T22:15:55.322544] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-06T22:15:56.102009] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-06T22:15:56.122474] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-06T22:15:56.413144] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T22:15:56.416220] [INFO ] [REMOTE ] VNO: Full fetch complete (70445 records). [2025-10-06T22:15:56.416384] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-06T22:15:56.861124] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-06T22:15:56.861269] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-06T22:15:56.862417] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-06T22:15:56.862482] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-06T22:15:56.864154] [DEBUG] [LOCAL ] VNO: Trimmed 70445 records to 48836 (keeping 200 days of data) [2025-10-06T22:15:56.926093] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-06T22:15:57.159854] [DEBUG] [LOCAL ] VNO: Primary data saved (48836 records). [2025-10-06T22:15:57.160024] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-06T22:15:57.160120] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VNO took 38.1s. Estimated remaining: 18m 2s. Rate: 7.1 symbols/min [2025-10-06T22:15:57.340487] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:15:57.340884] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-06T22:15:57.340943] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-06T22:15:57.341139] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-06T22:15:57.341195] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-06T22:15:57.341246] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-06T22:15:57.341280] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-06T22:15:57.709992] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:15:57.736622] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-06T22:15:57.740088] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T22:15:57.765047] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-06T22:15:58.522524] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-06T22:15:58.877349] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-06T22:15:58.881289] [INFO ] [REMOTE ] VNT: Full fetch complete (63446 records). [2025-10-06T22:15:58.881518] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-06T22:15:59.297450] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-06T22:15:59.297555] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-06T22:15:59.298706] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-06T22:15:59.298779] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-06T22:15:59.300403] [DEBUG] [LOCAL ] VNT: Trimmed 63446 records to 43570 (keeping 200 days of data) [2025-10-06T22:15:59.355179] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-06T22:15:59.576618] [DEBUG] [LOCAL ] VNT: Primary data saved (43570 records). [2025-10-06T22:15:59.576813] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-06T22:15:59.577825] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VNT took 40.5s. Estimated remaining: 17m 53s. Rate: 7.1 symbols/min [2025-10-06T22:15:59.794616] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:15:59.820042] [DEBUG] [LOCAL ] VPG: Loaded 17266 existing records from primary storage. [2025-10-06T22:15:59.820358] [INFO ] [MAIN ] VPG: Loaded 17266 existing records. [2025-10-06T22:16:00.040226] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:16:00.040697] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-06T22:16:00.040874] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-06T22:16:00.041205] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-06T22:16:00.041282] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-06T22:16:00.123074] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-06T22:16:00.298431] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T22:16:00.488737] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T22:16:00.492445] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:16:00.603507] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T22:16:00.603904] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-06T22:16:00.604002] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:16:00.604049] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-06T22:16:00.604109] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:16:00.604185] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-06T22:16:00.604255] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-06T22:16:00.604290] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-06T22:16:00.604328] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-06T22:16:00.604377] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VOYG took 3.4s. Estimated remaining: 17m 44s. Rate: 7.1 symbols/min [2025-10-06T22:16:00.790343] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:16:00.798903] [DEBUG] [LOCAL ] VPV: Loaded 5487 existing records from primary storage. [2025-10-06T22:16:00.799158] [INFO ] [MAIN ] VPV: Loaded 5487 existing records. [2025-10-06T22:16:00.927587] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-06T22:16:00.994021] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:16:00.994247] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-06T22:16:00.994305] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-06T22:16:00.994511] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-06T22:16:00.994568] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-06T22:16:01.381911] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:16:01.722557] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-06T22:16:02.522551] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-06T22:16:02.656427] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-06T22:16:02.682311] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T22:16:03.055545] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-06T22:16:03.322549] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-06T22:16:04.122583] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-06T22:16:04.144068] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-06T22:16:04.870580] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T22:16:04.922558] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-06T22:16:05.722537] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-06T22:16:05.893962] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T22:16:06.522557] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-06T22:16:07.190890] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-06T22:16:07.322491] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-06T22:16:07.366435] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T22:16:08.122498] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-06T22:16:08.151855] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-06T22:16:08.870629] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T22:16:08.922484] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-06T22:16:09.722521] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-06T22:16:10.421426] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-06T22:16:10.522540] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-06T22:16:10.734662] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-06T22:16:11.322539] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-06T22:16:12.076971] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T22:16:12.122528] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-06T22:16:12.167047] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-06T22:16:12.922536] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-06T22:16:13.646877] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T22:16:13.722494] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-06T22:16:14.262197] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-06T22:16:14.522625] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-06T22:16:15.008710] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-06T22:16:15.015259] [INFO ] [REMOTE ] VOYA: Full fetch complete (61782 records). [2025-10-06T22:16:15.016000] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-06T22:16:15.016097] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-06T22:16:15.327709] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-06T22:16:15.408246] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-06T22:16:15.408523] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-06T22:16:15.409844] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-06T22:16:15.409937] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-06T22:16:15.411382] [DEBUG] [LOCAL ] VOYA: Trimmed 61782 records to 42371 (keeping 200 days of data) [2025-10-06T22:16:15.672802] [DEBUG] [LOCAL ] VOYA: Primary data saved (42371 records). [2025-10-06T22:16:15.672957] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-06T22:16:15.673060] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VOYA took 27.5s. Estimated remaining: 17m 36s. Rate: 7.1 symbols/min [2025-10-06T22:16:15.838520] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:16:15.875130] [DEBUG] [LOCAL ] VRE: Loaded 35517 existing records from primary storage. [2025-10-06T22:16:15.875436] [INFO ] [MAIN ] VRE: Loaded 35517 existing records. [2025-10-06T22:16:16.053535] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:16:16.053840] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-06T22:16:16.053887] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-06T22:16:16.054145] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-06T22:16:16.054202] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-06T22:16:16.126338] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-06T22:16:16.432103] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:16:16.452691] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-06T22:16:16.672961] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T22:16:16.675418] [INFO ] [REMOTE ] VOC: Full fetch complete (13139 records). [2025-10-06T22:16:16.675598] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-06T22:16:16.927719] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-06T22:16:17.050975] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-06T22:16:17.051066] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-06T22:16:17.051403] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-06T22:16:17.051442] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-06T22:16:17.051963] [DEBUG] [LOCAL ] VOC: Trimmed 13139 records to 8980 (keeping 200 days of data) [2025-10-06T22:16:17.102759] [DEBUG] [LOCAL ] VOC: Primary data saved (8980 records). [2025-10-06T22:16:17.102914] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-06T22:16:17.103001] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VOC took 33.7s. Estimated remaining: 17m 27s. Rate: 7.1 symbols/min [2025-10-06T22:16:17.270258] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:16:17.331672] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-10-06T22:16:17.332117] [INFO ] [MAIN ] VRT: Loaded 54533 existing records. [2025-10-06T22:16:17.516083] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:16:17.516453] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-06T22:16:17.516570] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-06T22:16:17.516962] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-06T22:16:17.517023] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-06T22:16:17.627727] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-06T22:16:17.730514] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-06T22:16:17.895726] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:16:18.522703] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-06T22:16:18.802845] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-06T22:16:19.322549] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-06T22:16:19.824614] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-06T22:16:20.122553] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-06T22:16:20.408474] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-06T22:16:20.509860] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-06T22:16:20.922548] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-06T22:16:21.722516] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-06T22:16:22.162064] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-06T22:16:22.307426] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-06T22:16:22.522549] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-06T22:16:23.322508] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-06T22:16:23.648710] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T22:16:23.923535] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-06T22:16:24.122607] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-06T22:16:24.922562] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-06T22:16:25.533606] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-06T22:16:25.562073] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T22:16:25.722579] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-06T22:16:26.522551] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-06T22:16:27.261482] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-06T22:16:27.286327] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T22:16:27.322500] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-06T22:16:28.122570] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-06T22:16:28.601962] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-06T22:16:28.603122] [INFO ] [REMOTE ] VPV: Full fetch complete (9207 records). [2025-10-06T22:16:28.603215] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-06T22:16:28.908800] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T22:16:28.928683] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-06T22:16:29.057466] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-06T22:16:29.057574] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-06T22:16:29.057960] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-06T22:16:29.058024] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-06T22:16:29.058542] [DEBUG] [LOCAL ] VPV: Trimmed 9207 records to 5347 (keeping 200 days of data) [2025-10-06T22:16:29.096472] [DEBUG] [LOCAL ] VPV: Primary data saved (5347 records). [2025-10-06T22:16:29.096596] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-06T22:16:29.096711] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VPV took 28.5s. Estimated remaining: 17m 19s. Rate: 7.1 symbols/min [2025-10-06T22:16:29.277007] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:16:29.291241] [DEBUG] [LOCAL ] VRTS: Loaded 9386 existing records from primary storage. [2025-10-06T22:16:29.291502] [INFO ] [MAIN ] VRTS: Loaded 9386 existing records. [2025-10-06T22:16:29.464438] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:16:29.464699] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-06T22:16:29.464759] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-06T22:16:29.464957] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-06T22:16:29.465014] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-06T22:16:29.727724] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-06T22:16:29.835407] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:16:30.522536] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-06T22:16:31.117773] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-06T22:16:31.166483] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-06T22:16:31.322513] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-06T22:16:31.332729] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-06T22:16:32.122567] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-06T22:16:32.743060] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T22:16:32.922518] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-06T22:16:32.947435] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-06T22:16:33.722536] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-06T22:16:34.310865] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T22:16:34.364671] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-06T22:16:34.522580] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-06T22:16:35.157599] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-06T22:16:35.322518] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-06T22:16:35.997191] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-06T22:16:36.122519] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-06T22:16:36.781308] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-06T22:16:36.922543] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-06T22:16:37.706753] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-06T22:16:37.722467] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-06T22:16:38.194308] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-06T22:16:38.522561] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-06T22:16:39.322534] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-06T22:16:39.517275] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-06T22:16:40.122586] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-06T22:16:40.926812] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-06T22:16:40.930141] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-06T22:16:41.722571] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-06T22:16:41.780158] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-06T22:16:42.194621] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-06T22:16:42.458890] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-06T22:16:42.460506] [INFO ] [REMOTE ] VPG: Full fetch complete (22839 records). [2025-10-06T22:16:42.460590] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-06T22:16:42.527792] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-06T22:16:42.837316] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-06T22:16:42.837402] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-06T22:16:42.837920] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-06T22:16:42.837994] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-06T22:16:42.838637] [DEBUG] [LOCAL ] VPG: Trimmed 22839 records to 17118 (keeping 200 days of data) [2025-10-06T22:16:42.940851] [DEBUG] [LOCAL ] VPG: Primary data saved (17118 records). [2025-10-06T22:16:42.941024] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-06T22:16:42.941112] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VPG took 43.4s. Estimated remaining: 17m 11s. Rate: 7.1 symbols/min [2025-10-06T22:16:43.107216] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:16:43.167067] [DEBUG] [LOCAL ] VSCO: Loaded 53540 existing records from primary storage. [2025-10-06T22:16:43.167489] [INFO ] [MAIN ] VSCO: Loaded 53540 existing records. [2025-10-06T22:16:43.329212] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-06T22:16:43.362859] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:16:43.363171] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-06T22:16:43.363221] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-06T22:16:43.363437] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-06T22:16:43.363494] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-06T22:16:43.711066] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:16:43.932663] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-06T22:16:44.122521] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-06T22:16:44.771501] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-06T22:16:44.922597] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-06T22:16:45.695638] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-06T22:16:45.722488] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-06T22:16:45.981370] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T22:16:46.298187] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-06T22:16:46.299453] [INFO ] [REMOTE ] VRTS: Full fetch complete (11482 records). [2025-10-06T22:16:46.299541] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-06T22:16:46.532477] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-06T22:16:46.717545] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-06T22:16:46.717685] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-06T22:16:46.718222] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-06T22:16:46.718271] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-06T22:16:46.719153] [DEBUG] [LOCAL ] VRTS: Trimmed 11482 records to 9309 (keeping 200 days of data) [2025-10-06T22:16:46.783221] [DEBUG] [LOCAL ] VRTS: Primary data saved (9309 records). [2025-10-06T22:16:46.783422] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-06T22:16:46.783525] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRTS took 17.7s. Estimated remaining: 17m 2s. Rate: 7.1 symbols/min [2025-10-06T22:16:46.959758] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:16:47.019567] [DEBUG] [LOCAL ] VSH: Loaded 49064 existing records from primary storage. [2025-10-06T22:16:47.020037] [INFO ] [MAIN ] VSH: Loaded 49064 existing records. [2025-10-06T22:16:47.204254] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:16:47.204580] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-06T22:16:47.204630] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-06T22:16:47.205303] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-06T22:16:47.205406] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-06T22:16:47.327750] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-06T22:16:47.609115] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:16:47.844664] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-06T22:16:47.847314] [INFO ] [REMOTE ] VRE: Full fetch complete (48460 records). [2025-10-06T22:16:47.847434] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-06T22:16:48.127698] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-06T22:16:48.251969] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-06T22:16:48.252074] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-06T22:16:48.253098] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-06T22:16:48.253165] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-06T22:16:48.254539] [DEBUG] [LOCAL ] VRE: Trimmed 48460 records to 35130 (keeping 200 days of data) [2025-10-06T22:16:48.473230] [DEBUG] [LOCAL ] VRE: Primary data saved (35130 records). [2025-10-06T22:16:48.473418] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-06T22:16:48.473525] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRE took 32.8s. Estimated remaining: 16m 53s. Rate: 7.1 symbols/min [2025-10-06T22:16:48.647583] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:16:48.701796] [DEBUG] [LOCAL ] VST: Loaded 54498 existing records from primary storage. [2025-10-06T22:16:48.702179] [INFO ] [MAIN ] VST: Loaded 54498 existing records. [2025-10-06T22:16:48.879326] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:16:48.879627] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-06T22:16:48.879707] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-06T22:16:48.880041] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-06T22:16:48.880101] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-06T22:16:48.942995] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-06T22:16:49.240042] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:16:49.728671] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-06T22:16:49.751232] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-06T22:16:49.986942] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T22:16:50.522522] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-06T22:16:50.711161] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T22:16:51.322542] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-06T22:16:52.122510] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-06T22:16:52.242461] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-06T22:16:52.537717] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-06T22:16:52.922619] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-06T22:16:52.978974] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-06T22:16:53.528087] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T22:16:53.722586] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-06T22:16:54.522585] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-06T22:16:55.322554] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-06T22:16:55.463429] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-06T22:16:55.715755] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-06T22:16:56.122538] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-06T22:16:56.872052] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T22:16:56.922529] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-06T22:16:57.048334] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-06T22:16:57.722548] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-06T22:16:58.331736] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T22:16:58.457364] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-06T22:16:58.522552] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-06T22:16:59.322538] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-06T22:16:59.991463] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-06T22:17:00.122559] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-06T22:17:00.881103] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T22:17:00.922487] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-06T22:17:01.068734] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-06T22:17:01.722539] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-06T22:17:02.528276] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-06T22:17:02.534914] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-06T22:17:02.794820] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-06T22:17:03.322518] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-06T22:17:04.025049] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-06T22:17:04.122543] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-06T22:17:04.766220] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-06T22:17:04.922524] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-06T22:17:05.435870] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-06T22:17:05.722547] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-06T22:17:06.034010] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-06T22:17:06.522567] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-06T22:17:07.230638] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-06T22:17:07.322483] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-06T22:17:08.122562] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-06T22:17:08.367483] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-06T22:17:08.457705] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-06T22:17:08.922558] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-06T22:17:09.697295] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T22:17:09.727607] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-06T22:17:09.746126] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-06T22:17:10.522559] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-06T22:17:10.799502] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-06T22:17:11.322576] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-06T22:17:11.431446] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-06T22:17:12.122577] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-06T22:17:12.682717] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-06T22:17:12.685977] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-10-06T22:17:12.686171] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-06T22:17:12.932297] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-06T22:17:13.118272] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-06T22:17:13.118493] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-06T22:17:13.120266] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-06T22:17:13.120392] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-06T22:17:13.122541] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 53753 (keeping 200 days of data) [2025-10-06T22:17:13.302726] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-06T22:17:13.562378] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-10-06T22:17:13.562587] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-06T22:17:13.562715] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VRT took 56.5s. Estimated remaining: 16m 46s. Rate: 7.1 symbols/min [2025-10-06T22:17:13.726846] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-06T22:17:13.749362] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:17:13.783069] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T22:17:13.851530] [DEBUG] [LOCAL ] VSTS: Loaded 49740 existing records from primary storage. [2025-10-06T22:17:13.852183] [INFO ] [MAIN ] VSTS: Loaded 49740 existing records. [2025-10-06T22:17:14.054168] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:17:14.054511] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-06T22:17:14.054564] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-06T22:17:14.054876] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-06T22:17:14.054937] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-06T22:17:14.440254] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:17:14.522548] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-06T22:17:15.322497] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-06T22:17:15.566349] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-06T22:17:15.729348] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-06T22:17:16.122502] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-06T22:17:16.204774] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T22:17:16.912263] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-06T22:17:16.922566] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-06T22:17:17.722605] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-06T22:17:18.399804] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T22:17:18.403404] [INFO ] [REMOTE ] VSCO: Full fetch complete (76188 records). [2025-10-06T22:17:18.403555] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-06T22:17:18.527569] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-06T22:17:18.753610] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-06T22:17:18.895227] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-06T22:17:18.895354] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-06T22:17:18.897614] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-06T22:17:18.897714] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-06T22:17:18.899787] [DEBUG] [LOCAL ] VSCO: Trimmed 76188 records to 52754 (keeping 200 days of data) [2025-10-06T22:17:19.251699] [DEBUG] [LOCAL ] VSCO: Primary data saved (52754 records). [2025-10-06T22:17:19.251907] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-06T22:17:19.252026] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VSCO took 36.3s. Estimated remaining: 16m 37s. Rate: 7.1 symbols/min [2025-10-06T22:17:19.327696] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-06T22:17:19.534414] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:17:19.539797] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T22:17:19.595018] [DEBUG] [LOCAL ] VTEX: Loaded 43788 existing records from primary storage. [2025-10-06T22:17:19.595508] [INFO ] [MAIN ] VTEX: Loaded 43788 existing records. [2025-10-06T22:17:19.777966] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T22:17:19.815035] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:17:19.815822] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-06T22:17:19.815889] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-06T22:17:19.816344] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-06T22:17:19.816437] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-06T22:17:19.816302] [INFO ] [REMOTE ] VSH: Full fetch complete (70938 records). [2025-10-06T22:17:19.816580] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-06T22:17:20.137575] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-06T22:17:20.657769] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:17:20.680496] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-06T22:17:20.680616] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-06T22:17:20.682896] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-06T22:17:20.682972] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-06T22:17:20.685318] [DEBUG] [LOCAL ] VSH: Trimmed 70938 records to 48303 (keeping 200 days of data) [2025-10-06T22:17:20.922730] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-06T22:17:21.015077] [DEBUG] [LOCAL ] VSH: Primary data saved (48303 records). [2025-10-06T22:17:21.015290] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-06T22:17:21.015400] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSH took 34.2s. Estimated remaining: 16m 28s. Rate: 7.1 symbols/min [2025-10-06T22:17:21.191497] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:17:21.243602] [DEBUG] [LOCAL ] VTLE: Loaded 49133 existing records from primary storage. [2025-10-06T22:17:21.244092] [INFO ] [MAIN ] VTLE: Loaded 49133 existing records. [2025-10-06T22:17:21.431902] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:17:21.432398] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-06T22:17:21.432452] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-06T22:17:21.432786] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-06T22:17:21.432845] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-06T22:17:21.825800] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:17:21.826499] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-06T22:17:21.866181] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-06T22:17:21.940556] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-06T22:17:22.448850] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T22:17:22.522548] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-06T22:17:22.974105] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T22:17:22.977871] [INFO ] [REMOTE ] VST: Full fetch complete (77807 records). [2025-10-06T22:17:22.978039] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-06T22:17:23.322836] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-06T22:17:23.415443] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-06T22:17:23.415797] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-06T22:17:23.418005] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-06T22:17:23.418196] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-06T22:17:23.449081] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-06T22:17:23.447594] [DEBUG] [LOCAL ] VST: Trimmed 77807 records to 53718 (keeping 200 days of data) [2025-10-06T22:17:23.865348] [DEBUG] [LOCAL ] VST: Primary data saved (53718 records). [2025-10-06T22:17:23.865540] [INFO ] [MAIN ] VST: Full history saved. [2025-10-06T22:17:23.865703] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VST took 35.4s. Estimated remaining: 16m 19s. Rate: 7.1 symbols/min [2025-10-06T22:17:24.070376] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:17:24.090180] [DEBUG] [LOCAL ] VTMX: Loaded 17716 existing records from primary storage. [2025-10-06T22:17:24.090505] [INFO ] [MAIN ] VTMX: Loaded 17716 existing records. [2025-10-06T22:17:24.127938] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-06T22:17:24.285766] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:17:24.286036] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-06T22:17:24.286093] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-06T22:17:24.286320] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-06T22:17:24.286378] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-06T22:17:24.657518] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:17:24.922556] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-06T22:17:25.025314] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-06T22:17:25.722591] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-06T22:17:25.770858] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-06T22:17:25.820012] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-06T22:17:26.522628] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-06T22:17:27.133053] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T22:17:27.186452] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-06T22:17:27.322571] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-06T22:17:28.122543] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-06T22:17:28.894149] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-06T22:17:28.922493] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-06T22:17:29.390265] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-06T22:17:29.722547] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-06T22:17:30.522517] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-06T22:17:30.623569] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T22:17:30.856015] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-06T22:17:31.322550] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-06T22:17:32.127686] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-06T22:17:32.141778] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-06T22:17:32.376024] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T22:17:32.922537] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-06T22:17:33.676178] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T22:17:33.722513] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-06T22:17:33.913751] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T22:17:34.522729] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-06T22:17:35.322539] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-06T22:17:35.482275] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-06T22:17:35.535866] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-06T22:17:36.122548] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-06T22:17:36.866478] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-06T22:17:36.922507] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-06T22:17:37.162993] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-06T22:17:37.722597] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-06T22:17:38.416392] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-06T22:17:38.522623] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-06T22:17:39.328285] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-06T22:17:39.353677] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T22:17:39.399043] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-06T22:17:40.122548] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-06T22:17:40.922558] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-06T22:17:41.077708] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-06T22:17:41.203212] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T22:17:41.722553] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-06T22:17:42.509389] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T22:17:42.522470] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-06T22:17:43.043313] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T22:17:43.322552] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-06T22:17:44.056841] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T22:17:44.122482] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-06T22:17:44.922557] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-06T22:17:44.955463] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T22:17:45.715265] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-06T22:17:45.724421] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-06T22:17:45.803203] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-06T22:17:46.522807] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-06T22:17:46.982534] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T22:17:46.985523] [INFO ] [REMOTE ] VSTS: Full fetch complete (69784 records). [2025-10-06T22:17:46.985626] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-06T22:17:47.327786] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-06T22:17:47.429135] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-06T22:17:47.429295] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-06T22:17:47.431933] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-06T22:17:47.432032] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-06T22:17:47.434732] [DEBUG] [LOCAL ] VSTS: Trimmed 69784 records to 49025 (keeping 200 days of data) [2025-10-06T22:17:47.743006] [DEBUG] [LOCAL ] VSTS: Primary data saved (49025 records). [2025-10-06T22:17:47.743220] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-06T22:17:47.743354] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VSTS took 34.2s. Estimated remaining: 16m 12s. Rate: 7.1 symbols/min [2025-10-06T22:17:47.942333] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:17:47.955132] [DEBUG] [LOCAL ] VTN: Loaded 7110 existing records from primary storage. [2025-10-06T22:17:47.955432] [INFO ] [MAIN ] VTN: Loaded 7110 existing records. [2025-10-06T22:17:48.124278] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-06T22:17:48.158531] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:17:48.159305] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-06T22:17:48.159370] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-06T22:17:48.171328] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-06T22:17:48.188236] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-06T22:17:48.225487] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T22:17:48.304872] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-06T22:17:48.602294] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:17:48.922552] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-06T22:17:49.458893] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-06T22:17:49.722537] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-06T22:17:49.775543] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T22:17:50.522561] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-06T22:17:51.284760] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T22:17:51.322546] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-06T22:17:51.337087] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T22:17:52.122535] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-06T22:17:52.869871] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-06T22:17:52.922539] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-06T22:17:53.058388] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-06T22:17:53.722557] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-06T22:17:53.859190] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-06T22:17:54.382915] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-06T22:17:54.384734] [INFO ] [REMOTE ] VTMX: Full fetch complete (25715 records). [2025-10-06T22:17:54.384851] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-06T22:17:54.527629] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-06T22:17:54.808023] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-06T22:17:54.808134] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-06T22:17:54.809161] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-06T22:17:54.809231] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-06T22:17:54.810294] [DEBUG] [LOCAL ] VTMX: Trimmed 25715 records to 17569 (keeping 200 days of data) [2025-10-06T22:17:54.937912] [DEBUG] [LOCAL ] VTMX: Primary data saved (17569 records). [2025-10-06T22:17:54.938305] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-06T22:17:54.938529] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VTMX took 31.1s. Estimated remaining: 16m 3s. Rate: 7.1 symbols/min [2025-10-06T22:17:55.123864] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:17:55.145948] [DEBUG] [LOCAL ] VTOL: Loaded 19778 existing records from primary storage. [2025-10-06T22:17:55.146271] [INFO ] [MAIN ] VTOL: Loaded 19778 existing records. [2025-10-06T22:17:55.335754] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-06T22:17:55.340511] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:17:55.347622] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-06T22:17:55.348202] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-06T22:17:55.348578] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-06T22:17:55.353161] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-06T22:17:55.353239] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-06T22:17:55.727313] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:17:56.122552] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-06T22:17:56.922601] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-06T22:17:57.049813] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-06T22:17:57.088124] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-06T22:17:57.472463] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-06T22:17:57.722548] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-06T22:17:58.355718] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-06T22:17:58.522523] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-06T22:17:59.265032] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-06T22:17:59.322518] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-06T22:18:00.052552] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-06T22:18:00.122546] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-06T22:18:00.922506] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-06T22:18:00.974338] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-06T22:18:01.722549] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-06T22:18:02.218382] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-06T22:18:02.219509] [INFO ] [REMOTE ] VTN: Full fetch complete (11229 records). [2025-10-06T22:18:02.219662] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-06T22:18:02.527759] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-06T22:18:02.634468] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-06T22:18:02.634621] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-06T22:18:02.635167] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-06T22:18:02.635409] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-06T22:18:02.636694] [DEBUG] [LOCAL ] VTN: Trimmed 11229 records to 7017 (keeping 200 days of data) [2025-10-06T22:18:02.713812] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-06T22:18:02.741033] [DEBUG] [LOCAL ] VTN: Primary data saved (7017 records). [2025-10-06T22:18:02.741321] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-06T22:18:02.741517] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTN took 15.0s. Estimated remaining: 15m 55s. Rate: 7.1 symbols/min [2025-10-06T22:18:02.926739] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:18:02.987365] [DEBUG] [LOCAL ] VTR: Loaded 53582 existing records from primary storage. [2025-10-06T22:18:02.987819] [INFO ] [MAIN ] VTR: Loaded 53582 existing records. [2025-10-06T22:18:03.176682] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:18:03.177011] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-06T22:18:03.177069] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-06T22:18:03.177353] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-06T22:18:03.177417] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-06T22:18:03.330251] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-06T22:18:03.502306] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T22:18:03.587225] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:18:04.122551] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-06T22:18:04.647872] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-06T22:18:04.650919] [INFO ] [REMOTE ] VTEX: Full fetch complete (60683 records). [2025-10-06T22:18:04.651047] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-06T22:18:04.927733] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-06T22:18:05.066807] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-06T22:18:05.066922] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-06T22:18:05.068720] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-06T22:18:05.068791] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-06T22:18:05.070639] [DEBUG] [LOCAL ] VTEX: Trimmed 60683 records to 43018 (keeping 200 days of data) [2025-10-06T22:18:05.182512] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-06T22:18:05.352850] [DEBUG] [LOCAL ] VTEX: Primary data saved (43018 records). [2025-10-06T22:18:05.353038] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-06T22:18:05.353145] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTEX took 46.1s. Estimated remaining: 15m 46s. Rate: 7.1 symbols/min [2025-10-06T22:18:05.536464] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:18:05.577686] [DEBUG] [LOCAL ] VTS: Loaded 30893 existing records from primary storage. [2025-10-06T22:18:05.578161] [INFO ] [MAIN ] VTS: Loaded 30893 existing records. [2025-10-06T22:18:05.727728] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-06T22:18:05.769218] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:18:05.769481] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-06T22:18:05.769530] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-06T22:18:05.769820] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-06T22:18:05.769887] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-06T22:18:06.150418] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:18:06.279868] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T22:18:06.283304] [INFO ] [REMOTE ] VTLE: Full fetch complete (68867 records). [2025-10-06T22:18:06.283457] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-06T22:18:06.527740] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-06T22:18:06.706399] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-06T22:18:06.706508] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-06T22:18:06.708025] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-06T22:18:06.708093] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-06T22:18:06.710247] [DEBUG] [LOCAL ] VTLE: Trimmed 68867 records to 48355 (keeping 200 days of data) [2025-10-06T22:18:07.021302] [DEBUG] [LOCAL ] VTLE: Primary data saved (48355 records). [2025-10-06T22:18:07.021467] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-06T22:18:07.021573] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTLE took 46.0s. Estimated remaining: 15m 37s. Rate: 7.1 symbols/min [2025-10-06T22:18:07.210564] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:18:07.247453] [DEBUG] [LOCAL ] VVR: Loaded 31896 existing records from primary storage. [2025-10-06T22:18:07.247918] [INFO ] [MAIN ] VVR: Loaded 31896 existing records. [2025-10-06T22:18:07.324476] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-06T22:18:07.442877] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:18:07.443190] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-06T22:18:07.443484] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-06T22:18:07.443861] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-06T22:18:07.443920] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-06T22:18:07.690961] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-06T22:18:07.863815] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T22:18:07.926000] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:18:08.122568] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-06T22:18:08.385717] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-06T22:18:08.922599] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-06T22:18:09.427753] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T22:18:09.722619] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-06T22:18:10.072229] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-06T22:18:10.522576] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-06T22:18:11.322526] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-06T22:18:11.514781] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T22:18:11.653688] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-06T22:18:12.027116] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-06T22:18:12.122600] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-06T22:18:12.922554] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-06T22:18:13.559276] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T22:18:13.722594] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-06T22:18:14.522518] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-06T22:18:14.683753] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-06T22:18:14.788616] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T22:18:15.322611] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-06T22:18:15.964586] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-06T22:18:16.122548] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-06T22:18:16.713465] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T22:18:16.922534] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-06T22:18:17.179206] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-06T22:18:17.722582] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-06T22:18:18.429414] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-06T22:18:18.522571] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-06T22:18:19.068057] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T22:18:19.322544] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-06T22:18:19.737500] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T22:18:20.122569] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-06T22:18:20.922583] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-06T22:18:21.219463] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T22:18:21.274180] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-06T22:18:21.591988] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-06T22:18:21.722587] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-06T22:18:22.522615] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-06T22:18:23.322501] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-06T22:18:23.757101] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-06T22:18:23.805482] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-06T22:18:24.122509] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-06T22:18:24.183117] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T22:18:24.922520] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-06T22:18:25.722539] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-06T22:18:25.757895] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-06T22:18:25.932627] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-06T22:18:26.522546] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-06T22:18:26.940439] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T22:18:27.322537] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-06T22:18:27.799573] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-06T22:18:28.122610] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-06T22:18:28.674002] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-06T22:18:28.922612] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-06T22:18:29.573724] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T22:18:29.722586] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-06T22:18:29.764583] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-06T22:18:29.766180] [INFO ] [REMOTE ] VTOL: Full fetch complete (26049 records). [2025-10-06T22:18:29.766254] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-06T22:18:30.156357] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-06T22:18:30.156446] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-06T22:18:30.157049] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-06T22:18:30.157126] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-06T22:18:30.157797] [DEBUG] [LOCAL ] VTOL: Trimmed 26049 records to 19528 (keeping 200 days of data) [2025-10-06T22:18:30.284611] [DEBUG] [LOCAL ] VTOL: Primary data saved (19528 records). [2025-10-06T22:18:30.284810] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-06T22:18:30.284917] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTOL took 35.3s. Estimated remaining: 15m 30s. Rate: 7.1 symbols/min [2025-10-06T22:18:30.455336] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:18:30.504670] [DEBUG] [LOCAL ] VVV: Loaded 50880 existing records from primary storage. [2025-10-06T22:18:30.505089] [INFO ] [MAIN ] VVV: Loaded 50880 existing records. [2025-10-06T22:18:30.527832] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-06T22:18:30.731748] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:18:30.732004] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-06T22:18:30.732053] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-06T22:18:30.732320] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-06T22:18:30.732378] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-06T22:18:31.107425] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:18:31.213735] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-06T22:18:31.322546] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-06T22:18:31.977537] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T22:18:32.122518] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-06T22:18:32.922593] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-06T22:18:32.994315] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-06T22:18:33.415724] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-06T22:18:33.722555] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-06T22:18:34.522569] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-06T22:18:34.778605] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-06T22:18:35.260052] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-06T22:18:35.322545] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-06T22:18:35.737079] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T22:18:35.739765] [INFO ] [REMOTE ] VVR: Full fetch complete (46659 records). [2025-10-06T22:18:35.740253] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-06T22:18:36.123485] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-06T22:18:36.166273] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-06T22:18:36.166402] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-06T22:18:36.168429] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-06T22:18:36.168503] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-06T22:18:36.169887] [DEBUG] [LOCAL ] VVR: Trimmed 46659 records to 31678 (keeping 200 days of data) [2025-10-06T22:18:36.373161] [DEBUG] [LOCAL ] VVR: Primary data saved (31678 records). [2025-10-06T22:18:36.373357] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-06T22:18:36.373459] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VVR took 29.4s. Estimated remaining: 15m 21s. Rate: 7.1 symbols/min [2025-10-06T22:18:36.545615] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:18:36.571811] [DEBUG] [LOCAL ] VVX: Loaded 23447 existing records from primary storage. [2025-10-06T22:18:36.572196] [INFO ] [MAIN ] VVX: Loaded 23447 existing records. [2025-10-06T22:18:36.759102] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:18:36.759466] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-06T22:18:36.759523] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-06T22:18:36.759793] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-06T22:18:36.759852] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-06T22:18:36.923058] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-06T22:18:37.193134] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:18:37.167581] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-06T22:18:37.580312] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T22:18:37.722546] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-06T22:18:38.522587] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-06T22:18:38.974534] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T22:18:38.978028] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-06T22:18:38.998870] [INFO ] [REMOTE ] VTS: Full fetch complete (41456 records). [2025-10-06T22:18:38.999246] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-06T22:18:39.327455] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-06T22:18:39.426288] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-06T22:18:39.426391] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-06T22:18:39.427282] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-06T22:18:39.427363] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-06T22:18:39.428816] [DEBUG] [LOCAL ] VTS: Trimmed 41456 records to 30296 (keeping 200 days of data) [2025-10-06T22:18:39.620427] [DEBUG] [LOCAL ] VTS: Primary data saved (30296 records). [2025-10-06T22:18:39.620606] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-06T22:18:39.620727] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VTS took 34.3s. Estimated remaining: 15m 12s. Rate: 7.1 symbols/min [2025-10-06T22:18:39.797366] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:18:39.845107] [DEBUG] [LOCAL ] VYX: Loaded 49397 existing records from primary storage. [2025-10-06T22:18:39.845501] [INFO ] [MAIN ] VYX: Loaded 49397 existing records. [2025-10-06T22:18:40.040566] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:18:40.040895] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-06T22:18:40.040974] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-06T22:18:40.041379] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-06T22:18:40.041442] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-06T22:18:40.128862] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-06T22:18:40.363200] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-06T22:18:40.455852] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:18:40.511610] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-06T22:18:40.922566] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-06T22:18:41.722608] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-06T22:18:41.958005] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T22:18:42.522572] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-06T22:18:42.564665] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T22:18:42.771493] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-06T22:18:43.322548] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-06T22:18:44.122533] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-06T22:18:44.328663] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T22:18:44.421575] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-06T22:18:44.922586] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-06T22:18:45.722526] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-06T22:18:45.770112] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T22:18:46.091501] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-06T22:18:46.522569] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-06T22:18:47.322544] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-06T22:18:47.377126] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T22:18:47.788433] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T22:18:47.792329] [INFO ] [REMOTE ] VTR: Full fetch complete (76365 records). [2025-10-06T22:18:47.792536] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-06T22:18:48.123042] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-06T22:18:48.246799] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-06T22:18:48.249813] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-06T22:18:48.251435] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-06T22:18:48.252219] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-06T22:18:48.254146] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-06T22:18:48.267999] [DEBUG] [LOCAL ] VTR: Trimmed 76365 records to 52807 (keeping 200 days of data) [2025-10-06T22:18:48.606469] [DEBUG] [LOCAL ] VTR: Primary data saved (52807 records). [2025-10-06T22:18:48.606635] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-06T22:18:48.606775] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VTR took 45.9s. Estimated remaining: 15m 4s. Rate: 7.1 symbols/min [2025-10-06T22:18:48.775556] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:18:48.831057] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-10-06T22:18:48.831425] [INFO ] [MAIN ] VZ: Loaded 54571 existing records. [2025-10-06T22:18:48.928844] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-06T22:18:49.009575] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:18:49.009843] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-06T22:18:49.009893] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-06T22:18:49.010171] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-06T22:18:49.010229] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-06T22:18:49.357807] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:18:49.717115] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-06T22:18:49.726519] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-06T22:18:50.044291] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T22:18:50.522571] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-06T22:18:51.322558] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-06T22:18:51.496148] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-06T22:18:51.538472] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T22:18:52.122503] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-06T22:18:52.817769] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T22:18:52.922550] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-06T22:18:53.382420] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-06T22:18:53.722538] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-06T22:18:54.023234] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-06T22:18:54.522543] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-06T22:18:55.279984] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T22:18:55.322532] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-06T22:18:56.122489] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-06T22:18:56.180218] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-06T22:18:56.908891] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-06T22:18:56.922474] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-06T22:18:57.398716] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-06T22:18:57.722544] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-06T22:18:58.522559] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-06T22:18:58.892202] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-06T22:18:58.895292] [INFO ] [REMOTE ] VVV: Full fetch complete (72351 records). [2025-10-06T22:18:58.895582] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-06T22:18:59.322110] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-06T22:18:59.322369] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-06T22:18:59.323809] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-06T22:18:59.323961] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-06T22:18:59.324120] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-06T22:18:59.340708] [DEBUG] [LOCAL ] VVV: Trimmed 72351 records to 50235 (keeping 200 days of data) [2025-10-06T22:18:59.365222] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-06T22:18:59.614323] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-06T22:18:59.703075] [DEBUG] [LOCAL ] VVV: Primary data saved (50235 records). [2025-10-06T22:18:59.703257] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-06T22:18:59.703353] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVV took 29.4s. Estimated remaining: 14m 56s. Rate: 7.1 symbols/min [2025-10-06T22:18:59.876596] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:18:59.930526] [DEBUG] [LOCAL ] W: Loaded 54229 existing records from primary storage. [2025-10-06T22:18:59.930957] [INFO ] [MAIN ] W: Loaded 54229 existing records. [2025-10-06T22:19:00.114252] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:19:00.114486] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-06T22:19:00.114535] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-06T22:19:00.114799] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-06T22:19:00.114858] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-06T22:19:00.127747] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-06T22:19:00.496631] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:19:00.922497] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-06T22:19:01.112147] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-06T22:19:01.550322] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T22:19:01.722617] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-06T22:19:02.522576] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-06T22:19:02.822572] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-06T22:19:02.843468] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-06T22:19:02.845108] [INFO ] [REMOTE ] VVX: Full fetch complete (33459 records). [2025-10-06T22:19:02.845183] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-06T22:19:03.213638] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-06T22:19:03.213752] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-06T22:19:03.214431] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-06T22:19:03.214470] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-06T22:19:03.215306] [DEBUG] [LOCAL ] VVX: Trimmed 33459 records to 23022 (keeping 200 days of data) [2025-10-06T22:19:03.322774] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-06T22:19:03.360885] [DEBUG] [LOCAL ] VVX: Primary data saved (23022 records). [2025-10-06T22:19:03.361053] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-06T22:19:03.361163] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVX took 27.0s. Estimated remaining: 14m 47s. Rate: 7.1 symbols/min [2025-10-06T22:19:03.536361] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:19:03.590431] [DEBUG] [LOCAL ] WAB: Loaded 44708 existing records from primary storage. [2025-10-06T22:19:03.590801] [INFO ] [MAIN ] WAB: Loaded 44708 existing records. [2025-10-06T22:19:03.775479] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:19:03.776612] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-06T22:19:03.776723] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-06T22:19:03.777042] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-06T22:19:03.777099] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-06T22:19:04.140133] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:19:04.137160] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-06T22:19:04.169201] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-06T22:19:04.922586] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-06T22:19:05.181306] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T22:19:05.722546] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-06T22:19:06.449886] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-06T22:19:06.522470] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-06T22:19:06.580900] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-06T22:19:07.264188] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-06T22:19:07.322493] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-06T22:19:08.122562] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-06T22:19:08.183091] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T22:19:08.922512] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-06T22:19:09.027015] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-06T22:19:09.722617] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-06T22:19:10.316238] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-06T22:19:10.375326] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T22:19:10.522613] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-06T22:19:11.322515] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-06T22:19:11.445105] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-06T22:19:12.122612] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-06T22:19:12.309222] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-06T22:19:12.922704] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-06T22:19:13.178757] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T22:19:13.722500] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-06T22:19:13.831556] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T22:19:14.522496] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-06T22:19:14.589614] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-06T22:19:15.322546] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-06T22:19:15.957547] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-06T22:19:16.038963] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-06T22:19:16.122580] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-06T22:19:16.922536] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-06T22:19:16.950200] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-06T22:19:17.722616] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-06T22:19:18.438722] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-06T22:19:18.522573] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-06T22:19:18.934499] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-06T22:19:19.322582] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-06T22:19:19.607735] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T22:19:20.122582] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-06T22:19:20.922573] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-06T22:19:21.060335] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-06T22:19:21.223430] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-06T22:19:21.722503] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-06T22:19:21.818213] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T22:19:21.981732] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T22:19:21.985429] [INFO ] [REMOTE ] VYX: Full fetch complete (70192 records). [2025-10-06T22:19:21.985680] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-06T22:19:22.415527] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-06T22:19:22.415693] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-06T22:19:22.417469] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-06T22:19:22.417539] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-06T22:19:22.419912] [DEBUG] [LOCAL ] VYX: Trimmed 70192 records to 48663 (keeping 200 days of data) [2025-10-06T22:19:22.523022] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-06T22:19:22.758665] [DEBUG] [LOCAL ] VYX: Primary data saved (48663 records). [2025-10-06T22:19:22.758882] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-06T22:19:22.758990] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VYX took 43.1s. Estimated remaining: 14m 39s. Rate: 7.1 symbols/min [2025-10-06T22:19:22.938546] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:19:22.988406] [DEBUG] [LOCAL ] WAL: Loaded 45880 existing records from primary storage. [2025-10-06T22:19:22.988926] [INFO ] [MAIN ] WAL: Loaded 45880 existing records. [2025-10-06T22:19:23.175757] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:19:23.176190] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-06T22:19:23.176243] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-06T22:19:23.176597] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-06T22:19:23.176719] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-06T22:19:23.331403] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-06T22:19:23.561430] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:19:24.038754] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-06T22:19:24.090183] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-06T22:19:24.122480] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-06T22:19:24.922615] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-06T22:19:25.406348] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-06T22:19:25.542388] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-06T22:19:25.722553] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-06T22:19:26.527805] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-06T22:19:26.554511] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T22:19:27.322557] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-06T22:19:27.674538] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-06T22:19:28.122608] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-06T22:19:28.708153] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-06T22:19:28.910290] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-06T22:19:28.922486] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-06T22:19:29.722500] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-06T22:19:29.804405] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T22:19:30.522502] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-06T22:19:30.552395] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-06T22:19:31.322492] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-06T22:19:31.610464] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T22:19:32.071065] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T22:19:32.122589] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-06T22:19:32.574518] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T22:19:32.578691] [INFO ] [REMOTE ] WAB: Full fetch complete (64332 records). [2025-10-06T22:19:32.578961] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-06T22:19:32.929078] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-06T22:19:33.176376] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T22:19:33.190851] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-06T22:19:33.191767] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-06T22:19:33.193225] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-06T22:19:33.193404] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-06T22:19:33.202736] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-06T22:19:33.206810] [DEBUG] [LOCAL ] WAB: Trimmed 64332 records to 44071 (keeping 200 days of data) [2025-10-06T22:19:33.207740] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-10-06T22:19:33.208492] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-06T22:19:33.730711] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-06T22:19:33.725690] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-06T22:19:33.733419] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-06T22:19:33.736863] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-06T22:19:33.736976] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-06T22:19:33.740751] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 53791 (keeping 200 days of data) [2025-10-06T22:19:34.155274] [DEBUG] [LOCAL ] WAB: Primary data saved (44071 records). [2025-10-06T22:19:34.156049] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-06T22:19:34.156208] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. WAB took 30.8s. Estimated remaining: 14m 31s. Rate: 7.1 symbols/min [2025-10-06T22:19:34.343068] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:19:34.450117] [DEBUG] [LOCAL ] WAT: Loaded 35845 existing records from primary storage. [2025-10-06T22:19:34.452324] [INFO ] [MAIN ] WAT: Loaded 35845 existing records. [2025-10-06T22:19:34.525191] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-06T22:19:34.647396] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:19:34.649520] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-06T22:19:34.649863] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-06T22:19:34.650547] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-06T22:19:34.652686] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-06T22:19:34.652789] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-10-06T22:19:34.695323] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-06T22:19:34.695470] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. VZ took 46.1s. Estimated remaining: 14m 22s. Rate: 7.1 symbols/min [2025-10-06T22:19:35.055410] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:19:35.127900] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-06T22:19:35.151788] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-06T22:19:35.155250] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-06T22:19:35.155617] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-06T22:19:35.166146] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-06T22:19:35.176736] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-06T22:19:35.281498] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:19:35.332313] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-06T22:19:35.733775] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:19:35.735896] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-06T22:19:36.014012] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-06T22:19:36.016977] [INFO ] [REMOTE ] W: Full fetch complete (77392 records). [2025-10-06T22:19:36.017086] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-06T22:19:36.127771] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-06T22:19:36.437718] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-06T22:19:36.437860] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-06T22:19:36.440339] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-06T22:19:36.440418] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-06T22:19:36.442686] [DEBUG] [LOCAL ] W: Trimmed 77392 records to 53449 (keeping 200 days of data) [2025-10-06T22:19:36.768875] [DEBUG] [LOCAL ] W: Primary data saved (53449 records). [2025-10-06T22:19:36.769084] [INFO ] [MAIN ] W: Full history saved. [2025-10-06T22:19:36.769196] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. W took 37.1s. Estimated remaining: 14m 13s. Rate: 7.1 symbols/min [2025-10-06T22:19:36.901101] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T22:19:36.928700] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-06T22:19:36.975803] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:19:37.022247] [DEBUG] [LOCAL ] WBS: Loaded 49413 existing records from primary storage. [2025-10-06T22:19:37.022623] [INFO ] [MAIN ] WBS: Loaded 49413 existing records. [2025-10-06T22:19:37.103050] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T22:19:37.124490] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-06T22:19:37.124960] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:19:37.130420] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-06T22:19:37.145845] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:19:37.174197] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-06T22:19:37.198558] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-06T22:19:37.204527] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-06T22:19:37.204417] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:19:37.204759] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-06T22:19:37.204935] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-06T22:19:37.205134] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-06T22:19:37.205064] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WBI took 2.5s. Estimated remaining: 14m 4s. Rate: 7.1 symbols/min [2025-10-06T22:19:37.236903] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-06T22:19:37.248237] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-06T22:19:37.516254] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:19:37.689005] [DEBUG] [LOCAL ] WBX: Loaded 11679 existing records from primary storage. [2025-10-06T22:19:37.713969] [INFO ] [MAIN ] WBX: Loaded 11679 existing records. [2025-10-06T22:19:37.724411] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-06T22:19:37.857707] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:19:37.964478] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:19:37.964765] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-06T22:19:37.964903] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-06T22:19:37.965204] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-06T22:19:37.965272] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-06T22:19:38.093434] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-06T22:19:38.351835] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:19:38.522514] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-06T22:19:39.205130] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-06T22:19:39.258029] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T22:19:39.322557] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-06T22:19:39.897752] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-06T22:19:40.122542] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-06T22:19:40.922558] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-06T22:19:41.595850] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-06T22:19:41.722717] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-06T22:19:42.029227] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-06T22:19:42.470286] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-06T22:19:42.522553] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-06T22:19:43.322573] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-06T22:19:44.057286] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T22:19:44.122466] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-06T22:19:44.241327] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T22:19:44.437601] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-06T22:19:44.922544] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-06T22:19:45.722579] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-06T22:19:46.381269] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T22:19:46.482836] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T22:19:46.522555] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-06T22:19:47.322555] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-06T22:19:48.132769] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-06T22:19:48.138396] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-06T22:19:48.749711] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-06T22:19:48.922501] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-06T22:19:49.120935] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T22:19:49.722529] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-06T22:19:50.215865] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-06T22:19:50.325223] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-06T22:19:50.522561] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-06T22:19:51.322540] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-06T22:19:51.807790] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T22:19:52.093470] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-06T22:19:52.122475] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-06T22:19:52.841868] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-06T22:19:52.922550] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-06T22:19:53.681224] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-06T22:19:53.722478] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-06T22:19:54.514378] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-06T22:19:54.524325] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-06T22:19:54.990024] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-06T22:19:55.322538] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-06T22:19:56.122577] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-06T22:19:56.892920] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-06T22:19:56.923167] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-06T22:19:56.926880] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T22:19:57.722594] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-06T22:19:58.495670] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T22:19:58.522509] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-06T22:19:59.289019] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T22:19:59.322517] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-06T22:19:59.545984] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T22:19:59.549125] [INFO ] [REMOTE ] WAL: Full fetch complete (66670 records). [2025-10-06T22:19:59.549292] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-06T22:19:59.957740] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-06T22:19:59.957883] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-06T22:19:59.959187] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-06T22:19:59.959267] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-06T22:19:59.960990] [DEBUG] [LOCAL ] WAL: Trimmed 66670 records to 45159 (keeping 200 days of data) [2025-10-06T22:20:00.141503] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-06T22:20:00.246329] [DEBUG] [LOCAL ] WAL: Primary data saved (45159 records). [2025-10-06T22:20:00.246510] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-06T22:20:00.246606] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAL took 37.5s. Estimated remaining: 13m 56s. Rate: 7.1 symbols/min [2025-10-06T22:20:00.424413] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:20:00.468795] [DEBUG] [LOCAL ] WCC: Loaded 40042 existing records from primary storage. [2025-10-06T22:20:00.469152] [INFO ] [MAIN ] WCC: Loaded 40042 existing records. [2025-10-06T22:20:00.655027] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:20:00.655268] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-06T22:20:00.655333] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-06T22:20:00.655632] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-06T22:20:00.655721] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-06T22:20:00.929050] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-06T22:20:01.031622] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:20:01.058073] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T22:20:01.208867] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-06T22:20:01.413716] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-06T22:20:01.418495] [INFO ] [REMOTE ] WBS: Full fetch complete (69807 records). [2025-10-06T22:20:01.418778] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-06T22:20:01.727744] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-06T22:20:01.947790] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-06T22:20:01.947986] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-06T22:20:01.949951] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-06T22:20:01.950069] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-06T22:20:01.952411] [DEBUG] [LOCAL ] WBS: Trimmed 69807 records to 48718 (keeping 200 days of data) [2025-10-06T22:20:02.282771] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T22:20:02.300111] [INFO ] [REMOTE ] WAT: Full fetch complete (50211 records). [2025-10-06T22:20:02.307693] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-06T22:20:02.406300] [DEBUG] [LOCAL ] WBS: Primary data saved (48718 records). [2025-10-06T22:20:02.439117] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-06T22:20:02.443261] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WBS took 25.7s. Estimated remaining: 13m 48s. Rate: 7.1 symbols/min [2025-10-06T22:20:02.527719] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-06T22:20:02.874177] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:20:02.972523] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-06T22:20:02.972727] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-06T22:20:02.973915] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-06T22:20:02.974019] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-06T22:20:02.975612] [DEBUG] [LOCAL ] WAT: Trimmed 50211 records to 35451 (keeping 200 days of data) [2025-10-06T22:20:03.114095] [DEBUG] [LOCAL ] WCN: Loaded 48606 existing records from primary storage. [2025-10-06T22:20:03.115375] [INFO ] [MAIN ] WCN: Loaded 48606 existing records. [2025-10-06T22:20:03.231563] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-06T22:20:03.327146] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-06T22:20:03.333930] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:20:03.336266] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-06T22:20:03.336466] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-06T22:20:03.336788] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-06T22:20:03.336866] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-06T22:20:03.808732] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:20:03.831142] [DEBUG] [LOCAL ] WAT: Primary data saved (35451 records). [2025-10-06T22:20:03.831285] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-06T22:20:03.832157] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WAT took 29.7s. Estimated remaining: 13m 39s. Rate: 7.1 symbols/min [2025-10-06T22:20:03.965825] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-06T22:20:04.021471] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:20:04.055661] [DEBUG] [LOCAL ] WD: Loaded 23496 existing records from primary storage. [2025-10-06T22:20:04.055974] [INFO ] [MAIN ] WD: Loaded 23496 existing records. [2025-10-06T22:20:04.127818] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-06T22:20:04.234070] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:20:04.234300] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-06T22:20:04.234349] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-06T22:20:04.234595] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-06T22:20:04.234689] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-06T22:20:04.588786] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:20:04.593776] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-06T22:20:04.922554] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-06T22:20:05.727691] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-06T22:20:05.744778] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-06T22:20:06.523584] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-06T22:20:06.535140] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T22:20:07.072722] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-06T22:20:07.322580] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-06T22:20:07.681403] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-06T22:20:08.122541] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-06T22:20:08.480537] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-06T22:20:08.922551] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-06T22:20:09.722525] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-06T22:20:09.751741] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T22:20:10.223021] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-06T22:20:10.224060] [INFO ] [REMOTE ] WBX: Full fetch complete (24315 records). [2025-10-06T22:20:10.224132] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-06T22:20:10.527684] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-06T22:20:10.595815] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-06T22:20:10.595899] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-06T22:20:10.596440] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-06T22:20:10.596481] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-06T22:20:10.597370] [DEBUG] [LOCAL ] WBX: Trimmed 24315 records to 11130 (keeping 200 days of data) [2025-10-06T22:20:10.659590] [DEBUG] [LOCAL ] WBX: Primary data saved (11130 records). [2025-10-06T22:20:10.659780] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-06T22:20:10.659877] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WBX took 33.5s. Estimated remaining: 13m 30s. Rate: 7.1 symbols/min [2025-10-06T22:20:10.834898] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:20:10.858486] [DEBUG] [LOCAL ] WDH: Loaded 17937 existing records from primary storage. [2025-10-06T22:20:10.858856] [INFO ] [MAIN ] WDH: Loaded 17937 existing records. [2025-10-06T22:20:11.043383] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:20:11.043696] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-06T22:20:11.043767] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-06T22:20:11.043984] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-06T22:20:11.044053] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-06T22:20:11.327888] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-06T22:20:11.433299] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:20:11.447405] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T22:20:11.813033] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-06T22:20:12.122539] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-06T22:20:12.641732] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-06T22:20:12.922581] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-06T22:20:13.682455] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T22:20:13.722540] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-06T22:20:14.280056] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-06T22:20:14.522566] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-06T22:20:15.322536] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-06T22:20:15.384266] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T22:20:16.096471] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-06T22:20:16.122478] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-06T22:20:16.846468] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-06T22:20:16.922513] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-06T22:20:17.669254] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-06T22:20:17.722528] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-06T22:20:18.469525] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T22:20:18.522576] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-06T22:20:18.987804] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-06T22:20:19.322545] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-06T22:20:20.123314] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-06T22:20:20.123398] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-06T22:20:20.610542] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-06T22:20:20.922566] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-06T22:20:21.495201] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-06T22:20:21.722553] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-06T22:20:22.490371] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-06T22:20:22.522497] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-06T22:20:23.218095] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-06T22:20:23.322531] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-06T22:20:23.909162] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-06T22:20:24.122552] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-06T22:20:24.826263] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T22:20:24.922542] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-06T22:20:25.663823] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-06T22:20:25.722634] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-06T22:20:25.998154] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-06T22:20:26.522575] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-06T22:20:27.003800] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-06T22:20:27.322550] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-06T22:20:28.122536] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-06T22:20:28.406672] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T22:20:28.409530] [INFO ] [REMOTE ] WCC: Full fetch complete (57605 records). [2025-10-06T22:20:28.409795] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-06T22:20:28.861896] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-06T22:20:28.861990] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-06T22:20:28.863758] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-06T22:20:28.864024] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-06T22:20:28.884328] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T22:20:28.890683] [DEBUG] [LOCAL ] WCC: Trimmed 57605 records to 39285 (keeping 200 days of data) [2025-10-06T22:20:28.952830] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-06T22:20:29.170181] [DEBUG] [LOCAL ] WCC: Primary data saved (39285 records). [2025-10-06T22:20:29.170401] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-06T22:20:29.170507] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WCC took 28.9s. Estimated remaining: 13m 22s. Rate: 7.1 symbols/min [2025-10-06T22:20:29.380631] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:20:29.406857] [DEBUG] [LOCAL ] WDI: Loaded 21410 existing records from primary storage. [2025-10-06T22:20:29.407198] [INFO ] [MAIN ] WDI: Loaded 21410 existing records. [2025-10-06T22:20:29.601602] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:20:29.602267] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-06T22:20:29.602356] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-06T22:20:29.602773] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-06T22:20:29.602898] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-06T22:20:29.725808] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-06T22:20:29.722879] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-06T22:20:30.025495] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:20:30.232568] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-06T22:20:30.522554] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-06T22:20:30.995522] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-06T22:20:31.322610] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-06T22:20:31.920911] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T22:20:32.122534] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-06T22:20:32.711778] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-06T22:20:32.922535] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-06T22:20:33.672363] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-06T22:20:33.722503] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-06T22:20:34.392308] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-06T22:20:34.522535] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-06T22:20:35.093844] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-06T22:20:35.322546] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-06T22:20:35.816273] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-06T22:20:36.122564] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-06T22:20:36.676586] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-06T22:20:36.922541] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-06T22:20:37.486959] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-06T22:20:37.722559] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-06T22:20:38.461585] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-06T22:20:38.522513] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-06T22:20:39.322550] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-06T22:20:39.536121] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-06T22:20:39.538128] [INFO ] [REMOTE ] WDH: Full fetch complete (23702 records). [2025-10-06T22:20:39.538209] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-06T22:20:39.915114] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-06T22:20:39.915206] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-06T22:20:39.915725] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-06T22:20:39.915788] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-06T22:20:39.916488] [DEBUG] [LOCAL ] WDH: Trimmed 23702 records to 17903 (keeping 200 days of data) [2025-10-06T22:20:40.021290] [DEBUG] [LOCAL ] WDH: Primary data saved (17903 records). [2025-10-06T22:20:40.021474] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-06T22:20:40.021570] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WDH took 29.4s. Estimated remaining: 13m 14s. Rate: 7.1 symbols/min [2025-10-06T22:20:40.122542] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-06T22:20:40.183926] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-06T22:20:40.185844] [INFO ] [REMOTE ] WD: Full fetch complete (33327 records). [2025-10-06T22:20:40.185935] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-06T22:20:40.625012] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-06T22:20:40.625131] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-06T22:20:40.626669] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-06T22:20:40.626738] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-06T22:20:40.628130] [DEBUG] [LOCAL ] WD: Trimmed 33327 records to 23201 (keeping 200 days of data) [2025-10-06T22:20:40.790406] [DEBUG] [LOCAL ] WD: Primary data saved (23201 records). [2025-10-06T22:20:40.790613] [INFO ] [MAIN ] WD: Full history saved. [2025-10-06T22:20:40.790761] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WD took 37.0s. Estimated remaining: 13m 5s. Rate: 7.1 symbols/min [2025-10-06T22:20:40.922575] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-06T22:20:41.583196] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T22:20:41.640394] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T22:20:41.722785] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-06T22:20:42.308824] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-06T22:20:42.522541] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-06T22:20:43.076051] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-06T22:20:43.322534] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-06T22:20:44.034988] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-06T22:20:44.122533] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-06T22:20:44.922559] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-06T22:20:45.184772] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-06T22:20:45.525969] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T22:20:45.528815] [INFO ] [REMOTE ] WCN: Full fetch complete (69398 records). [2025-10-06T22:20:45.528962] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-06T22:20:45.727739] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-06T22:20:45.925973] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-06T22:20:45.926064] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-06T22:20:45.927254] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-06T22:20:45.927319] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-06T22:20:45.928832] [DEBUG] [LOCAL ] WCN: Trimmed 69398 records to 47931 (keeping 200 days of data) [2025-10-06T22:20:46.230373] [DEBUG] [LOCAL ] WCN: Primary data saved (47931 records). [2025-10-06T22:20:46.230544] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-06T22:20:46.230637] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WCN took 43.8s. Estimated remaining: 12m 57s. Rate: 7.1 symbols/min [2025-10-06T22:20:46.442391] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-06T22:20:46.522528] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-06T22:20:47.092716] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-06T22:20:47.322537] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-06T22:20:47.976539] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-06T22:20:48.122727] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-06T22:20:48.697261] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-06T22:20:48.922588] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-06T22:20:49.487214] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-06T22:20:49.722634] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-06T22:20:50.287925] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-06T22:20:50.522531] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-06T22:20:51.111849] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-06T22:20:51.113861] [INFO ] [REMOTE ] WDI: Full fetch complete (30826 records). [2025-10-06T22:20:51.113968] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-06T22:20:51.531156] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-06T22:20:51.531368] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-06T22:20:51.532488] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-06T22:20:51.532554] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-06T22:20:51.533620] [DEBUG] [LOCAL ] WDI: Trimmed 30826 records to 21121 (keeping 200 days of data) [2025-10-06T22:20:51.675479] [DEBUG] [LOCAL ] WDI: Primary data saved (21121 records). [2025-10-06T22:20:51.675672] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-06T22:20:51.675846] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 22.5s. Estimated remaining: 12m 48s. Rate: 7.1 symbols/min [2025-10-06T22:20:52.361271] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:20:52.407207] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:20:52.404093] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:20:52.481429] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:20:52.502610] [DEBUG] [LOCAL ] WEA: Loaded 7325 existing records from primary storage. [2025-10-06T22:20:52.503406] [INFO ] [MAIN ] WEA: Loaded 7325 existing records. [2025-10-06T22:20:52.682187] [DEBUG] [LOCAL ] WEAV: Loaded 42548 existing records from primary storage. [2025-10-06T22:20:52.705233] [INFO ] [MAIN ] WEAV: Loaded 42548 existing records. [2025-10-06T22:20:52.778390] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:20:52.791036] [DEBUG] [LOCAL ] WEC: Loaded 52957 existing records from primary storage. [2025-10-06T22:20:52.725518] [DEBUG] [LOCAL ] WDS: Loaded 43883 existing records from primary storage. [2025-10-06T22:20:52.791382] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-06T22:20:52.801509] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-06T22:20:52.810522] [INFO ] [MAIN ] WEC: Loaded 52957 existing records. [2025-10-06T22:20:52.827002] [INFO ] [MAIN ] WDS: Loaded 43883 existing records. [2025-10-06T22:20:52.836584] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-06T22:20:52.868639] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-06T22:20:53.650548] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:20:53.635410] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:20:53.694870] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-06T22:20:53.700376] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-06T22:20:53.704861] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:20:53.721278] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-06T22:20:53.726625] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-06T22:20:53.721167] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-06T22:20:53.743258] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-06T22:20:53.715639] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-06T22:20:53.743673] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-06T22:20:53.749015] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-06T22:20:53.749135] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-06T22:20:53.844058] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-06T22:20:53.982032] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-06T22:20:54.028199] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:20:54.080562] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-06T22:20:54.815304] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-06T22:20:54.842951] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-06T22:20:54.835617] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:20:54.862192] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-06T22:20:54.975089] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:20:54.985849] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-06T22:20:55.041053] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:20:55.041566] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-06T22:20:55.261931] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-06T22:20:55.322472] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-06T22:20:55.570248] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-06T22:20:55.599900] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-06T22:20:55.754207] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-06T22:20:55.794159] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-06T22:20:56.122519] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-06T22:20:56.870798] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-06T22:20:56.922505] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-06T22:20:57.722561] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-06T22:20:58.044912] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T22:20:58.522509] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-06T22:20:58.554240] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-06T22:20:59.322554] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-06T22:20:59.371032] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-06T22:21:00.082687] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T22:21:00.122558] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-06T22:21:00.922531] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-06T22:21:01.320145] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-06T22:21:01.320387] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-06T22:21:01.722607] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-06T22:21:02.523605] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-06T22:21:02.527284] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-06T22:21:02.926555] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-06T22:21:03.322558] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-06T22:21:04.064291] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-06T22:21:04.122512] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-06T22:21:04.528721] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-06T22:21:04.922592] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-06T22:21:05.732970] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-06T22:21:05.739234] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-06T22:21:06.203572] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-06T22:21:06.522585] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-06T22:21:07.322570] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-06T22:21:07.361003] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-06T22:21:08.111495] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-06T22:21:08.122475] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-06T22:21:08.615051] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-06T22:21:08.922599] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-06T22:21:09.407579] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-06T22:21:09.722546] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-06T22:21:10.204583] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-06T22:21:10.522542] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-06T22:21:11.242831] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-06T22:21:11.322548] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-06T22:21:12.094248] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T22:21:12.122471] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-06T22:21:12.828136] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-06T22:21:12.922583] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-06T22:21:13.715018] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-06T22:21:13.726132] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-06T22:21:14.179827] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-06T22:21:14.522563] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-06T22:21:15.245688] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T22:21:15.322546] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-06T22:21:16.128288] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-06T22:21:16.142846] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-06T22:21:16.861012] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-06T22:21:16.922601] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-06T22:21:17.727702] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-06T22:21:17.744882] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-06T22:21:18.122509] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-06T22:21:18.522569] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-06T22:21:19.322574] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-06T22:21:19.393162] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T22:21:19.776615] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T22:21:19.777594] [INFO ] [REMOTE ] WEA: Full fetch complete (9764 records). [2025-10-06T22:21:19.777715] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-06T22:21:20.122639] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-06T22:21:20.147372] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-06T22:21:20.147471] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-06T22:21:20.147793] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-06T22:21:20.147856] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-06T22:21:20.148483] [DEBUG] [LOCAL ] WEA: Trimmed 9764 records to 7348 (keeping 200 days of data) [2025-10-06T22:21:20.203923] [DEBUG] [LOCAL ] WEA: Primary data saved (7348 records). [2025-10-06T22:21:20.204113] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-06T22:21:20.204261] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 28.4s. Estimated remaining: 12m 41s. Rate: 7.1 symbols/min [2025-10-06T22:21:20.387147] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:21:20.458308] [DEBUG] [LOCAL ] WELL: Loaded 53120 existing records from primary storage. [2025-10-06T22:21:20.458820] [INFO ] [MAIN ] WELL: Loaded 53120 existing records. [2025-10-06T22:21:20.660071] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:21:20.660398] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-06T22:21:20.660451] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-06T22:21:20.660771] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-06T22:21:20.660832] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-06T22:21:20.925941] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-06T22:21:21.135563] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-06T22:21:21.142431] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:21:21.597419] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-06T22:21:21.722547] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-06T22:21:22.441789] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-06T22:21:22.522578] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-06T22:21:23.322510] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-06T22:21:23.732543] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-06T22:21:23.736921] [INFO ] [REMOTE ] WEAV: Full fetch complete (61594 records). [2025-10-06T22:21:23.737052] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-06T22:21:24.133427] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-06T22:21:24.136525] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-06T22:21:24.137561] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-06T22:21:24.138931] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-06T22:21:24.139052] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-06T22:21:24.170887] [DEBUG] [LOCAL ] WEAV: Trimmed 61594 records to 41857 (keeping 200 days of data) [2025-10-06T22:21:24.173736] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T22:21:24.425045] [DEBUG] [LOCAL ] WEAV: Primary data saved (41857 records). [2025-10-06T22:21:24.425203] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-06T22:21:24.425296] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEAV took 32.7s. Estimated remaining: 12m 32s. Rate: 7.1 symbols/min [2025-10-06T22:21:24.601509] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:21:24.648825] [DEBUG] [LOCAL ] WES: Loaded 48847 existing records from primary storage. [2025-10-06T22:21:24.649212] [INFO ] [MAIN ] WES: Loaded 48847 existing records. [2025-10-06T22:21:24.835061] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:21:24.835509] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-06T22:21:24.835590] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-06T22:21:24.835956] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-06T22:21:24.836014] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-06T22:21:24.923766] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-06T22:21:25.212971] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-06T22:21:25.291825] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:21:25.720387] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-06T22:21:25.728936] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-06T22:21:26.522500] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-06T22:21:26.566867] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T22:21:26.897256] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-06T22:21:26.900622] [INFO ] [REMOTE ] WEC: Full fetch complete (75532 records). [2025-10-06T22:21:26.900827] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-06T22:21:27.300224] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-06T22:21:27.300320] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-06T22:21:27.301554] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-06T22:21:27.301622] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-06T22:21:27.303257] [DEBUG] [LOCAL ] WEC: Trimmed 75532 records to 52183 (keeping 200 days of data) [2025-10-06T22:21:27.362594] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-06T22:21:27.646303] [DEBUG] [LOCAL ] WEC: Primary data saved (52183 records). [2025-10-06T22:21:27.646498] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-06T22:21:27.646738] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WEC took 36.0s. Estimated remaining: 12m 23s. Rate: 7.1 symbols/min [2025-10-06T22:21:27.822721] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:21:27.863217] [DEBUG] [LOCAL ] WEX: Loaded 34924 existing records from primary storage. [2025-10-06T22:21:27.863554] [INFO ] [MAIN ] WEX: Loaded 34924 existing records. [2025-10-06T22:21:28.047884] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:21:28.048280] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-06T22:21:28.048379] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-06T22:21:28.048708] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-06T22:21:28.048776] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-06T22:21:28.128890] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-06T22:21:28.428864] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:21:28.449872] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-06T22:21:28.927807] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-06T22:21:28.962270] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-06T22:21:29.609833] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-06T22:21:29.722586] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-06T22:21:30.522570] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-06T22:21:30.885616] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T22:21:30.888111] [INFO ] [REMOTE ] WDS: Full fetch complete (64376 records). [2025-10-06T22:21:30.888201] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-06T22:21:31.282277] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-06T22:21:31.282440] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-06T22:21:31.283776] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-06T22:21:31.283869] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-06T22:21:31.285848] [DEBUG] [LOCAL ] WDS: Trimmed 64376 records to 43125 (keeping 200 days of data) [2025-10-06T22:21:31.340982] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-06T22:21:31.413577] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-06T22:21:31.600919] [DEBUG] [LOCAL ] WDS: Primary data saved (43125 records). [2025-10-06T22:21:31.601083] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-06T22:21:31.601171] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WDS took 39.9s. Estimated remaining: 12m 15s. Rate: 7.1 symbols/min [2025-10-06T22:21:31.777634] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:21:31.792527] [DEBUG] [LOCAL ] WF: Loaded 10827 existing records from primary storage. [2025-10-06T22:21:31.792884] [INFO ] [MAIN ] WF: Loaded 10827 existing records. [2025-10-06T22:21:31.974062] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:21:31.974491] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-06T22:21:31.974551] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-06T22:21:31.975216] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-06T22:21:31.975277] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-06T22:21:32.125573] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-06T22:21:32.188369] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-06T22:21:32.362906] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:21:32.922508] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-06T22:21:32.987965] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-06T22:21:33.470024] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-06T22:21:33.722573] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-06T22:21:34.521505] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-06T22:21:34.528027] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-06T22:21:35.098020] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-06T22:21:35.322542] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-06T22:21:35.815552] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-06T22:21:36.122584] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-06T22:21:36.871075] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-06T22:21:36.922536] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-06T22:21:37.655031] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-06T22:21:37.722523] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-06T22:21:38.477451] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T22:21:38.522484] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-06T22:21:39.252449] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-06T22:21:39.322525] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-06T22:21:39.793020] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-06T22:21:40.122548] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-06T22:21:40.650776] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-06T22:21:40.922571] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-06T22:21:41.617781] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-06T22:21:41.722495] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-06T22:21:42.421507] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-06T22:21:42.522543] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-06T22:21:43.327687] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-06T22:21:43.344235] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-06T22:21:43.921378] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-06T22:21:44.122597] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-06T22:21:44.816233] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-06T22:21:44.922541] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-06T22:21:45.609473] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-06T22:21:45.722572] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-06T22:21:46.497313] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-06T22:21:46.522571] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-06T22:21:47.234256] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-06T22:21:47.322582] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-06T22:21:48.122554] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-06T22:21:48.179022] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-06T22:21:48.862749] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-06T22:21:48.922485] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-06T22:21:49.711531] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-06T22:21:49.722462] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-06T22:21:50.491984] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-06T22:21:50.522471] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-06T22:21:51.264711] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-06T22:21:51.322477] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-06T22:21:51.912968] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-06T22:21:52.122588] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-06T22:21:52.596956] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-06T22:21:52.922552] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-06T22:21:53.382274] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T22:21:53.385551] [INFO ] [REMOTE ] WELL: Full fetch complete (75754 records). [2025-10-06T22:21:53.385706] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-06T22:21:53.727744] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-06T22:21:53.822530] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-06T22:21:53.822678] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-06T22:21:53.824166] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-06T22:21:53.824236] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-06T22:21:53.826076] [DEBUG] [LOCAL ] WELL: Trimmed 75754 records to 52352 (keeping 200 days of data) [2025-10-06T22:21:54.169674] [DEBUG] [LOCAL ] WELL: Primary data saved (52352 records). [2025-10-06T22:21:54.169870] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-06T22:21:54.170877] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WELL took 34.0s. Estimated remaining: 12m 7s. Rate: 7.1 symbols/min [2025-10-06T22:21:54.346123] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:21:54.403974] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-10-06T22:21:54.404396] [INFO ] [MAIN ] WFC: Loaded 54528 existing records. [2025-10-06T22:21:54.531552] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-06T22:21:54.594394] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:21:54.595001] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-06T22:21:54.595145] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-06T22:21:54.595489] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-06T22:21:54.595629] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-06T22:21:54.744238] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-06T22:21:55.003001] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:21:55.322556] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-06T22:21:55.620004] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-06T22:21:55.622736] [INFO ] [REMOTE ] WEX: Full fetch complete (50475 records). [2025-10-06T22:21:55.622877] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-06T22:21:56.018544] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-06T22:21:56.018800] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-06T22:21:56.020043] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-06T22:21:56.020134] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-06T22:21:56.060215] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T22:21:56.058911] [DEBUG] [LOCAL ] WEX: Trimmed 50475 records to 34032 (keeping 200 days of data) [2025-10-06T22:21:56.126607] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-06T22:21:56.287155] [DEBUG] [LOCAL ] WEX: Primary data saved (34032 records). [2025-10-06T22:21:56.287349] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-06T22:21:56.287473] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WEX took 28.6s. Estimated remaining: 11m 58s. Rate: 7.1 symbols/min [2025-10-06T22:21:56.455965] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:21:56.481414] [DEBUG] [LOCAL ] WFG: Loaded 25021 existing records from primary storage. [2025-10-06T22:21:56.481742] [INFO ] [MAIN ] WFG: Loaded 25021 existing records. [2025-10-06T22:21:56.661945] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:21:56.662258] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-06T22:21:56.662376] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-06T22:21:56.662587] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-06T22:21:56.662666] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-06T22:21:56.926197] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-06T22:21:57.033690] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:21:57.074272] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-06T22:21:57.440898] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-06T22:21:57.722592] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-06T22:21:58.522504] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-06T22:21:58.565850] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T22:21:59.302101] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-06T22:21:59.322495] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-06T22:21:59.885395] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-06T22:22:00.122519] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-06T22:22:00.922576] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-06T22:22:01.073957] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-06T22:22:01.517255] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-06T22:22:01.722597] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-06T22:22:02.501725] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T22:22:02.522479] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-06T22:22:03.321084] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-06T22:22:03.329035] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-06T22:22:03.778814] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-06T22:22:04.122530] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-06T22:22:04.930694] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-06T22:22:04.968100] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-06T22:22:05.722548] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-06T22:22:06.350927] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-06T22:22:06.354082] [INFO ] [REMOTE ] WES: Full fetch complete (70048 records). [2025-10-06T22:22:06.354234] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-06T22:22:06.570446] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-06T22:22:06.863243] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-06T22:22:06.875537] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-06T22:22:06.875710] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-06T22:22:06.877329] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-06T22:22:06.877495] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-06T22:22:06.879903] [DEBUG] [LOCAL ] WES: Trimmed 70048 records to 48203 (keeping 200 days of data) [2025-10-06T22:22:07.115867] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-06T22:22:07.207576] [DEBUG] [LOCAL ] WES: Primary data saved (48203 records). [2025-10-06T22:22:07.207807] [INFO ] [MAIN ] WES: Full history saved. [2025-10-06T22:22:07.207933] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WES took 42.8s. Estimated remaining: 11m 50s. Rate: 7.1 symbols/min [2025-10-06T22:22:07.327740] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-06T22:22:07.389968] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:22:07.428032] [DEBUG] [LOCAL ] WGO: Loaded 39397 existing records from primary storage. [2025-10-06T22:22:07.428406] [INFO ] [MAIN ] WGO: Loaded 39397 existing records. [2025-10-06T22:22:07.611314] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:22:07.611589] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-06T22:22:07.611665] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-06T22:22:07.611944] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-06T22:22:07.612004] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-06T22:22:07.997659] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:22:08.122503] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-06T22:22:08.288201] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-06T22:22:08.835319] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-06T22:22:08.922535] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-06T22:22:09.536114] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-06T22:22:09.722571] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-06T22:22:10.331781] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-06T22:22:10.522563] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-06T22:22:11.316767] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-06T22:22:11.327917] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-06T22:22:11.878392] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-06T22:22:11.879575] [INFO ] [REMOTE ] WF: Full fetch complete (16237 records). [2025-10-06T22:22:11.879673] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-06T22:22:12.127634] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-06T22:22:12.245547] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-06T22:22:12.245639] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-06T22:22:12.246039] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-06T22:22:12.246082] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-06T22:22:12.246625] [DEBUG] [LOCAL ] WF: Trimmed 16237 records to 10717 (keeping 200 days of data) [2025-10-06T22:22:12.313323] [DEBUG] [LOCAL ] WF: Primary data saved (10717 records). [2025-10-06T22:22:12.313491] [INFO ] [MAIN ] WF: Full history saved. [2025-10-06T22:22:12.313694] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WF took 40.7s. Estimated remaining: 11m 41s. Rate: 7.1 symbols/min [2025-10-06T22:22:12.480585] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:22:12.526829] [DEBUG] [LOCAL ] WH: Loaded 46091 existing records from primary storage. [2025-10-06T22:22:12.527215] [INFO ] [MAIN ] WH: Loaded 46091 existing records. [2025-10-06T22:22:12.717207] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:22:12.717557] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-06T22:22:12.717615] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-06T22:22:12.717893] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-06T22:22:12.717953] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-06T22:22:12.931416] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-06T22:22:13.083476] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:22:13.114045] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-06T22:22:13.699421] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T22:22:13.722476] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-06T22:22:14.413001] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-06T22:22:14.522495] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-06T22:22:15.292744] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-06T22:22:15.322569] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-06T22:22:16.050098] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-06T22:22:16.122545] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-06T22:22:16.285828] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.16 seconds). [2025-10-06T22:22:16.289198] [INFO ] [REMOTE ] WFC: Full fetch complete (77791 records). [2025-10-06T22:22:16.289345] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-06T22:22:16.709943] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-06T22:22:16.710064] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-06T22:22:16.711413] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-06T22:22:16.711481] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-06T22:22:16.713264] [DEBUG] [LOCAL ] WFC: Trimmed 77791 records to 53748 (keeping 200 days of data) [2025-10-06T22:22:16.940624] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-06T22:22:17.073092] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-10-06T22:22:17.073277] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-06T22:22:17.074140] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFC took 22.9s. Estimated remaining: 11m 33s. Rate: 7.1 symbols/min [2025-10-06T22:22:17.258040] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:22:17.301814] [DEBUG] [LOCAL ] WHD: Loaded 40900 existing records from primary storage. [2025-10-06T22:22:17.302183] [INFO ] [MAIN ] WHD: Loaded 40900 existing records. [2025-10-06T22:22:17.485663] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:22:17.486060] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-06T22:22:17.486118] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-06T22:22:17.486351] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-06T22:22:17.486436] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-06T22:22:17.727811] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-06T22:22:17.854309] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:22:17.877959] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-06T22:22:18.464756] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-06T22:22:18.522537] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-06T22:22:19.166017] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-06T22:22:19.322555] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-06T22:22:19.988759] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-06T22:22:20.122574] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-06T22:22:20.719328] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T22:22:20.922567] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-06T22:22:21.521818] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-06T22:22:21.722554] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-06T22:22:22.457171] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-06T22:22:22.522488] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-06T22:22:23.216503] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-06T22:22:23.322525] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-06T22:22:24.020070] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-06T22:22:24.122535] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-06T22:22:24.874114] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-06T22:22:24.922511] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-06T22:22:25.682851] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T22:22:25.722482] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-06T22:22:26.500351] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T22:22:26.522517] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-06T22:22:27.127948] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-06T22:22:27.322541] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-06T22:22:28.082299] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-06T22:22:28.122596] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-06T22:22:28.842025] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-06T22:22:28.922488] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-06T22:22:29.666362] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-06T22:22:29.722520] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-06T22:22:30.449437] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T22:22:30.522540] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-06T22:22:31.322594] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-06T22:22:31.603279] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T22:22:31.605933] [INFO ] [REMOTE ] WHD: Full fetch complete (57627 records). [2025-10-06T22:22:31.606045] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-06T22:22:31.988533] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-06T22:22:31.988733] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-06T22:22:31.989877] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-06T22:22:31.989958] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-06T22:22:31.991451] [DEBUG] [LOCAL ] WHD: Trimmed 57627 records to 40133 (keeping 200 days of data) [2025-10-06T22:22:32.112676] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-06T22:22:32.123147] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-06T22:22:32.276752] [DEBUG] [LOCAL ] WHD: Primary data saved (40133 records). [2025-10-06T22:22:32.276902] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-06T22:22:32.276987] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WHD took 15.2s. Estimated remaining: 11m 24s. Rate: 7.1 symbols/min [2025-10-06T22:22:32.452296] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:22:32.458045] [DEBUG] [LOCAL ] WHG: Loaded 3327 existing records from primary storage. [2025-10-06T22:22:32.458194] [INFO ] [MAIN ] WHG: Loaded 3327 existing records. [2025-10-06T22:22:32.633468] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:22:32.633887] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-06T22:22:32.633946] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-06T22:22:32.634126] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-06T22:22:32.634182] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-06T22:22:32.924726] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-06T22:22:32.928405] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T22:22:33.016769] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:22:33.722262] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-06T22:22:33.729994] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-06T22:22:34.291822] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-06T22:22:34.522591] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-06T22:22:35.146931] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-06T22:22:35.322523] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-06T22:22:35.931896] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-06T22:22:36.122557] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-06T22:22:36.876286] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T22:22:36.922516] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-06T22:22:37.222713] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-06T22:22:37.722539] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-06T22:22:38.009211] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-06T22:22:38.522564] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-06T22:22:39.286159] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-06T22:22:39.322550] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-06T22:22:40.122622] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-06T22:22:40.538400] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T22:22:40.540720] [INFO ] [REMOTE ] WGO: Full fetch complete (57518 records). [2025-10-06T22:22:40.540816] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-06T22:22:40.935865] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-06T22:22:40.938972] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-06T22:22:40.939114] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-06T22:22:40.940293] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-06T22:22:40.941277] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-06T22:22:40.943364] [DEBUG] [LOCAL ] WGO: Trimmed 57518 records to 38647 (keeping 200 days of data) [2025-10-06T22:22:40.975885] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-06T22:22:41.219341] [DEBUG] [LOCAL ] WGO: Primary data saved (38647 records). [2025-10-06T22:22:41.219525] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-06T22:22:41.219622] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WGO took 34.0s. Estimated remaining: 11m 16s. Rate: 7.1 symbols/min [2025-10-06T22:22:41.386312] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:22:41.430790] [DEBUG] [LOCAL ] WHR: Loaded 48838 existing records from primary storage. [2025-10-06T22:22:41.431165] [INFO ] [MAIN ] WHR: Loaded 48838 existing records. [2025-10-06T22:22:41.606541] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:22:41.606836] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-06T22:22:41.606906] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-06T22:22:41.607148] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-06T22:22:41.607224] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-06T22:22:41.727457] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-06T22:22:41.722269] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-06T22:22:41.800258] [INFO ] [REMOTE ] WFG: Full fetch complete (35855 records). [2025-10-06T22:22:41.828456] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-06T22:22:42.193944] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:22:42.390033] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-06T22:22:42.390262] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-06T22:22:42.391941] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-06T22:22:42.392017] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-06T22:22:42.394833] [DEBUG] [LOCAL ] WFG: Trimmed 35855 records to 24705 (keeping 200 days of data) [2025-10-06T22:22:42.522683] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-06T22:22:42.573247] [DEBUG] [LOCAL ] WFG: Primary data saved (24705 records). [2025-10-06T22:22:42.573431] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-06T22:22:42.573536] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WFG took 46.3s. Estimated remaining: 11m 7s. Rate: 7.1 symbols/min [2025-10-06T22:22:42.799438] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:22:42.802146] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-06T22:22:42.818618] [DEBUG] [LOCAL ] WIA: Loaded 4897 existing records from primary storage. [2025-10-06T22:22:42.819015] [INFO ] [MAIN ] WIA: Loaded 4897 existing records. [2025-10-06T22:22:42.932489] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-06T22:22:43.021626] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:22:43.021975] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-06T22:22:43.022076] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-06T22:22:43.022286] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-06T22:22:43.022348] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-06T22:22:43.323215] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-06T22:22:43.409165] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:22:43.789561] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-06T22:22:44.122558] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-06T22:22:44.922548] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-06T22:22:45.288132] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-06T22:22:45.707147] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-06T22:22:45.722478] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-06T22:22:46.522772] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-06T22:22:47.059604] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-06T22:22:47.322485] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-06T22:22:47.407589] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T22:22:48.035410] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-06T22:22:48.122489] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-06T22:22:48.922615] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-06T22:22:49.299898] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-06T22:22:49.573370] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T22:22:49.722603] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-06T22:22:50.098701] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-06T22:22:50.522570] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-06T22:22:51.191598] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-06T22:22:51.322601] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-06T22:22:52.122617] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-06T22:22:52.922526] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-06T22:22:53.722738] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-06T22:23:04.776973] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (11.05 seconds). [2025-10-06T22:23:04.778964] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-06T22:23:05.578892] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (14.26 seconds). [2025-10-06T22:23:05.581252] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-06T22:23:05.683945] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (13.56 seconds). [2025-10-06T22:23:05.694562] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-06T22:23:06.257698] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-06T22:23:06.259158] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-06T22:23:06.390578] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-06T22:23:06.392510] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-06T22:23:06.428525] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.17 seconds). [2025-10-06T22:23:06.429854] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-06T22:23:06.722581] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-06T22:23:06.723354] [INFO ] [REMOTE ] WHG: Full fetch complete (4609 records). [2025-10-06T22:23:06.723423] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-06T22:23:06.986152] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-06T22:23:07.021976] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-06T22:23:07.104958] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-06T22:23:07.105050] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-06T22:23:07.105215] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-06T22:23:07.105254] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-06T22:23:07.105621] [DEBUG] [LOCAL ] WHG: Trimmed 4609 records to 3259 (keeping 200 days of data) [2025-10-06T22:23:07.125594] [DEBUG] [LOCAL ] WHG: Primary data saved (3259 records). [2025-10-06T22:23:07.125710] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-06T22:23:07.125807] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WHG took 34.8s. Estimated remaining: 10m 59s. Rate: 7.1 symbols/min [2025-10-06T22:23:07.296866] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:23:07.311153] [DEBUG] [LOCAL ] WINN: Loaded 11777 existing records from primary storage. [2025-10-06T22:23:07.311425] [INFO ] [MAIN ] WINN: Loaded 11777 existing records. [2025-10-06T22:23:07.495753] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:23:07.496514] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-06T22:23:07.497614] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-06T22:23:07.497998] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-06T22:23:07.498106] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-06T22:23:07.740030] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (14.82 seconds). [2025-10-06T22:23:07.786230] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-06T22:23:07.823404] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-06T22:23:07.824400] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-06T22:23:07.950572] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:23:07.951172] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-06T22:23:07.987996] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-06T22:23:08.000004] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-06T22:23:08.478845] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-06T22:23:08.480435] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-06T22:23:08.695351] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-06T22:23:08.698633] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-06T22:23:08.751957] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-06T22:23:08.763034] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-06T22:23:09.166631] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-06T22:23:09.168819] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-06T22:23:09.609367] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-06T22:23:09.612774] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-06T22:23:09.814859] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-06T22:23:09.813857] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-06T22:23:09.828464] [INFO ] [REMOTE ] WH: Full fetch complete (64952 records). [2025-10-06T22:23:09.828926] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-06T22:23:09.830576] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-06T22:23:09.830174] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-06T22:23:09.855832] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-06T22:23:10.323045] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-06T22:23:10.330621] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-06T22:23:10.330949] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-06T22:23:10.332048] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-06T22:23:10.333952] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-06T22:23:10.334198] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-06T22:23:10.336454] [DEBUG] [LOCAL ] WH: Trimmed 64952 records to 45361 (keeping 200 days of data) [2025-10-06T22:23:10.582781] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-06T22:23:10.587952] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-06T22:23:10.670696] [DEBUG] [LOCAL ] WH: Primary data saved (45361 records). [2025-10-06T22:23:10.670902] [INFO ] [MAIN ] WH: Full history saved. [2025-10-06T22:23:10.671044] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WH took 58.4s. Estimated remaining: 10m 51s. Rate: 7.1 symbols/min [2025-10-06T22:23:10.849511] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:23:10.905606] [DEBUG] [LOCAL ] WIT: Loaded 53128 existing records from primary storage. [2025-10-06T22:23:10.906061] [INFO ] [MAIN ] WIT: Loaded 53128 existing records. [2025-10-06T22:23:11.093688] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:23:11.094298] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-06T22:23:11.094446] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-06T22:23:11.094840] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-06T22:23:11.094901] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-06T22:23:11.289110] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T22:23:11.369836] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-06T22:23:11.411509] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T22:23:11.438141] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-06T22:23:11.529562] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:23:11.703528] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-06T22:23:11.859575] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-06T22:23:11.860510] [INFO ] [REMOTE ] WIA: Full fetch complete (7271 records). [2025-10-06T22:23:11.860581] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-06T22:23:12.124634] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-06T22:23:12.231043] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-06T22:23:12.231136] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-06T22:23:12.231368] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-06T22:23:12.231406] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-06T22:23:12.231854] [DEBUG] [LOCAL ] WIA: Trimmed 7271 records to 4878 (keeping 200 days of data) [2025-10-06T22:23:12.261935] [DEBUG] [LOCAL ] WIA: Primary data saved (4878 records). [2025-10-06T22:23:12.262127] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-06T22:23:12.262242] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WIA took 29.7s. Estimated remaining: 10m 42s. Rate: 7.1 symbols/min [2025-10-06T22:23:12.439976] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:23:12.463878] [DEBUG] [LOCAL ] WIW: Loaded 20635 existing records from primary storage. [2025-10-06T22:23:12.464216] [INFO ] [MAIN ] WIW: Loaded 20635 existing records. [2025-10-06T22:23:12.596327] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-06T22:23:12.685607] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:23:12.685927] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-06T22:23:12.685992] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-06T22:23:12.686243] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-06T22:23:12.686303] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-06T22:23:12.927721] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-06T22:23:13.081184] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:23:13.722547] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-06T22:23:13.898301] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-06T22:23:14.522526] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-06T22:23:14.835987] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-06T22:23:14.979310] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-06T22:23:15.322544] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-06T22:23:16.122538] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-06T22:23:16.346478] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T22:23:16.412341] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-06T22:23:16.922539] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-06T22:23:17.722520] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-06T22:23:17.953629] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-06T22:23:18.082097] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-06T22:23:18.322864] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-06T22:23:18.522563] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-06T22:23:19.322579] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-06T22:23:19.621961] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-06T22:23:20.122595] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-06T22:23:20.922534] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-06T22:23:21.003693] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T22:23:21.673553] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T22:23:21.720073] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-06T22:23:21.723136] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-06T22:23:22.522554] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-06T22:23:23.322496] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-06T22:23:23.540318] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T22:23:23.610958] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-06T22:23:23.864574] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-06T22:23:24.122550] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-06T22:23:24.922530] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-06T22:23:25.722517] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-06T22:23:25.830671] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-06T22:23:25.975691] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-06T22:23:26.201152] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-06T22:23:26.522536] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-06T22:23:27.322499] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-06T22:23:27.469925] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-06T22:23:28.122555] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-06T22:23:28.922505] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-06T22:23:29.054481] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T22:23:29.092251] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T22:23:29.554012] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-06T22:23:29.555521] [INFO ] [REMOTE ] WINN: Full fetch complete (17503 records). [2025-10-06T22:23:29.555605] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-06T22:23:29.730489] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-06T22:23:29.926018] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-06T22:23:29.926112] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-06T22:23:29.926551] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-06T22:23:29.926592] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-06T22:23:29.927989] [DEBUG] [LOCAL ] WINN: Trimmed 17503 records to 11587 (keeping 200 days of data) [2025-10-06T22:23:30.000138] [DEBUG] [LOCAL ] WINN: Primary data saved (11587 records). [2025-10-06T22:23:30.000333] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-06T22:23:30.000432] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WINN took 22.9s. Estimated remaining: 10m 34s. Rate: 7.1 symbols/min [2025-10-06T22:23:30.171084] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:23:30.215945] [DEBUG] [LOCAL ] WK: Loaded 37723 existing records from primary storage. [2025-10-06T22:23:30.216283] [INFO ] [MAIN ] WK: Loaded 37723 existing records. [2025-10-06T22:23:30.389208] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:23:30.389390] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-06T22:23:30.389440] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-06T22:23:30.389744] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-06T22:23:30.389800] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-06T22:23:30.527748] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-06T22:23:30.735913] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:23:31.215433] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T22:23:31.218539] [INFO ] [REMOTE ] WHR: Full fetch complete (68706 records). [2025-10-06T22:23:31.218741] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-06T22:23:31.324220] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-06T22:23:31.626171] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-06T22:23:31.626352] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-06T22:23:31.627688] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-06T22:23:31.627755] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-06T22:23:31.629354] [DEBUG] [LOCAL ] WHR: Trimmed 68706 records to 48229 (keeping 200 days of data) [2025-10-06T22:23:31.877358] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T22:23:31.954121] [DEBUG] [LOCAL ] WHR: Primary data saved (48229 records). [2025-10-06T22:23:31.954291] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-06T22:23:31.954386] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WHR took 50.7s. Estimated remaining: 10m 25s. Rate: 7.1 symbols/min [2025-10-06T22:23:32.126849] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:23:32.125216] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-06T22:23:32.163208] [DEBUG] [LOCAL ] WKC: Loaded 35318 existing records from primary storage. [2025-10-06T22:23:32.163543] [INFO ] [MAIN ] WKC: Loaded 35318 existing records. [2025-10-06T22:23:32.352870] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:23:32.353137] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-06T22:23:32.353195] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-06T22:23:32.353443] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-06T22:23:32.353506] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-06T22:23:32.730005] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:23:32.747793] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-06T22:23:32.922494] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-06T22:23:33.194100] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T22:23:33.722550] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-06T22:23:34.399544] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-06T22:23:34.522516] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-06T22:23:34.764592] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T22:23:35.322569] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-06T22:23:36.122533] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-06T22:23:36.213275] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-06T22:23:36.695217] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-06T22:23:36.924615] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-06T22:23:36.923821] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-06T22:23:36.927361] [INFO ] [REMOTE ] WIW: Full fetch complete (29810 records). [2025-10-06T22:23:36.927447] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-06T22:23:37.310268] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-06T22:23:37.310355] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-06T22:23:37.311072] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-06T22:23:37.311137] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-06T22:23:37.311900] [DEBUG] [LOCAL ] WIW: Trimmed 29810 records to 20445 (keeping 200 days of data) [2025-10-06T22:23:37.433190] [DEBUG] [LOCAL ] WIW: Primary data saved (20445 records). [2025-10-06T22:23:37.433368] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-06T22:23:37.433474] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIW took 25.2s. Estimated remaining: 10m 17s. Rate: 7.1 symbols/min [2025-10-06T22:23:37.620411] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:23:37.663991] [DEBUG] [LOCAL ] WLK: Loaded 46195 existing records from primary storage. [2025-10-06T22:23:37.664379] [INFO ] [MAIN ] WLK: Loaded 46195 existing records. [2025-10-06T22:23:37.728488] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-06T22:23:37.850869] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:23:37.851100] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-06T22:23:37.851150] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-06T22:23:37.851366] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-06T22:23:37.851426] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-06T22:23:38.216795] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:23:38.522537] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-06T22:23:38.881519] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-06T22:23:39.200780] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-06T22:23:39.322509] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-06T22:23:40.054216] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T22:23:40.122486] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-06T22:23:40.730489] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-06T22:23:40.922523] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-06T22:23:41.686869] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T22:23:41.722500] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-06T22:23:42.175789] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-06T22:23:42.522544] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-06T22:23:43.238170] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T22:23:43.322514] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-06T22:23:44.105001] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-06T22:23:44.122479] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-06T22:23:44.511639] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-06T22:23:44.922565] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-06T22:23:45.616290] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-06T22:23:45.722507] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-06T22:23:46.527824] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-06T22:23:46.542250] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-06T22:23:47.243447] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T22:23:47.322475] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-06T22:23:48.059263] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-06T22:23:48.122505] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-06T22:23:48.716797] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-06T22:23:48.922516] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-06T22:23:49.241142] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-06T22:23:49.722619] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-06T22:23:50.522563] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-06T22:23:50.603933] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T22:23:51.123091] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-06T22:23:51.322511] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-06T22:23:51.969636] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T22:23:52.122544] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-06T22:23:52.660947] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-06T22:23:52.922531] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-06T22:23:53.722554] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-06T22:23:53.866855] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T22:23:54.498284] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T22:23:54.522479] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-06T22:23:55.120938] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T22:23:55.322552] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-06T22:23:56.122630] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-06T22:23:56.250258] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-06T22:23:56.707962] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-06T22:23:56.922541] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-06T22:23:57.530078] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T22:23:57.722565] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-06T22:23:58.490714] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T22:23:58.522480] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-06T22:23:58.880949] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-06T22:23:58.884160] [INFO ] [REMOTE ] WIT: Full fetch complete (75676 records). [2025-10-06T22:23:58.884300] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-06T22:23:59.282260] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-06T22:23:59.282398] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-06T22:23:59.284025] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-06T22:23:59.284096] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-06T22:23:59.285866] [DEBUG] [LOCAL ] WIT: Trimmed 75676 records to 52389 (keeping 200 days of data) [2025-10-06T22:23:59.338227] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-06T22:23:59.623756] [DEBUG] [LOCAL ] WIT: Primary data saved (52389 records). [2025-10-06T22:23:59.623935] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-06T22:23:59.624030] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIT took 49.0s. Estimated remaining: 10m 9s. Rate: 7.1 symbols/min [2025-10-06T22:23:59.823864] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:23:59.834305] [DEBUG] [LOCAL ] WLKP: Loaded 6948 existing records from primary storage. [2025-10-06T22:23:59.834595] [INFO ] [MAIN ] WLKP: Loaded 6948 existing records. [2025-10-06T22:24:00.034707] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:24:00.036435] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-06T22:24:00.036502] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-06T22:24:00.037155] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-06T22:24:00.037217] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-06T22:24:00.123203] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-06T22:24:00.259787] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-06T22:24:00.461208] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:24:00.795242] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T22:24:00.922564] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-06T22:24:01.630363] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-06T22:24:01.722614] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-06T22:24:02.227489] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T22:24:02.230090] [INFO ] [REMOTE ] WK: Full fetch complete (52809 records). [2025-10-06T22:24:02.230185] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-06T22:24:02.527669] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-06T22:24:02.614263] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-06T22:24:02.614533] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-06T22:24:02.615695] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-06T22:24:02.615761] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-06T22:24:02.617180] [DEBUG] [LOCAL ] WK: Trimmed 52809 records to 37239 (keeping 200 days of data) [2025-10-06T22:24:02.838872] [DEBUG] [LOCAL ] WK: Primary data saved (37239 records). [2025-10-06T22:24:02.839050] [INFO ] [MAIN ] WK: Full history saved. [2025-10-06T22:24:02.839142] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 32.8s. Estimated remaining: 10m 0s. Rate: 7.1 symbols/min [2025-10-06T22:24:03.012491] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:24:03.012714] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-06T22:24:03.012764] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-06T22:24:03.012883] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-06T22:24:03.012925] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-06T22:24:03.012965] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-06T22:24:03.012996] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-06T22:24:03.347101] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-06T22:24:03.393991] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:24:03.395928] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-06T22:24:03.432341] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T22:24:04.122561] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-06T22:24:04.543347] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-06T22:24:04.922581] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-06T22:24:05.081360] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T22:24:05.722512] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-06T22:24:05.939602] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-06T22:24:05.941851] [INFO ] [REMOTE ] WKC: Full fetch complete (50809 records). [2025-10-06T22:24:05.941949] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-06T22:24:06.327078] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-06T22:24:06.327173] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-06T22:24:06.328210] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-06T22:24:06.328277] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-06T22:24:06.329496] [DEBUG] [LOCAL ] WKC: Trimmed 50809 records to 34752 (keeping 200 days of data) [2025-10-06T22:24:06.533087] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-06T22:24:06.532578] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-06T22:24:06.566890] [DEBUG] [LOCAL ] WKC: Primary data saved (34752 records). [2025-10-06T22:24:06.567051] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-06T22:24:06.567150] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 34.6s. Estimated remaining: 9m 51s. Rate: 7.1 symbols/min [2025-10-06T22:24:06.735142] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:24:06.766958] [DEBUG] [LOCAL ] WLY: Loaded 30031 existing records from primary storage. [2025-10-06T22:24:06.767270] [INFO ] [MAIN ] WLY: Loaded 30031 existing records. [2025-10-06T22:24:06.957945] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-06T22:24:06.957721] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:24:06.958529] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-06T22:24:06.960008] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-06T22:24:06.960283] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-06T22:24:06.960343] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-06T22:24:07.328395] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-06T22:24:07.334578] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:24:08.016011] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-06T22:24:08.122553] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-06T22:24:08.487557] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-06T22:24:08.922567] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-06T22:24:09.272205] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-06T22:24:09.722592] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-06T22:24:10.522536] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-06T22:24:11.052562] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-06T22:24:11.065815] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-06T22:24:11.322543] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-06T22:24:11.747996] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-06T22:24:12.122554] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-06T22:24:12.922578] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-06T22:24:13.340430] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-06T22:24:13.629186] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-06T22:24:13.722639] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-06T22:24:14.500765] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-06T22:24:14.522511] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-06T22:24:15.113217] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-06T22:24:15.322608] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-06T22:24:16.054031] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-06T22:24:16.122554] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-06T22:24:16.922608] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-06T22:24:17.341944] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-06T22:24:17.347612] [INFO ] [REMOTE ] WLK: Full fetch complete (63165 records). [2025-10-06T22:24:17.347812] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-06T22:24:17.725959] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-06T22:24:17.715840] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-06T22:24:17.777307] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-06T22:24:17.777411] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-06T22:24:17.778549] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-06T22:24:17.778615] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-06T22:24:17.780585] [DEBUG] [LOCAL ] WLK: Trimmed 63165 records to 45531 (keeping 200 days of data) [2025-10-06T22:24:18.090512] [DEBUG] [LOCAL ] WLK: Primary data saved (45531 records). [2025-10-06T22:24:18.090969] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-06T22:24:18.091176] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLK took 40.7s. Estimated remaining: 9m 43s. Rate: 7.1 symbols/min [2025-10-06T22:24:18.265290] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:24:18.319661] [DEBUG] [LOCAL ] WM: Loaded 51648 existing records from primary storage. [2025-10-06T22:24:18.320069] [INFO ] [MAIN ] WM: Loaded 51648 existing records. [2025-10-06T22:24:18.497952] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:24:18.498265] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-06T22:24:18.498314] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-06T22:24:18.498623] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-06T22:24:18.498719] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-06T22:24:18.529756] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-06T22:24:18.878034] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:24:18.950772] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-06T22:24:18.952391] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-06T22:24:19.322558] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-06T22:24:20.122583] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-06T22:24:20.478139] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-06T22:24:20.922550] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-06T22:24:21.186383] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T22:24:21.365619] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-06T22:24:21.722536] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-06T22:24:22.522577] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-06T22:24:23.123297] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-06T22:24:23.322548] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-06T22:24:24.122576] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-06T22:24:24.446053] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-06T22:24:24.596525] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T22:24:24.852467] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T22:24:24.922481] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-06T22:24:25.482682] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T22:24:25.483675] [INFO ] [REMOTE ] WLKP: Full fetch complete (10319 records). [2025-10-06T22:24:25.483751] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-06T22:24:25.731088] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-06T22:24:25.857158] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-06T22:24:25.857268] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-06T22:24:25.857818] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-06T22:24:25.857905] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-06T22:24:25.858472] [DEBUG] [LOCAL ] WLKP: Trimmed 10319 records to 6895 (keeping 200 days of data) [2025-10-06T22:24:25.903132] [DEBUG] [LOCAL ] WLKP: Primary data saved (6895 records). [2025-10-06T22:24:25.903312] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-06T22:24:25.903419] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLKP took 26.3s. Estimated remaining: 9m 35s. Rate: 7.1 symbols/min [2025-10-06T22:24:26.091420] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:24:26.156709] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-10-06T22:24:26.157261] [INFO ] [MAIN ] WMB: Loaded 54451 existing records. [2025-10-06T22:24:26.240115] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-06T22:24:26.360760] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:24:26.361068] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-06T22:24:26.361120] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-06T22:24:26.361397] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-06T22:24:26.361457] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-06T22:24:26.524968] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-06T22:24:26.806219] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:24:27.322562] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-06T22:24:28.122600] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-06T22:24:28.413152] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-06T22:24:28.922565] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-06T22:24:29.122034] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-06T22:24:29.197736] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-06T22:24:29.261728] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-06T22:24:29.722624] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-06T22:24:30.522681] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-06T22:24:31.322549] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-06T22:24:31.615475] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-06T22:24:31.964847] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T22:24:32.122505] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-06T22:24:32.922497] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-06T22:24:33.195941] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-06T22:24:33.260967] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T22:24:33.722518] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-06T22:24:34.522512] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-06T22:24:34.699393] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-06T22:24:35.322576] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-06T22:24:35.724480] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-06T22:24:35.763051] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-06T22:24:36.122557] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-06T22:24:36.922633] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-06T22:24:36.974609] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T22:24:37.242447] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-06T22:24:37.243444] [INFO ] [REMOTE ] WLTG: Full fetch complete (1671 records). [2025-10-06T22:24:37.243519] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-06T22:24:37.427401] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T22:24:37.427774] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-06T22:24:37.427971] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-06T22:24:37.433718] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-06T22:24:37.443366] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-06T22:24:37.443961] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-06T22:24:37.444495] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-06T22:24:37.444562] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-06T22:24:37.444746] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLTG took 34.6s. Estimated remaining: 9m 26s. Rate: 7.1 symbols/min [2025-10-06T22:24:37.621008] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:24:37.638491] [DEBUG] [LOCAL ] WMK: Loaded 14684 existing records from primary storage. [2025-10-06T22:24:37.638781] [INFO ] [MAIN ] WMK: Loaded 14684 existing records. [2025-10-06T22:24:37.727862] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-06T22:24:37.819147] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:24:37.819349] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-06T22:24:37.819395] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-06T22:24:37.819591] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-06T22:24:37.819682] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-06T22:24:38.178341] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:24:38.522572] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-06T22:24:39.322498] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-06T22:24:39.334608] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-06T22:24:39.789565] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-06T22:24:40.122487] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-06T22:24:40.279116] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-06T22:24:40.280996] [INFO ] [REMOTE ] WLY: Full fetch complete (42786 records). [2025-10-06T22:24:40.281074] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-06T22:24:40.651762] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-06T22:24:40.651857] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-06T22:24:40.652796] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-06T22:24:40.652861] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-06T22:24:40.653935] [DEBUG] [LOCAL ] WLY: Trimmed 42786 records to 29517 (keeping 200 days of data) [2025-10-06T22:24:40.828264] [DEBUG] [LOCAL ] WLY: Primary data saved (29517 records). [2025-10-06T22:24:40.828463] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-06T22:24:40.828566] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WLY took 34.3s. Estimated remaining: 9m 18s. Rate: 7.1 symbols/min [2025-10-06T22:24:40.928967] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-06T22:24:41.003484] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:24:41.043099] [DEBUG] [LOCAL ] WMS: Loaded 40088 existing records from primary storage. [2025-10-06T22:24:41.043479] [INFO ] [MAIN ] WMS: Loaded 40088 existing records. [2025-10-06T22:24:41.218068] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:24:41.218317] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-06T22:24:41.218390] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-06T22:24:41.218638] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-06T22:24:41.218723] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-06T22:24:41.564429] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:24:41.722568] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-06T22:24:42.009813] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-06T22:24:42.522548] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-06T22:24:42.887965] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-06T22:24:43.143036] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-06T22:24:43.216001] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-06T22:24:43.322492] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-06T22:24:44.122556] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-06T22:24:44.800406] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-06T22:24:44.922567] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-06T22:24:45.722580] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-06T22:24:46.522573] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-06T22:24:46.963067] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-06T22:24:46.978202] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-06T22:24:47.322615] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-06T22:24:48.051246] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-06T22:24:48.122498] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-06T22:24:48.782798] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-06T22:24:48.922502] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-06T22:24:49.032997] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-06T22:24:49.241700] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-06T22:24:49.722505] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-06T22:24:49.923154] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T22:24:50.522605] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-06T22:24:50.988394] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T22:24:51.322593] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-06T22:24:52.122497] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-06T22:24:52.525465] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-06T22:24:52.922552] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-06T22:24:53.186761] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-06T22:24:53.285145] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-06T22:24:53.722548] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-06T22:24:54.520055] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-06T22:24:54.530315] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-06T22:24:55.322560] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-06T22:24:55.590986] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-06T22:24:56.046274] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T22:24:56.122520] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-06T22:24:56.922589] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-06T22:24:57.213764] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-06T22:24:57.226421] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-06T22:24:57.231716] [INFO ] [REMOTE ] WM: Full fetch complete (73781 records). [2025-10-06T22:24:57.231885] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-06T22:24:57.657396] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-06T22:24:57.657528] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-06T22:24:57.659343] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-06T22:24:57.659433] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-06T22:24:57.661418] [DEBUG] [LOCAL ] WM: Trimmed 73781 records to 50929 (keeping 200 days of data) [2025-10-06T22:24:57.733136] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-06T22:24:57.801089] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T22:24:58.044426] [DEBUG] [LOCAL ] WM: Primary data saved (50929 records). [2025-10-06T22:24:58.044611] [INFO ] [MAIN ] WM: Full history saved. [2025-10-06T22:24:58.045758] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WM took 40.0s. Estimated remaining: 9m 9s. Rate: 7.1 symbols/min [2025-10-06T22:24:58.224251] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:24:58.282294] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-10-06T22:24:58.282728] [INFO ] [MAIN ] WMT: Loaded 54580 existing records. [2025-10-06T22:24:58.465957] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:24:58.466229] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-06T22:24:58.466278] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-06T22:24:58.466548] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-06T22:24:58.466605] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-06T22:24:58.528287] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-06T22:24:58.826299] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:24:59.293260] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T22:24:59.296698] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-10-06T22:24:59.296869] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-06T22:24:59.330397] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-06T22:24:59.759422] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-06T22:24:59.759269] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-06T22:24:59.759719] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-06T22:24:59.765424] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-06T22:24:59.766243] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-06T22:24:59.768470] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 53671 (keeping 200 days of data) [2025-10-06T22:25:00.122723] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-06T22:25:00.129438] [DEBUG] [LOCAL ] WMB: Primary data saved (53671 records). [2025-10-06T22:25:00.129716] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-06T22:25:00.129843] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WMB took 34.2s. Estimated remaining: 9m 1s. Rate: 7.1 symbols/min [2025-10-06T22:25:00.322684] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:25:00.368267] [DEBUG] [LOCAL ] WNC: Loaded 39805 existing records from primary storage. [2025-10-06T22:25:00.368736] [INFO ] [MAIN ] WNC: Loaded 39805 existing records. [2025-10-06T22:25:00.565688] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:25:00.566154] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-06T22:25:00.566415] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-06T22:25:00.566942] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-06T22:25:00.567005] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-06T22:25:00.923529] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-06T22:25:00.991592] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:25:00.968767] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-06T22:25:01.061350] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-06T22:25:01.722591] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-06T22:25:02.522561] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-06T22:25:03.052107] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-06T22:25:03.322578] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-06T22:25:03.617035] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-10-06T22:25:04.122563] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-06T22:25:04.268591] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T22:25:04.756679] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-06T22:25:04.922555] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-06T22:25:05.722562] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-06T22:25:06.200080] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-06T22:25:06.343341] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-06T22:25:06.522566] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-06T22:25:07.322008] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T22:25:07.330628] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-06T22:25:08.117086] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T22:25:08.126718] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-06T22:25:08.922554] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-06T22:25:09.103957] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-06T22:25:09.722510] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-06T22:25:09.879760] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-06T22:25:10.522510] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-06T22:25:10.580252] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-06T22:25:11.176082] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-06T22:25:11.322545] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-06T22:25:12.122600] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-06T22:25:12.905069] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T22:25:12.922465] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-06T22:25:13.247924] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-06T22:25:13.323671] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-06T22:25:13.326047] [INFO ] [REMOTE ] WMS: Full fetch complete (57212 records). [2025-10-06T22:25:13.326232] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-06T22:25:13.701828] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-06T22:25:13.701929] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-06T22:25:13.703006] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-06T22:25:13.703072] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-06T22:25:13.704290] [DEBUG] [LOCAL ] WMS: Trimmed 57212 records to 39588 (keeping 200 days of data) [2025-10-06T22:25:13.763938] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-06T22:25:13.962414] [DEBUG] [LOCAL ] WMS: Primary data saved (39588 records). [2025-10-06T22:25:13.962592] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-06T22:25:13.962719] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WMS took 33.1s. Estimated remaining: 8m 53s. Rate: 7.1 symbols/min [2025-10-06T22:25:14.132102] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:25:14.171633] [DEBUG] [LOCAL ] WNS: Loaded 40550 existing records from primary storage. [2025-10-06T22:25:14.172010] [INFO ] [MAIN ] WNS: Loaded 40550 existing records. [2025-10-06T22:25:14.355808] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:25:14.356106] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-06T22:25:14.356201] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-06T22:25:14.356452] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-06T22:25:14.356638] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-06T22:25:14.467352] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-06T22:25:14.527592] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-06T22:25:14.768517] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:25:14.764786] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-06T22:25:15.322549] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-06T22:25:16.085403] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T22:25:16.088763] [INFO ] [REMOTE ] WMK: Full fetch complete (19670 records). [2025-10-06T22:25:16.089069] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-06T22:25:16.127715] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-06T22:25:16.479870] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-06T22:25:16.479967] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-06T22:25:16.480766] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-06T22:25:16.480831] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-06T22:25:16.481543] [DEBUG] [LOCAL ] WMK: Trimmed 19670 records to 14518 (keeping 200 days of data) [2025-10-06T22:25:16.581220] [DEBUG] [LOCAL ] WMK: Primary data saved (14518 records). [2025-10-06T22:25:16.581452] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-06T22:25:16.581566] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMK took 39.1s. Estimated remaining: 8m 44s. Rate: 7.1 symbols/min [2025-10-06T22:25:16.773826] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:25:16.837939] [DEBUG] [LOCAL ] WOLF: Loaded 53962 existing records from primary storage. [2025-10-06T22:25:16.838423] [INFO ] [MAIN ] WOLF: Loaded 53962 existing records. [2025-10-06T22:25:16.925324] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-06T22:25:17.047092] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:25:17.047500] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-06T22:25:17.047808] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-06T22:25:17.048381] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-06T22:25:17.048708] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-06T22:25:17.125551] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-06T22:25:17.503859] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:25:17.526800] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-06T22:25:17.722548] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-06T22:25:18.478299] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T22:25:18.522541] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-06T22:25:19.322544] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-06T22:25:19.984074] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-06T22:25:20.099829] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-06T22:25:20.122480] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-06T22:25:20.922535] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-06T22:25:21.513202] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-06T22:25:21.722533] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-06T22:25:22.126800] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-06T22:25:22.174622] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-06T22:25:22.522573] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-06T22:25:23.322537] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-06T22:25:23.566348] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-06T22:25:23.569790] [INFO ] [REMOTE ] WNC: Full fetch complete (57564 records). [2025-10-06T22:25:23.569993] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-06T22:25:23.980689] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-06T22:25:23.980840] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-06T22:25:23.982080] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-06T22:25:23.982160] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-06T22:25:23.983830] [DEBUG] [LOCAL ] WNC: Trimmed 57564 records to 39061 (keeping 200 days of data) [2025-10-06T22:25:24.083032] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-06T22:25:24.123531] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-06T22:25:24.283185] [DEBUG] [LOCAL ] WNC: Primary data saved (39061 records). [2025-10-06T22:25:24.283379] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-06T22:25:24.283510] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNC took 24.2s. Estimated remaining: 8m 35s. Rate: 7.1 symbols/min [2025-10-06T22:25:24.482572] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:25:24.509662] [DEBUG] [LOCAL ] WOR: Loaded 25285 existing records from primary storage. [2025-10-06T22:25:24.509953] [INFO ] [MAIN ] WOR: Loaded 25285 existing records. [2025-10-06T22:25:24.685252] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:25:24.685510] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-06T22:25:24.685556] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-06T22:25:24.685807] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-06T22:25:24.685865] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-06T22:25:24.929158] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-06T22:25:25.039283] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:25:25.408483] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-06T22:25:25.722596] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-06T22:25:25.727338] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-06T22:25:26.522591] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-06T22:25:26.757808] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-06T22:25:27.085630] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-06T22:25:27.322487] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-06T22:25:27.678870] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-06T22:25:28.122518] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-06T22:25:28.922498] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-06T22:25:29.244317] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-06T22:25:29.524094] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-06T22:25:29.722585] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-06T22:25:30.364707] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-06T22:25:30.522526] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-06T22:25:30.839739] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T22:25:31.322570] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-06T22:25:32.122618] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-06T22:25:32.894615] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-06T22:25:32.928258] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-06T22:25:32.933171] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-06T22:25:33.480442] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-06T22:25:33.722526] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-06T22:25:34.522616] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-06T22:25:35.133841] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T22:25:35.205195] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-06T22:25:35.322557] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-06T22:25:35.796021] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T22:25:36.122631] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-06T22:25:36.922542] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-06T22:25:37.548544] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T22:25:37.595840] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-06T22:25:37.722508] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-06T22:25:38.522544] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-06T22:25:39.267145] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-06T22:25:39.322527] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-06T22:25:39.780549] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-06T22:25:40.122714] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-06T22:25:40.416742] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-06T22:25:40.922610] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-06T22:25:41.228616] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-06T22:25:41.722608] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-06T22:25:41.761226] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-06T22:25:42.522739] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-06T22:25:42.637492] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-06T22:25:42.725800] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T22:25:42.976772] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T22:25:42.981228] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-10-06T22:25:42.981403] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-06T22:25:43.335591] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-06T22:25:43.402628] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-06T22:25:43.402854] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-06T22:25:43.405109] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-06T22:25:43.405181] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-06T22:25:43.407408] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 53800 (keeping 200 days of data) [2025-10-06T22:25:43.790226] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-10-06T22:25:43.790472] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-06T22:25:43.790580] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WMT took 45.7s. Estimated remaining: 8m 27s. Rate: 7.1 symbols/min [2025-10-06T22:25:43.975282] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:25:44.011071] [DEBUG] [LOCAL ] WOW: Loaded 30989 existing records from primary storage. [2025-10-06T22:25:44.011455] [INFO ] [MAIN ] WOW: Loaded 30989 existing records. [2025-10-06T22:25:44.127807] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-06T22:25:44.199400] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:25:44.199935] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-06T22:25:44.199999] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-06T22:25:44.200262] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-06T22:25:44.200322] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-06T22:25:44.574133] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:25:44.922562] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-06T22:25:45.590621] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T22:25:45.722510] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-06T22:25:45.821810] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-06T22:25:46.074497] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-06T22:25:46.522517] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-06T22:25:46.771946] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-06T22:25:47.300329] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-06T22:25:47.322564] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-06T22:25:48.122557] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-06T22:25:48.922539] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-06T22:25:49.199306] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-06T22:25:49.530136] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-06T22:25:49.533691] [INFO ] [REMOTE ] WOLF: Full fetch complete (77245 records). [2025-10-06T22:25:49.533861] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-06T22:25:49.724532] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-06T22:25:49.980964] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-06T22:25:49.981090] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-06T22:25:49.982318] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-06T22:25:49.982719] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-06T22:25:49.984572] [DEBUG] [LOCAL ] WOLF: Trimmed 77245 records to 53177 (keeping 200 days of data) [2025-10-06T22:25:50.095593] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-06T22:25:50.332466] [DEBUG] [LOCAL ] WOLF: Primary data saved (53177 records). [2025-10-06T22:25:50.332710] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-06T22:25:50.333636] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WOLF took 33.8s. Estimated remaining: 8m 19s. Rate: 7.1 symbols/min [2025-10-06T22:25:50.500204] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:25:50.528706] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-06T22:25:50.551143] [DEBUG] [LOCAL ] WPC: Loaded 49077 existing records from primary storage. [2025-10-06T22:25:50.551511] [INFO ] [MAIN ] WPC: Loaded 49077 existing records. [2025-10-06T22:25:50.726993] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:25:50.727261] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-06T22:25:50.727309] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-06T22:25:50.727568] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-06T22:25:50.727625] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-06T22:25:51.114075] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:25:51.131196] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-06T22:25:51.322579] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-06T22:25:51.565270] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-06T22:25:52.122616] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-06T22:25:52.649825] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-06T22:25:52.922552] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-06T22:25:53.499526] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-06T22:25:53.722491] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-06T22:25:53.875798] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-06T22:25:53.877550] [INFO ] [REMOTE ] WOR: Full fetch complete (36670 records). [2025-10-06T22:25:53.877628] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-06T22:25:54.258525] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-06T22:25:54.258637] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-06T22:25:54.259544] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-06T22:25:54.259608] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-06T22:25:54.260708] [DEBUG] [LOCAL ] WOR: Trimmed 36670 records to 24870 (keeping 200 days of data) [2025-10-06T22:25:54.415831] [DEBUG] [LOCAL ] WOR: Primary data saved (24870 records). [2025-10-06T22:25:54.415993] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-06T22:25:54.416082] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOR took 30.1s. Estimated remaining: 8m 10s. Rate: 7.1 symbols/min [2025-10-06T22:25:54.527782] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-06T22:25:54.595585] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:25:54.648246] [DEBUG] [LOCAL ] WPM: Loaded 53501 existing records from primary storage. [2025-10-06T22:25:54.648675] [INFO ] [MAIN ] WPM: Loaded 53501 existing records. [2025-10-06T22:25:54.784247] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T22:25:54.829312] [INFO ] [REMOTE ] WNS: Full fetch complete (55048 records). [2025-10-06T22:25:54.831301] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-06T22:25:54.856139] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:25:54.862047] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-06T22:25:54.923044] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-06T22:25:54.959987] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-06T22:25:54.962827] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-06T22:25:55.331571] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-06T22:25:55.610112] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-06T22:25:55.646875] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-06T22:25:55.646708] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:25:55.648149] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-06T22:25:55.648481] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-06T22:25:55.649562] [DEBUG] [LOCAL ] WNS: Trimmed 55048 records to 39934 (keeping 200 days of data) [2025-10-06T22:25:55.874731] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-06T22:25:55.918042] [DEBUG] [LOCAL ] WNS: Primary data saved (39934 records). [2025-10-06T22:25:55.918227] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-06T22:25:55.918326] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WNS took 42.0s. Estimated remaining: 8m 2s. Rate: 7.1 symbols/min [2025-10-06T22:25:56.090420] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:25:56.123674] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-06T22:25:56.124427] [DEBUG] [LOCAL ] WPP: Loaded 34410 existing records from primary storage. [2025-10-06T22:25:56.125452] [INFO ] [MAIN ] WPP: Loaded 34410 existing records. [2025-10-06T22:25:56.304004] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:25:56.304302] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-06T22:25:56.304352] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-06T22:25:56.304578] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-06T22:25:56.304635] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-06T22:25:56.671763] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:25:56.826505] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-06T22:25:56.922475] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-06T22:25:57.722721] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-06T22:25:57.853903] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T22:25:58.522589] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-06T22:25:58.558737] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T22:25:58.722071] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-06T22:25:59.322576] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-06T22:26:00.122584] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-06T22:26:00.356743] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-06T22:26:00.420788] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-06T22:26:00.922557] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-06T22:26:01.727779] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-06T22:26:01.762912] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-06T22:26:01.801250] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-06T22:26:02.522626] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-06T22:26:03.127020] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-06T22:26:03.322537] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-06T22:26:03.426879] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-06T22:26:04.122555] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-06T22:26:04.533800] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-06T22:26:04.922521] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-06T22:26:05.722576] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-06T22:26:05.939584] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T22:26:06.439239] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-06T22:26:06.522496] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-06T22:26:07.038998] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T22:26:07.322552] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-06T22:26:08.084405] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T22:26:08.122478] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-06T22:26:08.922489] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-06T22:26:09.180268] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-06T22:26:09.271622] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-06T22:26:09.273739] [INFO ] [REMOTE ] WOW: Full fetch complete (42495 records). [2025-10-06T22:26:09.273816] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-06T22:26:09.646519] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-06T22:26:09.646609] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-06T22:26:09.647466] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-06T22:26:09.647526] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-06T22:26:09.648463] [DEBUG] [LOCAL ] WOW: Trimmed 42495 records to 30471 (keeping 200 days of data) [2025-10-06T22:26:09.727431] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-06T22:26:09.822527] [DEBUG] [LOCAL ] WOW: Primary data saved (30471 records). [2025-10-06T22:26:09.822738] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-06T22:26:09.822896] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WOW took 26.0s. Estimated remaining: 7m 53s. Rate: 7.1 symbols/min [2025-10-06T22:26:09.991759] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:26:10.043725] [DEBUG] [LOCAL ] WRB: Loaded 51321 existing records from primary storage. [2025-10-06T22:26:10.044079] [INFO ] [MAIN ] WRB: Loaded 51321 existing records. [2025-10-06T22:26:10.223309] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:26:10.223551] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-06T22:26:10.223607] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-06T22:26:10.223863] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-06T22:26:10.223921] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-06T22:26:10.522924] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-06T22:26:10.605515] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:26:10.613187] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T22:26:11.322584] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-06T22:26:11.369388] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-06T22:26:12.122555] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-06T22:26:12.175401] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-06T22:26:12.735787] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T22:26:12.922607] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-06T22:26:13.509526] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-06T22:26:13.722593] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-06T22:26:14.283063] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-06T22:26:14.522554] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-06T22:26:15.322572] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-06T22:26:15.743866] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-06T22:26:16.122557] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-06T22:26:16.153248] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-06T22:26:16.922504] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-06T22:26:17.163920] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T22:26:17.370373] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T22:26:17.722585] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-06T22:26:18.522508] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-06T22:26:18.688681] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-06T22:26:19.197486] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-06T22:26:19.322495] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-06T22:26:20.127688] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-06T22:26:20.133417] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-06T22:26:20.762485] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T22:26:20.922629] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-06T22:26:21.722552] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-06T22:26:21.866764] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T22:26:22.522500] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-06T22:26:22.605943] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T22:26:22.750575] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T22:26:22.752932] [INFO ] [REMOTE ] WPP: Full fetch complete (45902 records). [2025-10-06T22:26:22.753036] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-06T22:26:23.145800] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-06T22:26:23.145893] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-06T22:26:23.146839] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-06T22:26:23.146914] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-06T22:26:23.148053] [DEBUG] [LOCAL ] WPP: Trimmed 45902 records to 33995 (keeping 200 days of data) [2025-10-06T22:26:23.325986] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-06T22:26:23.372074] [DEBUG] [LOCAL ] WPP: Primary data saved (33995 records). [2025-10-06T22:26:23.372258] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-06T22:26:23.372353] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPP took 27.5s. Estimated remaining: 7m 45s. Rate: 7.1 symbols/min [2025-10-06T22:26:23.544345] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:26:23.594345] [DEBUG] [LOCAL ] WRBY: Loaded 51508 existing records from primary storage. [2025-10-06T22:26:23.594802] [INFO ] [MAIN ] WRBY: Loaded 51508 existing records. [2025-10-06T22:26:23.776324] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:26:23.776595] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-06T22:26:23.776666] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-06T22:26:23.776906] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-06T22:26:23.776964] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-06T22:26:24.140323] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:26:24.134600] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-06T22:26:24.331098] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-06T22:26:24.922569] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-06T22:26:25.092569] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-06T22:26:25.540833] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T22:26:25.544153] [INFO ] [REMOTE ] WPC: Full fetch complete (70718 records). [2025-10-06T22:26:25.544273] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-06T22:26:25.726811] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-06T22:26:25.946552] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-06T22:26:25.946705] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-06T22:26:25.948274] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-06T22:26:25.948385] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-06T22:26:25.951003] [DEBUG] [LOCAL ] WPC: Trimmed 70718 records to 48342 (keeping 200 days of data) [2025-10-06T22:26:26.286877] [DEBUG] [LOCAL ] WPC: Primary data saved (48342 records). [2025-10-06T22:26:26.287061] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-06T22:26:26.287156] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPC took 36.0s. Estimated remaining: 7m 36s. Rate: 7.1 symbols/min [2025-10-06T22:26:26.522610] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-06T22:26:27.041806] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-06T22:26:27.322585] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-06T22:26:27.640224] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-06T22:26:28.122578] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-06T22:26:28.167538] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-06T22:26:28.922544] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-06T22:26:29.147384] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-06T22:26:29.722593] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-06T22:26:29.822572] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T22:26:30.522506] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-06T22:26:30.617173] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T22:26:31.322561] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-06T22:26:31.625089] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-06T22:26:32.112388] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T22:26:32.122793] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-06T22:26:32.922587] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-06T22:26:32.999769] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-06T22:26:33.695306] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-06T22:26:33.698861] [INFO ] [REMOTE ] WPM: Full fetch complete (75935 records). [2025-10-06T22:26:33.699040] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-06T22:26:33.734063] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-06T22:26:34.118116] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-06T22:26:34.118223] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-06T22:26:34.120265] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-06T22:26:34.120333] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-06T22:26:34.122231] [DEBUG] [LOCAL ] WPM: Trimmed 75935 records to 52735 (keeping 200 days of data) [2025-10-06T22:26:34.499281] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-06T22:26:34.522671] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-06T22:26:34.533617] [DEBUG] [LOCAL ] WPM: Primary data saved (52735 records). [2025-10-06T22:26:34.533862] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-06T22:26:34.534032] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WPM took 40.1s. Estimated remaining: 7m 28s. Rate: 7.1 symbols/min [2025-10-06T22:26:35.464005] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T22:26:35.478482] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-06T22:26:36.245037] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-06T22:26:36.257309] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-06T22:26:36.879379] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-06T22:26:36.922504] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-06T22:26:37.645390] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T22:26:37.722486] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-06T22:26:38.821864] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T22:26:38.834000] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-06T22:26:39.413944] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-06T22:26:39.425954] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-06T22:26:39.986870] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-06T22:26:39.990608] [INFO ] [REMOTE ] WRB: Full fetch complete (73378 records). [2025-10-06T22:26:39.990812] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-06T22:26:40.412738] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-06T22:26:40.412864] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-06T22:26:40.415040] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-06T22:26:40.415183] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-06T22:26:40.417436] [DEBUG] [LOCAL ] WRB: Trimmed 73378 records to 50616 (keeping 200 days of data) [2025-10-06T22:26:40.550253] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-06T22:26:40.565210] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-06T22:26:40.816690] [DEBUG] [LOCAL ] WRB: Primary data saved (50616 records). [2025-10-06T22:26:40.816920] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-06T22:26:40.817031] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRB took 31.0s. Estimated remaining: 7m 19s. Rate: 7.1 symbols/min [2025-10-06T22:26:42.351326] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T22:26:42.363302] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-06T22:26:43.998820] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-06T22:26:44.010906] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-06T22:26:45.724501] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T22:26:45.737846] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-06T22:26:47.089496] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-06T22:26:47.092740] [INFO ] [REMOTE ] WRBY: Full fetch complete (73520 records). [2025-10-06T22:26:47.092875] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-06T22:26:47.502357] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-06T22:26:47.502460] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-06T22:26:47.504509] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-06T22:26:47.504577] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-06T22:26:47.506544] [DEBUG] [LOCAL ] WRBY: Trimmed 73520 records to 50718 (keeping 200 days of data) [2025-10-06T22:26:47.856312] [DEBUG] [LOCAL ] WRBY: Primary data saved (50718 records). [2025-10-06T22:26:47.856505] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-06T22:26:47.856606] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WRBY took 24.5s. Estimated remaining: 7m 11s. Rate: 7.1 symbols/min [2025-10-06T22:26:48.498205] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:26:48.496448] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:26:48.582359] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:26:48.612947] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:26:48.641285] [DEBUG] [LOCAL ] WSR: Loaded 23351 existing records from primary storage. [2025-10-06T22:26:48.641734] [INFO ] [MAIN ] WSR: Loaded 23351 existing records. [2025-10-06T22:26:48.724163] [DEBUG] [LOCAL ] WS: Loaded 24345 existing records from primary storage. [2025-10-06T22:26:48.788024] [DEBUG] [LOCAL ] WSO: Loaded 25075 existing records from primary storage. [2025-10-06T22:26:48.776345] [INFO ] [MAIN ] WS: Loaded 24345 existing records. [2025-10-06T22:26:48.806968] [INFO ] [MAIN ] WSO: Loaded 25075 existing records. [2025-10-06T22:26:49.068712] [DEBUG] [LOCAL ] WSM: Loaded 50270 existing records from primary storage. [2025-10-06T22:26:49.123907] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:26:49.145789] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-06T22:26:49.146388] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-06T22:26:49.140791] [INFO ] [MAIN ] WSM: Loaded 50270 existing records. [2025-10-06T22:26:49.162683] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-06T22:26:49.162875] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-06T22:26:49.387028] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:26:49.435485] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-06T22:26:49.451525] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-06T22:26:49.486082] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:26:49.512763] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-06T22:26:49.512694] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-06T22:26:49.518892] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-06T22:26:49.518976] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-06T22:26:49.555511] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-06T22:26:49.560862] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-06T22:26:50.005475] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:26:50.014816] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-06T22:26:50.054394] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-06T22:26:50.118104] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-06T22:26:50.182450] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-06T22:26:50.709037] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:26:50.772265] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-06T22:26:50.909813] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:26:51.013481] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-06T22:26:51.034814] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:26:51.063602] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-06T22:26:51.224003] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:26:51.224392] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-06T22:26:52.045811] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-06T22:26:52.051721] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-06T22:26:52.304133] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-06T22:26:52.308942] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-06T22:26:52.370318] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-06T22:26:52.376870] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-06T22:26:53.017399] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-06T22:26:53.028764] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-06T22:26:53.045446] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-06T22:26:53.050912] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-06T22:26:53.149133] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-06T22:26:53.153779] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-06T22:26:53.541482] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-06T22:26:53.547697] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-06T22:26:53.994196] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T22:26:53.999932] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-06T22:26:54.069214] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T22:26:54.075467] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-06T22:26:54.472475] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-06T22:26:54.479611] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-06T22:26:54.836071] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-06T22:26:54.846674] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-06T22:26:54.883136] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-06T22:26:55.255061] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-06T22:26:55.322503] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-06T22:26:55.395586] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-06T22:26:56.122499] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-06T22:26:56.312884] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-06T22:26:56.448080] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-06T22:26:56.922560] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-06T22:26:57.558338] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-06T22:26:57.722567] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-06T22:26:58.522506] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-06T22:26:58.889130] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-06T22:26:58.916447] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T22:26:59.322546] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-06T22:26:59.718455] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-06T22:27:00.122603] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-06T22:27:00.278077] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-06T22:27:00.922540] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-06T22:27:01.309872] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-06T22:27:01.722566] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-06T22:27:01.750628] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-06T22:27:02.522543] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-06T22:27:02.932757] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T22:27:03.322613] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-06T22:27:03.819705] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-06T22:27:04.122610] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-06T22:27:04.922509] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-06T22:27:05.209868] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-06T22:27:05.274940] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-06T22:27:05.722594] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-06T22:27:06.176168] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-06T22:27:06.522603] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-06T22:27:06.931940] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-06T22:27:07.322560] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-06T22:27:08.122568] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-06T22:27:08.420459] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-06T22:27:08.464778] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-06T22:27:08.922539] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-06T22:27:09.289931] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-06T22:27:09.722557] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-06T22:27:09.978453] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T22:27:10.522567] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-06T22:27:10.972211] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-06T22:27:11.322559] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-06T22:27:12.119832] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-06T22:27:12.129497] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-06T22:27:12.616992] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-06T22:27:12.922531] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-06T22:27:13.158604] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T22:27:13.160479] [INFO ] [REMOTE ] WS: Full fetch complete (36736 records). [2025-10-06T22:27:13.160577] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-06T22:27:13.540125] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-06T22:27:13.540224] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-06T22:27:13.540990] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-06T22:27:13.541052] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-06T22:27:13.541887] [DEBUG] [LOCAL ] WS: Trimmed 36736 records to 23846 (keeping 200 days of data) [2025-10-06T22:27:13.702555] [DEBUG] [LOCAL ] WS: Primary data saved (23846 records). [2025-10-06T22:27:13.702756] [INFO ] [MAIN ] WS: Full history saved. [2025-10-06T22:27:13.702878] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WS took 25.8s. Estimated remaining: 7m 3s. Rate: 7.1 symbols/min [2025-10-06T22:27:13.733013] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-06T22:27:13.876175] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:27:13.915180] [DEBUG] [LOCAL ] WST: Loaded 37749 existing records from primary storage. [2025-10-06T22:27:13.915533] [INFO ] [MAIN ] WST: Loaded 37749 existing records. [2025-10-06T22:27:14.097343] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:27:14.097593] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-06T22:27:14.097665] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-06T22:27:14.098145] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-06T22:27:14.098204] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-06T22:27:14.473512] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-06T22:27:14.510944] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-06T22:27:14.516103] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:27:14.516916] [INFO ] [REMOTE ] WSR: Full fetch complete (32863 records). [2025-10-06T22:27:14.517268] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-06T22:27:14.529041] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-06T22:27:14.891395] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-06T22:27:14.891484] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-06T22:27:14.892234] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-06T22:27:14.892298] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-06T22:27:14.893081] [DEBUG] [LOCAL ] WSR: Trimmed 32863 records to 22909 (keeping 200 days of data) [2025-10-06T22:27:15.033821] [DEBUG] [LOCAL ] WSR: Primary data saved (22909 records). [2025-10-06T22:27:15.033981] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-06T22:27:15.034069] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WSR took 27.2s. Estimated remaining: 6m 54s. Rate: 7.1 symbols/min [2025-10-06T22:27:15.201043] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:27:15.245464] [DEBUG] [LOCAL ] WT: Loaded 48451 existing records from primary storage. [2025-10-06T22:27:15.245844] [INFO ] [MAIN ] WT: Loaded 48451 existing records. [2025-10-06T22:27:15.327759] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-06T22:27:15.424982] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:27:15.425189] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-06T22:27:15.425238] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-06T22:27:15.425468] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-06T22:27:15.425525] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-06T22:27:15.778631] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:27:16.122543] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-06T22:27:16.419900] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-06T22:27:16.438417] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-06T22:27:16.440533] [INFO ] [REMOTE ] WSO: Full fetch complete (34696 records). [2025-10-06T22:27:16.440623] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-06T22:27:16.810982] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-06T22:27:16.811067] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-06T22:27:16.811805] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-06T22:27:16.811867] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-06T22:27:16.813846] [DEBUG] [LOCAL ] WSO: Trimmed 34696 records to 24867 (keeping 200 days of data) [2025-10-06T22:27:16.923564] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-06T22:27:16.976136] [DEBUG] [LOCAL ] WSO: Primary data saved (24867 records). [2025-10-06T22:27:16.976358] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-06T22:27:16.976523] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WSO took 29.1s. Estimated remaining: 6m 46s. Rate: 7.1 symbols/min [2025-10-06T22:27:17.155297] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:27:17.198672] [DEBUG] [LOCAL ] WTI: Loaded 44520 existing records from primary storage. [2025-10-06T22:27:17.199022] [INFO ] [MAIN ] WTI: Loaded 44520 existing records. [2025-10-06T22:27:17.380011] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:27:17.380402] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-06T22:27:17.380460] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-06T22:27:17.380783] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-06T22:27:17.380842] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-06T22:27:17.736025] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-06T22:27:17.777387] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:27:17.781827] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T22:27:18.472536] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-06T22:27:18.522490] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-06T22:27:19.241083] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T22:27:19.322524] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-06T22:27:20.122524] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-06T22:27:20.282011] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-06T22:27:20.760525] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-06T22:27:20.922511] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-06T22:27:21.722564] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-06T22:27:21.849538] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-06T22:27:22.180450] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T22:27:22.183579] [INFO ] [REMOTE ] WSM: Full fetch complete (71796 records). [2025-10-06T22:27:22.183757] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-06T22:27:22.538527] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-06T22:27:22.588223] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-06T22:27:22.588396] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-06T22:27:22.589817] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-06T22:27:22.589901] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-06T22:27:22.612231] [DEBUG] [LOCAL ] WSM: Trimmed 71796 records to 49433 (keeping 200 days of data) [2025-10-06T22:27:22.617960] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-06T22:27:22.953582] [DEBUG] [LOCAL ] WSM: Primary data saved (49433 records). [2025-10-06T22:27:22.953732] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-06T22:27:22.953852] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSM took 35.1s. Estimated remaining: 6m 37s. Rate: 7.1 symbols/min [2025-10-06T22:27:23.122262] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:27:23.122482] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-06T22:27:23.122521] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-06T22:27:23.122636] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-06T22:27:23.122716] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-06T22:27:23.122762] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-06T22:27:23.122794] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-06T22:27:23.331525] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-06T22:27:23.507490] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:27:24.122527] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-06T22:27:24.225089] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-06T22:27:24.511716] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-06T22:27:24.922546] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-06T22:27:25.040124] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T22:27:25.722612] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-06T22:27:26.262040] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-06T22:27:26.289087] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-06T22:27:26.522594] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-06T22:27:26.950635] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-06T22:27:27.322527] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-06T22:27:28.122548] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-06T22:27:28.610880] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-06T22:27:28.922519] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-06T22:27:28.963868] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T22:27:29.722593] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-06T22:27:30.408451] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T22:27:30.522526] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-06T22:27:31.217071] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-06T22:27:31.322573] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-06T22:27:32.109454] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-06T22:27:32.122472] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-06T22:27:32.398303] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-06T22:27:32.922528] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-06T22:27:33.716775] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T22:27:33.725227] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-06T22:27:34.522495] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-06T22:27:34.648748] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-06T22:27:35.239639] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T22:27:35.322532] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-06T22:27:36.122517] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-06T22:27:36.217554] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-06T22:27:36.483770] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-06T22:27:36.922516] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-06T22:27:37.016689] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T22:27:37.722621] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-06T22:27:38.522561] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-06T22:27:38.631460] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T22:27:39.258258] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-06T22:27:39.322567] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-06T22:27:40.122530] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-06T22:27:40.312291] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T22:27:40.514008] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-06T22:27:40.922499] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-06T22:27:41.115494] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-06T22:27:41.399740] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-06T22:27:41.722528] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-06T22:27:42.522634] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-06T22:27:43.145443] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T22:27:43.322582] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-06T22:27:43.785035] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-06T22:27:44.122512] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-06T22:27:44.905743] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T22:27:44.922470] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-06T22:27:45.722557] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-06T22:27:45.928409] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-06T22:27:46.458712] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-06T22:27:46.522483] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-06T22:27:46.864247] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-06T22:27:47.322558] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-06T22:27:47.781389] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T22:27:47.783802] [INFO ] [REMOTE ] WST: Full fetch complete (53910 records). [2025-10-06T22:27:47.783941] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-06T22:27:47.895161] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T22:27:47.939434] [INFO ] [REMOTE ] WTI: Full fetch complete (64024 records). [2025-10-06T22:27:47.961327] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-06T22:27:48.137941] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-06T22:27:48.370312] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-06T22:27:48.376911] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-06T22:27:48.378124] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-06T22:27:48.389405] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-06T22:27:48.496707] [DEBUG] [LOCAL ] WST: Trimmed 53910 records to 37060 (keeping 200 days of data) [2025-10-06T22:27:48.725372] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-06T22:27:48.729801] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-06T22:27:48.732021] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-06T22:27:48.733793] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-06T22:27:48.734176] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-06T22:27:48.737690] [DEBUG] [LOCAL ] WTI: Trimmed 64024 records to 43945 (keeping 200 days of data) [2025-10-06T22:27:48.930051] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-06T22:27:49.095553] [DEBUG] [LOCAL ] WST: Primary data saved (37060 records). [2025-10-06T22:27:49.096298] [INFO ] [MAIN ] WST: Full history saved. [2025-10-06T22:27:49.096741] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WST took 35.4s. Estimated remaining: 6m 29s. Rate: 7.1 symbols/min [2025-10-06T22:27:49.279440] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:27:49.319597] [DEBUG] [LOCAL ] WTI: Primary data saved (43945 records). [2025-10-06T22:27:49.320532] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-06T22:27:49.320671] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WTI took 32.3s. Estimated remaining: 6m 20s. Rate: 7.1 symbols/min [2025-10-06T22:27:49.518230] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-06T22:27:49.522324] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:27:49.542080] [DEBUG] [LOCAL ] WTRG: Loaded 51656 existing records from primary storage. [2025-10-06T22:27:49.542448] [INFO ] [MAIN ] WTRG: Loaded 51656 existing records. [2025-10-06T22:27:49.717238] [DEBUG] [LOCAL ] WTS: Loaded 18320 existing records from primary storage. [2025-10-06T22:27:49.735095] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-06T22:27:49.732930] [INFO ] [MAIN ] WTS: Loaded 18320 existing records. [2025-10-06T22:27:49.739815] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:27:49.810712] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-06T22:27:49.821724] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-06T22:27:49.843150] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-06T22:27:49.853669] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-06T22:27:50.026505] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:27:50.029429] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-06T22:27:50.040001] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-06T22:27:50.071334] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-06T22:27:50.081975] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-06T22:27:50.564935] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-06T22:27:50.559677] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:27:50.704037] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:27:51.264368] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-06T22:27:51.322510] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-06T22:27:51.560144] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-06T22:27:52.026843] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-06T22:27:52.122572] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-06T22:27:52.922536] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-06T22:27:53.728896] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-06T22:27:53.736158] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-06T22:27:53.892508] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T22:27:54.522585] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-06T22:27:55.322577] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-06T22:27:55.425330] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-06T22:27:55.441518] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-06T22:27:55.442718] [INFO ] [REMOTE ] WTM: Full fetch complete (2542 records). [2025-10-06T22:27:55.442811] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-06T22:27:55.643256] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-06T22:27:55.643535] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-06T22:27:55.643593] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-06T22:27:55.643690] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-06T22:27:55.643769] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-06T22:27:55.643806] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-06T22:27:55.643860] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-06T22:27:55.643942] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WTM took 32.7s. Estimated remaining: 6m 12s. Rate: 7.1 symbols/min [2025-10-06T22:27:55.813407] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:27:55.856154] [DEBUG] [LOCAL ] WTTR: Loaded 45598 existing records from primary storage. [2025-10-06T22:27:55.856521] [INFO ] [MAIN ] WTTR: Loaded 45598 existing records. [2025-10-06T22:27:56.039043] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:27:56.039325] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-06T22:27:56.039377] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-06T22:27:56.039633] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-06T22:27:56.039729] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-06T22:27:56.127176] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-06T22:27:56.430464] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:27:56.444577] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-06T22:27:56.922529] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-06T22:27:57.469967] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-06T22:27:57.473304] [INFO ] [REMOTE ] WT: Full fetch complete (69285 records). [2025-10-06T22:27:57.473446] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-06T22:27:57.731527] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-06T22:27:57.895072] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-06T22:27:57.895176] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-06T22:27:57.896855] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-06T22:27:57.896934] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-06T22:27:57.898941] [DEBUG] [LOCAL ] WT: Trimmed 69285 records to 47859 (keeping 200 days of data) [2025-10-06T22:27:58.219138] [DEBUG] [LOCAL ] WT: Primary data saved (47859 records). [2025-10-06T22:27:58.219307] [INFO ] [MAIN ] WT: Full history saved. [2025-10-06T22:27:58.219406] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WT took 43.2s. Estimated remaining: 6m 3s. Rate: 7.1 symbols/min [2025-10-06T22:27:58.400570] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:27:58.457001] [DEBUG] [LOCAL ] WU: Loaded 54233 existing records from primary storage. [2025-10-06T22:27:58.457806] [INFO ] [MAIN ] WU: Loaded 54233 existing records. [2025-10-06T22:27:58.531372] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-06T22:27:58.579597] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-06T22:27:58.704845] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:27:58.705426] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-06T22:27:58.705551] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-06T22:27:58.706083] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-06T22:27:58.706171] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-06T22:27:58.811411] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-06T22:27:59.091066] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:27:59.322552] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-06T22:28:00.122592] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-06T22:28:00.430414] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-06T22:28:00.925934] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-06T22:28:00.929559] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-06T22:28:01.412109] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-06T22:28:01.722608] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-06T22:28:02.522773] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-06T22:28:02.526536] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-06T22:28:02.910302] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T22:28:03.322554] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-06T22:28:04.122515] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-06T22:28:04.391333] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-06T22:28:04.530404] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-06T22:28:04.922498] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-06T22:28:05.232049] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-06T22:28:05.722574] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-06T22:28:06.522561] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-06T22:28:06.658431] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T22:28:06.770601] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-06T22:28:07.322551] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-06T22:28:08.122549] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-06T22:28:08.211694] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-06T22:28:08.393629] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-06T22:28:08.922521] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-06T22:28:09.197358] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-06T22:28:09.722543] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-06T22:28:10.522562] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-06T22:28:10.645949] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-06T22:28:11.157842] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-06T22:28:11.322513] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-06T22:28:11.582666] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-06T22:28:12.014925] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-06T22:28:12.016231] [INFO ] [REMOTE ] WTS: Full fetch complete (26072 records). [2025-10-06T22:28:12.016309] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-06T22:28:12.123474] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-06T22:28:12.389484] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-06T22:28:12.389576] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-06T22:28:12.390202] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-06T22:28:12.390266] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-06T22:28:12.391122] [DEBUG] [LOCAL ] WTS: Trimmed 26072 records to 17987 (keeping 200 days of data) [2025-10-06T22:28:12.504939] [DEBUG] [LOCAL ] WTS: Primary data saved (17987 records). [2025-10-06T22:28:12.505134] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-06T22:28:12.505231] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTS took 23.2s. Estimated remaining: 5m 55s. Rate: 7.1 symbols/min [2025-10-06T22:28:12.681981] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:28:12.733266] [DEBUG] [LOCAL ] WWW: Loaded 49849 existing records from primary storage. [2025-10-06T22:28:12.733639] [INFO ] [MAIN ] WWW: Loaded 49849 existing records. [2025-10-06T22:28:12.924144] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-06T22:28:12.928827] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:28:12.930438] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-06T22:28:12.930504] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-06T22:28:12.930729] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-06T22:28:12.930786] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-06T22:28:13.305987] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:28:13.429456] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-06T22:28:13.722568] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-06T22:28:14.340585] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-06T22:28:14.522556] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-06T22:28:15.322551] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-06T22:28:15.377613] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T22:28:16.122540] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-06T22:28:16.223528] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-06T22:28:16.922531] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-06T22:28:16.987933] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-06T22:28:17.695334] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-06T22:28:17.722484] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-06T22:28:18.115695] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-06T22:28:18.522625] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-06T22:28:19.322580] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-06T22:28:19.541520] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-06T22:28:20.122498] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-06T22:28:20.245748] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-06T22:28:20.762211] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T22:28:20.922528] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-06T22:28:21.722545] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-06T22:28:21.849039] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T22:28:22.433133] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T22:28:22.522502] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-06T22:28:23.275311] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T22:28:23.322484] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-06T22:28:24.084584] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-06T22:28:24.122514] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-06T22:28:24.922502] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-06T22:28:25.059432] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-06T22:28:25.722539] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-06T22:28:25.761014] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-06T22:28:26.522604] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-06T22:28:26.654007] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-06T22:28:27.167687] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-06T22:28:27.322486] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-06T22:28:28.017726] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-06T22:28:28.020564] [INFO ] [REMOTE ] WTTR: Full fetch complete (65633 records). [2025-10-06T22:28:28.020706] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-06T22:28:28.123888] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-06T22:28:28.415135] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-06T22:28:28.415234] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-06T22:28:28.416484] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-06T22:28:28.416552] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-06T22:28:28.417894] [DEBUG] [LOCAL ] WTTR: Trimmed 65633 records to 44812 (keeping 200 days of data) [2025-10-06T22:28:28.681854] [DEBUG] [LOCAL ] WTTR: Primary data saved (44812 records). [2025-10-06T22:28:28.682027] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-06T22:28:28.682123] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTTR took 33.0s. Estimated remaining: 5m 47s. Rate: 7.1 symbols/min [2025-10-06T22:28:28.858802] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:28:28.912514] [DEBUG] [LOCAL ] WY: Loaded 53893 existing records from primary storage. [2025-10-06T22:28:28.912939] [INFO ] [MAIN ] WY: Loaded 53893 existing records. [2025-10-06T22:28:28.927584] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-06T22:28:29.104892] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:28:29.105276] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-06T22:28:29.105339] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-06T22:28:29.105568] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-06T22:28:29.105626] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-06T22:28:29.529842] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:28:29.532410] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-06T22:28:29.570031] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-06T22:28:29.573290] [INFO ] [REMOTE ] WTRG: Full fetch complete (73486 records). [2025-10-06T22:28:29.573427] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-06T22:28:29.727758] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-06T22:28:29.973445] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-06T22:28:29.973545] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-06T22:28:29.974859] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-06T22:28:29.974945] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-06T22:28:29.976751] [DEBUG] [LOCAL ] WTRG: Trimmed 73486 records to 50948 (keeping 200 days of data) [2025-10-06T22:28:30.298686] [DEBUG] [LOCAL ] WTRG: Primary data saved (50948 records). [2025-10-06T22:28:30.298850] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-06T22:28:30.298943] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WTRG took 41.2s. Estimated remaining: 5m 38s. Rate: 7.1 symbols/min [2025-10-06T22:28:30.473424] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:28:30.506063] [DEBUG] [LOCAL ] XFLT: Loaded 30237 existing records from primary storage. [2025-10-06T22:28:30.506375] [INFO ] [MAIN ] XFLT: Loaded 30237 existing records. [2025-10-06T22:28:30.527603] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-06T22:28:30.698510] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:28:30.722206] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-06T22:28:30.725178] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-06T22:28:30.725491] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-06T22:28:30.726071] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-06T22:28:30.727118] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-06T22:28:31.121098] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:28:31.228664] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-06T22:28:31.322552] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-06T22:28:32.122621] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-06T22:28:32.370944] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-06T22:28:32.920042] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-06T22:28:32.929562] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-06T22:28:33.650313] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T22:28:33.722495] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-06T22:28:34.522516] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-06T22:28:34.863443] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-06T22:28:35.029426] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-06T22:28:35.322561] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-06T22:28:36.122572] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-06T22:28:36.285396] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T22:28:36.922568] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-06T22:28:37.010677] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-06T22:28:37.080038] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-06T22:28:37.722637] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-06T22:28:38.522552] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-06T22:28:38.574049] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T22:28:39.042277] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T22:28:39.322573] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-06T22:28:39.928969] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-06T22:28:39.932598] [INFO ] [REMOTE ] WU: Full fetch complete (77356 records). [2025-10-06T22:28:39.932789] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-06T22:28:40.136623] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-06T22:28:40.344945] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-06T22:28:40.345064] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-06T22:28:40.347141] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-06T22:28:40.347213] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-06T22:28:40.349339] [DEBUG] [LOCAL ] WU: Trimmed 77356 records to 53462 (keeping 200 days of data) [2025-10-06T22:28:40.701688] [DEBUG] [LOCAL ] WU: Primary data saved (53462 records). [2025-10-06T22:28:40.701916] [INFO ] [MAIN ] WU: Full history saved. [2025-10-06T22:28:40.702092] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WU took 42.5s. Estimated remaining: 5m 30s. Rate: 7.1 symbols/min [2025-10-06T22:28:40.891087] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:28:40.922497] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-06T22:28:40.941409] [DEBUG] [LOCAL ] XHR: Loaded 44335 existing records from primary storage. [2025-10-06T22:28:40.941902] [INFO ] [MAIN ] XHR: Loaded 44335 existing records. [2025-10-06T22:28:41.168681] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:28:41.169300] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-06T22:28:41.169554] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-06T22:28:41.169825] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-06T22:28:41.169886] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-06T22:28:41.293760] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-06T22:28:41.637332] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:28:41.660826] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-06T22:28:41.722559] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-06T22:28:42.469303] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-06T22:28:42.522610] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-06T22:28:43.167378] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-06T22:28:43.322549] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-06T22:28:44.103707] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-06T22:28:44.122476] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-06T22:28:44.220102] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-06T22:28:44.922517] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-06T22:28:45.722497] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-06T22:28:45.895276] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-06T22:28:46.072423] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-06T22:28:46.522540] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-06T22:28:47.322537] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-06T22:28:47.539529] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T22:28:47.756710] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-06T22:28:47.760139] [INFO ] [REMOTE ] WWW: Full fetch complete (70315 records). [2025-10-06T22:28:47.760302] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-06T22:28:48.127699] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-06T22:28:48.212932] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-06T22:28:48.213048] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-06T22:28:48.214841] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-06T22:28:48.214915] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-06T22:28:48.217358] [DEBUG] [LOCAL ] WWW: Trimmed 70315 records to 49236 (keeping 200 days of data) [2025-10-06T22:28:48.559812] [DEBUG] [LOCAL ] WWW: Primary data saved (49236 records). [2025-10-06T22:28:48.560002] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-06T22:28:48.560107] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. WWW took 36.1s. Estimated remaining: 5m 21s. Rate: 7.1 symbols/min [2025-10-06T22:28:48.772941] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T22:28:48.811349] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:28:48.811910] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-06T22:28:48.811981] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-06T22:28:48.812709] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-06T22:28:48.812791] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-06T22:28:48.812883] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-06T22:28:48.812958] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-06T22:28:48.927709] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-06T22:28:49.222853] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:28:49.536087] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-06T22:28:49.722559] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-06T22:28:49.932283] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T22:28:49.932825] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-06T22:28:49.932920] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:28:49.932968] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-06T22:28:49.933002] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:28:49.933044] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-06T22:28:49.933106] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-06T22:28:49.933143] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-06T22:28:49.933215] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-06T22:28:49.933287] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. XIFR took 1.4s. Estimated remaining: 5m 13s. Rate: 7.1 symbols/min [2025-10-06T22:28:50.125869] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:28:50.199381] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-10-06T22:28:50.199921] [INFO ] [MAIN ] XOM: Loaded 54573 existing records. [2025-10-06T22:28:50.390604] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:28:50.390911] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-06T22:28:50.390966] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-06T22:28:50.391722] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-06T22:28:50.391786] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-06T22:28:50.527633] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-06T22:28:50.842351] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:28:50.880764] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-06T22:28:51.322550] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-06T22:28:52.043765] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-06T22:28:52.122587] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-06T22:28:52.922501] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-06T22:28:53.196716] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-06T22:28:53.722564] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-06T22:28:54.311133] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-06T22:28:54.428257] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-06T22:28:54.522539] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-06T22:28:55.042602] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-06T22:28:55.322570] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-06T22:28:56.122538] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-06T22:28:56.642498] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-06T22:28:56.922547] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-06T22:28:57.162517] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-06T22:28:57.722542] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-06T22:28:57.832108] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T22:28:58.522540] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-06T22:28:58.654382] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T22:28:59.151291] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-06T22:28:59.322547] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-06T22:29:00.113112] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T22:29:00.122748] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-06T22:29:00.922572] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-06T22:29:01.152768] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T22:29:01.155003] [INFO ] [REMOTE ] XFLT: Full fetch complete (44107 records). [2025-10-06T22:29:01.155128] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-06T22:29:01.586839] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-06T22:29:01.586989] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-06T22:29:01.588432] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-06T22:29:01.588623] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-06T22:29:01.590421] [DEBUG] [LOCAL ] XFLT: Trimmed 44107 records to 29684 (keeping 200 days of data) [2025-10-06T22:29:01.714117] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-06T22:29:01.726865] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-06T22:29:01.829900] [DEBUG] [LOCAL ] XFLT: Primary data saved (29684 records). [2025-10-06T22:29:01.830099] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-06T22:29:01.830197] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. XFLT took 31.5s. Estimated remaining: 5m 4s. Rate: 7.1 symbols/min [2025-10-06T22:29:02.014409] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:29:02.052744] [DEBUG] [LOCAL ] XPER: Loaded 30362 existing records from primary storage. [2025-10-06T22:29:02.053151] [INFO ] [MAIN ] XPER: Loaded 30362 existing records. [2025-10-06T22:29:02.244942] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:29:02.245198] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-06T22:29:02.245248] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-06T22:29:02.245554] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-06T22:29:02.245632] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-06T22:29:02.525372] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-06T22:29:02.636962] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:29:02.664034] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-06T22:29:03.322512] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-06T22:29:03.644794] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-06T22:29:04.122554] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-06T22:29:04.691018] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-06T22:29:04.836454] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T22:29:04.922558] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-06T22:29:05.005523] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-06T22:29:05.722544] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-06T22:29:06.522559] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-06T22:29:07.137973] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-06T22:29:07.332069] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-06T22:29:07.353518] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T22:29:07.659618] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-06T22:29:08.122596] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-06T22:29:08.922637] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-06T22:29:09.722592] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-06T22:29:09.783889] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-06T22:29:10.131855] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-06T22:29:10.206454] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-06T22:29:10.522492] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-06T22:29:10.978169] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-06T22:29:10.991695] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-06T22:29:10.994992] [INFO ] [REMOTE ] WY: Full fetch complete (76847 records). [2025-10-06T22:29:10.995129] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-06T22:29:11.327830] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-06T22:29:11.409729] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-06T22:29:11.409836] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-06T22:29:11.411275] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-06T22:29:11.411361] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-06T22:29:11.413160] [DEBUG] [LOCAL ] WY: Trimmed 76847 records to 53136 (keeping 200 days of data) [2025-10-06T22:29:11.744209] [DEBUG] [LOCAL ] WY: Primary data saved (53136 records). [2025-10-06T22:29:11.744381] [INFO ] [MAIN ] WY: Full history saved. [2025-10-06T22:29:11.744510] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. WY took 43.1s. Estimated remaining: 4m 56s. Rate: 7.1 symbols/min [2025-10-06T22:29:11.923905] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:29:11.984196] [DEBUG] [LOCAL ] XPEV: Loaded 54416 existing records from primary storage. [2025-10-06T22:29:11.984789] [INFO ] [MAIN ] XPEV: Loaded 54416 existing records. [2025-10-06T22:29:12.127768] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-06T22:29:12.181039] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:29:12.181447] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-06T22:29:12.181510] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-06T22:29:12.181827] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-06T22:29:12.181886] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-06T22:29:12.540398] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:29:12.922538] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-06T22:29:13.722618] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-06T22:29:13.820542] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-06T22:29:13.836486] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-06T22:29:14.522544] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-06T22:29:14.922698] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-06T22:29:15.038026] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-06T22:29:15.322576] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-06T22:29:16.122535] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-06T22:29:16.765752] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-06T22:29:16.922550] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-06T22:29:17.425637] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-06T22:29:17.647872] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-06T22:29:17.722598] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-06T22:29:17.795487] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-06T22:29:17.799580] [INFO ] [REMOTE ] XHR: Full fetch complete (61792 records). [2025-10-06T22:29:17.799847] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-06T22:29:18.244873] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-06T22:29:18.244967] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-06T22:29:18.246196] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-06T22:29:18.246262] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-06T22:29:18.247546] [DEBUG] [LOCAL ] XHR: Trimmed 61792 records to 43728 (keeping 200 days of data) [2025-10-06T22:29:18.516018] [DEBUG] [LOCAL ] XHR: Primary data saved (43728 records). [2025-10-06T22:29:18.516175] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-06T22:29:18.516263] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XHR took 37.8s. Estimated remaining: 4m 47s. Rate: 7.1 symbols/min [2025-10-06T22:29:18.527700] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-06T22:29:18.703387] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:29:18.751294] [DEBUG] [LOCAL ] XPO: Loaded 48514 existing records from primary storage. [2025-10-06T22:29:18.751690] [INFO ] [MAIN ] XPO: Loaded 48514 existing records. [2025-10-06T22:29:18.945805] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:29:18.946092] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-06T22:29:18.946142] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-06T22:29:18.946402] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-06T22:29:18.946476] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-06T22:29:19.328103] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-06T22:29:19.333835] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:29:19.939029] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-06T22:29:20.122558] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-06T22:29:20.555778] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T22:29:20.869449] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-06T22:29:20.922618] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-06T22:29:21.722575] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-06T22:29:21.800721] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T22:29:22.088524] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-06T22:29:22.522567] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-06T22:29:23.322569] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-06T22:29:23.777307] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T22:29:23.780503] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-10-06T22:29:23.780731] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-06T22:29:24.127471] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-06T22:29:24.222093] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-06T22:29:24.222329] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-06T22:29:24.223991] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-06T22:29:24.224220] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-06T22:29:24.226336] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 53793 (keeping 200 days of data) [2025-10-06T22:29:24.371524] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-06T22:29:24.418521] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-06T22:29:24.668241] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-10-06T22:29:24.668436] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-06T22:29:24.669518] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XOM took 34.7s. Estimated remaining: 4m 39s. Rate: 7.1 symbols/min [2025-10-06T22:29:24.846172] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:29:24.893014] [DEBUG] [LOCAL ] XPOF: Loaded 38557 existing records from primary storage. [2025-10-06T22:29:24.893336] [INFO ] [MAIN ] XPOF: Loaded 38557 existing records. [2025-10-06T22:29:24.927745] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-06T22:29:25.081145] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:29:25.081423] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-06T22:29:25.081488] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-06T22:29:25.081809] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-06T22:29:25.081892] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-06T22:29:25.482855] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:29:25.536150] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-06T22:29:25.722586] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-06T22:29:26.522628] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-06T22:29:27.323028] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-06T22:29:27.334502] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-06T22:29:27.486671] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-06T22:29:27.800296] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T22:29:28.122588] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-06T22:29:28.678062] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-06T22:29:28.922552] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-06T22:29:29.722567] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-06T22:29:30.223383] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-06T22:29:30.312539] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-06T22:29:30.522540] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-06T22:29:31.075584] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-06T22:29:31.322575] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-06T22:29:31.980125] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-06T22:29:32.122554] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-06T22:29:32.922543] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-06T22:29:33.294046] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-06T22:29:33.722491] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-06T22:29:34.008433] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-06T22:29:34.115143] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-06T22:29:34.522558] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-06T22:29:35.322566] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-06T22:29:35.552916] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-06T22:29:36.081302] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-06T22:29:36.122565] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-06T22:29:36.922512] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-06T22:29:37.203550] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-06T22:29:37.205899] [INFO ] [REMOTE ] XPER: Full fetch complete (43282 records). [2025-10-06T22:29:37.205987] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-06T22:29:37.511340] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-06T22:29:37.638048] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-06T22:29:37.638144] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-06T22:29:37.639279] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-06T22:29:37.639343] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-06T22:29:37.640365] [DEBUG] [LOCAL ] XPER: Trimmed 43282 records to 30037 (keeping 200 days of data) [2025-10-06T22:29:37.723511] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-06T22:29:37.818103] [DEBUG] [LOCAL ] XPER: Primary data saved (30037 records). [2025-10-06T22:29:37.818306] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-06T22:29:37.818446] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XPER took 36.0s. Estimated remaining: 4m 31s. Rate: 7.1 symbols/min [2025-10-06T22:29:37.987087] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:29:38.032617] [DEBUG] [LOCAL ] XPRO: Loaded 46504 existing records from primary storage. [2025-10-06T22:29:38.033077] [INFO ] [MAIN ] XPRO: Loaded 46504 existing records. [2025-10-06T22:29:38.211352] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:29:38.211584] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-06T22:29:38.211632] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-06T22:29:38.212097] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-06T22:29:38.212154] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-06T22:29:38.526097] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-06T22:29:38.583779] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:29:38.611708] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T22:29:39.322570] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-06T22:29:40.115594] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T22:29:40.123397] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-06T22:29:40.181769] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-06T22:29:40.516043] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-06T22:29:40.922620] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-06T22:29:41.722582] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-06T22:29:41.780428] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T22:29:42.451047] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-06T22:29:42.522541] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-06T22:29:43.322532] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-06T22:29:43.851590] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-06T22:29:43.954023] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-06T22:29:44.122536] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-06T22:29:44.880281] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-06T22:29:44.922489] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-06T22:29:45.718222] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-06T22:29:45.726340] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-06T22:29:46.418292] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T22:29:46.522566] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-06T22:29:47.322497] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-06T22:29:47.520561] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T22:29:47.665082] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-06T22:29:48.122557] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-06T22:29:48.922558] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-06T22:29:49.396899] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-06T22:29:49.400204] [INFO ] [REMOTE ] XPEV: Full fetch complete (77677 records). [2025-10-06T22:29:49.400353] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-06T22:29:49.722602] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-06T22:29:49.809217] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-06T22:29:49.809557] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-06T22:29:49.810863] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-06T22:29:49.810941] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-06T22:29:49.834082] [DEBUG] [LOCAL ] XPEV: Trimmed 77677 records to 53634 (keeping 200 days of data) [2025-10-06T22:29:49.839205] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T22:29:50.174590] [DEBUG] [LOCAL ] XPEV: Primary data saved (53634 records). [2025-10-06T22:29:50.174827] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-06T22:29:50.175014] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPEV took 38.4s. Estimated remaining: 4m 22s. Rate: 7.1 symbols/min [2025-10-06T22:29:50.372529] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:29:50.383224] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-06T22:29:50.419275] [DEBUG] [LOCAL ] XYF: Loaded 28838 existing records from primary storage. [2025-10-06T22:29:50.419594] [INFO ] [MAIN ] XYF: Loaded 28838 existing records. [2025-10-06T22:29:50.527725] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-06T22:29:50.597638] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:29:50.597936] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-06T22:29:50.597987] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-06T22:29:50.598286] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-06T22:29:50.598370] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-06T22:29:50.955865] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:29:51.331580] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-06T22:29:51.336843] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-06T22:29:51.589269] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-06T22:29:51.591588] [INFO ] [REMOTE ] XPOF: Full fetch complete (52302 records). [2025-10-06T22:29:51.591709] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-06T22:29:51.984042] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-06T22:29:51.984138] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-06T22:29:51.985178] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-06T22:29:51.985242] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-06T22:29:51.986593] [DEBUG] [LOCAL ] XPOF: Trimmed 52302 records to 37750 (keeping 200 days of data) [2025-10-06T22:29:52.139896] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-06T22:29:52.202556] [DEBUG] [LOCAL ] XPOF: Primary data saved (37750 records). [2025-10-06T22:29:52.202747] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-06T22:29:52.202845] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XPOF took 27.5s. Estimated remaining: 4m 14s. Rate: 7.1 symbols/min [2025-10-06T22:29:52.404421] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:29:52.453094] [DEBUG] [LOCAL ] XYL: Loaded 48668 existing records from primary storage. [2025-10-06T22:29:52.453456] [INFO ] [MAIN ] XYL: Loaded 48668 existing records. [2025-10-06T22:29:52.574511] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-06T22:29:52.607788] [INFO ] [REMOTE ] XPO: Full fetch complete (69860 records). [2025-10-06T22:29:52.629563] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-06T22:29:52.652209] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:29:52.652614] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-06T22:29:52.652715] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-06T22:29:52.653126] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-06T22:29:52.684699] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-06T22:29:52.929692] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-06T22:29:53.417969] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:29:53.439087] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-06T22:29:53.439166] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-06T22:29:53.440597] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-06T22:29:53.440683] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-06T22:29:53.442044] [DEBUG] [LOCAL ] XPO: Trimmed 69860 records to 47822 (keeping 200 days of data) [2025-10-06T22:29:53.724123] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-06T22:29:53.740177] [DEBUG] [LOCAL ] XPO: Primary data saved (47822 records). [2025-10-06T22:29:53.740277] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-06T22:29:53.740363] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XPO took 35.2s. Estimated remaining: 4m 5s. Rate: 7.1 symbols/min [2025-10-06T22:29:53.919481] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:29:53.920357] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-06T22:29:53.920542] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-06T22:29:53.922576] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-06T22:29:53.922861] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-06T22:29:53.922912] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-06T22:29:53.922954] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-06T22:29:53.922985] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-06T22:29:54.063136] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-06T22:29:54.357788] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:29:54.522541] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-06T22:29:55.322562] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-06T22:29:55.409067] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T22:29:55.531587] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-06T22:29:55.531975] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-06T22:29:55.532077] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-06T22:29:55.532126] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-06T22:29:55.532160] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-06T22:29:55.532232] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-06T22:29:55.532301] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-06T22:29:55.532341] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-06T22:29:55.532401] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-06T22:29:55.532474] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XYZ took 1.8s. Estimated remaining: 3m 57s. Rate: 7.1 symbols/min [2025-10-06T22:29:55.698742] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:29:55.734240] [DEBUG] [LOCAL ] YALA: Loaded 37631 existing records from primary storage. [2025-10-06T22:29:55.734588] [INFO ] [MAIN ] YALA: Loaded 37631 existing records. [2025-10-06T22:29:55.911083] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:29:55.911400] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-06T22:29:55.911476] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-06T22:29:55.911798] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-06T22:29:55.911856] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-06T22:29:56.130888] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-06T22:29:56.274163] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T22:29:56.312539] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:29:56.575798] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-06T22:29:56.922545] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-06T22:29:57.722590] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-06T22:29:58.433097] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-06T22:29:58.522480] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-06T22:29:58.810681] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-06T22:29:59.322543] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-06T22:30:00.122501] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-06T22:30:00.156224] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-06T22:30:00.251005] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-06T22:30:00.922543] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-06T22:30:01.722708] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-06T22:30:02.020355] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-06T22:30:02.522638] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-06T22:30:02.785789] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-06T22:30:03.056971] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-06T22:30:03.322566] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-06T22:30:03.345903] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-06T22:30:04.122542] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-06T22:30:04.922495] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-06T22:30:05.179702] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-06T22:30:05.336335] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-06T22:30:05.722563] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-06T22:30:06.522518] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-06T22:30:06.628205] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-06T22:30:07.322564] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-06T22:30:07.728309] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-06T22:30:07.861219] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-06T22:30:08.122587] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-06T22:30:08.922511] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-06T22:30:08.981714] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T22:30:09.720487] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-06T22:30:09.729953] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-06T22:30:10.172216] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-06T22:30:10.522557] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-06T22:30:11.322506] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-06T22:30:11.486512] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-06T22:30:11.513607] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-06T22:30:11.517149] [INFO ] [REMOTE ] XPRO: Full fetch complete (66437 records). [2025-10-06T22:30:11.517368] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-06T22:30:11.905960] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-06T22:30:11.906070] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-06T22:30:11.907208] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-06T22:30:11.907276] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-06T22:30:11.909059] [DEBUG] [LOCAL ] XPRO: Trimmed 66437 records to 45841 (keeping 200 days of data) [2025-10-06T22:30:12.122591] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-06T22:30:12.198439] [DEBUG] [LOCAL ] XPRO: Primary data saved (45841 records). [2025-10-06T22:30:12.198678] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-06T22:30:12.198845] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XPRO took 34.4s. Estimated remaining: 3m 48s. Rate: 7.1 symbols/min [2025-10-06T22:30:12.384554] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:30:12.450044] [DEBUG] [LOCAL ] YELP: Loaded 45980 existing records from primary storage. [2025-10-06T22:30:12.450488] [INFO ] [MAIN ] YELP: Loaded 45980 existing records. [2025-10-06T22:30:12.673970] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:30:12.674443] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-06T22:30:12.674516] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-06T22:30:12.674891] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-06T22:30:12.674956] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-06T22:30:12.929693] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-06T22:30:13.100725] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-06T22:30:13.136123] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:30:13.343789] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-06T22:30:13.722587] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-06T22:30:14.343205] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-06T22:30:14.522546] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-06T22:30:15.247905] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-06T22:30:15.322573] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-06T22:30:15.811555] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-06T22:30:16.122542] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-06T22:30:16.925950] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-06T22:30:16.932404] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-06T22:30:17.561332] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T22:30:17.722590] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-06T22:30:18.378169] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-06T22:30:18.522483] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-06T22:30:18.926985] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-06T22:30:19.322541] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-06T22:30:20.122518] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-06T22:30:20.218057] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-06T22:30:20.774949] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-06T22:30:20.922564] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-06T22:30:21.244830] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-06T22:30:21.722559] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-06T22:30:22.246031] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-06T22:30:22.522620] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-06T22:30:23.203270] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T22:30:23.257316] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-06T22:30:23.322566] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-06T22:30:23.827774] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-06T22:30:23.830784] [INFO ] [REMOTE ] XYL: Full fetch complete (69751 records). [2025-10-06T22:30:23.830980] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-06T22:30:24.127600] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-06T22:30:24.235174] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-06T22:30:24.235263] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-06T22:30:24.236403] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-06T22:30:24.236470] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-06T22:30:24.238092] [DEBUG] [LOCAL ] XYL: Trimmed 69751 records to 47926 (keeping 200 days of data) [2025-10-06T22:30:24.552503] [DEBUG] [LOCAL ] XYL: Primary data saved (47926 records). [2025-10-06T22:30:24.552705] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-06T22:30:24.553550] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. XYL took 32.4s. Estimated remaining: 3m 40s. Rate: 7.1 symbols/min [2025-10-06T22:30:24.729697] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:30:24.785796] [DEBUG] [LOCAL ] YETI: Loaded 53220 existing records from primary storage. [2025-10-06T22:30:24.786196] [INFO ] [MAIN ] YETI: Loaded 53220 existing records. [2025-10-06T22:30:24.936516] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-06T22:30:24.981926] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:30:24.982253] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-06T22:30:24.982308] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-06T22:30:24.982518] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-06T22:30:24.982586] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-06T22:30:25.102752] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-06T22:30:25.139317] [INFO ] [REMOTE ] XYF: Full fetch complete (32239 records). [2025-10-06T22:30:25.171785] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-06T22:30:25.530562] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:30:25.727856] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-06T22:30:25.742057] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-06T22:30:25.742123] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-06T22:30:25.742803] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-06T22:30:25.742865] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-06T22:30:25.743774] [DEBUG] [LOCAL ] XYF: Trimmed 32239 records to 28488 (keeping 200 days of data) [2025-10-06T22:30:25.917411] [DEBUG] [LOCAL ] XYF: Primary data saved (28488 records). [2025-10-06T22:30:25.917571] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-06T22:30:25.917679] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. XYF took 35.7s. Estimated remaining: 3m 31s. Rate: 7.1 symbols/min [2025-10-06T22:30:26.084545] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:30:26.131128] [DEBUG] [LOCAL ] YEXT: Loaded 43743 existing records from primary storage. [2025-10-06T22:30:26.131488] [INFO ] [MAIN ] YEXT: Loaded 43743 existing records. [2025-10-06T22:30:26.309089] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:30:26.309347] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-06T22:30:26.309400] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-06T22:30:26.309581] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-06T22:30:26.309619] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-06T22:30:26.523288] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-06T22:30:26.679871] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:30:26.707838] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-06T22:30:27.322563] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-06T22:30:27.359853] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-06T22:30:28.122524] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-06T22:30:28.244562] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-06T22:30:28.922596] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-06T22:30:29.010128] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-06T22:30:29.722516] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-06T22:30:29.805002] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-06T22:30:30.186412] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-06T22:30:30.522610] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-06T22:30:31.042043] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-06T22:30:31.245006] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-06T22:30:31.247863] [INFO ] [REMOTE ] YALA: Full fetch complete (46691 records). [2025-10-06T22:30:31.248032] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-06T22:30:31.327755] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-06T22:30:31.651208] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-06T22:30:31.651320] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-06T22:30:31.652872] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-06T22:30:31.652942] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-06T22:30:31.654463] [DEBUG] [LOCAL ] YALA: Trimmed 46691 records to 37065 (keeping 200 days of data) [2025-10-06T22:30:31.881962] [DEBUG] [LOCAL ] YALA: Primary data saved (37065 records). [2025-10-06T22:30:31.882204] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-06T22:30:31.882325] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. YALA took 36.3s. Estimated remaining: 3m 23s. Rate: 7.1 symbols/min [2025-10-06T22:30:32.059260] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:30:32.118092] [DEBUG] [LOCAL ] YMM: Loaded 53399 existing records from primary storage. [2025-10-06T22:30:32.118640] [INFO ] [MAIN ] YMM: Loaded 53399 existing records. [2025-10-06T22:30:32.133469] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-06T22:30:32.326164] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:30:32.326518] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-06T22:30:32.326603] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-06T22:30:32.327013] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-06T22:30:32.327094] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-06T22:30:32.753402] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:30:32.922501] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-06T22:30:33.001028] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-06T22:30:33.722547] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-06T22:30:33.810937] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-06T22:30:34.522601] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-06T22:30:34.738387] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T22:30:35.322574] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-06T22:30:35.432262] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T22:30:36.029028] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-06T22:30:36.122551] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-06T22:30:36.922506] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-06T22:30:37.027996] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-06T22:30:37.722568] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-06T22:30:37.788806] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-06T22:30:38.417905] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T22:30:38.522583] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-06T22:30:39.322544] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-06T22:30:39.630887] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-06T22:30:40.071066] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-06T22:30:40.122580] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-06T22:30:40.922626] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-06T22:30:41.069284] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-06T22:30:41.687463] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-06T22:30:41.722575] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-06T22:30:42.522561] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-06T22:30:42.575775] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-06T22:30:43.241983] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-06T22:30:43.322508] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-06T22:30:44.122556] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-06T22:30:44.419433] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-06T22:30:44.713199] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-06T22:30:44.922518] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-06T22:30:45.722558] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-06T22:30:45.893322] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-06T22:30:46.469586] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-06T22:30:46.522478] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-06T22:30:47.075385] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-06T22:30:47.322551] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-06T22:30:47.444366] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-06T22:30:48.122551] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-06T22:30:48.922497] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-06T22:30:49.339825] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-06T22:30:49.722502] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-06T22:30:49.876953] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-06T22:30:50.127863] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-06T22:30:50.522549] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-06T22:30:51.322522] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-06T22:30:51.527473] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-06T22:30:51.867677] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-06T22:30:52.122537] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-06T22:30:52.618706] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-06T22:30:52.622531] [INFO ] [REMOTE ] YELP: Full fetch complete (64540 records). [2025-10-06T22:30:52.622842] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-06T22:30:52.929814] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-06T22:30:53.032873] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-06T22:30:53.032986] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-06T22:30:53.034660] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-06T22:30:53.034741] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-06T22:30:53.036372] [DEBUG] [LOCAL ] YELP: Trimmed 64540 records to 45396 (keeping 200 days of data) [2025-10-06T22:30:53.360632] [DEBUG] [LOCAL ] YELP: Primary data saved (45396 records). [2025-10-06T22:30:53.360867] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-06T22:30:53.360984] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. YELP took 41.2s. Estimated remaining: 3m 14s. Rate: 7.1 symbols/min [2025-10-06T22:30:53.557715] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:30:53.606840] [DEBUG] [LOCAL ] YOU: Loaded 50427 existing records from primary storage. [2025-10-06T22:30:53.607228] [INFO ] [MAIN ] YOU: Loaded 50427 existing records. [2025-10-06T22:30:53.724197] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-06T22:30:53.806714] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:30:53.812684] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-06T22:30:53.826515] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-06T22:30:53.831094] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-06T22:30:53.835423] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-06T22:30:53.843077] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-06T22:30:54.293298] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:30:54.303466] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-06T22:30:54.307044] [INFO ] [REMOTE ] YEXT: Full fetch complete (63177 records). [2025-10-06T22:30:54.307304] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-06T22:30:54.537758] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-06T22:30:54.931736] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-06T22:30:54.931880] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-06T22:30:54.934015] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-06T22:30:54.934122] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-06T22:30:54.936072] [DEBUG] [LOCAL ] YEXT: Trimmed 63177 records to 43092 (keeping 200 days of data) [2025-10-06T22:30:55.252153] [DEBUG] [LOCAL ] YEXT: Primary data saved (43092 records). [2025-10-06T22:30:55.252627] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-06T22:30:55.252859] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YEXT took 29.3s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-06T22:30:55.328302] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-06T22:30:55.497730] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:30:55.549858] [DEBUG] [LOCAL ] YPF: Loaded 51246 existing records from primary storage. [2025-10-06T22:30:55.550283] [INFO ] [MAIN ] YPF: Loaded 51246 existing records. [2025-10-06T22:30:55.770616] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:30:55.774621] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-06T22:30:55.774513] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-06T22:30:55.774831] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-06T22:30:55.785663] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-06T22:30:55.786194] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-06T22:30:56.124214] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-06T22:30:56.165485] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:30:56.450160] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-06T22:30:56.922583] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-06T22:30:57.151487] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-06T22:30:57.722574] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-06T22:30:57.872532] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-06T22:30:58.522632] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-06T22:30:58.573524] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-06T22:30:59.322568] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-06T22:30:59.501263] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T22:31:00.122510] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-06T22:31:00.252765] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-06T22:31:00.922524] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-06T22:31:01.185377] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-06T22:31:01.722532] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-06T22:31:01.976167] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T22:31:02.522635] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-06T22:31:02.650663] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-06T22:31:03.322492] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-06T22:31:03.438594] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-06T22:31:04.091755] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-06T22:31:04.094776] [INFO ] [REMOTE ] YMM: Full fetch complete (76379 records). [2025-10-06T22:31:04.094881] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-06T22:31:04.127582] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-06T22:31:04.493321] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-06T22:31:04.493421] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-06T22:31:04.494625] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-06T22:31:04.494712] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-06T22:31:04.496188] [DEBUG] [LOCAL ] YMM: Trimmed 76379 records to 52621 (keeping 200 days of data) [2025-10-06T22:31:04.813831] [DEBUG] [LOCAL ] YMM: Primary data saved (52621 records). [2025-10-06T22:31:04.814004] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-06T22:31:04.814097] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YMM took 32.9s. Estimated remaining: 2m 57s. Rate: 7.1 symbols/min [2025-10-06T22:31:04.927613] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-06T22:31:04.997905] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:31:05.013777] [DEBUG] [LOCAL ] YRD: Loaded 12794 existing records from primary storage. [2025-10-06T22:31:05.014053] [INFO ] [MAIN ] YRD: Loaded 12794 existing records. [2025-10-06T22:31:05.198964] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:31:05.199358] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-06T22:31:05.199439] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-06T22:31:05.199724] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-06T22:31:05.199806] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-06T22:31:05.463483] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-06T22:31:05.626201] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:31:05.722508] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-06T22:31:05.840534] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-06T22:31:06.329630] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-06T22:31:06.332923] [INFO ] [REMOTE ] YETI: Full fetch complete (75440 records). [2025-10-06T22:31:06.333102] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-06T22:31:06.510940] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-06T22:31:06.536913] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-06T22:31:06.777762] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-06T22:31:06.777868] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-06T22:31:06.779116] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-06T22:31:06.779189] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-06T22:31:06.780798] [DEBUG] [LOCAL ] YETI: Trimmed 75440 records to 52473 (keeping 200 days of data) [2025-10-06T22:31:07.090977] [DEBUG] [LOCAL ] YETI: Primary data saved (52473 records). [2025-10-06T22:31:07.091157] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-06T22:31:07.091251] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YETI took 42.5s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-06T22:31:07.259814] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:31:07.288836] [DEBUG] [LOCAL ] YSG: Loaded 25886 existing records from primary storage. [2025-10-06T22:31:07.289169] [INFO ] [MAIN ] YSG: Loaded 25886 existing records. [2025-10-06T22:31:07.331543] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-06T22:31:07.473702] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:31:07.473934] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-06T22:31:07.473982] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-06T22:31:07.474199] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-06T22:31:07.474254] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-06T22:31:07.826439] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:31:08.122591] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-06T22:31:08.231695] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-06T22:31:08.539701] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-06T22:31:08.922574] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-06T22:31:09.605812] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-06T22:31:09.722587] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-06T22:31:10.522514] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-06T22:31:10.698532] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-06T22:31:10.773530] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-06T22:31:11.322486] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-06T22:31:11.798438] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-06T22:31:12.122607] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-06T22:31:12.791381] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-06T22:31:12.922511] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-06T22:31:12.938885] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-06T22:31:13.722595] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-06T22:31:14.522493] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-06T22:31:14.562285] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-06T22:31:15.322495] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-06T22:31:15.399536] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-06T22:31:15.717533] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-06T22:31:16.122584] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-06T22:31:16.922549] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-06T22:31:16.986101] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T22:31:17.462937] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-06T22:31:17.722599] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-06T22:31:17.811122] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-06T22:31:18.522576] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-06T22:31:19.143034] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-06T22:31:19.322537] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-06T22:31:19.558419] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-06T22:31:20.082837] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-06T22:31:20.122471] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-06T22:31:20.922494] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-06T22:31:21.079613] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-06T22:31:21.722615] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-06T22:31:22.522514] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-06T22:31:22.581142] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-06T22:31:22.593201] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-06T22:31:23.322591] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-06T22:31:24.122522] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-06T22:31:24.372476] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-06T22:31:24.754874] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-06T22:31:24.918775] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-06T22:31:24.922467] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-06T22:31:25.722523] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-06T22:31:25.869248] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-06T22:31:26.522561] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-06T22:31:27.328883] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-06T22:31:27.330092] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-06T22:31:27.399488] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-06T22:31:28.122514] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-06T22:31:28.922560] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-06T22:31:29.471362] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-06T22:31:29.722573] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-06T22:31:29.804736] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-06T22:31:30.474510] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-06T22:31:30.477410] [INFO ] [REMOTE ] YPF: Full fetch complete (73461 records). [2025-10-06T22:31:30.477508] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-06T22:31:30.532354] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-06T22:31:30.872846] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-06T22:31:30.873037] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-06T22:31:30.874242] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-06T22:31:30.874308] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-06T22:31:30.875815] [DEBUG] [LOCAL ] YPF: Trimmed 73461 records to 50487 (keeping 200 days of data) [2025-10-06T22:31:31.103329] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-06T22:31:31.202514] [DEBUG] [LOCAL ] YPF: Primary data saved (50487 records). [2025-10-06T22:31:31.202689] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-06T22:31:31.202792] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YPF took 35.9s. Estimated remaining: 2m 41s. Rate: 7.1 symbols/min [2025-10-06T22:31:31.327426] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-06T22:31:31.379878] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:31:31.401562] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-06T22:31:31.443106] [DEBUG] [LOCAL ] YUM: Loaded 51935 existing records from primary storage. [2025-10-06T22:31:31.443450] [INFO ] [MAIN ] YUM: Loaded 51935 existing records. [2025-10-06T22:31:31.618689] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:31:31.618944] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-06T22:31:31.618996] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-06T22:31:31.619207] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-06T22:31:31.619256] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-06T22:31:31.970604] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:31:32.122482] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-06T22:31:32.782704] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-06T22:31:32.786369] [INFO ] [REMOTE ] YOU: Full fetch complete (72146 records). [2025-10-06T22:31:32.786494] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-06T22:31:32.944177] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-06T22:31:33.198483] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-06T22:31:33.198570] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-06T22:31:33.199705] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-06T22:31:33.199770] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-06T22:31:33.201396] [DEBUG] [LOCAL ] YOU: Trimmed 72146 records to 49674 (keeping 200 days of data) [2025-10-06T22:31:33.513291] [DEBUG] [LOCAL ] YOU: Primary data saved (49674 records). [2025-10-06T22:31:33.513441] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-06T22:31:33.513530] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YOU took 40.2s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-06T22:31:33.695413] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:31:33.726574] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-06T22:31:33.750861] [DEBUG] [LOCAL ] YUMC: Loaded 53407 existing records from primary storage. [2025-10-06T22:31:33.751334] [INFO ] [MAIN ] YUMC: Loaded 53407 existing records. [2025-10-06T22:31:33.872582] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-06T22:31:33.962237] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:31:33.977322] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-06T22:31:33.977426] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-06T22:31:33.989696] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-06T22:31:33.989884] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-06T22:31:34.054731] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-06T22:31:34.399972] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:31:34.522504] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-06T22:31:34.870752] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-06T22:31:35.168850] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-06T22:31:35.170166] [INFO ] [REMOTE ] YRD: Full fetch complete (19063 records). [2025-10-06T22:31:35.170252] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-06T22:31:35.322567] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-06T22:31:35.553660] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-06T22:31:35.553764] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-06T22:31:35.554240] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-06T22:31:35.554281] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-06T22:31:35.554989] [DEBUG] [LOCAL ] YRD: Trimmed 19063 records to 12286 (keeping 200 days of data) [2025-10-06T22:31:35.630669] [DEBUG] [LOCAL ] YRD: Primary data saved (12286 records). [2025-10-06T22:31:35.630846] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-06T22:31:35.630937] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YRD took 30.8s. Estimated remaining: 2m 24s. Rate: 7.1 symbols/min [2025-10-06T22:31:35.806990] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:31:35.862399] [DEBUG] [LOCAL ] ZBH: Loaded 51739 existing records from primary storage. [2025-10-06T22:31:35.862799] [INFO ] [MAIN ] ZBH: Loaded 51739 existing records. [2025-10-06T22:31:36.047921] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:31:36.048230] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-06T22:31:36.048283] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-06T22:31:36.048569] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-06T22:31:36.048627] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-06T22:31:36.127783] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-06T22:31:36.402759] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:31:36.922566] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-06T22:31:37.177564] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-06T22:31:37.722522] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-06T22:31:37.905620] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-06T22:31:38.443779] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-06T22:31:38.522590] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-06T22:31:38.647809] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T22:31:38.649966] [INFO ] [REMOTE ] YSG: Full fetch complete (32431 records). [2025-10-06T22:31:38.650067] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-06T22:31:39.040295] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-06T22:31:39.040403] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-06T22:31:39.041182] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-06T22:31:39.041247] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-06T22:31:39.042148] [DEBUG] [LOCAL ] YSG: Trimmed 32431 records to 25288 (keeping 200 days of data) [2025-10-06T22:31:39.192840] [DEBUG] [LOCAL ] YSG: Primary data saved (25288 records). [2025-10-06T22:31:39.193010] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-06T22:31:39.193107] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YSG took 32.1s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-06T22:31:39.327714] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-06T22:31:39.377135] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:31:39.396069] [DEBUG] [LOCAL ] ZEPP: Loaded 17887 existing records from primary storage. [2025-10-06T22:31:39.396340] [INFO ] [MAIN ] ZEPP: Loaded 17887 existing records. [2025-10-06T22:31:39.575009] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:31:39.575264] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-06T22:31:39.575310] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-06T22:31:39.575577] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-06T22:31:39.575634] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-06T22:31:39.942783] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:31:40.122520] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-06T22:31:40.343017] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-06T22:31:40.460672] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-06T22:31:40.578061] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T22:31:40.922544] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-06T22:31:41.722617] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-06T22:31:42.522509] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-06T22:31:42.564834] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-06T22:31:43.014982] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-06T22:31:43.099468] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-06T22:31:43.322542] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-06T22:31:44.122530] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-06T22:31:44.922520] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-06T22:31:45.003559] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T22:31:45.722492] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-06T22:31:45.973039] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-06T22:31:46.278559] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-06T22:31:46.522554] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-06T22:31:46.992748] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-06T22:31:47.322559] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-06T22:31:47.580863] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-06T22:31:48.122561] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-06T22:31:48.922528] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-06T22:31:49.291473] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-06T22:31:49.525179] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-06T22:31:49.722498] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-06T22:31:50.008014] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-06T22:31:50.262956] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-06T22:31:50.522521] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-06T22:31:51.322562] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-06T22:31:52.122519] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-06T22:31:52.183256] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-06T22:31:52.922522] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-06T22:31:52.984539] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-06T22:31:53.722540] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-06T22:31:53.945839] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-06T22:31:54.382305] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-06T22:31:54.522516] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-06T22:31:55.322489] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-06T22:31:55.374343] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-06T22:31:56.122575] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-06T22:31:56.240770] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T22:31:56.756837] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-06T22:31:56.922482] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-06T22:31:56.976817] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-06T22:31:57.568375] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-06T22:31:57.722594] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-06T22:31:58.522528] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-06T22:31:59.322568] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-06T22:31:59.437119] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-06T22:31:59.604894] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-06T22:32:00.122562] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-06T22:32:00.922554] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-06T22:32:01.240677] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-06T22:32:01.722566] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-06T22:32:01.914911] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-06T22:32:02.220326] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-06T22:32:02.223228] [INFO ] [REMOTE ] ZBH: Full fetch complete (73810 records). [2025-10-06T22:32:02.223365] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-06T22:32:02.527600] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-06T22:32:02.645808] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-06T22:32:02.645954] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-06T22:32:02.647362] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-06T22:32:02.647587] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-06T22:32:02.678565] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-06T22:32:02.676973] [DEBUG] [LOCAL ] ZBH: Trimmed 73810 records to 50961 (keeping 200 days of data) [2025-10-06T22:32:03.019829] [DEBUG] [LOCAL ] ZBH: Primary data saved (50961 records). [2025-10-06T22:32:03.020003] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-06T22:32:03.020094] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. ZBH took 27.4s. Estimated remaining: 2m 7s. Rate: 7.1 symbols/min [2025-10-06T22:32:03.186989] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:32:03.242566] [DEBUG] [LOCAL ] ZETA: Loaded 54377 existing records from primary storage. [2025-10-06T22:32:03.242981] [INFO ] [MAIN ] ZETA: Loaded 54377 existing records. [2025-10-06T22:32:03.327922] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-06T22:32:03.443590] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:32:03.444111] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-06T22:32:03.444178] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-06T22:32:03.444535] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-06T22:32:03.444616] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-06T22:32:04.027695] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:32:04.050715] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-06T22:32:04.122566] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-06T22:32:04.890569] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T22:32:04.922546] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-06T22:32:05.722561] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-06T22:32:06.522583] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-06T22:32:06.781525] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-06T22:32:06.866681] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-06T22:32:07.072088] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-06T22:32:07.322566] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-06T22:32:07.338573] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-06T22:32:07.340237] [INFO ] [REMOTE ] ZEPP: Full fetch complete (19481 records). [2025-10-06T22:32:07.340316] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-06T22:32:07.733719] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-06T22:32:07.733822] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-06T22:32:07.734310] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-06T22:32:07.734350] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-06T22:32:07.735099] [DEBUG] [LOCAL ] ZEPP: Trimmed 19481 records to 17976 (keeping 200 days of data) [2025-10-06T22:32:07.840417] [DEBUG] [LOCAL ] ZEPP: Primary data saved (17976 records). [2025-10-06T22:32:07.840583] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-06T22:32:07.840697] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. ZEPP took 28.6s. Estimated remaining: 1m 58s. Rate: 7.1 symbols/min [2025-10-06T22:32:08.122588] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-06T22:32:08.922576] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-06T22:32:09.149578] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-06T22:32:09.722564] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-06T22:32:09.926619] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-06T22:32:10.183331] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-06T22:32:10.186541] [INFO ] [REMOTE ] YUM: Full fetch complete (74495 records). [2025-10-06T22:32:10.186703] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-06T22:32:10.527728] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-06T22:32:10.605993] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-06T22:32:10.606082] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-06T22:32:10.607409] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-06T22:32:10.607476] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-06T22:32:10.609118] [DEBUG] [LOCAL ] YUM: Trimmed 74495 records to 51208 (keeping 200 days of data) [2025-10-06T22:32:10.952319] [DEBUG] [LOCAL ] YUM: Primary data saved (51208 records). [2025-10-06T22:32:10.952518] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-06T22:32:10.952679] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. YUM took 39.7s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-06T22:32:11.161274] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-06T22:32:11.322548] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-06T22:32:12.334581] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-06T22:32:12.346815] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-06T22:32:13.586971] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-06T22:32:13.597895] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-06T22:32:13.732210] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-06T22:32:13.735159] [INFO ] [REMOTE ] YUMC: Full fetch complete (76158 records). [2025-10-06T22:32:13.735258] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-06T22:32:14.134047] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-06T22:32:14.134179] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-06T22:32:14.135559] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-06T22:32:14.135661] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-06T22:32:14.137256] [DEBUG] [LOCAL ] YUMC: Trimmed 76158 records to 52614 (keeping 200 days of data) [2025-10-06T22:32:14.469068] [DEBUG] [LOCAL ] YUMC: Primary data saved (52614 records). [2025-10-06T22:32:14.469230] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-06T22:32:14.470039] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. YUMC took 41.0s. Estimated remaining: 1m 41s. Rate: 7.1 symbols/min [2025-10-06T22:32:15.843466] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-06T22:32:15.854517] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-06T22:32:17.915848] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-06T22:32:17.927560] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-06T22:32:19.988755] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-06T22:32:20.000026] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-06T22:32:22.198494] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-06T22:32:22.209450] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-06T22:32:24.792639] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-06T22:32:24.804998] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-06T22:32:27.411045] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-06T22:32:27.422536] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-06T22:32:29.823479] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-06T22:32:29.834989] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-06T22:32:31.864491] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-06T22:32:31.867522] [INFO ] [REMOTE ] ZETA: Full fetch complete (77680 records). [2025-10-06T22:32:31.867622] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-06T22:32:32.332783] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-06T22:32:32.332906] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-06T22:32:32.334776] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-06T22:32:32.334847] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-06T22:32:32.336973] [DEBUG] [LOCAL ] ZETA: Trimmed 77680 records to 53601 (keeping 200 days of data) [2025-10-06T22:32:32.700120] [DEBUG] [LOCAL ] ZETA: Primary data saved (53601 records). [2025-10-06T22:32:32.700322] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-06T22:32:32.700423] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 29.7s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-06T22:32:33.303415] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:32:33.485967] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:32:33.491602] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:32:33.520760] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:32:33.576467] [DEBUG] [LOCAL ] ZH: Loaded 26692 existing records from primary storage. [2025-10-06T22:32:33.577272] [INFO ] [MAIN ] ZH: Loaded 26692 existing records. [2025-10-06T22:32:33.632179] [DEBUG] [LOCAL ] ZGN: Loaded 41301 existing records from primary storage. [2025-10-06T22:32:33.646469] [INFO ] [MAIN ] ZGN: Loaded 41301 existing records. [2025-10-06T22:32:33.791312] [DEBUG] [LOCAL ] ZIP: Loaded 44711 existing records from primary storage. [2025-10-06T22:32:33.814029] [INFO ] [MAIN ] ZIP: Loaded 44711 existing records. [2025-10-06T22:32:33.999453] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:32:34.021848] [DEBUG] [LOCAL ] ZIM: Loaded 54289 existing records from primary storage. [2025-10-06T22:32:34.061808] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-06T22:32:34.068426] [INFO ] [MAIN ] ZIM: Loaded 54289 existing records. [2025-10-06T22:32:34.073759] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-06T22:32:34.136904] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-06T22:32:34.152106] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-06T22:32:34.140801] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:32:34.205412] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-06T22:32:34.405738] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:32:34.357682] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-06T22:32:34.449497] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-06T22:32:34.454221] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-06T22:32:34.465170] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-06T22:32:34.475689] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-06T22:32:34.538101] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-06T22:32:34.599955] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-06T22:32:34.830236] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:32:34.938514] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-06T22:32:34.948972] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-06T22:32:35.010318] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-06T22:32:35.047034] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-06T22:32:35.440217] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:32:35.480204] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-06T22:32:35.835251] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:32:35.912185] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-06T22:32:35.920522] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:32:35.943897] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-06T22:32:36.029921] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:32:36.030301] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-06T22:32:36.700023] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-06T22:32:36.705213] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-06T22:32:37.391300] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-06T22:32:37.398282] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-06T22:32:37.461594] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-06T22:32:37.474885] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-06T22:32:37.713845] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-06T22:32:37.718408] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-06T22:32:38.306071] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-06T22:32:38.317456] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-06T22:32:38.373056] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-06T22:32:38.379869] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-06T22:32:38.973032] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-06T22:32:38.981768] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-06T22:32:39.343258] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-06T22:32:39.353472] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-06T22:32:39.736955] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-06T22:32:39.744432] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-06T22:32:40.290249] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-06T22:32:40.297947] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-06T22:32:40.417202] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-06T22:32:40.428258] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-06T22:32:40.759750] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-06T22:32:40.768485] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-06T22:32:41.403466] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-06T22:32:41.413868] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-06T22:32:41.754736] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-06T22:32:41.763415] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-06T22:32:42.042978] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-06T22:32:42.055548] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-06T22:32:42.146538] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-06T22:32:42.157179] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-06T22:32:43.069404] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-06T22:32:43.070353] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-06T22:32:43.085198] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-06T22:32:43.085562] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-06T22:32:43.408132] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-06T22:32:43.417942] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-06T22:32:43.850775] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-06T22:32:43.856168] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-06T22:32:44.253690] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-06T22:32:44.265441] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-06T22:32:44.317474] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-06T22:32:44.327388] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-06T22:32:44.442710] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-06T22:32:44.452618] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-06T22:32:45.077081] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-06T22:32:45.083963] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-06T22:32:45.845402] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-06T22:32:45.855102] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-06T22:32:45.923899] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-06T22:32:45.932467] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-06T22:32:46.265521] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-06T22:32:46.290838] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-06T22:32:46.290237] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-06T22:32:46.297374] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-06T22:32:47.287945] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-06T22:32:47.297372] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-06T22:32:47.492630] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-06T22:32:47.502103] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-06T22:32:47.609727] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-06T22:32:47.616750] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-06T22:32:48.650187] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-06T22:32:48.652836] [INFO ] [REMOTE ] ZH: Full fetch complete (40167 records). [2025-10-06T22:32:48.653759] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-06T22:32:48.656241] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-06T22:32:48.718960] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-06T22:32:49.076986] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-06T22:32:49.142346] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-06T22:32:49.154107] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-06T22:32:49.147697] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-06T22:32:49.159088] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-06T22:32:49.159311] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-06T22:32:49.162241] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-06T22:32:49.171529] [DEBUG] [LOCAL ] ZH: Trimmed 40167 records to 26140 (keeping 200 days of data) [2025-10-06T22:32:49.173829] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-06T22:32:49.319246] [DEBUG] [LOCAL ] ZH: Primary data saved (26140 records). [2025-10-06T22:32:49.319406] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-06T22:32:49.319494] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 16.6s. Estimated remaining: 1m 25s. Rate: 7.1 symbols/min [2025-10-06T22:32:49.505337] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:32:49.548101] [DEBUG] [LOCAL ] ZK: Loaded 40134 existing records from primary storage. [2025-10-06T22:32:49.548502] [INFO ] [MAIN ] ZK: Loaded 40134 existing records. [2025-10-06T22:32:49.732408] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:32:49.732748] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-06T22:32:49.732803] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-06T22:32:49.733068] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-06T22:32:49.733127] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-06T22:32:50.109146] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:32:50.109467] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-06T22:32:50.571252] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-06T22:32:50.580966] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-06T22:32:50.657354] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-06T22:32:51.060967] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-06T22:32:51.322573] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-06T22:32:51.583454] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-06T22:32:51.586241] [INFO ] [REMOTE ] ZIP: Full fetch complete (59828 records). [2025-10-06T22:32:51.586375] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-06T22:32:52.024119] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-06T22:32:52.024320] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-06T22:32:52.025783] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-06T22:32:52.026410] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-06T22:32:52.027947] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-06T22:32:52.038424] [DEBUG] [LOCAL ] ZIP: Trimmed 59828 records to 43976 (keeping 200 days of data) [2025-10-06T22:32:52.127345] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-06T22:32:52.302685] [DEBUG] [LOCAL ] ZIP: Primary data saved (43976 records). [2025-10-06T22:32:52.302872] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-06T22:32:52.302977] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZIP took 19.6s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-06T22:32:52.473591] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:32:52.484982] [DEBUG] [LOCAL ] ZKH: Loaded 7885 existing records from primary storage. [2025-10-06T22:32:52.485225] [INFO ] [MAIN ] ZKH: Loaded 7885 existing records. [2025-10-06T22:32:52.582738] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T22:32:52.601830] [INFO ] [REMOTE ] ZGN: Full fetch complete (58083 records). [2025-10-06T22:32:52.622590] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-06T22:32:52.754501] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:32:52.770609] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-06T22:32:52.778716] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-06T22:32:52.781410] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-06T22:32:52.791906] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-06T22:32:52.930687] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-06T22:32:53.408991] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-06T22:32:53.424763] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-06T22:32:53.455053] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-06T22:32:53.455292] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-06T22:32:53.494247] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:32:53.495471] [DEBUG] [LOCAL ] ZGN: Trimmed 58083 records to 40770 (keeping 200 days of data) [2025-10-06T22:32:53.605158] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-06T22:32:53.726969] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-06T22:32:53.768463] [DEBUG] [LOCAL ] ZGN: Primary data saved (40770 records). [2025-10-06T22:32:53.768630] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-06T22:32:53.768778] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZGN took 21.1s. Estimated remaining: 1m 8s. Rate: 7.1 symbols/min [2025-10-06T22:32:53.933784] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:32:53.984275] [DEBUG] [LOCAL ] ZTO: Loaded 50585 existing records from primary storage. [2025-10-06T22:32:53.984709] [INFO ] [MAIN ] ZTO: Loaded 50585 existing records. [2025-10-06T22:32:54.164864] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:32:54.165158] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-06T22:32:54.165228] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-06T22:32:54.165585] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-06T22:32:54.165678] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-06T22:32:54.512811] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:32:54.522477] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-06T22:32:55.191261] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-06T22:32:55.224177] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-06T22:32:55.322479] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-06T22:32:56.122501] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-06T22:32:56.270932] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-06T22:32:56.922605] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-06T22:32:57.005040] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-06T22:32:57.722548] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-06T22:32:58.498104] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-06T22:32:58.522473] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-06T22:32:58.707716] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-06T22:32:59.187624] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-06T22:32:59.307747] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-06T22:32:59.322475] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-06T22:33:00.122560] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-06T22:33:00.890430] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-06T22:33:00.922484] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-06T22:33:01.132545] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-06T22:33:01.631872] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-06T22:33:01.722503] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-06T22:33:02.522592] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-06T22:33:03.322548] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-06T22:33:03.521611] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-06T22:33:04.099591] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-06T22:33:04.122474] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-06T22:33:04.352703] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-06T22:33:04.733526] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-06T22:33:04.922541] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-06T22:33:05.722592] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-06T22:33:06.522510] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-06T22:33:06.739542] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-06T22:33:07.084045] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-06T22:33:07.314364] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-06T22:33:07.327505] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-06T22:33:08.122549] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-06T22:33:08.922539] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-06T22:33:09.088912] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-06T22:33:09.598686] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-06T22:33:09.601839] [INFO ] [REMOTE ] ZIM: Full fetch complete (77501 records). [2025-10-06T22:33:09.601975] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-06T22:33:09.728721] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-06T22:33:10.065971] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-06T22:33:10.066082] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-06T22:33:10.067474] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-06T22:33:10.067542] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-06T22:33:10.069335] [DEBUG] [LOCAL ] ZIM: Trimmed 77501 records to 53507 (keeping 200 days of data) [2025-10-06T22:33:10.380341] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-06T22:33:10.421329] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-06T22:33:10.455856] [DEBUG] [LOCAL ] ZIM: Primary data saved (53507 records). [2025-10-06T22:33:10.456044] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-06T22:33:10.456974] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 37.7s. Estimated remaining: 59.2s. Rate: 7.1 symbols/min [2025-10-06T22:33:10.527635] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-06T22:33:10.640202] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:33:10.660300] [DEBUG] [LOCAL ] ZTR: Loaded 16981 existing records from primary storage. [2025-10-06T22:33:10.660580] [INFO ] [MAIN ] ZTR: Loaded 16981 existing records. [2025-10-06T22:33:10.838996] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:33:10.839263] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-06T22:33:10.839310] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-06T22:33:10.839533] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-06T22:33:10.839592] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-06T22:33:11.201780] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:33:11.322551] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-06T22:33:11.964225] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-06T22:33:12.122544] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-06T22:33:12.932378] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-06T22:33:12.953893] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-06T22:33:13.693787] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-06T22:33:13.722473] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-06T22:33:13.936204] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-06T22:33:14.522530] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-06T22:33:15.282080] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-06T22:33:15.322494] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-06T22:33:15.772422] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-06T22:33:16.122543] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-06T22:33:16.247673] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-06T22:33:16.249958] [INFO ] [REMOTE ] ZK: Full fetch complete (56975 records). [2025-10-06T22:33:16.250059] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-06T22:33:16.631515] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-06T22:33:16.631617] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-06T22:33:16.632806] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-06T22:33:16.632871] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-06T22:33:16.634171] [DEBUG] [LOCAL ] ZK: Trimmed 56975 records to 39361 (keeping 200 days of data) [2025-10-06T22:33:16.881308] [DEBUG] [LOCAL ] ZK: Primary data saved (39361 records). [2025-10-06T22:33:16.881476] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-06T22:33:16.881567] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZK took 27.6s. Estimated remaining: 50.7s. Rate: 7.1 symbols/min [2025-10-06T22:33:16.927809] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-06T22:33:17.058981] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:33:17.114352] [DEBUG] [LOCAL ] ZTS: Loaded 53769 existing records from primary storage. [2025-10-06T22:33:17.114738] [INFO ] [MAIN ] ZTS: Loaded 53769 existing records. [2025-10-06T22:33:17.290727] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:33:17.291028] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-06T22:33:17.291081] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-06T22:33:17.291306] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-06T22:33:17.291363] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-06T22:33:17.687844] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:33:17.722477] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-06T22:33:17.835770] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-06T22:33:17.863138] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-06T22:33:18.522552] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-06T22:33:19.322498] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-06T22:33:19.466268] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-06T22:33:19.501194] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-06T22:33:20.122537] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-06T22:33:20.922588] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-06T22:33:21.050283] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-06T22:33:21.075632] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-06T22:33:21.722545] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-06T22:33:21.926850] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-06T22:33:22.522599] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-06T22:33:23.022253] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-06T22:33:23.322556] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-06T22:33:23.519183] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-06T22:33:24.122544] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-06T22:33:24.580322] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-06T22:33:24.583415] [INFO ] [REMOTE ] ZTO: Full fetch complete (72875 records). [2025-10-06T22:33:24.583549] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-06T22:33:24.927807] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-06T22:33:25.007410] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-06T22:33:25.007538] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-06T22:33:25.009689] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-06T22:33:25.009813] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-06T22:33:25.012205] [DEBUG] [LOCAL ] ZTO: Trimmed 72875 records to 49704 (keeping 200 days of data) [2025-10-06T22:33:25.357302] [DEBUG] [LOCAL ] ZTO: Primary data saved (49704 records). [2025-10-06T22:33:25.357503] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-06T22:33:25.357621] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZTO took 31.6s. Estimated remaining: 42.3s. Rate: 7.1 symbols/min [2025-10-06T22:33:25.546758] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:33:25.585394] [DEBUG] [LOCAL ] ZVIA: Loaded 35928 existing records from primary storage. [2025-10-06T22:33:25.585767] [INFO ] [MAIN ] ZVIA: Loaded 35928 existing records. [2025-10-06T22:33:25.732364] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-06T22:33:25.760042] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-06T22:33:25.804984] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:33:25.808425] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-06T22:33:25.808610] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-06T22:33:25.809229] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-06T22:33:25.809294] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-06T22:33:26.169897] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:33:26.196881] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-06T22:33:26.522543] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-06T22:33:26.614206] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-06T22:33:27.322580] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-06T22:33:28.032714] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-06T22:33:28.122592] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-06T22:33:28.922522] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-06T22:33:29.116501] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-06T22:33:29.342916] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-06T22:33:29.343907] [INFO ] [REMOTE ] ZKH: Full fetch complete (11874 records). [2025-10-06T22:33:29.343979] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-06T22:33:29.726203] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-06T22:33:29.727435] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-06T22:33:29.727606] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-06T22:33:29.728191] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-06T22:33:29.728272] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-06T22:33:29.755150] [DEBUG] [LOCAL ] ZKH: Trimmed 11874 records to 7634 (keeping 200 days of data) [2025-10-06T22:33:29.756912] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-06T22:33:29.814578] [DEBUG] [LOCAL ] ZKH: Primary data saved (7634 records). [2025-10-06T22:33:29.814788] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-06T22:33:29.814904] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZKH took 37.5s. Estimated remaining: 33.8s. Rate: 7.1 symbols/min [2025-10-06T22:33:29.990944] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-26 to 2025-10-06. [2025-10-06T22:33:30.030878] [DEBUG] [LOCAL ] ZWS: Loaded 42932 existing records from primary storage. [2025-10-06T22:33:30.031241] [INFO ] [MAIN ] ZWS: Loaded 42932 existing records. [2025-10-06T22:33:30.230663] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-17 for 200 day retention. Performing full refresh. [2025-10-06T22:33:30.230922] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-06T22:33:30.230972] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-06T22:33:30.231232] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-06T22:33:30.231326] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-06T22:33:30.530024] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-06T22:33:30.641445] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-17 to 2025-10-06 (requires 11 months of data pull). [2025-10-06T22:33:30.692499] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-06T22:33:31.322543] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-06T22:33:31.927915] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-06T22:33:32.122563] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-06T22:33:32.922512] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-06T22:33:33.149671] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-06T22:33:33.202526] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-06T22:33:33.722546] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-06T22:33:34.381134] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-06T22:33:34.522529] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-06T22:33:35.322514] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-06T22:33:35.605788] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-06T22:33:36.073927] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-06T22:33:36.122540] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-06T22:33:36.380282] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-06T22:33:36.922552] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-06T22:33:37.411311] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-06T22:33:37.722502] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-06T22:33:37.866984] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-06T22:33:38.522529] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-06T22:33:39.139341] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-06T22:33:39.278716] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-06T22:33:39.280544] [INFO ] [REMOTE ] ZTR: Full fetch complete (27075 records). [2025-10-06T22:33:39.280622] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-06T22:33:39.327697] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-06T22:33:39.679509] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-06T22:33:39.679609] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-06T22:33:39.680614] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-06T22:33:39.680701] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-06T22:33:39.681542] [DEBUG] [LOCAL ] ZTR: Trimmed 27075 records to 16726 (keeping 200 days of data) [2025-10-06T22:33:39.792473] [DEBUG] [LOCAL ] ZTR: Primary data saved (16726 records). [2025-10-06T22:33:39.792692] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-06T22:33:39.792827] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZTR took 29.3s. Estimated remaining: 25.4s. Rate: 7.1 symbols/min [2025-10-06T22:33:40.122596] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-06T22:33:40.922615] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-06T22:33:41.310822] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-06T22:33:41.453326] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-06T22:33:41.722548] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-06T22:33:41.914830] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-06T22:33:42.522566] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-06T22:33:43.228969] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-06T22:33:43.322634] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-06T22:33:44.122590] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-06T22:33:44.388719] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-06T22:33:44.446834] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-06T22:33:44.922617] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-06T22:33:45.527980] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-06T22:33:45.722547] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-06T22:33:46.522505] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-06T22:33:46.835712] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-06T22:33:47.305617] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-06T22:33:47.322502] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-06T22:33:48.122596] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-06T22:33:48.642830] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-06T22:33:48.922554] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-06T22:33:49.044271] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-06T22:33:49.559687] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-06T22:33:49.722565] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-06T22:33:50.522529] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-06T22:33:50.817058] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-06T22:33:51.295898] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-06T22:33:51.322475] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-06T22:33:52.066882] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-06T22:33:52.122539] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-06T22:33:52.572361] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-06T22:33:52.575121] [INFO ] [REMOTE ] ZWS: Full fetch complete (62052 records). [2025-10-06T22:33:52.575251] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-06T22:33:52.927709] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-06T22:33:52.972116] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-06T22:33:52.972203] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-06T22:33:52.973309] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-06T22:33:52.973375] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-06T22:33:52.974870] [DEBUG] [LOCAL ] ZWS: Trimmed 62052 records to 42305 (keeping 200 days of data) [2025-10-06T22:33:53.257585] [DEBUG] [LOCAL ] ZWS: Primary data saved (42305 records). [2025-10-06T22:33:53.257843] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-06T22:33:53.257965] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZWS took 23.4s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-06T22:33:53.568051] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-06T22:33:53.722710] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-06T22:33:54.957633] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-06T22:33:54.969669] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-06T22:33:55.165134] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-06T22:33:55.322547] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-06T22:33:55.420807] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-06T22:33:55.424130] [INFO ] [REMOTE ] ZTS: Full fetch complete (76718 records). [2025-10-06T22:33:55.424248] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-06T22:33:55.822577] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-06T22:33:55.822963] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-06T22:33:55.824196] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-06T22:33:55.824260] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-06T22:33:55.825809] [DEBUG] [LOCAL ] ZTS: Trimmed 76718 records to 53037 (keeping 200 days of data) [2025-10-06T22:33:56.161082] [DEBUG] [LOCAL ] ZTS: Primary data saved (53037 records). [2025-10-06T22:33:56.161208] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-06T22:33:56.161312] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZTS took 39.3s. Estimated remaining: 8.5s. Rate: 7.1 symbols/min [2025-10-06T22:33:56.260348] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-06T22:33:56.262869] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52709 records). [2025-10-06T22:33:56.262983] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-06T22:33:56.687905] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-06T22:33:56.688012] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-06T22:33:56.689176] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-06T22:33:56.689292] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-06T22:33:56.690751] [DEBUG] [LOCAL ] ZVIA: Trimmed 52709 records to 35380 (keeping 200 days of data) [2025-10-06T22:33:56.911384] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35380 records). [2025-10-06T22:33:56.911531] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-06T22:33:56.911631] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZVIA took 31.6s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-06T22:33:56.913171] [INFO ] [MAIN ] Parallel update completed in 5h 33m 53s [2025-10-06T22:33:56.913404] [WARN ] [MAIN ] Failed symbols (334): AAMI, AAM, AAUC, ABEV, ABM, ACA, AD, ACV, ADCT, AEG... [2025-10-06T22:33:56.913487] [INFO ] [MAIN ] Update success rate: 85.9% (2037/2371 symbols) [2025-10-06T22:33:57.628492] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2037/2371 @ 85.91%)' [2025-10-06T22:33:57.629026] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-06T22:33:57.629095] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-06T22:33:57.629131] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-06T22:33:57.629228] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-06T22:33:57.629263] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-06T22:33:59.204119] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-06T22:33:59.204236] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-06T22:33:59.204458] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-06T22:33:59.206912] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-06T22:33:59.207112] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-06T22:33:59.207160] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-06T22:33:59.207225] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-06T22:33:59.207260] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-06T22:33:59.207303] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-06T22:33:59.207717] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-06T22:33:59.207785] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-06T22:33:59.207987] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-06T22:33:59.208022] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-06T22:33:59.208104] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-06T22:33:59.208154] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-06T22:33:59.235241] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-06T22:33:59.261726] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-06T22:33:59.261953] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-06T22:33:59.261990] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-06T22:33:59.262019] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-06T22:33:59.262074] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-06T22:33:59.262107] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-06T22:33:59.262143] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-06T22:33:59.264429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-06T22:33:59.264709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-06T22:33:59.264918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-06T22:33:59.265110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-06T22:33:59.265315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-06T22:33:59.265546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-10-06T22:33:59.265779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-06T22:33:59.265969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-06T22:33:59.266222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-06T22:33:59.266404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-06T22:33:59.266609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-10-06T22:33:59.266812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-06T22:33:59.267025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-06T22:33:59.267176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-06T22:33:59.267378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-06T22:33:59.267606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-06T22:33:59.267823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-06T22:33:59.267956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-06T22:33:59.268158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-10-06T22:33:59.268367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-06T22:33:59.268507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-06T22:33:59.268725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-06T22:33:59.268937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-10-06T22:33:59.269076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-06T22:33:59.269268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-06T22:33:59.269457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-06T22:33:59.269628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-06T22:33:59.269789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-10-06T22:33:59.269946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-06T22:33:59.270093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-06T22:33:59.270330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-06T22:33:59.270527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-06T22:33:59.270734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-06T22:33:59.270890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-10-06T22:33:59.271040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-06T22:33:59.271192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-10-06T22:33:59.271335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-06T22:33:59.271561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-06T22:33:59.271727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-06T22:33:59.271872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-06T22:33:59.272071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-06T22:33:59.272258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-06T22:33:59.272418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-06T22:33:59.272548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-06T22:33:59.272720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-06T22:33:59.272901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-06T22:33:59.273149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-06T22:33:59.273357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-06T22:33:59.273540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-06T22:33:59.273708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-10-06T22:33:59.273885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-06T22:33:59.274051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-06T22:33:59.274227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-06T22:33:59.274369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-06T22:33:59.274537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-06T22:33:59.274691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-06T22:33:59.274874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-06T22:33:59.275007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-06T22:33:59.275197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-06T22:33:59.275358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-06T22:33:59.275520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-10-06T22:33:59.275741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-06T22:33:59.275910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-10-06T22:33:59.276100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-06T22:33:59.276321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-06T22:33:59.276471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-10-06T22:33:59.277525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-06T22:33:59.277695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-06T22:33:59.277874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-06T22:33:59.278022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-06T22:33:59.278157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-06T22:33:59.278347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-06T22:33:59.278480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-06T22:33:59.278704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-06T22:33:59.278889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-06T22:33:59.279033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-10-06T22:33:59.279218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-06T22:33:59.279357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-10-06T22:33:59.279489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-10-06T22:33:59.279623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-10-06T22:33:59.279857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-06T22:33:59.280075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-06T22:33:59.280228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-10-06T22:33:59.280413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-10-06T22:33:59.280548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-06T22:33:59.280708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-06T22:33:59.280830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-06T22:33:59.280962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-10-06T22:33:59.281075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-06T22:33:59.281225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-06T22:33:59.281412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-06T22:33:59.281564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-06T22:33:59.281737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-10-06T22:33:59.281906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-06T22:33:59.282057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-06T22:33:59.282231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-06T22:33:59.282376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-06T22:33:59.282580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-06T22:33:59.282711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-10-06T22:33:59.282901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-06T22:33:59.283139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-06T22:33:59.283358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-06T22:33:59.283525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-06T22:33:59.283723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-06T22:33:59.283863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-10-06T22:33:59.284033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-06T22:33:59.284188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-06T22:33:59.284340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-06T22:33:59.284489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-06T22:33:59.284691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-06T22:33:59.284901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-06T22:33:59.285071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-06T22:33:59.285199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-06T22:33:59.285325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-06T22:33:59.285454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-10-06T22:33:59.285597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-06T22:33:59.285847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-06T22:33:59.286086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-06T22:33:59.286289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-06T22:33:59.286403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-06T22:33:59.286565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-06T22:33:59.286766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-06T22:33:59.286917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-06T22:33:59.287103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-06T22:33:59.287229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-06T22:33:59.287367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-06T22:33:59.287534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-06T22:33:59.287905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-06T22:33:59.288040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-06T22:33:59.288167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-06T22:33:59.288306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-06T22:33:59.288468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-06T22:33:59.288590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-06T22:33:59.288847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-06T22:33:59.289006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-06T22:33:59.289138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-06T22:33:59.289246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-06T22:33:59.289380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-06T22:33:59.289504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-10-06T22:33:59.289668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-06T22:33:59.289819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-06T22:33:59.289972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-06T22:33:59.290121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-06T22:33:59.290259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-06T22:33:59.290372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-06T22:33:59.290529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-06T22:33:59.290700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-06T22:33:59.290840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-06T22:33:59.290946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-06T22:33:59.291090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-06T22:33:59.291267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-06T22:33:59.291395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-06T22:33:59.291556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-06T22:33:59.291724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-06T22:33:59.291898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-06T22:33:59.292015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-06T22:33:59.292165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-10-06T22:33:59.292278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-06T22:33:59.292427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-06T22:33:59.292520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-06T22:33:59.292658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-06T22:33:59.292759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-10-06T22:33:59.292943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-06T22:33:59.293083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-10-06T22:33:59.293211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-06T22:33:59.293353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-06T22:33:59.293485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-06T22:33:59.293601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-06T22:33:59.293722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-06T22:33:59.293851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-06T22:33:59.293982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-06T22:33:59.294097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-06T22:33:59.294266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-06T22:33:59.294424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-06T22:33:59.294613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-06T22:33:59.294850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-06T22:33:59.294990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-06T22:33:59.295112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-06T22:33:59.295268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-10-06T22:33:59.295408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-06T22:33:59.295569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-06T22:33:59.295969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-06T22:33:59.296133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-06T22:33:59.296260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-06T22:33:59.296385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-06T22:33:59.296543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-06T22:33:59.296678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-06T22:33:59.296815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-06T22:33:59.296930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-06T22:33:59.297024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-06T22:33:59.297135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-06T22:33:59.297265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-06T22:33:59.297383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-06T22:33:59.297503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-06T22:33:59.297639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-10-06T22:33:59.297821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-06T22:33:59.297952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-06T22:33:59.298093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-06T22:33:59.298247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-06T22:33:59.298443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-06T22:33:59.298612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-06T22:33:59.298795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-06T22:33:59.298928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-06T22:33:59.299034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-06T22:33:59.299125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-10-06T22:33:59.299241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-06T22:33:59.299369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-06T22:33:59.299473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-06T22:33:59.299607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-06T22:33:59.299729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-06T22:33:59.299865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-06T22:33:59.300023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-06T22:33:59.300151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-06T22:33:59.300264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-06T22:33:59.300382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-06T22:33:59.300523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-06T22:33:59.300725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-06T22:33:59.300903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-06T22:33:59.301017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-06T22:33:59.301156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-06T22:33:59.301250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-10-06T22:33:59.301388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-06T22:33:59.301517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-10-06T22:33:59.301674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-06T22:33:59.301784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-06T22:33:59.301924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-10-06T22:33:59.302044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-06T22:33:59.302155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-06T22:33:59.302283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-10-06T22:33:59.302436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-06T22:33:59.302565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-06T22:33:59.302713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-06T22:33:59.302870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-06T22:33:59.303069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-10-06T22:33:59.303177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-06T22:33:59.303324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-06T22:33:59.303447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-06T22:33:59.303538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-06T22:33:59.303633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-06T22:33:59.303794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-06T22:33:59.303914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-06T22:33:59.304056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-06T22:33:59.304184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-06T22:33:59.304362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-06T22:33:59.304484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-10-06T22:33:59.304620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-06T22:33:59.304794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-06T22:33:59.304982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-06T22:33:59.305095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-06T22:33:59.305208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-10-06T22:33:59.305323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-06T22:33:59.305457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-06T22:33:59.305618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-06T22:33:59.305768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-06T22:33:59.305910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-06T22:33:59.306036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-06T22:33:59.306132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-06T22:33:59.306240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-06T22:33:59.306362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-06T22:33:59.306517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-06T22:33:59.306734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-10-06T22:33:59.306854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-06T22:33:59.306984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-06T22:33:59.307119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-10-06T22:33:59.307312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-06T22:33:59.307478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-06T22:33:59.307608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-06T22:33:59.307747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-06T22:33:59.307861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-06T22:33:59.308008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-06T22:33:59.308150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-06T22:33:59.308318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-06T22:33:59.308456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-06T22:33:59.308573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-06T22:33:59.308729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-06T22:33:59.308826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-06T22:33:59.308922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-06T22:33:59.309030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-06T22:33:59.309127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-06T22:33:59.309218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-06T22:33:59.309391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-06T22:33:59.309529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-06T22:33:59.309673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-06T22:33:59.309810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-06T22:33:59.309940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-06T22:33:59.310074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-06T22:33:59.310206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-06T22:33:59.310316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-06T22:33:59.310439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-06T22:33:59.310569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-06T22:33:59.310707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-06T22:33:59.310815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-06T22:33:59.310954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-06T22:33:59.311065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-06T22:33:59.311198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-06T22:33:59.311318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-06T22:33:59.311438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-06T22:33:59.311560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-06T22:33:59.311930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-06T22:33:59.312074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-06T22:33:59.312207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-06T22:33:59.312361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-10-06T22:33:59.312501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-06T22:33:59.312627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-06T22:33:59.312785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-06T22:33:59.312890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-06T22:33:59.313028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-06T22:33:59.313139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-10-06T22:33:59.313271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-06T22:33:59.313370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-06T22:33:59.313484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-06T22:33:59.313671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-10-06T22:33:59.313767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-06T22:33:59.313871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-06T22:33:59.314015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-06T22:33:59.314177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-06T22:33:59.314288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-06T22:33:59.314457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-06T22:33:59.314581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-06T22:33:59.314735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-10-06T22:33:59.314850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-06T22:33:59.314982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-06T22:33:59.315102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-10-06T22:33:59.315211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-06T22:33:59.315370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-06T22:33:59.315498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-06T22:33:59.315626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-06T22:33:59.315789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-06T22:33:59.315907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-06T22:33:59.316061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-06T22:33:59.316195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-06T22:33:59.316313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-06T22:33:59.316438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-06T22:33:59.316548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-06T22:33:59.316890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-10-06T22:33:59.317008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-06T22:33:59.317138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-06T22:33:59.317298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-10-06T22:33:59.317526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-06T22:33:59.317665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-06T22:33:59.317781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-06T22:33:59.317916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-06T22:33:59.318039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-06T22:33:59.318130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-06T22:33:59.318230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-06T22:33:59.318375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-06T22:33:59.318487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-06T22:33:59.318603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-10-06T22:33:59.318733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-10-06T22:33:59.318854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-10-06T22:33:59.318998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-06T22:33:59.319153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-06T22:33:59.319301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-06T22:33:59.319408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-06T22:33:59.319539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-10-06T22:33:59.319687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-10-06T22:33:59.319802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-06T22:33:59.319944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-06T22:33:59.320087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-06T22:33:59.320234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-10-06T22:33:59.320327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-06T22:33:59.320409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-06T22:33:59.320543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-06T22:33:59.320668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-06T22:33:59.320793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-06T22:33:59.320935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-06T22:33:59.321041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-06T22:33:59.321162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-06T22:33:59.321255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-06T22:33:59.321371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-06T22:33:59.321489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-06T22:33:59.321582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-06T22:33:59.321781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-06T22:33:59.321878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-06T22:33:59.321999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-06T22:33:59.322134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-06T22:33:59.322276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-10-06T22:33:59.322387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-06T22:33:59.322506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-06T22:33:59.322600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-06T22:33:59.322726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-06T22:33:59.322830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-06T22:33:59.322968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-06T22:33:59.323075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-06T22:33:59.323180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-06T22:33:59.323335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-06T22:33:59.323453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-10-06T22:33:59.323583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-10-06T22:33:59.323798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-06T22:33:59.323938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-06T22:33:59.324131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-06T22:33:59.324233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-06T22:33:59.324323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-06T22:33:59.324447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-06T22:33:59.324714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-06T22:33:59.324864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-06T22:33:59.324974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-06T22:33:59.325086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-06T22:33:59.325220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-06T22:33:59.325335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-06T22:33:59.325443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-06T22:33:59.325585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-06T22:33:59.325745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-06T22:33:59.325877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-06T22:33:59.326006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-06T22:33:59.326126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-06T22:33:59.326269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-06T22:33:59.326406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-06T22:33:59.326564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-06T22:33:59.326691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-06T22:33:59.326849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-06T22:33:59.326970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-06T22:33:59.327101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-06T22:33:59.327239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-06T22:33:59.327355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-06T22:33:59.327486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-10-06T22:33:59.327601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-06T22:33:59.327749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-06T22:33:59.327867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-06T22:33:59.327977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-06T22:33:59.328130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-06T22:33:59.328224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-06T22:33:59.328345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-06T22:33:59.328474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-06T22:33:59.328613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-06T22:33:59.328775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-06T22:33:59.328910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-06T22:33:59.329024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-06T22:33:59.329129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-06T22:33:59.329237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-06T22:33:59.329353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-06T22:33:59.329460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-10-06T22:33:59.329596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-06T22:33:59.329801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-06T22:33:59.329912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-06T22:33:59.330058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-06T22:33:59.330183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-06T22:33:59.330313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-06T22:33:59.330434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-10-06T22:33:59.330565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-06T22:33:59.330699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-10-06T22:33:59.330813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-06T22:33:59.330902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-06T22:33:59.330989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-06T22:33:59.331118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-06T22:33:59.331231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-06T22:33:59.331332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-06T22:33:59.331439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-06T22:33:59.331575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-06T22:33:59.331705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-06T22:33:59.331827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-06T22:33:59.331961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-06T22:33:59.332054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-06T22:33:59.332158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-06T22:33:59.332278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-06T22:33:59.332382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-06T22:33:59.332537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-10-06T22:33:59.332632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-10-06T22:33:59.332836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-06T22:33:59.332950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-06T22:33:59.333043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-10-06T22:33:59.333136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-06T22:33:59.333239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-06T22:33:59.333347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-06T22:33:59.333504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-06T22:33:59.333628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-06T22:33:59.333762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-06T22:33:59.333895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-06T22:33:59.334001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-06T22:33:59.334091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-10-06T22:33:59.334186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-06T22:33:59.334313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-10-06T22:33:59.334473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-06T22:33:59.334595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-10-06T22:33:59.334818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-06T22:33:59.334940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-10-06T22:33:59.335047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-06T22:33:59.335139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-10-06T22:33:59.335256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-06T22:33:59.335349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-06T22:33:59.335431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-06T22:33:59.335535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-06T22:33:59.335706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-06T22:33:59.335844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-10-06T22:33:59.335987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-06T22:33:59.336102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-10-06T22:33:59.336207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-06T22:33:59.336365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-06T22:33:59.336505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-06T22:33:59.336625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-06T22:33:59.336764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-06T22:33:59.336868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-06T22:33:59.336972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-06T22:33:59.337112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-10-06T22:33:59.337207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-06T22:33:59.337335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-06T22:33:59.337427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-06T22:33:59.337512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-06T22:33:59.337619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-06T22:33:59.337753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-06T22:33:59.337832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-06T22:33:59.337929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-10-06T22:33:59.338022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-06T22:33:59.338091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-06T22:33:59.338180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-10-06T22:33:59.338293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-06T22:33:59.338436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-06T22:33:59.338529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-06T22:33:59.338611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-06T22:33:59.338766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-06T22:33:59.338871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-06T22:33:59.338961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-10-06T22:33:59.339046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-06T22:33:59.339149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-06T22:33:59.339265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-06T22:33:59.339378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-06T22:33:59.339468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-06T22:33:59.339550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-06T22:33:59.339677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-10-06T22:33:59.339817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-06T22:33:59.339914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-06T22:33:59.340032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-06T22:33:59.340131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-06T22:33:59.340244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-06T22:33:59.340378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-10-06T22:33:59.340487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-06T22:33:59.340606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-06T22:33:59.340771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-06T22:33:59.340912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-06T22:33:59.341046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-06T22:33:59.341184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-06T22:33:59.341301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-06T22:33:59.341407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-06T22:33:59.341497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-06T22:33:59.341582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-10-06T22:33:59.341726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-06T22:33:59.341908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-06T22:33:59.342042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-06T22:33:59.342152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-06T22:33:59.342245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-06T22:33:59.342315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-06T22:33:59.342394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-06T22:33:59.342550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-06T22:33:59.342905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-06T22:33:59.343019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-10-06T22:33:59.343111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-06T22:33:59.343186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-06T22:33:59.343256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-06T22:33:59.343340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-10-06T22:33:59.343473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-06T22:33:59.343583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-06T22:33:59.343773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-06T22:33:59.343874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-06T22:33:59.343989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-06T22:33:59.344111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-10-06T22:33:59.344206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-06T22:33:59.344291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-06T22:33:59.344387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-06T22:33:59.344468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-06T22:33:59.344619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-06T22:33:59.344812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-06T22:33:59.344933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-06T22:33:59.345045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-06T22:33:59.345140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-06T22:33:59.345250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-06T22:33:59.345360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-10-06T22:33:59.345459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-06T22:33:59.345532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-06T22:33:59.345603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-06T22:33:59.345728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-06T22:33:59.345824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-10-06T22:33:59.345894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-06T22:33:59.345974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-06T22:33:59.346086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-06T22:33:59.346192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-06T22:33:59.346323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-10-06T22:33:59.346417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-06T22:33:59.346487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-06T22:33:59.346563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-06T22:33:59.346729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-06T22:33:59.346885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-06T22:33:59.347011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-06T22:33:59.347114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-06T22:33:59.347188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-06T22:33:59.347270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-06T22:33:59.347362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-06T22:33:59.347430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-06T22:33:59.347517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-06T22:33:59.347609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-06T22:33:59.347734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-06T22:33:59.347862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-10-06T22:33:59.347960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-06T22:33:59.348058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-06T22:33:59.348163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-10-06T22:33:59.348258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-06T22:33:59.348362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-06T22:33:59.348484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-06T22:33:59.348592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-06T22:33:59.348778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-06T22:33:59.348896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-10-06T22:33:59.349063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-06T22:33:59.349177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-06T22:33:59.349303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-06T22:33:59.349401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-06T22:33:59.349473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-06T22:33:59.349579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-06T22:33:59.349711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-06T22:33:59.349822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-06T22:33:59.349911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-06T22:33:59.349997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-06T22:33:59.350116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-10-06T22:33:59.350211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-06T22:33:59.350279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-06T22:33:59.350357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-06T22:33:59.350447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-06T22:33:59.350540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-10-06T22:33:59.350639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-06T22:33:59.350884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-06T22:33:59.350983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-06T22:33:59.351055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-06T22:33:59.351142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-10-06T22:33:59.351252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-06T22:33:59.351357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-06T22:33:59.351450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-06T22:33:59.351536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-06T22:33:59.351673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-06T22:33:59.351782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-06T22:33:59.351899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-06T22:33:59.352034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-06T22:33:59.352127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-06T22:33:59.352212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-06T22:33:59.352308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-06T22:33:59.352399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-06T22:33:59.352503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-06T22:33:59.352626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-06T22:33:59.352768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-06T22:33:59.352925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-06T22:33:59.353073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-06T22:33:59.353168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-06T22:33:59.353312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-06T22:33:59.353424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-06T22:33:59.353532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-06T22:33:59.353633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-06T22:33:59.353777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-06T22:33:59.353904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-06T22:33:59.353998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-10-06T22:33:59.354088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-06T22:33:59.354180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-06T22:33:59.354287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-06T22:33:59.354378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-06T22:33:59.354461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-06T22:33:59.354612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-06T22:33:59.354774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-06T22:33:59.354867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-06T22:33:59.354935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-06T22:33:59.355069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-06T22:33:59.355196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-06T22:33:59.355319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-06T22:33:59.355480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-06T22:33:59.355587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-06T22:33:59.355703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-06T22:33:59.355792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-10-06T22:33:59.355895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-06T22:33:59.356035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-06T22:33:59.356126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-06T22:33:59.356193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-06T22:33:59.356298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-06T22:33:59.356393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-06T22:33:59.356508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-06T22:33:59.356707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-06T22:33:59.356832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-06T22:33:59.356975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-06T22:33:59.357116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-06T22:33:59.357264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-06T22:33:59.357505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-06T22:33:59.357628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-06T22:33:59.357986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-06T22:33:59.358119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-06T22:33:59.358233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-06T22:33:59.358360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-06T22:33:59.358475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-06T22:33:59.358733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-06T22:33:59.358860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-06T22:33:59.358982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-10-06T22:33:59.359109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-06T22:33:59.359221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-06T22:33:59.359387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-06T22:33:59.359522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-06T22:33:59.359639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-06T22:33:59.359804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-10-06T22:33:59.359917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-06T22:33:59.360011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-06T22:33:59.360136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-10-06T22:33:59.360246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-06T22:33:59.360372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-06T22:33:59.360492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-06T22:33:59.360605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-06T22:33:59.360804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-06T22:33:59.360939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-06T22:33:59.361072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-06T22:33:59.361197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-06T22:33:59.361322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-06T22:33:59.361445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-06T22:33:59.361597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-06T22:33:59.361731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-06T22:33:59.361878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-06T22:33:59.361999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-06T22:33:59.362114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-06T22:33:59.362240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-06T22:33:59.362368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-06T22:33:59.362501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-10-06T22:33:59.362633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-06T22:33:59.362797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-10-06T22:33:59.362906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-06T22:33:59.363026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-06T22:33:59.363142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-06T22:33:59.363269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-06T22:33:59.363393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-06T22:33:59.363502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-06T22:33:59.363635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-06T22:33:59.363789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-06T22:33:59.363914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-06T22:33:59.364058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-06T22:33:59.364231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-06T22:33:59.364374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-06T22:33:59.364508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-06T22:33:59.364679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-06T22:33:59.364812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-06T22:33:59.364923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-06T22:33:59.365061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-06T22:33:59.365221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-06T22:33:59.365330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-06T22:33:59.365515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-06T22:33:59.365620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-06T22:33:59.365952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-10-06T22:33:59.366104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-06T22:33:59.366251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-06T22:33:59.366393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-06T22:33:59.366529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-06T22:33:59.366714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-06T22:33:59.366868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-06T22:33:59.366996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-06T22:33:59.367102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-06T22:33:59.367240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-06T22:33:59.367388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-06T22:33:59.367507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-06T22:33:59.367631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-06T22:33:59.367798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-06T22:33:59.367935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-06T22:33:59.368077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-10-06T22:33:59.368201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-06T22:33:59.368362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-06T22:33:59.368508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-06T22:33:59.368627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-06T22:33:59.368798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-06T22:33:59.368928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-10-06T22:33:59.369087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-10-06T22:33:59.369210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-06T22:33:59.369413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-06T22:33:59.369546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-06T22:33:59.370035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-06T22:33:59.370162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-06T22:33:59.370284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-06T22:33:59.370413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-10-06T22:33:59.370528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-10-06T22:33:59.370716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-06T22:33:59.370837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-06T22:33:59.370948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-06T22:33:59.371056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-06T22:33:59.371164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-06T22:33:59.371293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-06T22:33:59.371400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-06T22:33:59.371540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-10-06T22:33:59.371695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-10-06T22:33:59.371821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-06T22:33:59.371929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-06T22:33:59.372059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-06T22:33:59.372179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-06T22:33:59.372300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-10-06T22:33:59.372419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-06T22:33:59.372528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-06T22:33:59.372674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-06T22:33:59.372811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-06T22:33:59.372932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-06T22:33:59.373072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-06T22:33:59.373194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-06T22:33:59.373322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-10-06T22:33:59.373472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-06T22:33:59.373613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-06T22:33:59.373786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-10-06T22:33:59.373918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-06T22:33:59.374027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-06T22:33:59.374155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-06T22:33:59.374284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-06T22:33:59.374395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-06T22:33:59.374502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-06T22:33:59.374620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-06T22:33:59.374778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-06T22:33:59.374899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-06T22:33:59.375013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-06T22:33:59.375134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-06T22:33:59.375251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-10-06T22:33:59.375398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-10-06T22:33:59.375542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-06T22:33:59.375691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-06T22:33:59.375820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-10-06T22:33:59.375994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-06T22:33:59.376128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-06T22:33:59.376272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-06T22:33:59.376402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-06T22:33:59.376514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-06T22:33:59.376723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-06T22:33:59.376846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-06T22:33:59.376967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-06T22:33:59.377136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-06T22:33:59.377275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-06T22:33:59.377425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-06T22:33:59.377568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-06T22:33:59.377899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-06T22:33:59.378065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-06T22:33:59.378201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-06T22:33:59.378379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-06T22:33:59.378564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-10-06T22:33:59.378694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-06T22:33:59.378845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-06T22:33:59.378947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-06T22:33:59.379077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-06T22:33:59.379278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-10-06T22:33:59.379403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-06T22:33:59.379554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-06T22:33:59.379701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-06T22:33:59.379829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-06T22:33:59.379939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-06T22:33:59.380071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-06T22:33:59.380191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-06T22:33:59.380303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-06T22:33:59.380427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-06T22:33:59.380561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-06T22:33:59.380722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-10-06T22:33:59.380844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-06T22:33:59.380964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-10-06T22:33:59.381075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-06T22:33:59.381192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-06T22:33:59.381306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-06T22:33:59.381414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-06T22:33:59.381569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-06T22:33:59.381737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-06T22:33:59.382012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-10-06T22:33:59.382152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-06T22:33:59.382282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-06T22:33:59.382402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-06T22:33:59.382519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-06T22:33:59.382668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-06T22:33:59.382783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-06T22:33:59.382891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-06T22:33:59.383013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-10-06T22:33:59.383133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-06T22:33:59.383266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-10-06T22:33:59.383375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-06T22:33:59.383491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-06T22:33:59.383618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-06T22:33:59.383787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-06T22:33:59.383937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-06T22:33:59.384062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-10-06T22:33:59.384208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-06T22:33:59.384344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-06T22:33:59.384474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-06T22:33:59.384590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-06T22:33:59.384824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-06T22:33:59.384934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-06T22:33:59.385083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-06T22:33:59.385207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-06T22:33:59.385331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-06T22:33:59.385439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-06T22:33:59.385596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-06T22:33:59.385795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-06T22:33:59.385928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-06T22:33:59.386039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-06T22:33:59.386180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-10-06T22:33:59.386322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-06T22:33:59.386463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-06T22:33:59.386584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-06T22:33:59.386759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-06T22:33:59.386888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-06T22:33:59.387000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-06T22:33:59.387134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-06T22:33:59.387256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-06T22:33:59.387379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-06T22:33:59.387500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-10-06T22:33:59.387612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-06T22:33:59.387769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-06T22:33:59.387891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-06T22:33:59.388002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-06T22:33:59.388120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-06T22:33:59.388233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-06T22:33:59.388382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-06T22:33:59.388511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-10-06T22:33:59.388634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-06T22:33:59.388779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-06T22:33:59.388916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-10-06T22:33:59.389051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-06T22:33:59.389195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-06T22:33:59.389320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-10-06T22:33:59.389450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-06T22:33:59.389633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-06T22:33:59.389913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-10-06T22:33:59.390037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-06T22:33:59.390195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-10-06T22:33:59.390317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-10-06T22:33:59.390426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-06T22:33:59.390543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-06T22:33:59.390695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-06T22:33:59.390818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-06T22:33:59.390937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-10-06T22:33:59.391058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-06T22:33:59.391191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-10-06T22:33:59.391342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-06T22:33:59.391452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-06T22:33:59.391544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-06T22:33:59.391766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-06T22:33:59.391880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-06T22:33:59.391987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-10-06T22:33:59.392103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-06T22:33:59.392224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-10-06T22:33:59.392343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-06T22:33:59.392449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-06T22:33:59.392568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-06T22:33:59.392783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-06T22:33:59.392896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-06T22:33:59.393023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-06T22:33:59.393152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-10-06T22:33:59.393267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-06T22:33:59.393394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-06T22:33:59.393520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-06T22:33:59.393674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-06T22:33:59.393799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-06T22:33:59.393928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-06T22:33:59.394058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-06T22:33:59.394169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-06T22:33:59.394336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-06T22:33:59.394465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-06T22:33:59.394586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-06T22:33:59.394791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-06T22:33:59.394932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-06T22:33:59.395036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-06T22:33:59.395150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-06T22:33:59.395281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-06T22:33:59.395425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-06T22:33:59.395535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-10-06T22:33:59.395674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-10-06T22:33:59.395781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-06T22:33:59.395894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-06T22:33:59.396013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-10-06T22:33:59.396169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-06T22:33:59.396281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-06T22:33:59.396404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-10-06T22:33:59.396535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-10-06T22:33:59.396706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-06T22:33:59.396821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-06T22:33:59.396987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-06T22:33:59.397097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-06T22:33:59.397219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-06T22:33:59.397328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-06T22:33:59.397455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-10-06T22:33:59.397575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-06T22:33:59.397838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-06T22:33:59.397959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-06T22:33:59.398083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-06T22:33:59.398199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-06T22:33:59.398335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-10-06T22:33:59.398464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-06T22:33:59.398588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-10-06T22:33:59.398744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-06T22:33:59.398853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-06T22:33:59.398981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-06T22:33:59.399114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-06T22:33:59.399254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-06T22:33:59.399394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-10-06T22:33:59.399525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-06T22:33:59.399639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-06T22:33:59.399784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-06T22:33:59.399894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-10-06T22:33:59.400011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-06T22:33:59.400130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-06T22:33:59.400239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-06T22:33:59.400391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-06T22:33:59.400502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-06T22:33:59.400590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-10-06T22:33:59.400779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-10-06T22:33:59.400901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-06T22:33:59.401011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-06T22:33:59.401141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-06T22:33:59.401279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-06T22:33:59.401392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-06T22:33:59.401534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-06T22:33:59.401687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-06T22:33:59.401800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-06T22:33:59.401932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-06T22:33:59.402085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-06T22:33:59.402206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-06T22:33:59.402317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-06T22:33:59.402437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-06T22:33:59.402558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-06T22:33:59.402694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-06T22:33:59.402824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-06T22:33:59.402947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-10-06T22:33:59.403098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-06T22:33:59.403208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-06T22:33:59.403335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-06T22:33:59.403440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-06T22:33:59.403561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-10-06T22:33:59.403702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-06T22:33:59.403816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-06T22:33:59.403924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-06T22:33:59.404043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-10-06T22:33:59.404179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-06T22:33:59.404302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-06T22:33:59.404421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-06T22:33:59.404579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-06T22:33:59.404773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-06T22:33:59.404893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-06T22:33:59.404999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-06T22:33:59.405120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-06T22:33:59.405253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-06T22:33:59.405453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-06T22:33:59.405690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-06T22:33:59.405827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-06T22:33:59.405938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-06T22:33:59.406059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-06T22:33:59.406184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-10-06T22:33:59.406293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-06T22:33:59.406399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-06T22:33:59.406511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-06T22:33:59.406675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-06T22:33:59.406799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-06T22:33:59.406950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-06T22:33:59.407061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-06T22:33:59.407186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-06T22:33:59.407293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-06T22:33:59.407413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-10-06T22:33:59.407544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-10-06T22:33:59.407687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-06T22:33:59.407807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-06T22:33:59.407929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-06T22:33:59.408063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-06T22:33:59.408172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-06T22:33:59.408290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-06T22:33:59.408462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-06T22:33:59.408583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-06T22:33:59.408738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-06T22:33:59.408857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-06T22:33:59.408963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-06T22:33:59.409082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-06T22:33:59.409188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-06T22:33:59.409338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-06T22:33:59.409445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-06T22:33:59.409594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-06T22:33:59.409749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-06T22:33:59.409875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-06T22:33:59.409995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-06T22:33:59.410113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-06T22:33:59.410224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-06T22:33:59.410344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-06T22:33:59.410467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-06T22:33:59.410589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-10-06T22:33:59.410871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-06T22:33:59.410997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-06T22:33:59.411120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-10-06T22:33:59.411260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-06T22:33:59.411379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-06T22:33:59.411491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-06T22:33:59.411625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-06T22:33:59.411758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-06T22:33:59.411879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-06T22:33:59.411978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-06T22:33:59.412070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-06T22:33:59.412201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-06T22:33:59.412306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-06T22:33:59.412416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-06T22:33:59.412524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-06T22:33:59.412681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-06T22:33:59.412816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-10-06T22:33:59.412928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-06T22:33:59.413051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-10-06T22:33:59.413183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-06T22:33:59.413294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-06T22:33:59.413434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-06T22:33:59.413554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-06T22:33:59.413731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-06T22:33:59.413866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-06T22:33:59.413987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-10-06T22:33:59.414101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-06T22:33:59.414210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-06T22:33:59.414332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-06T22:33:59.414475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-06T22:33:59.414687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-06T22:33:59.414882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-06T22:33:59.414993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-06T22:33:59.415108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-06T22:33:59.415242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-10-06T22:33:59.415355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-06T22:33:59.415473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-06T22:33:59.415584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-06T22:33:59.415972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-06T22:33:59.416133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-06T22:33:59.416243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-06T22:33:59.416367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-10-06T22:33:59.416506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-06T22:33:59.416668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-10-06T22:33:59.416785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-06T22:33:59.416911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-06T22:33:59.417081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-06T22:33:59.417219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-06T22:33:59.417378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-06T22:33:59.417475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-06T22:33:59.417613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-06T22:33:59.417762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-06T22:33:59.417869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-06T22:33:59.418001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-06T22:33:59.418112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-06T22:33:59.418235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-10-06T22:33:59.418382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-06T22:33:59.418493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-10-06T22:33:59.418618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-06T22:33:59.418764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-10-06T22:33:59.418895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-06T22:33:59.419000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-10-06T22:33:59.419219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-06T22:33:59.419363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-06T22:33:59.419476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-06T22:33:59.419596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-10-06T22:33:59.419753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-06T22:33:59.419957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-06T22:33:59.420126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-10-06T22:33:59.420246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-06T22:33:59.420368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-06T22:33:59.420462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-06T22:33:59.420558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-06T22:33:59.420700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-06T22:33:59.420820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-06T22:33:59.420930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-06T22:33:59.421049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-06T22:33:59.421173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-06T22:33:59.421311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-06T22:33:59.421424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-06T22:33:59.421568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-06T22:33:59.421701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-10-06T22:33:59.421825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-06T22:33:59.421945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-06T22:33:59.422066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-06T22:33:59.422174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-06T22:33:59.422284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-06T22:33:59.422405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-06T22:33:59.422515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-06T22:33:59.422633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-06T22:33:59.422779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-06T22:33:59.422912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-06T22:33:59.423032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-06T22:33:59.423161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-10-06T22:33:59.423284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-06T22:33:59.423399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-06T22:33:59.423492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-06T22:33:59.423602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-06T22:33:59.423768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-06T22:33:59.423944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-06T22:33:59.424065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-06T22:33:59.424229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-06T22:33:59.424359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-10-06T22:33:59.424467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-06T22:33:59.424590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-06T22:33:59.424726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-10-06T22:33:59.424864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-06T22:33:59.424977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-06T22:33:59.425110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-06T22:33:59.425220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-06T22:33:59.425339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-06T22:33:59.425454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-06T22:33:59.425575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-06T22:33:59.425737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-10-06T22:33:59.425845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-06T22:33:59.426004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-06T22:33:59.426147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-06T22:33:59.426293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-06T22:33:59.426431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-06T22:33:59.426531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-06T22:33:59.426710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-06T22:33:59.426847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-06T22:33:59.426983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-06T22:33:59.427113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-06T22:33:59.427247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-10-06T22:33:59.427376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-06T22:33:59.427511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-06T22:33:59.427850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-06T22:33:59.428003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-10-06T22:33:59.428129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-06T22:33:59.428244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-10-06T22:33:59.428400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-06T22:33:59.428520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-06T22:33:59.428635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-06T22:33:59.428789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-06T22:33:59.428914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-06T22:33:59.429055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-06T22:33:59.429176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-06T22:33:59.429301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-06T22:33:59.429431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-06T22:33:59.429570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-10-06T22:33:59.429710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-06T22:33:59.429834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-06T22:33:59.429956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-06T22:33:59.430113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-06T22:33:59.430332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-06T22:33:59.430453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-06T22:33:59.430583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-06T22:33:59.430781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-06T22:33:59.430922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-06T22:33:59.431034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-06T22:33:59.431187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-06T22:33:59.431298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-06T22:33:59.431444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-06T22:33:59.431585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-06T22:33:59.431746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-06T22:33:59.431856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-10-06T22:33:59.431983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-06T22:33:59.432094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-06T22:33:59.432211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-06T22:33:59.432355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-06T22:33:59.432467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-06T22:33:59.432577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-06T22:33:59.432725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-06T22:33:59.432849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-06T22:33:59.432990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-06T22:33:59.433118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-06T22:33:59.433242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-06T22:33:59.433375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-10-06T22:33:59.433497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-06T22:33:59.433619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-06T22:33:59.433762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-06T22:33:59.433942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-10-06T22:33:59.434065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-06T22:33:59.434204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-06T22:33:59.434327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-06T22:33:59.434451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-06T22:33:59.434575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-06T22:33:59.434720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-06T22:33:59.434845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-06T22:33:59.434957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-06T22:33:59.435079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-06T22:33:59.435271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-06T22:33:59.435406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-06T22:33:59.435552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-06T22:33:59.435973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-06T22:33:59.436105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-10-06T22:33:59.436257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-06T22:33:59.436368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-06T22:33:59.436483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-06T22:33:59.436621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-06T22:33:59.436769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-06T22:33:59.436904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-06T22:33:59.437027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-06T22:33:59.437159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-06T22:33:59.437272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-06T22:33:59.437430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-06T22:33:59.437553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-06T22:33:59.437755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-06T22:33:59.437899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-06T22:33:59.437994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-06T22:33:59.438064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-06T22:33:59.438171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-06T22:33:59.438290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-06T22:33:59.438429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-06T22:33:59.438541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-06T22:33:59.438671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-06T22:33:59.438783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-06T22:33:59.438901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-06T22:33:59.439011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-06T22:33:59.439121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-06T22:33:59.439243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-06T22:33:59.439339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-10-06T22:33:59.439448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-06T22:33:59.439558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-06T22:33:59.439792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-10-06T22:33:59.439911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-06T22:33:59.440020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-06T22:33:59.440141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-06T22:33:59.440248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-06T22:33:59.440358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-06T22:33:59.440553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-10-06T22:33:59.440698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-10-06T22:33:59.440807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-06T22:33:59.440949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-06T22:33:59.441108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-06T22:33:59.441218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-06T22:33:59.441359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-06T22:33:59.441476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-06T22:33:59.441620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-06T22:33:59.441761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-06T22:33:59.441877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-10-06T22:33:59.441988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-06T22:33:59.442108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-06T22:33:59.442257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-06T22:33:59.442377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-10-06T22:33:59.442498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-10-06T22:33:59.442620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-06T22:33:59.442769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-10-06T22:33:59.442892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-06T22:33:59.443001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-06T22:33:59.443110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-06T22:33:59.443230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-06T22:33:59.443370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-06T22:33:59.443501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-06T22:33:59.443635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-06T22:33:59.443772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-10-06T22:33:59.443898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-06T22:33:59.444030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-06T22:33:59.444150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-06T22:33:59.444348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-06T22:33:59.444459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-06T22:33:59.444568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-06T22:33:59.444718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-06T22:33:59.444864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-06T22:33:59.444976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-06T22:33:59.445089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-10-06T22:33:59.445218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-10-06T22:33:59.445359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-06T22:33:59.445508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-06T22:33:59.445708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-06T22:33:59.445823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-06T22:33:59.445951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-06T22:33:59.446083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-06T22:33:59.446210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-06T22:33:59.446320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-06T22:33:59.446434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-10-06T22:33:59.446553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-06T22:33:59.446715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-06T22:33:59.446845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-10-06T22:33:59.446959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-06T22:33:59.447078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-06T22:33:59.447204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-06T22:33:59.447337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-06T22:33:59.447446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-06T22:33:59.447557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-10-06T22:33:59.447876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-06T22:33:59.448018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-06T22:33:59.448140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-10-06T22:33:59.448263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-06T22:33:59.448384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-06T22:33:59.448506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-06T22:33:59.448660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-06T22:33:59.448796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-06T22:33:59.448931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-06T22:33:59.449060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-06T22:33:59.449193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-06T22:33:59.449303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-06T22:33:59.449428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-06T22:33:59.449548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-06T22:33:59.449674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-06T22:33:59.449796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-06T22:33:59.449920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-06T22:33:59.450028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-06T22:33:59.450202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-10-06T22:33:59.450415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-06T22:33:59.450514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-06T22:33:59.450637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-06T22:33:59.450771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-06T22:33:59.450844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-06T22:33:59.450942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-06T22:33:59.451064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-06T22:33:59.451205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-06T22:33:59.451321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-10-06T22:33:59.451446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-06T22:33:59.451584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-06T22:33:59.451739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-06T22:33:59.451875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-06T22:33:59.451999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-10-06T22:33:59.452181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-06T22:33:59.452381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-10-06T22:33:59.452508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-06T22:33:59.452629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-06T22:33:59.452771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-06T22:33:59.452949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-06T22:33:59.453067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-10-06T22:33:59.453243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-06T22:33:59.453391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-10-06T22:33:59.453518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-10-06T22:33:59.453703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-06T22:33:59.453824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-06T22:33:59.453948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-06T22:33:59.454070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-06T22:33:59.454184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-06T22:33:59.454307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-06T22:33:59.454454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-10-06T22:33:59.454561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-06T22:33:59.454708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-06T22:33:59.454851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-06T22:33:59.454955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-06T22:33:59.455053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-06T22:33:59.455176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-06T22:33:59.455324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-06T22:33:59.455433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-06T22:33:59.455577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-06T22:33:59.455931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-06T22:33:59.456057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-06T22:33:59.456177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-06T22:33:59.456295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-06T22:33:59.456405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-10-06T22:33:59.456530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-10-06T22:33:59.456676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-06T22:33:59.456788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-10-06T22:33:59.456911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-06T22:33:59.457019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-06T22:33:59.457138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-06T22:33:59.457244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-06T22:33:59.457375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-06T22:33:59.457499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-06T22:33:59.457608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-06T22:33:59.457764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-10-06T22:33:59.457872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-10-06T22:33:59.458033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-06T22:33:59.458157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-06T22:33:59.458293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-06T22:33:59.458417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-06T22:33:59.458539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-06T22:33:59.458720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-06T22:33:59.458832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-06T22:33:59.458940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-06T22:33:59.459043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-06T22:33:59.459163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-10-06T22:33:59.459271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-06T22:33:59.459363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-06T22:33:59.459472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-06T22:33:59.459620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-06T22:33:59.459779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-06T22:33:59.459886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-06T22:33:59.460016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-06T22:33:59.460136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-06T22:33:59.460247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-06T22:33:59.460370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-06T22:33:59.460501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-06T22:33:59.460639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-10-06T22:33:59.460784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-06T22:33:59.460908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-06T22:33:59.461030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-06T22:33:59.461150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-06T22:33:59.461260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-06T22:33:59.461377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-06T22:33:59.461488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-06T22:33:59.461618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-06T22:33:59.461759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-06T22:33:59.461868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-06T22:33:59.461999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-06T22:33:59.462143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-06T22:33:59.462252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-10-06T22:33:59.462388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-06T22:33:59.462517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-10-06T22:33:59.462625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-06T22:33:59.462818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-06T22:33:59.462944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-06T22:33:59.463068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-06T22:33:59.463178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-06T22:33:59.463287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-06T22:33:59.463407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-06T22:33:59.463526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-06T22:33:59.463788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-06T22:33:59.463974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-06T22:33:59.464102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-10-06T22:33:59.464229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-06T22:33:59.464352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-10-06T22:33:59.464468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-06T22:33:59.464605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-10-06T22:33:59.464764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-06T22:33:59.464888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-06T22:33:59.465012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-06T22:33:59.465134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-06T22:33:59.465254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-06T22:33:59.465380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-06T22:33:59.465526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-06T22:33:59.465692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-06T22:33:59.465849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-06T22:33:59.465967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-06T22:33:59.466087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-06T22:33:59.466196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-06T22:33:59.466320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-06T22:33:59.466438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-06T22:33:59.466557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-06T22:33:59.466690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-06T22:33:59.466824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-06T22:33:59.466938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-06T22:33:59.467047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-06T22:33:59.467128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-10-06T22:33:59.467242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-06T22:33:59.467345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-06T22:33:59.467456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-06T22:33:59.467564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-10-06T22:33:59.467844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-06T22:33:59.467970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-10-06T22:33:59.468096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-06T22:33:59.468210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-06T22:33:59.468380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-06T22:33:59.468496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-06T22:33:59.468666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-06T22:33:59.468788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-06T22:33:59.468909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-06T22:33:59.469016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-06T22:33:59.469154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-10-06T22:33:59.469273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-06T22:33:59.469383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-06T22:33:59.469502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-06T22:33:59.469592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-06T22:33:59.469725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-10-06T22:33:59.469850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-06T22:33:59.470002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-06T22:33:59.470111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-06T22:33:59.470219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-06T22:33:59.470366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-06T22:33:59.470481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-06T22:33:59.470618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-06T22:33:59.470772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-06T22:33:59.470891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-06T22:33:59.470999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-06T22:33:59.471121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-10-06T22:33:59.471266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-10-06T22:33:59.471421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-06T22:33:59.471546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-06T22:33:59.471709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-10-06T22:33:59.471842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-06T22:33:59.471952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-10-06T22:33:59.472081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-06T22:33:59.472205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-06T22:33:59.472337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-06T22:33:59.472482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-10-06T22:33:59.472602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-06T22:33:59.472737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-06T22:33:59.472859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-06T22:33:59.472970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-10-06T22:33:59.473076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-06T22:33:59.473206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-06T22:33:59.473320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-06T22:33:59.473424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-06T22:33:59.473551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-06T22:33:59.473701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-06T22:33:59.473824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-06T22:33:59.473944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-06T22:33:59.474053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-06T22:33:59.474145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-06T22:33:59.474255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-06T22:33:59.474373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-06T22:33:59.474479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-06T22:33:59.474610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-06T22:33:59.474781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-10-06T22:33:59.474873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-06T22:33:59.475001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-10-06T22:33:59.475129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-06T22:33:59.475252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-06T22:33:59.475387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-06T22:33:59.475510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-06T22:33:59.475800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-10-06T22:33:59.475936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-10-06T22:33:59.476045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-06T22:33:59.476163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-06T22:33:59.476291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-06T22:33:59.476409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-10-06T22:33:59.476530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-06T22:33:59.476638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-06T22:33:59.476777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-10-06T22:33:59.476896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-06T22:33:59.477003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-06T22:33:59.477123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-10-06T22:33:59.477230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-06T22:33:59.477353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-06T22:33:59.477543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-06T22:33:59.477636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-06T22:33:59.477769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-06T22:33:59.477888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-06T22:33:59.477994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-06T22:33:59.478128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-06T22:33:59.478243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-06T22:33:59.478423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-06T22:33:59.478535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-06T22:33:59.478683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-06T22:33:59.478876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-06T22:33:59.478982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-06T22:33:59.479091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-06T22:33:59.479216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-06T22:33:59.479327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-06T22:33:59.479447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-06T22:33:59.479560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-06T22:33:59.479724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-06T22:33:59.479845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-06T22:33:59.479956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-10-06T22:33:59.480078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-06T22:33:59.480189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-10-06T22:33:59.480335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-06T22:33:59.480486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-06T22:33:59.480612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-06T22:33:59.480755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-06T22:33:59.480927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-06T22:33:59.481058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-06T22:33:59.481183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-10-06T22:33:59.481293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-06T22:33:59.481414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-06T22:33:59.481537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-10-06T22:33:59.481693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-10-06T22:33:59.481805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-06T22:33:59.481939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-06T22:33:59.482052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-06T22:33:59.482191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-06T22:33:59.482311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-06T22:33:59.482422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-06T22:33:59.482559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-06T22:33:59.482703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-06T22:33:59.482824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-06T22:33:59.482935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-06T22:33:59.483041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-06T22:33:59.483151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-06T22:33:59.483273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-06T22:33:59.483393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-06T22:33:59.483525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-06T22:33:59.483769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-06T22:33:59.483885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-06T22:33:59.484008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-06T22:33:59.484128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-06T22:33:59.484250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-06T22:33:59.484369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-06T22:33:59.484482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-06T22:33:59.484601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-06T22:33:59.484732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-06T22:33:59.484847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-06T22:33:59.484955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-06T22:33:59.485064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-10-06T22:33:59.485197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-10-06T22:33:59.485316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-06T22:33:59.485434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-06T22:33:59.485555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-06T22:33:59.485697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-06T22:33:59.485790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-06T22:33:59.485882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-06T22:33:59.486008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-06T22:33:59.486133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-06T22:33:59.486269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-06T22:33:59.486378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-06T22:33:59.486496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-06T22:33:59.486604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-06T22:33:59.486755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-06T22:33:59.486882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-06T22:33:59.487004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-06T22:33:59.487121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-10-06T22:33:59.487243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-06T22:33:59.487359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-06T22:33:59.487481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-06T22:33:59.487678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-06T22:33:59.487792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-06T22:33:59.487917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-06T22:33:59.488028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-06T22:33:59.488150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-06T22:33:59.488296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-06T22:33:59.488424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-06T22:33:59.488551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-10-06T22:33:59.488731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-06T22:33:59.488853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-06T22:33:59.488966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-06T22:33:59.489085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-06T22:33:59.489204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-06T22:33:59.489326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-06T22:33:59.489475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-06T22:33:59.489585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-06T22:33:59.489771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-06T22:33:59.489901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-10-06T22:33:59.490022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-06T22:33:59.490179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-06T22:33:59.490315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-06T22:33:59.490438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-06T22:33:59.490555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-10-06T22:33:59.490731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-06T22:33:59.490841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-06T22:33:59.490981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-06T22:33:59.491114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-06T22:33:59.491237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-10-06T22:33:59.491358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-06T22:33:59.491480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-10-06T22:33:59.491603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-06T22:33:59.491898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-06T22:33:59.492020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-06T22:33:59.492145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-06T22:33:59.492281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-06T22:33:59.492391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-10-06T22:33:59.492511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-06T22:33:59.492691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-06T22:33:59.492823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-06T22:33:59.492931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-06T22:33:59.493048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-10-06T22:33:59.493165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-10-06T22:33:59.493271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-06T22:33:59.493411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-06T22:33:59.493519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-06T22:33:59.493673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-06T22:33:59.493807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-06T22:33:59.493934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-06T22:33:59.494058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-06T22:33:59.494185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-06T22:33:59.494302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-06T22:33:59.494428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-06T22:33:59.494552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-06T22:33:59.494710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-06T22:33:59.494818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-06T22:33:59.494938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-06T22:33:59.495049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-10-06T22:33:59.495175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-06T22:33:59.495306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-10-06T22:33:59.495430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-06T22:33:59.495550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-10-06T22:33:59.495834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-06T22:33:59.495959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-06T22:33:59.496078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-06T22:33:59.496203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-10-06T22:33:59.496329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-06T22:33:59.496453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-10-06T22:33:59.496574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-06T22:33:59.496779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-10-06T22:33:59.496958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-06T22:33:59.497115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-06T22:33:59.497228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-06T22:33:59.497358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-06T22:33:59.497479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-06T22:33:59.497601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-06T22:33:59.497753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-06T22:33:59.497909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-10-06T22:33:59.498031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-06T22:33:59.498154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-06T22:33:59.498283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-06T22:33:59.498422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-06T22:33:59.498502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-06T22:33:59.498611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-06T22:33:59.498802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-06T22:33:59.498928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-10-06T22:33:59.499071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-06T22:33:59.499194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-06T22:33:59.499318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-06T22:33:59.499425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-06T22:33:59.499563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-06T22:33:59.499728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-10-06T22:33:59.499849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-06T22:33:59.499974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-06T22:33:59.500145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-06T22:33:59.500270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-06T22:33:59.500426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-06T22:33:59.500553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-06T22:33:59.500693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-06T22:33:59.500815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-10-06T22:33:59.500944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-06T22:33:59.501066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-06T22:33:59.501192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-10-06T22:33:59.501320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-06T22:33:59.501490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-10-06T22:33:59.501611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-06T22:33:59.501762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-06T22:33:59.501893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-06T22:33:59.502005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-06T22:33:59.502152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-06T22:33:59.502263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-06T22:33:59.502427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-06T22:33:59.502548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-06T22:33:59.502723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-06T22:33:59.502849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-06T22:33:59.502959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-06T22:33:59.503084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-06T22:33:59.503192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-06T22:33:59.503311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-10-06T22:33:59.503418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-06T22:33:59.503546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-10-06T22:33:59.503830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-06T22:33:59.503947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-06T22:33:59.504066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-10-06T22:33:59.504175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-06T22:33:59.504300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-06T22:33:59.504408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-06T22:33:59.504531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-10-06T22:33:59.504673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-06T22:33:59.504821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-06T22:33:59.504938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-06T22:33:59.505056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-10-06T22:33:59.505178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-06T22:33:59.505286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-06T22:33:59.505434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-10-06T22:33:59.505606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-06T22:33:59.505743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-06T22:33:59.505859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-06T22:33:59.505968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-10-06T22:33:59.506087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-06T22:33:59.506196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-06T22:33:59.506284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-06T22:33:59.506404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-10-06T22:33:59.506547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-10-06T22:33:59.506693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-06T22:33:59.506820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-10-06T22:33:59.506928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-06T22:33:59.507036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-06T22:33:59.507142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-06T22:33:59.507281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-06T22:33:59.507405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-06T22:33:59.507533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-06T22:33:59.507683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-06T22:33:59.507796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-06T22:33:59.507915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-06T22:33:59.508035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-06T22:33:59.508141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-06T22:33:59.508304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-06T22:33:59.508437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-06T22:33:59.508559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-06T22:33:59.508717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-06T22:33:59.508838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-06T22:33:59.508959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-06T22:33:59.509065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-06T22:33:59.509182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-06T22:33:59.509306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-06T22:33:59.509432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-06T22:33:59.509544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-10-06T22:33:59.509718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-06T22:33:59.509830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-10-06T22:33:59.509979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-10-06T22:33:59.510102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-06T22:33:59.510253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-10-06T22:33:59.510379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-06T22:33:59.510490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-10-06T22:33:59.510615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-06T22:33:59.510782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-06T22:33:59.510890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-06T22:33:59.511000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-06T22:33:59.511134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-10-06T22:33:59.511282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-06T22:33:59.511922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-10-06T22:33:59.512157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-06T22:33:59.512244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-06T22:33:59.512321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-06T22:33:59.512394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-10-06T22:33:59.512477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-06T22:33:59.512605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-06T22:33:59.512770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-06T22:33:59.512911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-10-06T22:33:59.513047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-06T22:33:59.513210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-06T22:33:59.513338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-06T22:33:59.513456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-06T22:33:59.513533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-06T22:33:59.513622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-10-06T22:33:59.513749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-06T22:33:59.513829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-06T22:33:59.513901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-06T22:33:59.513986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-06T22:33:59.514086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-10-06T22:33:59.514156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-06T22:33:59.514229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-06T22:33:59.514329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-06T22:33:59.514421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-06T22:33:59.514494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-10-06T22:33:59.514562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-06T22:33:59.514629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-06T22:33:59.514752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-06T22:33:59.514834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-06T22:33:59.514901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-06T22:33:59.515012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-06T22:33:59.515099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-06T22:33:59.515168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-06T22:33:59.515237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-06T22:33:59.515309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-06T22:33:59.515378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-10-06T22:33:59.515444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-06T22:33:59.515509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-06T22:33:59.515634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-06T22:33:59.515774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-06T22:33:59.515884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-10-06T22:33:59.515975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-06T22:33:59.516055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-06T22:33:59.516150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-06T22:33:59.516220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-06T22:33:59.516308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-06T22:33:59.516401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-06T22:33:59.516575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-06T22:33:59.516703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-06T22:33:59.516799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-06T22:33:59.516871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-06T22:33:59.516938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-06T22:33:59.517016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-06T22:33:59.517099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-06T22:33:59.517173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-06T22:33:59.517269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-06T22:33:59.517364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-06T22:33:59.517433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-06T22:33:59.517527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-06T22:33:59.517624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-06T22:33:59.517742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-10-06T22:33:59.517839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-10-06T22:33:59.517929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-06T22:33:59.517999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-06T22:33:59.518067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-06T22:33:59.518132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-06T22:33:59.518198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-06T22:33:59.518263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-10-06T22:33:59.518385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-06T22:33:59.518474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-06T22:33:59.518562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-06T22:33:59.518680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-06T22:33:59.518773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-10-06T22:33:59.518841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-10-06T22:33:59.518903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-10-06T22:33:59.518967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-10-06T22:33:59.519083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-06T22:33:59.519161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-06T22:33:59.519226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-10-06T22:33:59.519291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-06T22:33:59.519356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-06T22:33:59.519420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-10-06T22:33:59.519482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-10-06T22:33:59.519558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-06T22:33:59.519885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-06T22:33:59.519981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-06T22:33:59.520047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-06T22:33:59.520130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-06T22:33:59.520218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-06T22:33:59.520283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-06T22:33:59.520347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-06T22:33:59.520410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-06T22:33:59.520498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-06T22:33:59.520608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-06T22:33:59.520733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-06T22:33:59.520831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-06T22:33:59.520921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-10-06T22:33:59.520988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-06T22:33:59.521051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-06T22:33:59.521114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-06T22:33:59.521186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-10-06T22:33:59.521279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-06T22:33:59.521366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-06T22:33:59.521454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-06T22:33:59.521537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-10-06T22:33:59.521626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-06T22:33:59.521756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-06T22:33:59.521839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-06T22:33:59.522009] [INFO ] [LOCAL ] Deleted 1937 derivative data files. [2025-10-06T22:33:59.522042] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-06T22:33:59.524175] [INFO ] [LOCAL ] Found 2037 symbols with primary data. [2025-10-06T22:33:59.524704] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2037 symbols [2025-10-06T22:33:59.526138] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:33:59.527107] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:33:59.527484] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:33:59.612272] [DEBUG] [LOCAL ] AA: Loaded 53616 existing records from primary storage. [2025-10-06T22:33:59.612501] [INFO ] [MAIN ] AA: Loaded 53616 primary data records. [2025-10-06T22:33:59.776523] [DEBUG] [LOCAL ] A: Loaded 50749 existing records from primary storage. [2025-10-06T22:33:59.770535] [DEBUG] [LOCAL ] AAP: Loaded 51911 existing records from primary storage. [2025-10-06T22:33:59.796518] [INFO ] [MAIN ] A: Loaded 50749 primary data records. [2025-10-06T22:33:59.806153] [INFO ] [MAIN ] AAP: Loaded 51911 primary data records. [2025-10-06T22:34:00.718091] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:00.719379] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53616 primary records. [2025-10-06T22:34:00.721293] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-06T22:34:00.756456] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:00.758141] [INFO ] [MAIN ] A: Generated 1794 derivative records from 50749 primary records. [2025-10-06T22:34:00.758370] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-06T22:34:00.758477] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-10-06T22:34:00.759713] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-06T22:34:00.772961] [INFO ] [MAIN ] Derivative Progress: 1/2037 symbols completed. AA took 1.2s. Estimated remaining: 42m 22s. Rate: 48.1 symbols/min [2025-10-06T22:34:00.791269] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:00.792389] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:00.794391] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 51911 primary records. [2025-10-06T22:34:00.794603] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-06T22:34:00.808906] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-10-06T22:34:00.812700] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-06T22:34:00.816299] [INFO ] [MAIN ] Derivative Progress: 2/2037 symbols completed. A took 1.3s. Estimated remaining: 21m 55s. Rate: 92.9 symbols/min [2025-10-06T22:34:00.817091] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:00.817619] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-10-06T22:34:00.818115] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-06T22:34:00.820588] [INFO ] [MAIN ] Derivative Progress: 3/2037 symbols completed. AAP took 1.3s. Estimated remaining: 14m 39s. Rate: 138.9 symbols/min [2025-10-06T22:34:00.820927] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:00.855079] [DEBUG] [LOCAL ] AAT: Loaded 30297 existing records from primary storage. [2025-10-06T22:34:00.855354] [INFO ] [MAIN ] AAT: Loaded 30297 primary data records. [2025-10-06T22:34:00.943185] [DEBUG] [LOCAL ] AB: Loaded 26855 existing records from primary storage. [2025-10-06T22:34:00.958468] [INFO ] [MAIN ] AB: Loaded 26855 primary data records. [2025-10-06T22:34:01.226610] [DEBUG] [LOCAL ] ABBV: Loaded 53685 existing records from primary storage. [2025-10-06T22:34:01.233007] [INFO ] [MAIN ] ABBV: Loaded 53685 primary data records. [2025-10-06T22:34:01.976330] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:01.978008] [INFO ] [MAIN ] AAT: Generated 1794 derivative records from 30297 primary records. [2025-10-06T22:34:01.978117] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-06T22:34:02.012877] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:02.014909] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 26855 primary records. [2025-10-06T22:34:02.015252] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-06T22:34:02.018744] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-10-06T22:34:02.019121] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-06T22:34:02.029328] [INFO ] [MAIN ] Derivative Progress: 4/2037 symbols completed. AAT took 1.2s. Estimated remaining: 21m 13s. Rate: 95.8 symbols/min [2025-10-06T22:34:02.038634] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:02.038413] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-10-06T22:34:02.039370] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-06T22:34:02.043670] [INFO ] [MAIN ] Derivative Progress: 5/2037 symbols completed. AB took 1.2s. Estimated remaining: 17m 4s. Rate: 119.1 symbols/min [2025-10-06T22:34:02.043950] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:02.062282] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:02.063180] [INFO ] [MAIN ] ABBV: Generated 1794 derivative records from 53685 primary records. [2025-10-06T22:34:02.063292] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-10-06T22:34:02.101229] [DEBUG] [LOCAL ] ABG: Loaded 18626 existing records from primary storage. [2025-10-06T22:34:02.102298] [INFO ] [MAIN ] ABG: Loaded 18626 primary data records. [2025-10-06T22:34:02.137208] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1794 records). [2025-10-06T22:34:02.164048] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-10-06T22:34:02.175793] [INFO ] [MAIN ] Derivative Progress: 6/2037 symbols completed. ABBV took 1.4s. Estimated remaining: 14m 58s. Rate: 135.8 symbols/min [2025-10-06T22:34:02.198592] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:02.231431] [DEBUG] [LOCAL ] ABCB: Loaded 30452 existing records from primary storage. [2025-10-06T22:34:02.237703] [INFO ] [MAIN ] ABCB: Loaded 30452 primary data records. [2025-10-06T22:34:02.834342] [DEBUG] [LOCAL ] ABR: Loaded 52007 existing records from primary storage. [2025-10-06T22:34:02.847047] [INFO ] [MAIN ] ABR: Loaded 52007 primary data records. [2025-10-06T22:34:02.847592] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:02.848576] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 18626 primary records. [2025-10-06T22:34:02.860736] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-06T22:34:02.975032] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-10-06T22:34:02.975908] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-06T22:34:02.978119] [INFO ] [MAIN ] Derivative Progress: 7/2037 symbols completed. ABG took 0.9s. Estimated remaining: 16m 42s. Rate: 121.6 symbols/min [2025-10-06T22:34:02.978676] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:03.196604] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:03.198411] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30452 primary records. [2025-10-06T22:34:03.198555] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-06T22:34:03.218430] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-10-06T22:34:03.219214] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-06T22:34:03.221607] [INFO ] [MAIN ] Derivative Progress: 8/2037 symbols completed. ABCB took 1.2s. Estimated remaining: 15m 38s. Rate: 129.8 symbols/min [2025-10-06T22:34:03.221856] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:03.259122] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:03.261161] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 52007 primary records. [2025-10-06T22:34:03.275312] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-06T22:34:03.297101] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-10-06T22:34:03.301410] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-10-06T22:34:03.301679] [INFO ] [MAIN ] ABT: Loaded 53620 primary data records. [2025-10-06T22:34:03.301948] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-06T22:34:03.315770] [INFO ] [MAIN ] Derivative Progress: 9/2037 symbols completed. ABR took 1.1s. Estimated remaining: 14m 14s. Rate: 142.4 symbols/min [2025-10-06T22:34:03.340780] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:03.419550] [DEBUG] [LOCAL ] ACCO: Loaded 37176 existing records from primary storage. [2025-10-06T22:34:03.425346] [INFO ] [MAIN ] ACCO: Loaded 37176 primary data records. [2025-10-06T22:34:03.781794] [DEBUG] [LOCAL ] ACEL: Loaded 26688 existing records from primary storage. [2025-10-06T22:34:03.803473] [INFO ] [MAIN ] ACEL: Loaded 26688 primary data records. [2025-10-06T22:34:04.295287] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:34:04.296448] [INFO ] [MAIN ] ABT: Generated 1793 derivative records from 53620 primary records. [2025-10-06T22:34:04.296740] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-06T22:34:04.326346] [DEBUG] [LOCAL ] ABT: Derivative data saved (1793 records). [2025-10-06T22:34:04.339137] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-06T22:34:04.339453] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:04.341763] [INFO ] [MAIN ] Derivative Progress: 10/2037 symbols completed. ABT took 1.4s. Estimated remaining: 16m 17s. Rate: 124.5 symbols/min [2025-10-06T22:34:04.342116] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:04.343395] [INFO ] [MAIN ] ACCO: Generated 1794 derivative records from 37176 primary records. [2025-10-06T22:34:04.343562] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-06T22:34:04.363891] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1794 records). [2025-10-06T22:34:04.364204] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-06T22:34:04.366511] [INFO ] [MAIN ] Derivative Progress: 11/2037 symbols completed. ACCO took 1.1s. Estimated remaining: 14m 52s. Rate: 136.3 symbols/min [2025-10-06T22:34:04.366845] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:04.380787] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:04.381792] [INFO ] [MAIN ] ACEL: Generated 1794 derivative records from 26688 primary records. [2025-10-06T22:34:04.381865] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-06T22:34:04.417269] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1794 records). [2025-10-06T22:34:04.417522] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-06T22:34:04.419948] [INFO ] [MAIN ] Derivative Progress: 12/2037 symbols completed. ACEL took 1.1s. Estimated remaining: 13m 46s. Rate: 147.1 symbols/min [2025-10-06T22:34:04.420194] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:04.462179] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-06T22:34:04.472352] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-10-06T22:34:04.531921] [DEBUG] [LOCAL ] ACI: Loaded 53254 existing records from primary storage. [2025-10-06T22:34:04.575271] [INFO ] [MAIN ] ACI: Loaded 53254 primary data records. [2025-10-06T22:34:04.721991] [DEBUG] [LOCAL ] ACM: Loaded 43034 existing records from primary storage. [2025-10-06T22:34:04.759130] [INFO ] [MAIN ] ACM: Loaded 43034 primary data records. [2025-10-06T22:34:05.582038] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:05.583632] [INFO ] [MAIN ] ACHR: Generated 1794 derivative records from 53818 primary records. [2025-10-06T22:34:05.585902] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-06T22:34:05.626525] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:05.629066] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53254 primary records. [2025-10-06T22:34:05.630025] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-10-06T22:34:05.631392] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-06T22:34:05.631304] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-06T22:34:05.633762] [INFO ] [MAIN ] Derivative Progress: 13/2037 symbols completed. ACHR took 1.3s. Estimated remaining: 15m 51s. Rate: 127.7 symbols/min [2025-10-06T22:34:05.668104] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:05.669181] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-10-06T22:34:05.670109] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 43034 primary records. [2025-10-06T22:34:05.670233] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-06T22:34:05.672485] [INFO ] [MAIN ] Derivative Progress: 14/2037 symbols completed. ACI took 1.3s. Estimated remaining: 14m 48s. Rate: 136.6 symbols/min [2025-10-06T22:34:05.670321] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-06T22:34:05.689175] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-10-06T22:34:05.689322] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-06T22:34:05.692307] [INFO ] [MAIN ] Derivative Progress: 15/2037 symbols completed. ACM took 1.3s. Estimated remaining: 13m 51s. Rate: 145.9 symbols/min [2025-10-06T22:34:05.692928] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:05.693124] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:05.693195] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:05.705488] [DEBUG] [LOCAL ] ACR: Loaded 5753 existing records from primary storage. [2025-10-06T22:34:05.705685] [INFO ] [MAIN ] ACR: Loaded 5753 primary data records. [2025-10-06T22:34:05.930793] [DEBUG] [LOCAL ] ACP: Loaded 30961 existing records from primary storage. [2025-10-06T22:34:05.938220] [INFO ] [MAIN ] ACP: Loaded 30961 primary data records. [2025-10-06T22:34:06.190800] [DEBUG] [LOCAL ] ACN: Loaded 53428 existing records from primary storage. [2025-10-06T22:34:06.191232] [INFO ] [MAIN ] ACN: Loaded 53428 primary data records. [2025-10-06T22:34:06.852125] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:06.853780] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 5753 primary records. [2025-10-06T22:34:06.854541] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-06T22:34:06.892574] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:06.892941] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-10-06T22:34:06.893959] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 30961 primary records. [2025-10-06T22:34:06.894245] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-06T22:34:06.894338] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-06T22:34:06.897192] [INFO ] [MAIN ] Derivative Progress: 16/2037 symbols completed. ACR took 1.2s. Estimated remaining: 15m 31s. Rate: 130.2 symbols/min [2025-10-06T22:34:06.897976] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:06.914959] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-10-06T22:34:06.915236] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-06T22:34:06.917443] [INFO ] [MAIN ] Derivative Progress: 17/2037 symbols completed. ACP took 1.2s. Estimated remaining: 14m 38s. Rate: 138.0 symbols/min [2025-10-06T22:34:06.918979] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:06.937251] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:06.938396] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53428 primary records. [2025-10-06T22:34:06.938526] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-06T22:34:06.956478] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-10-06T22:34:06.956856] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-06T22:34:06.969672] [INFO ] [MAIN ] Derivative Progress: 18/2037 symbols completed. ACN took 1.3s. Estimated remaining: 13m 55s. Rate: 145.1 symbols/min [2025-10-06T22:34:06.970180] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:06.993943] [DEBUG] [LOCAL ] ACRE: Loaded 33652 existing records from primary storage. [2025-10-06T22:34:06.994232] [INFO ] [MAIN ] ACRE: Loaded 33652 primary data records. [2025-10-06T22:34:07.147287] [DEBUG] [LOCAL ] ACVA: Loaded 49225 existing records from primary storage. [2025-10-06T22:34:07.182875] [INFO ] [MAIN ] ACVA: Loaded 49225 primary data records. [2025-10-06T22:34:07.479838] [DEBUG] [LOCAL ] ADC: Loaded 46204 existing records from primary storage. [2025-10-06T22:34:07.495924] [INFO ] [MAIN ] ADC: Loaded 46204 primary data records. [2025-10-06T22:34:08.033543] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:08.035081] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33652 primary records. [2025-10-06T22:34:08.035513] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-06T22:34:08.052399] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-10-06T22:34:08.054118] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-06T22:34:08.056389] [INFO ] [MAIN ] Derivative Progress: 19/2037 symbols completed. ACRE took 1.2s. Estimated remaining: 15m 6s. Rate: 133.6 symbols/min [2025-10-06T22:34:08.056668] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:08.075002] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:08.076057] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49225 primary records. [2025-10-06T22:34:08.076676] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-06T22:34:08.106108] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-10-06T22:34:08.111785] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-06T22:34:08.111692] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:08.114317] [INFO ] [MAIN ] Derivative Progress: 20/2037 symbols completed. ACVA took 1.2s. Estimated remaining: 14m 26s. Rate: 139.7 symbols/min [2025-10-06T22:34:08.115539] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:08.115314] [INFO ] [MAIN ] ADC: Generated 1794 derivative records from 46204 primary records. [2025-10-06T22:34:08.116292] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-06T22:34:08.147192] [DEBUG] [LOCAL ] ADC: Derivative data saved (1794 records). [2025-10-06T22:34:08.147397] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-06T22:34:08.150419] [INFO ] [MAIN ] Derivative Progress: 21/2037 symbols completed. ADC took 1.2s. Estimated remaining: 13m 48s. Rate: 146.1 symbols/min [2025-10-06T22:34:08.150846] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:08.172595] [DEBUG] [LOCAL ] ADM: Loaded 53390 existing records from primary storage. [2025-10-06T22:34:08.172975] [INFO ] [MAIN ] ADM: Loaded 53390 primary data records. [2025-10-06T22:34:08.315949] [DEBUG] [LOCAL ] ADNT: Loaded 47236 existing records from primary storage. [2025-10-06T22:34:08.327536] [INFO ] [MAIN ] ADNT: Loaded 47236 primary data records. [2025-10-06T22:34:08.734682] [DEBUG] [LOCAL ] ADT: Loaded 53450 existing records from primary storage. [2025-10-06T22:34:08.762756] [INFO ] [MAIN ] ADT: Loaded 53450 primary data records. [2025-10-06T22:34:09.322628] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:09.323676] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53390 primary records. [2025-10-06T22:34:09.324265] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-06T22:34:09.346515] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-10-06T22:34:09.347871] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-06T22:34:09.350984] [INFO ] [MAIN ] Derivative Progress: 22/2037 symbols completed. ADM took 1.3s. Estimated remaining: 15m 0s. Rate: 134.3 symbols/min [2025-10-06T22:34:09.351508] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:09.367691] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:09.369341] [INFO ] [MAIN ] ADNT: Generated 1794 derivative records from 47236 primary records. [2025-10-06T22:34:09.369622] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-06T22:34:09.412037] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:09.413726] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53450 primary records. [2025-10-06T22:34:09.413876] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-06T22:34:09.414445] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1794 records). [2025-10-06T22:34:09.414547] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-06T22:34:09.417383] [INFO ] [MAIN ] Derivative Progress: 23/2037 symbols completed. ADNT took 1.3s. Estimated remaining: 14m 26s. Rate: 139.5 symbols/min [2025-10-06T22:34:09.417982] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:09.444802] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-10-06T22:34:09.445385] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-06T22:34:09.447820] [INFO ] [MAIN ] Derivative Progress: 24/2037 symbols completed. ADT took 1.3s. Estimated remaining: 13m 52s. Rate: 145.1 symbols/min [2025-10-06T22:34:09.443788] [DEBUG] [LOCAL ] ADX: Loaded 27478 existing records from primary storage. [2025-10-06T22:34:09.448062] [INFO ] [MAIN ] ADX: Loaded 27478 primary data records. [2025-10-06T22:34:09.448184] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:09.546267] [DEBUG] [LOCAL ] AEFC: Loaded 8467 existing records from primary storage. [2025-10-06T22:34:09.561442] [INFO ] [MAIN ] AEFC: Loaded 8467 primary data records. [2025-10-06T22:34:09.947006] [DEBUG] [LOCAL ] AEE: Loaded 50105 existing records from primary storage. [2025-10-06T22:34:09.963552] [INFO ] [MAIN ] AEE: Loaded 50105 primary data records. [2025-10-06T22:34:10.508059] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:10.510586] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27478 primary records. [2025-10-06T22:34:10.512292] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-06T22:34:10.544497] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:10.545631] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8467 primary records. [2025-10-06T22:34:10.545783] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-06T22:34:10.544011] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-10-06T22:34:10.546155] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-06T22:34:10.548905] [INFO ] [MAIN ] Derivative Progress: 25/2037 symbols completed. ADX took 1.2s. Estimated remaining: 14m 47s. Rate: 136.1 symbols/min [2025-10-06T22:34:10.549198] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:10.569824] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-10-06T22:34:10.569983] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-06T22:34:10.572207] [INFO ] [MAIN ] Derivative Progress: 26/2037 symbols completed. AEFC took 1.1s. Estimated remaining: 14m 15s. Rate: 141.2 symbols/min [2025-10-06T22:34:10.572468] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:10.588266] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:10.589819] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50105 primary records. [2025-10-06T22:34:10.590060] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-06T22:34:10.613572] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-10-06T22:34:10.613849] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-06T22:34:10.616779] [INFO ] [MAIN ] Derivative Progress: 27/2037 symbols completed. AEE took 1.2s. Estimated remaining: 13m 46s. Rate: 146.0 symbols/min [2025-10-06T22:34:10.631164] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:10.667258] [DEBUG] [LOCAL ] AEM: Loaded 53460 existing records from primary storage. [2025-10-06T22:34:10.667602] [INFO ] [MAIN ] AEM: Loaded 53460 primary data records. [2025-10-06T22:34:10.786916] [DEBUG] [LOCAL ] AEO: Loaded 53561 existing records from primary storage. [2025-10-06T22:34:10.820243] [INFO ] [MAIN ] AEO: Loaded 53561 primary data records. [2025-10-06T22:34:11.105820] [DEBUG] [LOCAL ] AER: Loaded 48299 existing records from primary storage. [2025-10-06T22:34:11.117762] [INFO ] [MAIN ] AER: Loaded 48299 primary data records. [2025-10-06T22:34:11.737185] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:11.738909] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53460 primary records. [2025-10-06T22:34:11.739611] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-06T22:34:11.763615] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-10-06T22:34:11.765713] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-06T22:34:11.768282] [INFO ] [MAIN ] Derivative Progress: 28/2037 symbols completed. AEM took 1.2s. Estimated remaining: 14m 39s. Rate: 137.2 symbols/min [2025-10-06T22:34:11.782619] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:11.785475] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53561 primary records. [2025-10-06T22:34:11.785700] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-06T22:34:11.806874] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:11.810220] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48299 primary records. [2025-10-06T22:34:11.810497] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-06T22:34:11.825853] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-10-06T22:34:11.826349] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-06T22:34:11.829322] [INFO ] [MAIN ] Derivative Progress: 29/2037 symbols completed. AEO took 1.3s. Estimated remaining: 14m 12s. Rate: 141.4 symbols/min [2025-10-06T22:34:11.833594] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-10-06T22:34:11.833683] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-06T22:34:11.836198] [INFO ] [MAIN ] Derivative Progress: 30/2037 symbols completed. AER took 1.2s. Estimated remaining: 13m 44s. Rate: 146.2 symbols/min [2025-10-06T22:34:11.836866] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:11.836750] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:11.836994] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:11.853328] [DEBUG] [LOCAL ] AFB: Loaded 11448 existing records from primary storage. [2025-10-06T22:34:11.853627] [INFO ] [MAIN ] AFB: Loaded 11448 primary data records. [2025-10-06T22:34:12.215233] [DEBUG] [LOCAL ] AESI: Loaded 49538 existing records from primary storage. [2025-10-06T22:34:12.218375] [INFO ] [MAIN ] AESI: Loaded 49538 primary data records. [2025-10-06T22:34:12.241730] [DEBUG] [LOCAL ] AES: Loaded 53670 existing records from primary storage. [2025-10-06T22:34:12.258470] [INFO ] [MAIN ] AES: Loaded 53670 primary data records. [2025-10-06T22:34:12.904022] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:12.906125] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11448 primary records. [2025-10-06T22:34:12.907557] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-06T22:34:12.926967] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-10-06T22:34:12.927109] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-06T22:34:12.929830] [INFO ] [MAIN ] Derivative Progress: 31/2037 symbols completed. AFB took 1.1s. Estimated remaining: 14m 27s. Rate: 138.7 symbols/min [2025-10-06T22:34:12.930149] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:12.953925] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:12.956161] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49538 primary records. [2025-10-06T22:34:12.958007] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-06T22:34:12.995686] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:12.999059] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-10-06T22:34:13.000230] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53670 primary records. [2025-10-06T22:34:13.000413] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-06T22:34:13.000537] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-06T22:34:13.002791] [INFO ] [MAIN ] Derivative Progress: 32/2037 symbols completed. AESI took 1.2s. Estimated remaining: 14m 5s. Rate: 142.4 symbols/min [2025-10-06T22:34:13.003633] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:13.033108] [DEBUG] [LOCAL ] AFG: Loaded 32332 existing records from primary storage. [2025-10-06T22:34:13.034366] [INFO ] [MAIN ] AFG: Loaded 32332 primary data records. [2025-10-06T22:34:13.036783] [DEBUG] [LOCAL ] AFGB: Loaded 2324 existing records from primary storage. [2025-10-06T22:34:13.037094] [INFO ] [MAIN ] AFGB: Loaded 2324 primary data records. [2025-10-06T22:34:13.036870] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-10-06T22:34:13.048918] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-06T22:34:13.081541] [INFO ] [MAIN ] Derivative Progress: 33/2037 symbols completed. AES took 1.2s. Estimated remaining: 13m 43s. Rate: 146.0 symbols/min [2025-10-06T22:34:13.106937] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:13.278511] [DEBUG] [LOCAL ] AFGC: Loaded 2551 existing records from primary storage. [2025-10-06T22:34:13.361889] [INFO ] [MAIN ] AFGC: Loaded 2551 primary data records. [2025-10-06T22:34:14.108065] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-06T22:34:14.113523] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:14.114627] [INFO ] [MAIN ] AFGB: Generated 1792 derivative records from 2324 primary records. [2025-10-06T22:34:14.115999] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32332 primary records. [2025-10-06T22:34:14.116133] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-06T22:34:14.115166] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-06T22:34:14.146519] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-10-06T22:34:14.154554] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-06T22:34:14.162611] [INFO ] [MAIN ] Derivative Progress: 34/2037 symbols completed. AFG took 1.2s. Estimated remaining: 14m 22s. Rate: 139.4 symbols/min [2025-10-06T22:34:14.162967] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:34:14.164154] [INFO ] [MAIN ] AFGC: Generated 1793 derivative records from 2551 primary records. [2025-10-06T22:34:14.164505] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-06T22:34:14.164613] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:14.175029] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1792 records). [2025-10-06T22:34:14.175201] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-06T22:34:14.181569] [INFO ] [MAIN ] Derivative Progress: 35/2037 symbols completed. AFGB took 1.2s. Estimated remaining: 13m 58s. Rate: 143.3 symbols/min [2025-10-06T22:34:14.181833] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:14.187518] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1793 records). [2025-10-06T22:34:14.188445] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-06T22:34:14.190935] [DEBUG] [LOCAL ] AFGD: Loaded 1805 existing records from primary storage. [2025-10-06T22:34:14.193920] [INFO ] [MAIN ] Derivative Progress: 36/2037 symbols completed. AFGC took 1.1s. Estimated remaining: 13m 35s. Rate: 147.2 symbols/min [2025-10-06T22:34:14.194126] [INFO ] [MAIN ] AFGD: Loaded 1805 primary data records. [2025-10-06T22:34:14.194353] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:14.218294] [DEBUG] [LOCAL ] AFGE: Loaded 2441 existing records from primary storage. [2025-10-06T22:34:14.252737] [INFO ] [MAIN ] AFGE: Loaded 2441 primary data records. [2025-10-06T22:34:14.847633] [DEBUG] [LOCAL ] AFL: Loaded 53156 existing records from primary storage. [2025-10-06T22:34:14.848699] [INFO ] [MAIN ] AFL: Loaded 53156 primary data records. [2025-10-06T22:34:15.074810] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:15.200348] [INFO ] [MAIN ] AFGD: Generated 1794 derivative records from 1805 primary records. [2025-10-06T22:34:15.199481] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:15.201149] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-06T22:34:15.201086] [INFO ] [MAIN ] AFGE: Generated 1794 derivative records from 2441 primary records. [2025-10-06T22:34:15.201878] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-06T22:34:15.229167] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1794 records). [2025-10-06T22:34:15.230825] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1794 records). [2025-10-06T22:34:15.231161] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-06T22:34:15.234027] [INFO ] [MAIN ] Derivative Progress: 37/2037 symbols completed. AFGE took 1.1s. Estimated remaining: 14m 9s. Rate: 141.3 symbols/min [2025-10-06T22:34:15.231244] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-06T22:34:15.236473] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:15.237111] [INFO ] [MAIN ] Derivative Progress: 38/2037 symbols completed. AFGD took 1.1s. Estimated remaining: 13m 47s. Rate: 145.1 symbols/min [2025-10-06T22:34:15.237714] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:15.265119] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:15.265963] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53156 primary records. [2025-10-06T22:34:15.266455] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-06T22:34:15.289043] [DEBUG] [LOCAL ] AGD: Loaded 18278 existing records from primary storage. [2025-10-06T22:34:15.290959] [INFO ] [MAIN ] AGD: Loaded 18278 primary data records. [2025-10-06T22:34:15.290854] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-10-06T22:34:15.291126] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-06T22:34:15.294230] [INFO ] [MAIN ] Derivative Progress: 39/2037 symbols completed. AFL took 1.1s. Estimated remaining: 13m 28s. Rate: 148.4 symbols/min [2025-10-06T22:34:15.325550] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:15.651198] [DEBUG] [LOCAL ] AG: Loaded 53642 existing records from primary storage. [2025-10-06T22:34:15.652097] [INFO ] [MAIN ] AG: Loaded 53642 primary data records. [2025-10-06T22:34:15.845941] [DEBUG] [LOCAL ] AGI: Loaded 53420 existing records from primary storage. [2025-10-06T22:34:15.880190] [INFO ] [MAIN ] AGI: Loaded 53420 primary data records. [2025-10-06T22:34:16.342516] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:16.344191] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 18278 primary records. [2025-10-06T22:34:16.344534] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-06T22:34:16.363395] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-10-06T22:34:16.364414] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-06T22:34:16.367601] [INFO ] [MAIN ] Derivative Progress: 40/2037 symbols completed. AGD took 1.1s. Estimated remaining: 14m 1s. Rate: 142.5 symbols/min [2025-10-06T22:34:16.370633] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:16.385993] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:16.387145] [INFO ] [MAIN ] AG: Generated 1794 derivative records from 53642 primary records. [2025-10-06T22:34:16.387624] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-06T22:34:16.406430] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-10-06T22:34:16.406734] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-06T22:34:16.411472] [INFO ] [MAIN ] Derivative Progress: 41/2037 symbols completed. AG took 1.2s. Estimated remaining: 13m 42s. Rate: 145.7 symbols/min [2025-10-06T22:34:16.415615] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:16.431001] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:16.431707] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53420 primary records. [2025-10-06T22:34:16.431802] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-06T22:34:16.469492] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-10-06T22:34:16.469387] [DEBUG] [LOCAL ] AGM: Loaded 10345 existing records from primary storage. [2025-10-06T22:34:16.469609] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-06T22:34:16.469721] [INFO ] [MAIN ] AGM: Loaded 10345 primary data records. [2025-10-06T22:34:16.472369] [INFO ] [MAIN ] Derivative Progress: 42/2037 symbols completed. AGI took 1.1s. Estimated remaining: 13m 25s. Rate: 148.7 symbols/min [2025-10-06T22:34:16.472797] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:16.573027] [DEBUG] [LOCAL ] AGL: Loaded 52469 existing records from primary storage. [2025-10-06T22:34:16.592929] [INFO ] [MAIN ] AGL: Loaded 52469 primary data records. [2025-10-06T22:34:16.985041] [DEBUG] [LOCAL ] AGRO: Loaded 33335 existing records from primary storage. [2025-10-06T22:34:17.027911] [INFO ] [MAIN ] AGRO: Loaded 33335 primary data records. [2025-10-06T22:34:17.541813] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:17.543324] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 10345 primary records. [2025-10-06T22:34:17.543772] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-06T22:34:17.563131] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-10-06T22:34:17.564244] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-06T22:34:17.566604] [INFO ] [MAIN ] Derivative Progress: 43/2037 symbols completed. AGM took 1.2s. Estimated remaining: 13m 57s. Rate: 143.0 symbols/min [2025-10-06T22:34:17.580353] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:17.581409] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52469 primary records. [2025-10-06T22:34:17.581682] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-06T22:34:17.598123] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-10-06T22:34:17.603204] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-06T22:34:17.607921] [INFO ] [MAIN ] Derivative Progress: 44/2037 symbols completed. AGL took 1.2s. Estimated remaining: 13m 39s. Rate: 146.0 symbols/min [2025-10-06T22:34:17.621565] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:17.622344] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 33335 primary records. [2025-10-06T22:34:17.622407] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-06T22:34:17.638727] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-10-06T22:34:17.638887] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-06T22:34:17.644579] [INFO ] [MAIN ] Derivative Progress: 45/2037 symbols completed. AGRO took 1.2s. Estimated remaining: 13m 22s. Rate: 149.0 symbols/min [2025-10-06T22:34:17.645485] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:17.645395] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:17.645333] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:17.707544] [DEBUG] [LOCAL ] AHH: Loaded 40877 existing records from primary storage. [2025-10-06T22:34:17.718535] [INFO ] [MAIN ] AHH: Loaded 40877 primary data records. [2025-10-06T22:34:17.743960] [DEBUG] [LOCAL ] AGX: Loaded 33146 existing records from primary storage. [2025-10-06T22:34:17.767171] [INFO ] [MAIN ] AGX: Loaded 33146 primary data records. [2025-10-06T22:34:17.844378] [DEBUG] [LOCAL ] AHR: Loaded 49133 existing records from primary storage. [2025-10-06T22:34:17.923431] [INFO ] [MAIN ] AHR: Loaded 49133 primary data records. [2025-10-06T22:34:18.734772] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:18.748504] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:18.750823] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33146 primary records. [2025-10-06T22:34:18.750929] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-06T22:34:18.749567] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 40877 primary records. [2025-10-06T22:34:18.752425] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-06T22:34:18.786901] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-10-06T22:34:18.787947] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-06T22:34:18.797967] [INFO ] [MAIN ] Derivative Progress: 46/2037 symbols completed. AGX took 1.2s. Estimated remaining: 13m 54s. Rate: 143.2 symbols/min [2025-10-06T22:34:18.787773] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-10-06T22:34:18.803048] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:18.802832] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-06T22:34:18.806453] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:18.807291] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49133 primary records. [2025-10-06T22:34:18.807523] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-06T22:34:18.806015] [INFO ] [MAIN ] Derivative Progress: 47/2037 symbols completed. AHH took 1.2s. Estimated remaining: 13m 36s. Rate: 146.3 symbols/min [2025-10-06T22:34:18.808402] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:18.826795] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-10-06T22:34:18.831293] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-06T22:34:18.831204] [DEBUG] [LOCAL ] AHT: Loaded 6203 existing records from primary storage. [2025-10-06T22:34:18.833895] [INFO ] [MAIN ] Derivative Progress: 48/2037 symbols completed. AHR took 1.2s. Estimated remaining: 13m 20s. Rate: 149.1 symbols/min [2025-10-06T22:34:18.834289] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:18.834174] [INFO ] [MAIN ] AHT: Loaded 6203 primary data records. [2025-10-06T22:34:19.182215] [DEBUG] [LOCAL ] AI: Loaded 53752 existing records from primary storage. [2025-10-06T22:34:19.197779] [INFO ] [MAIN ] AI: Loaded 53752 primary data records. [2025-10-06T22:34:19.355208] [DEBUG] [LOCAL ] AIG: Loaded 53472 existing records from primary storage. [2025-10-06T22:34:19.371976] [INFO ] [MAIN ] AIG: Loaded 53472 primary data records. [2025-10-06T22:34:19.833890] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:19.855497] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 6203 primary records. [2025-10-06T22:34:19.972138] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-06T22:34:19.994966] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-10-06T22:34:19.995483] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-06T22:34:19.998134] [INFO ] [MAIN ] Derivative Progress: 49/2037 symbols completed. AHT took 1.2s. Estimated remaining: 13m 51s. Rate: 143.6 symbols/min [2025-10-06T22:34:20.000265] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:20.018139] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:20.019464] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53752 primary records. [2025-10-06T22:34:20.019565] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-06T22:34:20.056842] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:20.058119] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53472 primary records. [2025-10-06T22:34:20.059211] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-06T22:34:20.072258] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-10-06T22:34:20.082500] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-06T22:34:20.084383] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-10-06T22:34:20.086802] [INFO ] [MAIN ] Derivative Progress: 50/2037 symbols completed. AI took 1.3s. Estimated remaining: 13m 37s. Rate: 145.9 symbols/min [2025-10-06T22:34:20.088388] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:20.088460] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-06T22:34:20.091933] [INFO ] [MAIN ] Derivative Progress: 51/2037 symbols completed. AIG took 1.3s. Estimated remaining: 13m 21s. Rate: 148.8 symbols/min [2025-10-06T22:34:20.092163] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:20.093106] [DEBUG] [LOCAL ] AIN: Loaded 24606 existing records from primary storage. [2025-10-06T22:34:20.093817] [INFO ] [MAIN ] AIN: Loaded 24606 primary data records. [2025-10-06T22:34:20.220775] [DEBUG] [LOCAL ] AIO: Loaded 13376 existing records from primary storage. [2025-10-06T22:34:20.236859] [INFO ] [MAIN ] AIO: Loaded 13376 primary data records. [2025-10-06T22:34:20.448674] [DEBUG] [LOCAL ] AIR: Loaded 28637 existing records from primary storage. [2025-10-06T22:34:20.502143] [INFO ] [MAIN ] AIR: Loaded 28637 primary data records. [2025-10-06T22:34:21.062010] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:21.063217] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24606 primary records. [2025-10-06T22:34:21.063476] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-06T22:34:21.081978] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-10-06T22:34:21.082228] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-06T22:34:21.084615] [INFO ] [MAIN ] Derivative Progress: 52/2037 symbols completed. AIN took 1.1s. Estimated remaining: 13m 43s. Rate: 144.7 symbols/min [2025-10-06T22:34:21.084989] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:21.104591] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:21.113988] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13376 primary records. [2025-10-06T22:34:21.119044] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-06T22:34:21.120076] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:21.121537] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 28637 primary records. [2025-10-06T22:34:21.121734] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-06T22:34:21.169937] [DEBUG] [LOCAL ] AIT: Loaded 27295 existing records from primary storage. [2025-10-06T22:34:21.171452] [INFO ] [MAIN ] AIT: Loaded 27295 primary data records. [2025-10-06T22:34:21.171921] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-10-06T22:34:21.183950] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-06T22:34:21.206271] [INFO ] [MAIN ] Derivative Progress: 53/2037 symbols completed. AIR took 1.1s. Estimated remaining: 13m 32s. Rate: 146.7 symbols/min [2025-10-06T22:34:21.206458] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-10-06T22:34:21.219240] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:21.241778] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-06T22:34:21.257569] [INFO ] [MAIN ] Derivative Progress: 54/2037 symbols completed. AIO took 1.2s. Estimated remaining: 13m 18s. Rate: 149.1 symbols/min [2025-10-06T22:34:21.263037] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:21.525370] [DEBUG] [LOCAL ] AIV: Loaded 40739 existing records from primary storage. [2025-10-06T22:34:21.526331] [INFO ] [MAIN ] AIV: Loaded 40739 primary data records. [2025-10-06T22:34:21.569325] [DEBUG] [LOCAL ] AIZ: Loaded 29808 existing records from primary storage. [2025-10-06T22:34:21.576961] [INFO ] [MAIN ] AIZ: Loaded 29808 primary data records. [2025-10-06T22:34:21.841973] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:21.862312] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 27295 primary records. [2025-10-06T22:34:22.010761] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-06T22:34:22.297626] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-10-06T22:34:22.299845] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-06T22:34:22.303494] [INFO ] [MAIN ] Derivative Progress: 55/2037 symbols completed. AIT took 1.2s. Estimated remaining: 13m 41s. Rate: 144.9 symbols/min [2025-10-06T22:34:22.304315] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:22.351818] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:22.352138] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:22.354461] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 29808 primary records. [2025-10-06T22:34:22.354671] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-06T22:34:22.353511] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 40739 primary records. [2025-10-06T22:34:22.354848] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-06T22:34:22.402291] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-10-06T22:34:22.401863] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-10-06T22:34:22.402625] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-06T22:34:22.405530] [INFO ] [MAIN ] Derivative Progress: 56/2037 symbols completed. AIZ took 1.1s. Estimated remaining: 13m 29s. Rate: 146.8 symbols/min [2025-10-06T22:34:22.402783] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-06T22:34:22.409895] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:22.410076] [INFO ] [MAIN ] Derivative Progress: 57/2037 symbols completed. AIV took 1.2s. Estimated remaining: 13m 15s. Rate: 149.4 symbols/min [2025-10-06T22:34:22.410586] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:22.428818] [DEBUG] [LOCAL ] AJG: Loaded 46800 existing records from primary storage. [2025-10-06T22:34:22.429316] [INFO ] [MAIN ] AJG: Loaded 46800 primary data records. [2025-10-06T22:34:22.796271] [DEBUG] [LOCAL ] AL: Loaded 44414 existing records from primary storage. [2025-10-06T22:34:22.811615] [INFO ] [MAIN ] AL: Loaded 44414 primary data records. [2025-10-06T22:34:22.812841] [DEBUG] [LOCAL ] ALB: Loaded 53274 existing records from primary storage. [2025-10-06T22:34:22.825497] [INFO ] [MAIN ] ALB: Loaded 53274 primary data records. [2025-10-06T22:34:23.457416] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:23.459235] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 46800 primary records. [2025-10-06T22:34:23.459447] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-06T22:34:23.478062] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-10-06T22:34:23.478398] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-06T22:34:23.480930] [INFO ] [MAIN ] Derivative Progress: 58/2037 symbols completed. AJG took 1.2s. Estimated remaining: 13m 37s. Rate: 145.3 symbols/min [2025-10-06T22:34:23.497467] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:23.498281] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44414 primary records. [2025-10-06T22:34:23.498446] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-06T22:34:23.527508] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:23.529253] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-10-06T22:34:23.529945] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53274 primary records. [2025-10-06T22:34:23.530043] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-06T22:34:23.530128] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-06T22:34:23.532449] [INFO ] [MAIN ] Derivative Progress: 59/2037 symbols completed. AL took 1.1s. Estimated remaining: 13m 25s. Rate: 147.4 symbols/min [2025-10-06T22:34:23.547703] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-10-06T22:34:23.547766] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-06T22:34:23.550731] [INFO ] [MAIN ] Derivative Progress: 60/2037 symbols completed. ALB took 1.1s. Estimated remaining: 13m 12s. Rate: 149.8 symbols/min [2025-10-06T22:34:23.551166] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:23.551089] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:23.551716] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:23.595282] [DEBUG] [LOCAL ] ALE: Loaded 31117 existing records from primary storage. [2025-10-06T22:34:23.595639] [INFO ] [MAIN ] ALE: Loaded 31117 primary data records. [2025-10-06T22:34:23.742580] [DEBUG] [LOCAL ] ALEX: Loaded 31205 existing records from primary storage. [2025-10-06T22:34:23.743167] [INFO ] [MAIN ] ALEX: Loaded 31205 primary data records. [2025-10-06T22:34:23.759796] [DEBUG] [LOCAL ] ALC: Loaded 50954 existing records from primary storage. [2025-10-06T22:34:23.783415] [INFO ] [MAIN ] ALC: Loaded 50954 primary data records. [2025-10-06T22:34:24.688219] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:24.690119] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 31117 primary records. [2025-10-06T22:34:24.690358] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-06T22:34:24.708447] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-10-06T22:34:24.708845] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-06T22:34:24.712237] [INFO ] [MAIN ] Derivative Progress: 61/2037 symbols completed. ALE took 1.2s. Estimated remaining: 13m 36s. Rate: 145.3 symbols/min [2025-10-06T22:34:24.712553] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:24.732722] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:24.736554] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 31205 primary records. [2025-10-06T22:34:24.749667] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-06T22:34:24.750357] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:24.752030] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 50954 primary records. [2025-10-06T22:34:24.765550] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-06T22:34:24.768515] [DEBUG] [LOCAL ] ALG: Loaded 10048 existing records from primary storage. [2025-10-06T22:34:24.773112] [INFO ] [MAIN ] ALG: Loaded 10048 primary data records. [2025-10-06T22:34:24.773890] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-10-06T22:34:24.796158] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-06T22:34:24.800410] [INFO ] [MAIN ] Derivative Progress: 62/2037 symbols completed. ALEX took 1.2s. Estimated remaining: 13m 25s. Rate: 147.2 symbols/min [2025-10-06T22:34:24.820445] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-10-06T22:34:24.827283] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-06T22:34:24.820597] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:24.861161] [INFO ] [MAIN ] Derivative Progress: 63/2037 symbols completed. ALC took 1.3s. Estimated remaining: 13m 14s. Rate: 149.2 symbols/min [2025-10-06T22:34:24.870679] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:25.180908] [DEBUG] [LOCAL ] ALIT: Loaded 52768 existing records from primary storage. [2025-10-06T22:34:25.196961] [INFO ] [MAIN ] ALIT: Loaded 52768 primary data records. [2025-10-06T22:34:25.218895] [DEBUG] [LOCAL ] ALK: Loaded 53058 existing records from primary storage. [2025-10-06T22:34:25.234256] [INFO ] [MAIN ] ALK: Loaded 53058 primary data records. [2025-10-06T22:34:25.644300] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:25.670779] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 10048 primary records. [2025-10-06T22:34:25.718534] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-06T22:34:25.919879] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-10-06T22:34:25.921327] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-06T22:34:25.923858] [INFO ] [MAIN ] Derivative Progress: 64/2037 symbols completed. ALG took 1.2s. Estimated remaining: 13m 34s. Rate: 145.5 symbols/min [2025-10-06T22:34:25.924216] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:25.950444] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:25.953048] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52768 primary records. [2025-10-06T22:34:25.953840] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-06T22:34:25.982565] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-10-06T22:34:25.979902] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:25.983454] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53058 primary records. [2025-10-06T22:34:25.983550] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-06T22:34:25.984169] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-06T22:34:25.986408] [INFO ] [MAIN ] Derivative Progress: 65/2037 symbols completed. ALIT took 1.2s. Estimated remaining: 13m 23s. Rate: 147.4 symbols/min [2025-10-06T22:34:25.986804] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:26.014400] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-10-06T22:34:26.014549] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-06T22:34:26.017152] [INFO ] [MAIN ] Derivative Progress: 66/2037 symbols completed. ALK took 1.1s. Estimated remaining: 13m 11s. Rate: 149.5 symbols/min [2025-10-06T22:34:26.017441] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:26.038044] [DEBUG] [LOCAL ] ALL: Loaded 49926 existing records from primary storage. [2025-10-06T22:34:26.038393] [INFO ] [MAIN ] ALL: Loaded 49926 primary data records. [2025-10-06T22:34:26.243990] [DEBUG] [LOCAL ] ALLE: Loaded 44573 existing records from primary storage. [2025-10-06T22:34:26.305001] [INFO ] [MAIN ] ALLE: Loaded 44573 primary data records. [2025-10-06T22:34:26.566464] [DEBUG] [LOCAL ] ALLY: Loaded 53227 existing records from primary storage. [2025-10-06T22:34:26.588521] [INFO ] [MAIN ] ALLY: Loaded 53227 primary data records. [2025-10-06T22:34:27.092977] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:27.094531] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 49926 primary records. [2025-10-06T22:34:27.094859] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-06T22:34:27.113766] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-10-06T22:34:27.115925] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-06T22:34:27.119050] [INFO ] [MAIN ] Derivative Progress: 67/2037 symbols completed. ALL took 1.2s. Estimated remaining: 13m 31s. Rate: 145.7 symbols/min [2025-10-06T22:34:27.119340] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:27.133803] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:27.134728] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 44573 primary records. [2025-10-06T22:34:27.134860] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-06T22:34:27.152800] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-10-06T22:34:27.154685] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-06T22:34:27.158039] [INFO ] [MAIN ] Derivative Progress: 68/2037 symbols completed. ALLE took 1.2s. Estimated remaining: 13m 20s. Rate: 147.6 symbols/min [2025-10-06T22:34:27.158877] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:27.172200] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:27.172959] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53227 primary records. [2025-10-06T22:34:27.173082] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-06T22:34:27.198425] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-10-06T22:34:27.199068] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-06T22:34:27.201706] [INFO ] [MAIN ] Derivative Progress: 69/2037 symbols completed. ALLY took 1.2s. Estimated remaining: 13m 9s. Rate: 149.6 symbols/min [2025-10-06T22:34:27.201973] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:27.225393] [DEBUG] [LOCAL ] ALSN: Loaded 43330 existing records from primary storage. [2025-10-06T22:34:27.225674] [INFO ] [MAIN ] ALSN: Loaded 43330 primary data records. [2025-10-06T22:34:27.258067] [DEBUG] [LOCAL ] ALUR: Loaded 10746 existing records from primary storage. [2025-10-06T22:34:27.273763] [DEBUG] [LOCAL ] ALTG: Loaded 23567 existing records from primary storage. [2025-10-06T22:34:27.301317] [INFO ] [MAIN ] ALUR: Loaded 10746 primary data records. [2025-10-06T22:34:27.306631] [INFO ] [MAIN ] ALTG: Loaded 23567 primary data records. [2025-10-06T22:34:28.227518] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:28.228152] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:28.229011] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 10746 primary records. [2025-10-06T22:34:28.229921] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-06T22:34:28.230977] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43330 primary records. [2025-10-06T22:34:28.240813] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-06T22:34:28.270169] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-10-06T22:34:28.276152] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-10-06T22:34:28.276344] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-06T22:34:28.276540] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-06T22:34:28.279022] [INFO ] [MAIN ] Derivative Progress: 70/2037 symbols completed. ALSN took 1.2s. Estimated remaining: 13m 28s. Rate: 146.1 symbols/min [2025-10-06T22:34:28.279503] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:28.282955] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23567 primary records. [2025-10-06T22:34:28.283275] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-06T22:34:28.283131] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:28.283546] [INFO ] [MAIN ] Derivative Progress: 71/2037 symbols completed. ALUR took 1.1s. Estimated remaining: 13m 16s. Rate: 148.1 symbols/min [2025-10-06T22:34:28.284881] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:28.307071] [DEBUG] [LOCAL ] ALX: Loaded 6403 existing records from primary storage. [2025-10-06T22:34:28.307831] [INFO ] [MAIN ] ALX: Loaded 6403 primary data records. [2025-10-06T22:34:28.356123] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-10-06T22:34:28.369354] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-06T22:34:28.381602] [INFO ] [MAIN ] Derivative Progress: 72/2037 symbols completed. ALTG took 1.2s. Estimated remaining: 13m 8s. Rate: 149.7 symbols/min [2025-10-06T22:34:28.387380] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:28.634195] [DEBUG] [LOCAL ] ALV: Loaded 42223 existing records from primary storage. [2025-10-06T22:34:28.648954] [INFO ] [MAIN ] ALV: Loaded 42223 primary data records. [2025-10-06T22:34:28.981938] [DEBUG] [LOCAL ] AM: Loaded 52028 existing records from primary storage. [2025-10-06T22:34:28.996181] [INFO ] [MAIN ] AM: Loaded 52028 primary data records. [2025-10-06T22:34:29.143211] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-06T22:34:29.183879] [INFO ] [MAIN ] ALX: Generated 1791 derivative records from 6403 primary records. [2025-10-06T22:34:29.215041] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-06T22:34:29.357014] [DEBUG] [LOCAL ] ALX: Derivative data saved (1791 records). [2025-10-06T22:34:29.357660] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-06T22:34:29.361336] [INFO ] [MAIN ] Derivative Progress: 73/2037 symbols completed. ALX took 1.1s. Estimated remaining: 13m 23s. Rate: 146.8 symbols/min [2025-10-06T22:34:29.381470] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:29.382560] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42223 primary records. [2025-10-06T22:34:29.382819] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-06T22:34:29.400494] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-10-06T22:34:29.400803] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-06T22:34:29.403586] [INFO ] [MAIN ] Derivative Progress: 74/2037 symbols completed. ALV took 1.1s. Estimated remaining: 13m 13s. Rate: 148.6 symbols/min [2025-10-06T22:34:29.418973] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:29.419663] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 52028 primary records. [2025-10-06T22:34:29.419732] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-06T22:34:29.435298] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-10-06T22:34:29.435360] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-06T22:34:29.438198] [INFO ] [MAIN ] Derivative Progress: 75/2037 symbols completed. AM took 1.1s. Estimated remaining: 13m 3s. Rate: 150.4 symbols/min [2025-10-06T22:34:29.439066] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:29.439219] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:29.439336] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:29.527934] [DEBUG] [LOCAL ] AMC: Loaded 53761 existing records from primary storage. [2025-10-06T22:34:29.528128] [INFO ] [MAIN ] AMC: Loaded 53761 primary data records. [2025-10-06T22:34:29.528679] [DEBUG] [LOCAL ] AMBC: Loaded 36473 existing records from primary storage. [2025-10-06T22:34:29.528763] [INFO ] [MAIN ] AMBC: Loaded 36473 primary data records. [2025-10-06T22:34:29.724870] [DEBUG] [LOCAL ] AMBP: Loaded 44851 existing records from primary storage. [2025-10-06T22:34:29.743320] [INFO ] [MAIN ] AMBP: Loaded 44851 primary data records. [2025-10-06T22:34:30.585263] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:30.604268] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 36473 primary records. [2025-10-06T22:34:30.604896] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-06T22:34:30.604703] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:30.607445] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53761 primary records. [2025-10-06T22:34:30.607565] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-06T22:34:30.606248] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:30.608527] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 44851 primary records. [2025-10-06T22:34:30.616887] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-06T22:34:30.644175] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-10-06T22:34:30.650873] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-06T22:34:30.654694] [INFO ] [MAIN ] Derivative Progress: 76/2037 symbols completed. AMBC took 1.2s. Estimated remaining: 13m 23s. Rate: 146.5 symbols/min [2025-10-06T22:34:30.655228] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:30.658044] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-10-06T22:34:30.659871] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-06T22:34:30.663147] [INFO ] [MAIN ] Derivative Progress: 77/2037 symbols completed. AMC took 1.2s. Estimated remaining: 13m 13s. Rate: 148.4 symbols/min [2025-10-06T22:34:30.664975] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-10-06T22:34:30.665490] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-06T22:34:30.665183] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:30.668416] [INFO ] [MAIN ] Derivative Progress: 78/2037 symbols completed. AMBP took 1.2s. Estimated remaining: 13m 2s. Rate: 150.3 symbols/min [2025-10-06T22:34:30.669124] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:30.706449] [DEBUG] [LOCAL ] AMG: Loaded 20292 existing records from primary storage. [2025-10-06T22:34:30.707894] [INFO ] [MAIN ] AMG: Loaded 20292 primary data records. [2025-10-06T22:34:30.828564] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-06T22:34:30.853561] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-10-06T22:34:31.012776] [DEBUG] [LOCAL ] AME: Loaded 48595 existing records from primary storage. [2025-10-06T22:34:31.029321] [INFO ] [MAIN ] AME: Loaded 48595 primary data records. [2025-10-06T22:34:31.721996] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:31.724023] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20292 primary records. [2025-10-06T22:34:31.724318] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-06T22:34:31.738507] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:31.746708] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-10-06T22:34:31.748145] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-06T22:34:31.755820] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-10-06T22:34:31.755991] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-06T22:34:31.775934] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-10-06T22:34:31.776099] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-06T22:34:31.772419] [INFO ] [MAIN ] Derivative Progress: 79/2037 symbols completed. AMG took 1.1s. Estimated remaining: 13m 19s. Rate: 147.0 symbols/min [2025-10-06T22:34:31.779243] [INFO ] [MAIN ] Derivative Progress: 80/2037 symbols completed. AMCR took 1.1s. Estimated remaining: 13m 9s. Rate: 148.8 symbols/min [2025-10-06T22:34:31.779171] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:31.779480] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:31.794004] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:31.794846] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48595 primary records. [2025-10-06T22:34:31.794990] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-06T22:34:31.814435] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-10-06T22:34:31.814832] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-06T22:34:31.817942] [INFO ] [MAIN ] Derivative Progress: 81/2037 symbols completed. AME took 1.2s. Estimated remaining: 12m 60s. Rate: 150.5 symbols/min [2025-10-06T22:34:31.818345] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:31.858710] [DEBUG] [LOCAL ] AMN: Loaded 41794 existing records from primary storage. [2025-10-06T22:34:31.859020] [INFO ] [MAIN ] AMN: Loaded 41794 primary data records. [2025-10-06T22:34:31.988040] [DEBUG] [LOCAL ] AMH: Loaded 51739 existing records from primary storage. [2025-10-06T22:34:32.070037] [DEBUG] [LOCAL ] AMP: Loaded 32047 existing records from primary storage. [2025-10-06T22:34:32.070128] [INFO ] [MAIN ] AMH: Loaded 51739 primary data records. [2025-10-06T22:34:32.075612] [INFO ] [MAIN ] AMP: Loaded 32047 primary data records. [2025-10-06T22:34:32.863188] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:32.864189] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 41794 primary records. [2025-10-06T22:34:32.864473] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-06T22:34:32.887168] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-10-06T22:34:32.887436] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-06T22:34:32.891744] [INFO ] [MAIN ] Derivative Progress: 82/2037 symbols completed. AMN took 1.1s. Estimated remaining: 13m 16s. Rate: 147.4 symbols/min [2025-10-06T22:34:32.892056] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:32.918189] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:34:32.919796] [INFO ] [MAIN ] AMP: Generated 1793 derivative records from 32047 primary records. [2025-10-06T22:34:32.920426] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:32.920537] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-06T22:34:32.921669] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51739 primary records. [2025-10-06T22:34:32.922097] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-06T22:34:32.954947] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-10-06T22:34:32.955616] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-06T22:34:32.959018] [INFO ] [MAIN ] Derivative Progress: 83/2037 symbols completed. AMH took 1.2s. Estimated remaining: 13m 7s. Rate: 148.9 symbols/min [2025-10-06T22:34:32.959547] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:32.961350] [DEBUG] [LOCAL ] AMP: Derivative data saved (1793 records). [2025-10-06T22:34:32.961472] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-06T22:34:32.965431] [INFO ] [MAIN ] Derivative Progress: 84/2037 symbols completed. AMP took 1.1s. Estimated remaining: 12m 58s. Rate: 150.7 symbols/min [2025-10-06T22:34:32.965813] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:33.020026] [DEBUG] [LOCAL ] AMPX: Loaded 52317 existing records from primary storage. [2025-10-06T22:34:33.020331] [INFO ] [MAIN ] AMPX: Loaded 52317 primary data records. [2025-10-06T22:34:33.126842] [DEBUG] [LOCAL ] AMPY: Loaded 38281 existing records from primary storage. [2025-10-06T22:34:33.142997] [INFO ] [MAIN ] AMPY: Loaded 38281 primary data records. [2025-10-06T22:34:33.143566] [DEBUG] [LOCAL ] AMR: Loaded 29056 existing records from primary storage. [2025-10-06T22:34:33.143767] [INFO ] [MAIN ] AMR: Loaded 29056 primary data records. [2025-10-06T22:34:34.014397] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:34.015610] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52317 primary records. [2025-10-06T22:34:34.016019] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-06T22:34:34.033804] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-10-06T22:34:34.033944] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-06T22:34:34.035934] [INFO ] [MAIN ] Derivative Progress: 85/2037 symbols completed. AMPX took 1.1s. Estimated remaining: 13m 13s. Rate: 147.8 symbols/min [2025-10-06T22:34:34.036342] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:34.067901] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:34.067615] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:34.068915] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 29056 primary records. [2025-10-06T22:34:34.069803] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-06T22:34:34.069590] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 38281 primary records. [2025-10-06T22:34:34.077953] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-06T22:34:34.098714] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-10-06T22:34:34.098833] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-06T22:34:34.109164] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-10-06T22:34:34.109415] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-06T22:34:34.108157] [INFO ] [MAIN ] Derivative Progress: 86/2037 symbols completed. AMR took 1.1s. Estimated remaining: 13m 5s. Rate: 149.2 symbols/min [2025-10-06T22:34:34.112589] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:34.112719] [INFO ] [MAIN ] Derivative Progress: 87/2037 symbols completed. AMPY took 1.2s. Estimated remaining: 12m 55s. Rate: 150.9 symbols/min [2025-10-06T22:34:34.113071] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:34.142590] [DEBUG] [LOCAL ] AMRC: Loaded 38127 existing records from primary storage. [2025-10-06T22:34:34.142919] [INFO ] [MAIN ] AMRC: Loaded 38127 primary data records. [2025-10-06T22:34:34.291167] [DEBUG] [LOCAL ] AMTB: Loaded 20474 existing records from primary storage. [2025-10-06T22:34:34.302732] [INFO ] [MAIN ] AMTB: Loaded 20474 primary data records. [2025-10-06T22:34:34.553934] [DEBUG] [LOCAL ] AMT: Loaded 52434 existing records from primary storage. [2025-10-06T22:34:34.584961] [INFO ] [MAIN ] AMT: Loaded 52434 primary data records. [2025-10-06T22:34:35.213248] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:35.215489] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38127 primary records. [2025-10-06T22:34:35.215796] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-06T22:34:35.247151] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-10-06T22:34:35.252470] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-06T22:34:35.252365] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:35.254835] [INFO ] [MAIN ] Derivative Progress: 88/2037 symbols completed. AMRC took 1.2s. Estimated remaining: 13m 11s. Rate: 147.8 symbols/min [2025-10-06T22:34:35.255825] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20474 primary records. [2025-10-06T22:34:35.256315] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-06T22:34:35.289878] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:35.292122] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52434 primary records. [2025-10-06T22:34:35.292305] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-06T22:34:35.292225] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-10-06T22:34:35.293128] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-06T22:34:35.295586] [INFO ] [MAIN ] Derivative Progress: 89/2037 symbols completed. AMTB took 1.2s. Estimated remaining: 13m 3s. Rate: 149.3 symbols/min [2025-10-06T22:34:35.311116] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-10-06T22:34:35.311194] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-06T22:34:35.314666] [INFO ] [MAIN ] Derivative Progress: 90/2037 symbols completed. AMT took 1.2s. Estimated remaining: 12m 54s. Rate: 150.9 symbols/min [2025-10-06T22:34:35.315256] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:35.315414] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:35.315148] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:35.323990] [DEBUG] [LOCAL ] AMTD: Loaded 3680 existing records from primary storage. [2025-10-06T22:34:35.324174] [INFO ] [MAIN ] AMTD: Loaded 3680 primary data records. [2025-10-06T22:34:35.400162] [DEBUG] [LOCAL ] AMWL: Loaded 9077 existing records from primary storage. [2025-10-06T22:34:35.412142] [INFO ] [MAIN ] AMWL: Loaded 9077 primary data records. [2025-10-06T22:34:35.846106] [DEBUG] [LOCAL ] AMTM: Loaded 50676 existing records from primary storage. [2025-10-06T22:34:35.966925] [INFO ] [MAIN ] AMTM: Loaded 50676 primary data records. [2025-10-06T22:34:36.363293] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:36.364432] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3680 primary records. [2025-10-06T22:34:36.364736] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-06T22:34:36.378573] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:36.386130] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 9077 primary records. [2025-10-06T22:34:36.387695] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-06T22:34:36.408872] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-10-06T22:34:36.409205] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-06T22:34:36.412742] [INFO ] [MAIN ] Derivative Progress: 91/2037 symbols completed. AMWL took 1.1s. Estimated remaining: 13m 9s. Rate: 148.0 symbols/min [2025-10-06T22:34:36.414430] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:36.414164] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-10-06T22:34:36.414895] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-06T22:34:36.417698] [INFO ] [MAIN ] Derivative Progress: 92/2037 symbols completed. AMTD took 1.1s. Estimated remaining: 12m 60s. Rate: 149.6 symbols/min [2025-10-06T22:34:36.418415] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:36.436930] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:36.437832] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50676 primary records. [2025-10-06T22:34:36.437919] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-06T22:34:36.482315] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-10-06T22:34:36.482899] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-06T22:34:36.486359] [INFO ] [MAIN ] Derivative Progress: 93/2037 symbols completed. AMTM took 1.2s. Estimated remaining: 12m 53s. Rate: 151.0 symbols/min [2025-10-06T22:34:36.486671] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:36.498511] [DEBUG] [LOCAL ] AN: Loaded 31749 existing records from primary storage. [2025-10-06T22:34:36.498845] [INFO ] [MAIN ] AN: Loaded 31749 primary data records. [2025-10-06T22:34:36.682356] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-06T22:34:36.718674] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-06T22:34:36.942980] [DEBUG] [LOCAL ] ANF: Loaded 52099 existing records from primary storage. [2025-10-06T22:34:36.965910] [INFO ] [MAIN ] ANF: Loaded 52099 primary data records. [2025-10-06T22:34:37.493925] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:37.495618] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 31749 primary records. [2025-10-06T22:34:37.495890] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-06T22:34:37.514974] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-10-06T22:34:37.515849] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-06T22:34:37.518588] [INFO ] [MAIN ] Derivative Progress: 94/2037 symbols completed. AN took 1.1s. Estimated remaining: 13m 5s. Rate: 148.4 symbols/min [2025-10-06T22:34:37.519002] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:37.538581] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:37.539683] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-10-06T22:34:37.539995] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-06T22:34:37.573417] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-10-06T22:34:37.573593] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-06T22:34:37.572043] [DEBUG] [LOCAL ] ANRO: Loaded 19075 existing records from primary storage. [2025-10-06T22:34:37.576072] [INFO ] [MAIN ] Derivative Progress: 95/2037 symbols completed. ANET took 1.2s. Estimated remaining: 12m 58s. Rate: 149.8 symbols/min [2025-10-06T22:34:37.576500] [INFO ] [MAIN ] ANRO: Loaded 19075 primary data records. [2025-10-06T22:34:37.610253] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:37.619011] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:34:37.665841] [INFO ] [MAIN ] ANF: Generated 1793 derivative records from 52099 primary records. [2025-10-06T22:34:37.666024] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-06T22:34:37.736502] [DEBUG] [LOCAL ] ANF: Derivative data saved (1793 records). [2025-10-06T22:34:37.759501] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-06T22:34:37.762254] [INFO ] [MAIN ] Derivative Progress: 96/2037 symbols completed. ANF took 1.3s. Estimated remaining: 12m 53s. Rate: 150.6 symbols/min [2025-10-06T22:34:37.786468] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:37.925848] [DEBUG] [LOCAL ] ANVS: Loaded 23133 existing records from primary storage. [2025-10-06T22:34:37.926010] [INFO ] [MAIN ] ANVS: Loaded 23133 primary data records. [2025-10-06T22:34:38.132844] [DEBUG] [LOCAL ] AOD: Loaded 30491 existing records from primary storage. [2025-10-06T22:34:38.250861] [INFO ] [MAIN ] AOD: Loaded 30491 primary data records. [2025-10-06T22:34:38.644419] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:38.646316] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 19075 primary records. [2025-10-06T22:34:38.646679] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-06T22:34:38.669849] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-10-06T22:34:38.670827] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-06T22:34:38.673928] [INFO ] [MAIN ] Derivative Progress: 97/2037 symbols completed. ANRO took 1.2s. Estimated remaining: 13m 3s. Rate: 148.7 symbols/min [2025-10-06T22:34:38.674364] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:38.688200] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:38.689755] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23133 primary records. [2025-10-06T22:34:38.689965] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-06T22:34:38.709782] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-10-06T22:34:38.711271] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-06T22:34:38.721455] [INFO ] [MAIN ] Derivative Progress: 98/2037 symbols completed. ANVS took 1.1s. Estimated remaining: 12m 56s. Rate: 150.0 symbols/min [2025-10-06T22:34:38.734890] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:38.735615] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:38.736834] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30491 primary records. [2025-10-06T22:34:38.736928] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-06T22:34:38.753981] [DEBUG] [LOCAL ] AOMR: Loaded 16487 existing records from primary storage. [2025-10-06T22:34:38.757914] [INFO ] [MAIN ] AOMR: Loaded 16487 primary data records. [2025-10-06T22:34:38.847391] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-10-06T22:34:38.858073] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-06T22:34:38.861339] [INFO ] [MAIN ] Derivative Progress: 99/2037 symbols completed. AOD took 1.1s. Estimated remaining: 12m 50s. Rate: 151.0 symbols/min [2025-10-06T22:34:38.861586] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:39.002576] [DEBUG] [LOCAL ] AON: Loaded 45253 existing records from primary storage. [2025-10-06T22:34:39.011006] [INFO ] [MAIN ] AON: Loaded 45253 primary data records. [2025-10-06T22:34:39.194432] [DEBUG] [LOCAL ] AORT: Loaded 29334 existing records from primary storage. [2025-10-06T22:34:39.229384] [INFO ] [MAIN ] AORT: Loaded 29334 primary data records. [2025-10-06T22:34:39.853712] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:39.856557] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16487 primary records. [2025-10-06T22:34:39.856999] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-06T22:34:39.875358] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-10-06T22:34:39.875917] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-06T22:34:39.878489] [INFO ] [MAIN ] Derivative Progress: 100/2037 symbols completed. AOMR took 1.2s. Estimated remaining: 13m 2s. Rate: 148.7 symbols/min [2025-10-06T22:34:39.878860] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:39.917835] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:39.923636] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 29334 primary records. [2025-10-06T22:34:39.923801] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-06T22:34:39.922682] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:39.926026] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45253 primary records. [2025-10-06T22:34:39.924126] [DEBUG] [LOCAL ] AP: Loaded 7211 existing records from primary storage. [2025-10-06T22:34:39.926581] [INFO ] [MAIN ] AP: Loaded 7211 primary data records. [2025-10-06T22:34:39.926749] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-06T22:34:40.027237] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-10-06T22:34:40.038067] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-06T22:34:40.047730] [INFO ] [MAIN ] Derivative Progress: 101/2037 symbols completed. AORT took 1.2s. Estimated remaining: 12m 57s. Rate: 149.5 symbols/min [2025-10-06T22:34:40.059537] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:40.072967] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-10-06T22:34:40.073924] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-06T22:34:40.078181] [INFO ] [MAIN ] Derivative Progress: 102/2037 symbols completed. AON took 1.3s. Estimated remaining: 12m 49s. Rate: 150.9 symbols/min [2025-10-06T22:34:40.089448] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:40.336939] [DEBUG] [LOCAL ] APAM: Loaded 36068 existing records from primary storage. [2025-10-06T22:34:40.337316] [INFO ] [MAIN ] APAM: Loaded 36068 primary data records. [2025-10-06T22:34:40.508175] [DEBUG] [LOCAL ] APD: Loaded 45311 existing records from primary storage. [2025-10-06T22:34:40.545383] [INFO ] [MAIN ] APD: Loaded 45311 primary data records. [2025-10-06T22:34:40.821978] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:40.833031] [INFO ] [MAIN ] AP: Generated 1794 derivative records from 7211 primary records. [2025-10-06T22:34:40.838427] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-06T22:34:40.925786] [DEBUG] [LOCAL ] AP: Derivative data saved (1794 records). [2025-10-06T22:34:41.046073] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-06T22:34:41.050093] [INFO ] [MAIN ] Derivative Progress: 103/2037 symbols completed. AP took 1.2s. Estimated remaining: 12m 60s. Rate: 148.8 symbols/min [2025-10-06T22:34:41.073035] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:41.074179] [INFO ] [MAIN ] APAM: Generated 1794 derivative records from 36068 primary records. [2025-10-06T22:34:41.074368] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-06T22:34:41.091071] [DEBUG] [LOCAL ] APAM: Derivative data saved (1794 records). [2025-10-06T22:34:41.091413] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-10-06T22:34:41.094718] [INFO ] [MAIN ] Derivative Progress: 104/2037 symbols completed. APAM took 1.0s. Estimated remaining: 12m 53s. Rate: 150.1 symbols/min [2025-10-06T22:34:41.111352] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:41.112145] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45311 primary records. [2025-10-06T22:34:41.112212] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-06T22:34:41.127720] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-10-06T22:34:41.127797] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-06T22:34:41.131870] [INFO ] [MAIN ] Derivative Progress: 105/2037 symbols completed. APD took 1.0s. Estimated remaining: 12m 46s. Rate: 151.4 symbols/min [2025-10-06T22:34:41.132385] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:41.132600] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:41.132814] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:41.239210] [DEBUG] [LOCAL ] APO: Loaded 53383 existing records from primary storage. [2025-10-06T22:34:41.240133] [DEBUG] [LOCAL ] APTV: Loaded 52044 existing records from primary storage. [2025-10-06T22:34:41.241359] [INFO ] [MAIN ] APO: Loaded 53383 primary data records. [2025-10-06T22:34:41.241503] [INFO ] [MAIN ] APTV: Loaded 52044 primary data records. [2025-10-06T22:34:41.241120] [DEBUG] [LOCAL ] APG: Loaded 50360 existing records from primary storage. [2025-10-06T22:34:41.242015] [INFO ] [MAIN ] APG: Loaded 50360 primary data records. [2025-10-06T22:34:42.426824] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:42.428104] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53383 primary records. [2025-10-06T22:34:42.436750] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-06T22:34:42.437224] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:42.449986] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 52044 primary records. [2025-10-06T22:34:42.458902] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-06T22:34:42.480804] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-10-06T22:34:42.499398] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-06T22:34:42.501964] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-10-06T22:34:42.506173] [INFO ] [MAIN ] Derivative Progress: 106/2037 symbols completed. APO took 1.4s. Estimated remaining: 13m 3s. Rate: 148.0 symbols/min [2025-10-06T22:34:42.506680] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:42.506889] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-06T22:34:42.507557] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:42.508609] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50360 primary records. [2025-10-06T22:34:42.511307] [INFO ] [MAIN ] Derivative Progress: 107/2037 symbols completed. APTV took 1.4s. Estimated remaining: 12m 55s. Rate: 149.3 symbols/min [2025-10-06T22:34:42.512125] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-06T22:34:42.512270] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:42.537078] [DEBUG] [LOCAL ] AQNB: Loaded 4138 existing records from primary storage. [2025-10-06T22:34:42.539856] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-10-06T22:34:42.540053] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-06T22:34:42.538437] [INFO ] [MAIN ] AQNB: Loaded 4138 primary data records. [2025-10-06T22:34:42.544208] [INFO ] [MAIN ] Derivative Progress: 108/2037 symbols completed. APG took 1.4s. Estimated remaining: 12m 48s. Rate: 150.6 symbols/min [2025-10-06T22:34:42.560719] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:42.839320] [DEBUG] [LOCAL ] AQN: Loaded 51873 existing records from primary storage. [2025-10-06T22:34:42.871472] [INFO ] [MAIN ] AQN: Loaded 51873 primary data records. [2025-10-06T22:34:43.141537] [DEBUG] [LOCAL ] AR: Loaded 53587 existing records from primary storage. [2025-10-06T22:34:43.147812] [INFO ] [MAIN ] AR: Loaded 53587 primary data records. [2025-10-06T22:34:43.674287] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:43.676138] [INFO ] [MAIN ] AQNB: Generated 1794 derivative records from 4138 primary records. [2025-10-06T22:34:43.677302] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-06T22:34:43.692246] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:43.705235] [INFO ] [MAIN ] AQN: Generated 1794 derivative records from 51873 primary records. [2025-10-06T22:34:43.705978] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-10-06T22:34:43.710196] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1794 records). [2025-10-06T22:34:43.710558] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-06T22:34:43.713213] [INFO ] [MAIN ] Derivative Progress: 109/2037 symbols completed. AQNB took 1.2s. Estimated remaining: 13m 2s. Rate: 148.0 symbols/min [2025-10-06T22:34:43.728484] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:43.731011] [DEBUG] [LOCAL ] AQN: Derivative data saved (1794 records). [2025-10-06T22:34:43.731942] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-10-06T22:34:43.734958] [INFO ] [MAIN ] Derivative Progress: 110/2037 symbols completed. AQN took 1.2s. Estimated remaining: 12m 54s. Rate: 149.3 symbols/min [2025-10-06T22:34:43.735594] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:43.750456] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:43.751400] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53587 primary records. [2025-10-06T22:34:43.751476] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-06T22:34:43.769486] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-10-06T22:34:43.773395] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-06T22:34:43.777299] [INFO ] [MAIN ] Derivative Progress: 111/2037 symbols completed. AR took 1.2s. Estimated remaining: 12m 48s. Rate: 150.5 symbols/min [2025-10-06T22:34:43.780622] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:43.789767] [DEBUG] [LOCAL ] ARDC: Loaded 14954 existing records from primary storage. [2025-10-06T22:34:43.790092] [INFO ] [MAIN ] ARDC: Loaded 14954 primary data records. [2025-10-06T22:34:44.121421] [DEBUG] [LOCAL ] ARDT: Loaded 27708 existing records from primary storage. [2025-10-06T22:34:44.120875] [DEBUG] [LOCAL ] ARCO: Loaded 44349 existing records from primary storage. [2025-10-06T22:34:44.135035] [INFO ] [MAIN ] ARDT: Loaded 27708 primary data records. [2025-10-06T22:34:44.134976] [INFO ] [MAIN ] ARCO: Loaded 44349 primary data records. [2025-10-06T22:34:44.890763] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:44.893270] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 14954 primary records. [2025-10-06T22:34:44.893793] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-06T22:34:44.911251] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-10-06T22:34:44.912621] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-06T22:34:44.915122] [INFO ] [MAIN ] Derivative Progress: 112/2037 symbols completed. ARDC took 1.2s. Estimated remaining: 13m 0s. Rate: 148.0 symbols/min [2025-10-06T22:34:44.917224] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:44.941174] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:44.942539] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 27708 primary records. [2025-10-06T22:34:44.942973] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-06T22:34:44.963939] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-10-06T22:34:44.964844] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-06T22:34:44.968543] [INFO ] [MAIN ] Derivative Progress: 113/2037 symbols completed. ARDT took 1.2s. Estimated remaining: 12m 54s. Rate: 149.2 symbols/min [2025-10-06T22:34:44.969163] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:44.983328] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:44.984305] [INFO ] [MAIN ] ARCO: Generated 1794 derivative records from 44349 primary records. [2025-10-06T22:34:44.984505] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-06T22:34:45.017149] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1794 records). [2025-10-06T22:34:45.017327] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-10-06T22:34:45.021032] [INFO ] [MAIN ] Derivative Progress: 114/2037 symbols completed. ARCO took 1.3s. Estimated remaining: 12m 47s. Rate: 150.3 symbols/min [2025-10-06T22:34:45.021478] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:45.042254] [DEBUG] [LOCAL ] ARE: Loaded 50684 existing records from primary storage. [2025-10-06T22:34:45.042627] [INFO ] [MAIN ] ARE: Loaded 50684 primary data records. [2025-10-06T22:34:45.217223] [DEBUG] [LOCAL ] ARI: Loaded 43598 existing records from primary storage. [2025-10-06T22:34:45.274717] [INFO ] [MAIN ] ARI: Loaded 43598 primary data records. [2025-10-06T22:34:45.467979] [DEBUG] [LOCAL ] ARIS: Loaded 42261 existing records from primary storage. [2025-10-06T22:34:45.497318] [INFO ] [MAIN ] ARIS: Loaded 42261 primary data records. [2025-10-06T22:34:46.109489] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:46.111368] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50684 primary records. [2025-10-06T22:34:46.112047] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-06T22:34:46.136854] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-10-06T22:34:46.137086] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-06T22:34:46.140249] [INFO ] [MAIN ] Derivative Progress: 115/2037 symbols completed. ARE took 1.2s. Estimated remaining: 12m 59s. Rate: 148.0 symbols/min [2025-10-06T22:34:46.141001] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:46.157294] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:46.160700] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43598 primary records. [2025-10-06T22:34:46.160906] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-06T22:34:46.185183] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:46.189243] [INFO ] [MAIN ] ARIS: Generated 1794 derivative records from 42261 primary records. [2025-10-06T22:34:46.192909] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-10-06T22:34:46.194194] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-10-06T22:34:46.203470] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-06T22:34:46.206728] [INFO ] [MAIN ] Derivative Progress: 116/2037 symbols completed. ARI took 1.2s. Estimated remaining: 12m 53s. Rate: 149.1 symbols/min [2025-10-06T22:34:46.226006] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1794 records). [2025-10-06T22:34:46.226594] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-10-06T22:34:46.229726] [INFO ] [MAIN ] Derivative Progress: 117/2037 symbols completed. ARIS took 1.2s. Estimated remaining: 12m 46s. Rate: 150.3 symbols/min [2025-10-06T22:34:46.230074] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:46.226281] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:46.250285] [DEBUG] [LOCAL ] ARLO: Loaded 43824 existing records from primary storage. [2025-10-06T22:34:46.250719] [INFO ] [MAIN ] ARLO: Loaded 43824 primary data records. [2025-10-06T22:34:46.590156] [DEBUG] [LOCAL ] AROC: Loaded 48939 existing records from primary storage. [2025-10-06T22:34:46.604085] [INFO ] [MAIN ] AROC: Loaded 48939 primary data records. [2025-10-06T22:34:46.680168] [DEBUG] [LOCAL ] ARMK: Loaded 50402 existing records from primary storage. [2025-10-06T22:34:46.701835] [INFO ] [MAIN ] ARMK: Loaded 50402 primary data records. [2025-10-06T22:34:47.404597] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:47.405885] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 43824 primary records. [2025-10-06T22:34:47.407402] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-06T22:34:47.433372] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-10-06T22:34:47.433876] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-06T22:34:47.437688] [INFO ] [MAIN ] Derivative Progress: 118/2037 symbols completed. ARLO took 1.3s. Estimated remaining: 12m 59s. Rate: 147.8 symbols/min [2025-10-06T22:34:47.476762] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:47.478709] [INFO ] [MAIN ] ARMK: Generated 1794 derivative records from 50402 primary records. [2025-10-06T22:34:47.477416] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:47.478924] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-06T22:34:47.479977] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 48939 primary records. [2025-10-06T22:34:47.481300] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-06T22:34:47.507531] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1794 records). [2025-10-06T22:34:47.511988] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-06T22:34:47.516304] [INFO ] [MAIN ] Derivative Progress: 119/2037 symbols completed. ARMK took 1.3s. Estimated remaining: 12m 54s. Rate: 148.8 symbols/min [2025-10-06T22:34:47.521117] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-10-06T22:34:47.521499] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-06T22:34:47.525327] [INFO ] [MAIN ] Derivative Progress: 120/2037 symbols completed. AROC took 1.3s. Estimated remaining: 12m 47s. Rate: 150.0 symbols/min [2025-10-06T22:34:47.525865] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:47.525980] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:47.526182] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:47.616365] [DEBUG] [LOCAL ] ARR: Loaded 52043 existing records from primary storage. [2025-10-06T22:34:47.616740] [INFO ] [MAIN ] ARR: Loaded 52043 primary data records. [2025-10-06T22:34:47.680443] [DEBUG] [LOCAL ] AS: Loaded 53091 existing records from primary storage. [2025-10-06T22:34:47.706706] [INFO ] [MAIN ] AS: Loaded 53091 primary data records. [2025-10-06T22:34:47.679422] [DEBUG] [LOCAL ] ARW: Loaded 32957 existing records from primary storage. [2025-10-06T22:34:47.752958] [INFO ] [MAIN ] ARW: Loaded 32957 primary data records. [2025-10-06T22:34:48.656887] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:48.658578] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52043 primary records. [2025-10-06T22:34:48.659003] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-06T22:34:48.658910] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:34:48.660361] [INFO ] [MAIN ] AS: Generated 1793 derivative records from 53091 primary records. [2025-10-06T22:34:48.661816] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-06T22:34:48.701751] [DEBUG] [LOCAL ] AS: Derivative data saved (1793 records). [2025-10-06T22:34:48.707157] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-06T22:34:48.707792] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:48.711769] [INFO ] [MAIN ] Derivative Progress: 121/2037 symbols completed. AS took 1.2s. Estimated remaining: 12m 59s. Rate: 147.6 symbols/min [2025-10-06T22:34:48.711939] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:48.708918] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 32957 primary records. [2025-10-06T22:34:48.712380] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-06T22:34:48.725824] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-10-06T22:34:48.730760] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-06T22:34:48.734126] [INFO ] [MAIN ] Derivative Progress: 122/2037 symbols completed. ARR took 1.2s. Estimated remaining: 12m 52s. Rate: 148.8 symbols/min [2025-10-06T22:34:48.736336] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:48.738217] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-10-06T22:34:48.742015] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-06T22:34:48.745522] [INFO ] [MAIN ] Derivative Progress: 123/2037 symbols completed. ARW took 1.2s. Estimated remaining: 12m 46s. Rate: 149.9 symbols/min [2025-10-06T22:34:48.745859] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:48.754189] [DEBUG] [LOCAL ] ASA: Loaded 14356 existing records from primary storage. [2025-10-06T22:34:48.754432] [INFO ] [MAIN ] ASA: Loaded 14356 primary data records. [2025-10-06T22:34:49.159922] [DEBUG] [LOCAL ] ASAN: Loaded 52722 existing records from primary storage. [2025-10-06T22:34:49.158540] [DEBUG] [LOCAL ] ASB: Loaded 49543 existing records from primary storage. [2025-10-06T22:34:49.161139] [INFO ] [MAIN ] ASAN: Loaded 52722 primary data records. [2025-10-06T22:34:49.161867] [INFO ] [MAIN ] ASB: Loaded 49543 primary data records. [2025-10-06T22:34:49.798264] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:49.799627] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 14356 primary records. [2025-10-06T22:34:49.800209] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-06T22:34:49.821580] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-10-06T22:34:49.822075] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-06T22:34:49.824517] [INFO ] [MAIN ] Derivative Progress: 124/2037 symbols completed. ASA took 1.1s. Estimated remaining: 12m 56s. Rate: 147.9 symbols/min [2025-10-06T22:34:49.824712] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:49.842985] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:49.843968] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52722 primary records. [2025-10-06T22:34:49.844402] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-06T22:34:49.847613] [DEBUG] [LOCAL ] ASBA: Loaded 3477 existing records from primary storage. [2025-10-06T22:34:49.850300] [INFO ] [MAIN ] ASBA: Loaded 3477 primary data records. [2025-10-06T22:34:49.914310] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:49.923276] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-10-06T22:34:49.935402] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-06T22:34:49.951341] [INFO ] [MAIN ] Derivative Progress: 125/2037 symbols completed. ASAN took 1.2s. Estimated remaining: 12m 51s. Rate: 148.7 symbols/min [2025-10-06T22:34:49.922492] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49543 primary records. [2025-10-06T22:34:49.963163] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-06T22:34:49.968440] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:50.214483] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-10-06T22:34:50.215042] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-06T22:34:50.218958] [INFO ] [MAIN ] Derivative Progress: 126/2037 symbols completed. ASB took 1.5s. Estimated remaining: 12m 49s. Rate: 149.1 symbols/min [2025-10-06T22:34:50.219302] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:50.235831] [DEBUG] [LOCAL ] ASC: Loaded 37386 existing records from primary storage. [2025-10-06T22:34:50.236312] [INFO ] [MAIN ] ASC: Loaded 37386 primary data records. [2025-10-06T22:34:50.347673] [DEBUG] [LOCAL ] ASG: Loaded 19758 existing records from primary storage. [2025-10-06T22:34:50.350991] [INFO ] [MAIN ] ASG: Loaded 19758 primary data records. [2025-10-06T22:34:50.666172] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:50.683631] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3477 primary records. [2025-10-06T22:34:50.689816] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-06T22:34:50.887959] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-10-06T22:34:50.889023] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-06T22:34:50.891146] [INFO ] [MAIN ] Derivative Progress: 127/2037 symbols completed. ASBA took 1.1s. Estimated remaining: 12m 53s. Rate: 148.3 symbols/min [2025-10-06T22:34:50.891355] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:50.925824] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:50.926817] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37386 primary records. [2025-10-06T22:34:50.927447] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-06T22:34:50.943994] [DEBUG] [LOCAL ] ASGI: Loaded 22716 existing records from primary storage. [2025-10-06T22:34:50.948008] [INFO ] [MAIN ] ASGI: Loaded 22716 primary data records. [2025-10-06T22:34:50.984681] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-10-06T22:34:51.009369] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-06T22:34:51.032282] [INFO ] [MAIN ] Derivative Progress: 128/2037 symbols completed. ASC took 1.1s. Estimated remaining: 12m 48s. Rate: 149.1 symbols/min [2025-10-06T22:34:51.069011] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:51.072729] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:51.085106] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 19758 primary records. [2025-10-06T22:34:51.095614] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-06T22:34:51.337166] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-10-06T22:34:51.338744] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-06T22:34:51.350842] [INFO ] [MAIN ] Derivative Progress: 129/2037 symbols completed. ASG took 1.1s. Estimated remaining: 12m 47s. Rate: 149.3 symbols/min [2025-10-06T22:34:51.351622] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:51.371309] [DEBUG] [LOCAL ] ASGN: Loaded 36354 existing records from primary storage. [2025-10-06T22:34:51.372106] [INFO ] [MAIN ] ASGN: Loaded 36354 primary data records. [2025-10-06T22:34:51.504753] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:51.527381] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22716 primary records. [2025-10-06T22:34:51.553117] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-06T22:34:51.617714] [DEBUG] [LOCAL ] ASH: Loaded 37623 existing records from primary storage. [2025-10-06T22:34:51.747398] [INFO ] [MAIN ] ASH: Loaded 37623 primary data records. [2025-10-06T22:34:51.869090] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-10-06T22:34:51.873752] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-06T22:34:51.951677] [INFO ] [MAIN ] Derivative Progress: 130/2037 symbols completed. ASGI took 1.1s. Estimated remaining: 12m 49s. Rate: 148.8 symbols/min [2025-10-06T22:34:52.075992] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:52.103181] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:52.104505] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 36354 primary records. [2025-10-06T22:34:52.104921] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-06T22:34:52.130670] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-10-06T22:34:52.131206] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-06T22:34:52.142720] [INFO ] [MAIN ] Derivative Progress: 131/2037 symbols completed. ASGN took 1.1s. Estimated remaining: 12m 46s. Rate: 149.4 symbols/min [2025-10-06T22:34:52.143178] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:52.147023] [DEBUG] [LOCAL ] ASIX: Loaded 22788 existing records from primary storage. [2025-10-06T22:34:52.147891] [INFO ] [MAIN ] ASIX: Loaded 22788 primary data records. [2025-10-06T22:34:52.241914] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:52.285632] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37623 primary records. [2025-10-06T22:34:52.291147] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-06T22:34:52.546061] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-10-06T22:34:52.546271] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-06T22:34:52.547572] [DEBUG] [LOCAL ] ASPN: Loaded 49662 existing records from primary storage. [2025-10-06T22:34:52.551461] [INFO ] [MAIN ] Derivative Progress: 132/2037 symbols completed. ASH took 1.2s. Estimated remaining: 12m 45s. Rate: 149.4 symbols/min [2025-10-06T22:34:52.552250] [INFO ] [MAIN ] ASPN: Loaded 49662 primary data records. [2025-10-06T22:34:52.552947] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:52.700229] [DEBUG] [LOCAL ] ASR: Loaded 9308 existing records from primary storage. [2025-10-06T22:34:52.739865] [INFO ] [MAIN ] ASR: Loaded 9308 primary data records. [2025-10-06T22:34:53.034975] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:53.061850] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 22788 primary records. [2025-10-06T22:34:53.092254] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-06T22:34:53.286287] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-10-06T22:34:53.286742] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-06T22:34:53.289840] [INFO ] [MAIN ] Derivative Progress: 133/2037 symbols completed. ASIX took 1.2s. Estimated remaining: 12m 50s. Rate: 148.4 symbols/min [2025-10-06T22:34:53.311368] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:53.312348] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49662 primary records. [2025-10-06T22:34:53.312533] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-06T22:34:53.329572] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-10-06T22:34:53.330236] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-06T22:34:53.332962] [INFO ] [MAIN ] Derivative Progress: 134/2037 symbols completed. ASPN took 1.2s. Estimated remaining: 12m 44s. Rate: 149.4 symbols/min [2025-10-06T22:34:53.347019] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:53.347700] [INFO ] [MAIN ] ASR: Generated 1794 derivative records from 9308 primary records. [2025-10-06T22:34:53.347765] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-06T22:34:53.363445] [DEBUG] [LOCAL ] ASR: Derivative data saved (1794 records). [2025-10-06T22:34:53.363532] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-06T22:34:53.366586] [INFO ] [MAIN ] Derivative Progress: 135/2037 symbols completed. ASR took 0.8s. Estimated remaining: 12m 39s. Rate: 150.4 symbols/min [2025-10-06T22:34:53.367160] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:53.367079] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:53.367408] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:53.422483] [DEBUG] [LOCAL ] ATGE: Loaded 31195 existing records from primary storage. [2025-10-06T22:34:53.422687] [INFO ] [MAIN ] ATGE: Loaded 31195 primary data records. [2025-10-06T22:34:53.537814] [DEBUG] [LOCAL ] ATEN: Loaded 39011 existing records from primary storage. [2025-10-06T22:34:53.559601] [INFO ] [MAIN ] ATEN: Loaded 39011 primary data records. [2025-10-06T22:34:53.608862] [DEBUG] [LOCAL ] ASX: Loaded 52844 existing records from primary storage. [2025-10-06T22:34:53.667102] [INFO ] [MAIN ] ASX: Loaded 52844 primary data records. [2025-10-06T22:34:54.423614] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:54.424625] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 31195 primary records. [2025-10-06T22:34:54.426166] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-06T22:34:54.443698] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-10-06T22:34:54.443767] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-06T22:34:54.446060] [INFO ] [MAIN ] Derivative Progress: 136/2037 symbols completed. ATGE took 1.1s. Estimated remaining: 12m 48s. Rate: 148.6 symbols/min [2025-10-06T22:34:54.446425] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:54.466142] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:54.478898] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 39011 primary records. [2025-10-06T22:34:54.479001] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-06T22:34:54.488804] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:54.489503] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52844 primary records. [2025-10-06T22:34:54.493493] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-06T22:34:54.499082] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-10-06T22:34:54.506871] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-06T22:34:54.509781] [INFO ] [MAIN ] Derivative Progress: 137/2037 symbols completed. ATEN took 1.1s. Estimated remaining: 12m 43s. Rate: 149.5 symbols/min [2025-10-06T22:34:54.518068] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:54.534496] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-10-06T22:34:54.537222] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-06T22:34:54.541092] [INFO ] [MAIN ] Derivative Progress: 138/2037 symbols completed. ASX took 1.2s. Estimated remaining: 12m 37s. Rate: 150.5 symbols/min [2025-10-06T22:34:54.537821] [DEBUG] [LOCAL ] ATHM: Loaded 31969 existing records from primary storage. [2025-10-06T22:34:54.541521] [INFO ] [MAIN ] ATHM: Loaded 31969 primary data records. [2025-10-06T22:34:54.541372] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:54.575770] [DEBUG] [LOCAL ] ATHS: Loaded 6841 existing records from primary storage. [2025-10-06T22:34:54.581081] [INFO ] [MAIN ] ATHS: Loaded 6841 primary data records. [2025-10-06T22:34:55.240675] [DEBUG] [LOCAL ] ATI: Loaded 51479 existing records from primary storage. [2025-10-06T22:34:55.242917] [INFO ] [MAIN ] ATI: Loaded 51479 primary data records. [2025-10-06T22:34:55.611163] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:55.610710] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:55.613688] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 6841 primary records. [2025-10-06T22:34:55.612401] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 31969 primary records. [2025-10-06T22:34:55.614027] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-06T22:34:55.614185] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-06T22:34:55.647286] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-10-06T22:34:55.648597] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-06T22:34:55.648493] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-10-06T22:34:55.651762] [INFO ] [MAIN ] Derivative Progress: 139/2037 symbols completed. ATHS took 1.1s. Estimated remaining: 12m 46s. Rate: 148.6 symbols/min [2025-10-06T22:34:55.651989] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-06T22:34:55.652405] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:55.655230] [INFO ] [MAIN ] Derivative Progress: 140/2037 symbols completed. ATHM took 1.2s. Estimated remaining: 12m 41s. Rate: 149.7 symbols/min [2025-10-06T22:34:55.656311] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:55.676979] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:55.677751] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51479 primary records. [2025-10-06T22:34:55.677815] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-06T22:34:55.703587] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-10-06T22:34:55.703806] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-06T22:34:55.706686] [INFO ] [MAIN ] Derivative Progress: 141/2037 symbols completed. ATI took 1.2s. Estimated remaining: 12m 35s. Rate: 150.6 symbols/min [2025-10-06T22:34:55.707066] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:55.733723] [DEBUG] [LOCAL ] ATKR: Loaded 35582 existing records from primary storage. [2025-10-06T22:34:55.734010] [INFO ] [MAIN ] ATKR: Loaded 35582 primary data records. [2025-10-06T22:34:55.815788] [DEBUG] [LOCAL ] ATMU: Loaded 39252 existing records from primary storage. [2025-10-06T22:34:55.825380] [INFO ] [MAIN ] ATMU: Loaded 39252 primary data records. [2025-10-06T22:34:56.056684] [DEBUG] [LOCAL ] ATO: Loaded 41911 existing records from primary storage. [2025-10-06T22:34:56.107590] [INFO ] [MAIN ] ATO: Loaded 41911 primary data records. [2025-10-06T22:34:56.761498] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:56.764465] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35582 primary records. [2025-10-06T22:34:56.764789] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-06T22:34:56.795121] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:56.798610] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 39252 primary records. [2025-10-06T22:34:56.799291] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-06T22:34:56.802048] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-10-06T22:34:56.802489] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-06T22:34:56.805032] [INFO ] [MAIN ] Derivative Progress: 142/2037 symbols completed. ATKR took 1.2s. Estimated remaining: 12m 44s. Rate: 148.7 symbols/min [2025-10-06T22:34:56.805226] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:56.837781] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:56.840157] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-10-06T22:34:56.841728] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-06T22:34:56.845367] [INFO ] [MAIN ] Derivative Progress: 143/2037 symbols completed. ATMU took 1.2s. Estimated remaining: 12m 39s. Rate: 149.7 symbols/min [2025-10-06T22:34:56.841439] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 41911 primary records. [2025-10-06T22:34:56.845696] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-06T22:34:56.845852] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:56.873324] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-10-06T22:34:56.873576] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-06T22:34:56.876891] [INFO ] [MAIN ] Derivative Progress: 144/2037 symbols completed. ATO took 1.2s. Estimated remaining: 12m 34s. Rate: 150.6 symbols/min [2025-10-06T22:34:56.877076] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:56.893630] [DEBUG] [LOCAL ] ATR: Loaded 30579 existing records from primary storage. [2025-10-06T22:34:56.893981] [INFO ] [MAIN ] ATR: Loaded 30579 primary data records. [2025-10-06T22:34:56.969109] [DEBUG] [LOCAL ] ATS: Loaded 17765 existing records from primary storage. [2025-10-06T22:34:57.007408] [INFO ] [MAIN ] ATS: Loaded 17765 primary data records. [2025-10-06T22:34:57.362898] [DEBUG] [LOCAL ] ATUS: Loaded 49415 existing records from primary storage. [2025-10-06T22:34:57.363587] [INFO ] [MAIN ] ATUS: Loaded 49415 primary data records. [2025-10-06T22:34:58.001209] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:58.002316] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30579 primary records. [2025-10-06T22:34:58.002829] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-06T22:34:58.028354] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-10-06T22:34:58.029213] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-06T22:34:58.031443] [INFO ] [MAIN ] Derivative Progress: 145/2037 symbols completed. ATR took 1.2s. Estimated remaining: 12m 43s. Rate: 148.7 symbols/min [2025-10-06T22:34:58.032801] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:58.047534] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:58.048786] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 17765 primary records. [2025-10-06T22:34:58.049010] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-06T22:34:58.068159] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-10-06T22:34:58.076231] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-06T22:34:58.084991] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:58.084572] [INFO ] [MAIN ] Derivative Progress: 146/2037 symbols completed. ATS took 1.2s. Estimated remaining: 12m 38s. Rate: 149.6 symbols/min [2025-10-06T22:34:58.085342] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:58.086342] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49415 primary records. [2025-10-06T22:34:58.086875] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-06T22:34:58.117064] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-10-06T22:34:58.117288] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-06T22:34:58.120722] [INFO ] [MAIN ] Derivative Progress: 147/2037 symbols completed. ATUS took 1.2s. Estimated remaining: 12m 33s. Rate: 150.5 symbols/min [2025-10-06T22:34:58.121127] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:58.145587] [DEBUG] [LOCAL ] AUNA: Loaded 4983 existing records from primary storage. [2025-10-06T22:34:58.145914] [INFO ] [MAIN ] AUNA: Loaded 4983 primary data records. [2025-10-06T22:34:58.168360] [DEBUG] [LOCAL ] AU: Loaded 52996 existing records from primary storage. [2025-10-06T22:34:58.203023] [INFO ] [MAIN ] AU: Loaded 52996 primary data records. [2025-10-06T22:34:58.462840] [DEBUG] [LOCAL ] AUB: Loaded 46259 existing records from primary storage. [2025-10-06T22:34:58.472816] [INFO ] [MAIN ] AUB: Loaded 46259 primary data records. [2025-10-06T22:34:59.139011] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:59.140478] [INFO ] [MAIN ] AUNA: Generated 1794 derivative records from 4983 primary records. [2025-10-06T22:34:59.140862] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-06T22:34:59.162711] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-10-06T22:34:59.162979] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-06T22:34:59.166052] [INFO ] [MAIN ] Derivative Progress: 148/2037 symbols completed. AUNA took 1.0s. Estimated remaining: 12m 41s. Rate: 148.9 symbols/min [2025-10-06T22:34:59.180311] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:59.181189] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 52996 primary records. [2025-10-06T22:34:59.181421] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-06T22:34:59.214779] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:34:59.216084] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-10-06T22:34:59.216951] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46259 primary records. [2025-10-06T22:34:59.217184] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-06T22:34:59.220508] [INFO ] [MAIN ] Derivative Progress: 149/2037 symbols completed. AU took 1.2s. Estimated remaining: 12m 36s. Rate: 149.8 symbols/min [2025-10-06T22:34:59.217323] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-06T22:34:59.236663] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-10-06T22:34:59.236785] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-06T22:34:59.240127] [INFO ] [MAIN ] Derivative Progress: 150/2037 symbols completed. AUB took 1.2s. Estimated remaining: 12m 31s. Rate: 150.7 symbols/min [2025-10-06T22:34:59.240852] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:59.241143] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:59.241008] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:34:59.271767] [DEBUG] [LOCAL ] AVD: Loaded 22424 existing records from primary storage. [2025-10-06T22:34:59.272097] [INFO ] [MAIN ] AVD: Loaded 22424 primary data records. [2025-10-06T22:34:59.461149] [DEBUG] [LOCAL ] AVA: Loaded 39355 existing records from primary storage. [2025-10-06T22:34:59.485752] [INFO ] [MAIN ] AVA: Loaded 39355 primary data records. [2025-10-06T22:34:59.514450] [DEBUG] [LOCAL ] AVB: Loaded 42045 existing records from primary storage. [2025-10-06T22:34:59.714410] [INFO ] [MAIN ] AVB: Loaded 42045 primary data records. [2025-10-06T22:35:00.380195] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:00.382809] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 22424 primary records. [2025-10-06T22:35:00.383075] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-06T22:35:00.411671] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-10-06T22:35:00.424830] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-06T22:35:00.428220] [INFO ] [MAIN ] Derivative Progress: 151/2037 symbols completed. AVD took 1.2s. Estimated remaining: 12m 41s. Rate: 148.8 symbols/min [2025-10-06T22:35:00.428460] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:00.430050] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:00.431445] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 39355 primary records. [2025-10-06T22:35:00.431880] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-06T22:35:00.452756] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-10-06T22:35:00.452860] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-06T22:35:00.456037] [INFO ] [MAIN ] Derivative Progress: 152/2037 symbols completed. AVA took 1.2s. Estimated remaining: 12m 36s. Rate: 149.7 symbols/min [2025-10-06T22:35:00.456543] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:00.472574] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:00.473877] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 42045 primary records. [2025-10-06T22:35:00.480192] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-06T22:35:00.510818] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-10-06T22:35:00.510959] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-06T22:35:00.508628] [DEBUG] [LOCAL ] AVK: Loaded 18166 existing records from primary storage. [2025-10-06T22:35:00.515137] [INFO ] [MAIN ] Derivative Progress: 153/2037 symbols completed. AVB took 1.3s. Estimated remaining: 12m 31s. Rate: 150.5 symbols/min [2025-10-06T22:35:00.515290] [INFO ] [MAIN ] AVK: Loaded 18166 primary data records. [2025-10-06T22:35:00.515541] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:00.634219] [DEBUG] [LOCAL ] AVNS: Loaded 33703 existing records from primary storage. [2025-10-06T22:35:00.657698] [INFO ] [MAIN ] AVNS: Loaded 33703 primary data records. [2025-10-06T22:35:01.236344] [DEBUG] [LOCAL ] AVTR: Loaded 53567 existing records from primary storage. [2025-10-06T22:35:01.236863] [INFO ] [MAIN ] AVTR: Loaded 53567 primary data records. [2025-10-06T22:35:01.635679] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:01.637368] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 18166 primary records. [2025-10-06T22:35:01.637831] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-06T22:35:01.673364] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-10-06T22:35:01.673479] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-06T22:35:01.675901] [INFO ] [MAIN ] Derivative Progress: 154/2037 symbols completed. AVK took 1.2s. Estimated remaining: 12m 40s. Rate: 148.7 symbols/min [2025-10-06T22:35:01.672776] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:01.677224] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33703 primary records. [2025-10-06T22:35:01.676210] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:01.677489] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-06T22:35:01.695971] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-10-06T22:35:01.696371] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-06T22:35:01.699874] [INFO ] [MAIN ] Derivative Progress: 155/2037 symbols completed. AVNS took 1.2s. Estimated remaining: 12m 35s. Rate: 149.6 symbols/min [2025-10-06T22:35:01.702468] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:01.718251] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:01.720484] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53567 primary records. [2025-10-06T22:35:01.720711] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-06T22:35:01.752340] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-10-06T22:35:01.752501] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-06T22:35:01.756095] [INFO ] [MAIN ] Derivative Progress: 156/2037 symbols completed. AVTR took 1.2s. Estimated remaining: 12m 30s. Rate: 150.4 symbols/min [2025-10-06T22:35:01.757005] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:01.768285] [DEBUG] [LOCAL ] AWF: Loaded 24363 existing records from primary storage. [2025-10-06T22:35:01.768513] [INFO ] [MAIN ] AWF: Loaded 24363 primary data records. [2025-10-06T22:35:01.862200] [DEBUG] [LOCAL ] AVY: Loaded 37507 existing records from primary storage. [2025-10-06T22:35:01.885706] [INFO ] [MAIN ] AVY: Loaded 37507 primary data records. [2025-10-06T22:35:02.088220] [DEBUG] [LOCAL ] AWI: Loaded 25311 existing records from primary storage. [2025-10-06T22:35:02.125678] [INFO ] [MAIN ] AWI: Loaded 25311 primary data records. [2025-10-06T22:35:02.795320] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:02.796257] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24363 primary records. [2025-10-06T22:35:02.796473] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-06T22:35:02.825584] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-10-06T22:35:02.831822] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-06T22:35:02.832111] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:02.835440] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 37507 primary records. [2025-10-06T22:35:02.835594] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-06T22:35:02.834491] [INFO ] [MAIN ] Derivative Progress: 157/2037 symbols completed. AWF took 1.1s. Estimated remaining: 12m 38s. Rate: 148.8 symbols/min [2025-10-06T22:35:02.835799] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:02.869470] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:02.871696] [INFO ] [MAIN ] AWI: Generated 1794 derivative records from 25311 primary records. [2025-10-06T22:35:02.871918] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-10-06T22:35:02.872001] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-06T22:35:02.872087] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-06T22:35:02.876110] [INFO ] [MAIN ] Derivative Progress: 158/2037 symbols completed. AVY took 1.2s. Estimated remaining: 12m 33s. Rate: 149.6 symbols/min [2025-10-06T22:35:02.877092] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:02.894071] [DEBUG] [LOCAL ] AWI: Derivative data saved (1794 records). [2025-10-06T22:35:02.904394] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-06T22:35:02.907749] [INFO ] [MAIN ] Derivative Progress: 159/2037 symbols completed. AWI took 1.2s. Estimated remaining: 12m 29s. Rate: 150.5 symbols/min [2025-10-06T22:35:02.908125] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:02.923427] [DEBUG] [LOCAL ] AWP: Loaded 21465 existing records from primary storage. [2025-10-06T22:35:02.924476] [INFO ] [MAIN ] AWP: Loaded 21465 primary data records. [2025-10-06T22:35:03.036371] [DEBUG] [LOCAL ] AWK: Loaded 48662 existing records from primary storage. [2025-10-06T22:35:03.064022] [DEBUG] [LOCAL ] AWR: Loaded 22676 existing records from primary storage. [2025-10-06T22:35:03.068728] [INFO ] [MAIN ] AWK: Loaded 48662 primary data records. [2025-10-06T22:35:03.074509] [INFO ] [MAIN ] AWR: Loaded 22676 primary data records. [2025-10-06T22:35:03.974475] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:03.976566] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21465 primary records. [2025-10-06T22:35:03.976777] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-06T22:35:03.998900] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:04.003391] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22676 primary records. [2025-10-06T22:35:04.005606] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-06T22:35:04.029586] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:04.031770] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48662 primary records. [2025-10-06T22:35:04.035115] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-06T22:35:04.032498] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-10-06T22:35:04.035954] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-06T22:35:04.039629] [INFO ] [MAIN ] Derivative Progress: 160/2037 symbols completed. AWP took 1.2s. Estimated remaining: 12m 37s. Rate: 148.8 symbols/min [2025-10-06T22:35:04.047377] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:04.054326] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-10-06T22:35:04.054460] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-06T22:35:04.057595] [INFO ] [MAIN ] Derivative Progress: 161/2037 symbols completed. AWR took 1.1s. Estimated remaining: 12m 32s. Rate: 149.7 symbols/min [2025-10-06T22:35:04.059714] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:04.063196] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-10-06T22:35:04.063273] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-06T22:35:04.066928] [INFO ] [MAIN ] Derivative Progress: 162/2037 symbols completed. AWK took 1.2s. Estimated remaining: 12m 27s. Rate: 150.6 symbols/min [2025-10-06T22:35:04.067197] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:04.111943] [DEBUG] [LOCAL ] AX: Loaded 28224 existing records from primary storage. [2025-10-06T22:35:04.112346] [INFO ] [MAIN ] AX: Loaded 28224 primary data records. [2025-10-06T22:35:04.290302] [DEBUG] [LOCAL ] AXL: Loaded 50503 existing records from primary storage. [2025-10-06T22:35:04.338209] [INFO ] [MAIN ] AXL: Loaded 50503 primary data records. [2025-10-06T22:35:04.458201] [DEBUG] [LOCAL ] AXP: Loaded 53176 existing records from primary storage. [2025-10-06T22:35:04.480520] [INFO ] [MAIN ] AXP: Loaded 53176 primary data records. [2025-10-06T22:35:05.126768] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:05.128853] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28224 primary records. [2025-10-06T22:35:05.129386] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-06T22:35:05.149478] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-10-06T22:35:05.150122] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-06T22:35:05.152598] [INFO ] [MAIN ] Derivative Progress: 163/2037 symbols completed. AX took 1.1s. Estimated remaining: 12m 35s. Rate: 149.0 symbols/min [2025-10-06T22:35:05.175230] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:05.187530] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:05.188465] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53176 primary records. [2025-10-06T22:35:05.189075] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50503 primary records. [2025-10-06T22:35:05.189133] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-06T22:35:05.189591] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-06T22:35:05.218919] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-10-06T22:35:05.219408] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-06T22:35:05.223169] [INFO ] [MAIN ] Derivative Progress: 164/2037 symbols completed. AXL took 1.2s. Estimated remaining: 12m 30s. Rate: 149.8 symbols/min [2025-10-06T22:35:05.224386] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-10-06T22:35:05.224451] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-06T22:35:05.228428] [INFO ] [MAIN ] Derivative Progress: 165/2037 symbols completed. AXP took 1.2s. Estimated remaining: 12m 25s. Rate: 150.7 symbols/min [2025-10-06T22:35:05.229022] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:05.229097] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:05.229199] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:05.236142] [DEBUG] [LOCAL ] AXR: Loaded 3009 existing records from primary storage. [2025-10-06T22:35:05.236306] [INFO ] [MAIN ] AXR: Loaded 3009 primary data records. [2025-10-06T22:35:05.573379] [DEBUG] [LOCAL ] AXS: Loaded 38503 existing records from primary storage. [2025-10-06T22:35:05.575208] [INFO ] [MAIN ] AXS: Loaded 38503 primary data records. [2025-10-06T22:35:05.671064] [DEBUG] [LOCAL ] AXTA: Loaded 52142 existing records from primary storage. [2025-10-06T22:35:05.690326] [INFO ] [MAIN ] AXTA: Loaded 52142 primary data records. [2025-10-06T22:35:06.260317] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:35:06.262939] [INFO ] [MAIN ] AXR: Generated 1793 derivative records from 3009 primary records. [2025-10-06T22:35:06.263260] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-06T22:35:06.279672] [DEBUG] [LOCAL ] AXR: Derivative data saved (1793 records). [2025-10-06T22:35:06.280273] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-06T22:35:06.283818] [INFO ] [MAIN ] Derivative Progress: 166/2037 symbols completed. AXR took 1.1s. Estimated remaining: 12m 32s. Rate: 149.2 symbols/min [2025-10-06T22:35:06.284071] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:06.306963] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:06.308292] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38503 primary records. [2025-10-06T22:35:06.308691] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-06T22:35:06.334638] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-10-06T22:35:06.334816] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-06T22:35:06.337108] [INFO ] [MAIN ] Derivative Progress: 167/2037 symbols completed. AXS took 1.1s. Estimated remaining: 12m 28s. Rate: 150.0 symbols/min [2025-10-06T22:35:06.337386] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:06.360620] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:06.361558] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52142 primary records. [2025-10-06T22:35:06.361675] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-06T22:35:06.362181] [DEBUG] [LOCAL ] AYI: Loaded 25228 existing records from primary storage. [2025-10-06T22:35:06.363047] [INFO ] [MAIN ] AYI: Loaded 25228 primary data records. [2025-10-06T22:35:06.444903] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-10-06T22:35:06.505021] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-06T22:35:06.504903] [DEBUG] [LOCAL ] AZZ: Loaded 21927 existing records from primary storage. [2025-10-06T22:35:06.509166] [INFO ] [MAIN ] Derivative Progress: 168/2037 symbols completed. AXTA took 1.3s. Estimated remaining: 12m 25s. Rate: 150.5 symbols/min [2025-10-06T22:35:06.509332] [INFO ] [MAIN ] AZZ: Loaded 21927 primary data records. [2025-10-06T22:35:06.524044] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:07.076030] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-06T22:35:07.076510] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-10-06T22:35:07.197918] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:07.199498] [INFO ] [MAIN ] AYI: Generated 1794 derivative records from 25228 primary records. [2025-10-06T22:35:07.205158] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-06T22:35:07.439920] [DEBUG] [LOCAL ] AYI: Derivative data saved (1794 records). [2025-10-06T22:35:07.426663] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:07.440082] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-06T22:35:07.444275] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 21927 primary records. [2025-10-06T22:35:07.444453] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-06T22:35:07.442528] [INFO ] [MAIN ] Derivative Progress: 169/2037 symbols completed. AYI took 1.2s. Estimated remaining: 12m 31s. Rate: 149.3 symbols/min [2025-10-06T22:35:07.444591] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:07.471133] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-10-06T22:35:07.471604] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-06T22:35:07.475170] [INFO ] [MAIN ] Derivative Progress: 170/2037 symbols completed. AZZ took 1.1s. Estimated remaining: 12m 26s. Rate: 150.1 symbols/min [2025-10-06T22:35:07.475466] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:07.519193] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:07.520111] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-10-06T22:35:07.520282] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-06T22:35:07.536384] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-10-06T22:35:07.537340] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-06T22:35:07.553819] [INFO ] [MAIN ] Derivative Progress: 171/2037 symbols completed. BABA took 1.0s. Estimated remaining: 12m 22s. Rate: 150.8 symbols/min [2025-10-06T22:35:07.570573] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:07.572482] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-06T22:35:07.572777] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-10-06T22:35:07.709514] [DEBUG] [LOCAL ] BAH: Loaded 51690 existing records from primary storage. [2025-10-06T22:35:07.721669] [INFO ] [MAIN ] BAH: Loaded 51690 primary data records. [2025-10-06T22:35:08.064409] [DEBUG] [LOCAL ] BAK: Loaded 39287 existing records from primary storage. [2025-10-06T22:35:08.084963] [INFO ] [MAIN ] BAK: Loaded 39287 primary data records. [2025-10-06T22:35:08.641069] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:08.643304] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-10-06T22:35:08.643541] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-06T22:35:08.676194] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-10-06T22:35:08.676935] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-06T22:35:08.679488] [INFO ] [MAIN ] Derivative Progress: 172/2037 symbols completed. BAC took 1.2s. Estimated remaining: 12m 30s. Rate: 149.2 symbols/min [2025-10-06T22:35:08.676744] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:08.679895] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:08.682558] [INFO ] [MAIN ] BAH: Generated 1794 derivative records from 51690 primary records. [2025-10-06T22:35:08.683728] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-06T22:35:08.714779] [DEBUG] [LOCAL ] BAH: Derivative data saved (1794 records). [2025-10-06T22:35:08.715313] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-06T22:35:08.718363] [INFO ] [MAIN ] Derivative Progress: 173/2037 symbols completed. BAH took 1.2s. Estimated remaining: 12m 26s. Rate: 150.0 symbols/min [2025-10-06T22:35:08.715738] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:08.718861] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:08.719797] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 39287 primary records. [2025-10-06T22:35:08.720013] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-06T22:35:08.737626] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-10-06T22:35:08.738013] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-06T22:35:08.741595] [INFO ] [MAIN ] Derivative Progress: 174/2037 symbols completed. BAK took 1.2s. Estimated remaining: 12m 21s. Rate: 150.8 symbols/min [2025-10-06T22:35:08.742148] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:08.781509] [DEBUG] [LOCAL ] BALL: Loaded 51811 existing records from primary storage. [2025-10-06T22:35:08.781901] [INFO ] [MAIN ] BALL: Loaded 51811 primary data records. [2025-10-06T22:35:08.938860] [DEBUG] [LOCAL ] BAM: Loaded 52007 existing records from primary storage. [2025-10-06T22:35:08.954871] [INFO ] [MAIN ] BAM: Loaded 52007 primary data records. [2025-10-06T22:35:09.266048] [DEBUG] [LOCAL ] BANC: Loaded 51268 existing records from primary storage. [2025-10-06T22:35:09.277960] [INFO ] [MAIN ] BANC: Loaded 51268 primary data records. [2025-10-06T22:35:09.809610] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:09.811336] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51811 primary records. [2025-10-06T22:35:09.811747] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-06T22:35:09.831125] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-10-06T22:35:09.832039] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-06T22:35:09.834897] [INFO ] [MAIN ] Derivative Progress: 175/2037 symbols completed. BALL took 1.2s. Estimated remaining: 12m 28s. Rate: 149.3 symbols/min [2025-10-06T22:35:09.835191] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:09.850251] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:09.851043] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52007 primary records. [2025-10-06T22:35:09.851301] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-06T22:35:09.868386] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-10-06T22:35:09.869735] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-06T22:35:09.872140] [INFO ] [MAIN ] Derivative Progress: 176/2037 symbols completed. BAM took 1.2s. Estimated remaining: 12m 24s. Rate: 150.1 symbols/min [2025-10-06T22:35:09.873350] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:09.898363] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:09.899283] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51268 primary records. [2025-10-06T22:35:09.899460] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-06T22:35:09.916002] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-10-06T22:35:09.916076] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-06T22:35:09.919593] [INFO ] [MAIN ] Derivative Progress: 177/2037 symbols completed. BANC took 1.2s. Estimated remaining: 12m 20s. Rate: 150.9 symbols/min [2025-10-06T22:35:09.919881] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:09.938676] [DEBUG] [LOCAL ] BAP: Loaded 26098 existing records from primary storage. [2025-10-06T22:35:09.938960] [INFO ] [MAIN ] BAP: Loaded 26098 primary data records. [2025-10-06T22:35:10.050585] [DEBUG] [LOCAL ] BARK: Loaded 37923 existing records from primary storage. [2025-10-06T22:35:10.054036] [INFO ] [MAIN ] BARK: Loaded 37923 primary data records. [2025-10-06T22:35:10.506587] [DEBUG] [LOCAL ] BAX: Loaded 53502 existing records from primary storage. [2025-10-06T22:35:10.623370] [INFO ] [MAIN ] BAX: Loaded 53502 primary data records. [2025-10-06T22:35:10.949216] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:10.950562] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 26098 primary records. [2025-10-06T22:35:10.950913] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-06T22:35:10.983863] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-10-06T22:35:10.984540] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-06T22:35:10.987176] [INFO ] [MAIN ] Derivative Progress: 178/2037 symbols completed. BAP took 1.2s. Estimated remaining: 12m 26s. Rate: 149.4 symbols/min [2025-10-06T22:35:10.987421] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:10.988892] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 37923 primary records. [2025-10-06T22:35:10.989042] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-06T22:35:11.005906] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-10-06T22:35:11.006760] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-06T22:35:11.009392] [INFO ] [MAIN ] Derivative Progress: 179/2037 symbols completed. BARK took 1.1s. Estimated remaining: 12m 22s. Rate: 150.2 symbols/min [2025-10-06T22:35:11.023774] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:11.024561] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53502 primary records. [2025-10-06T22:35:11.024624] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-06T22:35:11.040249] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-10-06T22:35:11.040316] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-06T22:35:11.043809] [INFO ] [MAIN ] Derivative Progress: 180/2037 symbols completed. BAX took 1.1s. Estimated remaining: 12m 18s. Rate: 151.0 symbols/min [2025-10-06T22:35:11.044388] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:11.044288] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:11.044479] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:11.107015] [DEBUG] [LOCAL ] BB: Loaded 52943 existing records from primary storage. [2025-10-06T22:35:11.120452] [INFO ] [MAIN ] BB: Loaded 52943 primary data records. [2025-10-06T22:35:11.204682] [DEBUG] [LOCAL ] BBAR: Loaded 41588 existing records from primary storage. [2025-10-06T22:35:11.246696] [INFO ] [MAIN ] BBAR: Loaded 41588 primary data records. [2025-10-06T22:35:11.278699] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-06T22:35:11.299372] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-06T22:35:12.191755] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:12.205317] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52943 primary records. [2025-10-06T22:35:12.205774] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-06T22:35:12.207137] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:12.208034] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 41588 primary records. [2025-10-06T22:35:12.219015] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-06T22:35:12.223552] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-10-06T22:35:12.223783] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-06T22:35:12.226826] [INFO ] [MAIN ] Derivative Progress: 181/2037 symbols completed. BB took 1.2s. Estimated remaining: 12m 26s. Rate: 149.4 symbols/min [2025-10-06T22:35:12.238285] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:12.244078] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-10-06T22:35:12.244673] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-06T22:35:12.247489] [INFO ] [MAIN ] Derivative Progress: 182/2037 symbols completed. BBAR took 1.2s. Estimated remaining: 12m 21s. Rate: 150.2 symbols/min [2025-10-06T22:35:12.247709] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:12.261142] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:12.261945] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-10-06T22:35:12.262010] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-06T22:35:12.278561] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-10-06T22:35:12.278773] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-06T22:35:12.281893] [INFO ] [MAIN ] Derivative Progress: 183/2037 symbols completed. BBAI took 1.2s. Estimated remaining: 12m 17s. Rate: 150.9 symbols/min [2025-10-06T22:35:12.282191] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:12.290013] [DEBUG] [LOCAL ] BBDO: Loaded 4950 existing records from primary storage. [2025-10-06T22:35:12.290268] [INFO ] [MAIN ] BBDO: Loaded 4950 primary data records. [2025-10-06T22:35:12.465028] [DEBUG] [LOCAL ] BBDC: Loaded 32900 existing records from primary storage. [2025-10-06T22:35:12.512430] [INFO ] [MAIN ] BBDC: Loaded 32900 primary data records. [2025-10-06T22:35:12.672061] [DEBUG] [LOCAL ] BBD: Loaded 53215 existing records from primary storage. [2025-10-06T22:35:12.679622] [INFO ] [MAIN ] BBD: Loaded 53215 primary data records. [2025-10-06T22:35:13.278674] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:13.280525] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 4950 primary records. [2025-10-06T22:35:13.280963] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-06T22:35:13.297901] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-10-06T22:35:13.298959] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-06T22:35:13.302661] [INFO ] [MAIN ] Derivative Progress: 184/2037 symbols completed. BBDO took 1.0s. Estimated remaining: 12m 23s. Rate: 149.6 symbols/min [2025-10-06T22:35:13.303533] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:13.318919] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:13.320252] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 32900 primary records. [2025-10-06T22:35:13.320525] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-06T22:35:13.342970] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-10-06T22:35:13.341904] [DEBUG] [LOCAL ] BBU: Loaded 4930 existing records from primary storage. [2025-10-06T22:35:13.343084] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-06T22:35:13.344381] [INFO ] [MAIN ] BBU: Loaded 4930 primary data records. [2025-10-06T22:35:13.358838] [INFO ] [MAIN ] Derivative Progress: 185/2037 symbols completed. BBDC took 1.1s. Estimated remaining: 12m 19s. Rate: 150.3 symbols/min [2025-10-06T22:35:13.368287] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:13.465011] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:13.478127] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53215 primary records. [2025-10-06T22:35:13.494271] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-06T22:35:13.510810] [DEBUG] [LOCAL ] BBUC: Loaded 13388 existing records from primary storage. [2025-10-06T22:35:13.534131] [INFO ] [MAIN ] BBUC: Loaded 13388 primary data records. [2025-10-06T22:35:13.784265] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-10-06T22:35:13.803672] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-06T22:35:13.816400] [INFO ] [MAIN ] Derivative Progress: 186/2037 symbols completed. BBD took 1.6s. Estimated remaining: 12m 19s. Rate: 150.2 symbols/min [2025-10-06T22:35:13.836298] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:14.115600] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:14.116564] [INFO ] [MAIN ] BBU: Generated 1794 derivative records from 4930 primary records. [2025-10-06T22:35:14.116821] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-06T22:35:14.155320] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-10-06T22:35:14.155663] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-06T22:35:14.171500] [INFO ] [MAIN ] Derivative Progress: 187/2037 symbols completed. BBU took 0.9s. Estimated remaining: 12m 18s. Rate: 150.3 symbols/min [2025-10-06T22:35:14.173155] [DEBUG] [LOCAL ] BBVA: Loaded 49200 existing records from primary storage. [2025-10-06T22:35:14.173734] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:14.173967] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:14.173618] [INFO ] [MAIN ] BBVA: Loaded 49200 primary data records. [2025-10-06T22:35:14.175337] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13388 primary records. [2025-10-06T22:35:14.180705] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-06T22:35:14.283286] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-10-06T22:35:14.289674] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-06T22:35:14.331469] [INFO ] [MAIN ] Derivative Progress: 188/2037 symbols completed. BBUC took 1.0s. Estimated remaining: 12m 16s. Rate: 150.8 symbols/min [2025-10-06T22:35:14.348272] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:14.540424] [DEBUG] [LOCAL ] BBW: Loaded 26836 existing records from primary storage. [2025-10-06T22:35:14.551870] [INFO ] [MAIN ] BBW: Loaded 26836 primary data records. [2025-10-06T22:35:14.908306] [DEBUG] [LOCAL ] BBWI: Loaded 53581 existing records from primary storage. [2025-10-06T22:35:14.909989] [INFO ] [MAIN ] BBWI: Loaded 53581 primary data records. [2025-10-06T22:35:15.037586] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:15.060538] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49200 primary records. [2025-10-06T22:35:15.100941] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-06T22:35:15.287324] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:15.288242] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-10-06T22:35:15.288540] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-06T22:35:15.291220] [INFO ] [MAIN ] Derivative Progress: 189/2037 symbols completed. BBVA took 1.5s. Estimated remaining: 12m 21s. Rate: 149.7 symbols/min [2025-10-06T22:35:15.292363] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 26836 primary records. [2025-10-06T22:35:15.291472] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:15.293291] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-06T22:35:15.313848] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-10-06T22:35:15.314234] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-06T22:35:15.317347] [INFO ] [MAIN ] Derivative Progress: 190/2037 symbols completed. BBW took 1.1s. Estimated remaining: 12m 17s. Rate: 150.4 symbols/min [2025-10-06T22:35:15.317664] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:15.338749] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:15.339772] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53581 primary records. [2025-10-06T22:35:15.339972] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-06T22:35:15.372271] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-10-06T22:35:15.372616] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-06T22:35:15.375932] [INFO ] [MAIN ] Derivative Progress: 191/2037 symbols completed. BBWI took 1.0s. Estimated remaining: 12m 13s. Rate: 151.1 symbols/min [2025-10-06T22:35:15.376452] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:15.407561] [DEBUG] [LOCAL ] BBY: Loaded 53463 existing records from primary storage. [2025-10-06T22:35:15.407943] [INFO ] [MAIN ] BBY: Loaded 53463 primary data records. [2025-10-06T22:35:15.539101] [DEBUG] [LOCAL ] BC: Loaded 44177 existing records from primary storage. [2025-10-06T22:35:15.555172] [INFO ] [MAIN ] BC: Loaded 44177 primary data records. [2025-10-06T22:35:15.853158] [DEBUG] [LOCAL ] BCAT: Loaded 34068 existing records from primary storage. [2025-10-06T22:35:15.856690] [INFO ] [MAIN ] BCAT: Loaded 34068 primary data records. [2025-10-06T22:35:16.444598] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:16.446161] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53463 primary records. [2025-10-06T22:35:16.446481] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-06T22:35:16.467008] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-10-06T22:35:16.467283] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-06T22:35:16.469693] [INFO ] [MAIN ] Derivative Progress: 192/2037 symbols completed. BBY took 1.2s. Estimated remaining: 12m 19s. Rate: 149.7 symbols/min [2025-10-06T22:35:16.477873] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:16.483777] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:16.484835] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44177 primary records. [2025-10-06T22:35:16.485045] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-06T22:35:16.519286] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:16.520441] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34068 primary records. [2025-10-06T22:35:16.519522] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-10-06T22:35:16.520778] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-06T22:35:16.520871] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-06T22:35:16.532276] [INFO ] [MAIN ] Derivative Progress: 193/2037 symbols completed. BC took 1.2s. Estimated remaining: 12m 16s. Rate: 150.4 symbols/min [2025-10-06T22:35:16.563414] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-10-06T22:35:16.564572] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-06T22:35:16.568488] [INFO ] [MAIN ] Derivative Progress: 194/2037 symbols completed. BCAT took 1.2s. Estimated remaining: 12m 12s. Rate: 151.1 symbols/min [2025-10-06T22:35:16.565047] [DEBUG] [LOCAL ] BCC: Loaded 28240 existing records from primary storage. [2025-10-06T22:35:16.568700] [INFO ] [MAIN ] BCC: Loaded 28240 primary data records. [2025-10-06T22:35:16.901524] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:16.902263] [INFO ] [MAIN ] BCC: Generated 1794 derivative records from 28240 primary records. [2025-10-06T22:35:16.902327] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-06T22:35:16.918131] [DEBUG] [LOCAL ] BCC: Derivative data saved (1794 records). [2025-10-06T22:35:16.918225] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-06T22:35:16.920374] [INFO ] [MAIN ] Derivative Progress: 195/2037 symbols completed. BCC took 0.4s. Estimated remaining: 12m 11s. Rate: 151.2 symbols/min [2025-10-06T22:35:16.921399] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:16.921240] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:16.921544] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:16.971157] [DEBUG] [LOCAL ] BCO: Loaded 25863 existing records from primary storage. [2025-10-06T22:35:16.971764] [DEBUG] [LOCAL ] BCH: Loaded 29704 existing records from primary storage. [2025-10-06T22:35:16.972185] [INFO ] [MAIN ] BCH: Loaded 29704 primary data records. [2025-10-06T22:35:16.972275] [INFO ] [MAIN ] BCO: Loaded 25863 primary data records. [2025-10-06T22:35:17.285008] [DEBUG] [LOCAL ] BCE: Loaded 52216 existing records from primary storage. [2025-10-06T22:35:17.335081] [INFO ] [MAIN ] BCE: Loaded 52216 primary data records. [2025-10-06T22:35:18.007988] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:18.021996] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 29704 primary records. [2025-10-06T22:35:18.021245] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:18.022156] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-06T22:35:18.023195] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 25863 primary records. [2025-10-06T22:35:18.023811] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-06T22:35:18.054414] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-10-06T22:35:18.054868] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-06T22:35:18.057798] [INFO ] [MAIN ] Derivative Progress: 196/2037 symbols completed. BCO took 1.1s. Estimated remaining: 12m 18s. Rate: 149.7 symbols/min [2025-10-06T22:35:18.058087] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:18.073442] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:18.074634] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52216 primary records. [2025-10-06T22:35:18.075022] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-06T22:35:18.075761] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-10-06T22:35:18.075846] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-06T22:35:18.078903] [INFO ] [MAIN ] Derivative Progress: 197/2037 symbols completed. BCH took 1.2s. Estimated remaining: 12m 14s. Rate: 150.5 symbols/min [2025-10-06T22:35:18.079676] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:18.101449] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-10-06T22:35:18.108934] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-06T22:35:18.112979] [INFO ] [MAIN ] Derivative Progress: 198/2037 symbols completed. BCE took 1.2s. Estimated remaining: 12m 10s. Rate: 151.2 symbols/min [2025-10-06T22:35:18.113352] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:18.138912] [DEBUG] [LOCAL ] BCSF: Loaded 27719 existing records from primary storage. [2025-10-06T22:35:18.139265] [INFO ] [MAIN ] BCSF: Loaded 27719 primary data records. [2025-10-06T22:35:18.286321] [DEBUG] [LOCAL ] BCS: Loaded 53449 existing records from primary storage. [2025-10-06T22:35:18.274928] [DEBUG] [LOCAL ] BCX: Loaded 21592 existing records from primary storage. [2025-10-06T22:35:18.296828] [INFO ] [MAIN ] BCS: Loaded 53449 primary data records. [2025-10-06T22:35:18.291634] [INFO ] [MAIN ] BCX: Loaded 21592 primary data records. [2025-10-06T22:35:19.126682] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:19.127991] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 27719 primary records. [2025-10-06T22:35:19.128118] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-06T22:35:19.169683] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:19.175941] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-10-06T22:35:19.176237] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:19.177064] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53449 primary records. [2025-10-06T22:35:19.176323] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-06T22:35:19.177802] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-06T22:35:19.179801] [INFO ] [MAIN ] Derivative Progress: 199/2037 symbols completed. BCSF took 1.1s. Estimated remaining: 12m 16s. Rate: 149.9 symbols/min [2025-10-06T22:35:19.177740] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 21592 primary records. [2025-10-06T22:35:19.179973] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:19.180143] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-06T22:35:19.208087] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-10-06T22:35:19.208941] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-06T22:35:19.212062] [INFO ] [MAIN ] Derivative Progress: 200/2037 symbols completed. BCX took 1.1s. Estimated remaining: 12m 12s. Rate: 150.6 symbols/min [2025-10-06T22:35:19.212291] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:19.216365] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-10-06T22:35:19.216548] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-06T22:35:19.220011] [INFO ] [MAIN ] Derivative Progress: 201/2037 symbols completed. BCS took 1.2s. Estimated remaining: 12m 8s. Rate: 151.3 symbols/min [2025-10-06T22:35:19.220180] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:19.238701] [DEBUG] [LOCAL ] BDC: Loaded 24628 existing records from primary storage. [2025-10-06T22:35:19.238840] [INFO ] [MAIN ] BDC: Loaded 24628 primary data records. [2025-10-06T22:35:19.359070] [DEBUG] [LOCAL ] BDJ: Loaded 28945 existing records from primary storage. [2025-10-06T22:35:19.370243] [INFO ] [MAIN ] BDJ: Loaded 28945 primary data records. [2025-10-06T22:35:19.687018] [DEBUG] [LOCAL ] BDN: Loaded 47524 existing records from primary storage. [2025-10-06T22:35:19.698668] [INFO ] [MAIN ] BDN: Loaded 47524 primary data records. [2025-10-06T22:35:20.271155] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:20.274429] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24628 primary records. [2025-10-06T22:35:20.274823] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-06T22:35:20.298883] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:20.305463] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 28945 primary records. [2025-10-06T22:35:20.307028] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-06T22:35:20.318151] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-10-06T22:35:20.321203] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-06T22:35:20.325104] [INFO ] [MAIN ] Derivative Progress: 202/2037 symbols completed. BDC took 1.1s. Estimated remaining: 12m 14s. Rate: 150.0 symbols/min [2025-10-06T22:35:20.325706] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:20.332085] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-10-06T22:35:20.334042] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-06T22:35:20.336942] [INFO ] [MAIN ] Derivative Progress: 203/2037 symbols completed. BDJ took 1.1s. Estimated remaining: 12m 10s. Rate: 150.7 symbols/min [2025-10-06T22:35:20.337188] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:20.351460] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:20.352298] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47524 primary records. [2025-10-06T22:35:20.352440] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-06T22:35:20.384841] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-10-06T22:35:20.385009] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-06T22:35:20.388497] [INFO ] [MAIN ] Derivative Progress: 204/2037 symbols completed. BDN took 1.2s. Estimated remaining: 12m 7s. Rate: 151.4 symbols/min [2025-10-06T22:35:20.388696] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:20.439497] [DEBUG] [LOCAL ] BDX: Loaded 52322 existing records from primary storage. [2025-10-06T22:35:20.440354] [INFO ] [MAIN ] BDX: Loaded 52322 primary data records. [2025-10-06T22:35:20.536227] [DEBUG] [LOCAL ] BEKE: Loaded 53233 existing records from primary storage. [2025-10-06T22:35:20.541659] [INFO ] [MAIN ] BEKE: Loaded 53233 primary data records. [2025-10-06T22:35:20.897715] [DEBUG] [LOCAL ] BEN: Loaded 53043 existing records from primary storage. [2025-10-06T22:35:20.897893] [INFO ] [MAIN ] BEN: Loaded 53043 primary data records. [2025-10-06T22:35:21.431842] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:21.434158] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52322 primary records. [2025-10-06T22:35:21.434768] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-06T22:35:21.467072] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:21.468113] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-10-06T22:35:21.469201] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-06T22:35:21.472287] [INFO ] [MAIN ] Derivative Progress: 205/2037 symbols completed. BDX took 1.1s. Estimated remaining: 12m 12s. Rate: 150.1 symbols/min [2025-10-06T22:35:21.469145] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53233 primary records. [2025-10-06T22:35:21.472469] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-06T22:35:21.472627] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:21.507924] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-10-06T22:35:21.508315] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:21.509241] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53043 primary records. [2025-10-06T22:35:21.509416] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-06T22:35:21.512247] [INFO ] [MAIN ] Derivative Progress: 206/2037 symbols completed. BEKE took 1.2s. Estimated remaining: 12m 9s. Rate: 150.8 symbols/min [2025-10-06T22:35:21.509351] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-06T22:35:21.512447] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:21.542348] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-10-06T22:35:21.542516] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-06T22:35:21.546736] [INFO ] [MAIN ] Derivative Progress: 207/2037 symbols completed. BEN took 1.2s. Estimated remaining: 12m 5s. Rate: 151.4 symbols/min [2025-10-06T22:35:21.546959] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:21.561805] [DEBUG] [LOCAL ] BEP: Loaded 38802 existing records from primary storage. [2025-10-06T22:35:21.562076] [INFO ] [MAIN ] BEP: Loaded 38802 primary data records. [2025-10-06T22:35:21.674991] [DEBUG] [LOCAL ] BEPH: Loaded 5361 existing records from primary storage. [2025-10-06T22:35:21.678402] [INFO ] [MAIN ] BEPH: Loaded 5361 primary data records. [2025-10-06T22:35:21.865414] [DEBUG] [LOCAL ] BEPC: Loaded 46439 existing records from primary storage. [2025-10-06T22:35:21.873587] [INFO ] [MAIN ] BEPC: Loaded 46439 primary data records. [2025-10-06T22:35:22.579951] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:22.581420] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38802 primary records. [2025-10-06T22:35:22.581762] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-06T22:35:22.613397] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:22.615157] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5361 primary records. [2025-10-06T22:35:22.623346] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-06T22:35:22.637286] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:22.640207] [INFO ] [MAIN ] BEPC: Generated 1794 derivative records from 46439 primary records. [2025-10-06T22:35:22.643165] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-06T22:35:22.643955] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-10-06T22:35:22.644087] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-06T22:35:22.646583] [INFO ] [MAIN ] Derivative Progress: 208/2037 symbols completed. BEP took 1.2s. Estimated remaining: 12m 11s. Rate: 150.1 symbols/min [2025-10-06T22:35:22.665856] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-10-06T22:35:22.666492] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-06T22:35:22.669629] [INFO ] [MAIN ] Derivative Progress: 209/2037 symbols completed. BEPC took 1.2s. Estimated remaining: 12m 7s. Rate: 150.8 symbols/min [2025-10-06T22:35:22.670119] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-10-06T22:35:22.670261] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-06T22:35:22.673155] [INFO ] [MAIN ] Derivative Progress: 210/2037 symbols completed. BEPH took 1.1s. Estimated remaining: 12m 3s. Rate: 151.5 symbols/min [2025-10-06T22:35:22.673611] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:22.673797] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:22.673851] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:22.682500] [DEBUG] [LOCAL ] BEPI: Loaded 3572 existing records from primary storage. [2025-10-06T22:35:22.682797] [INFO ] [MAIN ] BEPI: Loaded 3572 primary data records. [2025-10-06T22:35:22.810815] [DEBUG] [LOCAL ] BFK: Loaded 13725 existing records from primary storage. [2025-10-06T22:35:22.837397] [INFO ] [MAIN ] BFK: Loaded 13725 primary data records. [2025-10-06T22:35:23.048812] [DEBUG] [LOCAL ] BFAM: Loaded 33360 existing records from primary storage. [2025-10-06T22:35:23.069236] [INFO ] [MAIN ] BFAM: Loaded 33360 primary data records. [2025-10-06T22:35:23.653529] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:23.654726] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3572 primary records. [2025-10-06T22:35:23.654998] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-06T22:35:23.690374] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-10-06T22:35:23.690603] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-06T22:35:23.693815] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:23.694956] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13725 primary records. [2025-10-06T22:35:23.695058] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-06T22:35:23.693474] [INFO ] [MAIN ] Derivative Progress: 211/2037 symbols completed. BEPI took 1.0s. Estimated remaining: 12m 8s. Rate: 150.4 symbols/min [2025-10-06T22:35:23.697855] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:23.714266] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-10-06T22:35:23.714594] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-06T22:35:23.718012] [INFO ] [MAIN ] Derivative Progress: 212/2037 symbols completed. BFK took 1.0s. Estimated remaining: 12m 5s. Rate: 151.1 symbols/min [2025-10-06T22:35:23.731288] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:23.731907] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:23.732769] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33360 primary records. [2025-10-06T22:35:23.732833] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-06T22:35:23.757744] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-10-06T22:35:23.762030] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-06T22:35:23.765249] [INFO ] [MAIN ] Derivative Progress: 213/2037 symbols completed. BFAM took 1.1s. Estimated remaining: 12m 1s. Rate: 151.7 symbols/min [2025-10-06T22:35:23.762237] [DEBUG] [LOCAL ] BFS: Loaded 9256 existing records from primary storage. [2025-10-06T22:35:23.765561] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:23.765469] [INFO ] [MAIN ] BFS: Loaded 9256 primary data records. [2025-10-06T22:35:23.893573] [DEBUG] [LOCAL ] BFZ: Loaded 11936 existing records from primary storage. [2025-10-06T22:35:23.921031] [INFO ] [MAIN ] BFZ: Loaded 11936 primary data records. [2025-10-06T22:35:24.006845] [DEBUG] [LOCAL ] BFLY: Loaded 51804 existing records from primary storage. [2025-10-06T22:35:24.165522] [INFO ] [MAIN ] BFLY: Loaded 51804 primary data records. [2025-10-06T22:35:24.801614] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:24.803332] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 9256 primary records. [2025-10-06T22:35:24.803474] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-06T22:35:24.823804] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-10-06T22:35:24.824199] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-06T22:35:24.826592] [INFO ] [MAIN ] Derivative Progress: 214/2037 symbols completed. BFS took 1.1s. Estimated remaining: 12m 7s. Rate: 150.5 symbols/min [2025-10-06T22:35:24.827158] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:24.868787] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:24.869156] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:24.871165] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51804 primary records. [2025-10-06T22:35:24.870265] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 11936 primary records. [2025-10-06T22:35:24.871431] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-06T22:35:24.871377] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-06T22:35:24.902387] [DEBUG] [LOCAL ] BGB: Loaded 17794 existing records from primary storage. [2025-10-06T22:35:24.907093] [INFO ] [MAIN ] BGB: Loaded 17794 primary data records. [2025-10-06T22:35:24.908685] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-10-06T22:35:24.921186] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-06T22:35:24.942086] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-10-06T22:35:24.954191] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-06T22:35:24.983085] [INFO ] [MAIN ] Derivative Progress: 215/2037 symbols completed. BFZ took 1.2s. Estimated remaining: 12m 4s. Rate: 150.9 symbols/min [2025-10-06T22:35:24.993310] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:24.993466] [INFO ] [MAIN ] Derivative Progress: 216/2037 symbols completed. BFLY took 1.3s. Estimated remaining: 12m 1s. Rate: 151.6 symbols/min [2025-10-06T22:35:25.017195] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:25.235308] [DEBUG] [LOCAL ] BGH: Loaded 17115 existing records from primary storage. [2025-10-06T22:35:25.234568] [DEBUG] [LOCAL ] BGR: Loaded 13477 existing records from primary storage. [2025-10-06T22:35:25.236503] [INFO ] [MAIN ] BGR: Loaded 13477 primary data records. [2025-10-06T22:35:25.237042] [INFO ] [MAIN ] BGH: Loaded 17115 primary data records. [2025-10-06T22:35:25.878679] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:25.880204] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17794 primary records. [2025-10-06T22:35:25.880360] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-06T22:35:25.900194] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-10-06T22:35:25.900527] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-06T22:35:25.903294] [INFO ] [MAIN ] Derivative Progress: 217/2037 symbols completed. BGB took 1.1s. Estimated remaining: 12m 4s. Rate: 150.7 symbols/min [2025-10-06T22:35:25.903511] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:25.924714] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:25.926302] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 17115 primary records. [2025-10-06T22:35:25.926779] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-06T22:35:25.952858] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:25.957211] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13477 primary records. [2025-10-06T22:35:25.957845] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-06T22:35:25.975282] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-10-06T22:35:25.988898] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-06T22:35:25.995140] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-10-06T22:35:25.994585] [INFO ] [MAIN ] Derivative Progress: 218/2037 symbols completed. BGH took 1.0s. Estimated remaining: 12m 2s. Rate: 151.3 symbols/min [2025-10-06T22:35:25.995307] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-06T22:35:25.998998] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:25.999301] [INFO ] [MAIN ] Derivative Progress: 219/2037 symbols completed. BGR took 1.0s. Estimated remaining: 11m 58s. Rate: 152.0 symbols/min [2025-10-06T22:35:25.999823] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:26.018122] [DEBUG] [LOCAL ] BGS: Loaded 50464 existing records from primary storage. [2025-10-06T22:35:26.020671] [INFO ] [MAIN ] BGS: Loaded 50464 primary data records. [2025-10-06T22:35:26.084908] [DEBUG] [LOCAL ] BGSF: Loaded 7637 existing records from primary storage. [2025-10-06T22:35:26.138986] [DEBUG] [LOCAL ] BGT: Loaded 16588 existing records from primary storage. [2025-10-06T22:35:26.139319] [INFO ] [MAIN ] BGT: Loaded 16588 primary data records. [2025-10-06T22:35:26.134224] [INFO ] [MAIN ] BGSF: Loaded 7637 primary data records. [2025-10-06T22:35:27.020833] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:27.021890] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50464 primary records. [2025-10-06T22:35:27.022131] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-06T22:35:27.039417] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-10-06T22:35:27.040828] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-06T22:35:27.045332] [INFO ] [MAIN ] Derivative Progress: 220/2037 symbols completed. BGS took 1.1s. Estimated remaining: 12m 3s. Rate: 150.8 symbols/min [2025-10-06T22:35:27.045572] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:27.071175] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:27.076914] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16588 primary records. [2025-10-06T22:35:27.077491] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:27.078559] [INFO ] [MAIN ] BGSF: Generated 1794 derivative records from 7637 primary records. [2025-10-06T22:35:27.077593] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-06T22:35:27.081472] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-06T22:35:27.109890] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-10-06T22:35:27.110035] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-06T22:35:27.118068] [INFO ] [MAIN ] Derivative Progress: 221/2037 symbols completed. BGT took 1.1s. Estimated remaining: 11m 60s. Rate: 151.4 symbols/min [2025-10-06T22:35:27.115197] [DEBUG] [LOCAL ] BGX: Loaded 11087 existing records from primary storage. [2025-10-06T22:35:27.118300] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:27.118869] [INFO ] [MAIN ] BGX: Loaded 11087 primary data records. [2025-10-06T22:35:27.192706] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1794 records). [2025-10-06T22:35:27.209459] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-06T22:35:27.234213] [INFO ] [MAIN ] Derivative Progress: 222/2037 symbols completed. BGSF took 1.2s. Estimated remaining: 11m 57s. Rate: 151.9 symbols/min [2025-10-06T22:35:27.245288] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:27.316282] [DEBUG] [LOCAL ] BGY: Loaded 22014 existing records from primary storage. [2025-10-06T22:35:27.386882] [INFO ] [MAIN ] BGY: Loaded 22014 primary data records. [2025-10-06T22:35:27.492089] [DEBUG] [LOCAL ] BH: Loaded 16097 existing records from primary storage. [2025-10-06T22:35:27.531451] [INFO ] [MAIN ] BH: Loaded 16097 primary data records. [2025-10-06T22:35:28.192147] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:28.194617] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 11087 primary records. [2025-10-06T22:35:28.194866] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-06T22:35:28.214802] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-10-06T22:35:28.216044] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-06T22:35:28.218607] [INFO ] [MAIN ] Derivative Progress: 223/2037 symbols completed. BGX took 1.2s. Estimated remaining: 12m 1s. Rate: 150.9 symbols/min [2025-10-06T22:35:28.232379] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:28.233271] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 22014 primary records. [2025-10-06T22:35:28.233495] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-06T22:35:28.263551] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:28.266268] [INFO ] [MAIN ] BH: Generated 1794 derivative records from 16097 primary records. [2025-10-06T22:35:28.265343] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-10-06T22:35:28.266385] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-06T22:35:28.267209] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-06T22:35:28.270350] [INFO ] [MAIN ] Derivative Progress: 224/2037 symbols completed. BGY took 1.2s. Estimated remaining: 11m 58s. Rate: 151.4 symbols/min [2025-10-06T22:35:28.285859] [DEBUG] [LOCAL ] BH: Derivative data saved (1794 records). [2025-10-06T22:35:28.285950] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-06T22:35:28.289566] [INFO ] [MAIN ] Derivative Progress: 225/2037 symbols completed. BH took 1.0s. Estimated remaining: 11m 55s. Rate: 152.1 symbols/min [2025-10-06T22:35:28.290269] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:28.290153] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:28.290365] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:28.340871] [DEBUG] [LOCAL ] BHE: Loaded 24339 existing records from primary storage. [2025-10-06T22:35:28.341316] [DEBUG] [LOCAL ] BHK: Loaded 23146 existing records from primary storage. [2025-10-06T22:35:28.341607] [INFO ] [MAIN ] BHE: Loaded 24339 primary data records. [2025-10-06T22:35:28.341909] [INFO ] [MAIN ] BHK: Loaded 23146 primary data records. [2025-10-06T22:35:28.595506] [DEBUG] [LOCAL ] BHC: Loaded 46871 existing records from primary storage. [2025-10-06T22:35:28.596108] [INFO ] [MAIN ] BHC: Loaded 46871 primary data records. [2025-10-06T22:35:29.329350] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:29.335974] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 23146 primary records. [2025-10-06T22:35:29.336580] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-06T22:35:29.336341] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:29.338629] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 24339 primary records. [2025-10-06T22:35:29.338814] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-06T22:35:29.369931] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-10-06T22:35:29.371324] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-06T22:35:29.374060] [INFO ] [MAIN ] Derivative Progress: 226/2037 symbols completed. BHK took 1.1s. Estimated remaining: 11m 60s. Rate: 150.9 symbols/min [2025-10-06T22:35:29.375523] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:29.391674] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:29.393478] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46871 primary records. [2025-10-06T22:35:29.394062] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-06T22:35:29.393969] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-10-06T22:35:29.394723] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-06T22:35:29.397713] [INFO ] [MAIN ] Derivative Progress: 227/2037 symbols completed. BHE took 1.1s. Estimated remaining: 11m 57s. Rate: 151.5 symbols/min [2025-10-06T22:35:29.398226] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:29.416386] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-10-06T22:35:29.416550] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-06T22:35:29.420736] [INFO ] [MAIN ] Derivative Progress: 228/2037 symbols completed. BHC took 1.1s. Estimated remaining: 11m 53s. Rate: 152.2 symbols/min [2025-10-06T22:35:29.421109] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:29.449838] [DEBUG] [LOCAL ] BHR: Loaded 21645 existing records from primary storage. [2025-10-06T22:35:29.449988] [INFO ] [MAIN ] BHR: Loaded 21645 primary data records. [2025-10-06T22:35:29.578570] [DEBUG] [LOCAL ] BHP: Loaded 53370 existing records from primary storage. [2025-10-06T22:35:29.584379] [INFO ] [MAIN ] BHP: Loaded 53370 primary data records. [2025-10-06T22:35:29.908311] [DEBUG] [LOCAL ] BHVN: Loaded 50061 existing records from primary storage. [2025-10-06T22:35:29.912315] [INFO ] [MAIN ] BHVN: Loaded 50061 primary data records. [2025-10-06T22:35:30.487429] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:30.488891] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21645 primary records. [2025-10-06T22:35:30.489010] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-06T22:35:30.522041] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:30.522124] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-10-06T22:35:30.522303] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-06T22:35:30.523008] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53370 primary records. [2025-10-06T22:35:30.525543] [INFO ] [MAIN ] Derivative Progress: 229/2037 symbols completed. BHR took 1.1s. Estimated remaining: 11m 58s. Rate: 151.0 symbols/min [2025-10-06T22:35:30.525758] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-06T22:35:30.526002] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:30.546954] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-10-06T22:35:30.547194] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-06T22:35:30.550362] [INFO ] [MAIN ] Derivative Progress: 230/2037 symbols completed. BHP took 1.2s. Estimated remaining: 11m 55s. Rate: 151.6 symbols/min [2025-10-06T22:35:30.550590] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:30.564471] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:30.565175] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 50061 primary records. [2025-10-06T22:35:30.565350] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-06T22:35:30.582069] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-10-06T22:35:30.582360] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-06T22:35:30.585215] [INFO ] [MAIN ] Derivative Progress: 231/2037 symbols completed. BHVN took 1.2s. Estimated remaining: 11m 52s. Rate: 152.2 symbols/min [2025-10-06T22:35:30.585566] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:30.615339] [DEBUG] [LOCAL ] BIO: Loaded 24576 existing records from primary storage. [2025-10-06T22:35:30.615485] [INFO ] [MAIN ] BIO: Loaded 24576 primary data records. [2025-10-06T22:35:30.747934] [DEBUG] [LOCAL ] BILL: Loaded 52370 existing records from primary storage. [2025-10-06T22:35:30.761996] [INFO ] [MAIN ] BILL: Loaded 52370 primary data records. [2025-10-06T22:35:31.031619] [DEBUG] [LOCAL ] BIP: Loaded 39429 existing records from primary storage. [2025-10-06T22:35:31.045855] [INFO ] [MAIN ] BIP: Loaded 39429 primary data records. [2025-10-06T22:35:31.615875] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:31.617190] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 24576 primary records. [2025-10-06T22:35:31.617859] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-06T22:35:31.639927] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-10-06T22:35:31.640115] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-06T22:35:31.643337] [INFO ] [MAIN ] Derivative Progress: 232/2037 symbols completed. BIO took 1.1s. Estimated remaining: 11m 57s. Rate: 151.1 symbols/min [2025-10-06T22:35:31.647757] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:31.665155] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:31.666623] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52370 primary records. [2025-10-06T22:35:31.666894] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-06T22:35:31.704283] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-10-06T22:35:31.704780] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-06T22:35:31.708735] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:31.708195] [INFO ] [MAIN ] Derivative Progress: 233/2037 symbols completed. BILL took 1.2s. Estimated remaining: 11m 54s. Rate: 151.7 symbols/min [2025-10-06T22:35:31.709070] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:31.710071] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39429 primary records. [2025-10-06T22:35:31.711107] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-06T22:35:31.739579] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-10-06T22:35:31.742767] [DEBUG] [LOCAL ] BIPH: Loaded 2559 existing records from primary storage. [2025-10-06T22:35:31.739828] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-06T22:35:31.746864] [INFO ] [MAIN ] BIPH: Loaded 2559 primary data records. [2025-10-06T22:35:31.746719] [INFO ] [MAIN ] Derivative Progress: 234/2037 symbols completed. BIP took 1.2s. Estimated remaining: 11m 51s. Rate: 152.2 symbols/min [2025-10-06T22:35:31.747204] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:31.858083] [DEBUG] [LOCAL ] BIPC: Loaded 41260 existing records from primary storage. [2025-10-06T22:35:31.889327] [INFO ] [MAIN ] BIPC: Loaded 41260 primary data records. [2025-10-06T22:35:31.892027] [DEBUG] [LOCAL ] BIPI: Loaded 3194 existing records from primary storage. [2025-10-06T22:35:31.892213] [INFO ] [MAIN ] BIPI: Loaded 3194 primary data records. [2025-10-06T22:35:32.868204] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-06T22:35:32.869256] [INFO ] [MAIN ] BIPH: Generated 1791 derivative records from 2559 primary records. [2025-10-06T22:35:32.869480] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-06T22:35:32.899565] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:32.901751] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3194 primary records. [2025-10-06T22:35:32.902454] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-06T22:35:32.929505] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:32.929001] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1791 records). [2025-10-06T22:35:32.931321] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41260 primary records. [2025-10-06T22:35:32.932335] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-06T22:35:32.931701] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-06T22:35:32.935269] [INFO ] [MAIN ] Derivative Progress: 235/2037 symbols completed. BIPH took 1.2s. Estimated remaining: 11m 56s. Rate: 150.9 symbols/min [2025-10-06T22:35:32.935754] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:32.946947] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-10-06T22:35:32.947196] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-06T22:35:32.951741] [INFO ] [MAIN ] Derivative Progress: 236/2037 symbols completed. BIPI took 1.2s. Estimated remaining: 11m 53s. Rate: 151.6 symbols/min [2025-10-06T22:35:32.955453] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:32.963505] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-10-06T22:35:32.962563] [DEBUG] [LOCAL ] BIPJ: Loaded 3135 existing records from primary storage. [2025-10-06T22:35:32.963851] [INFO ] [MAIN ] BIPJ: Loaded 3135 primary data records. [2025-10-06T22:35:32.963954] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-06T22:35:32.995441] [INFO ] [MAIN ] Derivative Progress: 237/2037 symbols completed. BIPC took 1.3s. Estimated remaining: 11m 50s. Rate: 152.1 symbols/min [2025-10-06T22:35:32.996711] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:33.305340] [DEBUG] [LOCAL ] BIT: Loaded 23078 existing records from primary storage. [2025-10-06T22:35:33.305768] [INFO ] [MAIN ] BIT: Loaded 23078 primary data records. [2025-10-06T22:35:33.431684] [DEBUG] [LOCAL ] BIRK: Loaded 50930 existing records from primary storage. [2025-10-06T22:35:33.442266] [INFO ] [MAIN ] BIRK: Loaded 50930 primary data records. [2025-10-06T22:35:34.021090] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:34.022791] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 3135 primary records. [2025-10-06T22:35:34.022887] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-06T22:35:34.057808] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-10-06T22:35:34.058936] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-06T22:35:34.059559] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:34.064232] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 23078 primary records. [2025-10-06T22:35:34.063177] [INFO ] [MAIN ] Derivative Progress: 238/2037 symbols completed. BIPJ took 1.1s. Estimated remaining: 11m 55s. Rate: 151.0 symbols/min [2025-10-06T22:35:34.064675] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-06T22:35:34.082085] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-10-06T22:35:34.082279] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-06T22:35:34.085072] [INFO ] [MAIN ] Derivative Progress: 239/2037 symbols completed. BIT took 1.1s. Estimated remaining: 11m 51s. Rate: 151.6 symbols/min [2025-10-06T22:35:34.101021] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:34.101693] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 50930 primary records. [2025-10-06T22:35:34.101758] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-06T22:35:34.118277] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-10-06T22:35:34.118377] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-06T22:35:34.121516] [INFO ] [MAIN ] Derivative Progress: 240/2037 symbols completed. BIRK took 1.2s. Estimated remaining: 11m 48s. Rate: 152.2 symbols/min [2025-10-06T22:35:34.122120] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:34.122331] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:34.122508] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:34.222834] [DEBUG] [LOCAL ] BK: Loaded 53537 existing records from primary storage. [2025-10-06T22:35:34.237675] [INFO ] [MAIN ] BK: Loaded 53537 primary data records. [2025-10-06T22:35:34.251321] [DEBUG] [LOCAL ] BJ: Loaded 51429 existing records from primary storage. [2025-10-06T22:35:34.268306] [INFO ] [MAIN ] BJ: Loaded 51429 primary data records. [2025-10-06T22:35:34.561366] [DEBUG] [LOCAL ] BKD: Loaded 50317 existing records from primary storage. [2025-10-06T22:35:34.576687] [INFO ] [MAIN ] BKD: Loaded 50317 primary data records. [2025-10-06T22:35:35.314732] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:35.317466] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51429 primary records. [2025-10-06T22:35:35.317756] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-06T22:35:35.344797] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:35.346818] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53537 primary records. [2025-10-06T22:35:35.347985] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-06T22:35:35.364691] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-10-06T22:35:35.365748] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-06T22:35:35.369418] [INFO ] [MAIN ] Derivative Progress: 241/2037 symbols completed. BJ took 1.2s. Estimated remaining: 11m 54s. Rate: 150.9 symbols/min [2025-10-06T22:35:35.369615] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:35.377852] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-10-06T22:35:35.395953] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-06T22:35:35.399200] [INFO ] [MAIN ] Derivative Progress: 242/2037 symbols completed. BK took 1.3s. Estimated remaining: 11m 51s. Rate: 151.4 symbols/min [2025-10-06T22:35:35.399772] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:35.400045] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:35.401292] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50317 primary records. [2025-10-06T22:35:35.401599] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-06T22:35:35.420532] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-10-06T22:35:35.428946] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-06T22:35:35.433152] [INFO ] [MAIN ] Derivative Progress: 243/2037 symbols completed. BKD took 1.3s. Estimated remaining: 11m 48s. Rate: 152.0 symbols/min [2025-10-06T22:35:35.433600] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:35.449991] [DEBUG] [LOCAL ] BKE: Loaded 34159 existing records from primary storage. [2025-10-06T22:35:35.450168] [INFO ] [MAIN ] BKE: Loaded 34159 primary data records. [2025-10-06T22:35:35.768919] [DEBUG] [LOCAL ] BKH: Loaded 36789 existing records from primary storage. [2025-10-06T22:35:35.783338] [INFO ] [MAIN ] BKH: Loaded 36789 primary data records. [2025-10-06T22:35:35.783171] [DEBUG] [LOCAL ] BKKT: Loaded 35590 existing records from primary storage. [2025-10-06T22:35:35.783462] [INFO ] [MAIN ] BKKT: Loaded 35590 primary data records. [2025-10-06T22:35:36.461602] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:36.464042] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 34159 primary records. [2025-10-06T22:35:36.464382] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-06T22:35:36.490722] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-10-06T22:35:36.490996] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-06T22:35:36.494944] [INFO ] [MAIN ] Derivative Progress: 244/2037 symbols completed. BKE took 1.1s. Estimated remaining: 11m 53s. Rate: 151.0 symbols/min [2025-10-06T22:35:36.496583] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:36.514208] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:36.520281] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36789 primary records. [2025-10-06T22:35:36.520439] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-06T22:35:36.534184] [DEBUG] [LOCAL ] BKN: Loaded 7717 existing records from primary storage. [2025-10-06T22:35:36.547708] [INFO ] [MAIN ] BKN: Loaded 7717 primary data records. [2025-10-06T22:35:36.565266] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:36.579407] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 35590 primary records. [2025-10-06T22:35:36.599638] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-06T22:35:36.676686] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-10-06T22:35:36.688003] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-06T22:35:36.694127] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-10-06T22:35:36.712486] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-06T22:35:36.697865] [INFO ] [MAIN ] Derivative Progress: 245/2037 symbols completed. BKKT took 1.3s. Estimated remaining: 11m 51s. Rate: 151.3 symbols/min [2025-10-06T22:35:36.715770] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:36.715947] [INFO ] [MAIN ] Derivative Progress: 246/2037 symbols completed. BKH took 1.3s. Estimated remaining: 11m 48s. Rate: 151.9 symbols/min [2025-10-06T22:35:36.717021] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:36.970951] [DEBUG] [LOCAL ] BKT: Loaded 11729 existing records from primary storage. [2025-10-06T22:35:36.972215] [INFO ] [MAIN ] BKT: Loaded 11729 primary data records. [2025-10-06T22:35:37.145338] [DEBUG] [LOCAL ] BKSY: Loaded 48342 existing records from primary storage. [2025-10-06T22:35:37.162533] [INFO ] [MAIN ] BKSY: Loaded 48342 primary data records. [2025-10-06T22:35:37.578316] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:37.696851] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7717 primary records. [2025-10-06T22:35:37.697051] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-06T22:35:37.719700] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-10-06T22:35:37.721059] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-06T22:35:37.724699] [INFO ] [MAIN ] Derivative Progress: 247/2037 symbols completed. BKN took 1.2s. Estimated remaining: 11m 52s. Rate: 150.9 symbols/min [2025-10-06T22:35:37.725627] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:37.741185] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:37.742545] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 11729 primary records. [2025-10-06T22:35:37.742854] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-06T22:35:37.763785] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-10-06T22:35:37.763950] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-06T22:35:37.766805] [INFO ] [MAIN ] Derivative Progress: 248/2037 symbols completed. BKT took 1.0s. Estimated remaining: 11m 49s. Rate: 151.5 symbols/min [2025-10-06T22:35:37.767059] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:37.780906] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:37.781816] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48342 primary records. [2025-10-06T22:35:37.782038] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-06T22:35:37.809134] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-10-06T22:35:37.809261] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-06T22:35:37.812704] [INFO ] [MAIN ] Derivative Progress: 249/2037 symbols completed. BKSY took 1.1s. Estimated remaining: 11m 46s. Rate: 152.0 symbols/min [2025-10-06T22:35:37.813832] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:37.829639] [DEBUG] [LOCAL ] BKU: Loaded 41507 existing records from primary storage. [2025-10-06T22:35:37.837890] [INFO ] [MAIN ] BKU: Loaded 41507 primary data records. [2025-10-06T22:35:37.963999] [DEBUG] [LOCAL ] BKV: Loaded 29817 existing records from primary storage. [2025-10-06T22:35:37.969529] [INFO ] [MAIN ] BKV: Loaded 29817 primary data records. [2025-10-06T22:35:38.388868] [DEBUG] [LOCAL ] BLCO: Loaded 35566 existing records from primary storage. [2025-10-06T22:35:38.513675] [INFO ] [MAIN ] BLCO: Loaded 35566 primary data records. [2025-10-06T22:35:38.951052] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:38.952031] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 41507 primary records. [2025-10-06T22:35:38.952191] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-06T22:35:38.976774] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-10-06T22:35:38.977081] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-06T22:35:38.979679] [INFO ] [MAIN ] Derivative Progress: 250/2037 symbols completed. BKU took 1.3s. Estimated remaining: 11m 51s. Rate: 150.8 symbols/min [2025-10-06T22:35:38.979962] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:38.995002] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:38.996227] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29817 primary records. [2025-10-06T22:35:38.996370] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-06T22:35:39.026863] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-10-06T22:35:39.027215] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-06T22:35:39.030602] [INFO ] [MAIN ] Derivative Progress: 251/2037 symbols completed. BKV took 1.3s. Estimated remaining: 11m 48s. Rate: 151.3 symbols/min [2025-10-06T22:35:39.030924] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:39.045746] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:39.046407] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35566 primary records. [2025-10-06T22:35:39.046482] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-06T22:35:39.074527] [DEBUG] [LOCAL ] BLD: Loaded 27586 existing records from primary storage. [2025-10-06T22:35:39.075554] [INFO ] [MAIN ] BLD: Loaded 27586 primary data records. [2025-10-06T22:35:39.077198] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-10-06T22:35:39.077420] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-06T22:35:39.093345] [INFO ] [MAIN ] Derivative Progress: 252/2037 symbols completed. BLCO took 1.3s. Estimated remaining: 11m 45s. Rate: 151.9 symbols/min [2025-10-06T22:35:39.104211] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:39.281882] [DEBUG] [LOCAL ] BLE: Loaded 14135 existing records from primary storage. [2025-10-06T22:35:39.295696] [INFO ] [MAIN ] BLE: Loaded 14135 primary data records. [2025-10-06T22:35:39.559208] [DEBUG] [LOCAL ] BLDR: Loaded 51674 existing records from primary storage. [2025-10-06T22:35:39.593818] [INFO ] [MAIN ] BLDR: Loaded 51674 primary data records. [2025-10-06T22:35:40.083904] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:40.084987] [INFO ] [MAIN ] BLD: Generated 1794 derivative records from 27586 primary records. [2025-10-06T22:35:40.085346] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-06T22:35:40.121731] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:40.123806] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 14135 primary records. [2025-10-06T22:35:40.124399] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-06T22:35:40.126440] [DEBUG] [LOCAL ] BLD: Derivative data saved (1794 records). [2025-10-06T22:35:40.127158] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-06T22:35:40.130209] [INFO ] [MAIN ] Derivative Progress: 253/2037 symbols completed. BLD took 1.2s. Estimated remaining: 11m 49s. Rate: 150.9 symbols/min [2025-10-06T22:35:40.149800] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-10-06T22:35:40.149964] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-06T22:35:40.152873] [INFO ] [MAIN ] Derivative Progress: 254/2037 symbols completed. BLE took 1.0s. Estimated remaining: 11m 46s. Rate: 151.4 symbols/min [2025-10-06T22:35:40.165768] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:40.166480] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51674 primary records. [2025-10-06T22:35:40.166540] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-06T22:35:40.183257] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-10-06T22:35:40.183325] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-06T22:35:40.186520] [INFO ] [MAIN ] Derivative Progress: 255/2037 symbols completed. BLDR took 1.2s. Estimated remaining: 11m 43s. Rate: 152.0 symbols/min [2025-10-06T22:35:40.186994] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:40.187134] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:40.187262] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:40.206219] [DEBUG] [LOCAL ] BLX: Loaded 15594 existing records from primary storage. [2025-10-06T22:35:40.206363] [INFO ] [MAIN ] BLX: Loaded 15594 primary data records. [2025-10-06T22:35:40.434179] [DEBUG] [LOCAL ] BLK: Loaded 34166 existing records from primary storage. [2025-10-06T22:35:40.435288] [DEBUG] [LOCAL ] BLND: Loaded 49213 existing records from primary storage. [2025-10-06T22:35:40.537604] [INFO ] [MAIN ] BLND: Loaded 49213 primary data records. [2025-10-06T22:35:40.548698] [INFO ] [MAIN ] BLK: Loaded 34166 primary data records. [2025-10-06T22:35:41.244635] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:41.245580] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15594 primary records. [2025-10-06T22:35:41.246166] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-06T22:35:41.271154] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-10-06T22:35:41.273188] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-06T22:35:41.275604] [INFO ] [MAIN ] Derivative Progress: 256/2037 symbols completed. BLX took 1.1s. Estimated remaining: 11m 48s. Rate: 151.0 symbols/min [2025-10-06T22:35:41.276116] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:41.305705] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:41.305254] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:41.306964] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49213 primary records. [2025-10-06T22:35:41.307262] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-06T22:35:41.308513] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34166 primary records. [2025-10-06T22:35:41.308797] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-06T22:35:41.341905] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-10-06T22:35:41.342286] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-06T22:35:41.342338] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-10-06T22:35:41.345904] [INFO ] [MAIN ] Derivative Progress: 257/2037 symbols completed. BLK took 1.2s. Estimated remaining: 11m 45s. Rate: 151.4 symbols/min [2025-10-06T22:35:41.346002] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-06T22:35:41.346222] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:41.349701] [INFO ] [MAIN ] Derivative Progress: 258/2037 symbols completed. BLND took 1.2s. Estimated remaining: 11m 42s. Rate: 152.0 symbols/min [2025-10-06T22:35:41.350042] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:41.373447] [DEBUG] [LOCAL ] BME: Loaded 11023 existing records from primary storage. [2025-10-06T22:35:41.373767] [INFO ] [MAIN ] BME: Loaded 11023 primary data records. [2025-10-06T22:35:41.506053] [DEBUG] [LOCAL ] BMA: Loaded 35563 existing records from primary storage. [2025-10-06T22:35:41.506885] [DEBUG] [LOCAL ] BMEZ: Loaded 26581 existing records from primary storage. [2025-10-06T22:35:41.507207] [INFO ] [MAIN ] BMA: Loaded 35563 primary data records. [2025-10-06T22:35:41.513335] [INFO ] [MAIN ] BMEZ: Loaded 26581 primary data records. [2025-10-06T22:35:42.444727] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:42.447879] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 11023 primary records. [2025-10-06T22:35:42.449131] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-06T22:35:42.464924] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:42.476034] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 35563 primary records. [2025-10-06T22:35:42.482805] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-10-06T22:35:42.483202] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-06T22:35:42.483327] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-06T22:35:42.486949] [INFO ] [MAIN ] Derivative Progress: 259/2037 symbols completed. BME took 1.1s. Estimated remaining: 11m 47s. Rate: 150.9 symbols/min [2025-10-06T22:35:42.503715] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:42.513288] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:42.515237] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26581 primary records. [2025-10-06T22:35:42.515587] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-06T22:35:42.533599] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-10-06T22:35:42.534202] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-06T22:35:42.537960] [INFO ] [MAIN ] Derivative Progress: 260/2037 symbols completed. BMA took 1.3s. Estimated remaining: 11m 44s. Rate: 151.4 symbols/min [2025-10-06T22:35:42.538123] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-10-06T22:35:42.538292] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-06T22:35:42.542149] [INFO ] [MAIN ] Derivative Progress: 261/2037 symbols completed. BMEZ took 1.2s. Estimated remaining: 11m 41s. Rate: 152.0 symbols/min [2025-10-06T22:35:42.538474] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:42.542501] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:42.563238] [DEBUG] [LOCAL ] BMI: Loaded 24309 existing records from primary storage. [2025-10-06T22:35:42.563423] [INFO ] [MAIN ] BMI: Loaded 24309 primary data records. [2025-10-06T22:35:42.928617] [DEBUG] [LOCAL ] BMO: Loaded 41165 existing records from primary storage. [2025-10-06T22:35:42.928870] [INFO ] [MAIN ] BMO: Loaded 41165 primary data records. [2025-10-06T22:35:42.929869] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-06T22:35:42.969080] [INFO ] [MAIN ] BN: Loaded 52993 primary data records. [2025-10-06T22:35:43.593757] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:43.595401] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24309 primary records. [2025-10-06T22:35:43.595833] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-06T22:35:43.615960] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-10-06T22:35:43.616313] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-06T22:35:43.619695] [INFO ] [MAIN ] Derivative Progress: 262/2037 symbols completed. BMI took 1.1s. Estimated remaining: 11m 45s. Rate: 151.0 symbols/min [2025-10-06T22:35:43.621070] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:43.640353] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:43.643221] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41165 primary records. [2025-10-06T22:35:43.643357] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-06T22:35:43.676491] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:43.677616] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52993 primary records. [2025-10-06T22:35:43.678190] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-06T22:35:43.696873] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-10-06T22:35:43.696556] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-10-06T22:35:43.697056] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-06T22:35:43.699761] [INFO ] [MAIN ] Derivative Progress: 263/2037 symbols completed. BMO took 1.2s. Estimated remaining: 11m 43s. Rate: 151.5 symbols/min [2025-10-06T22:35:43.697129] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-06T22:35:43.709109] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:43.713934] [INFO ] [MAIN ] Derivative Progress: 264/2037 symbols completed. BN took 1.2s. Estimated remaining: 11m 40s. Rate: 152.0 symbols/min [2025-10-06T22:35:43.714166] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:43.715243] [DEBUG] [LOCAL ] BNED: Loaded 29447 existing records from primary storage. [2025-10-06T22:35:43.715585] [INFO ] [MAIN ] BNED: Loaded 29447 primary data records. [2025-10-06T22:35:43.802093] [DEBUG] [LOCAL ] BNJ: Loaded 2655 existing records from primary storage. [2025-10-06T22:35:43.810145] [DEBUG] [LOCAL ] BNH: Loaded 5218 existing records from primary storage. [2025-10-06T22:35:43.810218] [INFO ] [MAIN ] BNJ: Loaded 2655 primary data records. [2025-10-06T22:35:43.820361] [INFO ] [MAIN ] BNH: Loaded 5218 primary data records. [2025-10-06T22:35:44.742735] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:44.746689] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 29447 primary records. [2025-10-06T22:35:44.759453] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-06T22:35:44.774285] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:44.775755] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:44.776587] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2655 primary records. [2025-10-06T22:35:44.777460] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 5218 primary records. [2025-10-06T22:35:44.785092] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-06T22:35:44.777910] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-06T22:35:44.794453] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-10-06T22:35:44.801825] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-06T22:35:44.818929] [INFO ] [MAIN ] Derivative Progress: 265/2037 symbols completed. BNED took 1.2s. Estimated remaining: 11m 44s. Rate: 151.0 symbols/min [2025-10-06T22:35:44.819381] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:44.827081] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-10-06T22:35:44.827725] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-06T22:35:44.831336] [INFO ] [MAIN ] Derivative Progress: 266/2037 symbols completed. BNJ took 1.1s. Estimated remaining: 11m 41s. Rate: 151.6 symbols/min [2025-10-06T22:35:44.831939] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:44.833803] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-10-06T22:35:44.833905] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-06T22:35:44.837237] [INFO ] [MAIN ] Derivative Progress: 267/2037 symbols completed. BNH took 1.1s. Estimated remaining: 11m 38s. Rate: 152.1 symbols/min [2025-10-06T22:35:44.837453] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:44.849913] [DEBUG] [LOCAL ] BNT: Loaded 3349 existing records from primary storage. [2025-10-06T22:35:44.850157] [INFO ] [MAIN ] BNT: Loaded 3349 primary data records. [2025-10-06T22:35:45.240062] [DEBUG] [LOCAL ] BNL: Loaded 47097 existing records from primary storage. [2025-10-06T22:35:45.240412] [INFO ] [MAIN ] BNL: Loaded 47097 primary data records. [2025-10-06T22:35:45.241303] [DEBUG] [LOCAL ] BNS: Loaded 51491 existing records from primary storage. [2025-10-06T22:35:45.274666] [INFO ] [MAIN ] BNS: Loaded 51491 primary data records. [2025-10-06T22:35:45.867711] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:45.869473] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3349 primary records. [2025-10-06T22:35:45.869857] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-06T22:35:45.887325] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-10-06T22:35:45.887727] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-06T22:35:45.890865] [INFO ] [MAIN ] Derivative Progress: 268/2037 symbols completed. BNT took 1.1s. Estimated remaining: 11m 42s. Rate: 151.2 symbols/min [2025-10-06T22:35:45.911246] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:45.912130] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 47097 primary records. [2025-10-06T22:35:45.924245] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-06T22:35:45.924435] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:45.925604] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51491 primary records. [2025-10-06T22:35:45.925863] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-06T22:35:45.941575] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-10-06T22:35:45.941817] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-06T22:35:45.953428] [INFO ] [MAIN ] Derivative Progress: 269/2037 symbols completed. BNL took 1.1s. Estimated remaining: 11m 40s. Rate: 151.7 symbols/min [2025-10-06T22:35:45.960051] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-10-06T22:35:45.960115] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-06T22:35:45.963034] [INFO ] [MAIN ] Derivative Progress: 270/2037 symbols completed. BNS took 1.1s. Estimated remaining: 11m 37s. Rate: 152.2 symbols/min [2025-10-06T22:35:45.963677] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:45.963598] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:45.963796] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:45.974495] [DEBUG] [LOCAL ] BNY: Loaded 7004 existing records from primary storage. [2025-10-06T22:35:45.974750] [INFO ] [MAIN ] BNY: Loaded 7004 primary data records. [2025-10-06T22:35:46.109959] [DEBUG] [LOCAL ] BOC: Loaded 18309 existing records from primary storage. [2025-10-06T22:35:46.111277] [INFO ] [MAIN ] BOC: Loaded 18309 primary data records. [2025-10-06T22:35:46.111033] [DEBUG] [LOCAL ] BOE: Loaded 18006 existing records from primary storage. [2025-10-06T22:35:46.147756] [INFO ] [MAIN ] BOE: Loaded 18006 primary data records. [2025-10-06T22:35:47.038980] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:47.040262] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7004 primary records. [2025-10-06T22:35:47.040810] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-06T22:35:47.058110] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-10-06T22:35:47.059537] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-06T22:35:47.063153] [INFO ] [MAIN ] Derivative Progress: 271/2037 symbols completed. BNY took 1.1s. Estimated remaining: 11m 41s. Rate: 151.2 symbols/min [2025-10-06T22:35:47.064157] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:47.080454] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:47.081385] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18309 primary records. [2025-10-06T22:35:47.093939] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-06T22:35:47.094178] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:47.095558] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 18006 primary records. [2025-10-06T22:35:47.095903] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-06T22:35:47.111726] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-10-06T22:35:47.119287] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-06T22:35:47.122444] [INFO ] [MAIN ] Derivative Progress: 272/2037 symbols completed. BOC took 1.2s. Estimated remaining: 11m 38s. Rate: 151.7 symbols/min [2025-10-06T22:35:47.126801] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:47.139951] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-10-06T22:35:47.140050] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-06T22:35:47.143417] [INFO ] [MAIN ] Derivative Progress: 273/2037 symbols completed. BOE took 1.2s. Estimated remaining: 11m 35s. Rate: 152.2 symbols/min [2025-10-06T22:35:47.143785] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:47.155763] [DEBUG] [LOCAL ] BOH: Loaded 30588 existing records from primary storage. [2025-10-06T22:35:47.156317] [INFO ] [MAIN ] BOH: Loaded 30588 primary data records. [2025-10-06T22:35:47.394841] [DEBUG] [LOCAL ] BOND: Loaded 32214 existing records from primary storage. [2025-10-06T22:35:47.406818] [INFO ] [MAIN ] BOND: Loaded 32214 primary data records. [2025-10-06T22:35:47.526093] [DEBUG] [LOCAL ] BOOT: Loaded 40336 existing records from primary storage. [2025-10-06T22:35:47.538809] [INFO ] [MAIN ] BOOT: Loaded 40336 primary data records. [2025-10-06T22:35:48.200123] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:48.202742] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 30588 primary records. [2025-10-06T22:35:48.203350] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-06T22:35:48.224860] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-10-06T22:35:48.225434] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-06T22:35:48.228307] [INFO ] [MAIN ] Derivative Progress: 274/2037 symbols completed. BOH took 1.2s. Estimated remaining: 11m 39s. Rate: 151.2 symbols/min [2025-10-06T22:35:48.228718] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:48.247209] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:35:48.250716] [INFO ] [MAIN ] BOND: Generated 1793 derivative records from 32214 primary records. [2025-10-06T22:35:48.251104] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-06T22:35:48.284044] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:48.286323] [DEBUG] [LOCAL ] BOND: Derivative data saved (1793 records). [2025-10-06T22:35:48.286512] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-06T22:35:48.287331] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 40336 primary records. [2025-10-06T22:35:48.299798] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-06T22:35:48.298389] [INFO ] [MAIN ] Derivative Progress: 275/2037 symbols completed. BOND took 1.2s. Estimated remaining: 11m 37s. Rate: 151.7 symbols/min [2025-10-06T22:35:48.308982] [DEBUG] [LOCAL ] BOW: Loaded 23794 existing records from primary storage. [2025-10-06T22:35:48.300904] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:48.310860] [INFO ] [MAIN ] BOW: Loaded 23794 primary data records. [2025-10-06T22:35:48.440240] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-10-06T22:35:48.463263] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-06T22:35:48.475869] [INFO ] [MAIN ] Derivative Progress: 276/2037 symbols completed. BOOT took 1.3s. Estimated remaining: 11m 35s. Rate: 152.0 symbols/min [2025-10-06T22:35:48.487118] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:48.649708] [DEBUG] [LOCAL ] BOX: Loaded 50221 existing records from primary storage. [2025-10-06T22:35:48.650598] [INFO ] [MAIN ] BOX: Loaded 50221 primary data records. [2025-10-06T22:35:48.859226] [DEBUG] [LOCAL ] BR: Loaded 34837 existing records from primary storage. [2025-10-06T22:35:48.973098] [INFO ] [MAIN ] BR: Loaded 34837 primary data records. [2025-10-06T22:35:49.342020] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:49.343001] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23794 primary records. [2025-10-06T22:35:49.343172] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-06T22:35:49.361446] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-10-06T22:35:49.362226] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-06T22:35:49.365048] [INFO ] [MAIN ] Derivative Progress: 277/2037 symbols completed. BOW took 1.1s. Estimated remaining: 11m 38s. Rate: 151.3 symbols/min [2025-10-06T22:35:49.365948] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:49.383209] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:49.384129] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50221 primary records. [2025-10-06T22:35:49.384258] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-06T22:35:49.401432] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-10-06T22:35:49.401743] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-06T22:35:49.404769] [INFO ] [MAIN ] Derivative Progress: 278/2037 symbols completed. BOX took 1.1s. Estimated remaining: 11m 35s. Rate: 151.8 symbols/min [2025-10-06T22:35:49.405095] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:49.422707] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:49.423461] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34837 primary records. [2025-10-06T22:35:49.423604] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-06T22:35:49.440262] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-10-06T22:35:49.457009] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-06T22:35:49.460329] [INFO ] [MAIN ] Derivative Progress: 279/2037 symbols completed. BR took 1.0s. Estimated remaining: 11m 33s. Rate: 152.3 symbols/min [2025-10-06T22:35:49.460683] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:49.469316] [DEBUG] [LOCAL ] BRC: Loaded 18933 existing records from primary storage. [2025-10-06T22:35:49.469549] [INFO ] [MAIN ] BRC: Loaded 18933 primary data records. [2025-10-06T22:35:49.588394] [DEBUG] [LOCAL ] BRBR: Loaded 51408 existing records from primary storage. [2025-10-06T22:35:49.618917] [INFO ] [MAIN ] BRBR: Loaded 51408 primary data records. [2025-10-06T22:35:49.902799] [DEBUG] [LOCAL ] BRCC: Loaded 40170 existing records from primary storage. [2025-10-06T22:35:49.906316] [INFO ] [MAIN ] BRCC: Loaded 40170 primary data records. [2025-10-06T22:35:50.477060] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:50.479048] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 18933 primary records. [2025-10-06T22:35:50.480038] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-06T22:35:50.509990] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:50.515370] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51408 primary records. [2025-10-06T22:35:50.514374] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-10-06T22:35:50.515589] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-06T22:35:50.515705] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-06T22:35:50.518423] [INFO ] [MAIN ] Derivative Progress: 280/2037 symbols completed. BRC took 1.1s. Estimated remaining: 11m 36s. Rate: 151.4 symbols/min [2025-10-06T22:35:50.519588] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:50.538868] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-10-06T22:35:50.539234] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-06T22:35:50.543410] [INFO ] [MAIN ] Derivative Progress: 281/2037 symbols completed. BRBR took 1.2s. Estimated remaining: 11m 34s. Rate: 151.9 symbols/min [2025-10-06T22:35:50.543968] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:50.558816] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:50.559907] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40170 primary records. [2025-10-06T22:35:50.560070] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-06T22:35:50.579044] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-10-06T22:35:50.579277] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-06T22:35:50.583750] [INFO ] [MAIN ] Derivative Progress: 282/2037 symbols completed. BRCC took 1.1s. Estimated remaining: 11m 31s. Rate: 152.4 symbols/min [2025-10-06T22:35:50.584147] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:50.605261] [DEBUG] [LOCAL ] BRT: Loaded 4946 existing records from primary storage. [2025-10-06T22:35:50.605525] [INFO ] [MAIN ] BRT: Loaded 4946 primary data records. [2025-10-06T22:35:50.768164] [DEBUG] [LOCAL ] BRSP: Loaded 36695 existing records from primary storage. [2025-10-06T22:35:50.779571] [INFO ] [MAIN ] BRSP: Loaded 36695 primary data records. [2025-10-06T22:35:50.892286] [DEBUG] [LOCAL ] BROS: Loaded 53294 existing records from primary storage. [2025-10-06T22:35:51.013133] [INFO ] [MAIN ] BROS: Loaded 53294 primary data records. [2025-10-06T22:35:51.965793] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:51.967180] [INFO ] [MAIN ] BRT: Generated 1794 derivative records from 4946 primary records. [2025-10-06T22:35:51.967551] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-06T22:35:51.988443] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-10-06T22:35:51.988793] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-06T22:35:52.007521] [INFO ] [MAIN ] Derivative Progress: 283/2037 symbols completed. BRT took 1.4s. Estimated remaining: 11m 37s. Rate: 151.0 symbols/min [2025-10-06T22:35:52.009535] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:52.010808] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36695 primary records. [2025-10-06T22:35:52.010936] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-06T22:35:52.027075] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-10-06T22:35:52.027299] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-06T22:35:52.030569] [INFO ] [MAIN ] Derivative Progress: 284/2037 symbols completed. BRSP took 1.5s. Estimated remaining: 11m 34s. Rate: 151.5 symbols/min [2025-10-06T22:35:52.046268] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:52.047036] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53294 primary records. [2025-10-06T22:35:52.047101] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-06T22:35:52.063035] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-10-06T22:35:52.063161] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-06T22:35:52.067145] [INFO ] [MAIN ] Derivative Progress: 285/2037 symbols completed. BROS took 1.5s. Estimated remaining: 11m 32s. Rate: 151.9 symbols/min [2025-10-06T22:35:52.067694] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:52.067812] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:52.067927] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:52.091017] [DEBUG] [LOCAL ] BRW: Loaded 20615 existing records from primary storage. [2025-10-06T22:35:52.098580] [INFO ] [MAIN ] BRW: Loaded 20615 primary data records. [2025-10-06T22:35:52.224796] [DEBUG] [LOCAL ] BSAC: Loaded 32912 existing records from primary storage. [2025-10-06T22:35:52.225051] [INFO ] [MAIN ] BSAC: Loaded 32912 primary data records. [2025-10-06T22:35:52.386785] [DEBUG] [LOCAL ] BRX: Loaded 51731 existing records from primary storage. [2025-10-06T22:35:52.402732] [INFO ] [MAIN ] BRX: Loaded 51731 primary data records. [2025-10-06T22:35:53.084168] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:53.098070] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 32912 primary records. [2025-10-06T22:35:53.098723] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-06T22:35:53.098537] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:53.111905] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 20615 primary records. [2025-10-06T22:35:53.116292] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-06T22:35:53.129005] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-10-06T22:35:53.149811] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-10-06T22:35:53.148812] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-06T22:35:53.154488] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-06T22:35:53.154323] [INFO ] [MAIN ] Derivative Progress: 286/2037 symbols completed. BSAC took 1.1s. Estimated remaining: 11m 36s. Rate: 151.0 symbols/min [2025-10-06T22:35:53.157627] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:53.158152] [INFO ] [MAIN ] Derivative Progress: 287/2037 symbols completed. BRW took 1.1s. Estimated remaining: 11m 33s. Rate: 151.5 symbols/min [2025-10-06T22:35:53.157984] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:53.158497] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:53.159823] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51731 primary records. [2025-10-06T22:35:53.160510] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-06T22:35:53.178774] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-10-06T22:35:53.179021] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-06T22:35:53.182684] [INFO ] [MAIN ] Derivative Progress: 288/2037 symbols completed. BRX took 1.1s. Estimated remaining: 11m 30s. Rate: 152.0 symbols/min [2025-10-06T22:35:53.188507] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:53.206575] [DEBUG] [LOCAL ] BST: Loaded 19005 existing records from primary storage. [2025-10-06T22:35:53.206786] [INFO ] [MAIN ] BST: Loaded 19005 primary data records. [2025-10-06T22:35:53.340788] [DEBUG] [LOCAL ] BSBR: Loaded 35401 existing records from primary storage. [2025-10-06T22:35:53.341142] [INFO ] [MAIN ] BSBR: Loaded 35401 primary data records. [2025-10-06T22:35:53.691393] [DEBUG] [LOCAL ] BSTZ: Loaded 24876 existing records from primary storage. [2025-10-06T22:35:53.707720] [INFO ] [MAIN ] BSTZ: Loaded 24876 primary data records. [2025-10-06T22:35:54.234596] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:54.236217] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 19005 primary records. [2025-10-06T22:35:54.236405] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-06T22:35:54.258612] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:54.265489] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35401 primary records. [2025-10-06T22:35:54.265730] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-06T22:35:54.268738] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-10-06T22:35:54.269821] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-06T22:35:54.272361] [INFO ] [MAIN ] Derivative Progress: 289/2037 symbols completed. BST took 1.1s. Estimated remaining: 11m 34s. Rate: 151.1 symbols/min [2025-10-06T22:35:54.272557] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:54.304466] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-10-06T22:35:54.305077] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-06T22:35:54.308471] [INFO ] [MAIN ] Derivative Progress: 290/2037 symbols completed. BSBR took 1.2s. Estimated remaining: 11m 31s. Rate: 151.6 symbols/min [2025-10-06T22:35:54.305001] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:54.309539] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 24876 primary records. [2025-10-06T22:35:54.308716] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:54.309843] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-06T22:35:54.332237] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-10-06T22:35:54.332542] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-06T22:35:54.336738] [INFO ] [MAIN ] Derivative Progress: 291/2037 symbols completed. BSTZ took 1.1s. Estimated remaining: 11m 29s. Rate: 152.1 symbols/min [2025-10-06T22:35:54.337071] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:54.345041] [DEBUG] [LOCAL ] BTCM: Loaded 15847 existing records from primary storage. [2025-10-06T22:35:54.345202] [INFO ] [MAIN ] BTCM: Loaded 15847 primary data records. [2025-10-06T22:35:54.510040] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-06T22:35:54.525589] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-10-06T22:35:54.879303] [DEBUG] [LOCAL ] BTE: Loaded 52711 existing records from primary storage. [2025-10-06T22:35:54.901601] [INFO ] [MAIN ] BTE: Loaded 52711 primary data records. [2025-10-06T22:35:55.337662] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:55.338727] [INFO ] [MAIN ] BTCM: Generated 1794 derivative records from 15847 primary records. [2025-10-06T22:35:55.338927] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-10-06T22:35:55.361924] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1794 records). [2025-10-06T22:35:55.363028] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-10-06T22:35:55.365696] [INFO ] [MAIN ] Derivative Progress: 292/2037 symbols completed. BTCM took 1.1s. Estimated remaining: 11m 32s. Rate: 151.2 symbols/min [2025-10-06T22:35:55.366012] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:55.379706] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:55.380585] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-10-06T22:35:55.380950] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-06T22:35:55.404985] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-10-06T22:35:55.405330] [DEBUG] [LOCAL ] BTO: Loaded 8690 existing records from primary storage. [2025-10-06T22:35:55.406330] [INFO ] [MAIN ] BTO: Loaded 8690 primary data records. [2025-10-06T22:35:55.405505] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-06T22:35:55.421279] [INFO ] [MAIN ] Derivative Progress: 293/2037 symbols completed. BSX took 1.1s. Estimated remaining: 11m 30s. Rate: 151.7 symbols/min [2025-10-06T22:35:55.430831] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:55.510449] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:55.516501] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52711 primary records. [2025-10-06T22:35:55.537493] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-06T22:35:55.625961] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-10-06T22:35:55.660527] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-06T22:35:55.671920] [DEBUG] [LOCAL ] BTT: Loaded 15829 existing records from primary storage. [2025-10-06T22:35:55.695625] [INFO ] [MAIN ] Derivative Progress: 294/2037 symbols completed. BTE took 1.4s. Estimated remaining: 11m 29s. Rate: 151.8 symbols/min [2025-10-06T22:35:55.803149] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:55.695923] [INFO ] [MAIN ] BTT: Loaded 15829 primary data records. [2025-10-06T22:35:56.156871] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:56.158454] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8690 primary records. [2025-10-06T22:35:56.158556] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-06T22:35:56.188421] [DEBUG] [LOCAL ] BTU: Loaded 53310 existing records from primary storage. [2025-10-06T22:35:56.193248] [INFO ] [MAIN ] BTU: Loaded 53310 primary data records. [2025-10-06T22:35:56.312898] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-10-06T22:35:56.330534] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-06T22:35:56.333318] [INFO ] [MAIN ] Derivative Progress: 295/2037 symbols completed. BTO took 1.0s. Estimated remaining: 11m 30s. Rate: 151.5 symbols/min [2025-10-06T22:35:56.334118] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:56.333795] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:56.351978] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 15829 primary records. [2025-10-06T22:35:56.367893] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-06T22:35:56.567512] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-10-06T22:35:56.567772] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-06T22:35:56.571721] [INFO ] [MAIN ] Derivative Progress: 296/2037 symbols completed. BTT took 1.1s. Estimated remaining: 11m 28s. Rate: 151.7 symbols/min [2025-10-06T22:35:56.572429] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:56.585750] [DEBUG] [LOCAL ] BTZ: Loaded 22737 existing records from primary storage. [2025-10-06T22:35:56.586019] [INFO ] [MAIN ] BTZ: Loaded 22737 primary data records. [2025-10-06T22:35:56.929114] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:56.931427] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53310 primary records. [2025-10-06T22:35:56.931566] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-06T22:35:56.965737] [DEBUG] [LOCAL ] BUD: Loaded 52705 existing records from primary storage. [2025-10-06T22:35:56.964786] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-10-06T22:35:56.965997] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-06T22:35:56.965923] [INFO ] [MAIN ] BUD: Loaded 52705 primary data records. [2025-10-06T22:35:56.968477] [INFO ] [MAIN ] Derivative Progress: 297/2037 symbols completed. BTU took 1.2s. Estimated remaining: 11m 28s. Rate: 151.7 symbols/min [2025-10-06T22:35:56.973817] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:57.317976] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:57.331178] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22737 primary records. [2025-10-06T22:35:57.332662] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-06T22:35:57.334465] [DEBUG] [LOCAL ] BURL: Loaded 45861 existing records from primary storage. [2025-10-06T22:35:57.342068] [INFO ] [MAIN ] BURL: Loaded 45861 primary data records. [2025-10-06T22:35:57.383696] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-10-06T22:35:57.410247] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-06T22:35:57.427717] [INFO ] [MAIN ] Derivative Progress: 298/2037 symbols completed. BTZ took 1.1s. Estimated remaining: 11m 28s. Rate: 151.6 symbols/min [2025-10-06T22:35:57.715175] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:57.715974] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52705 primary records. [2025-10-06T22:35:57.716124] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-06T22:35:57.733880] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-10-06T22:35:57.734376] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-06T22:35:57.736488] [INFO ] [MAIN ] Derivative Progress: 299/2037 symbols completed. BUD took 1.2s. Estimated remaining: 11m 27s. Rate: 151.8 symbols/min [2025-10-06T22:35:57.755586] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:57.756223] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 45861 primary records. [2025-10-06T22:35:57.756284] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-06T22:35:57.771373] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-10-06T22:35:57.771432] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-06T22:35:57.774103] [INFO ] [MAIN ] Derivative Progress: 300/2037 symbols completed. BURL took 0.8s. Estimated remaining: 11m 25s. Rate: 152.2 symbols/min [2025-10-06T22:35:57.774530] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:57.774475] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:57.774729] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:57.794751] [DEBUG] [LOCAL ] BUXX: Loaded 15257 existing records from primary storage. [2025-10-06T22:35:57.794988] [INFO ] [MAIN ] BUXX: Loaded 15257 primary data records. [2025-10-06T22:35:57.961780] [DEBUG] [LOCAL ] BV: Loaded 38381 existing records from primary storage. [2025-10-06T22:35:57.967345] [INFO ] [MAIN ] BV: Loaded 38381 primary data records. [2025-10-06T22:35:58.083208] [DEBUG] [LOCAL ] BVN: Loaded 43948 existing records from primary storage. [2025-10-06T22:35:58.234138] [INFO ] [MAIN ] BVN: Loaded 43948 primary data records. [2025-10-06T22:35:58.805671] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:35:58.807333] [INFO ] [MAIN ] BUXX: Generated 1793 derivative records from 15257 primary records. [2025-10-06T22:35:58.808547] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-06T22:35:58.835269] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:58.836734] [INFO ] [MAIN ] BV: Generated 1794 derivative records from 38381 primary records. [2025-10-06T22:35:58.837272] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-06T22:35:58.857169] [DEBUG] [LOCAL ] BV: Derivative data saved (1794 records). [2025-10-06T22:35:58.857897] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-06T22:35:58.860831] [INFO ] [MAIN ] Derivative Progress: 301/2037 symbols completed. BV took 1.1s. Estimated remaining: 11m 28s. Rate: 151.3 symbols/min [2025-10-06T22:35:58.857750] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-10-06T22:35:58.862257] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:58.861188] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-06T22:35:58.865532] [INFO ] [MAIN ] Derivative Progress: 302/2037 symbols completed. BUXX took 1.1s. Estimated remaining: 11m 26s. Rate: 151.8 symbols/min [2025-10-06T22:35:58.867575] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:58.881931] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:58.882744] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 43948 primary records. [2025-10-06T22:35:58.882963] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-06T22:35:58.904858] [DEBUG] [LOCAL ] BWG: Loaded 12605 existing records from primary storage. [2025-10-06T22:35:58.905573] [INFO ] [MAIN ] BWG: Loaded 12605 primary data records. [2025-10-06T22:35:58.977683] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-10-06T22:35:58.994420] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-06T22:35:59.027438] [INFO ] [MAIN ] Derivative Progress: 303/2037 symbols completed. BVN took 1.3s. Estimated remaining: 11m 24s. Rate: 152.1 symbols/min [2025-10-06T22:35:59.038583] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:35:59.166082] [DEBUG] [LOCAL ] BWA: Loaded 52170 existing records from primary storage. [2025-10-06T22:35:59.253724] [INFO ] [MAIN ] BWA: Loaded 52170 primary data records. [2025-10-06T22:35:59.402706] [DEBUG] [LOCAL ] BWLP: Loaded 32271 existing records from primary storage. [2025-10-06T22:35:59.459935] [INFO ] [MAIN ] BWLP: Loaded 32271 primary data records. [2025-10-06T22:35:59.964232] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:35:59.965281] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12605 primary records. [2025-10-06T22:35:59.966171] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-06T22:36:00.000572] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:00.002511] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52170 primary records. [2025-10-06T22:36:00.003119] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-06T22:36:00.004117] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-10-06T22:36:00.004387] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-06T22:36:00.013882] [INFO ] [MAIN ] Derivative Progress: 304/2037 symbols completed. BWG took 1.1s. Estimated remaining: 11m 27s. Rate: 151.4 symbols/min [2025-10-06T22:36:00.015078] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:00.022916] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-10-06T22:36:00.022991] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-06T22:36:00.026093] [INFO ] [MAIN ] Derivative Progress: 305/2037 symbols completed. BWA took 1.2s. Estimated remaining: 11m 24s. Rate: 151.9 symbols/min [2025-10-06T22:36:00.026712] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:00.051565] [DEBUG] [LOCAL ] BWMX: Loaded 7693 existing records from primary storage. [2025-10-06T22:36:00.054881] [DEBUG] [LOCAL ] BWNB: Loaded 4392 existing records from primary storage. [2025-10-06T22:36:00.054957] [INFO ] [MAIN ] BWMX: Loaded 7693 primary data records. [2025-10-06T22:36:00.055257] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:00.055395] [INFO ] [MAIN ] BWNB: Loaded 4392 primary data records. [2025-10-06T22:36:00.099525] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 32271 primary records. [2025-10-06T22:36:00.140890] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-06T22:36:00.520495] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-10-06T22:36:00.554613] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-06T22:36:00.575007] [INFO ] [MAIN ] Derivative Progress: 306/2037 symbols completed. BWLP took 1.5s. Estimated remaining: 11m 25s. Rate: 151.7 symbols/min [2025-10-06T22:36:00.702365] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:00.716864] [DEBUG] [LOCAL ] BWSN: Loaded 5204 existing records from primary storage. [2025-10-06T22:36:00.718057] [INFO ] [MAIN ] BWSN: Loaded 5204 primary data records. [2025-10-06T22:36:00.843933] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:00.855431] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4392 primary records. [2025-10-06T22:36:00.866587] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-06T22:36:01.072278] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:01.074136] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7693 primary records. [2025-10-06T22:36:01.074501] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-06T22:36:01.084307] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-10-06T22:36:01.087949] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-06T22:36:01.090829] [INFO ] [MAIN ] Derivative Progress: 307/2037 symbols completed. BWNB took 1.1s. Estimated remaining: 11m 25s. Rate: 151.5 symbols/min [2025-10-06T22:36:01.094595] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:01.096184] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-10-06T22:36:01.096544] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-06T22:36:01.099670] [INFO ] [MAIN ] Derivative Progress: 308/2037 symbols completed. BWMX took 1.1s. Estimated remaining: 11m 22s. Rate: 152.0 symbols/min [2025-10-06T22:36:01.100034] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:01.122890] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:01.123698] [INFO ] [MAIN ] BWSN: Generated 1794 derivative records from 5204 primary records. [2025-10-06T22:36:01.123935] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-06T22:36:01.138978] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1794 records). [2025-10-06T22:36:01.149166] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-06T22:36:01.152717] [INFO ] [MAIN ] Derivative Progress: 309/2037 symbols completed. BWSN took 0.5s. Estimated remaining: 11m 20s. Rate: 152.4 symbols/min [2025-10-06T22:36:01.153165] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:01.189230] [DEBUG] [LOCAL ] BWXT: Loaded 46898 existing records from primary storage. [2025-10-06T22:36:01.189489] [INFO ] [MAIN ] BWXT: Loaded 46898 primary data records. [2025-10-06T22:36:01.217096] [DEBUG] [LOCAL ] BXC: Loaded 13641 existing records from primary storage. [2025-10-06T22:36:01.241612] [INFO ] [MAIN ] BXC: Loaded 13641 primary data records. [2025-10-06T22:36:01.314324] [DEBUG] [LOCAL ] BX: Loaded 53479 existing records from primary storage. [2025-10-06T22:36:01.354330] [INFO ] [MAIN ] BX: Loaded 53479 primary data records. [2025-10-06T22:36:02.254952] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:02.256241] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 46898 primary records. [2025-10-06T22:36:02.256478] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-06T22:36:02.303734] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:02.304802] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:02.305592] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13641 primary records. [2025-10-06T22:36:02.306876] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-06T22:36:02.307566] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53479 primary records. [2025-10-06T22:36:02.308470] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-06T22:36:02.306728] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-10-06T22:36:02.316085] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-06T22:36:02.328776] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-10-06T22:36:02.323951] [INFO ] [MAIN ] Derivative Progress: 310/2037 symbols completed. BWXT took 1.2s. Estimated remaining: 11m 24s. Rate: 151.5 symbols/min [2025-10-06T22:36:02.329019] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-06T22:36:02.344145] [INFO ] [MAIN ] Derivative Progress: 311/2037 symbols completed. BXC took 1.2s. Estimated remaining: 11m 22s. Rate: 151.9 symbols/min [2025-10-06T22:36:02.344344] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:02.341223] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:02.354055] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-10-06T22:36:02.354309] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-06T22:36:02.363593] [INFO ] [MAIN ] Derivative Progress: 312/2037 symbols completed. BX took 1.3s. Estimated remaining: 11m 19s. Rate: 152.4 symbols/min [2025-10-06T22:36:02.364016] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:02.376002] [DEBUG] [LOCAL ] BXMX: Loaded 19522 existing records from primary storage. [2025-10-06T22:36:02.376222] [INFO ] [MAIN ] BXMX: Loaded 19522 primary data records. [2025-10-06T22:36:02.599872] [DEBUG] [LOCAL ] BXMT: Loaded 47183 existing records from primary storage. [2025-10-06T22:36:02.600166] [INFO ] [MAIN ] BXMT: Loaded 47183 primary data records. [2025-10-06T22:36:02.858958] [DEBUG] [LOCAL ] BXSL: Loaded 47707 existing records from primary storage. [2025-10-06T22:36:02.881439] [INFO ] [MAIN ] BXSL: Loaded 47707 primary data records. [2025-10-06T22:36:03.318155] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:03.445439] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19522 primary records. [2025-10-06T22:36:03.445693] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-06T22:36:03.473223] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-10-06T22:36:03.475042] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-06T22:36:03.478754] [INFO ] [MAIN ] Derivative Progress: 313/2037 symbols completed. BXMX took 1.1s. Estimated remaining: 11m 23s. Rate: 151.5 symbols/min [2025-10-06T22:36:03.501224] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:03.502449] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47183 primary records. [2025-10-06T22:36:03.502558] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-06T22:36:03.529193] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-10-06T22:36:03.542285] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:03.543339] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 47707 primary records. [2025-10-06T22:36:03.543430] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-06T22:36:03.543590] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-06T22:36:03.547271] [INFO ] [MAIN ] Derivative Progress: 314/2037 symbols completed. BXMT took 1.2s. Estimated remaining: 11m 21s. Rate: 151.9 symbols/min [2025-10-06T22:36:03.564111] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-10-06T22:36:03.564189] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-06T22:36:03.567309] [INFO ] [MAIN ] Derivative Progress: 315/2037 symbols completed. BXSL took 1.2s. Estimated remaining: 11m 18s. Rate: 152.4 symbols/min [2025-10-06T22:36:03.567984] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:03.568375] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:03.568146] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:03.602102] [DEBUG] [LOCAL ] BY: Loaded 21672 existing records from primary storage. [2025-10-06T22:36:03.602293] [INFO ] [MAIN ] BY: Loaded 21672 primary data records. [2025-10-06T22:36:03.737195] [DEBUG] [LOCAL ] BZH: Loaded 32355 existing records from primary storage. [2025-10-06T22:36:03.751826] [INFO ] [MAIN ] BZH: Loaded 32355 primary data records. [2025-10-06T22:36:03.792738] [DEBUG] [LOCAL ] BYD: Loaded 44852 existing records from primary storage. [2025-10-06T22:36:03.863394] [INFO ] [MAIN ] BYD: Loaded 44852 primary data records. [2025-10-06T22:36:04.708026] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:04.708990] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21672 primary records. [2025-10-06T22:36:04.709275] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-06T22:36:04.729632] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-10-06T22:36:04.730332] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-06T22:36:04.733202] [INFO ] [MAIN ] Derivative Progress: 316/2037 symbols completed. BY took 1.2s. Estimated remaining: 11m 22s. Rate: 151.4 symbols/min [2025-10-06T22:36:04.733810] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:04.766691] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:04.767946] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32355 primary records. [2025-10-06T22:36:04.767139] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:04.768684] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 44852 primary records. [2025-10-06T22:36:04.768942] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-06T22:36:04.769341] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-06T22:36:04.801726] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-10-06T22:36:04.802115] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-06T22:36:04.806742] [INFO ] [MAIN ] Derivative Progress: 317/2037 symbols completed. BYD took 1.2s. Estimated remaining: 11m 20s. Rate: 151.8 symbols/min [2025-10-06T22:36:04.809111] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:04.808746] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-10-06T22:36:04.809917] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-06T22:36:04.812973] [INFO ] [MAIN ] Derivative Progress: 318/2037 symbols completed. BZH took 1.2s. Estimated remaining: 11m 17s. Rate: 152.3 symbols/min [2025-10-06T22:36:04.813274] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:04.859954] [DEBUG] [LOCAL ] CAAP: Loaded 19865 existing records from primary storage. [2025-10-06T22:36:04.861267] [INFO ] [MAIN ] CAAP: Loaded 19865 primary data records. [2025-10-06T22:36:04.861874] [DEBUG] [LOCAL ] CABO: Loaded 16885 existing records from primary storage. [2025-10-06T22:36:04.892038] [INFO ] [MAIN ] CABO: Loaded 16885 primary data records. [2025-10-06T22:36:04.958679] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-06T22:36:04.998760] [INFO ] [MAIN ] C: Loaded 53740 primary data records. [2025-10-06T22:36:05.933505] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:05.934403] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19865 primary records. [2025-10-06T22:36:05.934986] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-06T22:36:05.970807] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:05.970415] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-10-06T22:36:05.983808] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 16885 primary records. [2025-10-06T22:36:05.983982] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-06T22:36:05.986241] [INFO ] [MAIN ] Derivative Progress: 319/2037 symbols completed. CAAP took 1.2s. Estimated remaining: 11m 21s. Rate: 151.3 symbols/min [2025-10-06T22:36:05.986714] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:05.986577] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:05.986833] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-06T22:36:05.989109] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53740 primary records. [2025-10-06T22:36:05.989271] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-06T22:36:06.018702] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-10-06T22:36:06.020910] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-06T22:36:06.024752] [INFO ] [MAIN ] Derivative Progress: 320/2037 symbols completed. CABO took 1.2s. Estimated remaining: 11m 19s. Rate: 151.8 symbols/min [2025-10-06T22:36:06.025468] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:06.028309] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-10-06T22:36:06.034931] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-06T22:36:06.038031] [INFO ] [MAIN ] Derivative Progress: 321/2037 symbols completed. C took 1.3s. Estimated remaining: 11m 16s. Rate: 152.2 symbols/min [2025-10-06T22:36:06.038398] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:06.050895] [DEBUG] [LOCAL ] CACI: Loaded 24209 existing records from primary storage. [2025-10-06T22:36:06.051121] [INFO ] [MAIN ] CACI: Loaded 24209 primary data records. [2025-10-06T22:36:06.392835] [DEBUG] [LOCAL ] CAE: Loaded 39221 existing records from primary storage. [2025-10-06T22:36:06.403155] [INFO ] [MAIN ] CAE: Loaded 39221 primary data records. [2025-10-06T22:36:06.426011] [DEBUG] [LOCAL ] CADE: Loaded 49070 existing records from primary storage. [2025-10-06T22:36:06.442404] [INFO ] [MAIN ] CADE: Loaded 49070 primary data records. [2025-10-06T22:36:07.039151] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:07.040408] [INFO ] [MAIN ] CACI: Generated 1794 derivative records from 24209 primary records. [2025-10-06T22:36:07.040747] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-06T22:36:07.060200] [DEBUG] [LOCAL ] CACI: Derivative data saved (1794 records). [2025-10-06T22:36:07.060623] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-06T22:36:07.063615] [INFO ] [MAIN ] Derivative Progress: 322/2037 symbols completed. CACI took 1.1s. Estimated remaining: 11m 19s. Rate: 151.5 symbols/min [2025-10-06T22:36:07.064965] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:07.090166] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:07.088362] [DEBUG] [LOCAL ] CAF: Loaded 3419 existing records from primary storage. [2025-10-06T22:36:07.092022] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 49070 primary records. [2025-10-06T22:36:07.091258] [INFO ] [MAIN ] CAF: Loaded 3419 primary data records. [2025-10-06T22:36:07.092238] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-06T22:36:07.176574] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:07.205676] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 39221 primary records. [2025-10-06T22:36:07.224942] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-06T22:36:07.232200] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-10-06T22:36:07.243921] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-06T22:36:07.252071] [INFO ] [MAIN ] Derivative Progress: 323/2037 symbols completed. CADE took 1.2s. Estimated remaining: 11m 18s. Rate: 151.7 symbols/min [2025-10-06T22:36:07.258093] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:07.328030] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-10-06T22:36:07.441952] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-06T22:36:07.446159] [INFO ] [MAIN ] Derivative Progress: 324/2037 symbols completed. CAE took 1.4s. Estimated remaining: 11m 16s. Rate: 152.0 symbols/min [2025-10-06T22:36:07.446452] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:07.489095] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:07.490143] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3419 primary records. [2025-10-06T22:36:07.490312] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-06T22:36:07.505208] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-10-06T22:36:07.505346] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-06T22:36:07.508036] [INFO ] [MAIN ] Derivative Progress: 325/2037 symbols completed. CAF took 0.4s. Estimated remaining: 11m 14s. Rate: 152.4 symbols/min [2025-10-06T22:36:07.509081] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:07.539994] [DEBUG] [LOCAL ] CAG: Loaded 53664 existing records from primary storage. [2025-10-06T22:36:07.540241] [INFO ] [MAIN ] CAG: Loaded 53664 primary data records. [2025-10-06T22:36:07.661687] [DEBUG] [LOCAL ] CAH: Loaded 51470 existing records from primary storage. [2025-10-06T22:36:07.710117] [INFO ] [MAIN ] CAH: Loaded 51470 primary data records. [2025-10-06T22:36:08.052623] [DEBUG] [LOCAL ] CAL: Loaded 43096 existing records from primary storage. [2025-10-06T22:36:08.070426] [INFO ] [MAIN ] CAL: Loaded 43096 primary data records. [2025-10-06T22:36:08.588807] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:08.589788] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53664 primary records. [2025-10-06T22:36:08.590997] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-06T22:36:08.627380] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:08.628069] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-10-06T22:36:08.628553] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-06T22:36:08.629483] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51470 primary records. [2025-10-06T22:36:08.632888] [INFO ] [MAIN ] Derivative Progress: 326/2037 symbols completed. CAG took 1.4s. Estimated remaining: 11m 18s. Rate: 151.5 symbols/min [2025-10-06T22:36:08.633125] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-06T22:36:08.633264] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:08.654136] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-10-06T22:36:08.654492] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-06T22:36:08.658624] [INFO ] [MAIN ] Derivative Progress: 327/2037 symbols completed. CAH took 1.2s. Estimated remaining: 11m 15s. Rate: 151.9 symbols/min [2025-10-06T22:36:08.658866] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:08.673099] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:08.673879] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 43096 primary records. [2025-10-06T22:36:08.674038] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-06T22:36:08.691033] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-10-06T22:36:08.700911] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-06T22:36:08.704180] [INFO ] [MAIN ] Derivative Progress: 328/2037 symbols completed. CAL took 1.2s. Estimated remaining: 11m 13s. Rate: 152.3 symbols/min [2025-10-06T22:36:08.733375] [DEBUG] [LOCAL ] CANG: Loaded 26918 existing records from primary storage. [2025-10-06T22:36:08.734311] [DEBUG] [LOCAL ] CALX: Loaded 37817 existing records from primary storage. [2025-10-06T22:36:08.734538] [INFO ] [MAIN ] CANG: Loaded 26918 primary data records. [2025-10-06T22:36:08.734734] [INFO ] [MAIN ] CALX: Loaded 37817 primary data records. [2025-10-06T22:36:09.384350] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:09.385376] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 37817 primary records. [2025-10-06T22:36:09.385519] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-06T22:36:09.406281] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:09.414582] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 26918 primary records. [2025-10-06T22:36:09.414695] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-06T22:36:09.415721] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-10-06T22:36:09.415842] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-06T22:36:09.418695] [INFO ] [MAIN ] Derivative Progress: 329/2037 symbols completed. CALX took 0.8s. Estimated remaining: 11m 14s. Rate: 152.0 symbols/min [2025-10-06T22:36:09.433484] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-10-06T22:36:09.433551] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-06T22:36:09.436513] [INFO ] [MAIN ] Derivative Progress: 330/2037 symbols completed. CANG took 0.8s. Estimated remaining: 11m 12s. Rate: 152.4 symbols/min [2025-10-06T22:36:09.437117] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:09.437245] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:09.437764] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:09.447307] [DEBUG] [LOCAL ] CAPL: Loaded 5725 existing records from primary storage. [2025-10-06T22:36:09.447497] [INFO ] [MAIN ] CAPL: Loaded 5725 primary data records. [2025-10-06T22:36:09.782570] [DEBUG] [LOCAL ] CARS: Loaded 39750 existing records from primary storage. [2025-10-06T22:36:09.783079] [INFO ] [MAIN ] CARS: Loaded 39750 primary data records. [2025-10-06T22:36:09.888013] [DEBUG] [LOCAL ] CARR: Loaded 53595 existing records from primary storage. [2025-10-06T22:36:09.907713] [INFO ] [MAIN ] CARR: Loaded 53595 primary data records. [2025-10-06T22:36:10.547479] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:10.549914] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5725 primary records. [2025-10-06T22:36:10.550574] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-06T22:36:10.572148] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-10-06T22:36:10.572468] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-06T22:36:10.575544] [INFO ] [MAIN ] Derivative Progress: 331/2037 symbols completed. CAPL took 1.1s. Estimated remaining: 11m 15s. Rate: 151.5 symbols/min [2025-10-06T22:36:10.575879] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:10.595473] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:10.597847] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 39750 primary records. [2025-10-06T22:36:10.599797] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-06T22:36:10.634615] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:10.636418] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53595 primary records. [2025-10-06T22:36:10.636818] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-06T22:36:10.664914] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-10-06T22:36:10.682400] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-06T22:36:10.682523] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-10-06T22:36:10.686203] [INFO ] [MAIN ] Derivative Progress: 332/2037 symbols completed. CARR took 1.2s. Estimated remaining: 11m 14s. Rate: 151.9 symbols/min [2025-10-06T22:36:10.686405] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-06T22:36:10.689480] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:10.689633] [INFO ] [MAIN ] Derivative Progress: 333/2037 symbols completed. CARS took 1.3s. Estimated remaining: 11m 11s. Rate: 152.3 symbols/min [2025-10-06T22:36:10.690083] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:10.715707] [DEBUG] [LOCAL ] CAT: Loaded 52917 existing records from primary storage. [2025-10-06T22:36:10.716118] [INFO ] [MAIN ] CAT: Loaded 52917 primary data records. [2025-10-06T22:36:10.742863] [DEBUG] [LOCAL ] CATO: Loaded 7011 existing records from primary storage. [2025-10-06T22:36:10.777089] [INFO ] [MAIN ] CATO: Loaded 7011 primary data records. [2025-10-06T22:36:11.361605] [DEBUG] [LOCAL ] CAVA: Loaded 53556 existing records from primary storage. [2025-10-06T22:36:11.363334] [INFO ] [MAIN ] CAVA: Loaded 53556 primary data records. [2025-10-06T22:36:11.687422] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:11.688358] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52917 primary records. [2025-10-06T22:36:11.688528] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-06T22:36:11.721623] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:36:11.723357] [INFO ] [MAIN ] CATO: Generated 1793 derivative records from 7011 primary records. [2025-10-06T22:36:11.723789] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-06T22:36:11.740607] [DEBUG] [LOCAL ] CATO: Derivative data saved (1793 records). [2025-10-06T22:36:11.742198] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-06T22:36:11.742672] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-10-06T22:36:11.745800] [INFO ] [MAIN ] Derivative Progress: 334/2037 symbols completed. CATO took 1.1s. Estimated remaining: 11m 14s. Rate: 151.6 symbols/min [2025-10-06T22:36:11.745986] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-06T22:36:11.746138] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:11.749363] [INFO ] [MAIN ] Derivative Progress: 335/2037 symbols completed. CAT took 1.2s. Estimated remaining: 11m 12s. Rate: 152.0 symbols/min [2025-10-06T22:36:11.750615] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:11.773253] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:11.774266] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53556 primary records. [2025-10-06T22:36:11.774537] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-06T22:36:11.794991] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-10-06T22:36:11.799854] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-06T22:36:11.800299] [DEBUG] [LOCAL ] CBAN: Loaded 10712 existing records from primary storage. [2025-10-06T22:36:11.800545] [INFO ] [MAIN ] CBAN: Loaded 10712 primary data records. [2025-10-06T22:36:11.803418] [INFO ] [MAIN ] Derivative Progress: 336/2037 symbols completed. CAVA took 1.1s. Estimated remaining: 11m 10s. Rate: 152.4 symbols/min [2025-10-06T22:36:11.808961] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:11.961951] [DEBUG] [LOCAL ] CBL: Loaded 16311 existing records from primary storage. [2025-10-06T22:36:12.026183] [INFO ] [MAIN ] CBL: Loaded 16311 primary data records. [2025-10-06T22:36:12.041598] [DEBUG] [LOCAL ] CB: Loaded 49941 existing records from primary storage. [2025-10-06T22:36:12.067579] [INFO ] [MAIN ] CB: Loaded 49941 primary data records. [2025-10-06T22:36:12.836696] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:12.839007] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 10712 primary records. [2025-10-06T22:36:12.839156] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-06T22:36:12.857315] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-10-06T22:36:12.857824] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-06T22:36:12.860487] [INFO ] [MAIN ] Derivative Progress: 337/2037 symbols completed. CBAN took 1.1s. Estimated remaining: 11m 13s. Rate: 151.6 symbols/min [2025-10-06T22:36:12.860795] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:12.868738] [DEBUG] [LOCAL ] CBNA: Loaded 2906 existing records from primary storage. [2025-10-06T22:36:12.881414] [INFO ] [MAIN ] CBNA: Loaded 2906 primary data records. [2025-10-06T22:36:12.893613] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:12.947478] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16311 primary records. [2025-10-06T22:36:12.947628] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-06T22:36:13.011222] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:13.030888] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 49941 primary records. [2025-10-06T22:36:13.068459] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-06T22:36:13.226263] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-10-06T22:36:13.226919] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-06T22:36:13.230580] [INFO ] [MAIN ] Derivative Progress: 338/2037 symbols completed. CBL took 1.4s. Estimated remaining: 11m 12s. Rate: 151.7 symbols/min [2025-10-06T22:36:13.230812] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:13.248379] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-10-06T22:36:13.249452] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-06T22:36:13.252546] [INFO ] [MAIN ] Derivative Progress: 339/2037 symbols completed. CB took 1.5s. Estimated remaining: 11m 10s. Rate: 152.1 symbols/min [2025-10-06T22:36:13.253063] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:13.315674] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:13.316631] [INFO ] [MAIN ] CBNA: Generated 1794 derivative records from 2906 primary records. [2025-10-06T22:36:13.316761] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-06T22:36:13.317450] [DEBUG] [LOCAL ] CBT: Loaded 30746 existing records from primary storage. [2025-10-06T22:36:13.318403] [INFO ] [MAIN ] CBT: Loaded 30746 primary data records. [2025-10-06T22:36:13.442468] [DEBUG] [LOCAL ] CBRE: Loaded 50483 existing records from primary storage. [2025-10-06T22:36:13.436048] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-10-06T22:36:13.454955] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-06T22:36:13.457126] [INFO ] [MAIN ] Derivative Progress: 340/2037 symbols completed. CBNA took 0.6s. Estimated remaining: 11m 8s. Rate: 152.3 symbols/min [2025-10-06T22:36:13.457571] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:13.457275] [INFO ] [MAIN ] CBRE: Loaded 50483 primary data records. [2025-10-06T22:36:14.029037] [DEBUG] [LOCAL ] CBU: Loaded 22556 existing records from primary storage. [2025-10-06T22:36:14.038862] [INFO ] [MAIN ] CBU: Loaded 22556 primary data records. [2025-10-06T22:36:14.388862] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:14.390139] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 30746 primary records. [2025-10-06T22:36:14.390388] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-06T22:36:14.412394] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-10-06T22:36:14.413676] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-06T22:36:14.415866] [INFO ] [MAIN ] Derivative Progress: 341/2037 symbols completed. CBT took 1.2s. Estimated remaining: 11m 11s. Rate: 151.7 symbols/min [2025-10-06T22:36:14.416547] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:14.431807] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:14.432627] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50483 primary records. [2025-10-06T22:36:14.432833] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-06T22:36:14.453721] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-10-06T22:36:14.454025] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-06T22:36:14.461282] [INFO ] [MAIN ] Derivative Progress: 342/2037 symbols completed. CBRE took 1.2s. Estimated remaining: 11m 9s. Rate: 152.1 symbols/min [2025-10-06T22:36:14.475097] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:14.490793] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:14.492184] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22556 primary records. [2025-10-06T22:36:14.505718] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-06T22:36:14.511086] [DEBUG] [LOCAL ] CBZ: Loaded 33903 existing records from primary storage. [2025-10-06T22:36:14.523479] [INFO ] [MAIN ] CBZ: Loaded 33903 primary data records. [2025-10-06T22:36:14.543874] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-10-06T22:36:14.566150] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-06T22:36:14.600306] [INFO ] [MAIN ] Derivative Progress: 343/2037 symbols completed. CBU took 1.1s. Estimated remaining: 11m 7s. Rate: 152.4 symbols/min [2025-10-06T22:36:14.866063] [DEBUG] [LOCAL ] CC: Loaded 52991 existing records from primary storage. [2025-10-06T22:36:14.866385] [INFO ] [MAIN ] CC: Loaded 52991 primary data records. [2025-10-06T22:36:15.263466] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:15.264922] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 33903 primary records. [2025-10-06T22:36:15.265031] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-06T22:36:15.283218] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-10-06T22:36:15.283432] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-06T22:36:15.285996] [INFO ] [MAIN ] Derivative Progress: 344/2037 symbols completed. CBZ took 0.9s. Estimated remaining: 11m 8s. Rate: 152.0 symbols/min [2025-10-06T22:36:15.310415] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:15.311359] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 52991 primary records. [2025-10-06T22:36:15.311441] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-06T22:36:15.335350] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-10-06T22:36:15.335440] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-06T22:36:15.338403] [INFO ] [MAIN ] Derivative Progress: 345/2037 symbols completed. CC took 0.9s. Estimated remaining: 11m 6s. Rate: 152.4 symbols/min [2025-10-06T22:36:15.339632] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:15.339434] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:15.339563] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:15.362219] [DEBUG] [LOCAL ] CCIF: Loaded 15589 existing records from primary storage. [2025-10-06T22:36:15.362381] [INFO ] [MAIN ] CCIF: Loaded 15589 primary data records. [2025-10-06T22:36:15.621843] [DEBUG] [LOCAL ] CCJ: Loaded 53677 existing records from primary storage. [2025-10-06T22:36:15.739583] [INFO ] [MAIN ] CCJ: Loaded 53677 primary data records. [2025-10-06T22:36:15.741125] [DEBUG] [LOCAL ] CCI: Loaded 53139 existing records from primary storage. [2025-10-06T22:36:15.746913] [INFO ] [MAIN ] CCI: Loaded 53139 primary data records. [2025-10-06T22:36:16.492013] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:16.493242] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15589 primary records. [2025-10-06T22:36:16.493925] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-06T22:36:16.513468] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-10-06T22:36:16.514129] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-06T22:36:16.516953] [INFO ] [MAIN ] Derivative Progress: 346/2037 symbols completed. CCIF took 1.2s. Estimated remaining: 11m 10s. Rate: 151.5 symbols/min [2025-10-06T22:36:16.517504] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:16.537942] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:16.551127] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53677 primary records. [2025-10-06T22:36:16.551332] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:16.552035] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53139 primary records. [2025-10-06T22:36:16.552160] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-06T22:36:16.552118] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-06T22:36:16.582337] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-10-06T22:36:16.583394] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-06T22:36:16.585726] [INFO ] [MAIN ] Derivative Progress: 347/2037 symbols completed. CCJ took 1.2s. Estimated remaining: 11m 8s. Rate: 151.9 symbols/min [2025-10-06T22:36:16.587018] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:16.586902] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-10-06T22:36:16.587606] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-06T22:36:16.590613] [INFO ] [MAIN ] Derivative Progress: 348/2037 symbols completed. CCI took 1.3s. Estimated remaining: 11m 5s. Rate: 152.3 symbols/min [2025-10-06T22:36:16.590955] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:16.627031] [DEBUG] [LOCAL ] CCK: Loaded 46259 existing records from primary storage. [2025-10-06T22:36:16.627207] [INFO ] [MAIN ] CCK: Loaded 46259 primary data records. [2025-10-06T22:36:16.988384] [DEBUG] [LOCAL ] CCO: Loaded 47991 existing records from primary storage. [2025-10-06T22:36:16.997175] [INFO ] [MAIN ] CCO: Loaded 47991 primary data records. [2025-10-06T22:36:17.057106] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-06T22:36:17.075173] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-06T22:36:17.683757] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:17.685398] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46259 primary records. [2025-10-06T22:36:17.685773] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-06T22:36:17.705906] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-10-06T22:36:17.706239] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-06T22:36:17.711867] [INFO ] [MAIN ] Derivative Progress: 349/2037 symbols completed. CCK took 1.2s. Estimated remaining: 11m 8s. Rate: 151.5 symbols/min [2025-10-06T22:36:17.712207] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:17.729619] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:17.730942] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 47991 primary records. [2025-10-06T22:36:17.731254] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-06T22:36:17.761632] [DEBUG] [LOCAL ] CCRD: Loaded 9159 existing records from primary storage. [2025-10-06T22:36:17.768615] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:17.768720] [INFO ] [MAIN ] CCRD: Loaded 9159 primary data records. [2025-10-06T22:36:17.769785] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-10-06T22:36:17.775589] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-06T22:36:17.844101] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-10-06T22:36:17.867151] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-06T22:36:17.875934] [INFO ] [MAIN ] Derivative Progress: 350/2037 symbols completed. CCO took 1.3s. Estimated remaining: 11m 7s. Rate: 151.8 symbols/min [2025-10-06T22:36:17.891309] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:17.925235] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-10-06T22:36:17.925411] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-06T22:36:17.928595] [INFO ] [MAIN ] Derivative Progress: 351/2037 symbols completed. CCL took 1.3s. Estimated remaining: 11m 5s. Rate: 152.2 symbols/min [2025-10-06T22:36:17.946337] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:18.167260] [DEBUG] [LOCAL ] CDLR: Loaded 9885 existing records from primary storage. [2025-10-06T22:36:18.167428] [INFO ] [MAIN ] CDLR: Loaded 9885 primary data records. [2025-10-06T22:36:18.382856] [DEBUG] [LOCAL ] CDE: Loaded 53642 existing records from primary storage. [2025-10-06T22:36:18.391553] [INFO ] [MAIN ] CDE: Loaded 53642 primary data records. [2025-10-06T22:36:18.914872] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:18.916237] [INFO ] [MAIN ] CCRD: Generated 1794 derivative records from 9159 primary records. [2025-10-06T22:36:18.916390] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-06T22:36:18.952635] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:18.954696] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 9885 primary records. [2025-10-06T22:36:18.953586] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1794 records). [2025-10-06T22:36:18.954984] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-06T22:36:18.955094] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-06T22:36:18.957370] [INFO ] [MAIN ] Derivative Progress: 352/2037 symbols completed. CCRD took 1.2s. Estimated remaining: 11m 7s. Rate: 151.5 symbols/min [2025-10-06T22:36:18.958729] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:18.994205] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:18.995462] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53642 primary records. [2025-10-06T22:36:18.996185] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-10-06T22:36:18.996286] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-06T22:36:18.995820] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-06T22:36:18.998912] [INFO ] [MAIN ] Derivative Progress: 353/2037 symbols completed. CDLR took 1.1s. Estimated remaining: 11m 5s. Rate: 151.9 symbols/min [2025-10-06T22:36:19.001080] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:19.019534] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-10-06T22:36:19.019813] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-06T22:36:19.023404] [INFO ] [MAIN ] Derivative Progress: 354/2037 symbols completed. CDE took 1.1s. Estimated remaining: 11m 3s. Rate: 152.3 symbols/min [2025-10-06T22:36:19.023750] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:19.052191] [DEBUG] [LOCAL ] CDRE: Loaded 24654 existing records from primary storage. [2025-10-06T22:36:19.052348] [INFO ] [MAIN ] CDRE: Loaded 24654 primary data records. [2025-10-06T22:36:19.191065] [DEBUG] [LOCAL ] CDP: Loaded 42655 existing records from primary storage. [2025-10-06T22:36:19.217837] [INFO ] [MAIN ] CDP: Loaded 42655 primary data records. [2025-10-06T22:36:19.600475] [DEBUG] [LOCAL ] CE: Loaded 51474 existing records from primary storage. [2025-10-06T22:36:19.733828] [INFO ] [MAIN ] CE: Loaded 51474 primary data records. [2025-10-06T22:36:20.074815] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:20.077277] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 24654 primary records. [2025-10-06T22:36:20.077923] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-06T22:36:20.107463] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:20.109964] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42655 primary records. [2025-10-06T22:36:20.111741] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-06T22:36:20.124221] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-10-06T22:36:20.127638] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-06T22:36:20.130263] [INFO ] [MAIN ] Derivative Progress: 355/2037 symbols completed. CDRE took 1.1s. Estimated remaining: 11m 6s. Rate: 151.5 symbols/min [2025-10-06T22:36:20.134001] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-10-06T22:36:20.134567] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:20.134166] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-06T22:36:20.138265] [INFO ] [MAIN ] Derivative Progress: 356/2037 symbols completed. CDP took 1.2s. Estimated remaining: 11m 4s. Rate: 151.9 symbols/min [2025-10-06T22:36:20.138996] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:20.150740] [DEBUG] [LOCAL ] CEE: Loaded 5673 existing records from primary storage. [2025-10-06T22:36:20.150918] [INFO ] [MAIN ] CEE: Loaded 5673 primary data records. [2025-10-06T22:36:20.239482] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:20.263731] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51474 primary records. [2025-10-06T22:36:20.274799] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-06T22:36:20.383925] [DEBUG] [LOCAL ] CEPU: Loaded 26006 existing records from primary storage. [2025-10-06T22:36:20.550703] [INFO ] [MAIN ] CEPU: Loaded 26006 primary data records. [2025-10-06T22:36:20.566135] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-10-06T22:36:20.576418] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-06T22:36:20.580599] [INFO ] [MAIN ] Derivative Progress: 357/2037 symbols completed. CE took 1.6s. Estimated remaining: 11m 4s. Rate: 151.9 symbols/min [2025-10-06T22:36:20.603369] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:20.897527] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:20.898936] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 5673 primary records. [2025-10-06T22:36:20.901963] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-06T22:36:20.932444] [DEBUG] [LOCAL ] CF: Loaded 52167 existing records from primary storage. [2025-10-06T22:36:20.936733] [INFO ] [MAIN ] CF: Loaded 52167 primary data records. [2025-10-06T22:36:20.937560] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-10-06T22:36:20.958731] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-06T22:36:20.983272] [INFO ] [MAIN ] Derivative Progress: 358/2037 symbols completed. CEE took 0.8s. Estimated remaining: 11m 3s. Rate: 151.8 symbols/min [2025-10-06T22:36:21.109298] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:21.118472] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 26006 primary records. [2025-10-06T22:36:21.118609] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-06T22:36:21.277677] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-10-06T22:36:21.278289] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-06T22:36:21.282262] [INFO ] [MAIN ] Derivative Progress: 359/2037 symbols completed. CEPU took 1.1s. Estimated remaining: 11m 3s. Rate: 151.9 symbols/min [2025-10-06T22:36:21.302590] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:21.303307] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52167 primary records. [2025-10-06T22:36:21.303370] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-06T22:36:21.319390] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-10-06T22:36:21.319468] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-06T22:36:21.321973] [INFO ] [MAIN ] Derivative Progress: 360/2037 symbols completed. CF took 0.7s. Estimated remaining: 11m 1s. Rate: 152.3 symbols/min [2025-10-06T22:36:21.322898] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:21.323534] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:21.322821] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:21.328144] [DEBUG] [LOCAL ] CGV: Loaded 1391 existing records from primary storage. [2025-10-06T22:36:21.328446] [INFO ] [MAIN ] CGV: Loaded 1391 primary data records. [2025-10-06T22:36:21.690894] [DEBUG] [LOCAL ] CGAU: Loaded 42926 existing records from primary storage. [2025-10-06T22:36:21.691966] [INFO ] [MAIN ] CGAU: Loaded 42926 primary data records. [2025-10-06T22:36:21.813327] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-10-06T22:36:21.815801] [INFO ] [MAIN ] CFG: Loaded 53624 primary data records. [2025-10-06T22:36:22.455062] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:22.472981] [INFO ] [MAIN ] CGV: Generated 1794 derivative records from 1391 primary records. [2025-10-06T22:36:22.488477] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-06T22:36:22.510599] [DEBUG] [LOCAL ] CGV: Derivative data saved (1794 records). [2025-10-06T22:36:22.512531] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-06T22:36:22.516632] [INFO ] [MAIN ] Derivative Progress: 361/2037 symbols completed. CGV took 1.2s. Estimated remaining: 11m 4s. Rate: 151.5 symbols/min [2025-10-06T22:36:22.517639] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:22.531988] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:22.532944] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 42926 primary records. [2025-10-06T22:36:22.533064] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-06T22:36:22.561897] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-10-06T22:36:22.562071] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-06T22:36:22.566535] [INFO ] [MAIN ] Derivative Progress: 362/2037 symbols completed. CGAU took 1.2s. Estimated remaining: 11m 2s. Rate: 151.8 symbols/min [2025-10-06T22:36:22.566814] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:22.591024] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:22.592587] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53624 primary records. [2025-10-06T22:36:22.592732] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-06T22:36:22.591614] [DEBUG] [LOCAL ] CHCT: Loaded 23818 existing records from primary storage. [2025-10-06T22:36:22.593156] [INFO ] [MAIN ] CHCT: Loaded 23818 primary data records. [2025-10-06T22:36:22.737925] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-10-06T22:36:22.798740] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-06T22:36:22.816686] [INFO ] [MAIN ] Derivative Progress: 363/2037 symbols completed. CFG took 1.5s. Estimated remaining: 11m 1s. Rate: 152.0 symbols/min [2025-10-06T22:36:22.841981] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:23.000375] [DEBUG] [LOCAL ] CHD: Loaded 52192 existing records from primary storage. [2025-10-06T22:36:23.001388] [INFO ] [MAIN ] CHD: Loaded 52192 primary data records. [2025-10-06T22:36:23.116847] [DEBUG] [LOCAL ] CHE: Loaded 15216 existing records from primary storage. [2025-10-06T22:36:23.117874] [INFO ] [MAIN ] CHE: Loaded 15216 primary data records. [2025-10-06T22:36:23.669376] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:23.672772] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 23818 primary records. [2025-10-06T22:36:23.673395] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-06T22:36:23.693331] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-10-06T22:36:23.693582] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-06T22:36:23.696407] [INFO ] [MAIN ] Derivative Progress: 364/2037 symbols completed. CHCT took 1.2s. Estimated remaining: 11m 3s. Rate: 151.5 symbols/min [2025-10-06T22:36:23.696887] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:23.714046] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:23.714860] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52192 primary records. [2025-10-06T22:36:23.715056] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-06T22:36:23.733885] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-10-06T22:36:23.742286] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-06T22:36:23.750841] [INFO ] [MAIN ] Derivative Progress: 365/2037 symbols completed. CHD took 1.2s. Estimated remaining: 11m 1s. Rate: 151.8 symbols/min [2025-10-06T22:36:23.751080] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:23.751912] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:23.752622] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 15216 primary records. [2025-10-06T22:36:23.753113] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-06T22:36:23.781539] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-10-06T22:36:23.781791] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-06T22:36:23.784976] [INFO ] [MAIN ] Derivative Progress: 366/2037 symbols completed. CHE took 0.9s. Estimated remaining: 10m 59s. Rate: 152.2 symbols/min [2025-10-06T22:36:23.785274] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:23.807807] [DEBUG] [LOCAL ] CHGG: Loaded 47811 existing records from primary storage. [2025-10-06T22:36:23.808369] [INFO ] [MAIN ] CHGG: Loaded 47811 primary data records. [2025-10-06T22:36:23.829418] [DEBUG] [LOCAL ] CHN: Loaded 4779 existing records from primary storage. [2025-10-06T22:36:23.869276] [INFO ] [MAIN ] CHN: Loaded 4779 primary data records. [2025-10-06T22:36:23.864009] [DEBUG] [LOCAL ] CHMI: Loaded 21649 existing records from primary storage. [2025-10-06T22:36:23.922207] [INFO ] [MAIN ] CHMI: Loaded 21649 primary data records. [2025-10-06T22:36:24.841290] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:24.854532] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:24.855244] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4779 primary records. [2025-10-06T22:36:24.855464] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-06T22:36:24.856219] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47811 primary records. [2025-10-06T22:36:24.856339] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-06T22:36:24.882532] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-10-06T22:36:24.883631] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-06T22:36:24.889107] [INFO ] [MAIN ] Derivative Progress: 367/2037 symbols completed. CHN took 1.1s. Estimated remaining: 11m 1s. Rate: 151.5 symbols/min [2025-10-06T22:36:24.889283] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:24.907731] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:24.909192] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 21649 primary records. [2025-10-06T22:36:24.909525] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-06T22:36:24.910382] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-10-06T22:36:24.910465] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-06T22:36:24.912558] [INFO ] [MAIN ] Derivative Progress: 368/2037 symbols completed. CHGG took 1.2s. Estimated remaining: 10m 59s. Rate: 151.9 symbols/min [2025-10-06T22:36:24.923906] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:24.929743] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-10-06T22:36:24.929848] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-06T22:36:24.932912] [INFO ] [MAIN ] Derivative Progress: 369/2037 symbols completed. CHMI took 1.2s. Estimated remaining: 10m 57s. Rate: 152.3 symbols/min [2025-10-06T22:36:24.933068] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:24.960284] [DEBUG] [LOCAL ] CHT: Loaded 19553 existing records from primary storage. [2025-10-06T22:36:24.960424] [INFO ] [MAIN ] CHT: Loaded 19553 primary data records. [2025-10-06T22:36:25.087323] [DEBUG] [LOCAL ] CHPT: Loaded 48378 existing records from primary storage. [2025-10-06T22:36:25.098800] [INFO ] [MAIN ] CHPT: Loaded 48378 primary data records. [2025-10-06T22:36:25.454584] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-06T22:36:25.501381] [INFO ] [MAIN ] CHWY: Loaded 53654 primary data records. [2025-10-06T22:36:25.973511] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:25.974468] [INFO ] [MAIN ] CHT: Generated 1794 derivative records from 19553 primary records. [2025-10-06T22:36:25.974569] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-06T22:36:26.001279] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:26.002387] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 48378 primary records. [2025-10-06T22:36:26.002590] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-06T22:36:26.020719] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-10-06T22:36:26.020944] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-06T22:36:26.024572] [INFO ] [MAIN ] Derivative Progress: 370/2037 symbols completed. CHPT took 1.1s. Estimated remaining: 11m 0s. Rate: 151.5 symbols/min [2025-10-06T22:36:26.025037] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:26.026751] [DEBUG] [LOCAL ] CHT: Derivative data saved (1794 records). [2025-10-06T22:36:26.027402] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-06T22:36:26.029889] [INFO ] [MAIN ] Derivative Progress: 371/2037 symbols completed. CHT took 1.1s. Estimated remaining: 10m 58s. Rate: 151.9 symbols/min [2025-10-06T22:36:26.030130] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:26.047005] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:26.047847] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53654 primary records. [2025-10-06T22:36:26.047911] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-06T22:36:26.074788] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-10-06T22:36:26.081498] [DEBUG] [LOCAL ] CIA: Loaded 16872 existing records from primary storage. [2025-10-06T22:36:26.081635] [INFO ] [MAIN ] CIA: Loaded 16872 primary data records. [2025-10-06T22:36:26.081910] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-06T22:36:26.085667] [INFO ] [MAIN ] Derivative Progress: 372/2037 symbols completed. CHWY took 1.2s. Estimated remaining: 10m 56s. Rate: 152.3 symbols/min [2025-10-06T22:36:26.117770] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:26.241895] [DEBUG] [LOCAL ] CI: Loaded 49801 existing records from primary storage. [2025-10-06T22:36:26.250510] [INFO ] [MAIN ] CI: Loaded 49801 primary data records. [2025-10-06T22:36:26.538544] [DEBUG] [LOCAL ] CIB: Loaded 30791 existing records from primary storage. [2025-10-06T22:36:26.542497] [INFO ] [MAIN ] CIB: Loaded 30791 primary data records. [2025-10-06T22:36:27.117206] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:27.118137] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 16872 primary records. [2025-10-06T22:36:27.118243] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-06T22:36:27.150129] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:27.152506] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49801 primary records. [2025-10-06T22:36:27.156773] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-10-06T22:36:27.155900] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-06T22:36:27.157082] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-06T22:36:27.160620] [INFO ] [MAIN ] Derivative Progress: 373/2037 symbols completed. CIA took 1.1s. Estimated remaining: 10m 59s. Rate: 151.6 symbols/min [2025-10-06T22:36:27.181294] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-10-06T22:36:27.193950] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-06T22:36:27.193877] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:27.196860] [INFO ] [MAIN ] Derivative Progress: 374/2037 symbols completed. CI took 1.2s. Estimated remaining: 10m 57s. Rate: 152.0 symbols/min [2025-10-06T22:36:27.197831] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 30791 primary records. [2025-10-06T22:36:27.197895] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-06T22:36:27.213437] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-10-06T22:36:27.213501] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-06T22:36:27.216542] [INFO ] [MAIN ] Derivative Progress: 375/2037 symbols completed. CIB took 1.1s. Estimated remaining: 10m 55s. Rate: 152.3 symbols/min [2025-10-06T22:36:27.217062] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:27.217015] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:27.217115] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:27.225408] [DEBUG] [LOCAL ] CIF: Loaded 4156 existing records from primary storage. [2025-10-06T22:36:27.225874] [INFO ] [MAIN ] CIF: Loaded 4156 primary data records. [2025-10-06T22:36:27.364580] [DEBUG] [LOCAL ] CII: Loaded 15166 existing records from primary storage. [2025-10-06T22:36:27.365306] [INFO ] [MAIN ] CII: Loaded 15166 primary data records. [2025-10-06T22:36:27.557476] [DEBUG] [LOCAL ] CIG: Loaded 43776 existing records from primary storage. [2025-10-06T22:36:27.563161] [INFO ] [MAIN ] CIG: Loaded 43776 primary data records. [2025-10-06T22:36:28.220692] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:28.221790] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4156 primary records. [2025-10-06T22:36:28.222166] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-06T22:36:28.241845] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-10-06T22:36:28.242233] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-06T22:36:28.256816] [INFO ] [MAIN ] Derivative Progress: 376/2037 symbols completed. CIF took 1.0s. Estimated remaining: 10m 57s. Rate: 151.7 symbols/min [2025-10-06T22:36:28.257411] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:28.258549] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:28.260058] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15166 primary records. [2025-10-06T22:36:28.260948] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-06T22:36:28.282761] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:28.284628] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 43776 primary records. [2025-10-06T22:36:28.284832] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-06T22:36:28.308809] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-10-06T22:36:28.309348] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-06T22:36:28.313025] [INFO ] [MAIN ] Derivative Progress: 377/2037 symbols completed. CII took 1.1s. Estimated remaining: 10m 55s. Rate: 152.0 symbols/min [2025-10-06T22:36:28.313977] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:28.326748] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-10-06T22:36:28.326972] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-06T22:36:28.330258] [INFO ] [MAIN ] Derivative Progress: 378/2037 symbols completed. CIG took 1.1s. Estimated remaining: 10m 53s. Rate: 152.4 symbols/min [2025-10-06T22:36:28.330548] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:28.333231] [DEBUG] [LOCAL ] CIMN: Loaded 2736 existing records from primary storage. [2025-10-06T22:36:28.333345] [INFO ] [MAIN ] CIMN: Loaded 2736 primary data records. [2025-10-06T22:36:28.468482] [DEBUG] [LOCAL ] CIM: Loaded 37664 existing records from primary storage. [2025-10-06T22:36:28.495998] [INFO ] [MAIN ] CIM: Loaded 37664 primary data records. [2025-10-06T22:36:28.547488] [DEBUG] [LOCAL ] CIO: Loaded 20433 existing records from primary storage. [2025-10-06T22:36:28.721404] [INFO ] [MAIN ] CIO: Loaded 20433 primary data records. [2025-10-06T22:36:29.319556] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:36:29.320501] [INFO ] [MAIN ] CIMN: Generated 1793 derivative records from 2736 primary records. [2025-10-06T22:36:29.320910] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-06T22:36:29.338523] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1793 records). [2025-10-06T22:36:29.338831] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-06T22:36:29.341231] [INFO ] [MAIN ] Derivative Progress: 379/2037 symbols completed. CIMN took 1.0s. Estimated remaining: 10m 55s. Rate: 151.8 symbols/min [2025-10-06T22:36:29.350007] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:29.356898] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:29.357683] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37664 primary records. [2025-10-06T22:36:29.357799] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-06T22:36:29.370770] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:29.371765] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 20433 primary records. [2025-10-06T22:36:29.372002] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-06T22:36:29.403177] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-10-06T22:36:29.403036] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-10-06T22:36:29.403310] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-06T22:36:29.403386] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-06T22:36:29.406144] [INFO ] [MAIN ] Derivative Progress: 380/2037 symbols completed. CIM took 1.1s. Estimated remaining: 10m 54s. Rate: 152.1 symbols/min [2025-10-06T22:36:29.409850] [INFO ] [MAIN ] Derivative Progress: 381/2037 symbols completed. CIO took 1.1s. Estimated remaining: 10m 51s. Rate: 152.5 symbols/min [2025-10-06T22:36:29.409998] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:29.409804] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:29.432484] [DEBUG] [LOCAL ] CION: Loaded 28474 existing records from primary storage. [2025-10-06T22:36:29.432618] [INFO ] [MAIN ] CION: Loaded 28474 primary data records. [2025-10-06T22:36:29.774272] [DEBUG] [LOCAL ] CL: Loaded 53648 existing records from primary storage. [2025-10-06T22:36:29.789084] [INFO ] [MAIN ] CL: Loaded 53648 primary data records. [2025-10-06T22:36:29.822309] [DEBUG] [LOCAL ] CIVI: Loaded 52609 existing records from primary storage. [2025-10-06T22:36:29.834960] [INFO ] [MAIN ] CIVI: Loaded 52609 primary data records. [2025-10-06T22:36:30.409063] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:30.410257] [INFO ] [MAIN ] CION: Generated 1794 derivative records from 28474 primary records. [2025-10-06T22:36:30.410743] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-06T22:36:30.431237] [DEBUG] [LOCAL ] CION: Derivative data saved (1794 records). [2025-10-06T22:36:30.431507] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-10-06T22:36:30.435057] [INFO ] [MAIN ] Derivative Progress: 382/2037 symbols completed. CION took 1.1s. Estimated remaining: 10m 54s. Rate: 151.9 symbols/min [2025-10-06T22:36:30.435636] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:30.453230] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:30.454006] [INFO ] [MAIN ] CL: Generated 1794 derivative records from 53648 primary records. [2025-10-06T22:36:30.454201] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-06T22:36:30.486571] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-10-06T22:36:30.486722] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-06T22:36:30.489777] [INFO ] [MAIN ] Derivative Progress: 383/2037 symbols completed. CL took 1.1s. Estimated remaining: 10m 52s. Rate: 152.2 symbols/min [2025-10-06T22:36:30.490425] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:30.491389] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:30.492113] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52609 primary records. [2025-10-06T22:36:30.492178] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-06T22:36:30.517321] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-10-06T22:36:30.520339] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-06T22:36:30.523468] [INFO ] [MAIN ] Derivative Progress: 384/2037 symbols completed. CIVI took 1.1s. Estimated remaining: 10m 50s. Rate: 152.6 symbols/min [2025-10-06T22:36:30.524238] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:30.539821] [DEBUG] [LOCAL ] CLB: Loaded 33026 existing records from primary storage. [2025-10-06T22:36:30.540173] [DEBUG] [LOCAL ] CLCO: Loaded 12635 existing records from primary storage. [2025-10-06T22:36:30.540320] [INFO ] [MAIN ] CLCO: Loaded 12635 primary data records. [2025-10-06T22:36:30.540406] [INFO ] [MAIN ] CLB: Loaded 33026 primary data records. [2025-10-06T22:36:30.793828] [DEBUG] [LOCAL ] CLDT: Loaded 25327 existing records from primary storage. [2025-10-06T22:36:30.804438] [INFO ] [MAIN ] CLDT: Loaded 25327 primary data records. [2025-10-06T22:36:31.524862] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:31.533802] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33026 primary records. [2025-10-06T22:36:31.538880] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-06T22:36:31.539960] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:31.542146] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 12635 primary records. [2025-10-06T22:36:31.554336] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-06T22:36:31.559862] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-10-06T22:36:31.566622] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-06T22:36:31.568859] [INFO ] [MAIN ] Derivative Progress: 385/2037 symbols completed. CLB took 1.1s. Estimated remaining: 10m 52s. Rate: 151.9 symbols/min [2025-10-06T22:36:31.573452] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:31.585332] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-10-06T22:36:31.590857] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:31.592044] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 25327 primary records. [2025-10-06T22:36:31.592146] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-06T22:36:31.592258] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-06T22:36:31.595840] [INFO ] [MAIN ] Derivative Progress: 386/2037 symbols completed. CLCO took 1.1s. Estimated remaining: 10m 50s. Rate: 152.3 symbols/min [2025-10-06T22:36:31.596379] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:31.612627] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-10-06T22:36:31.612774] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-06T22:36:31.616272] [INFO ] [MAIN ] Derivative Progress: 387/2037 symbols completed. CLDT took 1.1s. Estimated remaining: 10m 48s. Rate: 152.7 symbols/min [2025-10-06T22:36:31.616712] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:31.637593] [DEBUG] [LOCAL ] CLPR: Loaded 10866 existing records from primary storage. [2025-10-06T22:36:31.637762] [INFO ] [MAIN ] CLPR: Loaded 10866 primary data records. [2025-10-06T22:36:31.751320] [DEBUG] [LOCAL ] CLH: Loaded 27690 existing records from primary storage. [2025-10-06T22:36:31.762941] [INFO ] [MAIN ] CLH: Loaded 27690 primary data records. [2025-10-06T22:36:32.033250] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-06T22:36:32.052307] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-10-06T22:36:32.670542] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:32.671861] [INFO ] [MAIN ] CLPR: Generated 1794 derivative records from 10866 primary records. [2025-10-06T22:36:32.672077] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-06T22:36:32.690029] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1794 records). [2025-10-06T22:36:32.691477] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-10-06T22:36:32.694122] [INFO ] [MAIN ] Derivative Progress: 388/2037 symbols completed. CLPR took 1.1s. Estimated remaining: 10m 51s. Rate: 152.0 symbols/min [2025-10-06T22:36:32.707853] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:32.708729] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 27690 primary records. [2025-10-06T22:36:32.708882] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-06T22:36:32.726831] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-10-06T22:36:32.739255] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:32.739421] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-06T22:36:32.740095] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-10-06T22:36:32.742568] [INFO ] [MAIN ] Derivative Progress: 389/2037 symbols completed. CLH took 1.1s. Estimated remaining: 10m 49s. Rate: 152.3 symbols/min [2025-10-06T22:36:32.742725] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-06T22:36:32.757988] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-10-06T22:36:32.758046] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-06T22:36:32.761999] [INFO ] [MAIN ] Derivative Progress: 390/2037 symbols completed. CLF took 1.2s. Estimated remaining: 10m 47s. Rate: 152.7 symbols/min [2025-10-06T22:36:32.762419] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:32.762495] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:32.762353] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:32.789488] [DEBUG] [LOCAL ] CLW: Loaded 21690 existing records from primary storage. [2025-10-06T22:36:32.789801] [INFO ] [MAIN ] CLW: Loaded 21690 primary data records. [2025-10-06T22:36:32.987202] [DEBUG] [LOCAL ] CLVT: Loaded 51951 existing records from primary storage. [2025-10-06T22:36:32.993996] [INFO ] [MAIN ] CLVT: Loaded 51951 primary data records. [2025-10-06T22:36:33.216155] [DEBUG] [LOCAL ] CLS: Loaded 53612 existing records from primary storage. [2025-10-06T22:36:33.225162] [INFO ] [MAIN ] CLS: Loaded 53612 primary data records. [2025-10-06T22:36:33.799743] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:33.801785] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21690 primary records. [2025-10-06T22:36:33.802102] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-06T22:36:33.823045] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-10-06T22:36:33.823977] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-06T22:36:33.829700] [INFO ] [MAIN ] Derivative Progress: 391/2037 symbols completed. CLW took 1.1s. Estimated remaining: 10m 50s. Rate: 152.0 symbols/min [2025-10-06T22:36:33.830823] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:33.847143] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:33.848788] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 51951 primary records. [2025-10-06T22:36:33.849129] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-06T22:36:33.882976] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:33.885569] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-10-06T22:36:33.884675] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53612 primary records. [2025-10-06T22:36:33.885784] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-06T22:36:33.889046] [INFO ] [MAIN ] Derivative Progress: 392/2037 symbols completed. CLVT took 1.1s. Estimated remaining: 10m 48s. Rate: 152.4 symbols/min [2025-10-06T22:36:33.889173] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-06T22:36:33.890291] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:33.927004] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-10-06T22:36:33.927264] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-06T22:36:33.930541] [INFO ] [MAIN ] Derivative Progress: 393/2037 symbols completed. CLS took 1.2s. Estimated remaining: 10m 46s. Rate: 152.7 symbols/min [2025-10-06T22:36:33.931009] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:33.966258] [DEBUG] [LOCAL ] CLX: Loaded 51548 existing records from primary storage. [2025-10-06T22:36:33.966605] [INFO ] [MAIN ] CLX: Loaded 51548 primary data records. [2025-10-06T22:36:34.113231] [DEBUG] [LOCAL ] CM: Loaded 48664 existing records from primary storage. [2025-10-06T22:36:34.113853] [INFO ] [MAIN ] CM: Loaded 48664 primary data records. [2025-10-06T22:36:34.435433] [DEBUG] [LOCAL ] CMA: Loaded 49881 existing records from primary storage. [2025-10-06T22:36:34.447099] [INFO ] [MAIN ] CMA: Loaded 49881 primary data records. [2025-10-06T22:36:35.089598] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:35.091222] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51548 primary records. [2025-10-06T22:36:35.091715] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-06T22:36:35.111438] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-10-06T22:36:35.112940] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-06T22:36:35.118481] [INFO ] [MAIN ] Derivative Progress: 394/2037 symbols completed. CLX took 1.3s. Estimated remaining: 10m 49s. Rate: 151.9 symbols/min [2025-10-06T22:36:35.119533] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:35.148845] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:35.147898] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:35.151841] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 49881 primary records. [2025-10-06T22:36:35.150721] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48664 primary records. [2025-10-06T22:36:35.152161] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-06T22:36:35.152085] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-06T22:36:35.190185] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-10-06T22:36:35.191175] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-06T22:36:35.194311] [INFO ] [MAIN ] Derivative Progress: 395/2037 symbols completed. CM took 1.3s. Estimated remaining: 10m 47s. Rate: 152.2 symbols/min [2025-10-06T22:36:35.195406] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:35.206072] [DEBUG] [LOCAL ] CMBT: Loaded 24195 existing records from primary storage. [2025-10-06T22:36:35.206497] [INFO ] [MAIN ] CMBT: Loaded 24195 primary data records. [2025-10-06T22:36:35.206941] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-10-06T22:36:35.207050] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-06T22:36:35.211996] [INFO ] [MAIN ] Derivative Progress: 396/2037 symbols completed. CMA took 1.3s. Estimated remaining: 10m 45s. Rate: 152.6 symbols/min [2025-10-06T22:36:35.212315] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:35.303993] [DEBUG] [LOCAL ] CMCM: Loaded 4714 existing records from primary storage. [2025-10-06T22:36:35.325879] [INFO ] [MAIN ] CMCM: Loaded 4714 primary data records. [2025-10-06T22:36:35.562256] [DEBUG] [LOCAL ] CMC: Loaded 45453 existing records from primary storage. [2025-10-06T22:36:35.677053] [INFO ] [MAIN ] CMC: Loaded 45453 primary data records. [2025-10-06T22:36:36.262087] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:36.264288] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 24195 primary records. [2025-10-06T22:36:36.265582] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-06T22:36:36.298139] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:36.302189] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4714 primary records. [2025-10-06T22:36:36.302531] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-06T22:36:36.304764] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-10-06T22:36:36.304873] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-06T22:36:36.308487] [INFO ] [MAIN ] Derivative Progress: 397/2037 symbols completed. CMBT took 1.2s. Estimated remaining: 10m 48s. Rate: 151.9 symbols/min [2025-10-06T22:36:36.316606] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:36.323704] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-10-06T22:36:36.324101] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-06T22:36:36.329441] [INFO ] [MAIN ] Derivative Progress: 398/2037 symbols completed. CMCM took 1.1s. Estimated remaining: 10m 46s. Rate: 152.3 symbols/min [2025-10-06T22:36:36.331072] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:36.347175] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:36.348363] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45453 primary records. [2025-10-06T22:36:36.348476] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-06T22:36:36.367299] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-10-06T22:36:36.367443] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-06T22:36:36.370920] [INFO ] [MAIN ] Derivative Progress: 399/2037 symbols completed. CMC took 1.2s. Estimated remaining: 10m 44s. Rate: 152.6 symbols/min [2025-10-06T22:36:36.371462] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:36.443445] [DEBUG] [LOCAL ] CMI: Loaded 41714 existing records from primary storage. [2025-10-06T22:36:36.464726] [INFO ] [MAIN ] CMI: Loaded 41714 primary data records. [2025-10-06T22:36:36.466277] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-06T22:36:36.479823] [INFO ] [MAIN ] CMG: Loaded 53721 primary data records. [2025-10-06T22:36:36.555104] [DEBUG] [LOCAL ] CMP: Loaded 36092 existing records from primary storage. [2025-10-06T22:36:36.601070] [INFO ] [MAIN ] CMP: Loaded 36092 primary data records. [2025-10-06T22:36:37.568145] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:37.570103] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41714 primary records. [2025-10-06T22:36:37.569049] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:37.571406] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53721 primary records. [2025-10-06T22:36:37.571754] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-06T22:36:37.571847] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-06T22:36:37.605065] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-10-06T22:36:37.625491] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:37.625739] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-06T22:36:37.625578] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-10-06T22:36:37.630389] [INFO ] [MAIN ] Derivative Progress: 400/2037 symbols completed. CMG took 1.3s. Estimated remaining: 10m 47s. Rate: 151.8 symbols/min [2025-10-06T22:36:37.631422] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 36092 primary records. [2025-10-06T22:36:37.631507] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-06T22:36:37.631948] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:37.631834] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-06T22:36:37.635691] [INFO ] [MAIN ] Derivative Progress: 401/2037 symbols completed. CMI took 1.3s. Estimated remaining: 10m 45s. Rate: 152.2 symbols/min [2025-10-06T22:36:37.636862] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:37.658707] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-10-06T22:36:37.659024] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-06T22:36:37.664508] [INFO ] [MAIN ] Derivative Progress: 402/2037 symbols completed. CMP took 1.3s. Estimated remaining: 10m 43s. Rate: 152.5 symbols/min [2025-10-06T22:36:37.665083] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:37.711668] [DEBUG] [LOCAL ] CMRE: Loaded 35445 existing records from primary storage. [2025-10-06T22:36:37.712133] [INFO ] [MAIN ] CMRE: Loaded 35445 primary data records. [2025-10-06T22:36:37.811177] [DEBUG] [LOCAL ] CMPO: Loaded 39064 existing records from primary storage. [2025-10-06T22:36:37.836011] [INFO ] [MAIN ] CMPO: Loaded 39064 primary data records. [2025-10-06T22:36:38.185688] [DEBUG] [LOCAL ] CMS: Loaded 52610 existing records from primary storage. [2025-10-06T22:36:38.201823] [INFO ] [MAIN ] CMS: Loaded 52610 primary data records. [2025-10-06T22:36:38.739123] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:38.738856] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:38.740567] [INFO ] [MAIN ] CMPO: Generated 1794 derivative records from 39064 primary records. [2025-10-06T22:36:38.740708] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-06T22:36:38.739946] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35445 primary records. [2025-10-06T22:36:38.740937] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-06T22:36:38.785741] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-10-06T22:36:38.786093] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-06T22:36:38.786430] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:38.789414] [INFO ] [MAIN ] Derivative Progress: 403/2037 symbols completed. CMPO took 1.2s. Estimated remaining: 10m 46s. Rate: 151.8 symbols/min [2025-10-06T22:36:38.793343] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52610 primary records. [2025-10-06T22:36:38.793460] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-10-06T22:36:38.793621] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-06T22:36:38.793739] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-06T22:36:38.796405] [INFO ] [MAIN ] Derivative Progress: 404/2037 symbols completed. CMRE took 1.2s. Estimated remaining: 10m 44s. Rate: 152.2 symbols/min [2025-10-06T22:36:38.812295] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-10-06T22:36:38.812381] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-06T22:36:38.815541] [INFO ] [MAIN ] Derivative Progress: 405/2037 symbols completed. CMS took 1.2s. Estimated remaining: 10m 42s. Rate: 152.6 symbols/min [2025-10-06T22:36:38.816019] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:38.816135] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:38.816461] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:38.824398] [DEBUG] [LOCAL ] CMSA: Loaded 3513 existing records from primary storage. [2025-10-06T22:36:38.825827] [INFO ] [MAIN ] CMSA: Loaded 3513 primary data records. [2025-10-06T22:36:38.908353] [DEBUG] [LOCAL ] CMSD: Loaded 8028 existing records from primary storage. [2025-10-06T22:36:38.913611] [INFO ] [MAIN ] CMSD: Loaded 8028 primary data records. [2025-10-06T22:36:38.885141] [DEBUG] [LOCAL ] CMSC: Loaded 5062 existing records from primary storage. [2025-10-06T22:36:38.931997] [INFO ] [MAIN ] CMSC: Loaded 5062 primary data records. [2025-10-06T22:36:39.834959] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:36:39.835906] [INFO ] [MAIN ] CMSA: Generated 1793 derivative records from 3513 primary records. [2025-10-06T22:36:39.836200] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-06T22:36:39.877159] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1793 records). [2025-10-06T22:36:39.877390] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:36:39.883700] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:39.883282] [INFO ] [MAIN ] CMSC: Generated 1793 derivative records from 5062 primary records. [2025-10-06T22:36:39.883362] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-06T22:36:39.884525] [INFO ] [MAIN ] CMSD: Generated 1794 derivative records from 8028 primary records. [2025-10-06T22:36:39.884614] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-06T22:36:39.886701] [INFO ] [MAIN ] Derivative Progress: 406/2037 symbols completed. CMSA took 1.1s. Estimated remaining: 10m 44s. Rate: 151.9 symbols/min [2025-10-06T22:36:39.887007] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-06T22:36:39.886928] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:39.916940] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-10-06T22:36:39.917350] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-06T22:36:39.920569] [INFO ] [MAIN ] Derivative Progress: 407/2037 symbols completed. CMSD took 1.1s. Estimated remaining: 10m 42s. Rate: 152.2 symbols/min [2025-10-06T22:36:39.921301] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:39.927242] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1793 records). [2025-10-06T22:36:39.927482] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-06T22:36:39.930928] [INFO ] [MAIN ] Derivative Progress: 408/2037 symbols completed. CMSC took 1.1s. Estimated remaining: 10m 40s. Rate: 152.6 symbols/min [2025-10-06T22:36:39.931147] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:39.944408] [DEBUG] [LOCAL ] CMU: Loaded 6438 existing records from primary storage. [2025-10-06T22:36:39.944605] [INFO ] [MAIN ] CMU: Loaded 6438 primary data records. [2025-10-06T22:36:40.080577] [DEBUG] [LOCAL ] CMTG: Loaded 36405 existing records from primary storage. [2025-10-06T22:36:40.098851] [INFO ] [MAIN ] CMTG: Loaded 36405 primary data records. [2025-10-06T22:36:40.379429] [DEBUG] [LOCAL ] CNA: Loaded 32857 existing records from primary storage. [2025-10-06T22:36:40.380178] [INFO ] [MAIN ] CNA: Loaded 32857 primary data records. [2025-10-06T22:36:40.969900] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:40.970999] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 6438 primary records. [2025-10-06T22:36:40.971186] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-06T22:36:40.989427] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-10-06T22:36:40.989626] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-06T22:36:40.992033] [INFO ] [MAIN ] Derivative Progress: 409/2037 symbols completed. CMU took 1.1s. Estimated remaining: 10m 43s. Rate: 152.0 symbols/min [2025-10-06T22:36:40.992398] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:41.011024] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:41.011765] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 36405 primary records. [2025-10-06T22:36:41.012214] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-06T22:36:41.034501] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:41.035457] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32857 primary records. [2025-10-06T22:36:41.043794] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-06T22:36:41.060689] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-10-06T22:36:41.082466] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-10-06T22:36:41.082384] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-06T22:36:41.082574] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-06T22:36:41.085818] [INFO ] [MAIN ] Derivative Progress: 410/2037 symbols completed. CNA took 1.2s. Estimated remaining: 10m 41s. Rate: 152.3 symbols/min [2025-10-06T22:36:41.089484] [INFO ] [MAIN ] Derivative Progress: 411/2037 symbols completed. CMTG took 1.2s. Estimated remaining: 10m 39s. Rate: 152.6 symbols/min [2025-10-06T22:36:41.089398] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:41.090041] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:41.115920] [DEBUG] [LOCAL ] CNC: Loaded 53745 existing records from primary storage. [2025-10-06T22:36:41.116179] [INFO ] [MAIN ] CNC: Loaded 53745 primary data records. [2025-10-06T22:36:41.173923] [DEBUG] [LOCAL ] CNF: Loaded 10495 existing records from primary storage. [2025-10-06T22:36:41.184388] [INFO ] [MAIN ] CNF: Loaded 10495 primary data records. [2025-10-06T22:36:41.640498] [DEBUG] [LOCAL ] CNI: Loaded 51661 existing records from primary storage. [2025-10-06T22:36:41.663300] [INFO ] [MAIN ] CNI: Loaded 51661 primary data records. [2025-10-06T22:36:42.248849] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:36:42.251286] [INFO ] [MAIN ] CNC: Generated 1793 derivative records from 53745 primary records. [2025-10-06T22:36:42.252020] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-06T22:36:42.275231] [DEBUG] [LOCAL ] CNC: Derivative data saved (1793 records). [2025-10-06T22:36:42.277498] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-06T22:36:42.280588] [INFO ] [MAIN ] Derivative Progress: 412/2037 symbols completed. CNC took 1.3s. Estimated remaining: 10m 42s. Rate: 151.9 symbols/min [2025-10-06T22:36:42.281296] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:42.296169] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:42.297012] [INFO ] [MAIN ] CNF: Generated 1794 derivative records from 10495 primary records. [2025-10-06T22:36:42.297111] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-06T22:36:42.313180] [DEBUG] [LOCAL ] CNF: Derivative data saved (1794 records). [2025-10-06T22:36:42.314266] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-06T22:36:42.317710] [INFO ] [MAIN ] Derivative Progress: 413/2037 symbols completed. CNF took 1.2s. Estimated remaining: 10m 40s. Rate: 152.2 symbols/min [2025-10-06T22:36:42.318004] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:42.335443] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:42.336419] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51661 primary records. [2025-10-06T22:36:42.336592] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-06T22:36:42.353971] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-10-06T22:36:42.354193] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-06T22:36:42.357281] [INFO ] [MAIN ] Derivative Progress: 414/2037 symbols completed. CNI took 1.3s. Estimated remaining: 10m 38s. Rate: 152.5 symbols/min [2025-10-06T22:36:42.357544] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:42.409499] [DEBUG] [LOCAL ] CNK: Loaded 52882 existing records from primary storage. [2025-10-06T22:36:42.409760] [INFO ] [MAIN ] CNK: Loaded 52882 primary data records. [2025-10-06T22:36:42.573528] [DEBUG] [LOCAL ] CNMD: Loaded 32267 existing records from primary storage. [2025-10-06T22:36:42.586030] [DEBUG] [LOCAL ] CNM: Loaded 51030 existing records from primary storage. [2025-10-06T22:36:42.586166] [INFO ] [MAIN ] CNM: Loaded 51030 primary data records. [2025-10-06T22:36:42.585204] [INFO ] [MAIN ] CNMD: Loaded 32267 primary data records. [2025-10-06T22:36:43.651925] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:43.654683] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52882 primary records. [2025-10-06T22:36:43.655700] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-06T22:36:43.685070] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-10-06T22:36:43.685553] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-06T22:36:43.688472] [INFO ] [MAIN ] Derivative Progress: 415/2037 symbols completed. CNK took 1.4s. Estimated remaining: 10m 42s. Rate: 151.7 symbols/min [2025-10-06T22:36:43.689120] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:43.719696] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:43.720778] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 51030 primary records. [2025-10-06T22:36:43.721290] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-06T22:36:43.767053] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:43.770512] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32267 primary records. [2025-10-06T22:36:43.771380] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-06T22:36:43.792061] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-10-06T22:36:43.813145] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-06T22:36:43.814758] [DEBUG] [LOCAL ] CNNE: Loaded 36348 existing records from primary storage. [2025-10-06T22:36:43.815631] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-10-06T22:36:43.819599] [INFO ] [MAIN ] Derivative Progress: 416/2037 symbols completed. CNMD took 1.5s. Estimated remaining: 10m 40s. Rate: 151.9 symbols/min [2025-10-06T22:36:43.820011] [INFO ] [MAIN ] CNNE: Loaded 36348 primary data records. [2025-10-06T22:36:43.820419] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:43.835775] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-06T22:36:43.868834] [INFO ] [MAIN ] Derivative Progress: 417/2037 symbols completed. CNM took 1.6s. Estimated remaining: 10m 38s. Rate: 152.2 symbols/min [2025-10-06T22:36:43.884760] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:44.259321] [DEBUG] [LOCAL ] CNO: Loaded 40924 existing records from primary storage. [2025-10-06T22:36:44.260265] [INFO ] [MAIN ] CNO: Loaded 40924 primary data records. [2025-10-06T22:36:44.383749] [DEBUG] [LOCAL ] CNP: Loaded 53471 existing records from primary storage. [2025-10-06T22:36:44.383985] [INFO ] [MAIN ] CNP: Loaded 53471 primary data records. [2025-10-06T22:36:44.904124] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:44.905032] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 36348 primary records. [2025-10-06T22:36:44.905244] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-06T22:36:44.922507] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-10-06T22:36:44.922787] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-06T22:36:44.925071] [INFO ] [MAIN ] Derivative Progress: 418/2037 symbols completed. CNNE took 1.2s. Estimated remaining: 10m 41s. Rate: 151.6 symbols/min [2025-10-06T22:36:44.944169] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:44.946103] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 40924 primary records. [2025-10-06T22:36:44.946275] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-06T22:36:44.959481] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:44.968879] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53471 primary records. [2025-10-06T22:36:44.972805] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-06T22:36:44.992046] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-10-06T22:36:44.992131] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-10-06T22:36:44.992300] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-06T22:36:44.992395] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-06T22:36:44.996019] [INFO ] [MAIN ] Derivative Progress: 419/2037 symbols completed. CNP took 1.1s. Estimated remaining: 10m 39s. Rate: 151.9 symbols/min [2025-10-06T22:36:44.998673] [INFO ] [MAIN ] Derivative Progress: 420/2037 symbols completed. CNO took 1.2s. Estimated remaining: 10m 37s. Rate: 152.3 symbols/min [2025-10-06T22:36:44.999230] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:44.999159] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:44.999088] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:45.029805] [DEBUG] [LOCAL ] CNS: Loaded 20806 existing records from primary storage. [2025-10-06T22:36:45.030118] [INFO ] [MAIN ] CNS: Loaded 20806 primary data records. [2025-10-06T22:36:45.394296] [DEBUG] [LOCAL ] CNX: Loaded 51353 existing records from primary storage. [2025-10-06T22:36:45.409926] [INFO ] [MAIN ] CNX: Loaded 51353 primary data records. [2025-10-06T22:36:45.411894] [DEBUG] [LOCAL ] CNQ: Loaded 53577 existing records from primary storage. [2025-10-06T22:36:45.412066] [INFO ] [MAIN ] CNQ: Loaded 53577 primary data records. [2025-10-06T22:36:46.132384] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:46.134211] [INFO ] [MAIN ] CNS: Generated 1794 derivative records from 20806 primary records. [2025-10-06T22:36:46.136451] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-10-06T22:36:46.159424] [DEBUG] [LOCAL ] CNS: Derivative data saved (1794 records). [2025-10-06T22:36:46.160064] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-10-06T22:36:46.163340] [INFO ] [MAIN ] Derivative Progress: 421/2037 symbols completed. CNS took 1.2s. Estimated remaining: 10m 40s. Rate: 151.6 symbols/min [2025-10-06T22:36:46.163744] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:46.184290] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:46.187671] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51353 primary records. [2025-10-06T22:36:46.188025] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-06T22:36:46.202494] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:46.211122] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53577 primary records. [2025-10-06T22:36:46.215576] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-06T22:36:46.220591] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-10-06T22:36:46.232215] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-06T22:36:46.234357] [INFO ] [MAIN ] Derivative Progress: 422/2037 symbols completed. CNX took 1.2s. Estimated remaining: 10m 38s. Rate: 151.9 symbols/min [2025-10-06T22:36:46.235732] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:46.241079] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-10-06T22:36:46.253032] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-06T22:36:46.256316] [INFO ] [MAIN ] Derivative Progress: 423/2037 symbols completed. CNQ took 1.3s. Estimated remaining: 10m 36s. Rate: 152.2 symbols/min [2025-10-06T22:36:46.256675] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:46.273570] [DEBUG] [LOCAL ] CODI: Loaded 40433 existing records from primary storage. [2025-10-06T22:36:46.275283] [INFO ] [MAIN ] CODI: Loaded 40433 primary data records. [2025-10-06T22:36:46.622556] [DEBUG] [LOCAL ] COF: Loaded 53609 existing records from primary storage. [2025-10-06T22:36:46.622914] [INFO ] [MAIN ] COF: Loaded 53609 primary data records. [2025-10-06T22:36:46.758715] [DEBUG] [LOCAL ] COLD: Loaded 52161 existing records from primary storage. [2025-10-06T22:36:46.764345] [INFO ] [MAIN ] COLD: Loaded 52161 primary data records. [2025-10-06T22:36:47.330734] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:47.332048] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 40433 primary records. [2025-10-06T22:36:47.332299] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-06T22:36:47.353450] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-10-06T22:36:47.354162] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-06T22:36:47.357459] [INFO ] [MAIN ] Derivative Progress: 424/2037 symbols completed. CODI took 1.2s. Estimated remaining: 10m 38s. Rate: 151.6 symbols/min [2025-10-06T22:36:47.358436] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:47.379245] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:47.380366] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53609 primary records. [2025-10-06T22:36:47.380522] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-06T22:36:47.401365] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-10-06T22:36:47.401773] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-06T22:36:47.404258] [INFO ] [MAIN ] Derivative Progress: 425/2037 symbols completed. COF took 1.2s. Estimated remaining: 10m 37s. Rate: 151.9 symbols/min [2025-10-06T22:36:47.418173] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:47.417560] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:47.430115] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 52161 primary records. [2025-10-06T22:36:47.430375] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-06T22:36:47.447790] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-10-06T22:36:47.448756] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-06T22:36:47.453150] [INFO ] [MAIN ] Derivative Progress: 426/2037 symbols completed. COLD took 1.2s. Estimated remaining: 10m 35s. Rate: 152.2 symbols/min [2025-10-06T22:36:47.453564] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:47.469095] [DEBUG] [LOCAL ] CON: Loaded 38814 existing records from primary storage. [2025-10-06T22:36:47.469400] [INFO ] [MAIN ] CON: Loaded 38814 primary data records. [2025-10-06T22:36:47.618117] [DEBUG] [LOCAL ] COOK: Loaded 24317 existing records from primary storage. [2025-10-06T22:36:47.634199] [INFO ] [MAIN ] COOK: Loaded 24317 primary data records. [2025-10-06T22:36:47.962322] [DEBUG] [LOCAL ] COR: Loaded 46949 existing records from primary storage. [2025-10-06T22:36:47.984210] [INFO ] [MAIN ] COR: Loaded 46949 primary data records. [2025-10-06T22:36:48.489065] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:48.490310] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38814 primary records. [2025-10-06T22:36:48.490794] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-06T22:36:48.510704] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-10-06T22:36:48.511462] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-06T22:36:48.514254] [INFO ] [MAIN ] Derivative Progress: 427/2037 symbols completed. CON took 1.2s. Estimated remaining: 10m 37s. Rate: 151.6 symbols/min [2025-10-06T22:36:48.514868] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:48.535867] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:48.538830] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24317 primary records. [2025-10-06T22:36:48.539065] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-06T22:36:48.568625] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-10-06T22:36:48.567831] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:48.568867] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-06T22:36:48.573709] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 46949 primary records. [2025-10-06T22:36:48.572485] [INFO ] [MAIN ] Derivative Progress: 428/2037 symbols completed. COOK took 1.2s. Estimated remaining: 10m 36s. Rate: 151.9 symbols/min [2025-10-06T22:36:48.573976] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-06T22:36:48.574102] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:48.606332] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-10-06T22:36:48.606493] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-06T22:36:48.609495] [INFO ] [MAIN ] Derivative Progress: 429/2037 symbols completed. COR took 1.2s. Estimated remaining: 10m 34s. Rate: 152.2 symbols/min [2025-10-06T22:36:48.609851] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:48.635054] [DEBUG] [LOCAL ] COTY: Loaded 53238 existing records from primary storage. [2025-10-06T22:36:48.635327] [INFO ] [MAIN ] COTY: Loaded 53238 primary data records. [2025-10-06T22:36:48.826379] [DEBUG] [LOCAL ] CP: Loaded 53262 existing records from primary storage. [2025-10-06T22:36:48.844216] [DEBUG] [LOCAL ] CPA: Loaded 28283 existing records from primary storage. [2025-10-06T22:36:48.883708] [INFO ] [MAIN ] CPA: Loaded 28283 primary data records. [2025-10-06T22:36:48.897715] [INFO ] [MAIN ] CP: Loaded 53262 primary data records. [2025-10-06T22:36:49.700175] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:49.701802] [INFO ] [MAIN ] COTY: Generated 1794 derivative records from 53238 primary records. [2025-10-06T22:36:49.701946] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-06T22:36:49.723167] [DEBUG] [LOCAL ] COTY: Derivative data saved (1794 records). [2025-10-06T22:36:49.723709] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-06T22:36:49.726775] [INFO ] [MAIN ] Derivative Progress: 430/2037 symbols completed. COTY took 1.2s. Estimated remaining: 10m 36s. Rate: 151.6 symbols/min [2025-10-06T22:36:49.727155] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:49.767272] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:49.774607] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:49.775447] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 28283 primary records. [2025-10-06T22:36:49.774384] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53262 primary records. [2025-10-06T22:36:49.775847] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-06T22:36:49.775606] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-06T22:36:49.822510] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-10-06T22:36:49.833492] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-06T22:36:49.836468] [INFO ] [MAIN ] Derivative Progress: 431/2037 symbols completed. CP took 1.3s. Estimated remaining: 10m 35s. Rate: 151.8 symbols/min [2025-10-06T22:36:49.833369] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-10-06T22:36:49.836700] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:49.837590] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-06T22:36:49.842956] [DEBUG] [LOCAL ] CPAY: Loaded 30485 existing records from primary storage. [2025-10-06T22:36:49.841857] [INFO ] [MAIN ] Derivative Progress: 432/2037 symbols completed. CPA took 1.2s. Estimated remaining: 10m 33s. Rate: 152.2 symbols/min [2025-10-06T22:36:49.843330] [INFO ] [MAIN ] CPAY: Loaded 30485 primary data records. [2025-10-06T22:36:49.843634] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:49.976249] [DEBUG] [LOCAL ] CPF: Loaded 15213 existing records from primary storage. [2025-10-06T22:36:49.993115] [INFO ] [MAIN ] CPF: Loaded 15213 primary data records. [2025-10-06T22:36:49.982497] [DEBUG] [LOCAL ] CPK: Loaded 13554 existing records from primary storage. [2025-10-06T22:36:50.048870] [INFO ] [MAIN ] CPK: Loaded 13554 primary data records. [2025-10-06T22:36:50.862468] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:50.863909] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 30485 primary records. [2025-10-06T22:36:50.864196] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-06T22:36:50.883139] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-10-06T22:36:50.884276] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-06T22:36:50.888676] [INFO ] [MAIN ] Derivative Progress: 433/2037 symbols completed. CPAY took 1.2s. Estimated remaining: 10m 35s. Rate: 151.6 symbols/min [2025-10-06T22:36:50.916689] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:50.916419] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:50.918042] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15213 primary records. [2025-10-06T22:36:50.917474] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13554 primary records. [2025-10-06T22:36:50.918136] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-06T22:36:50.918191] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-06T22:36:50.949787] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-10-06T22:36:50.949898] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-06T22:36:50.948706] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-10-06T22:36:50.952564] [INFO ] [MAIN ] Derivative Progress: 434/2037 symbols completed. CPK took 1.1s. Estimated remaining: 10m 33s. Rate: 151.9 symbols/min [2025-10-06T22:36:50.952707] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-06T22:36:50.956083] [INFO ] [MAIN ] Derivative Progress: 435/2037 symbols completed. CPF took 1.1s. Estimated remaining: 10m 31s. Rate: 152.2 symbols/min [2025-10-06T22:36:50.956432] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:50.956532] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:50.956615] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:50.990888] [DEBUG] [LOCAL ] CPS: Loaded 25745 existing records from primary storage. [2025-10-06T22:36:51.005554] [INFO ] [MAIN ] CPS: Loaded 25745 primary data records. [2025-10-06T22:36:51.160085] [DEBUG] [LOCAL ] CPRI: Loaded 52511 existing records from primary storage. [2025-10-06T22:36:51.170855] [INFO ] [MAIN ] CPRI: Loaded 52511 primary data records. [2025-10-06T22:36:51.460474] [DEBUG] [LOCAL ] CPT: Loaded 44378 existing records from primary storage. [2025-10-06T22:36:51.472849] [INFO ] [MAIN ] CPT: Loaded 44378 primary data records. [2025-10-06T22:36:52.162016] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:52.164368] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 25745 primary records. [2025-10-06T22:36:52.164519] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-06T22:36:52.201814] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:52.203622] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52511 primary records. [2025-10-06T22:36:52.204019] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-06T22:36:52.206741] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-10-06T22:36:52.214307] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-06T22:36:52.217456] [INFO ] [MAIN ] Derivative Progress: 436/2037 symbols completed. CPS took 1.3s. Estimated remaining: 10m 34s. Rate: 151.5 symbols/min [2025-10-06T22:36:52.217974] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:52.231564] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-10-06T22:36:52.231910] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-06T22:36:52.235264] [INFO ] [MAIN ] Derivative Progress: 437/2037 symbols completed. CPRI took 1.3s. Estimated remaining: 10m 32s. Rate: 151.8 symbols/min [2025-10-06T22:36:52.248754] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:52.249388] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:52.256478] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44378 primary records. [2025-10-06T22:36:52.256745] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-06T22:36:52.281321] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-10-06T22:36:52.281472] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-06T22:36:52.286315] [INFO ] [MAIN ] Derivative Progress: 438/2037 symbols completed. CPT took 1.3s. Estimated remaining: 10m 31s. Rate: 152.1 symbols/min [2025-10-06T22:36:52.286708] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:52.282094] [DEBUG] [LOCAL ] CQP: Loaded 19102 existing records from primary storage. [2025-10-06T22:36:52.287424] [INFO ] [MAIN ] CQP: Loaded 19102 primary data records. [2025-10-06T22:36:52.425291] [DEBUG] [LOCAL ] CR: Loaded 24251 existing records from primary storage. [2025-10-06T22:36:52.413768] [DEBUG] [LOCAL ] CRBD: Loaded 8957 existing records from primary storage. [2025-10-06T22:36:52.454613] [INFO ] [MAIN ] CR: Loaded 24251 primary data records. [2025-10-06T22:36:52.454440] [INFO ] [MAIN ] CRBD: Loaded 8957 primary data records. [2025-10-06T22:36:53.302821] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:53.304328] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 19102 primary records. [2025-10-06T22:36:53.304450] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-06T22:36:53.326830] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:53.331969] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24251 primary records. [2025-10-06T22:36:53.333234] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-06T22:36:53.354998] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-10-06T22:36:53.355400] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-06T22:36:53.358692] [INFO ] [MAIN ] Derivative Progress: 439/2037 symbols completed. CR took 1.1s. Estimated remaining: 10m 33s. Rate: 151.5 symbols/min [2025-10-06T22:36:53.359267] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:53.375792] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-10-06T22:36:53.376080] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:53.376521] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-06T22:36:53.377390] [INFO ] [MAIN ] CRBD: Generated 1794 derivative records from 8957 primary records. [2025-10-06T22:36:53.380734] [INFO ] [MAIN ] Derivative Progress: 440/2037 symbols completed. CQP took 1.2s. Estimated remaining: 10m 31s. Rate: 151.8 symbols/min [2025-10-06T22:36:53.381035] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-06T22:36:53.381219] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:53.400325] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1794 records). [2025-10-06T22:36:53.400545] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-06T22:36:53.404442] [INFO ] [MAIN ] Derivative Progress: 441/2037 symbols completed. CRBD took 1.1s. Estimated remaining: 10m 29s. Rate: 152.2 symbols/min [2025-10-06T22:36:53.404792] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:53.464598] [DEBUG] [LOCAL ] CRBG: Loaded 52399 existing records from primary storage. [2025-10-06T22:36:53.464812] [INFO ] [MAIN ] CRBG: Loaded 52399 primary data records. [2025-10-06T22:36:53.591269] [DEBUG] [LOCAL ] CRGY: Loaded 52502 existing records from primary storage. [2025-10-06T22:36:53.605326] [INFO ] [MAIN ] CRGY: Loaded 52502 primary data records. [2025-10-06T22:36:53.840894] [DEBUG] [LOCAL ] CRH: Loaded 53462 existing records from primary storage. [2025-10-06T22:36:53.959287] [INFO ] [MAIN ] CRH: Loaded 53462 primary data records. [2025-10-06T22:36:54.563107] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:54.564387] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52399 primary records. [2025-10-06T22:36:54.564529] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-06T22:36:54.586139] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-10-06T22:36:54.586326] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-06T22:36:54.588545] [INFO ] [MAIN ] Derivative Progress: 442/2037 symbols completed. CRBG took 1.2s. Estimated remaining: 10m 32s. Rate: 151.5 symbols/min [2025-10-06T22:36:54.588927] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:54.602986] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:54.603812] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52502 primary records. [2025-10-06T22:36:54.604058] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-06T22:36:54.625413] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-10-06T22:36:54.625727] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-06T22:36:54.629171] [INFO ] [MAIN ] Derivative Progress: 443/2037 symbols completed. CRGY took 1.2s. Estimated remaining: 10m 30s. Rate: 151.8 symbols/min [2025-10-06T22:36:54.641096] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:54.651633] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:54.652800] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53462 primary records. [2025-10-06T22:36:54.652998] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-06T22:36:54.692190] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-10-06T22:36:54.692328] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-06T22:36:54.697291] [INFO ] [MAIN ] Derivative Progress: 444/2037 symbols completed. CRH took 1.3s. Estimated remaining: 10m 28s. Rate: 152.1 symbols/min [2025-10-06T22:36:54.698317] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:54.723920] [DEBUG] [LOCAL ] CRK: Loaded 52172 existing records from primary storage. [2025-10-06T22:36:54.724255] [INFO ] [MAIN ] CRK: Loaded 52172 primary data records. [2025-10-06T22:36:54.864415] [DEBUG] [LOCAL ] CRL: Loaded 42885 existing records from primary storage. [2025-10-06T22:36:54.875431] [INFO ] [MAIN ] CRL: Loaded 42885 primary data records. [2025-10-06T22:36:55.422669] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-06T22:36:55.422941] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-10-06T22:36:55.762247] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:55.764708] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52172 primary records. [2025-10-06T22:36:55.766719] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-06T22:36:55.796927] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:55.798853] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 42885 primary records. [2025-10-06T22:36:55.799133] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-06T22:36:55.819143] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-10-06T22:36:55.820708] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-06T22:36:55.824922] [INFO ] [MAIN ] Derivative Progress: 445/2037 symbols completed. CRL took 1.2s. Estimated remaining: 10m 31s. Rate: 151.4 symbols/min [2025-10-06T22:36:55.825836] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-10-06T22:36:55.826328] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-06T22:36:55.826539] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:55.829525] [INFO ] [MAIN ] Derivative Progress: 446/2037 symbols completed. CRK took 1.2s. Estimated remaining: 10m 29s. Rate: 151.8 symbols/min [2025-10-06T22:36:55.830269] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:55.847550] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:55.848472] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-10-06T22:36:55.848622] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-06T22:36:55.867121] [DEBUG] [LOCAL ] CRT: Loaded 5015 existing records from primary storage. [2025-10-06T22:36:55.868024] [INFO ] [MAIN ] CRT: Loaded 5015 primary data records. [2025-10-06T22:36:55.988975] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-10-06T22:36:56.010410] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-06T22:36:56.019598] [INFO ] [MAIN ] Derivative Progress: 447/2037 symbols completed. CRM took 1.3s. Estimated remaining: 10m 28s. Rate: 152.0 symbols/min [2025-10-06T22:36:56.042810] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:56.214264] [DEBUG] [LOCAL ] CRS: Loaded 43201 existing records from primary storage. [2025-10-06T22:36:56.215612] [INFO ] [MAIN ] CRS: Loaded 43201 primary data records. [2025-10-06T22:36:56.638727] [DEBUG] [LOCAL ] CSAN: Loaded 42213 existing records from primary storage. [2025-10-06T22:36:56.640159] [INFO ] [MAIN ] CSAN: Loaded 42213 primary data records. [2025-10-06T22:36:56.692833] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:56.744202] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 5015 primary records. [2025-10-06T22:36:56.751566] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-06T22:36:57.018001] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-10-06T22:36:57.019356] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-06T22:36:57.022838] [INFO ] [MAIN ] Derivative Progress: 448/2037 symbols completed. CRT took 1.2s. Estimated remaining: 10m 30s. Rate: 151.4 symbols/min [2025-10-06T22:36:57.044736] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:57.046084] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43201 primary records. [2025-10-06T22:36:57.046611] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-06T22:36:57.066929] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-10-06T22:36:57.067186] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-06T22:36:57.070976] [INFO ] [MAIN ] Derivative Progress: 449/2037 symbols completed. CRS took 1.2s. Estimated remaining: 10m 28s. Rate: 151.7 symbols/min [2025-10-06T22:36:57.089572] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:57.090365] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42213 primary records. [2025-10-06T22:36:57.090429] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-06T22:36:57.106296] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-10-06T22:36:57.106385] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-06T22:36:57.109598] [INFO ] [MAIN ] Derivative Progress: 450/2037 symbols completed. CSAN took 1.1s. Estimated remaining: 10m 26s. Rate: 152.0 symbols/min [2025-10-06T22:36:57.110294] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:57.110429] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:57.110552] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:57.144052] [DEBUG] [LOCAL ] CSR: Loaded 12915 existing records from primary storage. [2025-10-06T22:36:57.144247] [INFO ] [MAIN ] CSR: Loaded 12915 primary data records. [2025-10-06T22:36:57.237807] [DEBUG] [LOCAL ] CSL: Loaded 31516 existing records from primary storage. [2025-10-06T22:36:57.254906] [INFO ] [MAIN ] CSL: Loaded 31516 primary data records. [2025-10-06T22:36:57.385819] [DEBUG] [LOCAL ] CSTM: Loaded 47430 existing records from primary storage. [2025-10-06T22:36:57.406703] [INFO ] [MAIN ] CSTM: Loaded 47430 primary data records. [2025-10-06T22:36:58.195797] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:58.214887] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 12915 primary records. [2025-10-06T22:36:58.215376] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-06T22:36:58.215944] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:58.218170] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31516 primary records. [2025-10-06T22:36:58.218713] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-06T22:36:58.249306] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-10-06T22:36:58.250408] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-06T22:36:58.254348] [INFO ] [MAIN ] Derivative Progress: 451/2037 symbols completed. CSL took 1.1s. Estimated remaining: 10m 29s. Rate: 151.4 symbols/min [2025-10-06T22:36:58.255181] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:58.262536] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-10-06T22:36:58.262812] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-06T22:36:58.265488] [INFO ] [MAIN ] Derivative Progress: 452/2037 symbols completed. CSR took 1.2s. Estimated remaining: 10m 27s. Rate: 151.7 symbols/min [2025-10-06T22:36:58.265930] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:58.285771] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:58.286876] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47430 primary records. [2025-10-06T22:36:58.288812] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-06T22:36:58.304769] [DEBUG] [LOCAL ] CSV: Loaded 12801 existing records from primary storage. [2025-10-06T22:36:58.307739] [INFO ] [MAIN ] CSV: Loaded 12801 primary data records. [2025-10-06T22:36:58.319147] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-10-06T22:36:58.322193] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-06T22:36:58.322522] [DEBUG] [LOCAL ] CTDD: Loaded 5859 existing records from primary storage. [2025-10-06T22:36:58.339330] [INFO ] [MAIN ] CTDD: Loaded 5859 primary data records. [2025-10-06T22:36:58.355013] [INFO ] [MAIN ] Derivative Progress: 453/2037 symbols completed. CSTM took 1.2s. Estimated remaining: 10m 25s. Rate: 152.0 symbols/min [2025-10-06T22:36:58.399869] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:58.902445] [DEBUG] [LOCAL ] CTO: Loaded 27723 existing records from primary storage. [2025-10-06T22:36:58.904202] [INFO ] [MAIN ] CTO: Loaded 27723 primary data records. [2025-10-06T22:36:59.392151] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:59.393493] [INFO ] [MAIN ] CTDD: Generated 1794 derivative records from 5859 primary records. [2025-10-06T22:36:59.393701] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-06T22:36:59.424845] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:59.427631] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 12801 primary records. [2025-10-06T22:36:59.428469] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-06T22:36:59.447129] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1794 records). [2025-10-06T22:36:59.448162] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-06T22:36:59.451598] [INFO ] [MAIN ] Derivative Progress: 454/2037 symbols completed. CTDD took 1.2s. Estimated remaining: 10m 27s. Rate: 151.4 symbols/min [2025-10-06T22:36:59.452451] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:59.454618] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-10-06T22:36:59.455760] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-06T22:36:59.459117] [INFO ] [MAIN ] Derivative Progress: 455/2037 symbols completed. CSV took 1.2s. Estimated remaining: 10m 26s. Rate: 151.7 symbols/min [2025-10-06T22:36:59.460053] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:59.478745] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:36:59.479954] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 27723 primary records. [2025-10-06T22:36:59.480136] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-06T22:36:59.503672] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-10-06T22:36:59.504029] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-06T22:36:59.507271] [INFO ] [MAIN ] Derivative Progress: 456/2037 symbols completed. CTO took 1.1s. Estimated remaining: 10m 24s. Rate: 152.0 symbols/min [2025-10-06T22:36:59.507589] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:36:59.528881] [DEBUG] [LOCAL ] CTS: Loaded 19411 existing records from primary storage. [2025-10-06T22:36:59.529113] [INFO ] [MAIN ] CTS: Loaded 19411 primary data records. [2025-10-06T22:36:59.714912] [DEBUG] [LOCAL ] CTRE: Loaded 49286 existing records from primary storage. [2025-10-06T22:36:59.732762] [INFO ] [MAIN ] CTRE: Loaded 49286 primary data records. [2025-10-06T22:37:00.094747] [DEBUG] [LOCAL ] CTVA: Loaded 53246 existing records from primary storage. [2025-10-06T22:37:00.135852] [INFO ] [MAIN ] CTVA: Loaded 53246 primary data records. [2025-10-06T22:37:00.626606] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:00.628456] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19411 primary records. [2025-10-06T22:37:00.628906] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-06T22:37:00.662876] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:00.664062] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49286 primary records. [2025-10-06T22:37:00.664287] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-06T22:37:00.678028] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-10-06T22:37:00.678265] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-06T22:37:00.680768] [INFO ] [MAIN ] Derivative Progress: 457/2037 symbols completed. CTS took 1.2s. Estimated remaining: 10m 26s. Rate: 151.4 symbols/min [2025-10-06T22:37:00.681995] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:00.706131] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:00.706887] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53246 primary records. [2025-10-06T22:37:00.707063] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-06T22:37:00.708052] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-10-06T22:37:00.717021] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-06T22:37:00.724299] [INFO ] [MAIN ] Derivative Progress: 458/2037 symbols completed. CTRE took 1.3s. Estimated remaining: 10m 25s. Rate: 151.7 symbols/min [2025-10-06T22:37:00.725717] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:00.732245] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-10-06T22:37:00.733153] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-06T22:37:00.738422] [INFO ] [MAIN ] Derivative Progress: 459/2037 symbols completed. CTVA took 1.2s. Estimated remaining: 10m 23s. Rate: 152.0 symbols/min [2025-10-06T22:37:00.755946] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:00.796265] [DEBUG] [LOCAL ] CUBI: Loaded 27064 existing records from primary storage. [2025-10-06T22:37:00.796533] [INFO ] [MAIN ] CUBI: Loaded 27064 primary data records. [2025-10-06T22:37:00.819927] [DEBUG] [LOCAL ] CUBE: Loaded 50758 existing records from primary storage. [2025-10-06T22:37:00.843221] [INFO ] [MAIN ] CUBE: Loaded 50758 primary data records. [2025-10-06T22:37:01.276181] [DEBUG] [LOCAL ] CUK: Loaded 50984 existing records from primary storage. [2025-10-06T22:37:01.540073] [INFO ] [MAIN ] CUK: Loaded 50984 primary data records. [2025-10-06T22:37:01.911274] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:01.927676] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:01.927314] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27064 primary records. [2025-10-06T22:37:01.928522] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-06T22:37:01.930093] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50758 primary records. [2025-10-06T22:37:01.930424] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-06T22:37:01.962149] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-10-06T22:37:01.962910] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-06T22:37:01.966231] [INFO ] [MAIN ] Derivative Progress: 460/2037 symbols completed. CUBE took 1.3s. Estimated remaining: 10m 25s. Rate: 151.3 symbols/min [2025-10-06T22:37:01.967324] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:01.974773] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-10-06T22:37:01.987359] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-06T22:37:01.990519] [INFO ] [MAIN ] Derivative Progress: 461/2037 symbols completed. CUBI took 1.3s. Estimated remaining: 10m 24s. Rate: 151.6 symbols/min [2025-10-06T22:37:01.990926] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:01.991134] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:01.992380] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 50984 primary records. [2025-10-06T22:37:01.992994] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-06T22:37:02.018617] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-10-06T22:37:02.028008] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-06T22:37:02.031544] [INFO ] [MAIN ] Derivative Progress: 462/2037 symbols completed. CUK took 1.3s. Estimated remaining: 10m 22s. Rate: 151.9 symbols/min [2025-10-06T22:37:02.031731] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:02.032705] [DEBUG] [LOCAL ] CURV: Loaded 26819 existing records from primary storage. [2025-10-06T22:37:02.033335] [INFO ] [MAIN ] CURV: Loaded 26819 primary data records. [2025-10-06T22:37:02.219068] [DEBUG] [LOCAL ] CVEO: Loaded 15179 existing records from primary storage. [2025-10-06T22:37:02.270556] [INFO ] [MAIN ] CVEO: Loaded 15179 primary data records. [2025-10-06T22:37:02.397824] [DEBUG] [LOCAL ] CUZ: Loaded 49398 existing records from primary storage. [2025-10-06T22:37:02.404688] [INFO ] [MAIN ] CUZ: Loaded 49398 primary data records. [2025-10-06T22:37:03.168131] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:03.170074] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 26819 primary records. [2025-10-06T22:37:03.170541] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-06T22:37:03.191267] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-10-06T22:37:03.191941] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-06T22:37:03.195941] [INFO ] [MAIN ] Derivative Progress: 463/2037 symbols completed. CURV took 1.2s. Estimated remaining: 10m 24s. Rate: 151.2 symbols/min [2025-10-06T22:37:03.214667] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:03.216885] [INFO ] [MAIN ] CVEO: Generated 1794 derivative records from 15179 primary records. [2025-10-06T22:37:03.216972] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-06T22:37:03.250455] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1794 records). [2025-10-06T22:37:03.250004] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:03.250799] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-06T22:37:03.251745] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49398 primary records. [2025-10-06T22:37:03.254552] [INFO ] [MAIN ] Derivative Progress: 464/2037 symbols completed. CVEO took 1.2s. Estimated remaining: 10m 23s. Rate: 151.5 symbols/min [2025-10-06T22:37:03.254811] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-06T22:37:03.272319] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-10-06T22:37:03.272391] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-06T22:37:03.276833] [INFO ] [MAIN ] Derivative Progress: 465/2037 symbols completed. CUZ took 1.3s. Estimated remaining: 10m 21s. Rate: 151.8 symbols/min [2025-10-06T22:37:03.277595] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:03.277956] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:03.277443] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:03.366879] [DEBUG] [LOCAL ] CVI: Loaded 46494 existing records from primary storage. [2025-10-06T22:37:03.397759] [INFO ] [MAIN ] CVI: Loaded 46494 primary data records. [2025-10-06T22:37:03.438871] [DEBUG] [LOCAL ] CVNA: Loaded 52929 existing records from primary storage. [2025-10-06T22:37:03.421511] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-10-06T22:37:03.459998] [INFO ] [MAIN ] CVS: Loaded 53696 primary data records. [2025-10-06T22:37:03.469454] [INFO ] [MAIN ] CVNA: Loaded 52929 primary data records. [2025-10-06T22:37:04.430212] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:04.431520] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46494 primary records. [2025-10-06T22:37:04.433843] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-06T22:37:04.465340] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:04.468272] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 52929 primary records. [2025-10-06T22:37:04.468859] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-06T22:37:04.483560] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:04.484443] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53696 primary records. [2025-10-06T22:37:04.483157] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-10-06T22:37:04.493620] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-06T22:37:04.496696] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-10-06T22:37:04.501886] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-10-06T22:37:04.504453] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-06T22:37:04.504324] [INFO ] [MAIN ] Derivative Progress: 466/2037 symbols completed. CVI took 1.2s. Estimated remaining: 10m 24s. Rate: 151.2 symbols/min [2025-10-06T22:37:04.521055] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:04.523334] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-10-06T22:37:04.523504] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-06T22:37:04.523118] [INFO ] [MAIN ] Derivative Progress: 467/2037 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 22s. Rate: 151.5 symbols/min [2025-10-06T22:37:04.527916] [INFO ] [MAIN ] Derivative Progress: 468/2037 symbols completed. CVS took 1.2s. Estimated remaining: 10m 20s. Rate: 151.8 symbols/min [2025-10-06T22:37:04.528094] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:04.527857] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:04.639436] [DEBUG] [LOCAL ] CWAN: Loaded 52437 existing records from primary storage. [2025-10-06T22:37:04.639838] [INFO ] [MAIN ] CWAN: Loaded 52437 primary data records. [2025-10-06T22:37:04.641805] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-06T22:37:04.691562] [DEBUG] [LOCAL ] CWEN: Loaded 45176 existing records from primary storage. [2025-10-06T22:37:04.698771] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-10-06T22:37:04.719936] [INFO ] [MAIN ] CWEN: Loaded 45176 primary data records. [2025-10-06T22:37:05.732178] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:05.733083] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52437 primary records. [2025-10-06T22:37:05.733535] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-06T22:37:05.753541] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-10-06T22:37:05.753913] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-06T22:37:05.757281] [INFO ] [MAIN ] Derivative Progress: 469/2037 symbols completed. CWAN took 1.2s. Estimated remaining: 10m 23s. Rate: 151.1 symbols/min [2025-10-06T22:37:05.758354] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:05.774202] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:05.775220] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 45176 primary records. [2025-10-06T22:37:05.775596] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-06T22:37:05.797581] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-10-06T22:37:05.806062] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-06T22:37:05.815262] [INFO ] [MAIN ] Derivative Progress: 470/2037 symbols completed. CWEN took 1.3s. Estimated remaining: 10m 21s. Rate: 151.4 symbols/min [2025-10-06T22:37:05.816086] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:05.815709] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:05.817887] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-10-06T22:37:05.817975] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-06T22:37:05.855102] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-10-06T22:37:05.855400] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-06T22:37:05.859974] [INFO ] [MAIN ] Derivative Progress: 471/2037 symbols completed. CVX took 1.3s. Estimated remaining: 10m 20s. Rate: 151.7 symbols/min [2025-10-06T22:37:05.860458] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:05.891431] [DEBUG] [LOCAL ] CWH: Loaded 51312 existing records from primary storage. [2025-10-06T22:37:05.891622] [INFO ] [MAIN ] CWH: Loaded 51312 primary data records. [2025-10-06T22:37:06.068513] [DEBUG] [LOCAL ] CWK: Loaded 49481 existing records from primary storage. [2025-10-06T22:37:06.101529] [INFO ] [MAIN ] CWK: Loaded 49481 primary data records. [2025-10-06T22:37:06.108506] [DEBUG] [LOCAL ] CWT: Loaded 27928 existing records from primary storage. [2025-10-06T22:37:06.222067] [INFO ] [MAIN ] CWT: Loaded 27928 primary data records. [2025-10-06T22:37:06.913735] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:06.914913] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51312 primary records. [2025-10-06T22:37:06.915336] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-06T22:37:06.936250] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-10-06T22:37:06.937070] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-06T22:37:06.940598] [INFO ] [MAIN ] Derivative Progress: 472/2037 symbols completed. CWH took 1.2s. Estimated remaining: 10m 21s. Rate: 151.1 symbols/min [2025-10-06T22:37:06.942057] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:06.959174] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:06.960340] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49481 primary records. [2025-10-06T22:37:06.960619] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-06T22:37:06.982401] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-10-06T22:37:06.982670] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-06T22:37:06.986442] [INFO ] [MAIN ] Derivative Progress: 473/2037 symbols completed. CWK took 1.2s. Estimated remaining: 10m 20s. Rate: 151.4 symbols/min [2025-10-06T22:37:06.986965] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:07.001630] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:07.002836] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 27928 primary records. [2025-10-06T22:37:07.003040] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-06T22:37:07.023524] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-10-06T22:37:07.023919] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-06T22:37:07.028200] [INFO ] [MAIN ] Derivative Progress: 474/2037 symbols completed. CWT took 1.2s. Estimated remaining: 10m 18s. Rate: 151.7 symbols/min [2025-10-06T22:37:07.032498] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:07.032796] [DEBUG] [LOCAL ] CXE: Loaded 6286 existing records from primary storage. [2025-10-06T22:37:07.050216] [INFO ] [MAIN ] CXE: Loaded 6286 primary data records. [2025-10-06T22:37:07.142897] [DEBUG] [LOCAL ] CXH: Loaded 4449 existing records from primary storage. [2025-10-06T22:37:07.156210] [INFO ] [MAIN ] CXH: Loaded 4449 primary data records. [2025-10-06T22:37:07.252831] [DEBUG] [LOCAL ] CX: Loaded 52807 existing records from primary storage. [2025-10-06T22:37:07.336134] [INFO ] [MAIN ] CX: Loaded 52807 primary data records. [2025-10-06T22:37:08.106311] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:08.109602] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 6286 primary records. [2025-10-06T22:37:08.110608] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-06T22:37:08.133564] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:08.139229] [INFO ] [MAIN ] CXH: Generated 1794 derivative records from 4449 primary records. [2025-10-06T22:37:08.141098] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-10-06T22:37:08.141426] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-06T22:37:08.143515] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-06T22:37:08.143432] [INFO ] [MAIN ] Derivative Progress: 475/2037 symbols completed. CXE took 1.2s. Estimated remaining: 10m 20s. Rate: 151.1 symbols/min [2025-10-06T22:37:08.143756] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:08.163449] [DEBUG] [LOCAL ] CXH: Derivative data saved (1794 records). [2025-10-06T22:37:08.163808] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-06T22:37:08.166601] [INFO ] [MAIN ] Derivative Progress: 476/2037 symbols completed. CXH took 1.1s. Estimated remaining: 10m 19s. Rate: 151.4 symbols/min [2025-10-06T22:37:08.167044] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:08.181675] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:08.182967] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52807 primary records. [2025-10-06T22:37:08.183110] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-06T22:37:08.202545] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-10-06T22:37:08.202812] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-06T22:37:08.207346] [INFO ] [MAIN ] Derivative Progress: 477/2037 symbols completed. CX took 1.3s. Estimated remaining: 10m 17s. Rate: 151.7 symbols/min [2025-10-06T22:37:08.208057] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:08.243563] [DEBUG] [LOCAL ] CXM: Loaded 47544 existing records from primary storage. [2025-10-06T22:37:08.243916] [INFO ] [MAIN ] CXM: Loaded 47544 primary data records. [2025-10-06T22:37:08.374333] [DEBUG] [LOCAL ] CXT: Loaded 30991 existing records from primary storage. [2025-10-06T22:37:08.385338] [INFO ] [MAIN ] CXT: Loaded 30991 primary data records. [2025-10-06T22:37:08.674177] [DEBUG] [LOCAL ] CXW: Loaded 43955 existing records from primary storage. [2025-10-06T22:37:08.700582] [INFO ] [MAIN ] CXW: Loaded 43955 primary data records. [2025-10-06T22:37:09.360948] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:09.362796] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47544 primary records. [2025-10-06T22:37:09.363369] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-06T22:37:09.382998] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-10-06T22:37:09.384427] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-06T22:37:09.387270] [INFO ] [MAIN ] Derivative Progress: 478/2037 symbols completed. CXM took 1.2s. Estimated remaining: 10m 19s. Rate: 151.1 symbols/min [2025-10-06T22:37:09.406895] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:09.408202] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 30991 primary records. [2025-10-06T22:37:09.412824] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-06T22:37:09.440452] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:09.444797] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 43955 primary records. [2025-10-06T22:37:09.445678] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-06T22:37:09.465629] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-10-06T22:37:09.467011] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-06T22:37:09.472245] [INFO ] [MAIN ] Derivative Progress: 479/2037 symbols completed. CXW took 1.3s. Estimated remaining: 10m 18s. Rate: 151.3 symbols/min [2025-10-06T22:37:09.467139] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-10-06T22:37:09.473098] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-06T22:37:09.476539] [INFO ] [MAIN ] Derivative Progress: 480/2037 symbols completed. CXT took 1.3s. Estimated remaining: 10m 16s. Rate: 151.6 symbols/min [2025-10-06T22:37:09.477490] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:09.477706] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:09.477574] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:09.524140] [DEBUG] [LOCAL ] CYD: Loaded 26399 existing records from primary storage. [2025-10-06T22:37:09.524383] [INFO ] [MAIN ] CYD: Loaded 26399 primary data records. [2025-10-06T22:37:09.674946] [DEBUG] [LOCAL ] CYH: Loaded 47591 existing records from primary storage. [2025-10-06T22:37:09.678593] [INFO ] [MAIN ] CYH: Loaded 47591 primary data records. [2025-10-06T22:37:10.034374] [DEBUG] [LOCAL ] D: Loaded 53645 existing records from primary storage. [2025-10-06T22:37:10.087723] [INFO ] [MAIN ] D: Loaded 53645 primary data records. [2025-10-06T22:37:10.565324] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:10.566980] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26399 primary records. [2025-10-06T22:37:10.567880] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-06T22:37:10.591104] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:10.596976] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47591 primary records. [2025-10-06T22:37:10.601337] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-06T22:37:10.603601] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-10-06T22:37:10.604545] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-06T22:37:10.614221] [INFO ] [MAIN ] Derivative Progress: 481/2037 symbols completed. CYD took 1.1s. Estimated remaining: 10m 18s. Rate: 151.0 symbols/min [2025-10-06T22:37:10.619736] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:10.626877] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-10-06T22:37:10.627429] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-06T22:37:10.630406] [INFO ] [MAIN ] Derivative Progress: 482/2037 symbols completed. CYH took 1.2s. Estimated remaining: 10m 17s. Rate: 151.3 symbols/min [2025-10-06T22:37:10.630952] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:10.660987] [DEBUG] [LOCAL ] DAC: Loaded 12528 existing records from primary storage. [2025-10-06T22:37:10.661298] [INFO ] [MAIN ] DAC: Loaded 12528 primary data records. [2025-10-06T22:37:10.660474] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:10.694298] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53645 primary records. [2025-10-06T22:37:10.706969] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-06T22:37:10.806777] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-10-06T22:37:10.817344] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-06T22:37:10.868991] [INFO ] [MAIN ] Derivative Progress: 483/2037 symbols completed. D took 1.4s. Estimated remaining: 10m 16s. Rate: 151.5 symbols/min [2025-10-06T22:37:10.888456] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:11.027461] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-06T22:37:11.028613] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-10-06T22:37:11.397120] [DEBUG] [LOCAL ] DAN: Loaded 49053 existing records from primary storage. [2025-10-06T22:37:11.401672] [INFO ] [MAIN ] DAN: Loaded 49053 primary data records. [2025-10-06T22:37:11.453440] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:11.483151] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12528 primary records. [2025-10-06T22:37:11.488803] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-06T22:37:11.582741] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-10-06T22:37:11.622078] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-06T22:37:11.787297] [INFO ] [MAIN ] Derivative Progress: 484/2037 symbols completed. DAC took 1.2s. Estimated remaining: 10m 17s. Rate: 151.0 symbols/min [2025-10-06T22:37:11.800369] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:11.825329] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:11.826358] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-10-06T22:37:11.826801] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-06T22:37:11.845858] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-10-06T22:37:11.846128] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-06T22:37:11.849833] [INFO ] [MAIN ] Derivative Progress: 485/2037 symbols completed. DAL took 1.2s. Estimated remaining: 10m 15s. Rate: 151.3 symbols/min [2025-10-06T22:37:11.850438] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:11.884214] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:11.885105] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 49053 primary records. [2025-10-06T22:37:11.885340] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-06T22:37:11.903169] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-10-06T22:37:11.903473] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-06T22:37:11.920317] [INFO ] [MAIN ] Derivative Progress: 486/2037 symbols completed. DAN took 1.0s. Estimated remaining: 10m 14s. Rate: 151.6 symbols/min [2025-10-06T22:37:11.920565] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:11.925803] [DEBUG] [LOCAL ] DAR: Loaded 51849 existing records from primary storage. [2025-10-06T22:37:11.926142] [INFO ] [MAIN ] DAR: Loaded 51849 primary data records. [2025-10-06T22:37:12.063083] [DEBUG] [LOCAL ] DAVA: Loaded 41193 existing records from primary storage. [2025-10-06T22:37:12.063424] [INFO ] [MAIN ] DAVA: Loaded 41193 primary data records. [2025-10-06T22:37:12.413195] [DEBUG] [LOCAL ] DAY: Loaded 49247 existing records from primary storage. [2025-10-06T22:37:12.436492] [INFO ] [MAIN ] DAY: Loaded 49247 primary data records. [2025-10-06T22:37:12.940504] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:12.955699] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51849 primary records. [2025-10-06T22:37:12.956773] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:12.957048] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-06T22:37:12.957833] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 41193 primary records. [2025-10-06T22:37:12.958092] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-06T22:37:13.013325] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-10-06T22:37:13.014036] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-06T22:37:13.018096] [INFO ] [MAIN ] Derivative Progress: 487/2037 symbols completed. DAR took 1.2s. Estimated remaining: 10m 16s. Rate: 151.0 symbols/min [2025-10-06T22:37:13.019046] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:13.019812] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:13.021362] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 49247 primary records. [2025-10-06T22:37:13.023148] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-06T22:37:13.037196] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-10-06T22:37:13.042181] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-06T22:37:13.047944] [INFO ] [MAIN ] Derivative Progress: 488/2037 symbols completed. DAVA took 1.2s. Estimated remaining: 10m 14s. Rate: 151.3 symbols/min [2025-10-06T22:37:13.048590] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-10-06T22:37:13.049071] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-06T22:37:13.052708] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:13.053025] [INFO ] [MAIN ] Derivative Progress: 489/2037 symbols completed. DAY took 1.1s. Estimated remaining: 10m 13s. Rate: 151.6 symbols/min [2025-10-06T22:37:13.053674] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:13.068106] [DEBUG] [LOCAL ] DBL: Loaded 9270 existing records from primary storage. [2025-10-06T22:37:13.068545] [INFO ] [MAIN ] DBL: Loaded 9270 primary data records. [2025-10-06T22:37:13.441729] [DEBUG] [LOCAL ] DBI: Loaded 44435 existing records from primary storage. [2025-10-06T22:37:13.443562] [INFO ] [MAIN ] DBI: Loaded 44435 primary data records. [2025-10-06T22:37:13.458470] [DEBUG] [LOCAL ] DB: Loaded 52532 existing records from primary storage. [2025-10-06T22:37:13.494861] [INFO ] [MAIN ] DB: Loaded 52532 primary data records. [2025-10-06T22:37:14.193172] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:14.196842] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9270 primary records. [2025-10-06T22:37:14.197372] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-06T22:37:14.218000] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-10-06T22:37:14.218263] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-06T22:37:14.222437] [INFO ] [MAIN ] Derivative Progress: 490/2037 symbols completed. DBL took 1.2s. Estimated remaining: 10m 15s. Rate: 151.0 symbols/min [2025-10-06T22:37:14.223738] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:14.239431] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:14.241250] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 44435 primary records. [2025-10-06T22:37:14.241362] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-06T22:37:14.262051] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:14.264271] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52532 primary records. [2025-10-06T22:37:14.267392] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-06T22:37:14.285609] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-10-06T22:37:14.286125] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-06T22:37:14.289088] [INFO ] [MAIN ] Derivative Progress: 491/2037 symbols completed. DBI took 1.2s. Estimated remaining: 10m 13s. Rate: 151.3 symbols/min [2025-10-06T22:37:14.289245] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:14.293875] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-10-06T22:37:14.294062] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-06T22:37:14.297457] [INFO ] [MAIN ] Derivative Progress: 492/2037 symbols completed. DB took 1.3s. Estimated remaining: 10m 12s. Rate: 151.6 symbols/min [2025-10-06T22:37:14.297833] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:14.325288] [DEBUG] [LOCAL ] DCO: Loaded 13883 existing records from primary storage. [2025-10-06T22:37:14.325435] [INFO ] [MAIN ] DCO: Loaded 13883 primary data records. [2025-10-06T22:37:14.456665] [DEBUG] [LOCAL ] DBRG: Loaded 49774 existing records from primary storage. [2025-10-06T22:37:14.459545] [INFO ] [MAIN ] DBRG: Loaded 49774 primary data records. [2025-10-06T22:37:14.832895] [DEBUG] [LOCAL ] DD: Loaded 52847 existing records from primary storage. [2025-10-06T22:37:14.849536] [INFO ] [MAIN ] DD: Loaded 52847 primary data records. [2025-10-06T22:37:15.381399] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:15.382775] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 13883 primary records. [2025-10-06T22:37:15.383137] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-06T22:37:15.420925] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:15.422690] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49774 primary records. [2025-10-06T22:37:15.423305] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-10-06T22:37:15.423484] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-06T22:37:15.423556] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-06T22:37:15.426379] [INFO ] [MAIN ] Derivative Progress: 493/2037 symbols completed. DCO took 1.1s. Estimated remaining: 10m 14s. Rate: 151.0 symbols/min [2025-10-06T22:37:15.447520] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-10-06T22:37:15.460489] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-06T22:37:15.464952] [INFO ] [MAIN ] Derivative Progress: 494/2037 symbols completed. DBRG took 1.2s. Estimated remaining: 10m 12s. Rate: 151.3 symbols/min [2025-10-06T22:37:15.460761] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:15.466133] [INFO ] [MAIN ] DD: Generated 1794 derivative records from 52847 primary records. [2025-10-06T22:37:15.466214] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-06T22:37:15.482769] [DEBUG] [LOCAL ] DD: Derivative data saved (1794 records). [2025-10-06T22:37:15.482839] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-06T22:37:15.485790] [INFO ] [MAIN ] Derivative Progress: 495/2037 symbols completed. DD took 1.2s. Estimated remaining: 10m 10s. Rate: 151.6 symbols/min [2025-10-06T22:37:15.486767] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:15.486489] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:15.486639] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:15.504010] [DEBUG] [LOCAL ] DDS: Loaded 12900 existing records from primary storage. [2025-10-06T22:37:15.504266] [INFO ] [MAIN ] DDS: Loaded 12900 primary data records. [2025-10-06T22:37:15.906718] [DEBUG] [LOCAL ] DDL: Loaded 36671 existing records from primary storage. [2025-10-06T22:37:15.907047] [INFO ] [MAIN ] DDL: Loaded 36671 primary data records. [2025-10-06T22:37:15.913595] [DEBUG] [LOCAL ] DDD: Loaded 50902 existing records from primary storage. [2025-10-06T22:37:15.934721] [INFO ] [MAIN ] DDD: Loaded 50902 primary data records. [2025-10-06T22:37:16.597214] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:37:16.598806] [INFO ] [MAIN ] DDS: Generated 1793 derivative records from 12900 primary records. [2025-10-06T22:37:16.598914] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-06T22:37:16.618521] [DEBUG] [LOCAL ] DDS: Derivative data saved (1793 records). [2025-10-06T22:37:16.619108] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-06T22:37:16.623138] [INFO ] [MAIN ] Derivative Progress: 496/2037 symbols completed. DDS took 1.1s. Estimated remaining: 10m 12s. Rate: 151.0 symbols/min [2025-10-06T22:37:16.623996] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:16.644820] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:16.646060] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36671 primary records. [2025-10-06T22:37:16.646520] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-06T22:37:16.650722] [DEBUG] [LOCAL ] DDT: Loaded 2087 existing records from primary storage. [2025-10-06T22:37:16.662804] [INFO ] [MAIN ] DDT: Loaded 2087 primary data records. [2025-10-06T22:37:16.759535] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-10-06T22:37:16.783741] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:16.795702] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50902 primary records. [2025-10-06T22:37:16.795910] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-06T22:37:16.796029] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-06T22:37:16.799502] [INFO ] [MAIN ] Derivative Progress: 497/2037 symbols completed. DDL took 1.3s. Estimated remaining: 10m 11s. Rate: 151.2 symbols/min [2025-10-06T22:37:16.800072] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:16.859201] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-10-06T22:37:16.859378] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-06T22:37:16.862633] [INFO ] [MAIN ] Derivative Progress: 498/2037 symbols completed. DDD took 1.4s. Estimated remaining: 10m 10s. Rate: 151.4 symbols/min [2025-10-06T22:37:16.881124] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:17.073982] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-06T22:37:17.075185] [INFO ] [MAIN ] DDT: Generated 1792 derivative records from 2087 primary records. [2025-10-06T22:37:17.075425] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-06T22:37:17.112525] [DEBUG] [LOCAL ] DE: Loaded 47559 existing records from primary storage. [2025-10-06T22:37:17.118693] [INFO ] [MAIN ] DE: Loaded 47559 primary data records. [2025-10-06T22:37:17.146125] [DEBUG] [LOCAL ] DDT: Derivative data saved (1792 records). [2025-10-06T22:37:17.162617] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-06T22:37:17.187971] [INFO ] [MAIN ] Derivative Progress: 499/2037 symbols completed. DDT took 0.6s. Estimated remaining: 10m 9s. Rate: 151.5 symbols/min [2025-10-06T22:37:17.230089] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:17.242427] [DEBUG] [LOCAL ] DECK: Loaded 53291 existing records from primary storage. [2025-10-06T22:37:17.259111] [INFO ] [MAIN ] DECK: Loaded 53291 primary data records. [2025-10-06T22:37:17.828083] [DEBUG] [LOCAL ] DEI: Loaded 48286 existing records from primary storage. [2025-10-06T22:37:17.828704] [INFO ] [MAIN ] DEI: Loaded 48286 primary data records. [2025-10-06T22:37:18.207969] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:18.209476] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47559 primary records. [2025-10-06T22:37:18.210887] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-06T22:37:18.251888] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-10-06T22:37:18.252901] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-06T22:37:18.252625] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:18.255685] [INFO ] [MAIN ] Derivative Progress: 500/2037 symbols completed. DE took 1.5s. Estimated remaining: 10m 11s. Rate: 151.0 symbols/min [2025-10-06T22:37:18.257163] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53291 primary records. [2025-10-06T22:37:18.257816] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-06T22:37:18.257334] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:18.281979] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-10-06T22:37:18.282195] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-06T22:37:18.285497] [INFO ] [MAIN ] Derivative Progress: 501/2037 symbols completed. DECK took 1.4s. Estimated remaining: 10m 9s. Rate: 151.2 symbols/min [2025-10-06T22:37:18.286092] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:18.303293] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:18.313471] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48286 primary records. [2025-10-06T22:37:18.313676] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-06T22:37:18.342206] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-10-06T22:37:18.350857] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-06T22:37:18.343011] [DEBUG] [LOCAL ] DFH: Loaded 32142 existing records from primary storage. [2025-10-06T22:37:18.354101] [INFO ] [MAIN ] Derivative Progress: 502/2037 symbols completed. DEI took 1.1s. Estimated remaining: 10m 8s. Rate: 151.5 symbols/min [2025-10-06T22:37:18.354489] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:18.354330] [INFO ] [MAIN ] DFH: Loaded 32142 primary data records. [2025-10-06T22:37:18.449393] [DEBUG] [LOCAL ] DFIN: Loaded 22914 existing records from primary storage. [2025-10-06T22:37:18.474217] [INFO ] [MAIN ] DFIN: Loaded 22914 primary data records. [2025-10-06T22:37:18.544307] [DEBUG] [LOCAL ] DFP: Loaded 11297 existing records from primary storage. [2025-10-06T22:37:18.584860] [INFO ] [MAIN ] DFP: Loaded 11297 primary data records. [2025-10-06T22:37:19.335763] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:19.349821] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 32142 primary records. [2025-10-06T22:37:19.351534] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-06T22:37:19.351947] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:19.352953] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 22914 primary records. [2025-10-06T22:37:19.353090] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-06T22:37:19.394149] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:19.395526] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11297 primary records. [2025-10-06T22:37:19.396563] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-10-06T22:37:19.397185] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-06T22:37:19.397485] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-06T22:37:19.400090] [INFO ] [MAIN ] Derivative Progress: 503/2037 symbols completed. DFH took 1.1s. Estimated remaining: 10m 10s. Rate: 151.0 symbols/min [2025-10-06T22:37:19.400838] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:19.403794] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-10-06T22:37:19.404503] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-06T22:37:19.407473] [INFO ] [MAIN ] Derivative Progress: 504/2037 symbols completed. DFIN took 1.1s. Estimated remaining: 10m 8s. Rate: 151.3 symbols/min [2025-10-06T22:37:19.415445] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:19.426270] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-10-06T22:37:19.426509] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-06T22:37:19.430352] [INFO ] [MAIN ] Derivative Progress: 505/2037 symbols completed. DFP took 1.1s. Estimated remaining: 10m 6s. Rate: 151.6 symbols/min [2025-10-06T22:37:19.430749] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:19.520183] [DEBUG] [LOCAL ] DHF: Loaded 21258 existing records from primary storage. [2025-10-06T22:37:19.520371] [INFO ] [MAIN ] DHF: Loaded 21258 primary data records. [2025-10-06T22:37:19.729910] [DEBUG] [LOCAL ] DG: Loaded 53279 existing records from primary storage. [2025-10-06T22:37:19.752017] [INFO ] [MAIN ] DG: Loaded 53279 primary data records. [2025-10-06T22:37:19.942138] [DEBUG] [LOCAL ] DGX: Loaded 44815 existing records from primary storage. [2025-10-06T22:37:19.982095] [INFO ] [MAIN ] DGX: Loaded 44815 primary data records. [2025-10-06T22:37:20.689366] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:20.691317] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 21258 primary records. [2025-10-06T22:37:20.692030] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-06T22:37:20.713555] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-10-06T22:37:20.713930] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-06T22:37:20.717035] [INFO ] [MAIN ] Derivative Progress: 506/2037 symbols completed. DHF took 1.3s. Estimated remaining: 10m 9s. Rate: 150.9 symbols/min [2025-10-06T22:37:20.723745] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:20.743743] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:20.746107] [INFO ] [MAIN ] DG: Generated 1794 derivative records from 53279 primary records. [2025-10-06T22:37:20.748473] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-06T22:37:20.776461] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:20.779303] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 44815 primary records. [2025-10-06T22:37:20.779757] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-06T22:37:20.800318] [DEBUG] [LOCAL ] DG: Derivative data saved (1794 records). [2025-10-06T22:37:20.801169] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-06T22:37:20.801009] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-10-06T22:37:20.804179] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-06T22:37:20.803991] [INFO ] [MAIN ] Derivative Progress: 507/2037 symbols completed. DG took 1.4s. Estimated remaining: 10m 7s. Rate: 151.1 symbols/min [2025-10-06T22:37:20.804455] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:20.809000] [INFO ] [MAIN ] Derivative Progress: 508/2037 symbols completed. DGX took 1.4s. Estimated remaining: 10m 6s. Rate: 151.4 symbols/min [2025-10-06T22:37:20.857196] [DEBUG] [LOCAL ] DHI: Loaded 53341 existing records from primary storage. [2025-10-06T22:37:20.857465] [INFO ] [MAIN ] DHI: Loaded 53341 primary data records. [2025-10-06T22:37:21.184289] [DEBUG] [LOCAL ] DHR: Loaded 53376 existing records from primary storage. [2025-10-06T22:37:21.185224] [INFO ] [MAIN ] DHR: Loaded 53376 primary data records. [2025-10-06T22:37:21.510552] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:21.512099] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53341 primary records. [2025-10-06T22:37:21.512327] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-06T22:37:21.531450] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-10-06T22:37:21.531522] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-06T22:37:21.533587] [INFO ] [MAIN ] Derivative Progress: 509/2037 symbols completed. DHI took 0.8s. Estimated remaining: 10m 6s. Rate: 151.2 symbols/min [2025-10-06T22:37:21.550511] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:21.551238] [INFO ] [MAIN ] DHR: Generated 1794 derivative records from 53376 primary records. [2025-10-06T22:37:21.551302] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-06T22:37:21.567474] [DEBUG] [LOCAL ] DHR: Derivative data saved (1794 records). [2025-10-06T22:37:21.567546] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-06T22:37:21.570169] [INFO ] [MAIN ] Derivative Progress: 510/2037 symbols completed. DHR took 0.8s. Estimated remaining: 10m 5s. Rate: 151.5 symbols/min [2025-10-06T22:37:21.570788] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:21.570939] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:21.571103] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:21.596052] [DEBUG] [LOCAL ] DHX: Loaded 12976 existing records from primary storage. [2025-10-06T22:37:21.596461] [INFO ] [MAIN ] DHX: Loaded 12976 primary data records. [2025-10-06T22:37:21.685148] [DEBUG] [LOCAL ] DIAX: Loaded 13131 existing records from primary storage. [2025-10-06T22:37:21.737160] [INFO ] [MAIN ] DIAX: Loaded 13131 primary data records. [2025-10-06T22:37:22.110141] [DEBUG] [LOCAL ] DHT: Loaded 47877 existing records from primary storage. [2025-10-06T22:37:22.117280] [INFO ] [MAIN ] DHT: Loaded 47877 primary data records. [2025-10-06T22:37:22.768304] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:22.769625] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 12976 primary records. [2025-10-06T22:37:22.769765] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-06T22:37:22.793574] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-10-06T22:37:22.801969] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-06T22:37:22.809431] [INFO ] [MAIN ] Derivative Progress: 511/2037 symbols completed. DHX took 1.2s. Estimated remaining: 10m 7s. Rate: 150.8 symbols/min [2025-10-06T22:37:22.810362] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:22.810904] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:22.812529] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 13131 primary records. [2025-10-06T22:37:22.813679] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-06T22:37:22.853317] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-10-06T22:37:22.853626] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-06T22:37:22.854050] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:22.857579] [INFO ] [MAIN ] Derivative Progress: 512/2037 symbols completed. DIAX took 1.3s. Estimated remaining: 10m 6s. Rate: 151.1 symbols/min [2025-10-06T22:37:22.857925] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:22.859634] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 47877 primary records. [2025-10-06T22:37:22.859805] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-06T22:37:22.896607] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-10-06T22:37:22.896997] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-06T22:37:22.904066] [INFO ] [MAIN ] Derivative Progress: 513/2037 symbols completed. DHT took 1.3s. Estimated remaining: 10m 4s. Rate: 151.3 symbols/min [2025-10-06T22:37:22.905436] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:22.919947] [DEBUG] [LOCAL ] DIN: Loaded 37218 existing records from primary storage. [2025-10-06T22:37:22.920535] [INFO ] [MAIN ] DIN: Loaded 37218 primary data records. [2025-10-06T22:37:23.307678] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-06T22:37:23.308926] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-10-06T22:37:23.576271] [DEBUG] [LOCAL ] DK: Loaded 49324 existing records from primary storage. [2025-10-06T22:37:23.716713] [INFO ] [MAIN ] DK: Loaded 49324 primary data records. [2025-10-06T22:37:23.922290] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:23.954825] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37218 primary records. [2025-10-06T22:37:23.972957] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-06T22:37:24.111883] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-10-06T22:37:24.114443] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-06T22:37:24.118013] [INFO ] [MAIN ] Derivative Progress: 514/2037 symbols completed. DIN took 1.3s. Estimated remaining: 10m 6s. Rate: 150.7 symbols/min [2025-10-06T22:37:24.118969] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:24.135365] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:24.136996] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-10-06T22:37:24.137334] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-06T22:37:24.161679] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-10-06T22:37:24.162081] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-06T22:37:24.166299] [INFO ] [MAIN ] Derivative Progress: 515/2037 symbols completed. DIS took 1.3s. Estimated remaining: 10m 5s. Rate: 151.0 symbols/min [2025-10-06T22:37:24.166790] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:24.181698] [DEBUG] [LOCAL ] DKL: Loaded 18266 existing records from primary storage. [2025-10-06T22:37:24.182020] [INFO ] [MAIN ] DKL: Loaded 18266 primary data records. [2025-10-06T22:37:24.217757] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:24.245537] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49324 primary records. [2025-10-06T22:37:24.273277] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-06T22:37:24.250966] [DEBUG] [LOCAL ] DLNG: Loaded 6088 existing records from primary storage. [2025-10-06T22:37:24.298780] [INFO ] [MAIN ] DLNG: Loaded 6088 primary data records. [2025-10-06T22:37:24.695116] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-10-06T22:37:24.733147] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-06T22:37:24.737407] [INFO ] [MAIN ] Derivative Progress: 516/2037 symbols completed. DK took 1.8s. Estimated remaining: 10m 5s. Rate: 150.9 symbols/min [2025-10-06T22:37:24.755240] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:25.007696] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:25.008995] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 18266 primary records. [2025-10-06T22:37:25.009348] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-06T22:37:25.053764] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-10-06T22:37:25.068559] [DEBUG] [LOCAL ] DLR: Loaded 50908 existing records from primary storage. [2025-10-06T22:37:25.068810] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-06T22:37:25.069477] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-06T22:37:25.070412] [INFO ] [MAIN ] DLNG: Generated 1792 derivative records from 6088 primary records. [2025-10-06T22:37:25.069575] [INFO ] [MAIN ] DLR: Loaded 50908 primary data records. [2025-10-06T22:37:25.074112] [INFO ] [MAIN ] Derivative Progress: 517/2037 symbols completed. DKL took 1.0s. Estimated remaining: 10m 4s. Rate: 150.9 symbols/min [2025-10-06T22:37:25.074456] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-06T22:37:25.108082] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:25.200087] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1792 records). [2025-10-06T22:37:25.200715] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-06T22:37:25.209518] [INFO ] [MAIN ] Derivative Progress: 518/2037 symbols completed. DLNG took 1.0s. Estimated remaining: 10m 3s. Rate: 151.1 symbols/min [2025-10-06T22:37:25.225379] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:25.455764] [DEBUG] [LOCAL ] DLX: Loaded 28542 existing records from primary storage. [2025-10-06T22:37:25.456522] [INFO ] [MAIN ] DLX: Loaded 28542 primary data records. [2025-10-06T22:37:25.595560] [DEBUG] [LOCAL ] DLY: Loaded 20190 existing records from primary storage. [2025-10-06T22:37:25.597137] [INFO ] [MAIN ] DLY: Loaded 20190 primary data records. [2025-10-06T22:37:26.040333] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:26.163531] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 50908 primary records. [2025-10-06T22:37:26.164565] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-06T22:37:26.187920] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-10-06T22:37:26.188917] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-06T22:37:26.192631] [INFO ] [MAIN ] Derivative Progress: 519/2037 symbols completed. DLR took 1.4s. Estimated remaining: 10m 4s. Rate: 150.7 symbols/min [2025-10-06T22:37:26.193079] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:26.206847] [DEBUG] [LOCAL ] DMA: Loaded 4554 existing records from primary storage. [2025-10-06T22:37:26.215677] [INFO ] [MAIN ] DMA: Loaded 4554 primary data records. [2025-10-06T22:37:26.257841] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:26.310715] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28542 primary records. [2025-10-06T22:37:26.326066] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-06T22:37:26.423333] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-10-06T22:37:26.423576] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-06T22:37:26.412121] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:26.426762] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 20190 primary records. [2025-10-06T22:37:26.429752] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-06T22:37:26.449178] [INFO ] [MAIN ] Derivative Progress: 520/2037 symbols completed. DLX took 1.3s. Estimated remaining: 10m 4s. Rate: 150.8 symbols/min [2025-10-06T22:37:26.454857] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:26.595547] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-10-06T22:37:26.595709] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-06T22:37:26.599507] [INFO ] [MAIN ] Derivative Progress: 521/2037 symbols completed. DLY took 1.4s. Estimated remaining: 10m 3s. Rate: 151.0 symbols/min [2025-10-06T22:37:26.601602] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:26.646201] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:26.647364] [INFO ] [MAIN ] DMA: Generated 1794 derivative records from 4554 primary records. [2025-10-06T22:37:26.647519] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-06T22:37:26.673099] [DEBUG] [LOCAL ] DMA: Derivative data saved (1794 records). [2025-10-06T22:37:26.673282] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-06T22:37:26.676947] [INFO ] [MAIN ] Derivative Progress: 522/2037 symbols completed. DMA took 0.5s. Estimated remaining: 10m 1s. Rate: 151.2 symbols/min [2025-10-06T22:37:26.692063] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:26.694764] [DEBUG] [LOCAL ] DNA: Loaded 48384 existing records from primary storage. [2025-10-06T22:37:26.708024] [INFO ] [MAIN ] DNA: Loaded 48384 primary data records. [2025-10-06T22:37:26.714447] [DEBUG] [LOCAL ] DNOW: Loaded 43717 existing records from primary storage. [2025-10-06T22:37:26.748995] [INFO ] [MAIN ] DNOW: Loaded 43717 primary data records. [2025-10-06T22:37:27.132453] [DEBUG] [LOCAL ] DNP: Loaded 33242 existing records from primary storage. [2025-10-06T22:37:27.274249] [INFO ] [MAIN ] DNP: Loaded 33242 primary data records. [2025-10-06T22:37:27.815632] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:27.819163] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48384 primary records. [2025-10-06T22:37:27.820846] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-06T22:37:27.852876] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:27.855926] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43717 primary records. [2025-10-06T22:37:27.858153] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-06T22:37:27.860880] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-10-06T22:37:27.861723] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-06T22:37:27.872337] [INFO ] [MAIN ] Derivative Progress: 523/2037 symbols completed. DNA took 1.4s. Estimated remaining: 10m 3s. Rate: 150.6 symbols/min [2025-10-06T22:37:27.884917] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-10-06T22:37:27.885257] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-06T22:37:27.888518] [INFO ] [MAIN ] Derivative Progress: 524/2037 symbols completed. DNOW took 1.3s. Estimated remaining: 10m 2s. Rate: 150.9 symbols/min [2025-10-06T22:37:27.904891] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:27.905517] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33242 primary records. [2025-10-06T22:37:27.905578] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-06T22:37:27.921790] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-10-06T22:37:27.921856] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-06T22:37:27.927857] [INFO ] [MAIN ] Derivative Progress: 525/2037 symbols completed. DNP took 1.2s. Estimated remaining: 10m 0s. Rate: 151.1 symbols/min [2025-10-06T22:37:27.928969] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:27.928746] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:27.928871] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:28.033040] [DEBUG] [LOCAL ] DOCS: Loaded 51060 existing records from primary storage. [2025-10-06T22:37:28.034616] [INFO ] [MAIN ] DOCS: Loaded 51060 primary data records. [2025-10-06T22:37:28.035543] [DEBUG] [LOCAL ] DOCN: Loaded 50703 existing records from primary storage. [2025-10-06T22:37:28.070432] [INFO ] [MAIN ] DOCN: Loaded 50703 primary data records. [2025-10-06T22:37:28.280000] [DEBUG] [LOCAL ] DOC: Loaded 53551 existing records from primary storage. [2025-10-06T22:37:28.333267] [INFO ] [MAIN ] DOC: Loaded 53551 primary data records. [2025-10-06T22:37:29.143777] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:29.145972] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 51060 primary records. [2025-10-06T22:37:29.159588] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:29.161225] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-06T22:37:29.162339] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50703 primary records. [2025-10-06T22:37:29.163368] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-06T22:37:29.194962] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-10-06T22:37:29.196810] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-06T22:37:29.202468] [INFO ] [MAIN ] Derivative Progress: 526/2037 symbols completed. DOCS took 1.3s. Estimated remaining: 10m 2s. Rate: 150.5 symbols/min [2025-10-06T22:37:29.203881] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:29.207898] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-10-06T22:37:29.209617] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-06T22:37:29.213133] [INFO ] [MAIN ] Derivative Progress: 527/2037 symbols completed. DOCN took 1.3s. Estimated remaining: 10m 1s. Rate: 150.8 symbols/min [2025-10-06T22:37:29.213533] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:29.230479] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:29.231518] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53551 primary records. [2025-10-06T22:37:29.231742] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-06T22:37:29.261972] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-10-06T22:37:29.264206] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-06T22:37:29.267810] [INFO ] [MAIN ] Derivative Progress: 528/2037 symbols completed. DOC took 1.3s. Estimated remaining: 9m 59s. Rate: 151.0 symbols/min [2025-10-06T22:37:29.268220] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:29.304758] [DEBUG] [LOCAL ] DOUG: Loaded 34381 existing records from primary storage. [2025-10-06T22:37:29.305879] [DEBUG] [LOCAL ] DOLE: Loaded 38603 existing records from primary storage. [2025-10-06T22:37:29.306126] [INFO ] [MAIN ] DOLE: Loaded 38603 primary data records. [2025-10-06T22:37:29.306423] [INFO ] [MAIN ] DOUG: Loaded 34381 primary data records. [2025-10-06T22:37:29.977427] [DEBUG] [LOCAL ] DOV: Loaded 45461 existing records from primary storage. [2025-10-06T22:37:29.978173] [INFO ] [MAIN ] DOV: Loaded 45461 primary data records. [2025-10-06T22:37:30.325006] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:30.329408] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 38603 primary records. [2025-10-06T22:37:30.332044] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-06T22:37:30.365374] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:30.369270] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34381 primary records. [2025-10-06T22:37:30.370317] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-06T22:37:30.389720] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-10-06T22:37:30.392586] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-10-06T22:37:30.394616] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-06T22:37:30.396055] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-06T22:37:30.400014] [INFO ] [MAIN ] Derivative Progress: 529/2037 symbols completed. DOUG took 1.2s. Estimated remaining: 10m 1s. Rate: 150.5 symbols/min [2025-10-06T22:37:30.403923] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:30.404255] [INFO ] [MAIN ] Derivative Progress: 530/2037 symbols completed. DOLE took 1.2s. Estimated remaining: 9m 60s. Rate: 150.8 symbols/min [2025-10-06T22:37:30.405186] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:30.420980] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:30.422473] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45461 primary records. [2025-10-06T22:37:30.428207] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-06T22:37:30.455795] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-10-06T22:37:30.455264] [DEBUG] [LOCAL ] DPG: Loaded 13375 existing records from primary storage. [2025-10-06T22:37:30.456096] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-06T22:37:30.459621] [INFO ] [MAIN ] Derivative Progress: 531/2037 symbols completed. DOV took 1.2s. Estimated remaining: 9m 58s. Rate: 151.0 symbols/min [2025-10-06T22:37:30.460067] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:30.460992] [INFO ] [MAIN ] DPG: Loaded 13375 primary data records. [2025-10-06T22:37:30.840044] [DEBUG] [LOCAL ] DQ: Loaded 43466 existing records from primary storage. [2025-10-06T22:37:30.838296] [DEBUG] [LOCAL ] DRD: Loaded 37053 existing records from primary storage. [2025-10-06T22:37:30.841132] [INFO ] [MAIN ] DRD: Loaded 37053 primary data records. [2025-10-06T22:37:30.841243] [INFO ] [MAIN ] DQ: Loaded 43466 primary data records. [2025-10-06T22:37:31.599703] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:31.602534] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13375 primary records. [2025-10-06T22:37:31.603330] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-06T22:37:31.630567] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-10-06T22:37:31.631009] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-06T22:37:31.633639] [INFO ] [MAIN ] Derivative Progress: 532/2037 symbols completed. DPG took 1.2s. Estimated remaining: 10m 0s. Rate: 150.5 symbols/min [2025-10-06T22:37:31.634233] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:31.655053] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:31.670358] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 37053 primary records. [2025-10-06T22:37:31.671128] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-06T22:37:31.671028] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:31.672293] [INFO ] [MAIN ] DQ: Generated 1794 derivative records from 43466 primary records. [2025-10-06T22:37:31.672475] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-06T22:37:31.707268] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-10-06T22:37:31.708021] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-06T22:37:31.711142] [INFO ] [MAIN ] Derivative Progress: 533/2037 symbols completed. DRD took 1.3s. Estimated remaining: 9m 59s. Rate: 150.7 symbols/min [2025-10-06T22:37:31.711466] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:31.727534] [DEBUG] [LOCAL ] DQ: Derivative data saved (1794 records). [2025-10-06T22:37:31.727884] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-06T22:37:31.732617] [INFO ] [MAIN ] Derivative Progress: 534/2037 symbols completed. DQ took 1.3s. Estimated remaining: 9m 57s. Rate: 151.0 symbols/min [2025-10-06T22:37:31.733026] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:31.755020] [DEBUG] [LOCAL ] DRH: Loaded 50446 existing records from primary storage. [2025-10-06T22:37:31.759998] [INFO ] [MAIN ] DRH: Loaded 50446 primary data records. [2025-10-06T22:37:31.884715] [DEBUG] [LOCAL ] DSM: Loaded 14715 existing records from primary storage. [2025-10-06T22:37:31.906688] [INFO ] [MAIN ] DSM: Loaded 14715 primary data records. [2025-10-06T22:37:31.951357] [DEBUG] [LOCAL ] DRI: Loaded 47748 existing records from primary storage. [2025-10-06T22:37:32.105933] [INFO ] [MAIN ] DRI: Loaded 47748 primary data records. [2025-10-06T22:37:32.804746] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:32.806762] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50446 primary records. [2025-10-06T22:37:32.807035] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-06T22:37:32.842380] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:32.843807] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 14715 primary records. [2025-10-06T22:37:32.843055] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-10-06T22:37:32.843947] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-06T22:37:32.844870] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-06T22:37:32.847192] [INFO ] [MAIN ] Derivative Progress: 535/2037 symbols completed. DRH took 1.2s. Estimated remaining: 9m 59s. Rate: 150.5 symbols/min [2025-10-06T22:37:32.854677] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:32.865293] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-10-06T22:37:32.865443] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-06T22:37:32.867840] [INFO ] [MAIN ] Derivative Progress: 536/2037 symbols completed. DSM took 1.1s. Estimated remaining: 9m 57s. Rate: 150.7 symbols/min [2025-10-06T22:37:32.875910] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:32.881410] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:32.882692] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47748 primary records. [2025-10-06T22:37:32.882888] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-06T22:37:32.902113] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-10-06T22:37:32.909005] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-06T22:37:32.912116] [INFO ] [MAIN ] Derivative Progress: 537/2037 symbols completed. DRI took 1.2s. Estimated remaining: 9m 56s. Rate: 151.0 symbols/min [2025-10-06T22:37:32.912367] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:32.928737] [DEBUG] [LOCAL ] DSU: Loaded 22739 existing records from primary storage. [2025-10-06T22:37:32.928973] [INFO ] [MAIN ] DSU: Loaded 22739 primary data records. [2025-10-06T22:37:33.022871] [DEBUG] [LOCAL ] DSX: Loaded 24112 existing records from primary storage. [2025-10-06T22:37:33.040178] [INFO ] [MAIN ] DSX: Loaded 24112 primary data records. [2025-10-06T22:37:33.500148] [DEBUG] [LOCAL ] DT: Loaded 52945 existing records from primary storage. [2025-10-06T22:37:33.500975] [INFO ] [MAIN ] DT: Loaded 52945 primary data records. [2025-10-06T22:37:33.939706] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:33.941305] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 22739 primary records. [2025-10-06T22:37:33.942888] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-06T22:37:33.969154] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:33.970394] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 24112 primary records. [2025-10-06T22:37:33.970829] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-06T22:37:33.989107] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-10-06T22:37:33.990175] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-10-06T22:37:33.990269] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-06T22:37:33.992591] [INFO ] [MAIN ] Derivative Progress: 538/2037 symbols completed. DSX took 1.1s. Estimated remaining: 9m 58s. Rate: 150.5 symbols/min [2025-10-06T22:37:33.992827] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-06T22:37:33.997097] [INFO ] [MAIN ] Derivative Progress: 539/2037 symbols completed. DSU took 1.1s. Estimated remaining: 9m 56s. Rate: 150.8 symbols/min [2025-10-06T22:37:34.010823] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:34.011384] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52945 primary records. [2025-10-06T22:37:34.011442] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-06T22:37:34.027833] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-10-06T22:37:34.027893] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-06T22:37:34.030597] [INFO ] [MAIN ] Derivative Progress: 540/2037 symbols completed. DT took 1.1s. Estimated remaining: 9m 55s. Rate: 151.0 symbols/min [2025-10-06T22:37:34.031632] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:34.031838] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:34.031721] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:34.041323] [DEBUG] [LOCAL ] DTB: Loaded 4928 existing records from primary storage. [2025-10-06T22:37:34.041745] [INFO ] [MAIN ] DTB: Loaded 4928 primary data records. [2025-10-06T22:37:34.090114] [DEBUG] [LOCAL ] DTG: Loaded 5777 existing records from primary storage. [2025-10-06T22:37:34.128939] [INFO ] [MAIN ] DTG: Loaded 5777 primary data records. [2025-10-06T22:37:34.699549] [DEBUG] [LOCAL ] DTE: Loaded 47627 existing records from primary storage. [2025-10-06T22:37:34.700592] [INFO ] [MAIN ] DTE: Loaded 47627 primary data records. [2025-10-06T22:37:35.050568] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:35.051904] [INFO ] [MAIN ] DTB: Generated 1794 derivative records from 4928 primary records. [2025-10-06T22:37:35.053195] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-06T22:37:35.085762] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:35.088314] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5777 primary records. [2025-10-06T22:37:35.088455] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-06T22:37:35.103388] [DEBUG] [LOCAL ] DTB: Derivative data saved (1794 records). [2025-10-06T22:37:35.103923] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-10-06T22:37:35.107936] [INFO ] [MAIN ] Derivative Progress: 541/2037 symbols completed. DTB took 1.1s. Estimated remaining: 9m 56s. Rate: 150.6 symbols/min [2025-10-06T22:37:35.109072] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:35.115803] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-10-06T22:37:35.116037] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-06T22:37:35.119741] [INFO ] [MAIN ] Derivative Progress: 542/2037 symbols completed. DTG took 1.1s. Estimated remaining: 9m 55s. Rate: 150.8 symbols/min [2025-10-06T22:37:35.120264] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:35.133751] [DEBUG] [LOCAL ] DUKB: Loaded 6368 existing records from primary storage. [2025-10-06T22:37:35.134050] [INFO ] [MAIN ] DUKB: Loaded 6368 primary data records. [2025-10-06T22:37:35.180715] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:35.215925] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 47627 primary records. [2025-10-06T22:37:35.233777] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-06T22:37:35.376241] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-10-06T22:37:35.495988] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-06T22:37:35.587552] [INFO ] [MAIN ] Derivative Progress: 543/2037 symbols completed. DTE took 1.6s. Estimated remaining: 9m 54s. Rate: 150.8 symbols/min [2025-10-06T22:37:35.589468] [DEBUG] [LOCAL ] DUK: Loaded 53450 existing records from primary storage. [2025-10-06T22:37:35.588022] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:35.590050] [INFO ] [MAIN ] DUK: Loaded 53450 primary data records. [2025-10-06T22:37:35.966530] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:35.968504] [INFO ] [MAIN ] DUKB: Generated 1794 derivative records from 6368 primary records. [2025-10-06T22:37:35.969049] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-06T22:37:35.996798] [DEBUG] [LOCAL ] DV: Loaded 51300 existing records from primary storage. [2025-10-06T22:37:36.010709] [INFO ] [MAIN ] DV: Loaded 51300 primary data records. [2025-10-06T22:37:36.141471] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1794 records). [2025-10-06T22:37:36.149183] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-06T22:37:36.192079] [INFO ] [MAIN ] Derivative Progress: 544/2037 symbols completed. DUKB took 1.1s. Estimated remaining: 9m 55s. Rate: 150.6 symbols/min [2025-10-06T22:37:36.239472] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:36.239124] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:36.241892] [INFO ] [MAIN ] DUK: Generated 1794 derivative records from 53450 primary records. [2025-10-06T22:37:36.242110] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-06T22:37:36.509886] [DEBUG] [LOCAL ] DUK: Derivative data saved (1794 records). [2025-10-06T22:37:36.510368] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-06T22:37:36.513794] [INFO ] [MAIN ] Derivative Progress: 545/2037 symbols completed. DUK took 1.4s. Estimated remaining: 9m 54s. Rate: 150.7 symbols/min [2025-10-06T22:37:36.526370] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:36.555702] [DEBUG] [LOCAL ] DVA: Loaded 41094 existing records from primary storage. [2025-10-06T22:37:36.555925] [INFO ] [MAIN ] DVA: Loaded 41094 primary data records. [2025-10-06T22:37:36.689728] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:36.695503] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51300 primary records. [2025-10-06T22:37:36.721144] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-06T22:37:36.974011] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-06T22:37:36.972277] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-10-06T22:37:36.975218] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-06T22:37:36.975370] [INFO ] [MAIN ] DVN: Loaded 53699 primary data records. [2025-10-06T22:37:36.980436] [INFO ] [MAIN ] Derivative Progress: 546/2037 symbols completed. DV took 1.4s. Estimated remaining: 9m 54s. Rate: 150.7 symbols/min [2025-10-06T22:37:37.018844] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:37.312631] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:37.314144] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 41094 primary records. [2025-10-06T22:37:37.314498] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-06T22:37:37.349530] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-10-06T22:37:37.364059] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-06T22:37:37.366953] [INFO ] [MAIN ] Derivative Progress: 547/2037 symbols completed. DVA took 1.1s. Estimated remaining: 9m 53s. Rate: 150.7 symbols/min [2025-10-06T22:37:37.368874] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:37.368584] [DEBUG] [LOCAL ] DX: Loaded 52483 existing records from primary storage. [2025-10-06T22:37:37.369194] [INFO ] [MAIN ] DX: Loaded 52483 primary data records. [2025-10-06T22:37:37.508255] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:37.519705] [INFO ] [MAIN ] DVN: Generated 1794 derivative records from 53699 primary records. [2025-10-06T22:37:37.550821] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-10-06T22:37:37.760759] [DEBUG] [LOCAL ] DVN: Derivative data saved (1794 records). [2025-10-06T22:37:37.761788] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-10-06T22:37:37.766047] [INFO ] [MAIN ] Derivative Progress: 548/2037 symbols completed. DVN took 1.2s. Estimated remaining: 9m 53s. Rate: 150.7 symbols/min [2025-10-06T22:37:37.766554] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:37.787926] [DEBUG] [LOCAL ] DXC: Loaded 49859 existing records from primary storage. [2025-10-06T22:37:37.788669] [INFO ] [MAIN ] DXC: Loaded 49859 primary data records. [2025-10-06T22:37:38.142952] [DEBUG] [LOCAL ] DXYZ: Loaded 36973 existing records from primary storage. [2025-10-06T22:37:38.157076] [INFO ] [MAIN ] DXYZ: Loaded 36973 primary data records. [2025-10-06T22:37:38.157446] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:38.158300] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52483 primary records. [2025-10-06T22:37:38.159091] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-06T22:37:38.474749] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-10-06T22:37:38.484274] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-10-06T22:37:38.487293] [INFO ] [MAIN ] Derivative Progress: 549/2037 symbols completed. DX took 1.5s. Estimated remaining: 9m 53s. Rate: 150.4 symbols/min [2025-10-06T22:37:38.487546] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:38.511392] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:38.512824] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49859 primary records. [2025-10-06T22:37:38.513585] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-06T22:37:38.534340] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-10-06T22:37:38.534502] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-06T22:37:38.549691] [INFO ] [MAIN ] Derivative Progress: 550/2037 symbols completed. DXC took 1.2s. Estimated remaining: 9m 52s. Rate: 150.7 symbols/min [2025-10-06T22:37:38.550351] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:38.572411] [DEBUG] [LOCAL ] EAI: Loaded 3998 existing records from primary storage. [2025-10-06T22:37:38.573407] [DEBUG] [LOCAL ] EAF: Loaded 42328 existing records from primary storage. [2025-10-06T22:37:38.574269] [INFO ] [MAIN ] EAI: Loaded 3998 primary data records. [2025-10-06T22:37:38.585858] [INFO ] [MAIN ] EAF: Loaded 42328 primary data records. [2025-10-06T22:37:38.747368] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:38.786431] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 36973 primary records. [2025-10-06T22:37:38.789526] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-06T22:37:39.195957] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-10-06T22:37:39.196442] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-06T22:37:39.200234] [INFO ] [MAIN ] Derivative Progress: 551/2037 symbols completed. DXYZ took 1.4s. Estimated remaining: 9m 52s. Rate: 150.5 symbols/min [2025-10-06T22:37:39.201160] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:39.227886] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:39.229494] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 42328 primary records. [2025-10-06T22:37:39.231111] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-06T22:37:39.255608] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:39.256776] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 3998 primary records. [2025-10-06T22:37:39.257861] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-06T22:37:39.286054] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-10-06T22:37:39.287036] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-10-06T22:37:39.289512] [INFO ] [MAIN ] Derivative Progress: 552/2037 symbols completed. EAI took 0.7s. Estimated remaining: 9m 51s. Rate: 150.7 symbols/min [2025-10-06T22:37:39.286931] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-10-06T22:37:39.289984] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:39.289856] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-06T22:37:39.306497] [INFO ] [MAIN ] Derivative Progress: 553/2037 symbols completed. EAF took 0.8s. Estimated remaining: 9m 50s. Rate: 151.0 symbols/min [2025-10-06T22:37:39.308463] [DEBUG] [LOCAL ] EAT: Loaded 49806 existing records from primary storage. [2025-10-06T22:37:39.308622] [INFO ] [MAIN ] EAT: Loaded 49806 primary data records. [2025-10-06T22:37:39.657116] [DEBUG] [LOCAL ] EB: Loaded 36985 existing records from primary storage. [2025-10-06T22:37:39.657358] [INFO ] [MAIN ] EB: Loaded 36985 primary data records. [2025-10-06T22:37:39.990163] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:39.990956] [INFO ] [MAIN ] EAT: Generated 1794 derivative records from 49806 primary records. [2025-10-06T22:37:39.991452] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-06T22:37:40.011438] [DEBUG] [LOCAL ] EAT: Derivative data saved (1794 records). [2025-10-06T22:37:40.011551] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-06T22:37:40.014164] [INFO ] [MAIN ] Derivative Progress: 554/2037 symbols completed. EAT took 0.8s. Estimated remaining: 9m 50s. Rate: 150.8 symbols/min [2025-10-06T22:37:40.034705] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:40.035592] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 36985 primary records. [2025-10-06T22:37:40.035683] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-06T22:37:40.052110] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-10-06T22:37:40.052282] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-06T22:37:40.055312] [INFO ] [MAIN ] Derivative Progress: 555/2037 symbols completed. EB took 0.8s. Estimated remaining: 9m 49s. Rate: 151.0 symbols/min [2025-10-06T22:37:40.055951] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:40.056112] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:40.056252] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:40.079448] [DEBUG] [LOCAL ] EBF: Loaded 19101 existing records from primary storage. [2025-10-06T22:37:40.079609] [INFO ] [MAIN ] EBF: Loaded 19101 primary data records. [2025-10-06T22:37:40.255067] [DEBUG] [LOCAL ] EBR: Loaded 43038 existing records from primary storage. [2025-10-06T22:37:40.319382] [INFO ] [MAIN ] EBR: Loaded 43038 primary data records. [2025-10-06T22:37:40.339240] [DEBUG] [LOCAL ] ECC: Loaded 43187 existing records from primary storage. [2025-10-06T22:37:40.463484] [INFO ] [MAIN ] ECC: Loaded 43187 primary data records. [2025-10-06T22:37:41.128863] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:41.130302] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19101 primary records. [2025-10-06T22:37:41.130507] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-06T22:37:41.150043] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-10-06T22:37:41.150473] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-06T22:37:41.152738] [INFO ] [MAIN ] Derivative Progress: 556/2037 symbols completed. EBF took 1.1s. Estimated remaining: 9m 50s. Rate: 150.5 symbols/min [2025-10-06T22:37:41.152959] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:41.176949] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:41.177991] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43038 primary records. [2025-10-06T22:37:41.178192] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-06T22:37:41.219438] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-10-06T22:37:41.219880] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-06T22:37:41.219714] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:41.222402] [INFO ] [MAIN ] Derivative Progress: 557/2037 symbols completed. EBR took 1.2s. Estimated remaining: 9m 49s. Rate: 150.7 symbols/min [2025-10-06T22:37:41.223723] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43187 primary records. [2025-10-06T22:37:41.222725] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:41.224096] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-06T22:37:41.250072] [DEBUG] [LOCAL ] ECG: Loaded 33612 existing records from primary storage. [2025-10-06T22:37:41.251300] [INFO ] [MAIN ] ECG: Loaded 33612 primary data records. [2025-10-06T22:37:41.251125] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-10-06T22:37:41.251495] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-06T22:37:41.284751] [INFO ] [MAIN ] Derivative Progress: 558/2037 symbols completed. ECC took 1.2s. Estimated remaining: 9m 48s. Rate: 151.0 symbols/min [2025-10-06T22:37:41.312988] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:41.369360] [DEBUG] [LOCAL ] ECO: Loaded 18421 existing records from primary storage. [2025-10-06T22:37:41.375515] [INFO ] [MAIN ] ECO: Loaded 18421 primary data records. [2025-10-06T22:37:41.798609] [DEBUG] [LOCAL ] ECVT: Loaded 43195 existing records from primary storage. [2025-10-06T22:37:41.944359] [INFO ] [MAIN ] ECVT: Loaded 43195 primary data records. [2025-10-06T22:37:42.301305] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:42.303700] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 33612 primary records. [2025-10-06T22:37:42.304020] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-06T22:37:42.323752] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-10-06T22:37:42.323912] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-06T22:37:42.327124] [INFO ] [MAIN ] Derivative Progress: 559/2037 symbols completed. ECG took 1.2s. Estimated remaining: 9m 49s. Rate: 150.5 symbols/min [2025-10-06T22:37:42.329553] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:42.347947] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:42.349016] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18421 primary records. [2025-10-06T22:37:42.349239] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-06T22:37:42.371722] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-10-06T22:37:42.372073] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-06T22:37:42.375126] [INFO ] [MAIN ] Derivative Progress: 560/2037 symbols completed. ECO took 1.2s. Estimated remaining: 9m 48s. Rate: 150.8 symbols/min [2025-10-06T22:37:42.375738] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:42.412117] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:42.413104] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43195 primary records. [2025-10-06T22:37:42.413328] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-06T22:37:42.466255] [DEBUG] [LOCAL ] ED: Loaded 52735 existing records from primary storage. [2025-10-06T22:37:42.464757] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-10-06T22:37:42.467198] [INFO ] [MAIN ] ED: Loaded 52735 primary data records. [2025-10-06T22:37:42.466859] [DEBUG] [LOCAL ] EDD: Loaded 27034 existing records from primary storage. [2025-10-06T22:37:42.467517] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-06T22:37:42.467706] [INFO ] [MAIN ] EDD: Loaded 27034 primary data records. [2025-10-06T22:37:42.471407] [INFO ] [MAIN ] Derivative Progress: 561/2037 symbols completed. ECVT took 1.2s. Estimated remaining: 9m 47s. Rate: 151.0 symbols/min [2025-10-06T22:37:42.477152] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:42.814751] [DEBUG] [LOCAL ] EDF: Loaded 13267 existing records from primary storage. [2025-10-06T22:37:42.884048] [INFO ] [MAIN ] EDF: Loaded 13267 primary data records. [2025-10-06T22:37:43.580368] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:43.595407] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 27034 primary records. [2025-10-06T22:37:43.595536] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-06T22:37:43.594485] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:43.596589] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52735 primary records. [2025-10-06T22:37:43.607217] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-06T22:37:43.617451] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-10-06T22:37:43.617694] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-06T22:37:43.620829] [INFO ] [MAIN ] Derivative Progress: 562/2037 symbols completed. EDD took 1.2s. Estimated remaining: 9m 48s. Rate: 150.5 symbols/min [2025-10-06T22:37:43.632894] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:43.653092] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-10-06T22:37:43.653729] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-06T22:37:43.653483] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:43.654799] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 13267 primary records. [2025-10-06T22:37:43.659109] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-06T22:37:43.658966] [INFO ] [MAIN ] Derivative Progress: 563/2037 symbols completed. ED took 1.3s. Estimated remaining: 9m 47s. Rate: 150.7 symbols/min [2025-10-06T22:37:43.660180] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:43.682882] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-10-06T22:37:43.683203] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-06T22:37:43.685878] [INFO ] [MAIN ] Derivative Progress: 564/2037 symbols completed. EDF took 1.2s. Estimated remaining: 9m 45s. Rate: 151.0 symbols/min [2025-10-06T22:37:43.686104] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:43.695200] [DEBUG] [LOCAL ] EDN: Loaded 18203 existing records from primary storage. [2025-10-06T22:37:43.695494] [INFO ] [MAIN ] EDN: Loaded 18203 primary data records. [2025-10-06T22:37:43.908806] [DEBUG] [LOCAL ] EE: Loaded 32610 existing records from primary storage. [2025-10-06T22:37:43.933483] [INFO ] [MAIN ] EE: Loaded 32610 primary data records. [2025-10-06T22:37:43.961935] [DEBUG] [LOCAL ] EDU: Loaded 44860 existing records from primary storage. [2025-10-06T22:37:43.962433] [INFO ] [MAIN ] EDU: Loaded 44860 primary data records. [2025-10-06T22:37:44.845027] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:44.846521] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 18203 primary records. [2025-10-06T22:37:44.846850] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-06T22:37:44.866496] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-10-06T22:37:44.867177] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-06T22:37:44.869850] [INFO ] [MAIN ] Derivative Progress: 565/2037 symbols completed. EDN took 1.2s. Estimated remaining: 9m 47s. Rate: 150.4 symbols/min [2025-10-06T22:37:44.870475] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:44.891448] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:44.894697] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32610 primary records. [2025-10-06T22:37:44.895016] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-06T22:37:44.922476] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:44.936544] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-10-06T22:37:44.938120] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-06T22:37:44.937961] [DEBUG] [LOCAL ] EEX: Loaded 11058 existing records from primary storage. [2025-10-06T22:37:44.938351] [INFO ] [MAIN ] EEX: Loaded 11058 primary data records. [2025-10-06T22:37:44.937564] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 44860 primary records. [2025-10-06T22:37:44.952229] [INFO ] [MAIN ] Derivative Progress: 566/2037 symbols completed. EE took 1.3s. Estimated remaining: 9m 46s. Rate: 150.6 symbols/min [2025-10-06T22:37:44.976031] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-06T22:37:44.988359] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:45.183292] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-10-06T22:37:45.298411] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-06T22:37:45.317587] [INFO ] [MAIN ] Derivative Progress: 567/2037 symbols completed. EDU took 1.7s. Estimated remaining: 9m 45s. Rate: 150.7 symbols/min [2025-10-06T22:37:45.318198] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:45.359431] [DEBUG] [LOCAL ] EFX: Loaded 44615 existing records from primary storage. [2025-10-06T22:37:45.370132] [INFO ] [MAIN ] EFX: Loaded 44615 primary data records. [2025-10-06T22:37:45.497180] [DEBUG] [LOCAL ] EFXT: Loaded 29254 existing records from primary storage. [2025-10-06T22:37:45.497889] [INFO ] [MAIN ] EFXT: Loaded 29254 primary data records. [2025-10-06T22:37:45.848270] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:45.860741] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 11058 primary records. [2025-10-06T22:37:45.877852] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-06T22:37:46.159828] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-10-06T22:37:46.160768] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-06T22:37:46.163750] [INFO ] [MAIN ] Derivative Progress: 568/2037 symbols completed. EEX took 1.3s. Estimated remaining: 9m 46s. Rate: 150.4 symbols/min [2025-10-06T22:37:46.186985] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:46.188095] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44615 primary records. [2025-10-06T22:37:46.188318] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-06T22:37:46.207746] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-10-06T22:37:46.209212] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-06T22:37:46.215361] [INFO ] [MAIN ] Derivative Progress: 569/2037 symbols completed. EFX took 1.2s. Estimated remaining: 9m 45s. Rate: 150.6 symbols/min [2025-10-06T22:37:46.236853] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:46.238048] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29254 primary records. [2025-10-06T22:37:46.238132] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-06T22:37:46.258293] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-10-06T22:37:46.258517] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-06T22:37:46.262104] [INFO ] [MAIN ] Derivative Progress: 570/2037 symbols completed. EFXT took 0.9s. Estimated remaining: 9m 44s. Rate: 150.8 symbols/min [2025-10-06T22:37:46.263346] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:46.263206] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:46.263002] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:46.302579] [DEBUG] [LOCAL ] EG: Loaded 27903 existing records from primary storage. [2025-10-06T22:37:46.313998] [INFO ] [MAIN ] EG: Loaded 27903 primary data records. [2025-10-06T22:37:46.459419] [DEBUG] [LOCAL ] EGP: Loaded 30780 existing records from primary storage. [2025-10-06T22:37:46.466536] [INFO ] [MAIN ] EGP: Loaded 30780 primary data records. [2025-10-06T22:37:46.565154] [DEBUG] [LOCAL ] EGO: Loaded 51656 existing records from primary storage. [2025-10-06T22:37:46.590564] [INFO ] [MAIN ] EGO: Loaded 51656 primary data records. [2025-10-06T22:37:47.425393] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:47.426485] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 27903 primary records. [2025-10-06T22:37:47.426594] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-06T22:37:47.450565] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-10-06T22:37:47.452847] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-06T22:37:47.456591] [INFO ] [MAIN ] Derivative Progress: 571/2037 symbols completed. EG took 1.2s. Estimated remaining: 9m 45s. Rate: 150.3 symbols/min [2025-10-06T22:37:47.465333] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:47.487227] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:47.487790] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:47.489436] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 30780 primary records. [2025-10-06T22:37:47.489740] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-06T22:37:47.490967] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51656 primary records. [2025-10-06T22:37:47.492265] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-06T22:37:47.527201] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-10-06T22:37:47.527785] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-06T22:37:47.530917] [INFO ] [MAIN ] Derivative Progress: 572/2037 symbols completed. EGO took 1.3s. Estimated remaining: 9m 44s. Rate: 150.5 symbols/min [2025-10-06T22:37:47.532277] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-10-06T22:37:47.532887] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-06T22:37:47.532495] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:47.536314] [INFO ] [MAIN ] Derivative Progress: 573/2037 symbols completed. EGP took 1.3s. Estimated remaining: 9m 43s. Rate: 150.8 symbols/min [2025-10-06T22:37:47.536827] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:47.590712] [DEBUG] [LOCAL ] EGY: Loaded 41895 existing records from primary storage. [2025-10-06T22:37:47.599195] [DEBUG] [LOCAL ] EIG: Loaded 20309 existing records from primary storage. [2025-10-06T22:37:47.599509] [INFO ] [MAIN ] EGY: Loaded 41895 primary data records. [2025-10-06T22:37:47.599749] [INFO ] [MAIN ] EIG: Loaded 20309 primary data records. [2025-10-06T22:37:47.605700] [DEBUG] [LOCAL ] EIC: Loaded 23167 existing records from primary storage. [2025-10-06T22:37:47.617762] [INFO ] [MAIN ] EIC: Loaded 23167 primary data records. [2025-10-06T22:37:48.724513] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:48.726514] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20309 primary records. [2025-10-06T22:37:48.726745] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-06T22:37:48.747067] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-10-06T22:37:48.748896] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-06T22:37:48.752461] [INFO ] [MAIN ] Derivative Progress: 574/2037 symbols completed. EIG took 1.2s. Estimated remaining: 9m 44s. Rate: 150.2 symbols/min [2025-10-06T22:37:48.752975] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:48.770430] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:48.772526] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 23167 primary records. [2025-10-06T22:37:48.772752] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-06T22:37:48.800431] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:48.802449] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 41895 primary records. [2025-10-06T22:37:48.802858] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-06T22:37:48.807196] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-10-06T22:37:48.815087] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-06T22:37:48.822230] [INFO ] [MAIN ] Derivative Progress: 575/2037 symbols completed. EIC took 1.3s. Estimated remaining: 9m 43s. Rate: 150.5 symbols/min [2025-10-06T22:37:48.823027] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:48.827784] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-10-06T22:37:48.828832] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-06T22:37:48.833528] [INFO ] [MAIN ] Derivative Progress: 576/2037 symbols completed. EGY took 1.4s. Estimated remaining: 9m 42s. Rate: 150.7 symbols/min [2025-10-06T22:37:48.834098] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:48.872403] [DEBUG] [LOCAL ] EIX: Loaded 53343 existing records from primary storage. [2025-10-06T22:37:48.872801] [INFO ] [MAIN ] EIX: Loaded 53343 primary data records. [2025-10-06T22:37:49.244461] [DEBUG] [LOCAL ] EL: Loaded 53370 existing records from primary storage. [2025-10-06T22:37:49.245849] [INFO ] [MAIN ] EL: Loaded 53370 primary data records. [2025-10-06T22:37:49.254745] [DEBUG] [LOCAL ] ELAN: Loaded 53267 existing records from primary storage. [2025-10-06T22:37:49.254917] [INFO ] [MAIN ] ELAN: Loaded 53267 primary data records. [2025-10-06T22:37:49.933675] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:49.935269] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53343 primary records. [2025-10-06T22:37:49.935741] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-06T22:37:49.962535] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-10-06T22:37:49.963548] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-06T22:37:49.966677] [INFO ] [MAIN ] Derivative Progress: 577/2037 symbols completed. EIX took 1.2s. Estimated remaining: 9m 43s. Rate: 150.2 symbols/min [2025-10-06T22:37:49.967078] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:49.993914] [DEBUG] [LOCAL ] ELC: Loaded 3501 existing records from primary storage. [2025-10-06T22:37:49.995682] [INFO ] [MAIN ] ELC: Loaded 3501 primary data records. [2025-10-06T22:37:49.995524] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:50.066485] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53370 primary records. [2025-10-06T22:37:50.065138] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:50.087554] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-06T22:37:50.093700] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53267 primary records. [2025-10-06T22:37:50.099826] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-06T22:37:50.357111] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-10-06T22:37:50.358026] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-06T22:37:50.362968] [INFO ] [MAIN ] Derivative Progress: 578/2037 symbols completed. EL took 1.5s. Estimated remaining: 9m 43s. Rate: 150.2 symbols/min [2025-10-06T22:37:50.364231] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:50.364347] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-10-06T22:37:50.364738] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-06T22:37:50.368365] [INFO ] [MAIN ] Derivative Progress: 579/2037 symbols completed. ELAN took 1.5s. Estimated remaining: 9m 41s. Rate: 150.5 symbols/min [2025-10-06T22:37:50.370013] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:50.404253] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:50.405331] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3501 primary records. [2025-10-06T22:37:50.405477] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-06T22:37:50.427079] [DEBUG] [LOCAL ] ELP: Loaded 25589 existing records from primary storage. [2025-10-06T22:37:50.427767] [INFO ] [MAIN ] ELP: Loaded 25589 primary data records. [2025-10-06T22:37:50.517041] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-10-06T22:37:50.528924] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-06T22:37:50.537009] [INFO ] [MAIN ] Derivative Progress: 580/2037 symbols completed. ELC took 0.6s. Estimated remaining: 9m 40s. Rate: 150.6 symbols/min [2025-10-06T22:37:50.554099] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:50.816038] [DEBUG] [LOCAL ] ELF: Loaded 52098 existing records from primary storage. [2025-10-06T22:37:50.817340] [INFO ] [MAIN ] ELF: Loaded 52098 primary data records. [2025-10-06T22:37:51.192415] [DEBUG] [LOCAL ] ELV: Loaded 50614 existing records from primary storage. [2025-10-06T22:37:51.207269] [INFO ] [MAIN ] ELV: Loaded 50614 primary data records. [2025-10-06T22:37:51.406635] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:51.521354] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 25589 primary records. [2025-10-06T22:37:51.521688] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-06T22:37:51.543172] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-10-06T22:37:51.545467] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-06T22:37:51.548976] [INFO ] [MAIN ] Derivative Progress: 581/2037 symbols completed. ELP took 1.2s. Estimated remaining: 9m 41s. Rate: 150.2 symbols/min [2025-10-06T22:37:51.549550] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:51.563205] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:51.564093] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52098 primary records. [2025-10-06T22:37:51.564291] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-06T22:37:51.602314] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-10-06T22:37:51.608952] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-06T22:37:51.602955] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:51.612680] [INFO ] [MAIN ] Derivative Progress: 582/2037 symbols completed. ELF took 1.2s. Estimated remaining: 9m 40s. Rate: 150.5 symbols/min [2025-10-06T22:37:51.612844] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:51.613672] [INFO ] [MAIN ] ELV: Generated 1794 derivative records from 50614 primary records. [2025-10-06T22:37:51.614672] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-06T22:37:51.614611] [DEBUG] [LOCAL ] EMD: Loaded 21095 existing records from primary storage. [2025-10-06T22:37:51.615632] [INFO ] [MAIN ] EMD: Loaded 21095 primary data records. [2025-10-06T22:37:51.734212] [DEBUG] [LOCAL ] ELV: Derivative data saved (1794 records). [2025-10-06T22:37:51.737698] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-06T22:37:51.752847] [INFO ] [MAIN ] Derivative Progress: 583/2037 symbols completed. ELV took 1.2s. Estimated remaining: 9m 39s. Rate: 150.6 symbols/min [2025-10-06T22:37:51.963036] [DEBUG] [LOCAL ] EME: Loaded 31251 existing records from primary storage. [2025-10-06T22:37:51.964137] [INFO ] [MAIN ] EME: Loaded 31251 primary data records. [2025-10-06T22:37:52.289528] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:52.291750] [INFO ] [MAIN ] EMD: Generated 1794 derivative records from 21095 primary records. [2025-10-06T22:37:52.292324] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-06T22:37:52.311828] [DEBUG] [LOCAL ] EMD: Derivative data saved (1794 records). [2025-10-06T22:37:52.311921] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-06T22:37:52.314849] [INFO ] [MAIN ] Derivative Progress: 584/2037 symbols completed. EMD took 0.8s. Estimated remaining: 9m 39s. Rate: 150.5 symbols/min [2025-10-06T22:37:52.337912] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:52.338808] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 31251 primary records. [2025-10-06T22:37:52.338872] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-06T22:37:52.355015] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-10-06T22:37:52.355084] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-06T22:37:52.358379] [INFO ] [MAIN ] Derivative Progress: 585/2037 symbols completed. EME took 0.7s. Estimated remaining: 9m 38s. Rate: 150.8 symbols/min [2025-10-06T22:37:52.359067] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:52.358958] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:52.359262] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:52.366904] [DEBUG] [LOCAL ] EMF: Loaded 3285 existing records from primary storage. [2025-10-06T22:37:52.367068] [INFO ] [MAIN ] EMF: Loaded 3285 primary data records. [2025-10-06T22:37:52.476971] [DEBUG] [LOCAL ] EMO: Loaded 12701 existing records from primary storage. [2025-10-06T22:37:52.479871] [INFO ] [MAIN ] EMO: Loaded 12701 primary data records. [2025-10-06T22:37:53.052144] [DEBUG] [LOCAL ] EMN: Loaded 50602 existing records from primary storage. [2025-10-06T22:37:53.053307] [INFO ] [MAIN ] EMN: Loaded 50602 primary data records. [2025-10-06T22:37:53.391812] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:53.393516] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3285 primary records. [2025-10-06T22:37:53.393743] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-06T22:37:53.427318] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:53.430071] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 12701 primary records. [2025-10-06T22:37:53.430760] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-06T22:37:53.441809] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-10-06T22:37:53.445931] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-06T22:37:53.449179] [INFO ] [MAIN ] Derivative Progress: 586/2037 symbols completed. EMF took 1.1s. Estimated remaining: 9m 39s. Rate: 150.3 symbols/min [2025-10-06T22:37:53.449500] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:53.457530] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-10-06T22:37:53.457990] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-06T22:37:53.464409] [INFO ] [MAIN ] Derivative Progress: 587/2037 symbols completed. EMO took 1.1s. Estimated remaining: 9m 38s. Rate: 150.6 symbols/min [2025-10-06T22:37:53.460572] [DEBUG] [LOCAL ] EMP: Loaded 3074 existing records from primary storage. [2025-10-06T22:37:53.464774] [INFO ] [MAIN ] EMP: Loaded 3074 primary data records. [2025-10-06T22:37:53.465010] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:53.516025] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:53.544969] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50602 primary records. [2025-10-06T22:37:53.580761] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-06T22:37:53.807004] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-10-06T22:37:53.807278] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-06T22:37:53.811134] [INFO ] [MAIN ] Derivative Progress: 588/2037 symbols completed. EMN took 1.5s. Estimated remaining: 9m 37s. Rate: 150.6 symbols/min [2025-10-06T22:37:53.811694] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:53.866967] [DEBUG] [LOCAL ] EMR: Loaded 53243 existing records from primary storage. [2025-10-06T22:37:53.867484] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:53.867797] [INFO ] [MAIN ] EMR: Loaded 53243 primary data records. [2025-10-06T22:37:53.868743] [INFO ] [MAIN ] EMP: Generated 1794 derivative records from 3074 primary records. [2025-10-06T22:37:53.880155] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-06T22:37:54.049530] [DEBUG] [LOCAL ] EMP: Derivative data saved (1794 records). [2025-10-06T22:37:54.078555] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-06T22:37:54.081331] [INFO ] [MAIN ] Derivative Progress: 589/2037 symbols completed. EMP took 0.6s. Estimated remaining: 9m 37s. Rate: 150.7 symbols/min [2025-10-06T22:37:54.198707] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:54.218897] [DEBUG] [LOCAL ] ENB: Loaded 53507 existing records from primary storage. [2025-10-06T22:37:54.220533] [INFO ] [MAIN ] ENB: Loaded 53507 primary data records. [2025-10-06T22:37:54.246919] [DEBUG] [LOCAL ] ENFY: Loaded 3206 existing records from primary storage. [2025-10-06T22:37:54.262816] [INFO ] [MAIN ] ENFY: Loaded 3206 primary data records. [2025-10-06T22:37:54.964982] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:54.966679] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53243 primary records. [2025-10-06T22:37:54.966841] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-06T22:37:54.990798] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-10-06T22:37:54.990939] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-06T22:37:54.993414] [INFO ] [MAIN ] Derivative Progress: 590/2037 symbols completed. EMR took 1.5s. Estimated remaining: 9m 37s. Rate: 150.3 symbols/min [2025-10-06T22:37:54.994068] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:55.016966] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:55.018734] [INFO ] [MAIN ] ENFY: Generated 1794 derivative records from 3206 primary records. [2025-10-06T22:37:55.018956] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-10-06T22:37:55.039810] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:55.046325] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53507 primary records. [2025-10-06T22:37:55.051114] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-06T22:37:55.063733] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1794 records). [2025-10-06T22:37:55.064116] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-10-06T22:37:55.071239] [INFO ] [MAIN ] Derivative Progress: 591/2037 symbols completed. ENFY took 0.9s. Estimated remaining: 9m 36s. Rate: 150.5 symbols/min [2025-10-06T22:37:55.072153] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:55.087426] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-10-06T22:37:55.087794] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-06T22:37:55.091184] [INFO ] [MAIN ] Derivative Progress: 592/2037 symbols completed. ENB took 1.3s. Estimated remaining: 9m 35s. Rate: 150.8 symbols/min [2025-10-06T22:37:55.091484] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:55.110086] [DEBUG] [LOCAL ] ENIC: Loaded 36237 existing records from primary storage. [2025-10-06T22:37:55.110523] [INFO ] [MAIN ] ENIC: Loaded 36237 primary data records. [2025-10-06T22:37:55.291240] [DEBUG] [LOCAL ] ENOV: Loaded 44760 existing records from primary storage. [2025-10-06T22:37:55.313623] [INFO ] [MAIN ] ENOV: Loaded 44760 primary data records. [2025-10-06T22:37:55.651388] [DEBUG] [LOCAL ] ENR: Loaded 43088 existing records from primary storage. [2025-10-06T22:37:55.663043] [INFO ] [MAIN ] ENR: Loaded 43088 primary data records. [2025-10-06T22:37:56.229967] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:56.231056] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36237 primary records. [2025-10-06T22:37:56.232021] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-06T22:37:56.252606] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-10-06T22:37:56.265605] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-06T22:37:56.266192] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:56.270475] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 44760 primary records. [2025-10-06T22:37:56.269220] [INFO ] [MAIN ] Derivative Progress: 593/2037 symbols completed. ENIC took 1.3s. Estimated remaining: 9m 36s. Rate: 150.3 symbols/min [2025-10-06T22:37:56.270852] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-06T22:37:56.270967] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:56.297264] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-10-06T22:37:56.311997] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-06T22:37:56.312224] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:56.313159] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 43088 primary records. [2025-10-06T22:37:56.316201] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-06T22:37:56.316121] [INFO ] [MAIN ] Derivative Progress: 594/2037 symbols completed. ENOV took 1.2s. Estimated remaining: 9m 35s. Rate: 150.5 symbols/min [2025-10-06T22:37:56.317270] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:56.343888] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-10-06T22:37:56.344039] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-06T22:37:56.346869] [INFO ] [MAIN ] Derivative Progress: 595/2037 symbols completed. ENR took 1.3s. Estimated remaining: 9m 34s. Rate: 150.7 symbols/min [2025-10-06T22:37:56.347161] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:56.365138] [DEBUG] [LOCAL ] ENS: Loaded 29382 existing records from primary storage. [2025-10-06T22:37:56.365450] [INFO ] [MAIN ] ENS: Loaded 29382 primary data records. [2025-10-06T22:37:56.495153] [DEBUG] [LOCAL ] ENVA: Loaded 25317 existing records from primary storage. [2025-10-06T22:37:56.496279] [INFO ] [MAIN ] ENVA: Loaded 25317 primary data records. [2025-10-06T22:37:56.501980] [DEBUG] [LOCAL ] EOD: Loaded 14608 existing records from primary storage. [2025-10-06T22:37:56.528562] [INFO ] [MAIN ] EOD: Loaded 14608 primary data records. [2025-10-06T22:37:57.404757] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:57.405987] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29382 primary records. [2025-10-06T22:37:57.406193] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-06T22:37:57.439439] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-10-06T22:37:57.440944] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:57.441047] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-06T22:37:57.446015] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25317 primary records. [2025-10-06T22:37:57.445094] [INFO ] [MAIN ] Derivative Progress: 596/2037 symbols completed. ENS took 1.2s. Estimated remaining: 9m 35s. Rate: 150.3 symbols/min [2025-10-06T22:37:57.446236] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-06T22:37:57.446437] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:57.470506] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:57.477806] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 14608 primary records. [2025-10-06T22:37:57.478888] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-10-06T22:37:57.479147] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-06T22:37:57.479241] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-06T22:37:57.482829] [INFO ] [MAIN ] Derivative Progress: 597/2037 symbols completed. ENVA took 1.2s. Estimated remaining: 9m 34s. Rate: 150.5 symbols/min [2025-10-06T22:37:57.483470] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:57.506566] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-10-06T22:37:57.506769] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-06T22:37:57.509708] [INFO ] [MAIN ] Derivative Progress: 598/2037 symbols completed. EOD took 1.2s. Estimated remaining: 9m 33s. Rate: 150.8 symbols/min [2025-10-06T22:37:57.514861] [DEBUG] [LOCAL ] EOI: Loaded 10822 existing records from primary storage. [2025-10-06T22:37:57.515021] [INFO ] [MAIN ] EOI: Loaded 10822 primary data records. [2025-10-06T22:37:57.710055] [DEBUG] [LOCAL ] EOG: Loaded 53344 existing records from primary storage. [2025-10-06T22:37:57.731452] [INFO ] [MAIN ] EOG: Loaded 53344 primary data records. [2025-10-06T22:37:58.162028] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:58.162983] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10822 primary records. [2025-10-06T22:37:58.163168] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-06T22:37:58.181728] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-10-06T22:37:58.181814] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-06T22:37:58.184639] [INFO ] [MAIN ] Derivative Progress: 599/2037 symbols completed. EOI took 0.7s. Estimated remaining: 9m 33s. Rate: 150.6 symbols/min [2025-10-06T22:37:58.197474] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:58.198500] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53344 primary records. [2025-10-06T22:37:58.198596] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-06T22:37:58.215026] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-10-06T22:37:58.215091] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-06T22:37:58.217724] [INFO ] [MAIN ] Derivative Progress: 600/2037 symbols completed. EOG took 0.8s. Estimated remaining: 9m 32s. Rate: 150.8 symbols/min [2025-10-06T22:37:58.218128] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:58.218267] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:58.218395] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:58.230057] [DEBUG] [LOCAL ] EOT: Loaded 6792 existing records from primary storage. [2025-10-06T22:37:58.230277] [INFO ] [MAIN ] EOT: Loaded 6792 primary data records. [2025-10-06T22:37:58.346445] [DEBUG] [LOCAL ] EOS: Loaded 15387 existing records from primary storage. [2025-10-06T22:37:58.360990] [INFO ] [MAIN ] EOS: Loaded 15387 primary data records. [2025-10-06T22:37:58.673156] [DEBUG] [LOCAL ] EPAM: Loaded 39686 existing records from primary storage. [2025-10-06T22:37:58.685184] [INFO ] [MAIN ] EPAM: Loaded 39686 primary data records. [2025-10-06T22:37:59.267368] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:59.268275] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6792 primary records. [2025-10-06T22:37:59.268596] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-06T22:37:59.303209] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:59.302913] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-10-06T22:37:59.304409] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15387 primary records. [2025-10-06T22:37:59.303689] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-06T22:37:59.307082] [INFO ] [MAIN ] Derivative Progress: 601/2037 symbols completed. EOT took 1.1s. Estimated remaining: 9m 33s. Rate: 150.4 symbols/min [2025-10-06T22:37:59.307245] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-06T22:37:59.308457] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:59.339006] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:37:59.340617] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39686 primary records. [2025-10-06T22:37:59.340849] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-06T22:37:59.342412] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-10-06T22:37:59.342974] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-06T22:37:59.345816] [INFO ] [MAIN ] Derivative Progress: 602/2037 symbols completed. EOS took 1.1s. Estimated remaining: 9m 32s. Rate: 150.6 symbols/min [2025-10-06T22:37:59.346253] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:59.363079] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-10-06T22:37:59.363296] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-06T22:37:59.366371] [INFO ] [MAIN ] Derivative Progress: 603/2037 symbols completed. EPAM took 1.1s. Estimated remaining: 9m 30s. Rate: 150.8 symbols/min [2025-10-06T22:37:59.366553] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:37:59.420355] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-06T22:37:59.420686] [INFO ] [MAIN ] EPD: Loaded 53611 primary data records. [2025-10-06T22:37:59.546742] [DEBUG] [LOCAL ] EPR: Loaded 43944 existing records from primary storage. [2025-10-06T22:37:59.546975] [INFO ] [MAIN ] EPR: Loaded 43944 primary data records. [2025-10-06T22:37:59.751613] [DEBUG] [LOCAL ] EPRT: Loaded 48481 existing records from primary storage. [2025-10-06T22:37:59.881879] [INFO ] [MAIN ] EPRT: Loaded 48481 primary data records. [2025-10-06T22:38:00.403329] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:00.405988] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53611 primary records. [2025-10-06T22:38:00.406436] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-06T22:38:00.433887] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:00.436375] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 43944 primary records. [2025-10-06T22:38:00.437679] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-06T22:38:00.439615] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-10-06T22:38:00.440199] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-06T22:38:00.454390] [INFO ] [MAIN ] Derivative Progress: 604/2037 symbols completed. EPD took 1.1s. Estimated remaining: 9m 32s. Rate: 150.4 symbols/min [2025-10-06T22:38:00.458789] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-10-06T22:38:00.459456] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-06T22:38:00.459167] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:00.462566] [INFO ] [MAIN ] Derivative Progress: 605/2037 symbols completed. EPR took 1.1s. Estimated remaining: 9m 30s. Rate: 150.7 symbols/min [2025-10-06T22:38:00.462863] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:00.482391] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:00.483354] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48481 primary records. [2025-10-06T22:38:00.483513] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-06T22:38:00.505508] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-10-06T22:38:00.505905] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-06T22:38:00.509193] [INFO ] [MAIN ] Derivative Progress: 606/2037 symbols completed. EPRT took 1.1s. Estimated remaining: 9m 29s. Rate: 150.9 symbols/min [2025-10-06T22:38:00.509453] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:00.561114] [DEBUG] [LOCAL ] EQNR: Loaded 53023 existing records from primary storage. [2025-10-06T22:38:00.562828] [INFO ] [MAIN ] EQNR: Loaded 53023 primary data records. [2025-10-06T22:38:00.684873] [DEBUG] [LOCAL ] EQH: Loaded 52656 existing records from primary storage. [2025-10-06T22:38:00.685762] [INFO ] [MAIN ] EQH: Loaded 52656 primary data records. [2025-10-06T22:38:01.039681] [DEBUG] [LOCAL ] EQR: Loaded 51571 existing records from primary storage. [2025-10-06T22:38:01.056084] [INFO ] [MAIN ] EQR: Loaded 51571 primary data records. [2025-10-06T22:38:01.705615] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:01.709446] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53023 primary records. [2025-10-06T22:38:01.710577] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-06T22:38:01.744319] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:01.746695] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-10-06T22:38:01.748211] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-06T22:38:01.748108] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52656 primary records. [2025-10-06T22:38:01.750802] [INFO ] [MAIN ] Derivative Progress: 607/2037 symbols completed. EQNR took 1.3s. Estimated remaining: 9m 31s. Rate: 150.4 symbols/min [2025-10-06T22:38:01.751053] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-06T22:38:01.751222] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:01.781484] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-10-06T22:38:01.781834] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-06T22:38:01.786138] [INFO ] [MAIN ] Derivative Progress: 608/2037 symbols completed. EQH took 1.3s. Estimated remaining: 9m 29s. Rate: 150.6 symbols/min [2025-10-06T22:38:01.794498] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:01.803833] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:01.805610] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51571 primary records. [2025-10-06T22:38:01.806998] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-06T22:38:01.812601] [DEBUG] [LOCAL ] EQV: Loaded 2713 existing records from primary storage. [2025-10-06T22:38:01.821418] [INFO ] [MAIN ] EQV: Loaded 2713 primary data records. [2025-10-06T22:38:01.980949] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-10-06T22:38:02.001952] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-06T22:38:02.046369] [INFO ] [MAIN ] Derivative Progress: 609/2037 symbols completed. EQR took 1.5s. Estimated remaining: 9m 29s. Rate: 150.7 symbols/min [2025-10-06T22:38:02.038834] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-06T22:38:02.070720] [INFO ] [MAIN ] EQT: Loaded 53682 primary data records. [2025-10-06T22:38:02.154953] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:02.584416] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:02.585546] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2713 primary records. [2025-10-06T22:38:02.586852] [DEBUG] [LOCAL ] ERJ: Loaded 50587 existing records from primary storage. [2025-10-06T22:38:02.585726] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-06T22:38:02.587737] [INFO ] [MAIN ] ERJ: Loaded 50587 primary data records. [2025-10-06T22:38:02.708707] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-10-06T22:38:02.708898] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-06T22:38:02.716784] [INFO ] [MAIN ] Derivative Progress: 610/2037 symbols completed. EQV took 0.9s. Estimated remaining: 9m 29s. Rate: 150.5 symbols/min [2025-10-06T22:38:02.751703] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:02.937460] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:02.940741] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53682 primary records. [2025-10-06T22:38:02.940953] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-06T22:38:02.971928] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-10-06T22:38:02.972441] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-06T22:38:02.976028] [INFO ] [MAIN ] Derivative Progress: 611/2037 symbols completed. EQT took 1.2s. Estimated remaining: 9m 28s. Rate: 150.6 symbols/min [2025-10-06T22:38:02.976733] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:03.002795] [DEBUG] [LOCAL ] ERO: Loaded 41364 existing records from primary storage. [2025-10-06T22:38:03.003345] [INFO ] [MAIN ] ERO: Loaded 41364 primary data records. [2025-10-06T22:38:03.122373] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:03.131767] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50587 primary records. [2025-10-06T22:38:03.150254] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-06T22:38:03.427583] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-10-06T22:38:03.429702] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-06T22:38:03.433706] [INFO ] [MAIN ] Derivative Progress: 612/2037 symbols completed. ERJ took 1.3s. Estimated remaining: 9m 28s. Rate: 150.5 symbols/min [2025-10-06T22:38:03.434136] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:03.429496] [DEBUG] [LOCAL ] ES: Loaded 52594 existing records from primary storage. [2025-10-06T22:38:03.434405] [INFO ] [MAIN ] ES: Loaded 52594 primary data records. [2025-10-06T22:38:03.779014] [DEBUG] [LOCAL ] ESAB: Loaded 26153 existing records from primary storage. [2025-10-06T22:38:03.780250] [INFO ] [MAIN ] ESAB: Loaded 26153 primary data records. [2025-10-06T22:38:03.993264] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:03.994822] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41364 primary records. [2025-10-06T22:38:04.111220] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-06T22:38:04.133306] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-10-06T22:38:04.133743] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-06T22:38:04.137170] [INFO ] [MAIN ] Derivative Progress: 613/2037 symbols completed. ERO took 1.4s. Estimated remaining: 9m 28s. Rate: 150.4 symbols/min [2025-10-06T22:38:04.154712] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:04.155542] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52594 primary records. [2025-10-06T22:38:04.155840] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-06T22:38:04.173143] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-10-06T22:38:04.173432] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-06T22:38:04.176910] [INFO ] [MAIN ] Derivative Progress: 614/2037 symbols completed. ES took 1.2s. Estimated remaining: 9m 27s. Rate: 150.6 symbols/min [2025-10-06T22:38:04.203427] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:04.204851] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 26153 primary records. [2025-10-06T22:38:04.204936] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-06T22:38:04.225668] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-10-06T22:38:04.225839] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-06T22:38:04.228891] [INFO ] [MAIN ] Derivative Progress: 615/2037 symbols completed. ESAB took 0.8s. Estimated remaining: 9m 26s. Rate: 150.8 symbols/min [2025-10-06T22:38:04.229376] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:04.229522] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:04.229687] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:04.266394] [DEBUG] [LOCAL ] ESE: Loaded 16617 existing records from primary storage. [2025-10-06T22:38:04.266721] [INFO ] [MAIN ] ESE: Loaded 16617 primary data records. [2025-10-06T22:38:04.374341] [DEBUG] [LOCAL ] ESNT: Loaded 38283 existing records from primary storage. [2025-10-06T22:38:04.389205] [INFO ] [MAIN ] ESNT: Loaded 38283 primary data records. [2025-10-06T22:38:04.553372] [DEBUG] [LOCAL ] ESI: Loaded 50703 existing records from primary storage. [2025-10-06T22:38:04.603399] [INFO ] [MAIN ] ESI: Loaded 50703 primary data records. [2025-10-06T22:38:05.335389] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:05.336447] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16617 primary records. [2025-10-06T22:38:05.336625] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-06T22:38:05.368133] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:05.369944] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38283 primary records. [2025-10-06T22:38:05.370262] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-06T22:38:05.372523] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-10-06T22:38:05.374705] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-06T22:38:05.377070] [INFO ] [MAIN ] Derivative Progress: 616/2037 symbols completed. ESE took 1.1s. Estimated remaining: 9m 27s. Rate: 150.3 symbols/min [2025-10-06T22:38:05.384770] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:05.406848] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:05.408480] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50703 primary records. [2025-10-06T22:38:05.408576] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-06T22:38:05.409360] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-10-06T22:38:05.410268] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-06T22:38:05.413428] [INFO ] [MAIN ] Derivative Progress: 617/2037 symbols completed. ESNT took 1.2s. Estimated remaining: 9m 26s. Rate: 150.6 symbols/min [2025-10-06T22:38:05.421195] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:05.432930] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-10-06T22:38:05.433156] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-06T22:38:05.436333] [INFO ] [MAIN ] Derivative Progress: 618/2037 symbols completed. ESI took 1.2s. Estimated remaining: 9m 25s. Rate: 150.8 symbols/min [2025-10-06T22:38:05.436613] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:05.499442] [DEBUG] [LOCAL ] ESS: Loaded 29925 existing records from primary storage. [2025-10-06T22:38:05.511445] [INFO ] [MAIN ] ESS: Loaded 29925 primary data records. [2025-10-06T22:38:05.525339] [DEBUG] [LOCAL ] ESRT: Loaded 46288 existing records from primary storage. [2025-10-06T22:38:05.550346] [INFO ] [MAIN ] ESRT: Loaded 46288 primary data records. [2025-10-06T22:38:05.796511] [DEBUG] [LOCAL ] ESTC: Loaded 50008 existing records from primary storage. [2025-10-06T22:38:05.825014] [INFO ] [MAIN ] ESTC: Loaded 50008 primary data records. [2025-10-06T22:38:06.485731] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:06.487573] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 29925 primary records. [2025-10-06T22:38:06.487839] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-06T22:38:06.502413] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:06.514632] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46288 primary records. [2025-10-06T22:38:06.515305] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-06T22:38:06.536942] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-10-06T22:38:06.537912] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-06T22:38:06.536849] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-10-06T22:38:06.541378] [INFO ] [MAIN ] Derivative Progress: 619/2037 symbols completed. ESS took 1.1s. Estimated remaining: 9m 26s. Rate: 150.4 symbols/min [2025-10-06T22:38:06.541742] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:06.541476] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-06T22:38:06.544670] [INFO ] [MAIN ] Derivative Progress: 620/2037 symbols completed. ESRT took 1.2s. Estimated remaining: 9m 25s. Rate: 150.6 symbols/min [2025-10-06T22:38:06.545270] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:06.559307] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:06.560131] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50008 primary records. [2025-10-06T22:38:06.560341] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-06T22:38:06.580094] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-10-06T22:38:06.580232] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-06T22:38:06.583029] [INFO ] [MAIN ] Derivative Progress: 621/2037 symbols completed. ESTC took 1.1s. Estimated remaining: 9m 23s. Rate: 150.8 symbols/min [2025-10-06T22:38:06.583249] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:06.590031] [DEBUG] [LOCAL ] ETB: Loaded 12264 existing records from primary storage. [2025-10-06T22:38:06.590312] [INFO ] [MAIN ] ETB: Loaded 12264 primary data records. [2025-10-06T22:38:06.798671] [DEBUG] [LOCAL ] ETD: Loaded 27331 existing records from primary storage. [2025-10-06T22:38:06.913104] [INFO ] [MAIN ] ETD: Loaded 27331 primary data records. [2025-10-06T22:38:07.035197] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-06T22:38:07.039073] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-10-06T22:38:07.610229] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:07.611723] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 12264 primary records. [2025-10-06T22:38:07.612141] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-06T22:38:07.631178] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-10-06T22:38:07.631405] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-06T22:38:07.634249] [INFO ] [MAIN ] Derivative Progress: 622/2037 symbols completed. ETB took 1.1s. Estimated remaining: 9m 24s. Rate: 150.4 symbols/min [2025-10-06T22:38:07.635123] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:07.654284] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:07.655409] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27331 primary records. [2025-10-06T22:38:07.655910] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-06T22:38:07.677004] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-10-06T22:38:07.677397] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-06T22:38:07.680030] [INFO ] [MAIN ] Derivative Progress: 623/2037 symbols completed. ETD took 1.1s. Estimated remaining: 9m 23s. Rate: 150.6 symbols/min [2025-10-06T22:38:07.680272] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:07.689698] [DEBUG] [LOCAL ] ETG: Loaded 16551 existing records from primary storage. [2025-10-06T22:38:07.690003] [INFO ] [MAIN ] ETG: Loaded 16551 primary data records. [2025-10-06T22:38:07.766316] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:07.797673] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-10-06T22:38:07.814071] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-06T22:38:07.850214] [DEBUG] [LOCAL ] ETJ: Loaded 16949 existing records from primary storage. [2025-10-06T22:38:07.855558] [INFO ] [MAIN ] ETJ: Loaded 16949 primary data records. [2025-10-06T22:38:08.141309] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-10-06T22:38:08.142008] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-06T22:38:08.156261] [INFO ] [MAIN ] Derivative Progress: 624/2037 symbols completed. ET took 1.6s. Estimated remaining: 9m 23s. Rate: 150.6 symbols/min [2025-10-06T22:38:08.185109] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:08.366479] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:08.367305] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16551 primary records. [2025-10-06T22:38:08.367637] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-06T22:38:08.401262] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-10-06T22:38:08.401714] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-06T22:38:08.404159] [INFO ] [MAIN ] Derivative Progress: 625/2037 symbols completed. ETG took 0.8s. Estimated remaining: 9m 22s. Rate: 150.7 symbols/min [2025-10-06T22:38:08.404597] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:08.434622] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:08.437136] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16949 primary records. [2025-10-06T22:38:08.437371] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-06T22:38:08.439341] [DEBUG] [LOCAL ] ETN: Loaded 52723 existing records from primary storage. [2025-10-06T22:38:08.446877] [INFO ] [MAIN ] ETN: Loaded 52723 primary data records. [2025-10-06T22:38:08.468977] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-10-06T22:38:08.478946] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-06T22:38:08.482106] [INFO ] [MAIN ] Derivative Progress: 626/2037 symbols completed. ETJ took 0.8s. Estimated remaining: 9m 21s. Rate: 150.9 symbols/min [2025-10-06T22:38:08.495500] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:08.543044] [DEBUG] [LOCAL ] ETO: Loaded 6695 existing records from primary storage. [2025-10-06T22:38:08.576357] [INFO ] [MAIN ] ETO: Loaded 6695 primary data records. [2025-10-06T22:38:09.104964] [DEBUG] [LOCAL ] ETR: Loaded 53231 existing records from primary storage. [2025-10-06T22:38:09.106355] [INFO ] [MAIN ] ETR: Loaded 53231 primary data records. [2025-10-06T22:38:09.482208] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:09.483342] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52723 primary records. [2025-10-06T22:38:09.483434] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-06T22:38:09.506469] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-10-06T22:38:09.519572] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-06T22:38:09.522403] [INFO ] [MAIN ] Derivative Progress: 627/2037 symbols completed. ETN took 1.3s. Estimated remaining: 9m 22s. Rate: 150.5 symbols/min [2025-10-06T22:38:09.523808] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:09.523420] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:09.524669] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6695 primary records. [2025-10-06T22:38:09.525361] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-06T22:38:09.543527] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-10-06T22:38:09.543892] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-06T22:38:09.546679] [INFO ] [MAIN ] Derivative Progress: 628/2037 symbols completed. ETO took 1.1s. Estimated remaining: 9m 21s. Rate: 150.7 symbols/min [2025-10-06T22:38:09.569766] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:09.570524] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53231 primary records. [2025-10-06T22:38:09.571040] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-06T22:38:09.579528] [DEBUG] [LOCAL ] ETV: Loaded 21817 existing records from primary storage. [2025-10-06T22:38:09.587113] [INFO ] [MAIN ] ETV: Loaded 21817 primary data records. [2025-10-06T22:38:09.595548] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-10-06T22:38:09.619026] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-06T22:38:09.635024] [INFO ] [MAIN ] Derivative Progress: 629/2037 symbols completed. ETR took 1.1s. Estimated remaining: 9m 20s. Rate: 150.9 symbols/min [2025-10-06T22:38:09.919606] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:09.920309] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 21817 primary records. [2025-10-06T22:38:09.920370] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-06T22:38:09.935863] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-10-06T22:38:09.935959] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-06T22:38:09.938717] [INFO ] [MAIN ] Derivative Progress: 630/2037 symbols completed. ETV took 0.4s. Estimated remaining: 9m 19s. Rate: 150.9 symbols/min [2025-10-06T22:38:09.939785] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:09.939623] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:09.939867] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:09.950740] [DEBUG] [LOCAL ] ETX: Loaded 5157 existing records from primary storage. [2025-10-06T22:38:09.959287] [INFO ] [MAIN ] ETX: Loaded 5157 primary data records. [2025-10-06T22:38:10.037108] [DEBUG] [LOCAL ] ETY: Loaded 22976 existing records from primary storage. [2025-10-06T22:38:10.060115] [INFO ] [MAIN ] ETY: Loaded 22976 primary data records. [2025-10-06T22:38:10.140919] [DEBUG] [LOCAL ] ETW: Loaded 25222 existing records from primary storage. [2025-10-06T22:38:10.169281] [INFO ] [MAIN ] ETW: Loaded 25222 primary data records. [2025-10-06T22:38:11.040009] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:11.041373] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 5157 primary records. [2025-10-06T22:38:11.041730] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-06T22:38:11.060118] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-10-06T22:38:11.060619] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-06T22:38:11.079695] [INFO ] [MAIN ] Derivative Progress: 631/2037 symbols completed. ETX took 1.1s. Estimated remaining: 9m 21s. Rate: 150.5 symbols/min [2025-10-06T22:38:11.080491] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:11.080146] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:11.081342] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 22976 primary records. [2025-10-06T22:38:11.081774] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-06T22:38:11.108235] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:11.112694] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-10-06T22:38:11.113503] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25222 primary records. [2025-10-06T22:38:11.113830] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-06T22:38:11.113889] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-06T22:38:11.117095] [INFO ] [MAIN ] Derivative Progress: 632/2037 symbols completed. ETY took 1.2s. Estimated remaining: 9m 19s. Rate: 150.7 symbols/min [2025-10-06T22:38:11.122421] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:11.147286] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-10-06T22:38:11.147569] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-06T22:38:11.150965] [INFO ] [MAIN ] Derivative Progress: 633/2037 symbols completed. ETW took 1.2s. Estimated remaining: 9m 18s. Rate: 150.9 symbols/min [2025-10-06T22:38:11.151277] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:11.147990] [DEBUG] [LOCAL ] EVC: Loaded 18396 existing records from primary storage. [2025-10-06T22:38:11.152053] [INFO ] [MAIN ] EVC: Loaded 18396 primary data records. [2025-10-06T22:38:11.279619] [DEBUG] [LOCAL ] EVF: Loaded 9540 existing records from primary storage. [2025-10-06T22:38:11.296094] [INFO ] [MAIN ] EVF: Loaded 9540 primary data records. [2025-10-06T22:38:11.306877] [DEBUG] [LOCAL ] EVEX: Loaded 30942 existing records from primary storage. [2025-10-06T22:38:11.396701] [INFO ] [MAIN ] EVEX: Loaded 30942 primary data records. [2025-10-06T22:38:12.164595] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:12.165838] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 18396 primary records. [2025-10-06T22:38:12.166129] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-06T22:38:12.186996] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-10-06T22:38:12.194958] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-06T22:38:12.200604] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:12.203219] [INFO ] [MAIN ] Derivative Progress: 634/2037 symbols completed. EVC took 1.1s. Estimated remaining: 9m 19s. Rate: 150.5 symbols/min [2025-10-06T22:38:12.203690] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:12.205285] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9540 primary records. [2025-10-06T22:38:12.206471] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-06T22:38:12.239117] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-10-06T22:38:12.239483] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:12.242624] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-06T22:38:12.242483] [DEBUG] [LOCAL ] EVG: Loaded 5987 existing records from primary storage. [2025-10-06T22:38:12.245582] [INFO ] [MAIN ] Derivative Progress: 635/2037 symbols completed. EVF took 1.1s. Estimated remaining: 9m 18s. Rate: 150.8 symbols/min [2025-10-06T22:38:12.246498] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 30942 primary records. [2025-10-06T22:38:12.246702] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:12.246765] [INFO ] [MAIN ] EVG: Loaded 5987 primary data records. [2025-10-06T22:38:12.252465] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-06T22:38:12.420438] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-10-06T22:38:12.487721] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-06T22:38:12.566197] [INFO ] [MAIN ] Derivative Progress: 636/2037 symbols completed. EVEX took 1.4s. Estimated remaining: 9m 17s. Rate: 150.8 symbols/min [2025-10-06T22:38:12.577412] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:12.601784] [DEBUG] [LOCAL ] EVH: Loaded 49465 existing records from primary storage. [2025-10-06T22:38:12.607404] [INFO ] [MAIN ] EVH: Loaded 49465 primary data records. [2025-10-06T22:38:12.607299] [DEBUG] [LOCAL ] EVN: Loaded 11130 existing records from primary storage. [2025-10-06T22:38:12.607666] [INFO ] [MAIN ] EVN: Loaded 11130 primary data records. [2025-10-06T22:38:12.867867] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:12.987619] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5987 primary records. [2025-10-06T22:38:13.000410] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-06T22:38:13.309847] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-10-06T22:38:13.311021] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-06T22:38:13.314267] [INFO ] [MAIN ] Derivative Progress: 637/2037 symbols completed. EVG took 1.1s. Estimated remaining: 9m 18s. Rate: 150.6 symbols/min [2025-10-06T22:38:13.314712] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:13.356260] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:13.356681] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:13.357507] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 11130 primary records. [2025-10-06T22:38:13.367272] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-06T22:38:13.358136] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49465 primary records. [2025-10-06T22:38:13.368606] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-06T22:38:13.398804] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-10-06T22:38:13.411281] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-06T22:38:13.411054] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-10-06T22:38:13.412125] [DEBUG] [LOCAL ] EVR: Loaded 34649 existing records from primary storage. [2025-10-06T22:38:13.412269] [INFO ] [MAIN ] EVR: Loaded 34649 primary data records. [2025-10-06T22:38:13.411442] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-06T22:38:13.415010] [INFO ] [MAIN ] Derivative Progress: 638/2037 symbols completed. EVN took 0.8s. Estimated remaining: 9m 17s. Rate: 150.8 symbols/min [2025-10-06T22:38:13.494866] [INFO ] [MAIN ] Derivative Progress: 639/2037 symbols completed. EVH took 1.2s. Estimated remaining: 9m 16s. Rate: 151.0 symbols/min [2025-10-06T22:38:13.489689] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:13.495042] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:13.749136] [DEBUG] [LOCAL ] EVT: Loaded 16858 existing records from primary storage. [2025-10-06T22:38:13.749409] [INFO ] [MAIN ] EVT: Loaded 16858 primary data records. [2025-10-06T22:38:13.825601] [DEBUG] [LOCAL ] EVTC: Loaded 26337 existing records from primary storage. [2025-10-06T22:38:13.838026] [INFO ] [MAIN ] EVTC: Loaded 26337 primary data records. [2025-10-06T22:38:14.439012] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:14.440284] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 34649 primary records. [2025-10-06T22:38:14.440705] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-06T22:38:14.460985] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-10-06T22:38:14.461279] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-06T22:38:14.463791] [INFO ] [MAIN ] Derivative Progress: 640/2037 symbols completed. EVR took 1.1s. Estimated remaining: 9m 16s. Rate: 150.6 symbols/min [2025-10-06T22:38:14.464174] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:14.484251] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:14.485185] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 16858 primary records. [2025-10-06T22:38:14.485357] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-06T22:38:14.522949] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-10-06T22:38:14.523811] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-06T22:38:14.526535] [INFO ] [MAIN ] Derivative Progress: 641/2037 symbols completed. EVT took 1.0s. Estimated remaining: 9m 15s. Rate: 150.8 symbols/min [2025-10-06T22:38:14.523730] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:14.527838] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26337 primary records. [2025-10-06T22:38:14.526804] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:14.537569] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-06T22:38:14.569486] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-10-06T22:38:14.570776] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-06T22:38:14.575250] [DEBUG] [LOCAL ] EVTL: Loaded 38735 existing records from primary storage. [2025-10-06T22:38:14.574114] [INFO ] [MAIN ] Derivative Progress: 642/2037 symbols completed. EVTC took 1.1s. Estimated remaining: 9m 14s. Rate: 151.0 symbols/min [2025-10-06T22:38:14.575463] [INFO ] [MAIN ] EVTL: Loaded 38735 primary data records. [2025-10-06T22:38:14.575833] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:14.710503] [DEBUG] [LOCAL ] EVTR: Loaded 24050 existing records from primary storage. [2025-10-06T22:38:14.720262] [INFO ] [MAIN ] EVTR: Loaded 24050 primary data records. [2025-10-06T22:38:15.129468] [DEBUG] [LOCAL ] EW: Loaded 53402 existing records from primary storage. [2025-10-06T22:38:15.161138] [INFO ] [MAIN ] EW: Loaded 53402 primary data records. [2025-10-06T22:38:15.710990] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:15.711943] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 38735 primary records. [2025-10-06T22:38:15.712416] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-06T22:38:15.731949] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-10-06T22:38:15.734533] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-06T22:38:15.738025] [INFO ] [MAIN ] Derivative Progress: 643/2037 symbols completed. EVTL took 1.3s. Estimated remaining: 9m 15s. Rate: 150.6 symbols/min [2025-10-06T22:38:15.752297] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:15.753369] [INFO ] [MAIN ] EVTR: Generated 1794 derivative records from 24050 primary records. [2025-10-06T22:38:15.753607] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-06T22:38:15.772035] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1794 records). [2025-10-06T22:38:15.772133] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-06T22:38:15.775750] [INFO ] [MAIN ] Derivative Progress: 644/2037 symbols completed. EVTR took 1.2s. Estimated remaining: 9m 14s. Rate: 150.8 symbols/min [2025-10-06T22:38:15.790799] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:15.791755] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53402 primary records. [2025-10-06T22:38:15.791823] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-06T22:38:15.812247] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-10-06T22:38:15.812450] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-06T22:38:15.815604] [INFO ] [MAIN ] Derivative Progress: 645/2037 symbols completed. EW took 1.2s. Estimated remaining: 9m 13s. Rate: 151.0 symbols/min [2025-10-06T22:38:15.816262] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:15.816746] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:15.816938] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:15.856278] [DEBUG] [LOCAL ] EXP: Loaded 29678 existing records from primary storage. [2025-10-06T22:38:15.873072] [INFO ] [MAIN ] EXP: Loaded 29678 primary data records. [2025-10-06T22:38:15.920360] [DEBUG] [LOCAL ] EXG: Loaded 34162 existing records from primary storage. [2025-10-06T22:38:15.966408] [INFO ] [MAIN ] EXG: Loaded 34162 primary data records. [2025-10-06T22:38:16.032551] [DEBUG] [LOCAL ] EXK: Loaded 53138 existing records from primary storage. [2025-10-06T22:38:16.075954] [INFO ] [MAIN ] EXK: Loaded 53138 primary data records. [2025-10-06T22:38:16.854916] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:16.856090] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 29678 primary records. [2025-10-06T22:38:16.856513] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-06T22:38:16.870343] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:16.883210] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34162 primary records. [2025-10-06T22:38:16.885344] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-06T22:38:16.888922] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-10-06T22:38:16.895995] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-06T22:38:16.904558] [INFO ] [MAIN ] Derivative Progress: 646/2037 symbols completed. EXP took 1.1s. Estimated remaining: 9m 14s. Rate: 150.6 symbols/min [2025-10-06T22:38:16.907860] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:16.907714] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-10-06T22:38:16.908852] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-06T22:38:16.911853] [INFO ] [MAIN ] Derivative Progress: 647/2037 symbols completed. EXG took 1.1s. Estimated remaining: 9m 13s. Rate: 150.8 symbols/min [2025-10-06T22:38:16.912241] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:16.926429] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:16.927334] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53138 primary records. [2025-10-06T22:38:16.927581] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-06T22:38:16.948705] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-10-06T22:38:16.948944] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-06T22:38:16.952622] [INFO ] [MAIN ] Derivative Progress: 648/2037 symbols completed. EXK took 1.1s. Estimated remaining: 9m 12s. Rate: 151.0 symbols/min [2025-10-06T22:38:16.953289] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:16.999147] [DEBUG] [LOCAL ] EXR: Loaded 45249 existing records from primary storage. [2025-10-06T22:38:16.999361] [INFO ] [MAIN ] EXR: Loaded 45249 primary data records. [2025-10-06T22:38:17.121625] [DEBUG] [LOCAL ] EXPD: Loaded 47837 existing records from primary storage. [2025-10-06T22:38:17.180339] [INFO ] [MAIN ] EXPD: Loaded 47837 primary data records. [2025-10-06T22:38:17.415625] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-06T22:38:17.423863] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-06T22:38:18.031271] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:18.033101] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45249 primary records. [2025-10-06T22:38:18.033971] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-06T22:38:18.053019] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-10-06T22:38:18.054913] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-06T22:38:18.059253] [INFO ] [MAIN ] Derivative Progress: 649/2037 symbols completed. EXR took 1.1s. Estimated remaining: 9m 13s. Rate: 150.6 symbols/min [2025-10-06T22:38:18.071692] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:18.073259] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:18.074037] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 47837 primary records. [2025-10-06T22:38:18.074225] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-06T22:38:18.107896] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:18.108321] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-10-06T22:38:18.108629] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-06T22:38:18.109399] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-10-06T22:38:18.112732] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-06T22:38:18.112550] [INFO ] [MAIN ] Derivative Progress: 650/2037 symbols completed. EXPD took 1.2s. Estimated remaining: 9m 12s. Rate: 150.8 symbols/min [2025-10-06T22:38:18.113814] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:18.141395] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-10-06T22:38:18.141475] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-06T22:38:18.144404] [INFO ] [MAIN ] Derivative Progress: 651/2037 symbols completed. F took 1.2s. Estimated remaining: 9m 11s. Rate: 151.0 symbols/min [2025-10-06T22:38:18.145303] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:18.158559] [DEBUG] [LOCAL ] FAF: Loaded 41653 existing records from primary storage. [2025-10-06T22:38:18.158784] [INFO ] [MAIN ] FAF: Loaded 41653 primary data records. [2025-10-06T22:38:18.342683] [DEBUG] [LOCAL ] FBK: Loaded 26494 existing records from primary storage. [2025-10-06T22:38:18.366811] [INFO ] [MAIN ] FBK: Loaded 26494 primary data records. [2025-10-06T22:38:18.541697] [DEBUG] [LOCAL ] FBIN: Loaded 50431 existing records from primary storage. [2025-10-06T22:38:18.569906] [INFO ] [MAIN ] FBIN: Loaded 50431 primary data records. [2025-10-06T22:38:19.126473] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:19.127911] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41653 primary records. [2025-10-06T22:38:19.128458] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-06T22:38:19.150477] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-10-06T22:38:19.151198] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-06T22:38:19.153635] [INFO ] [MAIN ] Derivative Progress: 652/2037 symbols completed. FAF took 1.1s. Estimated remaining: 9m 12s. Rate: 150.7 symbols/min [2025-10-06T22:38:19.154087] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:19.168320] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:19.170553] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 26494 primary records. [2025-10-06T22:38:19.170637] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-06T22:38:19.198957] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:19.200555] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50431 primary records. [2025-10-06T22:38:19.201100] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-06T22:38:19.220444] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-10-06T22:38:19.220635] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-06T22:38:19.225882] [INFO ] [MAIN ] Derivative Progress: 653/2037 symbols completed. FBIN took 1.1s. Estimated remaining: 9m 10s. Rate: 150.9 symbols/min [2025-10-06T22:38:19.222689] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-10-06T22:38:19.226470] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-06T22:38:19.226189] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:19.229507] [INFO ] [MAIN ] Derivative Progress: 654/2037 symbols completed. FBK took 1.1s. Estimated remaining: 9m 9s. Rate: 151.1 symbols/min [2025-10-06T22:38:19.229868] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:19.255994] [DEBUG] [LOCAL ] FC: Loaded 15376 existing records from primary storage. [2025-10-06T22:38:19.256204] [INFO ] [MAIN ] FC: Loaded 15376 primary data records. [2025-10-06T22:38:19.384039] [DEBUG] [LOCAL ] FBP: Loaded 45899 existing records from primary storage. [2025-10-06T22:38:19.384690] [INFO ] [MAIN ] FBP: Loaded 45899 primary data records. [2025-10-06T22:38:19.529890] [DEBUG] [LOCAL ] FBRT: Loaded 34881 existing records from primary storage. [2025-10-06T22:38:19.683388] [INFO ] [MAIN ] FBRT: Loaded 34881 primary data records. [2025-10-06T22:38:20.281955] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:20.283078] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 15376 primary records. [2025-10-06T22:38:20.296543] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-06T22:38:20.297023] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:20.297893] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 45899 primary records. [2025-10-06T22:38:20.298001] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-06T22:38:20.330452] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-10-06T22:38:20.330780] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-10-06T22:38:20.330849] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-06T22:38:20.334121] [INFO ] [MAIN ] Derivative Progress: 655/2037 symbols completed. FBP took 1.2s. Estimated remaining: 9m 10s. Rate: 150.7 symbols/min [2025-10-06T22:38:20.334238] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-06T22:38:20.334345] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:20.336907] [INFO ] [MAIN ] Derivative Progress: 656/2037 symbols completed. FC took 1.1s. Estimated remaining: 9m 9s. Rate: 150.9 symbols/min [2025-10-06T22:38:20.337297] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:20.356079] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:20.356872] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 34881 primary records. [2025-10-06T22:38:20.357085] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-06T22:38:20.383405] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-10-06T22:38:20.383836] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-06T22:38:20.387298] [INFO ] [MAIN ] Derivative Progress: 657/2037 symbols completed. FBRT took 1.2s. Estimated remaining: 9m 8s. Rate: 151.1 symbols/min [2025-10-06T22:38:20.397461] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:20.406768] [DEBUG] [LOCAL ] FCN: Loaded 25991 existing records from primary storage. [2025-10-06T22:38:20.406898] [INFO ] [MAIN ] FCN: Loaded 25991 primary data records. [2025-10-06T22:38:20.521279] [DEBUG] [LOCAL ] FCF: Loaded 39322 existing records from primary storage. [2025-10-06T22:38:20.532422] [INFO ] [MAIN ] FCF: Loaded 39322 primary data records. [2025-10-06T22:38:20.860683] [DEBUG] [LOCAL ] FCPT: Loaded 37322 existing records from primary storage. [2025-10-06T22:38:20.892691] [INFO ] [MAIN ] FCPT: Loaded 37322 primary data records. [2025-10-06T22:38:21.355349] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:21.357331] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 25991 primary records. [2025-10-06T22:38:21.358375] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-06T22:38:21.377978] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-10-06T22:38:21.379813] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-06T22:38:21.382250] [INFO ] [MAIN ] Derivative Progress: 658/2037 symbols completed. FCN took 1.0s. Estimated remaining: 9m 9s. Rate: 150.8 symbols/min [2025-10-06T22:38:21.397205] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:21.397941] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39322 primary records. [2025-10-06T22:38:21.398138] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-06T22:38:21.414817] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-10-06T22:38:21.414944] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-06T22:38:21.417797] [INFO ] [MAIN ] Derivative Progress: 659/2037 symbols completed. FCF took 1.1s. Estimated remaining: 9m 8s. Rate: 151.0 symbols/min [2025-10-06T22:38:21.432828] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:21.433496] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37322 primary records. [2025-10-06T22:38:21.433587] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-06T22:38:21.449419] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-10-06T22:38:21.449478] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-06T22:38:21.452259] [INFO ] [MAIN ] Derivative Progress: 660/2037 symbols completed. FCPT took 1.1s. Estimated remaining: 9m 6s. Rate: 151.2 symbols/min [2025-10-06T22:38:21.452770] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:21.452898] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:21.453205] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:21.471120] [DEBUG] [LOCAL ] FCT: Loaded 14710 existing records from primary storage. [2025-10-06T22:38:21.471468] [INFO ] [MAIN ] FCT: Loaded 14710 primary data records. [2025-10-06T22:38:21.645196] [DEBUG] [LOCAL ] FDP: Loaded 30103 existing records from primary storage. [2025-10-06T22:38:21.679067] [INFO ] [MAIN ] FDP: Loaded 30103 primary data records. [2025-10-06T22:38:21.930205] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-06T22:38:21.948125] [INFO ] [MAIN ] FCX: Loaded 53700 primary data records. [2025-10-06T22:38:22.472420] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:22.473364] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14710 primary records. [2025-10-06T22:38:22.473559] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-06T22:38:22.492737] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-10-06T22:38:22.492927] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-06T22:38:22.495667] [INFO ] [MAIN ] Derivative Progress: 661/2037 symbols completed. FCT took 1.0s. Estimated remaining: 9m 7s. Rate: 150.8 symbols/min [2025-10-06T22:38:22.495965] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:22.516237] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:22.517194] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 30103 primary records. [2025-10-06T22:38:22.517557] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-06T22:38:22.548151] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-10-06T22:38:22.548255] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-06T22:38:22.551062] [INFO ] [MAIN ] Derivative Progress: 662/2037 symbols completed. FDP took 1.1s. Estimated remaining: 9m 6s. Rate: 151.0 symbols/min [2025-10-06T22:38:22.553375] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:22.577917] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:22.578925] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53700 primary records. [2025-10-06T22:38:22.579135] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-06T22:38:22.580318] [DEBUG] [LOCAL ] FDS: Loaded 26884 existing records from primary storage. [2025-10-06T22:38:22.580715] [INFO ] [MAIN ] FDS: Loaded 26884 primary data records. [2025-10-06T22:38:22.701242] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-10-06T22:38:22.707051] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-06T22:38:22.730150] [INFO ] [MAIN ] Derivative Progress: 663/2037 symbols completed. FCX took 1.3s. Estimated remaining: 9m 5s. Rate: 151.1 symbols/min [2025-10-06T22:38:22.761143] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:22.935449] [DEBUG] [LOCAL ] FDX: Loaded 51530 existing records from primary storage. [2025-10-06T22:38:22.936161] [INFO ] [MAIN ] FDX: Loaded 51530 primary data records. [2025-10-06T22:38:23.275447] [DEBUG] [LOCAL ] FE: Loaded 53430 existing records from primary storage. [2025-10-06T22:38:23.276926] [INFO ] [MAIN ] FE: Loaded 53430 primary data records. [2025-10-06T22:38:23.368750] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:23.398563] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 26884 primary records. [2025-10-06T22:38:23.398816] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-06T22:38:23.658037] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-10-06T22:38:23.667530] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-06T22:38:23.670420] [INFO ] [MAIN ] Derivative Progress: 664/2037 symbols completed. FDS took 1.2s. Estimated remaining: 9m 6s. Rate: 150.8 symbols/min [2025-10-06T22:38:23.671013] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:23.693596] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:23.694813] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51530 primary records. [2025-10-06T22:38:23.695030] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-06T22:38:23.715148] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-10-06T22:38:23.715488] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-06T22:38:23.718451] [INFO ] [MAIN ] Derivative Progress: 665/2037 symbols completed. FDX took 1.2s. Estimated remaining: 9m 5s. Rate: 151.0 symbols/min [2025-10-06T22:38:23.718874] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:23.752028] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:23.752864] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53430 primary records. [2025-10-06T22:38:23.752987] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-06T22:38:23.783961] [DEBUG] [LOCAL ] FET: Loaded 12814 existing records from primary storage. [2025-10-06T22:38:23.784393] [INFO ] [MAIN ] FET: Loaded 12814 primary data records. [2025-10-06T22:38:23.791029] [DEBUG] [LOCAL ] FERG: Loaded 48790 existing records from primary storage. [2025-10-06T22:38:23.791138] [INFO ] [MAIN ] FERG: Loaded 48790 primary data records. [2025-10-06T22:38:24.034805] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-10-06T22:38:24.080370] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-06T22:38:24.123470] [INFO ] [MAIN ] Derivative Progress: 666/2037 symbols completed. FE took 1.4s. Estimated remaining: 9m 5s. Rate: 151.0 symbols/min [2025-10-06T22:38:24.255059] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:24.447480] [DEBUG] [LOCAL ] FF: Loaded 24656 existing records from primary storage. [2025-10-06T22:38:24.448124] [INFO ] [MAIN ] FF: Loaded 24656 primary data records. [2025-10-06T22:38:24.462201] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:24.507006] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48790 primary records. [2025-10-06T22:38:24.529436] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-06T22:38:24.626240] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:24.679286] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12814 primary records. [2025-10-06T22:38:24.682019] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-06T22:38:24.805508] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-10-06T22:38:24.820479] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-06T22:38:24.828182] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-10-06T22:38:24.830841] [INFO ] [MAIN ] Derivative Progress: 667/2037 symbols completed. FERG took 1.2s. Estimated remaining: 9m 5s. Rate: 150.8 symbols/min [2025-10-06T22:38:24.831727] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-06T22:38:24.835638] [INFO ] [MAIN ] Derivative Progress: 668/2037 symbols completed. FET took 1.1s. Estimated remaining: 9m 4s. Rate: 151.1 symbols/min [2025-10-06T22:38:24.832134] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:24.836888] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:24.851785] [DEBUG] [LOCAL ] FFA: Loaded 5960 existing records from primary storage. [2025-10-06T22:38:24.860021] [INFO ] [MAIN ] FFA: Loaded 5960 primary data records. [2025-10-06T22:38:24.877220] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:24.902603] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 24656 primary records. [2025-10-06T22:38:24.915300] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-06T22:38:24.983049] [DEBUG] [LOCAL ] FFC: Loaded 16713 existing records from primary storage. [2025-10-06T22:38:24.996023] [INFO ] [MAIN ] FFC: Loaded 16713 primary data records. [2025-10-06T22:38:25.513481] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-10-06T22:38:25.554046] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-06T22:38:25.557170] [INFO ] [MAIN ] Derivative Progress: 669/2037 symbols completed. FF took 1.3s. Estimated remaining: 9m 4s. Rate: 150.9 symbols/min [2025-10-06T22:38:25.558662] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:25.604707] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:25.607809] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 5960 primary records. [2025-10-06T22:38:25.607966] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-06T22:38:25.631469] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:25.648691] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-10-06T22:38:25.651083] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-06T22:38:25.650846] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16713 primary records. [2025-10-06T22:38:25.653410] [INFO ] [MAIN ] Derivative Progress: 670/2037 symbols completed. FFA took 0.8s. Estimated remaining: 9m 3s. Rate: 151.1 symbols/min [2025-10-06T22:38:25.653559] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-06T22:38:25.653768] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:25.655181] [DEBUG] [LOCAL ] FFWM: Loaded 35744 existing records from primary storage. [2025-10-06T22:38:25.656066] [INFO ] [MAIN ] FFWM: Loaded 35744 primary data records. [2025-10-06T22:38:25.717695] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-10-06T22:38:25.717994] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-06T22:38:25.721368] [INFO ] [MAIN ] Derivative Progress: 671/2037 symbols completed. FFC took 0.9s. Estimated remaining: 9m 2s. Rate: 151.2 symbols/min [2025-10-06T22:38:25.742155] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:25.761996] [DEBUG] [LOCAL ] FGN: Loaded 3847 existing records from primary storage. [2025-10-06T22:38:25.780676] [INFO ] [MAIN ] FGN: Loaded 3847 primary data records. [2025-10-06T22:38:26.325468] [DEBUG] [LOCAL ] FHI: Loaded 40064 existing records from primary storage. [2025-10-06T22:38:26.326109] [INFO ] [MAIN ] FHI: Loaded 40064 primary data records. [2025-10-06T22:38:26.662638] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:26.664532] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 35744 primary records. [2025-10-06T22:38:26.665061] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-06T22:38:26.685920] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:26.692623] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3847 primary records. [2025-10-06T22:38:26.696235] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-10-06T22:38:26.693427] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-06T22:38:26.696442] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-06T22:38:26.699163] [INFO ] [MAIN ] Derivative Progress: 672/2037 symbols completed. FFWM took 1.1s. Estimated remaining: 9m 3s. Rate: 150.9 symbols/min [2025-10-06T22:38:26.699504] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:26.718300] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-10-06T22:38:26.719633] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-06T22:38:26.722994] [INFO ] [MAIN ] Derivative Progress: 673/2037 symbols completed. FGN took 1.1s. Estimated remaining: 9m 2s. Rate: 151.1 symbols/min [2025-10-06T22:38:26.738522] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:26.739299] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 40064 primary records. [2025-10-06T22:38:26.739392] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-06T22:38:26.755626] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-10-06T22:38:26.768959] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-06T22:38:26.771525] [INFO ] [MAIN ] Derivative Progress: 674/2037 symbols completed. FHI took 1.0s. Estimated remaining: 9m 0s. Rate: 151.3 symbols/min [2025-10-06T22:38:26.792738] [DEBUG] [LOCAL ] FHN: Loaded 53368 existing records from primary storage. [2025-10-06T22:38:26.792920] [INFO ] [MAIN ] FHN: Loaded 53368 primary data records. [2025-10-06T22:38:27.099477] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:27.100146] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53368 primary records. [2025-10-06T22:38:27.100208] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-06T22:38:27.115688] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-10-06T22:38:27.115764] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-06T22:38:27.118075] [INFO ] [MAIN ] Derivative Progress: 675/2037 symbols completed. FHN took 0.4s. Estimated remaining: 8m 60s. Rate: 151.3 symbols/min [2025-10-06T22:38:27.118804] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:27.118915] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:27.118726] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:27.159066] [DEBUG] [LOCAL ] FICO: Loaded 21078 existing records from primary storage. [2025-10-06T22:38:27.159426] [INFO ] [MAIN ] FICO: Loaded 21078 primary data records. [2025-10-06T22:38:27.293401] [DEBUG] [LOCAL ] FIGS: Loaded 48868 existing records from primary storage. [2025-10-06T22:38:27.299560] [INFO ] [MAIN ] FIGS: Loaded 48868 primary data records. [2025-10-06T22:38:27.625169] [DEBUG] [LOCAL ] FI: Loaded 53525 existing records from primary storage. [2025-10-06T22:38:27.626717] [INFO ] [MAIN ] FI: Loaded 53525 primary data records. [2025-10-06T22:38:28.187379] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:38:28.188638] [INFO ] [MAIN ] FICO: Generated 1793 derivative records from 21078 primary records. [2025-10-06T22:38:28.188984] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-06T22:38:28.211293] [DEBUG] [LOCAL ] FICO: Derivative data saved (1793 records). [2025-10-06T22:38:28.228597] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-06T22:38:28.233152] [INFO ] [MAIN ] Derivative Progress: 676/2037 symbols completed. FICO took 1.1s. Estimated remaining: 9m 1s. Rate: 150.9 symbols/min [2025-10-06T22:38:28.230438] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:28.234443] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48868 primary records. [2025-10-06T22:38:28.234667] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:28.234926] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-06T22:38:28.265117] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:28.266719] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53525 primary records. [2025-10-06T22:38:28.267326] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-06T22:38:28.269929] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-10-06T22:38:28.270664] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-06T22:38:28.275218] [INFO ] [MAIN ] Derivative Progress: 677/2037 symbols completed. FIGS took 1.2s. Estimated remaining: 8m 60s. Rate: 151.1 symbols/min [2025-10-06T22:38:28.283377] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:28.308536] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-10-06T22:38:28.309075] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-06T22:38:28.308980] [DEBUG] [LOCAL ] FINS: Loaded 8268 existing records from primary storage. [2025-10-06T22:38:28.312740] [INFO ] [MAIN ] FINS: Loaded 8268 primary data records. [2025-10-06T22:38:28.312346] [INFO ] [MAIN ] Derivative Progress: 678/2037 symbols completed. FI took 1.2s. Estimated remaining: 8m 59s. Rate: 151.3 symbols/min [2025-10-06T22:38:28.313013] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:28.407897] [DEBUG] [LOCAL ] FIHL: Loaded 39695 existing records from primary storage. [2025-10-06T22:38:28.429454] [INFO ] [MAIN ] FIHL: Loaded 39695 primary data records. [2025-10-06T22:38:28.799089] [DEBUG] [LOCAL ] FINV: Loaded 45189 existing records from primary storage. [2025-10-06T22:38:28.810393] [INFO ] [MAIN ] FINV: Loaded 45189 primary data records. [2025-10-06T22:38:29.328801] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:29.330154] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8268 primary records. [2025-10-06T22:38:29.331842] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-06T22:38:29.357587] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-10-06T22:38:29.362859] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-06T22:38:29.366410] [INFO ] [MAIN ] Derivative Progress: 679/2037 symbols completed. FINS took 1.1s. Estimated remaining: 8m 60s. Rate: 151.0 symbols/min [2025-10-06T22:38:29.366691] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:29.367194] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:29.368122] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 39695 primary records. [2025-10-06T22:38:29.368520] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-06T22:38:29.386125] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-10-06T22:38:29.386424] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-06T22:38:29.389794] [INFO ] [MAIN ] Derivative Progress: 680/2037 symbols completed. FIHL took 1.2s. Estimated remaining: 8m 59s. Rate: 151.2 symbols/min [2025-10-06T22:38:29.390134] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:29.407898] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:29.408857] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45189 primary records. [2025-10-06T22:38:29.408965] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-06T22:38:29.426337] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-10-06T22:38:29.426419] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-06T22:38:29.429301] [INFO ] [MAIN ] Derivative Progress: 681/2037 symbols completed. FINV took 1.1s. Estimated remaining: 8m 57s. Rate: 151.4 symbols/min [2025-10-06T22:38:29.429681] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:29.457886] [DEBUG] [LOCAL ] FLC: Loaded 5358 existing records from primary storage. [2025-10-06T22:38:29.458883] [INFO ] [MAIN ] FLC: Loaded 5358 primary data records. [2025-10-06T22:38:29.529690] [DEBUG] [LOCAL ] FIX: Loaded 29431 existing records from primary storage. [2025-10-06T22:38:29.551733] [INFO ] [MAIN ] FIX: Loaded 29431 primary data records. [2025-10-06T22:38:29.634501] [DEBUG] [LOCAL ] FIS: Loaded 53356 existing records from primary storage. [2025-10-06T22:38:29.669948] [INFO ] [MAIN ] FIS: Loaded 53356 primary data records. [2025-10-06T22:38:30.764714] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:30.786112] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5358 primary records. [2025-10-06T22:38:30.789696] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-06T22:38:30.790208] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:30.794005] [INFO ] [MAIN ] FIX: Generated 1794 derivative records from 29431 primary records. [2025-10-06T22:38:30.794238] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-06T22:38:30.842520] [DEBUG] [LOCAL ] FIX: Derivative data saved (1794 records). [2025-10-06T22:38:30.843959] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-06T22:38:30.848250] [INFO ] [MAIN ] Derivative Progress: 682/2037 symbols completed. FIX took 1.5s. Estimated remaining: 8m 59s. Rate: 150.8 symbols/min [2025-10-06T22:38:30.862310] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-10-06T22:38:30.871014] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:30.870838] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-06T22:38:30.875107] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:30.876756] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53356 primary records. [2025-10-06T22:38:30.874012] [INFO ] [MAIN ] Derivative Progress: 683/2037 symbols completed. FLC took 1.4s. Estimated remaining: 8m 58s. Rate: 151.0 symbols/min [2025-10-06T22:38:30.877005] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:30.877232] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-06T22:38:30.906261] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-10-06T22:38:30.906587] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-06T22:38:30.911064] [INFO ] [MAIN ] Derivative Progress: 684/2037 symbols completed. FIS took 1.5s. Estimated remaining: 8m 57s. Rate: 151.2 symbols/min [2025-10-06T22:38:30.911674] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:30.961818] [DEBUG] [LOCAL ] FLNG: Loaded 33633 existing records from primary storage. [2025-10-06T22:38:30.962148] [INFO ] [MAIN ] FLNG: Loaded 33633 primary data records. [2025-10-06T22:38:31.056556] [DEBUG] [LOCAL ] FLG: Loaded 53331 existing records from primary storage. [2025-10-06T22:38:31.088380] [INFO ] [MAIN ] FLG: Loaded 53331 primary data records. [2025-10-06T22:38:31.441715] [DEBUG] [LOCAL ] FLO: Loaded 51944 existing records from primary storage. [2025-10-06T22:38:31.471450] [INFO ] [MAIN ] FLO: Loaded 51944 primary data records. [2025-10-06T22:38:32.063245] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:32.065502] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33633 primary records. [2025-10-06T22:38:32.066103] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-06T22:38:32.096914] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:32.099516] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53331 primary records. [2025-10-06T22:38:32.100620] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-06T22:38:32.118727] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-10-06T22:38:32.117548] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-10-06T22:38:32.118985] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-06T22:38:32.121575] [INFO ] [MAIN ] Derivative Progress: 685/2037 symbols completed. FLNG took 1.2s. Estimated remaining: 8m 58s. Rate: 150.8 symbols/min [2025-10-06T22:38:32.122012] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:32.122736] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-06T22:38:32.125689] [INFO ] [MAIN ] Derivative Progress: 686/2037 symbols completed. FLG took 1.3s. Estimated remaining: 8m 57s. Rate: 151.0 symbols/min [2025-10-06T22:38:32.125915] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:32.143877] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:32.144703] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 51944 primary records. [2025-10-06T22:38:32.144973] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-06T22:38:32.163001] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-10-06T22:38:32.163228] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-06T22:38:32.166058] [INFO ] [MAIN ] Derivative Progress: 687/2037 symbols completed. FLO took 1.3s. Estimated remaining: 8m 56s. Rate: 151.2 symbols/min [2025-10-06T22:38:32.166290] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:32.225564] [DEBUG] [LOCAL ] FLR: Loaded 53157 existing records from primary storage. [2025-10-06T22:38:32.226919] [INFO ] [MAIN ] FLR: Loaded 53157 primary data records. [2025-10-06T22:38:32.227888] [DEBUG] [LOCAL ] FLS: Loaded 50202 existing records from primary storage. [2025-10-06T22:38:32.263953] [INFO ] [MAIN ] FLS: Loaded 50202 primary data records. [2025-10-06T22:38:32.730694] [DEBUG] [LOCAL ] FLUT: Loaded 50782 existing records from primary storage. [2025-10-06T22:38:32.842596] [INFO ] [MAIN ] FLUT: Loaded 50782 primary data records. [2025-10-06T22:38:33.201092] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:33.214676] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50202 primary records. [2025-10-06T22:38:33.214951] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:33.215156] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-06T22:38:33.215768] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53157 primary records. [2025-10-06T22:38:33.216448] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-06T22:38:33.246753] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-10-06T22:38:33.248678] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-06T22:38:33.251809] [INFO ] [MAIN ] Derivative Progress: 688/2037 symbols completed. FLS took 1.1s. Estimated remaining: 8m 57s. Rate: 150.8 symbols/min [2025-10-06T22:38:33.267877] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:33.269390] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50782 primary records. [2025-10-06T22:38:33.269478] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-06T22:38:33.268610] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-10-06T22:38:33.270032] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-06T22:38:33.272495] [INFO ] [MAIN ] Derivative Progress: 689/2037 symbols completed. FLR took 1.2s. Estimated remaining: 8m 56s. Rate: 151.0 symbols/min [2025-10-06T22:38:33.288262] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-10-06T22:38:33.288359] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-06T22:38:33.292092] [INFO ] [MAIN ] Derivative Progress: 690/2037 symbols completed. FLUT took 1.1s. Estimated remaining: 8m 54s. Rate: 151.2 symbols/min [2025-10-06T22:38:33.292500] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:33.292742] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:33.292890] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:33.303360] [DEBUG] [LOCAL ] FMN: Loaded 5340 existing records from primary storage. [2025-10-06T22:38:33.303626] [INFO ] [MAIN ] FMN: Loaded 5340 primary data records. [2025-10-06T22:38:33.420290] [DEBUG] [LOCAL ] FLXR: Loaded 20614 existing records from primary storage. [2025-10-06T22:38:33.420550] [INFO ] [MAIN ] FLXR: Loaded 20614 primary data records. [2025-10-06T22:38:33.837187] [DEBUG] [LOCAL ] FMC: Loaded 51802 existing records from primary storage. [2025-10-06T22:38:33.954837] [INFO ] [MAIN ] FMC: Loaded 51802 primary data records. [2025-10-06T22:38:34.352434] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:34.355610] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 5340 primary records. [2025-10-06T22:38:34.355806] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-06T22:38:34.394207] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-10-06T22:38:34.395103] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-06T22:38:34.398724] [INFO ] [MAIN ] Derivative Progress: 691/2037 symbols completed. FMN took 1.1s. Estimated remaining: 8m 55s. Rate: 150.8 symbols/min [2025-10-06T22:38:34.399037] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:34.394724] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:34.401213] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 20614 primary records. [2025-10-06T22:38:34.401352] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-06T22:38:34.419837] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-10-06T22:38:34.420348] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-06T22:38:34.423842] [INFO ] [MAIN ] Derivative Progress: 692/2037 symbols completed. FLXR took 1.1s. Estimated remaining: 8m 54s. Rate: 151.0 symbols/min [2025-10-06T22:38:34.425484] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:34.440891] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:34.441789] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51802 primary records. [2025-10-06T22:38:34.441945] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-06T22:38:34.472697] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-10-06T22:38:34.472990] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-06T22:38:34.476697] [INFO ] [MAIN ] Derivative Progress: 693/2037 symbols completed. FMC took 1.2s. Estimated remaining: 8m 53s. Rate: 151.2 symbols/min [2025-10-06T22:38:34.477089] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:34.494011] [DEBUG] [LOCAL ] FMY: Loaded 1383 existing records from primary storage. [2025-10-06T22:38:34.494243] [INFO ] [MAIN ] FMY: Loaded 1383 primary data records. [2025-10-06T22:38:34.495249] [DEBUG] [LOCAL ] FMS: Loaded 30006 existing records from primary storage. [2025-10-06T22:38:34.525489] [INFO ] [MAIN ] FMS: Loaded 30006 primary data records. [2025-10-06T22:38:34.739393] [DEBUG] [LOCAL ] FMX: Loaded 40749 existing records from primary storage. [2025-10-06T22:38:34.749906] [INFO ] [MAIN ] FMX: Loaded 40749 primary data records. [2025-10-06T22:38:35.567420] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-06T22:38:35.570376] [INFO ] [MAIN ] FMY: Generated 1790 derivative records from 1383 primary records. [2025-10-06T22:38:35.571561] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-06T22:38:35.596424] [DEBUG] [LOCAL ] FMY: Derivative data saved (1790 records). [2025-10-06T22:38:35.602050] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-06T22:38:35.605397] [INFO ] [MAIN ] Derivative Progress: 694/2037 symbols completed. FMY took 1.1s. Estimated remaining: 8m 54s. Rate: 150.8 symbols/min [2025-10-06T22:38:35.605680] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:35.602461] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:35.607106] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30006 primary records. [2025-10-06T22:38:35.607697] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-06T22:38:35.628783] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-10-06T22:38:35.629031] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-06T22:38:35.632570] [INFO ] [MAIN ] Derivative Progress: 695/2037 symbols completed. FMS took 1.2s. Estimated remaining: 8m 53s. Rate: 151.0 symbols/min [2025-10-06T22:38:35.633413] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:35.649598] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:35.650817] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40749 primary records. [2025-10-06T22:38:35.651011] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-06T22:38:35.680581] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-10-06T22:38:35.680812] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-06T22:38:35.684585] [INFO ] [MAIN ] Derivative Progress: 696/2037 symbols completed. FMX took 1.3s. Estimated remaining: 8m 52s. Rate: 151.2 symbols/min [2025-10-06T22:38:35.684981] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:35.703867] [DEBUG] [LOCAL ] FN: Loaded 38314 existing records from primary storage. [2025-10-06T22:38:35.704104] [INFO ] [MAIN ] FN: Loaded 38314 primary data records. [2025-10-06T22:38:35.941056] [DEBUG] [LOCAL ] FNB: Loaded 52507 existing records from primary storage. [2025-10-06T22:38:35.946426] [INFO ] [MAIN ] FNB: Loaded 52507 primary data records. [2025-10-06T22:38:36.207034] [DEBUG] [LOCAL ] FND: Loaded 52088 existing records from primary storage. [2025-10-06T22:38:36.218380] [INFO ] [MAIN ] FND: Loaded 52088 primary data records. [2025-10-06T22:38:36.824363] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:36.827488] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 38314 primary records. [2025-10-06T22:38:36.828599] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-06T22:38:36.851748] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-10-06T22:38:36.852084] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-06T22:38:36.856190] [INFO ] [MAIN ] Derivative Progress: 697/2037 symbols completed. FN took 1.3s. Estimated remaining: 8m 53s. Rate: 150.8 symbols/min [2025-10-06T22:38:36.856625] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:36.877361] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:36.878735] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52507 primary records. [2025-10-06T22:38:36.878982] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-06T22:38:36.899134] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-10-06T22:38:36.899458] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-06T22:38:36.901922] [INFO ] [MAIN ] Derivative Progress: 698/2037 symbols completed. FNB took 1.3s. Estimated remaining: 8m 52s. Rate: 151.0 symbols/min [2025-10-06T22:38:36.902483] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:36.927577] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:36.939829] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52088 primary records. [2025-10-06T22:38:36.940123] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-06T22:38:36.964587] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-10-06T22:38:36.964925] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-06T22:38:36.968701] [INFO ] [MAIN ] Derivative Progress: 699/2037 symbols completed. FND took 1.3s. Estimated remaining: 8m 51s. Rate: 151.2 symbols/min [2025-10-06T22:38:36.969052] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:36.985868] [DEBUG] [LOCAL ] FNF: Loaded 48975 existing records from primary storage. [2025-10-06T22:38:36.986262] [INFO ] [MAIN ] FNF: Loaded 48975 primary data records. [2025-10-06T22:38:37.137135] [DEBUG] [LOCAL ] FOA: Loaded 13043 existing records from primary storage. [2025-10-06T22:38:37.172625] [DEBUG] [LOCAL ] FNV: Loaded 46139 existing records from primary storage. [2025-10-06T22:38:37.171135] [INFO ] [MAIN ] FOA: Loaded 13043 primary data records. [2025-10-06T22:38:37.181738] [INFO ] [MAIN ] FNV: Loaded 46139 primary data records. [2025-10-06T22:38:38.042447] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:38.044522] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 48975 primary records. [2025-10-06T22:38:38.044996] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-06T22:38:38.079079] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:38.082479] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13043 primary records. [2025-10-06T22:38:38.086742] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-06T22:38:38.088497] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-10-06T22:38:38.102842] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-06T22:38:38.105325] [INFO ] [MAIN ] Derivative Progress: 700/2037 symbols completed. FNF took 1.2s. Estimated remaining: 8m 52s. Rate: 150.8 symbols/min [2025-10-06T22:38:38.106204] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:38.118284] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:38.120071] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46139 primary records. [2025-10-06T22:38:38.120948] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-06T22:38:38.146880] [DEBUG] [LOCAL ] FOF: Loaded 8463 existing records from primary storage. [2025-10-06T22:38:38.148132] [INFO ] [MAIN ] FOF: Loaded 8463 primary data records. [2025-10-06T22:38:38.160108] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-10-06T22:38:38.169892] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-06T22:38:38.182861] [INFO ] [MAIN ] Derivative Progress: 701/2037 symbols completed. FOA took 1.2s. Estimated remaining: 8m 51s. Rate: 150.9 symbols/min [2025-10-06T22:38:38.183950] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:38.242978] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-10-06T22:38:38.256422] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-06T22:38:38.291905] [INFO ] [MAIN ] Derivative Progress: 702/2037 symbols completed. FNV took 1.4s. Estimated remaining: 8m 50s. Rate: 151.1 symbols/min [2025-10-06T22:38:38.344787] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:38.358909] [DEBUG] [LOCAL ] FOR: Loaded 19733 existing records from primary storage. [2025-10-06T22:38:38.534363] [INFO ] [MAIN ] FOR: Loaded 19733 primary data records. [2025-10-06T22:38:38.907337] [DEBUG] [LOCAL ] FOUR: Loaded 49579 existing records from primary storage. [2025-10-06T22:38:38.927180] [INFO ] [MAIN ] FOUR: Loaded 49579 primary data records. [2025-10-06T22:38:38.928307] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:38.946235] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8463 primary records. [2025-10-06T22:38:38.951771] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-06T22:38:39.062008] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-10-06T22:38:39.066140] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-06T22:38:39.075315] [INFO ] [MAIN ] Derivative Progress: 703/2037 symbols completed. FOF took 1.0s. Estimated remaining: 8m 50s. Rate: 150.9 symbols/min [2025-10-06T22:38:39.142054] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:39.168889] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 19733 primary records. [2025-10-06T22:38:39.233674] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-06T22:38:39.315035] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-10-06T22:38:39.315194] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-06T22:38:39.318283] [INFO ] [MAIN ] Derivative Progress: 704/2037 symbols completed. FOR took 1.1s. Estimated remaining: 8m 50s. Rate: 151.0 symbols/min [2025-10-06T22:38:39.338703] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:39.339399] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49579 primary records. [2025-10-06T22:38:39.339463] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-06T22:38:39.354800] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-10-06T22:38:39.354866] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-06T22:38:39.357361] [INFO ] [MAIN ] Derivative Progress: 705/2037 symbols completed. FOUR took 1.0s. Estimated remaining: 8m 49s. Rate: 151.2 symbols/min [2025-10-06T22:38:39.357897] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:39.357837] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:39.358079] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:39.395564] [DEBUG] [LOCAL ] FPF: Loaded 18409 existing records from primary storage. [2025-10-06T22:38:39.402692] [INFO ] [MAIN ] FPF: Loaded 18409 primary data records. [2025-10-06T22:38:39.395198] [DEBUG] [LOCAL ] FPH: Loaded 19298 existing records from primary storage. [2025-10-06T22:38:39.403000] [INFO ] [MAIN ] FPH: Loaded 19298 primary data records. [2025-10-06T22:38:39.637776] [DEBUG] [LOCAL ] FPI: Loaded 31057 existing records from primary storage. [2025-10-06T22:38:39.685261] [INFO ] [MAIN ] FPI: Loaded 31057 primary data records. [2025-10-06T22:38:40.452101] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:40.453551] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 18409 primary records. [2025-10-06T22:38:40.454119] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-06T22:38:40.491713] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-10-06T22:38:40.492146] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:40.492680] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-06T22:38:40.497293] [INFO ] [MAIN ] Derivative Progress: 706/2037 symbols completed. FPF took 1.1s. Estimated remaining: 8m 50s. Rate: 150.8 symbols/min [2025-10-06T22:38:40.493779] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19298 primary records. [2025-10-06T22:38:40.497773] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-06T22:38:40.498869] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:40.527752] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:40.529117] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31057 primary records. [2025-10-06T22:38:40.529464] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-06T22:38:40.549428] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-10-06T22:38:40.549820] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-06T22:38:40.553185] [INFO ] [MAIN ] Derivative Progress: 707/2037 symbols completed. FPI took 1.2s. Estimated remaining: 8m 49s. Rate: 150.9 symbols/min [2025-10-06T22:38:40.553442] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:40.554704] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-10-06T22:38:40.555126] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-06T22:38:40.558952] [INFO ] [MAIN ] Derivative Progress: 708/2037 symbols completed. FPH took 1.2s. Estimated remaining: 8m 48s. Rate: 151.2 symbols/min [2025-10-06T22:38:40.559298] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:40.602274] [DEBUG] [LOCAL ] FRA: Loaded 14576 existing records from primary storage. [2025-10-06T22:38:40.601639] [DEBUG] [LOCAL ] FRGE: Loaded 17112 existing records from primary storage. [2025-10-06T22:38:40.617423] [INFO ] [MAIN ] FRA: Loaded 14576 primary data records. [2025-10-06T22:38:40.617695] [INFO ] [MAIN ] FRGE: Loaded 17112 primary data records. [2025-10-06T22:38:40.618563] [DEBUG] [LOCAL ] FR: Loaded 46451 existing records from primary storage. [2025-10-06T22:38:40.687589] [INFO ] [MAIN ] FR: Loaded 46451 primary data records. [2025-10-06T22:38:41.623989] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:41.639406] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:41.641706] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46451 primary records. [2025-10-06T22:38:41.643793] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-06T22:38:41.643631] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 17112 primary records. [2025-10-06T22:38:41.646031] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-06T22:38:41.684894] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:41.688430] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14576 primary records. [2025-10-06T22:38:41.689268] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-06T22:38:41.691786] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-10-06T22:38:41.693369] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-06T22:38:41.696971] [INFO ] [MAIN ] Derivative Progress: 709/2037 symbols completed. FRGE took 1.1s. Estimated remaining: 8m 49s. Rate: 150.8 symbols/min [2025-10-06T22:38:41.697599] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:41.716553] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-10-06T22:38:41.717922] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-06T22:38:41.720533] [INFO ] [MAIN ] Derivative Progress: 710/2037 symbols completed. FR took 1.2s. Estimated remaining: 8m 47s. Rate: 151.0 symbols/min [2025-10-06T22:38:41.721078] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:41.722911] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-10-06T22:38:41.723144] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-06T22:38:41.727232] [INFO ] [MAIN ] Derivative Progress: 711/2037 symbols completed. FRA took 1.2s. Estimated remaining: 8m 46s. Rate: 151.2 symbols/min [2025-10-06T22:38:41.727875] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:41.815798] [DEBUG] [LOCAL ] FSCO: Loaded 37913 existing records from primary storage. [2025-10-06T22:38:41.829458] [INFO ] [MAIN ] FSCO: Loaded 37913 primary data records. [2025-10-06T22:38:41.830309] [DEBUG] [LOCAL ] FRT: Loaded 41945 existing records from primary storage. [2025-10-06T22:38:41.830476] [INFO ] [MAIN ] FRT: Loaded 41945 primary data records. [2025-10-06T22:38:41.836393] [DEBUG] [LOCAL ] FRO: Loaded 51693 existing records from primary storage. [2025-10-06T22:38:41.901721] [INFO ] [MAIN ] FRO: Loaded 51693 primary data records. [2025-10-06T22:38:42.839396] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:42.864540] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 41945 primary records. [2025-10-06T22:38:42.865574] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:42.866366] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 37913 primary records. [2025-10-06T22:38:42.866763] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-06T22:38:42.866636] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:42.867411] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51693 primary records. [2025-10-06T22:38:42.868280] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-06T22:38:42.868384] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-06T22:38:42.920979] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-10-06T22:38:42.919478] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-10-06T22:38:42.922308] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-10-06T22:38:42.921468] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-06T22:38:42.922417] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-06T22:38:42.922598] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-06T22:38:42.926041] [INFO ] [MAIN ] Derivative Progress: 712/2037 symbols completed. FRO took 1.2s. Estimated remaining: 8m 47s. Rate: 150.7 symbols/min [2025-10-06T22:38:42.931767] [INFO ] [MAIN ] Derivative Progress: 713/2037 symbols completed. FSCO took 1.2s. Estimated remaining: 8m 46s. Rate: 150.9 symbols/min [2025-10-06T22:38:42.931633] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:42.932058] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:42.932136] [INFO ] [MAIN ] Derivative Progress: 714/2037 symbols completed. FRT took 1.2s. Estimated remaining: 8m 45s. Rate: 151.2 symbols/min [2025-10-06T22:38:42.932977] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:42.996386] [DEBUG] [LOCAL ] FSK: Loaded 49404 existing records from primary storage. [2025-10-06T22:38:43.009100] [INFO ] [MAIN ] FSK: Loaded 49404 primary data records. [2025-10-06T22:38:43.155070] [DEBUG] [LOCAL ] FSM: Loaded 53295 existing records from primary storage. [2025-10-06T22:38:43.149141] [DEBUG] [LOCAL ] FSLY: Loaded 51238 existing records from primary storage. [2025-10-06T22:38:43.170884] [INFO ] [MAIN ] FSLY: Loaded 51238 primary data records. [2025-10-06T22:38:43.170711] [INFO ] [MAIN ] FSM: Loaded 53295 primary data records. [2025-10-06T22:38:44.003829] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:44.005313] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49404 primary records. [2025-10-06T22:38:44.006270] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-06T22:38:44.038751] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:44.042236] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53295 primary records. [2025-10-06T22:38:44.042858] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-06T22:38:44.052766] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-10-06T22:38:44.053854] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-06T22:38:44.056061] [INFO ] [MAIN ] Derivative Progress: 715/2037 symbols completed. FSK took 1.1s. Estimated remaining: 8m 46s. Rate: 150.8 symbols/min [2025-10-06T22:38:44.059117] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:44.074769] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:44.076744] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51238 primary records. [2025-10-06T22:38:44.077170] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-06T22:38:44.093774] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-10-06T22:38:44.094735] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-06T22:38:44.099043] [INFO ] [MAIN ] Derivative Progress: 716/2037 symbols completed. FSM took 1.2s. Estimated remaining: 8m 45s. Rate: 151.0 symbols/min [2025-10-06T22:38:44.100176] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:44.103860] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-10-06T22:38:44.104080] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-06T22:38:44.107479] [INFO ] [MAIN ] Derivative Progress: 717/2037 symbols completed. FSLY took 1.2s. Estimated remaining: 8m 44s. Rate: 151.2 symbols/min [2025-10-06T22:38:44.107815] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:44.139634] [DEBUG] [LOCAL ] FTHY: Loaded 12272 existing records from primary storage. [2025-10-06T22:38:44.139870] [INFO ] [MAIN ] FTHY: Loaded 12272 primary data records. [2025-10-06T22:38:44.140971] [DEBUG] [LOCAL ] FSS: Loaded 34047 existing records from primary storage. [2025-10-06T22:38:44.162719] [INFO ] [MAIN ] FSS: Loaded 34047 primary data records. [2025-10-06T22:38:44.861096] [DEBUG] [LOCAL ] FTI: Loaded 53298 existing records from primary storage. [2025-10-06T22:38:44.863116] [INFO ] [MAIN ] FTI: Loaded 53298 primary data records. [2025-10-06T22:38:45.204911] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:45.205992] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 12272 primary records. [2025-10-06T22:38:45.206337] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-06T22:38:45.241839] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:45.243520] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 34047 primary records. [2025-10-06T22:38:45.243794] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-06T22:38:45.253479] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-10-06T22:38:45.257627] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-06T22:38:45.261303] [INFO ] [MAIN ] Derivative Progress: 718/2037 symbols completed. FTHY took 1.2s. Estimated remaining: 8m 45s. Rate: 150.8 symbols/min [2025-10-06T22:38:45.264560] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-10-06T22:38:45.265124] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-06T22:38:45.268028] [INFO ] [MAIN ] Derivative Progress: 719/2037 symbols completed. FSS took 1.2s. Estimated remaining: 8m 44s. Rate: 151.0 symbols/min [2025-10-06T22:38:45.283423] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:45.284020] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53298 primary records. [2025-10-06T22:38:45.284081] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-06T22:38:45.299503] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-10-06T22:38:45.299568] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-06T22:38:45.302406] [INFO ] [MAIN ] Derivative Progress: 720/2037 symbols completed. FTI took 1.2s. Estimated remaining: 8m 43s. Rate: 151.2 symbols/min [2025-10-06T22:38:45.303009] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:45.302898] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:45.303240] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:45.369182] [DEBUG] [LOCAL ] FTK: Loaded 32430 existing records from primary storage. [2025-10-06T22:38:45.382206] [INFO ] [MAIN ] FTK: Loaded 32430 primary data records. [2025-10-06T22:38:45.419528] [DEBUG] [LOCAL ] FTS: Loaded 42375 existing records from primary storage. [2025-10-06T22:38:45.427248] [INFO ] [MAIN ] FTS: Loaded 42375 primary data records. [2025-10-06T22:38:45.572250] [DEBUG] [LOCAL ] FTV: Loaded 52977 existing records from primary storage. [2025-10-06T22:38:45.579257] [INFO ] [MAIN ] FTV: Loaded 52977 primary data records. [2025-10-06T22:38:46.360883] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:46.362801] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32430 primary records. [2025-10-06T22:38:46.362976] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-06T22:38:46.392225] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:46.395848] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42375 primary records. [2025-10-06T22:38:46.398722] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-10-06T22:38:46.398257] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-06T22:38:46.399005] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-06T22:38:46.401339] [INFO ] [MAIN ] Derivative Progress: 721/2037 symbols completed. FTK took 1.1s. Estimated remaining: 8m 44s. Rate: 150.8 symbols/min [2025-10-06T22:38:46.403271] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:46.429487] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:46.431801] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 52977 primary records. [2025-10-06T22:38:46.432744] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-06T22:38:46.446318] [DEBUG] [LOCAL ] FTWO: Loaded 1872 existing records from primary storage. [2025-10-06T22:38:46.450554] [INFO ] [MAIN ] FTWO: Loaded 1872 primary data records. [2025-10-06T22:38:46.473212] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-10-06T22:38:46.502801] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-10-06T22:38:46.502976] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-06T22:38:46.502711] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-06T22:38:46.519951] [INFO ] [MAIN ] Derivative Progress: 722/2037 symbols completed. FTV took 1.2s. Estimated remaining: 8m 43s. Rate: 150.9 symbols/min [2025-10-06T22:38:46.572865] [INFO ] [MAIN ] Derivative Progress: 723/2037 symbols completed. FTS took 1.2s. Estimated remaining: 8m 42s. Rate: 151.1 symbols/min [2025-10-06T22:38:46.564955] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:46.577591] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:46.876518] [DEBUG] [LOCAL ] FUL: Loaded 32931 existing records from primary storage. [2025-10-06T22:38:46.876960] [INFO ] [MAIN ] FUL: Loaded 32931 primary data records. [2025-10-06T22:38:47.013451] [DEBUG] [LOCAL ] FUBO: Loaded 53700 existing records from primary storage. [2025-10-06T22:38:47.023950] [INFO ] [MAIN ] FUBO: Loaded 53700 primary data records. [2025-10-06T22:38:47.348483] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:38:47.355200] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1872 primary records. [2025-10-06T22:38:47.366699] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-06T22:38:47.575848] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-10-06T22:38:47.576130] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-06T22:38:47.578480] [INFO ] [MAIN ] Derivative Progress: 724/2037 symbols completed. FTWO took 1.2s. Estimated remaining: 8m 42s. Rate: 150.8 symbols/min [2025-10-06T22:38:47.579866] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:47.605790] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:47.607296] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 32931 primary records. [2025-10-06T22:38:47.607629] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-06T22:38:47.631799] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-10-06T22:38:47.645339] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-06T22:38:47.645697] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:47.648165] [INFO ] [MAIN ] Derivative Progress: 725/2037 symbols completed. FUL took 1.1s. Estimated remaining: 8m 41s. Rate: 151.0 symbols/min [2025-10-06T22:38:47.649297] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53700 primary records. [2025-10-06T22:38:47.649467] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:47.649530] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-06T22:38:47.681745] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-10-06T22:38:47.695215] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-06T22:38:47.703798] [INFO ] [MAIN ] Derivative Progress: 726/2037 symbols completed. FUBO took 1.1s. Estimated remaining: 8m 40s. Rate: 151.2 symbols/min [2025-10-06T22:38:47.704102] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:47.705744] [DEBUG] [LOCAL ] FUN: Loaded 51688 existing records from primary storage. [2025-10-06T22:38:47.706215] [INFO ] [MAIN ] FUN: Loaded 51688 primary data records. [2025-10-06T22:38:47.805672] [DEBUG] [LOCAL ] FVR: Loaded 21748 existing records from primary storage. [2025-10-06T22:38:47.815701] [INFO ] [MAIN ] FVR: Loaded 21748 primary data records. [2025-10-06T22:38:48.224056] [DEBUG] [LOCAL ] FVRR: Loaded 40140 existing records from primary storage. [2025-10-06T22:38:48.352549] [INFO ] [MAIN ] FVRR: Loaded 40140 primary data records. [2025-10-06T22:38:48.680799] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:48.685926] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51688 primary records. [2025-10-06T22:38:48.686277] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-06T22:38:48.716115] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:48.718510] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 21748 primary records. [2025-10-06T22:38:48.719615] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-06T22:38:48.719293] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-10-06T22:38:48.720247] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-06T22:38:48.722600] [INFO ] [MAIN ] Derivative Progress: 727/2037 symbols completed. FUN took 1.1s. Estimated remaining: 8m 41s. Rate: 150.8 symbols/min [2025-10-06T22:38:48.723258] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:48.739800] [DEBUG] [LOCAL ] FXED: Loaded 1246 existing records from primary storage. [2025-10-06T22:38:48.741787] [INFO ] [MAIN ] FXED: Loaded 1246 primary data records. [2025-10-06T22:38:48.779411] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-10-06T22:38:48.812318] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-06T22:38:48.815015] [INFO ] [MAIN ] Derivative Progress: 728/2037 symbols completed. FVR took 1.2s. Estimated remaining: 8m 40s. Rate: 151.0 symbols/min [2025-10-06T22:38:48.832789] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:49.001504] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:49.100791] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40140 primary records. [2025-10-06T22:38:49.116630] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-06T22:38:49.149206] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-10-06T22:38:49.150580] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-06T22:38:49.154061] [INFO ] [MAIN ] Derivative Progress: 729/2037 symbols completed. FVRR took 1.4s. Estimated remaining: 8m 40s. Rate: 151.0 symbols/min [2025-10-06T22:38:49.154380] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:49.193592] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:38:49.195582] [DEBUG] [LOCAL ] G: Loaded 49955 existing records from primary storage. [2025-10-06T22:38:49.194612] [INFO ] [MAIN ] FXED: Generated 1793 derivative records from 1246 primary records. [2025-10-06T22:38:49.195871] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-06T22:38:49.195998] [INFO ] [MAIN ] G: Loaded 49955 primary data records. [2025-10-06T22:38:49.317700] [DEBUG] [LOCAL ] GAB: Loaded 27872 existing records from primary storage. [2025-10-06T22:38:49.332210] [INFO ] [MAIN ] GAB: Loaded 27872 primary data records. [2025-10-06T22:38:49.336343] [DEBUG] [LOCAL ] FXED: Derivative data saved (1793 records). [2025-10-06T22:38:49.427360] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-06T22:38:49.608616] [INFO ] [MAIN ] Derivative Progress: 730/2037 symbols completed. FXED took 0.9s. Estimated remaining: 8m 39s. Rate: 151.0 symbols/min [2025-10-06T22:38:49.626935] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:49.722185] [DEBUG] [LOCAL ] GAM: Loaded 4002 existing records from primary storage. [2025-10-06T22:38:49.840450] [INFO ] [MAIN ] GAM: Loaded 4002 primary data records. [2025-10-06T22:38:50.179711] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:50.180761] [INFO ] [MAIN ] G: Generated 1794 derivative records from 49955 primary records. [2025-10-06T22:38:50.181530] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-06T22:38:50.218502] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:50.220691] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27872 primary records. [2025-10-06T22:38:50.221072] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-10-06T22:38:50.221335] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-06T22:38:50.224169] [INFO ] [MAIN ] Derivative Progress: 731/2037 symbols completed. G took 1.4s. Estimated remaining: 8m 39s. Rate: 150.9 symbols/min [2025-10-06T22:38:50.224389] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:50.221256] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-06T22:38:50.245146] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-10-06T22:38:50.245621] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-06T22:38:50.248277] [INFO ] [MAIN ] Derivative Progress: 732/2037 symbols completed. GAB took 1.1s. Estimated remaining: 8m 38s. Rate: 151.1 symbols/min [2025-10-06T22:38:50.249966] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:50.267827] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:38:50.268814] [INFO ] [MAIN ] GAM: Generated 1793 derivative records from 4002 primary records. [2025-10-06T22:38:50.269005] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-06T22:38:50.285783] [DEBUG] [LOCAL ] GAM: Derivative data saved (1793 records). [2025-10-06T22:38:50.285898] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-06T22:38:50.289234] [INFO ] [MAIN ] Derivative Progress: 733/2037 symbols completed. GAM took 0.7s. Estimated remaining: 8m 37s. Rate: 151.3 symbols/min [2025-10-06T22:38:50.316671] [DEBUG] [LOCAL ] GATX: Loaded 18134 existing records from primary storage. [2025-10-06T22:38:50.316811] [INFO ] [MAIN ] GATX: Loaded 18134 primary data records. [2025-10-06T22:38:50.487197] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-06T22:38:50.510984] [INFO ] [MAIN ] GAP: Loaded 53653 primary data records. [2025-10-06T22:38:51.001140] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:51.002210] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18134 primary records. [2025-10-06T22:38:51.002436] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-06T22:38:51.028050] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-10-06T22:38:51.028518] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-06T22:38:51.031224] [INFO ] [MAIN ] Derivative Progress: 734/2037 symbols completed. GATX took 0.8s. Estimated remaining: 8m 37s. Rate: 151.1 symbols/min [2025-10-06T22:38:51.045217] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:51.046139] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53653 primary records. [2025-10-06T22:38:51.046206] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-06T22:38:51.063823] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-10-06T22:38:51.064000] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-06T22:38:51.066764] [INFO ] [MAIN ] Derivative Progress: 735/2037 symbols completed. GAP took 0.8s. Estimated remaining: 8m 36s. Rate: 151.3 symbols/min [2025-10-06T22:38:51.067455] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:51.067686] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:51.067335] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:51.089399] [DEBUG] [LOCAL ] GBAB: Loaded 12982 existing records from primary storage. [2025-10-06T22:38:51.089984] [INFO ] [MAIN ] GBAB: Loaded 12982 primary data records. [2025-10-06T22:38:51.276100] [DEBUG] [LOCAL ] GBCI: Loaded 40436 existing records from primary storage. [2025-10-06T22:38:51.276555] [INFO ] [MAIN ] GBCI: Loaded 40436 primary data records. [2025-10-06T22:38:51.277961] [DEBUG] [LOCAL ] GBTG: Loaded 40019 existing records from primary storage. [2025-10-06T22:38:51.342616] [INFO ] [MAIN ] GBTG: Loaded 40019 primary data records. [2025-10-06T22:38:52.234031] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:52.235933] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 12982 primary records. [2025-10-06T22:38:52.236075] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-06T22:38:52.260664] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-10-06T22:38:52.278147] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-06T22:38:52.278611] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:52.282386] [INFO ] [MAIN ] Derivative Progress: 736/2037 symbols completed. GBAB took 1.2s. Estimated remaining: 8m 37s. Rate: 150.8 symbols/min [2025-10-06T22:38:52.283369] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40019 primary records. [2025-10-06T22:38:52.301467] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-06T22:38:52.302411] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:52.306298] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:52.319741] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40436 primary records. [2025-10-06T22:38:52.324021] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-06T22:38:52.324417] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-10-06T22:38:52.326014] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-06T22:38:52.329477] [INFO ] [MAIN ] Derivative Progress: 737/2037 symbols completed. GBTG took 1.3s. Estimated remaining: 8m 36s. Rate: 151.0 symbols/min [2025-10-06T22:38:52.330073] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:52.351624] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-10-06T22:38:52.351897] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-06T22:38:52.355960] [INFO ] [MAIN ] Derivative Progress: 738/2037 symbols completed. GBCI took 1.3s. Estimated remaining: 8m 35s. Rate: 151.2 symbols/min [2025-10-06T22:38:52.356368] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:52.385801] [DEBUG] [LOCAL ] GBX: Loaded 29064 existing records from primary storage. [2025-10-06T22:38:52.386096] [INFO ] [MAIN ] GBX: Loaded 29064 primary data records. [2025-10-06T22:38:52.561692] [DEBUG] [LOCAL ] GCO: Loaded 24281 existing records from primary storage. [2025-10-06T22:38:52.578108] [INFO ] [MAIN ] GCO: Loaded 24281 primary data records. [2025-10-06T22:38:52.584500] [DEBUG] [LOCAL ] GCI: Loaded 44118 existing records from primary storage. [2025-10-06T22:38:52.620009] [INFO ] [MAIN ] GCI: Loaded 44118 primary data records. [2025-10-06T22:38:53.555346] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:53.557269] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29064 primary records. [2025-10-06T22:38:53.557413] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-06T22:38:53.581065] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-10-06T22:38:53.584465] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-06T22:38:53.588926] [INFO ] [MAIN ] Derivative Progress: 739/2037 symbols completed. GBX took 1.3s. Estimated remaining: 8m 37s. Rate: 150.8 symbols/min [2025-10-06T22:38:53.589329] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:53.611165] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:53.612592] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 24281 primary records. [2025-10-06T22:38:53.625752] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-06T22:38:53.626319] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:53.628978] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 44118 primary records. [2025-10-06T22:38:53.629140] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-06T22:38:53.667266] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-10-06T22:38:53.668620] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-06T22:38:53.674104] [INFO ] [MAIN ] Derivative Progress: 740/2037 symbols completed. GCO took 1.3s. Estimated remaining: 8m 36s. Rate: 150.9 symbols/min [2025-10-06T22:38:53.675516] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:53.677785] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-10-06T22:38:53.683502] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-06T22:38:53.687668] [INFO ] [MAIN ] Derivative Progress: 741/2037 symbols completed. GCI took 1.4s. Estimated remaining: 8m 34s. Rate: 151.1 symbols/min [2025-10-06T22:38:53.688263] [DEBUG] [LOCAL ] GCTS: Loaded 20127 existing records from primary storage. [2025-10-06T22:38:53.688612] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:53.688839] [INFO ] [MAIN ] GCTS: Loaded 20127 primary data records. [2025-10-06T22:38:53.779510] [DEBUG] [LOCAL ] GCV: Loaded 7525 existing records from primary storage. [2025-10-06T22:38:53.804273] [INFO ] [MAIN ] GCV: Loaded 7525 primary data records. [2025-10-06T22:38:54.341763] [DEBUG] [LOCAL ] GD: Loaded 47000 existing records from primary storage. [2025-10-06T22:38:54.343168] [INFO ] [MAIN ] GD: Loaded 47000 primary data records. [2025-10-06T22:38:54.669048] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:54.670627] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 20127 primary records. [2025-10-06T22:38:54.683007] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-06T22:38:54.684362] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:38:54.685379] [INFO ] [MAIN ] GCV: Generated 1793 derivative records from 7525 primary records. [2025-10-06T22:38:54.693370] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-06T22:38:54.708944] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-10-06T22:38:54.712416] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-06T22:38:54.714834] [INFO ] [MAIN ] Derivative Progress: 742/2037 symbols completed. GCTS took 1.1s. Estimated remaining: 8m 35s. Rate: 150.8 symbols/min [2025-10-06T22:38:54.715182] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:54.722421] [DEBUG] [LOCAL ] GCV: Derivative data saved (1793 records). [2025-10-06T22:38:54.722783] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-06T22:38:54.727262] [INFO ] [MAIN ] Derivative Progress: 743/2037 symbols completed. GCV took 1.1s. Estimated remaining: 8m 34s. Rate: 151.0 symbols/min [2025-10-06T22:38:54.727496] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:54.749190] [DEBUG] [LOCAL ] GDIV: Loaded 3609 existing records from primary storage. [2025-10-06T22:38:54.749945] [INFO ] [MAIN ] GDIV: Loaded 3609 primary data records. [2025-10-06T22:38:54.749848] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:54.787704] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 47000 primary records. [2025-10-06T22:38:54.794295] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-06T22:38:55.001038] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-10-06T22:38:54.999879] [DEBUG] [LOCAL ] GDDY: Loaded 49828 existing records from primary storage. [2025-10-06T22:38:55.107622] [INFO ] [MAIN ] GDDY: Loaded 49828 primary data records. [2025-10-06T22:38:55.120707] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-06T22:38:55.125544] [INFO ] [MAIN ] Derivative Progress: 744/2037 symbols completed. GD took 1.4s. Estimated remaining: 8m 34s. Rate: 151.0 symbols/min [2025-10-06T22:38:55.146948] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:55.239267] [DEBUG] [LOCAL ] GDL: Loaded 2554 existing records from primary storage. [2025-10-06T22:38:55.253708] [INFO ] [MAIN ] GDL: Loaded 2554 primary data records. [2025-10-06T22:38:55.847168] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:38:55.849168] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3609 primary records. [2025-10-06T22:38:55.850218] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-06T22:38:55.868566] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-10-06T22:38:55.868864] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-06T22:38:55.871619] [INFO ] [MAIN ] Derivative Progress: 745/2037 symbols completed. GDIV took 1.1s. Estimated remaining: 8m 34s. Rate: 150.8 symbols/min [2025-10-06T22:38:55.872047] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:55.892237] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:55.894238] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49828 primary records. [2025-10-06T22:38:55.894398] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-06T22:38:55.921769] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:55.930677] [DEBUG] [LOCAL ] GDO: Loaded 5937 existing records from primary storage. [2025-10-06T22:38:55.931371] [INFO ] [MAIN ] GDO: Loaded 5937 primary data records. [2025-10-06T22:38:55.933195] [INFO ] [MAIN ] GDL: Generated 1794 derivative records from 2554 primary records. [2025-10-06T22:38:55.986923] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-06T22:38:55.998612] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-10-06T22:38:55.998901] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-06T22:38:56.008690] [INFO ] [MAIN ] Derivative Progress: 746/2037 symbols completed. GDDY took 1.3s. Estimated remaining: 8m 33s. Rate: 151.0 symbols/min [2025-10-06T22:38:56.018683] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:56.078200] [DEBUG] [LOCAL ] GDL: Derivative data saved (1794 records). [2025-10-06T22:38:56.102428] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-06T22:38:56.107726] [INFO ] [MAIN ] Derivative Progress: 747/2037 symbols completed. GDL took 1.0s. Estimated remaining: 8m 32s. Rate: 151.1 symbols/min [2025-10-06T22:38:56.124902] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:56.344000] [DEBUG] [LOCAL ] GDOT: Loaded 38015 existing records from primary storage. [2025-10-06T22:38:56.344334] [INFO ] [MAIN ] GDOT: Loaded 38015 primary data records. [2025-10-06T22:38:56.413841] [DEBUG] [LOCAL ] GDV: Loaded 19450 existing records from primary storage. [2025-10-06T22:38:56.440535] [INFO ] [MAIN ] GDV: Loaded 19450 primary data records. [2025-10-06T22:38:57.009586] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:57.012617] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 5937 primary records. [2025-10-06T22:38:57.014235] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-06T22:38:57.035101] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-10-06T22:38:57.036603] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-06T22:38:57.039419] [INFO ] [MAIN ] Derivative Progress: 748/2037 symbols completed. GDO took 1.2s. Estimated remaining: 8m 33s. Rate: 150.8 symbols/min [2025-10-06T22:38:57.053187] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:57.054076] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 38015 primary records. [2025-10-06T22:38:57.054232] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-06T22:38:57.072431] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-10-06T22:38:57.072639] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-06T22:38:57.075100] [INFO ] [MAIN ] Derivative Progress: 749/2037 symbols completed. GDOT took 1.1s. Estimated remaining: 8m 32s. Rate: 151.0 symbols/min [2025-10-06T22:38:57.087936] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:57.088529] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19450 primary records. [2025-10-06T22:38:57.088589] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-06T22:38:57.103541] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-10-06T22:38:57.103599] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-06T22:38:57.106829] [INFO ] [MAIN ] Derivative Progress: 750/2037 symbols completed. GDV took 1.0s. Estimated remaining: 8m 31s. Rate: 151.2 symbols/min [2025-10-06T22:38:57.107352] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:57.107227] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:57.107289] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:57.149623] [DEBUG] [LOCAL ] GEF: Loaded 20723 existing records from primary storage. [2025-10-06T22:38:57.149897] [INFO ] [MAIN ] GEF: Loaded 20723 primary data records. [2025-10-06T22:38:57.299028] [DEBUG] [LOCAL ] GENI: Loaded 52944 existing records from primary storage. [2025-10-06T22:38:57.327830] [INFO ] [MAIN ] GENI: Loaded 52944 primary data records. [2025-10-06T22:38:57.593276] [DEBUG] [LOCAL ] GE: Loaded 53712 existing records from primary storage. [2025-10-06T22:38:57.638568] [INFO ] [MAIN ] GE: Loaded 53712 primary data records. [2025-10-06T22:38:58.177020] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:58.178038] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20723 primary records. [2025-10-06T22:38:58.178136] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-06T22:38:58.198443] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-10-06T22:38:58.198638] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-06T22:38:58.201127] [INFO ] [MAIN ] Derivative Progress: 751/2037 symbols completed. GEF took 1.1s. Estimated remaining: 8m 31s. Rate: 150.9 symbols/min [2025-10-06T22:38:58.214534] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:58.215090] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:58.216138] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52944 primary records. [2025-10-06T22:38:58.216779] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-06T22:38:58.244968] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-10-06T22:38:58.250322] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-06T22:38:58.250550] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:58.253313] [INFO ] [MAIN ] Derivative Progress: 752/2037 symbols completed. GENI took 1.1s. Estimated remaining: 8m 30s. Rate: 151.0 symbols/min [2025-10-06T22:38:58.253681] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:58.254587] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53712 primary records. [2025-10-06T22:38:58.254820] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-06T22:38:58.285400] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-10-06T22:38:58.285695] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-06T22:38:58.289745] [INFO ] [MAIN ] Derivative Progress: 753/2037 symbols completed. GE took 1.2s. Estimated remaining: 8m 29s. Rate: 151.2 symbols/min [2025-10-06T22:38:58.290161] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:58.311501] [DEBUG] [LOCAL ] GEO: Loaded 51904 existing records from primary storage. [2025-10-06T22:38:58.311895] [INFO ] [MAIN ] GEO: Loaded 51904 primary data records. [2025-10-06T22:38:58.451473] [DEBUG] [LOCAL ] GES: Loaded 38989 existing records from primary storage. [2025-10-06T22:38:58.485801] [INFO ] [MAIN ] GES: Loaded 38989 primary data records. [2025-10-06T22:38:58.620464] [DEBUG] [LOCAL ] GETY: Loaded 35319 existing records from primary storage. [2025-10-06T22:38:58.760732] [INFO ] [MAIN ] GETY: Loaded 35319 primary data records. [2025-10-06T22:38:59.321262] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:59.322450] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 51904 primary records. [2025-10-06T22:38:59.322962] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-06T22:38:59.343360] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-10-06T22:38:59.343681] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-06T22:38:59.345802] [INFO ] [MAIN ] Derivative Progress: 754/2037 symbols completed. GEO took 1.1s. Estimated remaining: 8m 30s. Rate: 150.9 symbols/min [2025-10-06T22:38:59.346392] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:59.359806] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:38:59.360546] [INFO ] [MAIN ] GES: Generated 1793 derivative records from 38989 primary records. [2025-10-06T22:38:59.360852] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-06T22:38:59.379519] [DEBUG] [LOCAL ] GES: Derivative data saved (1793 records). [2025-10-06T22:38:59.380255] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-06T22:38:59.384177] [INFO ] [MAIN ] Derivative Progress: 755/2037 symbols completed. GES took 1.1s. Estimated remaining: 8m 29s. Rate: 151.1 symbols/min [2025-10-06T22:38:59.384460] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:59.399039] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:38:59.400571] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 35319 primary records. [2025-10-06T22:38:59.400809] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-06T22:38:59.403513] [DEBUG] [LOCAL ] GF: Loaded 2827 existing records from primary storage. [2025-10-06T22:38:59.403976] [INFO ] [MAIN ] GF: Loaded 2827 primary data records. [2025-10-06T22:38:59.439366] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-10-06T22:38:59.439481] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-06T22:38:59.457974] [INFO ] [MAIN ] Derivative Progress: 756/2037 symbols completed. GETY took 1.2s. Estimated remaining: 8m 28s. Rate: 151.2 symbols/min [2025-10-06T22:38:59.458213] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:38:59.768835] [DEBUG] [LOCAL ] GEV: Loaded 53024 existing records from primary storage. [2025-10-06T22:38:59.769186] [INFO ] [MAIN ] GEV: Loaded 53024 primary data records. [2025-10-06T22:38:59.881514] [DEBUG] [LOCAL ] GFF: Loaded 30332 existing records from primary storage. [2025-10-06T22:38:59.893335] [INFO ] [MAIN ] GFF: Loaded 30332 primary data records. [2025-10-06T22:39:00.476587] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:00.479425] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 2827 primary records. [2025-10-06T22:39:00.479778] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-06T22:39:00.496796] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-10-06T22:39:00.497081] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-06T22:39:00.500196] [INFO ] [MAIN ] Derivative Progress: 757/2037 symbols completed. GF took 1.1s. Estimated remaining: 8m 29s. Rate: 150.9 symbols/min [2025-10-06T22:39:00.500393] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:00.521692] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:00.522900] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53024 primary records. [2025-10-06T22:39:00.523457] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-06T22:39:00.544492] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-10-06T22:39:00.544861] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-06T22:39:00.548054] [INFO ] [MAIN ] Derivative Progress: 758/2037 symbols completed. GEV took 1.2s. Estimated remaining: 8m 28s. Rate: 151.1 symbols/min [2025-10-06T22:39:00.561823] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:00.561667] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:00.563458] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30332 primary records. [2025-10-06T22:39:00.563556] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-06T22:39:00.595393] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-10-06T22:39:00.595579] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-06T22:39:00.599058] [INFO ] [MAIN ] Derivative Progress: 759/2037 symbols completed. GFF took 1.1s. Estimated remaining: 8m 27s. Rate: 151.3 symbols/min [2025-10-06T22:39:00.599443] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:00.616859] [DEBUG] [LOCAL ] GFI: Loaded 53100 existing records from primary storage. [2025-10-06T22:39:00.617296] [INFO ] [MAIN ] GFI: Loaded 53100 primary data records. [2025-10-06T22:39:00.722509] [DEBUG] [LOCAL ] GFR: Loaded 8022 existing records from primary storage. [2025-10-06T22:39:00.739233] [INFO ] [MAIN ] GFR: Loaded 8022 primary data records. [2025-10-06T22:39:01.057601] [DEBUG] [LOCAL ] GFL: Loaded 47867 existing records from primary storage. [2025-10-06T22:39:01.058090] [INFO ] [MAIN ] GFL: Loaded 47867 primary data records. [2025-10-06T22:39:01.671583] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:01.673060] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53100 primary records. [2025-10-06T22:39:01.673272] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-06T22:39:01.692498] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-10-06T22:39:01.693699] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-06T22:39:01.697192] [INFO ] [MAIN ] Derivative Progress: 760/2037 symbols completed. GFI took 1.2s. Estimated remaining: 8m 28s. Rate: 150.9 symbols/min [2025-10-06T22:39:01.697762] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:01.712957] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:01.715341] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 8022 primary records. [2025-10-06T22:39:01.715559] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-06T22:39:01.736057] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:01.738254] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 47867 primary records. [2025-10-06T22:39:01.741115] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-06T22:39:01.758835] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-10-06T22:39:01.759091] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-06T22:39:01.763474] [INFO ] [MAIN ] Derivative Progress: 761/2037 symbols completed. GFR took 1.2s. Estimated remaining: 8m 27s. Rate: 151.1 symbols/min [2025-10-06T22:39:01.764605] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:01.781027] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-10-06T22:39:01.781184] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-06T22:39:01.784287] [INFO ] [MAIN ] Derivative Progress: 762/2037 symbols completed. GFL took 1.2s. Estimated remaining: 8m 26s. Rate: 151.3 symbols/min [2025-10-06T22:39:01.784625] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:01.811127] [DEBUG] [LOCAL ] GGB: Loaded 51155 existing records from primary storage. [2025-10-06T22:39:01.811405] [INFO ] [MAIN ] GGB: Loaded 51155 primary data records. [2025-10-06T22:39:01.871080] [DEBUG] [LOCAL ] GGT: Loaded 14104 existing records from primary storage. [2025-10-06T22:39:01.871180] [INFO ] [MAIN ] GGT: Loaded 14104 primary data records. [2025-10-06T22:39:02.111456] [DEBUG] [LOCAL ] GGG: Loaded 40905 existing records from primary storage. [2025-10-06T22:39:02.175081] [INFO ] [MAIN ] GGG: Loaded 40905 primary data records. [2025-10-06T22:39:02.814207] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:02.813795] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-06T22:39:02.816042] [INFO ] [MAIN ] GGT: Generated 1792 derivative records from 14104 primary records. [2025-10-06T22:39:02.816156] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-06T22:39:02.815209] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51155 primary records. [2025-10-06T22:39:02.817377] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-06T22:39:02.847299] [DEBUG] [LOCAL ] GGT: Derivative data saved (1792 records). [2025-10-06T22:39:02.849230] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-06T22:39:02.852791] [INFO ] [MAIN ] Derivative Progress: 763/2037 symbols completed. GGT took 1.1s. Estimated remaining: 8m 26s. Rate: 150.9 symbols/min [2025-10-06T22:39:02.869798] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-10-06T22:39:02.869912] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-06T22:39:02.869333] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:02.870701] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40905 primary records. [2025-10-06T22:39:02.873091] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-06T22:39:02.872934] [INFO ] [MAIN ] Derivative Progress: 764/2037 symbols completed. GGB took 1.2s. Estimated remaining: 8m 25s. Rate: 151.1 symbols/min [2025-10-06T22:39:02.889107] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-10-06T22:39:02.889252] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-06T22:39:02.892291] [INFO ] [MAIN ] Derivative Progress: 765/2037 symbols completed. GGG took 1.1s. Estimated remaining: 8m 24s. Rate: 151.3 symbols/min [2025-10-06T22:39:02.892883] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:02.892822] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:02.893027] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:02.905041] [DEBUG] [LOCAL ] GGZ: Loaded 2424 existing records from primary storage. [2025-10-06T22:39:02.904881] [DEBUG] [LOCAL ] GHG: Loaded 3180 existing records from primary storage. [2025-10-06T22:39:02.905236] [INFO ] [MAIN ] GHG: Loaded 3180 primary data records. [2025-10-06T22:39:02.905319] [INFO ] [MAIN ] GGZ: Loaded 2424 primary data records. [2025-10-06T22:39:03.011143] [DEBUG] [LOCAL ] GHI: Loaded 7131 existing records from primary storage. [2025-10-06T22:39:03.058108] [INFO ] [MAIN ] GHI: Loaded 7131 primary data records. [2025-10-06T22:39:03.952977] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:03.956787] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2424 primary records. [2025-10-06T22:39:03.956889] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-06T22:39:03.995787] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:03.996753] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 7131 primary records. [2025-10-06T22:39:04.000541] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-10-06T22:39:04.000467] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-06T22:39:03.997084] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:04.002480] [INFO ] [MAIN ] GHG: Generated 1794 derivative records from 3180 primary records. [2025-10-06T22:39:04.002888] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-06T22:39:04.002985] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-06T22:39:04.013668] [INFO ] [MAIN ] Derivative Progress: 766/2037 symbols completed. GGZ took 1.1s. Estimated remaining: 8m 25s. Rate: 150.9 symbols/min [2025-10-06T22:39:04.013913] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:04.039070] [DEBUG] [LOCAL ] GHLD: Loaded 4174 existing records from primary storage. [2025-10-06T22:39:04.040544] [DEBUG] [LOCAL ] GHG: Derivative data saved (1794 records). [2025-10-06T22:39:04.040744] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-06T22:39:04.041237] [INFO ] [MAIN ] GHLD: Loaded 4174 primary data records. [2025-10-06T22:39:04.076684] [INFO ] [MAIN ] Derivative Progress: 767/2037 symbols completed. GHG took 1.2s. Estimated remaining: 8m 24s. Rate: 151.1 symbols/min [2025-10-06T22:39:04.109154] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-10-06T22:39:04.114433] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-06T22:39:04.125569] [INFO ] [MAIN ] Derivative Progress: 768/2037 symbols completed. GHI took 1.2s. Estimated remaining: 8m 23s. Rate: 151.3 symbols/min [2025-10-06T22:39:04.101487] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:04.130947] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:04.382446] [DEBUG] [LOCAL ] GHM: Loaded 14084 existing records from primary storage. [2025-10-06T22:39:04.383062] [DEBUG] [LOCAL ] GHY: Loaded 20917 existing records from primary storage. [2025-10-06T22:39:04.384999] [INFO ] [MAIN ] GHM: Loaded 14084 primary data records. [2025-10-06T22:39:04.385593] [INFO ] [MAIN ] GHY: Loaded 20917 primary data records. [2025-10-06T22:39:05.103310] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:39:05.105604] [INFO ] [MAIN ] GHLD: Generated 1793 derivative records from 4174 primary records. [2025-10-06T22:39:05.106165] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-06T22:39:05.125517] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1793 records). [2025-10-06T22:39:05.126138] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-06T22:39:05.128595] [INFO ] [MAIN ] Derivative Progress: 769/2037 symbols completed. GHLD took 1.1s. Estimated remaining: 8m 24s. Rate: 151.0 symbols/min [2025-10-06T22:39:05.129883] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:05.157338] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:05.165913] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20917 primary records. [2025-10-06T22:39:05.166048] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-06T22:39:05.223432] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-10-06T22:39:05.223633] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-06T22:39:05.219214] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:05.226208] [DEBUG] [LOCAL ] GIB: Loaded 31983 existing records from primary storage. [2025-10-06T22:39:05.230268] [INFO ] [MAIN ] Derivative Progress: 770/2037 symbols completed. GHY took 1.1s. Estimated remaining: 8m 23s. Rate: 151.1 symbols/min [2025-10-06T22:39:05.226037] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14084 primary records. [2025-10-06T22:39:05.230617] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:05.230904] [INFO ] [MAIN ] GIB: Loaded 31983 primary data records. [2025-10-06T22:39:05.230746] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-06T22:39:05.367460] [DEBUG] [LOCAL ] GIC: Loaded 13433 existing records from primary storage. [2025-10-06T22:39:05.369377] [INFO ] [MAIN ] GIC: Loaded 13433 primary data records. [2025-10-06T22:39:05.392394] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-10-06T22:39:05.431247] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-06T22:39:05.528703] [INFO ] [MAIN ] Derivative Progress: 771/2037 symbols completed. GHM took 1.4s. Estimated remaining: 8m 22s. Rate: 151.2 symbols/min [2025-10-06T22:39:05.545903] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:05.978196] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:05.991052] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 31983 primary records. [2025-10-06T22:39:05.991329] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-06T22:39:05.994382] [DEBUG] [LOCAL ] GIL: Loaded 43543 existing records from primary storage. [2025-10-06T22:39:06.006308] [INFO ] [MAIN ] GIL: Loaded 43543 primary data records. [2025-10-06T22:39:06.100397] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-10-06T22:39:06.114408] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-06T22:39:06.141774] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:06.144269] [INFO ] [MAIN ] Derivative Progress: 772/2037 symbols completed. GIB took 1.0s. Estimated remaining: 8m 22s. Rate: 151.1 symbols/min [2025-10-06T22:39:06.145368] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13433 primary records. [2025-10-06T22:39:06.144491] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:06.145607] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-06T22:39:06.344512] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-10-06T22:39:06.344637] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-06T22:39:06.347906] [INFO ] [MAIN ] Derivative Progress: 773/2037 symbols completed. GIC took 1.1s. Estimated remaining: 8m 22s. Rate: 151.2 symbols/min [2025-10-06T22:39:06.348240] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:06.401281] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:06.402043] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43543 primary records. [2025-10-06T22:39:06.402195] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-06T22:39:06.431993] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-06T22:39:06.433186] [INFO ] [MAIN ] GIS: Loaded 53672 primary data records. [2025-10-06T22:39:06.491771] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-10-06T22:39:06.512574] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-06T22:39:06.520430] [INFO ] [MAIN ] Derivative Progress: 774/2037 symbols completed. GIL took 1.0s. Estimated remaining: 8m 21s. Rate: 151.3 symbols/min [2025-10-06T22:39:06.532492] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:06.538475] [DEBUG] [LOCAL ] GKOS: Loaded 42686 existing records from primary storage. [2025-10-06T22:39:06.555865] [INFO ] [MAIN ] GKOS: Loaded 42686 primary data records. [2025-10-06T22:39:07.113215] [DEBUG] [LOCAL ] GL: Loaded 37789 existing records from primary storage. [2025-10-06T22:39:07.114103] [INFO ] [MAIN ] GL: Loaded 37789 primary data records. [2025-10-06T22:39:07.264391] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:07.311780] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53672 primary records. [2025-10-06T22:39:07.482176] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-06T22:39:07.516544] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:07.526190] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 42686 primary records. [2025-10-06T22:39:07.526289] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-06T22:39:07.528902] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-10-06T22:39:07.530098] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-06T22:39:07.544735] [INFO ] [MAIN ] Derivative Progress: 775/2037 symbols completed. GIS took 1.4s. Estimated remaining: 8m 22s. Rate: 151.0 symbols/min [2025-10-06T22:39:07.546867] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:07.553515] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-10-06T22:39:07.553742] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-06T22:39:07.556315] [INFO ] [MAIN ] Derivative Progress: 776/2037 symbols completed. GKOS took 1.2s. Estimated remaining: 8m 21s. Rate: 151.2 symbols/min [2025-10-06T22:39:07.556593] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:07.577459] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:07.578713] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37789 primary records. [2025-10-06T22:39:07.578848] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-06T22:39:07.584284] [DEBUG] [LOCAL ] GLP: Loaded 9299 existing records from primary storage. [2025-10-06T22:39:07.584678] [INFO ] [MAIN ] GLP: Loaded 9299 primary data records. [2025-10-06T22:39:07.694078] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-10-06T22:39:07.716590] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-06T22:39:07.725417] [INFO ] [MAIN ] Derivative Progress: 777/2037 symbols completed. GL took 1.2s. Estimated remaining: 8m 20s. Rate: 151.3 symbols/min [2025-10-06T22:39:07.760851] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:07.938194] [DEBUG] [LOCAL ] GLOB: Loaded 47770 existing records from primary storage. [2025-10-06T22:39:07.938630] [INFO ] [MAIN ] GLOB: Loaded 47770 primary data records. [2025-10-06T22:39:08.288591] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:08.291232] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9299 primary records. [2025-10-06T22:39:08.291472] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-06T22:39:08.322598] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-06T22:39:08.327136] [INFO ] [MAIN ] GLW: Loaded 53636 primary data records. [2025-10-06T22:39:08.343825] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-10-06T22:39:08.364054] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-06T22:39:08.372077] [INFO ] [MAIN ] Derivative Progress: 778/2037 symbols completed. GLP took 0.8s. Estimated remaining: 8m 20s. Rate: 151.1 symbols/min [2025-10-06T22:39:08.671613] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:08.673578] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47770 primary records. [2025-10-06T22:39:08.673707] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-06T22:39:08.692268] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-10-06T22:39:08.693039] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-06T22:39:08.695283] [INFO ] [MAIN ] Derivative Progress: 779/2037 symbols completed. GLOB took 1.1s. Estimated remaining: 8m 19s. Rate: 151.2 symbols/min [2025-10-06T22:39:08.721826] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:08.722944] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53636 primary records. [2025-10-06T22:39:08.723037] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-06T22:39:08.742491] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-10-06T22:39:08.742698] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-06T22:39:08.745494] [INFO ] [MAIN ] Derivative Progress: 780/2037 symbols completed. GLW took 1.0s. Estimated remaining: 8m 18s. Rate: 151.3 symbols/min [2025-10-06T22:39:08.746320] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:08.746260] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:08.746440] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:08.831044] [DEBUG] [LOCAL ] GME: Loaded 53775 existing records from primary storage. [2025-10-06T22:39:08.831409] [INFO ] [MAIN ] GME: Loaded 53775 primary data records. [2025-10-06T22:39:08.952585] [DEBUG] [LOCAL ] GMED: Loaded 48398 existing records from primary storage. [2025-10-06T22:39:08.974721] [INFO ] [MAIN ] GMED: Loaded 48398 primary data records. [2025-10-06T22:39:08.981465] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-06T22:39:09.017217] [INFO ] [MAIN ] GM: Loaded 53729 primary data records. [2025-10-06T22:39:09.918982] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:09.920894] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53775 primary records. [2025-10-06T22:39:09.921504] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-06T22:39:09.944111] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-10-06T22:39:09.945286] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-06T22:39:09.949101] [INFO ] [MAIN ] Derivative Progress: 781/2037 symbols completed. GME took 1.2s. Estimated remaining: 8m 19s. Rate: 151.0 symbols/min [2025-10-06T22:39:09.950759] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:09.965386] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:09.966911] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53729 primary records. [2025-10-06T22:39:09.980428] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-06T22:39:09.980241] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:09.981277] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48398 primary records. [2025-10-06T22:39:09.981803] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-06T22:39:10.020626] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-10-06T22:39:10.021754] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-10-06T22:39:10.021961] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-06T22:39:10.022049] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-06T22:39:10.034327] [INFO ] [MAIN ] Derivative Progress: 782/2037 symbols completed. GMED took 1.3s. Estimated remaining: 8m 18s. Rate: 151.1 symbols/min [2025-10-06T22:39:10.037484] [INFO ] [MAIN ] Derivative Progress: 783/2037 symbols completed. GM took 1.3s. Estimated remaining: 8m 17s. Rate: 151.3 symbols/min [2025-10-06T22:39:10.037292] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:10.038120] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:10.055763] [DEBUG] [LOCAL ] GMRE: Loaded 37203 existing records from primary storage. [2025-10-06T22:39:10.056183] [INFO ] [MAIN ] GMRE: Loaded 37203 primary data records. [2025-10-06T22:39:10.160769] [DEBUG] [LOCAL ] GNE: Loaded 17825 existing records from primary storage. [2025-10-06T22:39:10.178400] [INFO ] [MAIN ] GNE: Loaded 17825 primary data records. [2025-10-06T22:39:10.530551] [DEBUG] [LOCAL ] GNK: Loaded 40229 existing records from primary storage. [2025-10-06T22:39:10.541505] [INFO ] [MAIN ] GNK: Loaded 40229 primary data records. [2025-10-06T22:39:11.072681] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:11.073883] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37203 primary records. [2025-10-06T22:39:11.074139] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-06T22:39:11.093308] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-10-06T22:39:11.093464] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-06T22:39:11.096782] [INFO ] [MAIN ] Derivative Progress: 784/2037 symbols completed. GMRE took 1.1s. Estimated remaining: 8m 18s. Rate: 151.0 symbols/min [2025-10-06T22:39:11.097248] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:11.114434] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:11.115279] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17825 primary records. [2025-10-06T22:39:11.115567] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-06T22:39:11.151969] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:11.153289] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40229 primary records. [2025-10-06T22:39:11.154147] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-06T22:39:11.155827] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-10-06T22:39:11.155925] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-06T22:39:11.158185] [INFO ] [MAIN ] Derivative Progress: 785/2037 symbols completed. GNE took 1.1s. Estimated remaining: 8m 17s. Rate: 151.1 symbols/min [2025-10-06T22:39:11.165924] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:11.187599] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-10-06T22:39:11.187866] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-06T22:39:11.190761] [INFO ] [MAIN ] Derivative Progress: 786/2037 symbols completed. GNK took 1.2s. Estimated remaining: 8m 16s. Rate: 151.3 symbols/min [2025-10-06T22:39:11.191109] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:11.208603] [DEBUG] [LOCAL ] GNL: Loaded 46772 existing records from primary storage. [2025-10-06T22:39:11.209007] [INFO ] [MAIN ] GNL: Loaded 46772 primary data records. [2025-10-06T22:39:11.291011] [DEBUG] [LOCAL ] GNT: Loaded 8216 existing records from primary storage. [2025-10-06T22:39:11.296328] [INFO ] [MAIN ] GNT: Loaded 8216 primary data records. [2025-10-06T22:39:11.525742] [DEBUG] [LOCAL ] GNRC: Loaded 45174 existing records from primary storage. [2025-10-06T22:39:11.541841] [INFO ] [MAIN ] GNRC: Loaded 45174 primary data records. [2025-10-06T22:39:12.246927] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:12.248989] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 46772 primary records. [2025-10-06T22:39:12.261952] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:12.261576] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-06T22:39:12.262966] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8216 primary records. [2025-10-06T22:39:12.263205] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-06T22:39:12.292299] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-10-06T22:39:12.293097] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-06T22:39:12.295069] [INFO ] [MAIN ] Derivative Progress: 787/2037 symbols completed. GNL took 1.2s. Estimated remaining: 8m 17s. Rate: 151.0 symbols/min [2025-10-06T22:39:12.295496] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:12.298858] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-10-06T22:39:12.299042] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-06T22:39:12.301903] [INFO ] [MAIN ] Derivative Progress: 788/2037 symbols completed. GNT took 1.1s. Estimated remaining: 8m 16s. Rate: 151.2 symbols/min [2025-10-06T22:39:12.304481] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:12.321830] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:12.323234] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45174 primary records. [2025-10-06T22:39:12.323507] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-06T22:39:12.347235] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-10-06T22:39:12.347516] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-06T22:39:12.350445] [INFO ] [MAIN ] Derivative Progress: 789/2037 symbols completed. GNRC took 1.2s. Estimated remaining: 8m 15s. Rate: 151.3 symbols/min [2025-10-06T22:39:12.350637] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:12.399414] [DEBUG] [LOCAL ] GNW: Loaded 51370 existing records from primary storage. [2025-10-06T22:39:12.421042] [INFO ] [MAIN ] GNW: Loaded 51370 primary data records. [2025-10-06T22:39:12.433285] [DEBUG] [LOCAL ] GOF: Loaded 42540 existing records from primary storage. [2025-10-06T22:39:12.453436] [INFO ] [MAIN ] GOF: Loaded 42540 primary data records. [2025-10-06T22:39:12.604108] [DEBUG] [LOCAL ] GOLF: Loaded 31144 existing records from primary storage. [2025-10-06T22:39:12.637361] [INFO ] [MAIN ] GOLF: Loaded 31144 primary data records. [2025-10-06T22:39:13.444863] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:13.460962] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:13.460433] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51370 primary records. [2025-10-06T22:39:13.462111] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-06T22:39:13.461867] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42540 primary records. [2025-10-06T22:39:13.464287] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-06T22:39:13.513177] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-10-06T22:39:13.514031] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-06T22:39:13.516821] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:13.516309] [INFO ] [MAIN ] Derivative Progress: 790/2037 symbols completed. GNW took 1.2s. Estimated remaining: 8m 16s. Rate: 151.0 symbols/min [2025-10-06T22:39:13.518310] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:13.517840] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 31144 primary records. [2025-10-06T22:39:13.520013] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-06T22:39:13.530489] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-10-06T22:39:13.534303] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-06T22:39:13.540823] [INFO ] [MAIN ] Derivative Progress: 791/2037 symbols completed. GOF took 1.2s. Estimated remaining: 8m 15s. Rate: 151.1 symbols/min [2025-10-06T22:39:13.541358] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:13.545059] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-10-06T22:39:13.545428] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-06T22:39:13.549512] [INFO ] [MAIN ] Derivative Progress: 792/2037 symbols completed. GOLF took 1.2s. Estimated remaining: 8m 14s. Rate: 151.3 symbols/min [2025-10-06T22:39:13.550063] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:13.617322] [DEBUG] [LOCAL ] GOOS: Loaded 44826 existing records from primary storage. [2025-10-06T22:39:13.615811] [DEBUG] [LOCAL ] GOTU: Loaded 38020 existing records from primary storage. [2025-10-06T22:39:13.630893] [INFO ] [MAIN ] GOOS: Loaded 44826 primary data records. [2025-10-06T22:39:13.631047] [INFO ] [MAIN ] GOTU: Loaded 38020 primary data records. [2025-10-06T22:39:13.871235] [DEBUG] [LOCAL ] GPC: Loaded 46272 existing records from primary storage. [2025-10-06T22:39:13.944737] [INFO ] [MAIN ] GPC: Loaded 46272 primary data records. [2025-10-06T22:39:14.720558] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:14.734702] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 38020 primary records. [2025-10-06T22:39:14.735288] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:14.735801] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-06T22:39:14.736743] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 44826 primary records. [2025-10-06T22:39:14.738740] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-06T22:39:14.771551] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-10-06T22:39:14.775894] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-06T22:39:14.779160] [INFO ] [MAIN ] Derivative Progress: 793/2037 symbols completed. GOTU took 1.2s. Estimated remaining: 8m 15s. Rate: 150.9 symbols/min [2025-10-06T22:39:14.775625] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-10-06T22:39:14.780721] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-06T22:39:14.783249] [INFO ] [MAIN ] Derivative Progress: 794/2037 symbols completed. GOOS took 1.3s. Estimated remaining: 8m 14s. Rate: 151.1 symbols/min [2025-10-06T22:39:14.799534] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:14.800374] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46272 primary records. [2025-10-06T22:39:14.800452] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-06T22:39:14.816791] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-10-06T22:39:14.816857] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-06T22:39:14.820990] [INFO ] [MAIN ] Derivative Progress: 795/2037 symbols completed. GPC took 1.3s. Estimated remaining: 8m 13s. Rate: 151.3 symbols/min [2025-10-06T22:39:14.821441] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:14.821690] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:14.822385] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:14.833709] [DEBUG] [LOCAL ] GPJA: Loaded 4264 existing records from primary storage. [2025-10-06T22:39:14.834002] [INFO ] [MAIN ] GPJA: Loaded 4264 primary data records. [2025-10-06T22:39:14.931343] [DEBUG] [LOCAL ] GPI: Loaded 14633 existing records from primary storage. [2025-10-06T22:39:14.953512] [INFO ] [MAIN ] GPI: Loaded 14633 primary data records. [2025-10-06T22:39:15.416341] [DEBUG] [LOCAL ] GPK: Loaded 52659 existing records from primary storage. [2025-10-06T22:39:15.426057] [INFO ] [MAIN ] GPK: Loaded 52659 primary data records. [2025-10-06T22:39:15.907184] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:39:15.909391] [INFO ] [MAIN ] GPJA: Generated 1793 derivative records from 4264 primary records. [2025-10-06T22:39:15.910317] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-06T22:39:15.931875] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1793 records). [2025-10-06T22:39:15.932162] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-06T22:39:15.935704] [INFO ] [MAIN ] Derivative Progress: 796/2037 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 13s. Rate: 150.9 symbols/min [2025-10-06T22:39:15.936908] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:15.953019] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:15.954214] [INFO ] [MAIN ] GPI: Generated 1794 derivative records from 14633 primary records. [2025-10-06T22:39:15.954552] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-06T22:39:15.972615] [DEBUG] [LOCAL ] GPI: Derivative data saved (1794 records). [2025-10-06T22:39:15.972959] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-06T22:39:15.976464] [INFO ] [MAIN ] Derivative Progress: 797/2037 symbols completed. GPI took 1.2s. Estimated remaining: 8m 12s. Rate: 151.1 symbols/min [2025-10-06T22:39:15.976720] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:16.005127] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:16.014790] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52659 primary records. [2025-10-06T22:39:16.015047] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-06T22:39:16.015529] [DEBUG] [LOCAL ] GPMT: Loaded 25788 existing records from primary storage. [2025-10-06T22:39:16.016469] [INFO ] [MAIN ] GPMT: Loaded 25788 primary data records. [2025-10-06T22:39:16.070682] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-10-06T22:39:16.088610] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-06T22:39:16.117876] [INFO ] [MAIN ] Derivative Progress: 798/2037 symbols completed. GPK took 1.3s. Estimated remaining: 8m 12s. Rate: 151.2 symbols/min [2025-10-06T22:39:16.123343] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:16.336491] [DEBUG] [LOCAL ] GPOR: Loaded 23195 existing records from primary storage. [2025-10-06T22:39:16.446713] [INFO ] [MAIN ] GPOR: Loaded 23195 primary data records. [2025-10-06T22:39:16.449914] [DEBUG] [LOCAL ] GPN: Loaded 52052 existing records from primary storage. [2025-10-06T22:39:16.450468] [INFO ] [MAIN ] GPN: Loaded 52052 primary data records. [2025-10-06T22:39:17.129706] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:17.131555] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 25788 primary records. [2025-10-06T22:39:17.131722] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-06T22:39:17.153564] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-10-06T22:39:17.154527] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-06T22:39:17.157352] [INFO ] [MAIN ] Derivative Progress: 799/2037 symbols completed. GPMT took 1.2s. Estimated remaining: 8m 12s. Rate: 150.9 symbols/min [2025-10-06T22:39:17.158106] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:17.194904] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:17.194626] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:17.196158] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52052 primary records. [2025-10-06T22:39:17.197261] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-06T22:39:17.197394] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 23195 primary records. [2025-10-06T22:39:17.210896] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-06T22:39:17.215368] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-10-06T22:39:17.226475] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-06T22:39:17.231211] [INFO ] [MAIN ] Derivative Progress: 800/2037 symbols completed. GPN took 1.3s. Estimated remaining: 8m 11s. Rate: 151.1 symbols/min [2025-10-06T22:39:17.231520] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:17.264315] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-10-06T22:39:17.264630] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-06T22:39:17.268590] [INFO ] [MAIN ] Derivative Progress: 801/2037 symbols completed. GPOR took 1.1s. Estimated remaining: 8m 10s. Rate: 151.3 symbols/min [2025-10-06T22:39:17.269061] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:17.271123] [DEBUG] [LOCAL ] GPRK: Loaded 39398 existing records from primary storage. [2025-10-06T22:39:17.281579] [INFO ] [MAIN ] GPRK: Loaded 39398 primary data records. [2025-10-06T22:39:17.439860] [DEBUG] [LOCAL ] GRBK: Loaded 27003 existing records from primary storage. [2025-10-06T22:39:17.439615] [DEBUG] [LOCAL ] GRC: Loaded 9136 existing records from primary storage. [2025-10-06T22:39:17.447810] [INFO ] [MAIN ] GRBK: Loaded 27003 primary data records. [2025-10-06T22:39:17.448026] [INFO ] [MAIN ] GRC: Loaded 9136 primary data records. [2025-10-06T22:39:18.456130] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:18.458218] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39398 primary records. [2025-10-06T22:39:18.458550] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-06T22:39:18.477490] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-10-06T22:39:18.479807] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-06T22:39:18.482147] [INFO ] [MAIN ] Derivative Progress: 802/2037 symbols completed. GPRK took 1.3s. Estimated remaining: 8m 11s. Rate: 150.9 symbols/min [2025-10-06T22:39:18.482942] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:18.497893] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:18.498979] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 9136 primary records. [2025-10-06T22:39:18.499231] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-06T22:39:18.519522] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-10-06T22:39:18.539507] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-06T22:39:18.542992] [INFO ] [MAIN ] Derivative Progress: 803/2037 symbols completed. GRC took 1.3s. Estimated remaining: 8m 10s. Rate: 151.0 symbols/min [2025-10-06T22:39:18.543267] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:18.540139] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:18.544993] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 27003 primary records. [2025-10-06T22:39:18.545277] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-06T22:39:18.575899] [DEBUG] [LOCAL ] GRDN: Loaded 20751 existing records from primary storage. [2025-10-06T22:39:18.582754] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-10-06T22:39:18.583364] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-06T22:39:18.583476] [INFO ] [MAIN ] GRDN: Loaded 20751 primary data records. [2025-10-06T22:39:18.588048] [INFO ] [MAIN ] Derivative Progress: 804/2037 symbols completed. GRBK took 1.4s. Estimated remaining: 8m 9s. Rate: 151.2 symbols/min [2025-10-06T22:39:18.600269] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:18.935345] [DEBUG] [LOCAL ] GRMN: Loaded 40885 existing records from primary storage. [2025-10-06T22:39:18.935793] [INFO ] [MAIN ] GRMN: Loaded 40885 primary data records. [2025-10-06T22:39:19.064708] [DEBUG] [LOCAL ] GRND: Loaded 49982 existing records from primary storage. [2025-10-06T22:39:19.064996] [INFO ] [MAIN ] GRND: Loaded 49982 primary data records. [2025-10-06T22:39:19.581614] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:19.583963] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 20751 primary records. [2025-10-06T22:39:19.584191] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-06T22:39:19.602983] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-10-06T22:39:19.603420] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-06T22:39:19.606079] [INFO ] [MAIN ] Derivative Progress: 805/2037 symbols completed. GRDN took 1.1s. Estimated remaining: 8m 10s. Rate: 150.9 symbols/min [2025-10-06T22:39:19.606520] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:19.627274] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:19.628179] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 40885 primary records. [2025-10-06T22:39:19.628574] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-06T22:39:19.680817] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:19.680448] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-10-06T22:39:19.681669] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 49982 primary records. [2025-10-06T22:39:19.681741] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-06T22:39:19.681868] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-06T22:39:19.684005] [INFO ] [MAIN ] Derivative Progress: 806/2037 symbols completed. GRMN took 1.1s. Estimated remaining: 8m 9s. Rate: 151.0 symbols/min [2025-10-06T22:39:19.684275] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:19.685940] [DEBUG] [LOCAL ] GRNT: Loaded 33784 existing records from primary storage. [2025-10-06T22:39:19.686602] [INFO ] [MAIN ] GRNT: Loaded 33784 primary data records. [2025-10-06T22:39:19.776327] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-10-06T22:39:19.792048] [DEBUG] [LOCAL ] GROV: Loaded 8836 existing records from primary storage. [2025-10-06T22:39:19.814529] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-06T22:39:19.817516] [INFO ] [MAIN ] Derivative Progress: 807/2037 symbols completed. GRND took 1.2s. Estimated remaining: 8m 8s. Rate: 151.2 symbols/min [2025-10-06T22:39:19.818082] [INFO ] [MAIN ] GROV: Loaded 8836 primary data records. [2025-10-06T22:39:19.845308] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:20.141475] [DEBUG] [LOCAL ] GRX: Loaded 4771 existing records from primary storage. [2025-10-06T22:39:20.153236] [INFO ] [MAIN ] GRX: Loaded 4771 primary data records. [2025-10-06T22:39:20.756617] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:20.759598] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33784 primary records. [2025-10-06T22:39:20.760135] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-06T22:39:20.785017] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:20.790557] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 8836 primary records. [2025-10-06T22:39:20.790832] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-06T22:39:20.811769] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-10-06T22:39:20.813162] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-06T22:39:20.816321] [INFO ] [MAIN ] Derivative Progress: 808/2037 symbols completed. GROV took 1.1s. Estimated remaining: 8m 9s. Rate: 150.9 symbols/min [2025-10-06T22:39:20.819417] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-10-06T22:39:20.819673] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-06T22:39:20.822464] [INFO ] [MAIN ] Derivative Progress: 809/2037 symbols completed. GRNT took 1.2s. Estimated remaining: 8m 8s. Rate: 151.1 symbols/min [2025-10-06T22:39:20.835355] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:20.836071] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4771 primary records. [2025-10-06T22:39:20.836135] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-06T22:39:20.850869] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-10-06T22:39:20.850931] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-06T22:39:20.853961] [INFO ] [MAIN ] Derivative Progress: 810/2037 symbols completed. GRX took 1.0s. Estimated remaining: 8m 7s. Rate: 151.2 symbols/min [2025-10-06T22:39:20.854398] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:20.854569] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:20.854710] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:20.953259] [DEBUG] [LOCAL ] GSBD: Loaded 39199 existing records from primary storage. [2025-10-06T22:39:20.953626] [INFO ] [MAIN ] GSBD: Loaded 39199 primary data records. [2025-10-06T22:39:20.959749] [DEBUG] [LOCAL ] GSK: Loaded 53496 existing records from primary storage. [2025-10-06T22:39:20.986781] [INFO ] [MAIN ] GSK: Loaded 53496 primary data records. [2025-10-06T22:39:21.173797] [DEBUG] [LOCAL ] GS: Loaded 51804 existing records from primary storage. [2025-10-06T22:39:21.223967] [INFO ] [MAIN ] GS: Loaded 51804 primary data records. [2025-10-06T22:39:21.985514] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:21.986217] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:21.989103] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53496 primary records. [2025-10-06T22:39:21.987988] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39199 primary records. [2025-10-06T22:39:21.989515] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-06T22:39:21.989437] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-06T22:39:22.023360] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-10-06T22:39:22.025624] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-06T22:39:22.028392] [INFO ] [MAIN ] Derivative Progress: 811/2037 symbols completed. GSBD took 1.2s. Estimated remaining: 8m 8s. Rate: 150.9 symbols/min [2025-10-06T22:39:22.029316] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:22.046319] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-10-06T22:39:22.046471] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-06T22:39:22.045770] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:22.047424] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 51804 primary records. [2025-10-06T22:39:22.047613] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-06T22:39:22.051122] [INFO ] [MAIN ] Derivative Progress: 812/2037 symbols completed. GSK took 1.2s. Estimated remaining: 8m 7s. Rate: 151.1 symbols/min [2025-10-06T22:39:22.051399] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:22.070739] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-10-06T22:39:22.071081] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-06T22:39:22.076798] [INFO ] [MAIN ] Derivative Progress: 813/2037 symbols completed. GS took 1.2s. Estimated remaining: 8m 6s. Rate: 151.2 symbols/min [2025-10-06T22:39:22.077105] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:22.103296] [DEBUG] [LOCAL ] GSL: Loaded 33204 existing records from primary storage. [2025-10-06T22:39:22.103582] [INFO ] [MAIN ] GSL: Loaded 33204 primary data records. [2025-10-06T22:39:22.310614] [DEBUG] [LOCAL ] GTES: Loaded 50481 existing records from primary storage. [2025-10-06T22:39:22.341111] [INFO ] [MAIN ] GTES: Loaded 50481 primary data records. [2025-10-06T22:39:22.497708] [DEBUG] [LOCAL ] GTLS: Loaded 42958 existing records from primary storage. [2025-10-06T22:39:22.525415] [INFO ] [MAIN ] GTLS: Loaded 42958 primary data records. [2025-10-06T22:39:23.195967] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:23.198737] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33204 primary records. [2025-10-06T22:39:23.199228] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-06T22:39:23.222940] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-10-06T22:39:23.225729] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-06T22:39:23.229356] [INFO ] [MAIN ] Derivative Progress: 814/2037 symbols completed. GSL took 1.2s. Estimated remaining: 8m 6s. Rate: 150.9 symbols/min [2025-10-06T22:39:23.229938] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:23.246821] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:23.248499] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50481 primary records. [2025-10-06T22:39:23.248929] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-06T22:39:23.311495] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:23.311018] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-10-06T22:39:23.312724] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 42958 primary records. [2025-10-06T22:39:23.312951] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-06T22:39:23.314219] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-06T22:39:23.317722] [INFO ] [MAIN ] Derivative Progress: 815/2037 symbols completed. GTES took 1.3s. Estimated remaining: 8m 5s. Rate: 151.0 symbols/min [2025-10-06T22:39:23.318058] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:23.350202] [DEBUG] [LOCAL ] GTN: Loaded 45354 existing records from primary storage. [2025-10-06T22:39:23.351202] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-10-06T22:39:23.351703] [INFO ] [MAIN ] GTN: Loaded 45354 primary data records. [2025-10-06T22:39:23.351619] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-06T22:39:23.355335] [INFO ] [MAIN ] Derivative Progress: 816/2037 symbols completed. GTLS took 1.3s. Estimated remaining: 8m 5s. Rate: 151.2 symbols/min [2025-10-06T22:39:23.355614] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:23.568082] [DEBUG] [LOCAL ] GUG: Loaded 12145 existing records from primary storage. [2025-10-06T22:39:23.575489] [DEBUG] [LOCAL ] GTY: Loaded 30203 existing records from primary storage. [2025-10-06T22:39:23.573762] [INFO ] [MAIN ] GUG: Loaded 12145 primary data records. [2025-10-06T22:39:23.575631] [INFO ] [MAIN ] GTY: Loaded 30203 primary data records. [2025-10-06T22:39:24.364466] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:24.368088] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45354 primary records. [2025-10-06T22:39:24.368882] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-06T22:39:24.408402] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:24.409131] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-10-06T22:39:24.409529] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-06T22:39:24.410771] [INFO ] [MAIN ] GUG: Generated 1794 derivative records from 12145 primary records. [2025-10-06T22:39:24.413543] [INFO ] [MAIN ] Derivative Progress: 817/2037 symbols completed. GTN took 1.2s. Estimated remaining: 8m 5s. Rate: 150.9 symbols/min [2025-10-06T22:39:24.413862] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-06T22:39:24.415336] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:24.440209] [DEBUG] [LOCAL ] GUG: Derivative data saved (1794 records). [2025-10-06T22:39:24.459529] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-06T22:39:24.459369] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:24.463448] [INFO ] [MAIN ] Derivative Progress: 818/2037 symbols completed. GUG took 1.1s. Estimated remaining: 8m 4s. Rate: 151.0 symbols/min [2025-10-06T22:39:24.470970] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30203 primary records. [2025-10-06T22:39:24.471178] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-06T22:39:24.471858] [DEBUG] [LOCAL ] GUT: Loaded 15409 existing records from primary storage. [2025-10-06T22:39:24.473299] [INFO ] [MAIN ] GUT: Loaded 15409 primary data records. [2025-10-06T22:39:24.471324] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:24.585092] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-10-06T22:39:24.596102] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-06T22:39:24.600113] [INFO ] [MAIN ] Derivative Progress: 819/2037 symbols completed. GTY took 1.3s. Estimated remaining: 8m 3s. Rate: 151.2 symbols/min [2025-10-06T22:39:24.611454] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:24.862208] [DEBUG] [LOCAL ] GWH: Loaded 16637 existing records from primary storage. [2025-10-06T22:39:24.865143] [INFO ] [MAIN ] GWH: Loaded 16637 primary data records. [2025-10-06T22:39:24.863361] [DEBUG] [LOCAL ] GVA: Loaded 33051 existing records from primary storage. [2025-10-06T22:39:24.879050] [INFO ] [MAIN ] GVA: Loaded 33051 primary data records. [2025-10-06T22:39:25.399505] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:25.531846] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15409 primary records. [2025-10-06T22:39:25.532352] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-06T22:39:25.552568] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-10-06T22:39:25.553439] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-06T22:39:25.556619] [INFO ] [MAIN ] Derivative Progress: 820/2037 symbols completed. GUT took 1.1s. Estimated remaining: 8m 4s. Rate: 150.9 symbols/min [2025-10-06T22:39:25.557032] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:25.581712] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:25.582551] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 16637 primary records. [2025-10-06T22:39:25.582664] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-06T22:39:25.613971] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:25.628833] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 33051 primary records. [2025-10-06T22:39:25.629668] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-06T22:39:25.631781] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-10-06T22:39:25.639561] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-06T22:39:25.643589] [INFO ] [MAIN ] Derivative Progress: 821/2037 symbols completed. GWH took 1.0s. Estimated remaining: 8m 3s. Rate: 151.0 symbols/min [2025-10-06T22:39:25.646780] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:25.651470] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-10-06T22:39:25.652832] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-06T22:39:25.656342] [INFO ] [MAIN ] Derivative Progress: 822/2037 symbols completed. GVA took 1.2s. Estimated remaining: 8m 2s. Rate: 151.2 symbols/min [2025-10-06T22:39:25.656756] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:25.672252] [DEBUG] [LOCAL ] GWRE: Loaded 40309 existing records from primary storage. [2025-10-06T22:39:25.672914] [INFO ] [MAIN ] GWRE: Loaded 40309 primary data records. [2025-10-06T22:39:25.804626] [DEBUG] [LOCAL ] GWW: Loaded 19489 existing records from primary storage. [2025-10-06T22:39:25.820764] [INFO ] [MAIN ] GWW: Loaded 19489 primary data records. [2025-10-06T22:39:26.171178] [DEBUG] [LOCAL ] GXO: Loaded 47204 existing records from primary storage. [2025-10-06T22:39:26.177261] [INFO ] [MAIN ] GXO: Loaded 47204 primary data records. [2025-10-06T22:39:26.832302] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:26.833933] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 40309 primary records. [2025-10-06T22:39:26.834235] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-06T22:39:26.857672] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-10-06T22:39:26.858199] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-06T22:39:26.861460] [INFO ] [MAIN ] Derivative Progress: 823/2037 symbols completed. GWRE took 1.3s. Estimated remaining: 8m 3s. Rate: 150.9 symbols/min [2025-10-06T22:39:26.875799] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:26.876909] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19489 primary records. [2025-10-06T22:39:26.877100] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-06T22:39:26.909827] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:26.909596] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-10-06T22:39:26.910638] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 47204 primary records. [2025-10-06T22:39:26.910761] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-06T22:39:26.913878] [INFO ] [MAIN ] Derivative Progress: 824/2037 symbols completed. GWW took 1.3s. Estimated remaining: 8m 2s. Rate: 151.0 symbols/min [2025-10-06T22:39:26.910836] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-06T22:39:26.930264] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-10-06T22:39:26.930329] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-06T22:39:26.933939] [INFO ] [MAIN ] Derivative Progress: 825/2037 symbols completed. GXO took 1.3s. Estimated remaining: 8m 1s. Rate: 151.2 symbols/min [2025-10-06T22:39:26.934462] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:26.934554] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:26.934401] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:26.940008] [DEBUG] [LOCAL ] GYLD: Loaded 1533 existing records from primary storage. [2025-10-06T22:39:26.940426] [INFO ] [MAIN ] GYLD: Loaded 1533 primary data records. [2025-10-06T22:39:27.319026] [DEBUG] [LOCAL ] HAE: Loaded 39450 existing records from primary storage. [2025-10-06T22:39:27.321469] [INFO ] [MAIN ] HAE: Loaded 39450 primary data records. [2025-10-06T22:39:27.322992] [DEBUG] [LOCAL ] H: Loaded 44555 existing records from primary storage. [2025-10-06T22:39:27.349375] [INFO ] [MAIN ] H: Loaded 44555 primary data records. [2025-10-06T22:39:28.039190] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:39:28.041772] [INFO ] [MAIN ] GYLD: Generated 1793 derivative records from 1533 primary records. [2025-10-06T22:39:28.042225] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-06T22:39:28.064782] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1793 records). [2025-10-06T22:39:28.065766] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-06T22:39:28.069574] [INFO ] [MAIN ] Derivative Progress: 826/2037 symbols completed. GYLD took 1.1s. Estimated remaining: 8m 2s. Rate: 150.8 symbols/min [2025-10-06T22:39:28.070154] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:28.093811] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:28.095260] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39450 primary records. [2025-10-06T22:39:28.103541] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-06T22:39:28.110679] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:28.119347] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44555 primary records. [2025-10-06T22:39:28.123570] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-06T22:39:28.149081] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-10-06T22:39:28.149469] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-06T22:39:28.164910] [INFO ] [MAIN ] Derivative Progress: 827/2037 symbols completed. H took 1.2s. Estimated remaining: 8m 1s. Rate: 151.0 symbols/min [2025-10-06T22:39:28.165850] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:28.167935] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-10-06T22:39:28.168230] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-06T22:39:28.171123] [INFO ] [MAIN ] Derivative Progress: 828/2037 symbols completed. HAE took 1.2s. Estimated remaining: 7m 60s. Rate: 151.2 symbols/min [2025-10-06T22:39:28.171523] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:28.188925] [DEBUG] [LOCAL ] HAFN: Loaded 43169 existing records from primary storage. [2025-10-06T22:39:28.189121] [INFO ] [MAIN ] HAFN: Loaded 43169 primary data records. [2025-10-06T22:39:28.590419] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-06T22:39:28.590231] [DEBUG] [LOCAL ] HASI: Loaded 47215 existing records from primary storage. [2025-10-06T22:39:28.592007] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-10-06T22:39:28.592110] [INFO ] [MAIN ] HASI: Loaded 47215 primary data records. [2025-10-06T22:39:29.365397] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:29.367130] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43169 primary records. [2025-10-06T22:39:29.367927] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-06T22:39:29.391476] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-10-06T22:39:29.392094] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-06T22:39:29.395613] [INFO ] [MAIN ] Derivative Progress: 829/2037 symbols completed. HAFN took 1.3s. Estimated remaining: 8m 1s. Rate: 150.8 symbols/min [2025-10-06T22:39:29.396335] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:29.415535] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:29.417913] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47215 primary records. [2025-10-06T22:39:29.420056] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-06T22:39:29.444414] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:29.448808] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-10-06T22:39:29.449478] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-06T22:39:29.469271] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-10-06T22:39:29.480483] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-06T22:39:29.484445] [INFO ] [MAIN ] Derivative Progress: 830/2037 symbols completed. HASI took 1.3s. Estimated remaining: 7m 60s. Rate: 150.9 symbols/min [2025-10-06T22:39:29.485723] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:29.487449] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-10-06T22:39:29.487669] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-06T22:39:29.492734] [INFO ] [MAIN ] Derivative Progress: 831/2037 symbols completed. HAL took 1.3s. Estimated remaining: 7m 59s. Rate: 151.1 symbols/min [2025-10-06T22:39:29.493110] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:29.516251] [DEBUG] [LOCAL ] HBB: Loaded 6528 existing records from primary storage. [2025-10-06T22:39:29.516448] [INFO ] [MAIN ] HBB: Loaded 6528 primary data records. [2025-10-06T22:39:29.517526] [DEBUG] [LOCAL ] HAYW: Loaded 48771 existing records from primary storage. [2025-10-06T22:39:29.539191] [INFO ] [MAIN ] HAYW: Loaded 48771 primary data records. [2025-10-06T22:39:30.238910] [DEBUG] [LOCAL ] HBI: Loaded 52991 existing records from primary storage. [2025-10-06T22:39:30.239821] [INFO ] [MAIN ] HBI: Loaded 52991 primary data records. [2025-10-06T22:39:30.613819] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:30.615743] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6528 primary records. [2025-10-06T22:39:30.616004] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-06T22:39:30.651763] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:30.653784] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48771 primary records. [2025-10-06T22:39:30.653880] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-06T22:39:30.658153] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-10-06T22:39:30.667378] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-06T22:39:30.673578] [INFO ] [MAIN ] Derivative Progress: 832/2037 symbols completed. HBB took 1.2s. Estimated remaining: 7m 60s. Rate: 150.7 symbols/min [2025-10-06T22:39:30.675417] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:30.680629] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-10-06T22:39:30.680964] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-06T22:39:30.685188] [INFO ] [MAIN ] Derivative Progress: 833/2037 symbols completed. HAYW took 1.3s. Estimated remaining: 7m 59s. Rate: 150.9 symbols/min [2025-10-06T22:39:30.685875] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:30.704409] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:30.705521] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 52991 primary records. [2025-10-06T22:39:30.705674] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-06T22:39:30.725908] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-10-06T22:39:30.726316] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-06T22:39:30.729463] [INFO ] [MAIN ] Derivative Progress: 834/2037 symbols completed. HBI took 1.2s. Estimated remaining: 7m 58s. Rate: 151.1 symbols/min [2025-10-06T22:39:30.729901] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:30.798218] [DEBUG] [LOCAL ] HBM: Loaded 52914 existing records from primary storage. [2025-10-06T22:39:30.798597] [INFO ] [MAIN ] HBM: Loaded 52914 primary data records. [2025-10-06T22:39:30.820911] [DEBUG] [LOCAL ] HCA: Loaded 46826 existing records from primary storage. [2025-10-06T22:39:30.843520] [INFO ] [MAIN ] HCA: Loaded 46826 primary data records. [2025-10-06T22:39:31.138975] [DEBUG] [LOCAL ] HCC: Loaded 45347 existing records from primary storage. [2025-10-06T22:39:31.266854] [INFO ] [MAIN ] HCC: Loaded 45347 primary data records. [2025-10-06T22:39:31.920973] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:31.923909] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52914 primary records. [2025-10-06T22:39:31.926034] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-06T22:39:31.954328] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:31.955599] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 46826 primary records. [2025-10-06T22:39:31.960079] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-10-06T22:39:31.960575] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-06T22:39:31.960697] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-06T22:39:31.963236] [INFO ] [MAIN ] Derivative Progress: 835/2037 symbols completed. HBM took 1.3s. Estimated remaining: 7m 59s. Rate: 150.7 symbols/min [2025-10-06T22:39:31.964499] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:31.987090] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-10-06T22:39:31.987361] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-06T22:39:31.999331] [INFO ] [MAIN ] Derivative Progress: 836/2037 symbols completed. HCA took 1.3s. Estimated remaining: 7m 58s. Rate: 150.9 symbols/min [2025-10-06T22:39:31.999587] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:32.010837] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:32.012403] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45347 primary records. [2025-10-06T22:39:32.012566] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-06T22:39:32.033224] [DEBUG] [LOCAL ] HCI: Loaded 13998 existing records from primary storage. [2025-10-06T22:39:32.034678] [INFO ] [MAIN ] HCI: Loaded 13998 primary data records. [2025-10-06T22:39:32.088363] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-10-06T22:39:32.114312] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-06T22:39:32.141989] [INFO ] [MAIN ] Derivative Progress: 837/2037 symbols completed. HCC took 1.4s. Estimated remaining: 7m 57s. Rate: 151.0 symbols/min [2025-10-06T22:39:32.161734] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:32.419380] [DEBUG] [LOCAL ] HD: Loaded 53493 existing records from primary storage. [2025-10-06T22:39:32.420628] [INFO ] [MAIN ] HD: Loaded 53493 primary data records. [2025-10-06T22:39:32.673975] [DEBUG] [LOCAL ] HDB: Loaded 51935 existing records from primary storage. [2025-10-06T22:39:32.691925] [INFO ] [MAIN ] HDB: Loaded 51935 primary data records. [2025-10-06T22:39:32.968281] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:32.980340] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 13998 primary records. [2025-10-06T22:39:32.996097] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-06T22:39:33.217596] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-10-06T22:39:33.219609] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-06T22:39:33.223703] [INFO ] [MAIN ] Derivative Progress: 838/2037 symbols completed. HCI took 1.3s. Estimated remaining: 7m 57s. Rate: 150.7 symbols/min [2025-10-06T22:39:33.239260] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:33.240267] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53493 primary records. [2025-10-06T22:39:33.240361] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-06T22:39:33.261892] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-10-06T22:39:33.262268] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-06T22:39:33.265592] [INFO ] [MAIN ] Derivative Progress: 839/2037 symbols completed. HD took 1.3s. Estimated remaining: 7m 57s. Rate: 150.8 symbols/min [2025-10-06T22:39:33.282814] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:33.283690] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51935 primary records. [2025-10-06T22:39:33.283757] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-06T22:39:33.301109] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-10-06T22:39:33.301278] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-06T22:39:33.305107] [INFO ] [MAIN ] Derivative Progress: 840/2037 symbols completed. HDB took 1.1s. Estimated remaining: 7m 56s. Rate: 151.0 symbols/min [2025-10-06T22:39:33.305831] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:33.306003] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:33.306070] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:33.342852] [DEBUG] [LOCAL ] HEQ: Loaded 6477 existing records from primary storage. [2025-10-06T22:39:33.343017] [INFO ] [MAIN ] HEQ: Loaded 6477 primary data records. [2025-10-06T22:39:33.479700] [DEBUG] [LOCAL ] HEI: Loaded 31769 existing records from primary storage. [2025-10-06T22:39:33.485866] [INFO ] [MAIN ] HEI: Loaded 31769 primary data records. [2025-10-06T22:39:33.789848] [DEBUG] [LOCAL ] HE: Loaded 48994 existing records from primary storage. [2025-10-06T22:39:33.848432] [INFO ] [MAIN ] HE: Loaded 48994 primary data records. [2025-10-06T22:39:34.431889] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:34.433167] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6477 primary records. [2025-10-06T22:39:34.434036] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-06T22:39:34.454923] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-10-06T22:39:34.455224] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-06T22:39:34.458254] [INFO ] [MAIN ] Derivative Progress: 841/2037 symbols completed. HEQ took 1.2s. Estimated remaining: 7m 56s. Rate: 150.7 symbols/min [2025-10-06T22:39:34.458865] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:34.473112] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:34.474172] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 31769 primary records. [2025-10-06T22:39:34.474337] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-06T22:39:34.498731] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-10-06T22:39:34.499121] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-06T22:39:34.503229] [INFO ] [MAIN ] Derivative Progress: 842/2037 symbols completed. HEI took 1.2s. Estimated remaining: 7m 55s. Rate: 150.8 symbols/min [2025-10-06T22:39:34.503574] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:34.519361] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:34.520298] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 48994 primary records. [2025-10-06T22:39:34.520456] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-06T22:39:34.561293] [DEBUG] [LOCAL ] HFRO: Loaded 17511 existing records from primary storage. [2025-10-06T22:39:34.561909] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-10-06T22:39:34.562115] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-06T22:39:34.562202] [INFO ] [MAIN ] HFRO: Loaded 17511 primary data records. [2025-10-06T22:39:34.565875] [INFO ] [MAIN ] Derivative Progress: 843/2037 symbols completed. HE took 1.3s. Estimated remaining: 7m 55s. Rate: 151.0 symbols/min [2025-10-06T22:39:34.598926] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:34.685762] [DEBUG] [LOCAL ] HESM: Loaded 48236 existing records from primary storage. [2025-10-06T22:39:34.690105] [INFO ] [MAIN ] HESM: Loaded 48236 primary data records. [2025-10-06T22:39:34.916536] [DEBUG] [LOCAL ] HGER: Loaded 13996 existing records from primary storage. [2025-10-06T22:39:35.027277] [INFO ] [MAIN ] HGER: Loaded 13996 primary data records. [2025-10-06T22:39:35.688287] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:35.689839] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17511 primary records. [2025-10-06T22:39:35.691034] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-06T22:39:35.709200] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-10-06T22:39:35.710457] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-06T22:39:35.713706] [INFO ] [MAIN ] Derivative Progress: 844/2037 symbols completed. HFRO took 1.2s. Estimated remaining: 7m 55s. Rate: 150.6 symbols/min [2025-10-06T22:39:35.714132] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:35.730417] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:35.732580] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48236 primary records. [2025-10-06T22:39:35.732720] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-06T22:39:35.767292] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:35.772901] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 13996 primary records. [2025-10-06T22:39:35.773841] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-10-06T22:39:35.773207] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-06T22:39:35.774152] [DEBUG] [LOCAL ] HGLB: Loaded 9702 existing records from primary storage. [2025-10-06T22:39:35.774213] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-06T22:39:35.777864] [INFO ] [MAIN ] Derivative Progress: 845/2037 symbols completed. HESM took 1.3s. Estimated remaining: 7m 54s. Rate: 150.8 symbols/min [2025-10-06T22:39:35.779107] [INFO ] [MAIN ] HGLB: Loaded 9702 primary data records. [2025-10-06T22:39:35.778992] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:35.894991] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-10-06T22:39:35.911119] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-06T22:39:35.922190] [DEBUG] [LOCAL ] HGTY: Loaded 13227 existing records from primary storage. [2025-10-06T22:39:35.927456] [INFO ] [MAIN ] HGTY: Loaded 13227 primary data records. [2025-10-06T22:39:35.931181] [INFO ] [MAIN ] Derivative Progress: 846/2037 symbols completed. HGER took 1.3s. Estimated remaining: 7m 54s. Rate: 150.9 symbols/min [2025-10-06T22:39:35.931427] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:36.486760] [DEBUG] [LOCAL ] HGV: Loaded 46518 existing records from primary storage. [2025-10-06T22:39:36.487564] [INFO ] [MAIN ] HGV: Loaded 46518 primary data records. [2025-10-06T22:39:36.687299] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:36.690508] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9702 primary records. [2025-10-06T22:39:36.713465] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-06T22:39:36.861878] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-10-06T22:39:36.870852] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-06T22:39:36.874166] [INFO ] [MAIN ] Derivative Progress: 847/2037 symbols completed. HGLB took 1.2s. Estimated remaining: 7m 54s. Rate: 150.6 symbols/min [2025-10-06T22:39:36.879989] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:36.881474] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:36.883394] [INFO ] [MAIN ] HGTY: Generated 1794 derivative records from 13227 primary records. [2025-10-06T22:39:36.884103] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-06T22:39:36.903423] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1794 records). [2025-10-06T22:39:36.905036] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-06T22:39:36.908795] [INFO ] [MAIN ] Derivative Progress: 848/2037 symbols completed. HGTY took 1.1s. Estimated remaining: 7m 53s. Rate: 150.8 symbols/min [2025-10-06T22:39:36.908981] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:36.945419] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:36.947203] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46518 primary records. [2025-10-06T22:39:36.947368] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-06T22:39:36.981547] [DEBUG] [LOCAL ] HHH: Loaded 32909 existing records from primary storage. [2025-10-06T22:39:36.982413] [INFO ] [MAIN ] HHH: Loaded 32909 primary data records. [2025-10-06T22:39:37.115169] [DEBUG] [LOCAL ] HI: Loaded 35378 existing records from primary storage. [2025-10-06T22:39:37.116690] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-10-06T22:39:37.117042] [INFO ] [MAIN ] HI: Loaded 35378 primary data records. [2025-10-06T22:39:37.117137] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-06T22:39:37.121495] [INFO ] [MAIN ] Derivative Progress: 849/2037 symbols completed. HGV took 1.2s. Estimated remaining: 7m 52s. Rate: 150.9 symbols/min [2025-10-06T22:39:37.142716] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:37.730930] [DEBUG] [LOCAL ] HIG: Loaded 51186 existing records from primary storage. [2025-10-06T22:39:37.731233] [INFO ] [MAIN ] HIG: Loaded 51186 primary data records. [2025-10-06T22:39:37.857813] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:37.864087] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 32909 primary records. [2025-10-06T22:39:37.869695] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-06T22:39:38.180165] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-10-06T22:39:38.186007] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-06T22:39:38.189028] [INFO ] [MAIN ] Derivative Progress: 850/2037 symbols completed. HHH took 1.3s. Estimated remaining: 7m 53s. Rate: 150.6 symbols/min [2025-10-06T22:39:38.189785] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:38.190132] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:38.192127] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35378 primary records. [2025-10-06T22:39:38.192969] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-06T22:39:38.213975] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-10-06T22:39:38.214519] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-06T22:39:38.218048] [INFO ] [MAIN ] Derivative Progress: 851/2037 symbols completed. HI took 1.3s. Estimated remaining: 7m 52s. Rate: 150.8 symbols/min [2025-10-06T22:39:38.218305] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:38.253109] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:38.255553] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51186 primary records. [2025-10-06T22:39:38.267213] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-06T22:39:38.268269] [DEBUG] [LOCAL ] HII: Loaded 34309 existing records from primary storage. [2025-10-06T22:39:38.269272] [INFO ] [MAIN ] HII: Loaded 34309 primary data records. [2025-10-06T22:39:38.530564] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-06T22:39:38.524594] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-10-06T22:39:38.530927] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-10-06T22:39:38.531074] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-06T22:39:38.693779] [INFO ] [MAIN ] Derivative Progress: 852/2037 symbols completed. HIG took 1.6s. Estimated remaining: 7m 52s. Rate: 150.7 symbols/min [2025-10-06T22:39:38.717789] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:39.071917] [DEBUG] [LOCAL ] HIO: Loaded 23975 existing records from primary storage. [2025-10-06T22:39:39.073114] [INFO ] [MAIN ] HIO: Loaded 23975 primary data records. [2025-10-06T22:39:39.243974] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:39.251353] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 34309 primary records. [2025-10-06T22:39:39.268358] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-06T22:39:39.607056] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:39.613386] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-10-06T22:39:39.611031] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-10-06T22:39:39.614193] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-06T22:39:39.618730] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-06T22:39:39.617723] [INFO ] [MAIN ] Derivative Progress: 853/2037 symbols completed. HII took 1.4s. Estimated remaining: 7m 52s. Rate: 150.5 symbols/min [2025-10-06T22:39:39.646692] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-10-06T22:39:39.646898] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-06T22:39:39.653458] [INFO ] [MAIN ] Derivative Progress: 854/2037 symbols completed. HIMS took 1.4s. Estimated remaining: 7m 51s. Rate: 150.6 symbols/min [2025-10-06T22:39:39.679899] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:39.681020] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 23975 primary records. [2025-10-06T22:39:39.681109] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-06T22:39:39.704252] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-10-06T22:39:39.704522] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-06T22:39:39.709370] [INFO ] [MAIN ] Derivative Progress: 855/2037 symbols completed. HIO took 1.0s. Estimated remaining: 7m 50s. Rate: 150.8 symbols/min [2025-10-06T22:39:39.710765] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:39.711130] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:39.710522] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:39.778423] [DEBUG] [LOCAL ] HIPO: Loaded 22020 existing records from primary storage. [2025-10-06T22:39:39.795705] [INFO ] [MAIN ] HIPO: Loaded 22020 primary data records. [2025-10-06T22:39:39.803140] [DEBUG] [LOCAL ] HIX: Loaded 20616 existing records from primary storage. [2025-10-06T22:39:39.832772] [INFO ] [MAIN ] HIX: Loaded 20616 primary data records. [2025-10-06T22:39:40.030482] [DEBUG] [LOCAL ] HIW: Loaded 44532 existing records from primary storage. [2025-10-06T22:39:40.105940] [INFO ] [MAIN ] HIW: Loaded 44532 primary data records. [2025-10-06T22:39:40.971278] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:40.978391] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20616 primary records. [2025-10-06T22:39:40.977471] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:40.980686] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 22020 primary records. [2025-10-06T22:39:40.980931] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-06T22:39:40.980866] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-06T22:39:41.019078] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-10-06T22:39:41.026283] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-06T22:39:41.031802] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-10-06T22:39:41.030556] [INFO ] [MAIN ] Derivative Progress: 856/2037 symbols completed. HIX took 1.3s. Estimated remaining: 7m 51s. Rate: 150.4 symbols/min [2025-10-06T22:39:41.032047] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-06T22:39:41.030976] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:41.032237] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:41.035841] [INFO ] [MAIN ] Derivative Progress: 857/2037 symbols completed. HIPO took 1.3s. Estimated remaining: 7m 50s. Rate: 150.6 symbols/min [2025-10-06T22:39:41.033244] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44532 primary records. [2025-10-06T22:39:41.036410] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-06T22:39:41.036506] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:41.053727] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-10-06T22:39:41.053867] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-06T22:39:41.057478] [INFO ] [MAIN ] Derivative Progress: 858/2037 symbols completed. HIW took 1.3s. Estimated remaining: 7m 49s. Rate: 150.7 symbols/min [2025-10-06T22:39:41.057884] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:41.077879] [DEBUG] [LOCAL ] HKD: Loaded 18473 existing records from primary storage. [2025-10-06T22:39:41.078064] [INFO ] [MAIN ] HKD: Loaded 18473 primary data records. [2025-10-06T22:39:41.437431] [DEBUG] [LOCAL ] HLF: Loaded 48493 existing records from primary storage. [2025-10-06T22:39:41.437687] [INFO ] [MAIN ] HLF: Loaded 48493 primary data records. [2025-10-06T22:39:41.450801] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-10-06T22:39:41.470995] [INFO ] [MAIN ] HL: Loaded 53671 primary data records. [2025-10-06T22:39:42.119134] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:42.121546] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18473 primary records. [2025-10-06T22:39:42.121735] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-06T22:39:42.142926] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-10-06T22:39:42.143742] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-06T22:39:42.146572] [INFO ] [MAIN ] Derivative Progress: 859/2037 symbols completed. HKD took 1.1s. Estimated remaining: 7m 50s. Rate: 150.4 symbols/min [2025-10-06T22:39:42.147021] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:42.170494] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:42.171507] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48493 primary records. [2025-10-06T22:39:42.171680] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-06T22:39:42.186831] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:42.188135] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53671 primary records. [2025-10-06T22:39:42.195396] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-06T22:39:42.204970] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-10-06T22:39:42.220924] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-06T22:39:42.223464] [INFO ] [MAIN ] Derivative Progress: 860/2037 symbols completed. HLF took 1.2s. Estimated remaining: 7m 49s. Rate: 150.6 symbols/min [2025-10-06T22:39:42.223732] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:42.232369] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-10-06T22:39:42.232496] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-06T22:39:42.235947] [INFO ] [MAIN ] Derivative Progress: 861/2037 symbols completed. HL took 1.2s. Estimated remaining: 7m 48s. Rate: 150.7 symbols/min [2025-10-06T22:39:42.236364] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:42.248971] [DEBUG] [LOCAL ] HLI: Loaded 30859 existing records from primary storage. [2025-10-06T22:39:42.249151] [INFO ] [MAIN ] HLI: Loaded 30859 primary data records. [2025-10-06T22:39:42.615601] [DEBUG] [LOCAL ] HLLY: Loaded 33352 existing records from primary storage. [2025-10-06T22:39:42.624572] [INFO ] [MAIN ] HLLY: Loaded 33352 primary data records. [2025-10-06T22:39:42.472215] [DEBUG] [LOCAL ] HLIO: Loaded 27953 existing records from primary storage. [2025-10-06T22:39:42.636492] [INFO ] [MAIN ] HLIO: Loaded 27953 primary data records. [2025-10-06T22:39:43.254792] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:43.256917] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 30859 primary records. [2025-10-06T22:39:43.257441] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-06T22:39:43.276528] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-10-06T22:39:43.276899] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-06T22:39:43.279289] [INFO ] [MAIN ] Derivative Progress: 862/2037 symbols completed. HLI took 1.1s. Estimated remaining: 7m 49s. Rate: 150.5 symbols/min [2025-10-06T22:39:43.279790] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:43.303520] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:43.304630] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33352 primary records. [2025-10-06T22:39:43.304849] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-06T22:39:43.338417] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-10-06T22:39:43.339048] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-06T22:39:43.339551] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:43.342460] [INFO ] [MAIN ] Derivative Progress: 863/2037 symbols completed. HLLY took 1.1s. Estimated remaining: 7m 48s. Rate: 150.6 symbols/min [2025-10-06T22:39:43.344298] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 27953 primary records. [2025-10-06T22:39:43.342957] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:43.344504] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-06T22:39:43.376704] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-10-06T22:39:43.376861] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-06T22:39:43.380215] [INFO ] [MAIN ] Derivative Progress: 864/2037 symbols completed. HLIO took 1.2s. Estimated remaining: 7m 47s. Rate: 150.8 symbols/min [2025-10-06T22:39:43.380583] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:43.398743] [DEBUG] [LOCAL ] HLN: Loaded 53099 existing records from primary storage. [2025-10-06T22:39:43.399131] [INFO ] [MAIN ] HLN: Loaded 53099 primary data records. [2025-10-06T22:39:43.737702] [DEBUG] [LOCAL ] HLT: Loaded 50609 existing records from primary storage. [2025-10-06T22:39:43.738792] [INFO ] [MAIN ] HLT: Loaded 50609 primary data records. [2025-10-06T22:39:43.809948] [DEBUG] [LOCAL ] HLX: Loaded 47698 existing records from primary storage. [2025-10-06T22:39:43.824876] [INFO ] [MAIN ] HLX: Loaded 47698 primary data records. [2025-10-06T22:39:44.408253] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:44.410223] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53099 primary records. [2025-10-06T22:39:44.410919] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-06T22:39:44.436880] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-10-06T22:39:44.437055] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-06T22:39:44.440027] [INFO ] [MAIN ] Derivative Progress: 865/2037 symbols completed. HLN took 1.2s. Estimated remaining: 7m 47s. Rate: 150.5 symbols/min [2025-10-06T22:39:44.440452] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:44.460149] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:44.461176] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50609 primary records. [2025-10-06T22:39:44.461409] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-06T22:39:44.501610] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:44.504251] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 47698 primary records. [2025-10-06T22:39:44.503713] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-10-06T22:39:44.504599] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-06T22:39:44.504882] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-06T22:39:44.508448] [INFO ] [MAIN ] Derivative Progress: 866/2037 symbols completed. HLT took 1.2s. Estimated remaining: 7m 46s. Rate: 150.6 symbols/min [2025-10-06T22:39:44.509109] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:44.539737] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-10-06T22:39:44.539930] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-06T22:39:44.543545] [INFO ] [MAIN ] Derivative Progress: 867/2037 symbols completed. HLX took 1.2s. Estimated remaining: 7m 46s. Rate: 150.8 symbols/min [2025-10-06T22:39:44.543976] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:44.561136] [DEBUG] [LOCAL ] HMC: Loaded 46633 existing records from primary storage. [2025-10-06T22:39:44.566889] [INFO ] [MAIN ] HMC: Loaded 46633 primary data records. [2025-10-06T22:39:44.649531] [DEBUG] [LOCAL ] HMN: Loaded 23470 existing records from primary storage. [2025-10-06T22:39:44.667945] [INFO ] [MAIN ] HMN: Loaded 23470 primary data records. [2025-10-06T22:39:44.987409] [DEBUG] [LOCAL ] HMY: Loaded 53139 existing records from primary storage. [2025-10-06T22:39:45.133818] [INFO ] [MAIN ] HMY: Loaded 53139 primary data records. [2025-10-06T22:39:45.656811] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:45.660289] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46633 primary records. [2025-10-06T22:39:45.660400] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-06T22:39:45.694456] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:45.697350] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-10-06T22:39:45.698560] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23470 primary records. [2025-10-06T22:39:45.699007] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-06T22:39:45.699161] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-06T22:39:45.702105] [INFO ] [MAIN ] Derivative Progress: 868/2037 symbols completed. HMC took 1.3s. Estimated remaining: 7m 46s. Rate: 150.4 symbols/min [2025-10-06T22:39:45.737425] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:45.740003] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53139 primary records. [2025-10-06T22:39:45.740098] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-06T22:39:45.739081] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-10-06T22:39:45.740637] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-06T22:39:45.744091] [INFO ] [MAIN ] Derivative Progress: 869/2037 symbols completed. HMN took 1.2s. Estimated remaining: 7m 45s. Rate: 150.6 symbols/min [2025-10-06T22:39:45.762184] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-10-06T22:39:45.762273] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-06T22:39:45.766502] [INFO ] [MAIN ] Derivative Progress: 870/2037 symbols completed. HMY took 1.2s. Estimated remaining: 7m 44s. Rate: 150.8 symbols/min [2025-10-06T22:39:45.767179] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:45.767442] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:45.767313] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:45.825183] [DEBUG] [LOCAL ] HNI: Loaded 29391 existing records from primary storage. [2025-10-06T22:39:45.825356] [INFO ] [MAIN ] HNI: Loaded 29391 primary data records. [2025-10-06T22:39:45.893502] [DEBUG] [LOCAL ] HOUS: Loaded 44769 existing records from primary storage. [2025-10-06T22:39:45.917148] [INFO ] [MAIN ] HOUS: Loaded 44769 primary data records. [2025-10-06T22:39:45.992287] [DEBUG] [LOCAL ] HOG: Loaded 51071 existing records from primary storage. [2025-10-06T22:39:46.026587] [INFO ] [MAIN ] HOG: Loaded 51071 primary data records. [2025-10-06T22:39:46.903735] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:46.906070] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 29391 primary records. [2025-10-06T22:39:46.907200] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-06T22:39:46.962694] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-10-06T22:39:46.962976] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-06T22:39:46.955692] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:46.965880] [INFO ] [MAIN ] Derivative Progress: 871/2037 symbols completed. HNI took 1.2s. Estimated remaining: 7m 45s. Rate: 150.4 symbols/min [2025-10-06T22:39:46.955060] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:46.967168] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 44769 primary records. [2025-10-06T22:39:46.967315] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:46.968803] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 51071 primary records. [2025-10-06T22:39:46.968897] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-06T22:39:46.969941] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-06T22:39:47.000687] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-10-06T22:39:47.005896] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-06T22:39:47.011245] [INFO ] [MAIN ] Derivative Progress: 872/2037 symbols completed. HOG took 1.2s. Estimated remaining: 7m 44s. Rate: 150.6 symbols/min [2025-10-06T22:39:47.011555] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:47.015638] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-10-06T22:39:47.016294] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-06T22:39:47.026234] [INFO ] [MAIN ] Derivative Progress: 873/2037 symbols completed. HOUS took 1.3s. Estimated remaining: 7m 43s. Rate: 150.7 symbols/min [2025-10-06T22:39:47.026988] [DEBUG] [LOCAL ] HOV: Loaded 13870 existing records from primary storage. [2025-10-06T22:39:47.027184] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:47.027626] [INFO ] [MAIN ] HOV: Loaded 13870 primary data records. [2025-10-06T22:39:47.388135] [DEBUG] [LOCAL ] HP: Loaded 51643 existing records from primary storage. [2025-10-06T22:39:47.403914] [INFO ] [MAIN ] HP: Loaded 51643 primary data records. [2025-10-06T22:39:47.438803] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-06T22:39:47.463510] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-10-06T22:39:47.785381] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:47.910074] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 13870 primary records. [2025-10-06T22:39:47.931245] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-06T22:39:48.108798] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-10-06T22:39:48.110051] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-06T22:39:48.113607] [INFO ] [MAIN ] Derivative Progress: 874/2037 symbols completed. HOV took 1.1s. Estimated remaining: 7m 44s. Rate: 150.4 symbols/min [2025-10-06T22:39:48.115475] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:48.134020] [DEBUG] [LOCAL ] HPF: Loaded 7465 existing records from primary storage. [2025-10-06T22:39:48.135471] [INFO ] [MAIN ] HPF: Loaded 7465 primary data records. [2025-10-06T22:39:48.222130] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:48.273664] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51643 primary records. [2025-10-06T22:39:48.274302] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:48.292052] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-06T22:39:48.291917] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-10-06T22:39:48.316903] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-06T22:39:48.516683] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-10-06T22:39:48.519121] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-10-06T22:39:48.519252] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-06T22:39:48.519336] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-06T22:39:48.522493] [INFO ] [MAIN ] Derivative Progress: 875/2037 symbols completed. HP took 1.5s. Estimated remaining: 7m 43s. Rate: 150.4 symbols/min [2025-10-06T22:39:48.526828] [INFO ] [MAIN ] Derivative Progress: 876/2037 symbols completed. HPE took 1.5s. Estimated remaining: 7m 43s. Rate: 150.6 symbols/min [2025-10-06T22:39:48.526722] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:48.527519] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:48.553204] [DEBUG] [LOCAL ] HPI: Loaded 10524 existing records from primary storage. [2025-10-06T22:39:48.555177] [INFO ] [MAIN ] HPI: Loaded 10524 primary data records. [2025-10-06T22:39:48.631697] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:48.685391] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7465 primary records. [2025-10-06T22:39:48.738040] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-06T22:39:48.863144] [DEBUG] [LOCAL ] HPP: Loaded 51012 existing records from primary storage. [2025-10-06T22:39:49.047435] [INFO ] [MAIN ] HPP: Loaded 51012 primary data records. [2025-10-06T22:39:49.171165] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-10-06T22:39:49.181728] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-06T22:39:49.189374] [INFO ] [MAIN ] Derivative Progress: 877/2037 symbols completed. HPF took 1.1s. Estimated remaining: 7m 42s. Rate: 150.5 symbols/min [2025-10-06T22:39:49.189713] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:49.436677] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:49.437854] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10524 primary records. [2025-10-06T22:39:49.438528] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-06T22:39:49.474472] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-10-06T22:39:49.492110] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-06T22:39:49.495029] [INFO ] [MAIN ] Derivative Progress: 878/2037 symbols completed. HPI took 1.0s. Estimated remaining: 7m 42s. Rate: 150.5 symbols/min [2025-10-06T22:39:49.495335] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:49.497058] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-06T22:39:49.497364] [INFO ] [MAIN ] HPQ: Loaded 53668 primary data records. [2025-10-06T22:39:49.645441] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:49.655407] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 51012 primary records. [2025-10-06T22:39:49.661190] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-06T22:39:49.666885] [DEBUG] [LOCAL ] HPS: Loaded 10238 existing records from primary storage. [2025-10-06T22:39:49.683908] [INFO ] [MAIN ] HPS: Loaded 10238 primary data records. [2025-10-06T22:39:50.020951] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-10-06T22:39:50.037820] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-06T22:39:50.067179] [INFO ] [MAIN ] Derivative Progress: 879/2037 symbols completed. HPP took 1.5s. Estimated remaining: 7m 42s. Rate: 150.5 symbols/min [2025-10-06T22:39:50.103449] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:50.276842] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:50.278701] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53668 primary records. [2025-10-06T22:39:50.279046] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-06T22:39:50.277594] [DEBUG] [LOCAL ] HQH: Loaded 25404 existing records from primary storage. [2025-10-06T22:39:50.279613] [INFO ] [MAIN ] HQH: Loaded 25404 primary data records. [2025-10-06T22:39:50.349116] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-10-06T22:39:50.365473] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-06T22:39:50.373546] [INFO ] [MAIN ] Derivative Progress: 880/2037 symbols completed. HPQ took 1.2s. Estimated remaining: 7m 41s. Rate: 150.5 symbols/min [2025-10-06T22:39:50.388373] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:50.399961] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:50.420707] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10238 primary records. [2025-10-06T22:39:50.420882] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-06T22:39:50.563174] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-10-06T22:39:50.661927] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-06T22:39:50.663227] [DEBUG] [LOCAL ] HQL: Loaded 16481 existing records from primary storage. [2025-10-06T22:39:50.667974] [INFO ] [MAIN ] HQL: Loaded 16481 primary data records. [2025-10-06T22:39:50.667194] [INFO ] [MAIN ] Derivative Progress: 881/2037 symbols completed. HPS took 1.2s. Estimated remaining: 7m 41s. Rate: 150.5 symbols/min [2025-10-06T22:39:50.668216] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:51.139200] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:51.140866] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 25404 primary records. [2025-10-06T22:39:51.142199] [DEBUG] [LOCAL ] HR: Loaded 51938 existing records from primary storage. [2025-10-06T22:39:51.142518] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-06T22:39:51.142609] [INFO ] [MAIN ] HR: Loaded 51938 primary data records. [2025-10-06T22:39:51.238864] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-10-06T22:39:51.244786] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-06T22:39:51.283900] [INFO ] [MAIN ] Derivative Progress: 882/2037 symbols completed. HQH took 1.2s. Estimated remaining: 7m 41s. Rate: 150.4 symbols/min [2025-10-06T22:39:51.290692] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:51.542313] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:51.544618] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 16481 primary records. [2025-10-06T22:39:51.544962] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-06T22:39:51.581561] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-10-06T22:39:51.581913] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-06T22:39:51.584979] [INFO ] [MAIN ] Derivative Progress: 883/2037 symbols completed. HQL took 1.2s. Estimated remaining: 7m 40s. Rate: 150.5 symbols/min [2025-10-06T22:39:51.607815] [DEBUG] [LOCAL ] HRB: Loaded 48434 existing records from primary storage. [2025-10-06T22:39:51.608252] [INFO ] [MAIN ] HRB: Loaded 48434 primary data records. [2025-10-06T22:39:51.623015] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:51.682739] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 51938 primary records. [2025-10-06T22:39:51.691798] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-06T22:39:51.958613] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-10-06T22:39:51.958834] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-06T22:39:51.961995] [INFO ] [MAIN ] Derivative Progress: 884/2037 symbols completed. HR took 1.3s. Estimated remaining: 7m 40s. Rate: 150.5 symbols/min [2025-10-06T22:39:51.988529] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:51.989409] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48434 primary records. [2025-10-06T22:39:51.989479] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-06T22:39:52.005308] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-10-06T22:39:52.005371] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-06T22:39:52.008755] [INFO ] [MAIN ] Derivative Progress: 885/2037 symbols completed. HRB took 0.7s. Estimated remaining: 7m 39s. Rate: 150.6 symbols/min [2025-10-06T22:39:52.009565] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:52.009438] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:52.009669] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:52.053078] [DEBUG] [LOCAL ] HRTG: Loaded 33628 existing records from primary storage. [2025-10-06T22:39:52.053337] [INFO ] [MAIN ] HRTG: Loaded 33628 primary data records. [2025-10-06T22:39:52.252331] [DEBUG] [LOCAL ] HRI: Loaded 32701 existing records from primary storage. [2025-10-06T22:39:52.292515] [DEBUG] [LOCAL ] HRL: Loaded 53083 existing records from primary storage. [2025-10-06T22:39:52.291539] [INFO ] [MAIN ] HRI: Loaded 32701 primary data records. [2025-10-06T22:39:52.292774] [INFO ] [MAIN ] HRL: Loaded 53083 primary data records. [2025-10-06T22:39:53.135391] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:53.137153] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 33628 primary records. [2025-10-06T22:39:53.137730] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-06T22:39:53.157204] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-10-06T22:39:53.157703] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-06T22:39:53.160682] [INFO ] [MAIN ] Derivative Progress: 886/2037 symbols completed. HRTG took 1.2s. Estimated remaining: 7m 39s. Rate: 150.3 symbols/min [2025-10-06T22:39:53.161017] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:53.182171] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:53.183243] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 32701 primary records. [2025-10-06T22:39:53.191482] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-06T22:39:53.197025] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:53.198206] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53083 primary records. [2025-10-06T22:39:53.198315] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-06T22:39:53.228855] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-10-06T22:39:53.229031] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-06T22:39:53.234312] [INFO ] [MAIN ] Derivative Progress: 887/2037 symbols completed. HRI took 1.2s. Estimated remaining: 7m 39s. Rate: 150.5 symbols/min [2025-10-06T22:39:53.236085] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:53.241039] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-10-06T22:39:53.257871] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-06T22:39:53.261033] [INFO ] [MAIN ] Derivative Progress: 888/2037 symbols completed. HRL took 1.3s. Estimated remaining: 7m 38s. Rate: 150.6 symbols/min [2025-10-06T22:39:53.261464] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:53.276231] [DEBUG] [LOCAL ] HSHP: Loaded 15249 existing records from primary storage. [2025-10-06T22:39:53.276488] [INFO ] [MAIN ] HSHP: Loaded 15249 primary data records. [2025-10-06T22:39:53.317134] [DEBUG] [LOCAL ] HSBC: Loaded 50991 existing records from primary storage. [2025-10-06T22:39:53.334228] [INFO ] [MAIN ] HSBC: Loaded 50991 primary data records. [2025-10-06T22:39:53.920076] [DEBUG] [LOCAL ] HSY: Loaded 50371 existing records from primary storage. [2025-10-06T22:39:54.027243] [INFO ] [MAIN ] HSY: Loaded 50371 primary data records. [2025-10-06T22:39:54.448497] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:54.449614] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 15249 primary records. [2025-10-06T22:39:54.450082] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-06T22:39:54.471759] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-10-06T22:39:54.480326] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-06T22:39:54.489108] [INFO ] [MAIN ] Derivative Progress: 889/2037 symbols completed. HSHP took 1.3s. Estimated remaining: 7m 38s. Rate: 150.3 symbols/min [2025-10-06T22:39:54.486125] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:54.489367] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:54.491000] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 50991 primary records. [2025-10-06T22:39:54.491238] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-06T22:39:54.516029] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-10-06T22:39:54.516362] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-06T22:39:54.519431] [INFO ] [MAIN ] Derivative Progress: 890/2037 symbols completed. HSBC took 1.4s. Estimated remaining: 7m 38s. Rate: 150.4 symbols/min [2025-10-06T22:39:54.519756] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:54.529638] [DEBUG] [LOCAL ] HTD: Loaded 13905 existing records from primary storage. [2025-10-06T22:39:54.530805] [INFO ] [MAIN ] HTD: Loaded 13905 primary data records. [2025-10-06T22:39:54.608575] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:54.633113] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50371 primary records. [2025-10-06T22:39:54.633366] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-06T22:39:54.782100] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-10-06T22:39:54.909614] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-06T22:39:54.913022] [INFO ] [MAIN ] Derivative Progress: 891/2037 symbols completed. HSY took 1.7s. Estimated remaining: 7m 37s. Rate: 150.4 symbols/min [2025-10-06T22:39:54.914470] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:54.936619] [DEBUG] [LOCAL ] HTGC: Loaded 47393 existing records from primary storage. [2025-10-06T22:39:54.937502] [INFO ] [MAIN ] HTGC: Loaded 47393 primary data records. [2025-10-06T22:39:55.287424] [DEBUG] [LOCAL ] HTH: Loaded 32268 existing records from primary storage. [2025-10-06T22:39:55.287871] [INFO ] [MAIN ] HTH: Loaded 32268 primary data records. [2025-10-06T22:39:55.339134] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:55.373910] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 13905 primary records. [2025-10-06T22:39:55.385957] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-06T22:39:55.710752] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-10-06T22:39:55.711266] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-06T22:39:55.715722] [INFO ] [MAIN ] Derivative Progress: 892/2037 symbols completed. HTD took 1.2s. Estimated remaining: 7m 37s. Rate: 150.3 symbols/min [2025-10-06T22:39:55.718062] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:55.740763] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:55.742427] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47393 primary records. [2025-10-06T22:39:55.742532] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-06T22:39:55.761533] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-10-06T22:39:55.763063] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-06T22:39:55.767016] [INFO ] [MAIN ] Derivative Progress: 893/2037 symbols completed. HTGC took 1.2s. Estimated remaining: 7m 36s. Rate: 150.4 symbols/min [2025-10-06T22:39:55.767235] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:55.786157] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:55.787746] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32268 primary records. [2025-10-06T22:39:55.788064] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-06T22:39:55.816036] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-10-06T22:39:55.816221] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-06T22:39:55.819546] [INFO ] [MAIN ] Derivative Progress: 894/2037 symbols completed. HTH took 0.9s. Estimated remaining: 7m 36s. Rate: 150.5 symbols/min [2025-10-06T22:39:55.819891] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:55.849044] [DEBUG] [LOCAL ] HUBB: Loaded 36613 existing records from primary storage. [2025-10-06T22:39:55.849431] [INFO ] [MAIN ] HUBB: Loaded 36613 primary data records. [2025-10-06T22:39:56.023851] [DEBUG] [LOCAL ] HUBS: Loaded 39538 existing records from primary storage. [2025-10-06T22:39:56.065181] [INFO ] [MAIN ] HUBS: Loaded 39538 primary data records. [2025-10-06T22:39:56.255848] [DEBUG] [LOCAL ] HUN: Loaded 53203 existing records from primary storage. [2025-10-06T22:39:56.301608] [INFO ] [MAIN ] HUN: Loaded 53203 primary data records. [2025-10-06T22:39:56.897976] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:56.899686] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 36613 primary records. [2025-10-06T22:39:56.899884] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-06T22:39:56.921233] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-10-06T22:39:56.921923] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-06T22:39:56.925116] [INFO ] [MAIN ] Derivative Progress: 895/2037 symbols completed. HUBB took 1.2s. Estimated remaining: 7m 36s. Rate: 150.3 symbols/min [2025-10-06T22:39:56.925496] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:56.945019] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:56.948940] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 39538 primary records. [2025-10-06T22:39:56.949321] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-06T22:39:56.973025] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:56.982478] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53203 primary records. [2025-10-06T22:39:56.983108] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-06T22:39:56.983010] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-10-06T22:39:56.984057] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-06T22:39:56.986326] [INFO ] [MAIN ] Derivative Progress: 896/2037 symbols completed. HUBS took 1.2s. Estimated remaining: 7m 35s. Rate: 150.4 symbols/min [2025-10-06T22:39:56.986882] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:57.022046] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-10-06T22:39:57.022441] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-06T22:39:57.039114] [INFO ] [MAIN ] Derivative Progress: 897/2037 symbols completed. HUN took 1.2s. Estimated remaining: 7m 34s. Rate: 150.5 symbols/min [2025-10-06T22:39:57.039382] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:57.048179] [DEBUG] [LOCAL ] HVT: Loaded 15312 existing records from primary storage. [2025-10-06T22:39:57.048485] [INFO ] [MAIN ] HVT: Loaded 15312 primary data records. [2025-10-06T22:39:57.050090] [DEBUG] [LOCAL ] HUYA: Loaded 43951 existing records from primary storage. [2025-10-06T22:39:57.066466] [INFO ] [MAIN ] HUYA: Loaded 43951 primary data records. [2025-10-06T22:39:57.771724] [DEBUG] [LOCAL ] HWM: Loaded 52914 existing records from primary storage. [2025-10-06T22:39:57.772399] [INFO ] [MAIN ] HWM: Loaded 52914 primary data records. [2025-10-06T22:39:58.122111] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:58.124198] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 15312 primary records. [2025-10-06T22:39:58.124697] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-06T22:39:58.142034] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:58.156232] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 43951 primary records. [2025-10-06T22:39:58.156974] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-06T22:39:58.181882] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-10-06T22:39:58.182363] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-06T22:39:58.186369] [INFO ] [MAIN ] Derivative Progress: 898/2037 symbols completed. HUYA took 1.3s. Estimated remaining: 7m 35s. Rate: 150.2 symbols/min [2025-10-06T22:39:58.186563] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-10-06T22:39:58.187185] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-06T22:39:58.190019] [INFO ] [MAIN ] Derivative Progress: 899/2037 symbols completed. HVT took 1.2s. Estimated remaining: 7m 34s. Rate: 150.4 symbols/min [2025-10-06T22:39:58.208594] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:58.209492] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 52914 primary records. [2025-10-06T22:39:58.209559] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-06T22:39:58.226764] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-10-06T22:39:58.226846] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-06T22:39:58.230418] [INFO ] [MAIN ] Derivative Progress: 900/2037 symbols completed. HWM took 1.2s. Estimated remaining: 7m 33s. Rate: 150.5 symbols/min [2025-10-06T22:39:58.231004] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:58.231186] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:58.231369] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:58.255863] [DEBUG] [LOCAL ] HY: Loaded 9953 existing records from primary storage. [2025-10-06T22:39:58.256230] [DEBUG] [LOCAL ] HYI: Loaded 9840 existing records from primary storage. [2025-10-06T22:39:58.256564] [INFO ] [MAIN ] HY: Loaded 9953 primary data records. [2025-10-06T22:39:58.256737] [INFO ] [MAIN ] HYI: Loaded 9840 primary data records. [2025-10-06T22:39:58.801408] [DEBUG] [LOCAL ] HXL: Loaded 45883 existing records from primary storage. [2025-10-06T22:39:58.927220] [INFO ] [MAIN ] HXL: Loaded 45883 primary data records. [2025-10-06T22:39:59.310038] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:59.312132] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 9953 primary records. [2025-10-06T22:39:59.312744] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-06T22:39:59.327799] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:59.342636] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 9840 primary records. [2025-10-06T22:39:59.343151] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-06T22:39:59.366057] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-10-06T22:39:59.361578] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-10-06T22:39:59.366369] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-06T22:39:59.366485] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-06T22:39:59.369854] [INFO ] [MAIN ] Derivative Progress: 901/2037 symbols completed. HYI took 1.1s. Estimated remaining: 7m 34s. Rate: 150.2 symbols/min [2025-10-06T22:39:59.373827] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:59.374210] [INFO ] [MAIN ] Derivative Progress: 902/2037 symbols completed. HY took 1.1s. Estimated remaining: 7m 33s. Rate: 150.4 symbols/min [2025-10-06T22:39:59.374896] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:39:59.396427] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:39:59.397799] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 45883 primary records. [2025-10-06T22:39:59.398090] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-06T22:39:59.402292] [DEBUG] [LOCAL ] HYTR: Loaded 3133 existing records from primary storage. [2025-10-06T22:39:59.403466] [INFO ] [MAIN ] HYTR: Loaded 3133 primary data records. [2025-10-06T22:39:59.569626] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-10-06T22:39:59.569984] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-06T22:39:59.576516] [DEBUG] [LOCAL ] HYT: Loaded 33640 existing records from primary storage. [2025-10-06T22:39:59.600997] [INFO ] [MAIN ] HYT: Loaded 33640 primary data records. [2025-10-06T22:39:59.605082] [INFO ] [MAIN ] Derivative Progress: 903/2037 symbols completed. HXL took 1.4s. Estimated remaining: 7m 32s. Rate: 150.5 symbols/min [2025-10-06T22:39:59.614415] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:00.197427] [DEBUG] [LOCAL ] HZO: Loaded 29152 existing records from primary storage. [2025-10-06T22:40:00.199057] [INFO ] [MAIN ] HZO: Loaded 29152 primary data records. [2025-10-06T22:40:00.412352] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:40:00.444296] [INFO ] [MAIN ] HYTR: Generated 1793 derivative records from 3133 primary records. [2025-10-06T22:40:00.573594] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-06T22:40:00.602566] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1793 records). [2025-10-06T22:40:00.603357] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-06T22:40:00.607137] [INFO ] [MAIN ] Derivative Progress: 904/2037 symbols completed. HYTR took 1.2s. Estimated remaining: 7m 33s. Rate: 150.2 symbols/min [2025-10-06T22:40:00.607497] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:00.623121] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:00.624185] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33640 primary records. [2025-10-06T22:40:00.624424] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-06T22:40:00.649683] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-10-06T22:40:00.648303] [DEBUG] [LOCAL ] IAE: Loaded 6005 existing records from primary storage. [2025-10-06T22:40:00.650170] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-06T22:40:00.650275] [INFO ] [MAIN ] IAE: Loaded 6005 primary data records. [2025-10-06T22:40:00.653739] [INFO ] [MAIN ] Derivative Progress: 905/2037 symbols completed. HYT took 1.3s. Estimated remaining: 7m 32s. Rate: 150.4 symbols/min [2025-10-06T22:40:00.687378] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:00.975549] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:00.985501] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29152 primary records. [2025-10-06T22:40:00.985811] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-06T22:40:01.019767] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-10-06T22:40:01.020669] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-06T22:40:01.023736] [INFO ] [MAIN ] Derivative Progress: 906/2037 symbols completed. HZO took 1.4s. Estimated remaining: 7m 31s. Rate: 150.4 symbols/min [2025-10-06T22:40:01.023968] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:01.046911] [DEBUG] [LOCAL ] IAG: Loaded 53456 existing records from primary storage. [2025-10-06T22:40:01.047436] [INFO ] [MAIN ] IAG: Loaded 53456 primary data records. [2025-10-06T22:40:01.159802] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:01.190122] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 6005 primary records. [2025-10-06T22:40:01.225991] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-06T22:40:01.489039] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-10-06T22:40:01.489700] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-06T22:40:01.494385] [INFO ] [MAIN ] Derivative Progress: 907/2037 symbols completed. IAE took 0.9s. Estimated remaining: 7m 31s. Rate: 150.3 symbols/min [2025-10-06T22:40:01.498931] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:01.498549] [DEBUG] [LOCAL ] IBM: Loaded 53631 existing records from primary storage. [2025-10-06T22:40:01.501526] [INFO ] [MAIN ] IBM: Loaded 53631 primary data records. [2025-10-06T22:40:01.836901] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:01.976459] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53456 primary records. [2025-10-06T22:40:01.986108] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-06T22:40:01.988722] [DEBUG] [LOCAL ] IBN: Loaded 52865 existing records from primary storage. [2025-10-06T22:40:01.989871] [INFO ] [MAIN ] IBN: Loaded 52865 primary data records. [2025-10-06T22:40:02.042406] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-10-06T22:40:02.069457] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-06T22:40:02.099761] [INFO ] [MAIN ] Derivative Progress: 908/2037 symbols completed. IAG took 1.4s. Estimated remaining: 7m 31s. Rate: 150.3 symbols/min [2025-10-06T22:40:02.124087] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:02.441966] [DEBUG] [LOCAL ] IBP: Loaded 28785 existing records from primary storage. [2025-10-06T22:40:02.444207] [INFO ] [MAIN ] IBP: Loaded 28785 primary data records. [2025-10-06T22:40:02.443840] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:02.459456] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53631 primary records. [2025-10-06T22:40:02.487034] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-06T22:40:02.636818] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-10-06T22:40:02.659733] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-06T22:40:02.669802] [INFO ] [MAIN ] Derivative Progress: 909/2037 symbols completed. IBM took 1.6s. Estimated remaining: 7m 31s. Rate: 150.2 symbols/min [2025-10-06T22:40:02.831313] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:02.846509] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:02.847772] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52865 primary records. [2025-10-06T22:40:02.848266] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-06T22:40:02.868568] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-10-06T22:40:02.869100] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-06T22:40:02.872504] [INFO ] [MAIN ] Derivative Progress: 910/2037 symbols completed. IBN took 1.4s. Estimated remaining: 7m 30s. Rate: 150.3 symbols/min [2025-10-06T22:40:02.874731] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:02.918218] [DEBUG] [LOCAL ] IBTA: Loaded 37411 existing records from primary storage. [2025-10-06T22:40:02.918902] [INFO ] [MAIN ] IBTA: Loaded 37411 primary data records. [2025-10-06T22:40:02.918834] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:02.919728] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 28785 primary records. [2025-10-06T22:40:02.930924] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-06T22:40:03.127296] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-10-06T22:40:03.134685] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-06T22:40:03.253430] [INFO ] [MAIN ] Derivative Progress: 911/2037 symbols completed. IBP took 1.1s. Estimated remaining: 7m 30s. Rate: 150.3 symbols/min [2025-10-06T22:40:03.254093] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:03.274445] [DEBUG] [LOCAL ] ICE: Loaded 53010 existing records from primary storage. [2025-10-06T22:40:03.275807] [INFO ] [MAIN ] ICE: Loaded 53010 primary data records. [2025-10-06T22:40:03.619384] [DEBUG] [LOCAL ] ICL: Loaded 38331 existing records from primary storage. [2025-10-06T22:40:03.623082] [INFO ] [MAIN ] ICL: Loaded 38331 primary data records. [2025-10-06T22:40:03.680122] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:03.725999] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 37411 primary records. [2025-10-06T22:40:03.739201] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-06T22:40:03.957474] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-10-06T22:40:03.958011] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-06T22:40:03.961182] [INFO ] [MAIN ] Derivative Progress: 912/2037 symbols completed. IBTA took 1.1s. Estimated remaining: 7m 30s. Rate: 150.1 symbols/min [2025-10-06T22:40:03.961617] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:03.982122] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:03.984332] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53010 primary records. [2025-10-06T22:40:03.985283] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-06T22:40:04.012286] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-10-06T22:40:04.012712] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-06T22:40:04.016805] [INFO ] [MAIN ] Derivative Progress: 913/2037 symbols completed. ICE took 1.1s. Estimated remaining: 7m 29s. Rate: 150.3 symbols/min [2025-10-06T22:40:04.031610] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:04.041444] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38331 primary records. [2025-10-06T22:40:04.041581] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-06T22:40:04.068006] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-10-06T22:40:04.068116] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-06T22:40:04.067926] [DEBUG] [LOCAL ] IDA: Loaded 32463 existing records from primary storage. [2025-10-06T22:40:04.071184] [INFO ] [MAIN ] Derivative Progress: 914/2037 symbols completed. ICL took 0.8s. Estimated remaining: 7m 28s. Rate: 150.4 symbols/min [2025-10-06T22:40:04.071374] [INFO ] [MAIN ] IDA: Loaded 32463 primary data records. [2025-10-06T22:40:04.415528] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:04.416198] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32463 primary records. [2025-10-06T22:40:04.416260] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-06T22:40:04.435631] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-10-06T22:40:04.435844] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-06T22:40:04.438856] [INFO ] [MAIN ] Derivative Progress: 915/2037 symbols completed. IDA took 0.5s. Estimated remaining: 7m 27s. Rate: 150.4 symbols/min [2025-10-06T22:40:04.439513] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:04.439760] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:04.439904] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:04.470635] [DEBUG] [LOCAL ] IDE: Loaded 8817 existing records from primary storage. [2025-10-06T22:40:04.485698] [DEBUG] [LOCAL ] IDT: Loaded 18050 existing records from primary storage. [2025-10-06T22:40:04.485891] [INFO ] [MAIN ] IDE: Loaded 8817 primary data records. [2025-10-06T22:40:04.486193] [INFO ] [MAIN ] IDT: Loaded 18050 primary data records. [2025-10-06T22:40:04.756266] [DEBUG] [LOCAL ] IEX: Loaded 38346 existing records from primary storage. [2025-10-06T22:40:04.854240] [INFO ] [MAIN ] IEX: Loaded 38346 primary data records. [2025-10-06T22:40:05.527979] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:05.530129] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 8817 primary records. [2025-10-06T22:40:05.545281] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-06T22:40:05.547404] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:05.558289] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 18050 primary records. [2025-10-06T22:40:05.564590] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-06T22:40:05.567467] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-10-06T22:40:05.567580] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-06T22:40:05.570348] [INFO ] [MAIN ] Derivative Progress: 916/2037 symbols completed. IDE took 1.1s. Estimated remaining: 7m 28s. Rate: 150.1 symbols/min [2025-10-06T22:40:05.570856] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:05.587453] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-10-06T22:40:05.587527] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-06T22:40:05.590389] [INFO ] [MAIN ] Derivative Progress: 917/2037 symbols completed. IDT took 1.2s. Estimated remaining: 7m 27s. Rate: 150.3 symbols/min [2025-10-06T22:40:05.590919] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:05.610453] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:05.611499] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38346 primary records. [2025-10-06T22:40:05.611662] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-06T22:40:05.701283] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-10-06T22:40:05.702833] [DEBUG] [LOCAL ] IFN: Loaded 18369 existing records from primary storage. [2025-10-06T22:40:05.703020] [INFO ] [MAIN ] IFN: Loaded 18369 primary data records. [2025-10-06T22:40:05.702906] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-06T22:40:05.708352] [INFO ] [MAIN ] Derivative Progress: 918/2037 symbols completed. IEX took 1.3s. Estimated remaining: 7m 26s. Rate: 150.4 symbols/min [2025-10-06T22:40:05.715141] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:05.924590] [DEBUG] [LOCAL ] IFF: Loaded 51017 existing records from primary storage. [2025-10-06T22:40:05.933149] [INFO ] [MAIN ] IFF: Loaded 51017 primary data records. [2025-10-06T22:40:05.948510] [DEBUG] [LOCAL ] IFS: Loaded 22985 existing records from primary storage. [2025-10-06T22:40:06.022106] [INFO ] [MAIN ] IFS: Loaded 22985 primary data records. [2025-10-06T22:40:06.824273] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:06.825970] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18369 primary records. [2025-10-06T22:40:06.826256] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-06T22:40:06.856432] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-10-06T22:40:06.858053] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-06T22:40:06.893741] [INFO ] [MAIN ] Derivative Progress: 919/2037 symbols completed. IFN took 1.3s. Estimated remaining: 7m 27s. Rate: 150.1 symbols/min [2025-10-06T22:40:06.890381] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:06.894376] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:06.896015] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 22985 primary records. [2025-10-06T22:40:06.896966] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 51017 primary records. [2025-10-06T22:40:06.895054] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:06.897297] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-06T22:40:06.897800] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-06T22:40:06.930941] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-10-06T22:40:06.931603] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-06T22:40:06.932103] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-10-06T22:40:06.939140] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-06T22:40:06.935338] [INFO ] [MAIN ] Derivative Progress: 920/2037 symbols completed. IFS took 1.2s. Estimated remaining: 7m 26s. Rate: 150.2 symbols/min [2025-10-06T22:40:06.939349] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:06.943085] [INFO ] [MAIN ] Derivative Progress: 921/2037 symbols completed. IFF took 1.4s. Estimated remaining: 7m 25s. Rate: 150.4 symbols/min [2025-10-06T22:40:06.943323] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:06.950101] [DEBUG] [LOCAL ] IGA: Loaded 9908 existing records from primary storage. [2025-10-06T22:40:06.950592] [INFO ] [MAIN ] IGA: Loaded 9908 primary data records. [2025-10-06T22:40:07.034820] [DEBUG] [LOCAL ] IGI: Loaded 3684 existing records from primary storage. [2025-10-06T22:40:07.053041] [INFO ] [MAIN ] IGI: Loaded 3684 primary data records. [2025-10-06T22:40:07.184991] [DEBUG] [LOCAL ] IGD: Loaded 19180 existing records from primary storage. [2025-10-06T22:40:07.247613] [INFO ] [MAIN ] IGD: Loaded 19180 primary data records. [2025-10-06T22:40:07.972342] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:07.973678] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 9908 primary records. [2025-10-06T22:40:07.973821] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-06T22:40:08.017702] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-10-06T22:40:08.018569] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-06T22:40:08.018125] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:08.021682] [INFO ] [MAIN ] Derivative Progress: 922/2037 symbols completed. IGA took 1.1s. Estimated remaining: 7m 26s. Rate: 150.1 symbols/min [2025-10-06T22:40:08.023062] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3684 primary records. [2025-10-06T22:40:08.031768] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-06T22:40:08.031560] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:08.044794] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:08.055446] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19180 primary records. [2025-10-06T22:40:08.054463] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-10-06T22:40:08.055788] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-06T22:40:08.055977] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-06T22:40:08.060888] [INFO ] [MAIN ] Derivative Progress: 923/2037 symbols completed. IGI took 1.1s. Estimated remaining: 7m 25s. Rate: 150.3 symbols/min [2025-10-06T22:40:08.061783] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:08.079375] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-10-06T22:40:08.080711] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-06T22:40:08.083919] [INFO ] [MAIN ] Derivative Progress: 924/2037 symbols completed. IGD took 1.1s. Estimated remaining: 7m 24s. Rate: 150.4 symbols/min [2025-10-06T22:40:08.084211] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:08.088573] [DEBUG] [LOCAL ] IH: Loaded 2883 existing records from primary storage. [2025-10-06T22:40:08.088889] [INFO ] [MAIN ] IH: Loaded 2883 primary data records. [2025-10-06T22:40:08.217804] [DEBUG] [LOCAL ] IHD: Loaded 6945 existing records from primary storage. [2025-10-06T22:40:08.230725] [INFO ] [MAIN ] IHD: Loaded 6945 primary data records. [2025-10-06T22:40:08.241989] [DEBUG] [LOCAL ] IGR: Loaded 30365 existing records from primary storage. [2025-10-06T22:40:08.274922] [INFO ] [MAIN ] IGR: Loaded 30365 primary data records. [2025-10-06T22:40:09.216543] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:09.217504] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 2883 primary records. [2025-10-06T22:40:09.217624] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-06T22:40:09.236441] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-10-06T22:40:09.236946] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-06T22:40:09.239951] [INFO ] [MAIN ] Derivative Progress: 925/2037 symbols completed. IH took 1.2s. Estimated remaining: 7m 24s. Rate: 150.1 symbols/min [2025-10-06T22:40:09.240412] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:09.265218] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:09.266427] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30365 primary records. [2025-10-06T22:40:09.289035] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-06T22:40:09.288909] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:09.298516] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 6945 primary records. [2025-10-06T22:40:09.302714] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-06T22:40:09.315184] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-10-06T22:40:09.315346] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-06T22:40:09.320151] [INFO ] [MAIN ] Derivative Progress: 926/2037 symbols completed. IGR took 1.3s. Estimated remaining: 7m 24s. Rate: 150.2 symbols/min [2025-10-06T22:40:09.321058] [DEBUG] [LOCAL ] IHG: Loaded 24338 existing records from primary storage. [2025-10-06T22:40:09.321947] [INFO ] [MAIN ] IHG: Loaded 24338 primary data records. [2025-10-06T22:40:09.350525] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:09.428819] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-10-06T22:40:09.434488] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-06T22:40:09.456623] [INFO ] [MAIN ] Derivative Progress: 927/2037 symbols completed. IHD took 1.4s. Estimated remaining: 7m 23s. Rate: 150.4 symbols/min [2025-10-06T22:40:09.468462] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:09.680394] [DEBUG] [LOCAL ] IIF: Loaded 5697 existing records from primary storage. [2025-10-06T22:40:09.681532] [INFO ] [MAIN ] IIF: Loaded 5697 primary data records. [2025-10-06T22:40:09.808910] [DEBUG] [LOCAL ] IHS: Loaded 38705 existing records from primary storage. [2025-10-06T22:40:09.814911] [INFO ] [MAIN ] IHS: Loaded 38705 primary data records. [2025-10-06T22:40:10.372564] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:10.375932] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24338 primary records. [2025-10-06T22:40:10.376579] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-06T22:40:10.396500] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-10-06T22:40:10.397927] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-06T22:40:10.401176] [INFO ] [MAIN ] Derivative Progress: 928/2037 symbols completed. IHG took 1.2s. Estimated remaining: 7m 23s. Rate: 150.1 symbols/min [2025-10-06T22:40:10.419467] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:10.420447] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5697 primary records. [2025-10-06T22:40:10.420601] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-06T22:40:10.438346] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-10-06T22:40:10.450950] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-06T22:40:10.453917] [INFO ] [MAIN ] Derivative Progress: 929/2037 symbols completed. IIF took 1.0s. Estimated remaining: 7m 22s. Rate: 150.3 symbols/min [2025-10-06T22:40:10.451210] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:10.455070] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 38705 primary records. [2025-10-06T22:40:10.455138] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-06T22:40:10.470795] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-10-06T22:40:10.470862] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-06T22:40:10.473766] [INFO ] [MAIN ] Derivative Progress: 930/2037 symbols completed. IHS took 1.1s. Estimated remaining: 7m 22s. Rate: 150.4 symbols/min [2025-10-06T22:40:10.474428] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:10.474512] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:10.474745] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:10.512348] [DEBUG] [LOCAL ] IIM: Loaded 15908 existing records from primary storage. [2025-10-06T22:40:10.511883] [DEBUG] [LOCAL ] IIIN: Loaded 16204 existing records from primary storage. [2025-10-06T22:40:10.512706] [INFO ] [MAIN ] IIM: Loaded 15908 primary data records. [2025-10-06T22:40:10.567528] [INFO ] [MAIN ] IIIN: Loaded 16204 primary data records. [2025-10-06T22:40:10.690104] [DEBUG] [LOCAL ] IIPR: Loaded 29626 existing records from primary storage. [2025-10-06T22:40:10.720034] [INFO ] [MAIN ] IIPR: Loaded 29626 primary data records. [2025-10-06T22:40:11.550624] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:11.552403] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15908 primary records. [2025-10-06T22:40:11.552777] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-06T22:40:11.589419] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:11.602975] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16204 primary records. [2025-10-06T22:40:11.604059] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:11.604169] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-10-06T22:40:11.603793] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-06T22:40:11.604351] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-06T22:40:11.604985] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29626 primary records. [2025-10-06T22:40:11.608368] [INFO ] [MAIN ] Derivative Progress: 931/2037 symbols completed. IIM took 1.1s. Estimated remaining: 7m 22s. Rate: 150.1 symbols/min [2025-10-06T22:40:11.608551] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:11.608615] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-06T22:40:11.637066] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-10-06T22:40:11.637493] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-06T22:40:11.640582] [INFO ] [MAIN ] Derivative Progress: 932/2037 symbols completed. IIIN took 1.2s. Estimated remaining: 7m 21s. Rate: 150.3 symbols/min [2025-10-06T22:40:11.641044] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:11.644665] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-10-06T22:40:11.644935] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-06T22:40:11.647896] [INFO ] [MAIN ] Derivative Progress: 933/2037 symbols completed. IIPR took 1.2s. Estimated remaining: 7m 20s. Rate: 150.4 symbols/min [2025-10-06T22:40:11.648240] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:11.690305] [DEBUG] [LOCAL ] IMAX: Loaded 42878 existing records from primary storage. [2025-10-06T22:40:11.690561] [INFO ] [MAIN ] IMAX: Loaded 42878 primary data records. [2025-10-06T22:40:12.044268] [DEBUG] [LOCAL ] INFA: Loaded 49450 existing records from primary storage. [2025-10-06T22:40:12.054936] [INFO ] [MAIN ] INFA: Loaded 49450 primary data records. [2025-10-06T22:40:12.054538] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-06T22:40:12.078391] [INFO ] [MAIN ] INFY: Loaded 53596 primary data records. [2025-10-06T22:40:12.759558] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:12.760940] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 42878 primary records. [2025-10-06T22:40:12.761213] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-06T22:40:12.781058] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-10-06T22:40:12.781308] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-06T22:40:12.784189] [INFO ] [MAIN ] Derivative Progress: 934/2037 symbols completed. IMAX took 1.2s. Estimated remaining: 7m 21s. Rate: 150.1 symbols/min [2025-10-06T22:40:12.784728] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:12.802945] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:12.805293] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 49450 primary records. [2025-10-06T22:40:12.805401] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-06T22:40:12.831632] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:12.835788] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-10-06T22:40:12.835894] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-06T22:40:12.838886] [INFO ] [MAIN ] Derivative Progress: 935/2037 symbols completed. INFA took 1.2s. Estimated remaining: 7m 20s. Rate: 150.3 symbols/min [2025-10-06T22:40:12.836577] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53596 primary records. [2025-10-06T22:40:12.839250] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-06T22:40:12.839166] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:12.857212] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-10-06T22:40:12.857450] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-06T22:40:12.860115] [INFO ] [MAIN ] Derivative Progress: 936/2037 symbols completed. INFY took 1.2s. Estimated remaining: 7m 19s. Rate: 150.4 symbols/min [2025-10-06T22:40:12.860338] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:12.920516] [DEBUG] [LOCAL ] INGM: Loaded 28691 existing records from primary storage. [2025-10-06T22:40:12.920879] [INFO ] [MAIN ] INGM: Loaded 28691 primary data records. [2025-10-06T22:40:12.965581] [DEBUG] [LOCAL ] ING: Loaded 50693 existing records from primary storage. [2025-10-06T22:40:13.007463] [INFO ] [MAIN ] ING: Loaded 50693 primary data records. [2025-10-06T22:40:13.171212] [DEBUG] [LOCAL ] INGR: Loaded 33586 existing records from primary storage. [2025-10-06T22:40:13.228578] [INFO ] [MAIN ] INGR: Loaded 33586 primary data records. [2025-10-06T22:40:13.930801] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:13.931902] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28691 primary records. [2025-10-06T22:40:13.932098] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-06T22:40:13.969508] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-10-06T22:40:13.970258] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:13.971082] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50693 primary records. [2025-10-06T22:40:13.969978] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-06T22:40:13.973562] [INFO ] [MAIN ] Derivative Progress: 937/2037 symbols completed. INGM took 1.1s. Estimated remaining: 7m 20s. Rate: 150.1 symbols/min [2025-10-06T22:40:13.973893] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:13.974968] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-06T22:40:14.009025] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-10-06T22:40:14.009240] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-06T22:40:14.008320] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:14.011921] [INFO ] [MAIN ] Derivative Progress: 938/2037 symbols completed. ING took 1.2s. Estimated remaining: 7m 19s. Rate: 150.3 symbols/min [2025-10-06T22:40:14.013010] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33586 primary records. [2025-10-06T22:40:14.013230] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-06T22:40:14.012131] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:14.048312] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-10-06T22:40:14.048608] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-06T22:40:14.051742] [INFO ] [MAIN ] Derivative Progress: 939/2037 symbols completed. INGR took 1.2s. Estimated remaining: 7m 18s. Rate: 150.4 symbols/min [2025-10-06T22:40:14.052090] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:14.070350] [DEBUG] [LOCAL ] INN: Loaded 41760 existing records from primary storage. [2025-10-06T22:40:14.079035] [INFO ] [MAIN ] INN: Loaded 41760 primary data records. [2025-10-06T22:40:14.230683] [DEBUG] [LOCAL ] INSP: Loaded 37461 existing records from primary storage. [2025-10-06T22:40:14.241744] [INFO ] [MAIN ] INSP: Loaded 37461 primary data records. [2025-10-06T22:40:14.385001] [DEBUG] [LOCAL ] INSW: Loaded 39789 existing records from primary storage. [2025-10-06T22:40:14.508557] [INFO ] [MAIN ] INSW: Loaded 39789 primary data records. [2025-10-06T22:40:15.142732] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:15.143801] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41760 primary records. [2025-10-06T22:40:15.144096] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-06T22:40:15.179936] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-10-06T22:40:15.186548] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-06T22:40:15.189009] [INFO ] [MAIN ] Derivative Progress: 940/2037 symbols completed. INN took 1.2s. Estimated remaining: 7m 18s. Rate: 150.1 symbols/min [2025-10-06T22:40:15.189220] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:15.186357] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:15.205694] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:15.204891] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 37461 primary records. [2025-10-06T22:40:15.205960] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-06T22:40:15.208007] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 39789 primary records. [2025-10-06T22:40:15.208556] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-06T22:40:15.240620] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-10-06T22:40:15.241779] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-06T22:40:15.245340] [INFO ] [MAIN ] Derivative Progress: 941/2037 symbols completed. INSW took 1.2s. Estimated remaining: 7m 18s. Rate: 150.3 symbols/min [2025-10-06T22:40:15.246065] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:15.247908] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-10-06T22:40:15.248382] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-06T22:40:15.252318] [INFO ] [MAIN ] Derivative Progress: 942/2037 symbols completed. INSP took 1.2s. Estimated remaining: 7m 17s. Rate: 150.4 symbols/min [2025-10-06T22:40:15.252594] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:15.310694] [DEBUG] [LOCAL ] INVX: Loaded 29134 existing records from primary storage. [2025-10-06T22:40:15.312102] [INFO ] [MAIN ] INVX: Loaded 29134 primary data records. [2025-10-06T22:40:15.324610] [DEBUG] [LOCAL ] INVH: Loaded 53152 existing records from primary storage. [2025-10-06T22:40:15.361015] [INFO ] [MAIN ] INVH: Loaded 53152 primary data records. [2025-10-06T22:40:15.707840] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-06T22:40:15.847458] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-06T22:40:16.338063] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:16.337548] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:16.339880] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29134 primary records. [2025-10-06T22:40:16.339252] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53152 primary records. [2025-10-06T22:40:16.340063] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-06T22:40:16.340135] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-06T22:40:16.377398] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-10-06T22:40:16.377727] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-10-06T22:40:16.379727] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-06T22:40:16.379521] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-06T22:40:16.382499] [INFO ] [MAIN ] Derivative Progress: 943/2037 symbols completed. INVX took 1.1s. Estimated remaining: 7m 17s. Rate: 150.1 symbols/min [2025-10-06T22:40:16.386757] [INFO ] [MAIN ] Derivative Progress: 944/2037 symbols completed. INVH took 1.2s. Estimated remaining: 7m 16s. Rate: 150.3 symbols/min [2025-10-06T22:40:16.400332] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:16.401171] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-10-06T22:40:16.401238] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-06T22:40:16.417894] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-10-06T22:40:16.417994] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-06T22:40:16.420772] [INFO ] [MAIN ] Derivative Progress: 945/2037 symbols completed. IONQ took 1.2s. Estimated remaining: 7m 16s. Rate: 150.4 symbols/min [2025-10-06T22:40:16.421276] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:16.421359] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:16.421721] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:16.511911] [DEBUG] [LOCAL ] IOT: Loaded 53471 existing records from primary storage. [2025-10-06T22:40:16.512989] [INFO ] [MAIN ] IOT: Loaded 53471 primary data records. [2025-10-06T22:40:16.594136] [DEBUG] [LOCAL ] IPG: Loaded 53329 existing records from primary storage. [2025-10-06T22:40:16.628466] [INFO ] [MAIN ] IPG: Loaded 53329 primary data records. [2025-10-06T22:40:16.864081] [DEBUG] [LOCAL ] IP: Loaded 53313 existing records from primary storage. [2025-10-06T22:40:17.023222] [INFO ] [MAIN ] IP: Loaded 53313 primary data records. [2025-10-06T22:40:17.593580] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:17.598294] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53471 primary records. [2025-10-06T22:40:17.598839] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-06T22:40:17.629163] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:17.631067] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53329 primary records. [2025-10-06T22:40:17.631548] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-06T22:40:17.647729] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-10-06T22:40:17.648553] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-06T22:40:17.650928] [INFO ] [MAIN ] Derivative Progress: 946/2037 symbols completed. IOT took 1.2s. Estimated remaining: 7m 16s. Rate: 150.1 symbols/min [2025-10-06T22:40:17.651760] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:17.659991] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-10-06T22:40:17.660152] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-06T22:40:17.664518] [INFO ] [MAIN ] Derivative Progress: 947/2037 symbols completed. IPG took 1.2s. Estimated remaining: 7m 15s. Rate: 150.3 symbols/min [2025-10-06T22:40:17.678049] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:17.678756] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:17.686112] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53313 primary records. [2025-10-06T22:40:17.686438] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-06T22:40:17.712697] [DEBUG] [LOCAL ] IPI: Loaded 21499 existing records from primary storage. [2025-10-06T22:40:17.713478] [INFO ] [MAIN ] IPI: Loaded 21499 primary data records. [2025-10-06T22:40:17.767673] [DEBUG] [LOCAL ] IQI: Loaded 18004 existing records from primary storage. [2025-10-06T22:40:17.781639] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-10-06T22:40:17.780911] [INFO ] [MAIN ] IQI: Loaded 18004 primary data records. [2025-10-06T22:40:17.791713] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-06T22:40:17.826397] [INFO ] [MAIN ] Derivative Progress: 948/2037 symbols completed. IP took 1.4s. Estimated remaining: 7m 15s. Rate: 150.4 symbols/min [2025-10-06T22:40:17.909920] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:18.421462] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:18.422903] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21499 primary records. [2025-10-06T22:40:18.423140] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-06T22:40:18.425916] [DEBUG] [LOCAL ] IR: Loaded 52726 existing records from primary storage. [2025-10-06T22:40:18.429395] [INFO ] [MAIN ] IR: Loaded 52726 primary data records. [2025-10-06T22:40:18.472050] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:18.499627] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-10-06T22:40:18.500935] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-06T22:40:18.510400] [INFO ] [MAIN ] Derivative Progress: 949/2037 symbols completed. IPI took 0.9s. Estimated remaining: 7m 14s. Rate: 150.2 symbols/min [2025-10-06T22:40:18.523495] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:18.500832] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 18004 primary records. [2025-10-06T22:40:18.555608] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-06T22:40:18.792685] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-10-06T22:40:18.792864] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-06T22:40:18.796191] [INFO ] [MAIN ] Derivative Progress: 950/2037 symbols completed. IQI took 1.1s. Estimated remaining: 7m 14s. Rate: 150.3 symbols/min [2025-10-06T22:40:18.796485] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:18.831357] [DEBUG] [LOCAL ] IRM: Loaded 49285 existing records from primary storage. [2025-10-06T22:40:18.835971] [INFO ] [MAIN ] IRM: Loaded 49285 primary data records. [2025-10-06T22:40:18.962244] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:18.972464] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52726 primary records. [2025-10-06T22:40:18.994894] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-06T22:40:18.989505] [DEBUG] [LOCAL ] IRS: Loaded 22173 existing records from primary storage. [2025-10-06T22:40:19.060822] [INFO ] [MAIN ] IRS: Loaded 22173 primary data records. [2025-10-06T22:40:19.065167] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-10-06T22:40:19.246707] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-06T22:40:19.287946] [INFO ] [MAIN ] Derivative Progress: 951/2037 symbols completed. IR took 1.4s. Estimated remaining: 7m 14s. Rate: 150.3 symbols/min [2025-10-06T22:40:19.288683] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:19.596108] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:19.597269] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49285 primary records. [2025-10-06T22:40:19.597856] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-06T22:40:19.632065] [DEBUG] [LOCAL ] IRT: Loaded 50382 existing records from primary storage. [2025-10-06T22:40:19.633315] [INFO ] [MAIN ] IRT: Loaded 50382 primary data records. [2025-10-06T22:40:19.699507] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-10-06T22:40:19.711999] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-06T22:40:19.739335] [INFO ] [MAIN ] Derivative Progress: 952/2037 symbols completed. IRM took 1.2s. Estimated remaining: 7m 13s. Rate: 150.2 symbols/min [2025-10-06T22:40:19.744518] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:19.952923] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:19.954679] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 22173 primary records. [2025-10-06T22:40:19.954882] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-06T22:40:19.974212] [DEBUG] [LOCAL ] ISD: Loaded 15726 existing records from primary storage. [2025-10-06T22:40:19.975358] [INFO ] [MAIN ] ISD: Loaded 15726 primary data records. [2025-10-06T22:40:20.068736] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-10-06T22:40:20.084899] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-06T22:40:20.087202] [INFO ] [MAIN ] Derivative Progress: 953/2037 symbols completed. IRS took 1.3s. Estimated remaining: 7m 13s. Rate: 150.3 symbols/min [2025-10-06T22:40:20.093403] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:20.302818] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:20.303829] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50382 primary records. [2025-10-06T22:40:20.303969] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-06T22:40:20.345156] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-10-06T22:40:20.348461] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-06T22:40:20.347718] [DEBUG] [LOCAL ] IT: Loaded 42187 existing records from primary storage. [2025-10-06T22:40:20.350942] [INFO ] [MAIN ] Derivative Progress: 954/2037 symbols completed. IRT took 1.1s. Estimated remaining: 7m 12s. Rate: 150.3 symbols/min [2025-10-06T22:40:20.351173] [INFO ] [MAIN ] IT: Loaded 42187 primary data records. [2025-10-06T22:40:20.382509] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:20.436334] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:20.448071] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15726 primary records. [2025-10-06T22:40:20.470999] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-06T22:40:20.707666] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-10-06T22:40:20.709466] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-06T22:40:20.710080] [DEBUG] [LOCAL ] ITGR: Loaded 31364 existing records from primary storage. [2025-10-06T22:40:20.712819] [INFO ] [MAIN ] Derivative Progress: 955/2037 symbols completed. ISD took 1.0s. Estimated remaining: 7m 12s. Rate: 150.3 symbols/min [2025-10-06T22:40:20.712960] [INFO ] [MAIN ] ITGR: Loaded 31364 primary data records. [2025-10-06T22:40:20.714147] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:21.040868] [DEBUG] [LOCAL ] ITT: Loaded 32662 existing records from primary storage. [2025-10-06T22:40:21.041235] [INFO ] [MAIN ] ITT: Loaded 32662 primary data records. [2025-10-06T22:40:21.142454] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:21.165556] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 42187 primary records. [2025-10-06T22:40:21.166180] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-06T22:40:21.431326] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-10-06T22:40:21.432280] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-06T22:40:21.434920] [INFO ] [MAIN ] Derivative Progress: 956/2037 symbols completed. IT took 1.3s. Estimated remaining: 7m 12s. Rate: 150.2 symbols/min [2025-10-06T22:40:21.435380] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:21.457384] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:21.458510] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31364 primary records. [2025-10-06T22:40:21.458736] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-06T22:40:21.477899] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-10-06T22:40:21.478135] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-06T22:40:21.481499] [INFO ] [MAIN ] Derivative Progress: 957/2037 symbols completed. ITGR took 1.1s. Estimated remaining: 7m 11s. Rate: 150.3 symbols/min [2025-10-06T22:40:21.482951] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:21.498793] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:21.499611] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 32662 primary records. [2025-10-06T22:40:21.499735] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-06T22:40:21.516698] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-10-06T22:40:21.516987] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-06T22:40:21.519927] [INFO ] [MAIN ] Derivative Progress: 958/2037 symbols completed. ITT took 0.8s. Estimated remaining: 7m 10s. Rate: 150.5 symbols/min [2025-10-06T22:40:21.565209] [DEBUG] [LOCAL ] ITUB: Loaded 53317 existing records from primary storage. [2025-10-06T22:40:21.565490] [INFO ] [MAIN ] ITUB: Loaded 53317 primary data records. [2025-10-06T22:40:21.786785] [DEBUG] [LOCAL ] ITW: Loaded 45700 existing records from primary storage. [2025-10-06T22:40:21.811746] [INFO ] [MAIN ] ITW: Loaded 45700 primary data records. [2025-10-06T22:40:22.256233] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:22.257323] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53317 primary records. [2025-10-06T22:40:22.257697] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-06T22:40:22.276832] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-10-06T22:40:22.277028] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-06T22:40:22.279513] [INFO ] [MAIN ] Derivative Progress: 959/2037 symbols completed. ITUB took 0.8s. Estimated remaining: 7m 10s. Rate: 150.3 symbols/min [2025-10-06T22:40:22.295375] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:22.295999] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 45700 primary records. [2025-10-06T22:40:22.296059] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-06T22:40:22.311880] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-10-06T22:40:22.311949] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-06T22:40:22.315415] [INFO ] [MAIN ] Derivative Progress: 960/2037 symbols completed. ITW took 0.8s. Estimated remaining: 7m 9s. Rate: 150.5 symbols/min [2025-10-06T22:40:22.316157] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:22.316274] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:22.316818] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:22.363743] [DEBUG] [LOCAL ] IVT: Loaded 30780 existing records from primary storage. [2025-10-06T22:40:22.363934] [INFO ] [MAIN ] IVT: Loaded 30780 primary data records. [2025-10-06T22:40:22.509212] [DEBUG] [LOCAL ] IVR: Loaded 47998 existing records from primary storage. [2025-10-06T22:40:22.529432] [INFO ] [MAIN ] IVR: Loaded 47998 primary data records. [2025-10-06T22:40:22.735124] [DEBUG] [LOCAL ] IVZ: Loaded 53132 existing records from primary storage. [2025-10-06T22:40:22.862609] [INFO ] [MAIN ] IVZ: Loaded 53132 primary data records. [2025-10-06T22:40:23.490612] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:23.506841] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 30780 primary records. [2025-10-06T22:40:23.507612] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:23.508551] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 47998 primary records. [2025-10-06T22:40:23.507785] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-06T22:40:23.510099] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-06T22:40:23.540755] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-10-06T22:40:23.544556] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-06T22:40:23.547434] [INFO ] [MAIN ] Derivative Progress: 961/2037 symbols completed. IVT took 1.2s. Estimated remaining: 7m 10s. Rate: 150.1 symbols/min [2025-10-06T22:40:23.548007] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:23.569013] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:23.571279] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53132 primary records. [2025-10-06T22:40:23.571542] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-10-06T22:40:23.571609] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-06T22:40:23.571760] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-06T22:40:23.575074] [INFO ] [MAIN ] Derivative Progress: 962/2037 symbols completed. IVR took 1.3s. Estimated remaining: 7m 9s. Rate: 150.3 symbols/min [2025-10-06T22:40:23.575743] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:23.601865] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-10-06T22:40:23.610365] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-06T22:40:23.611215] [DEBUG] [LOCAL ] IX: Loaded 22330 existing records from primary storage. [2025-10-06T22:40:23.614381] [INFO ] [MAIN ] IX: Loaded 22330 primary data records. [2025-10-06T22:40:23.614255] [INFO ] [MAIN ] Derivative Progress: 963/2037 symbols completed. IVZ took 1.3s. Estimated remaining: 7m 8s. Rate: 150.4 symbols/min [2025-10-06T22:40:23.614770] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:24.012361] [DEBUG] [LOCAL ] J: Loaded 40186 existing records from primary storage. [2025-10-06T22:40:24.013262] [INFO ] [MAIN ] J: Loaded 40186 primary data records. [2025-10-06T22:40:24.059579] [DEBUG] [LOCAL ] JBGS: Loaded 42393 existing records from primary storage. [2025-10-06T22:40:24.073963] [INFO ] [MAIN ] JBGS: Loaded 42393 primary data records. [2025-10-06T22:40:24.751677] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:24.753364] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22330 primary records. [2025-10-06T22:40:24.754423] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-06T22:40:24.778933] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-10-06T22:40:24.780051] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-06T22:40:24.783981] [INFO ] [MAIN ] Derivative Progress: 964/2037 symbols completed. IX took 1.2s. Estimated remaining: 7m 9s. Rate: 150.1 symbols/min [2025-10-06T22:40:24.784331] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:24.805610] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:24.806974] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40186 primary records. [2025-10-06T22:40:24.807232] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-06T22:40:24.830630] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-10-06T22:40:24.830940] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-06T22:40:24.833467] [INFO ] [MAIN ] Derivative Progress: 965/2037 symbols completed. J took 1.3s. Estimated remaining: 7m 8s. Rate: 150.3 symbols/min [2025-10-06T22:40:24.833889] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:24.850246] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:24.851144] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42393 primary records. [2025-10-06T22:40:24.851210] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-06T22:40:24.871291] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-10-06T22:40:24.871466] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-06T22:40:24.875879] [INFO ] [MAIN ] Derivative Progress: 966/2037 symbols completed. JBGS took 1.3s. Estimated remaining: 7m 7s. Rate: 150.4 symbols/min [2025-10-06T22:40:24.876148] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:24.928127] [DEBUG] [LOCAL ] JBI: Loaded 43384 existing records from primary storage. [2025-10-06T22:40:24.928422] [INFO ] [MAIN ] JBI: Loaded 43384 primary data records. [2025-10-06T22:40:25.057077] [DEBUG] [LOCAL ] JBL: Loaded 48400 existing records from primary storage. [2025-10-06T22:40:25.052756] [DEBUG] [LOCAL ] JBND: Loaded 26300 existing records from primary storage. [2025-10-06T22:40:25.063194] [INFO ] [MAIN ] JBND: Loaded 26300 primary data records. [2025-10-06T22:40:25.079011] [INFO ] [MAIN ] JBL: Loaded 48400 primary data records. [2025-10-06T22:40:26.005829] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:26.007278] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 43384 primary records. [2025-10-06T22:40:26.007503] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-06T22:40:26.044432] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:26.060927] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48400 primary records. [2025-10-06T22:40:26.061598] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:26.062564] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 26300 primary records. [2025-10-06T22:40:26.062690] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-06T22:40:26.063032] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-06T22:40:26.064515] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-10-06T22:40:26.065833] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-06T22:40:26.088374] [INFO ] [MAIN ] Derivative Progress: 967/2037 symbols completed. JBI took 1.3s. Estimated remaining: 7m 8s. Rate: 150.1 symbols/min [2025-10-06T22:40:26.096612] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:26.101589] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-10-06T22:40:26.102147] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-06T22:40:26.105372] [INFO ] [MAIN ] Derivative Progress: 968/2037 symbols completed. JBND took 1.2s. Estimated remaining: 7m 7s. Rate: 150.2 symbols/min [2025-10-06T22:40:26.105511] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-10-06T22:40:26.105983] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-06T22:40:26.105621] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:26.109041] [INFO ] [MAIN ] Derivative Progress: 969/2037 symbols completed. JBL took 1.3s. Estimated remaining: 7m 6s. Rate: 150.4 symbols/min [2025-10-06T22:40:26.109171] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:26.119072] [DEBUG] [LOCAL ] JCE: Loaded 6968 existing records from primary storage. [2025-10-06T22:40:26.119266] [INFO ] [MAIN ] JCE: Loaded 6968 primary data records. [2025-10-06T22:40:26.538621] [DEBUG] [LOCAL ] JEF: Loaded 50035 existing records from primary storage. [2025-10-06T22:40:26.539249] [INFO ] [MAIN ] JEF: Loaded 50035 primary data records. [2025-10-06T22:40:26.640110] [DEBUG] [LOCAL ] JCI: Loaded 53538 existing records from primary storage. [2025-10-06T22:40:26.669033] [INFO ] [MAIN ] JCI: Loaded 53538 primary data records. [2025-10-06T22:40:27.209334] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:27.211455] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 6968 primary records. [2025-10-06T22:40:27.212026] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-06T22:40:27.232807] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-10-06T22:40:27.233447] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-06T22:40:27.236915] [INFO ] [MAIN ] Derivative Progress: 970/2037 symbols completed. JCE took 1.1s. Estimated remaining: 7m 6s. Rate: 150.1 symbols/min [2025-10-06T22:40:27.237347] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:27.277241] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:27.279134] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 50035 primary records. [2025-10-06T22:40:27.279250] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-06T22:40:27.277924] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:27.281318] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53538 primary records. [2025-10-06T22:40:27.281806] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-06T22:40:27.329578] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-10-06T22:40:27.330694] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-06T22:40:27.330552] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-10-06T22:40:27.333506] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-06T22:40:27.333409] [INFO ] [MAIN ] Derivative Progress: 971/2037 symbols completed. JEF took 1.2s. Estimated remaining: 7m 6s. Rate: 150.2 symbols/min [2025-10-06T22:40:27.336733] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:27.336828] [INFO ] [MAIN ] Derivative Progress: 972/2037 symbols completed. JCI took 1.2s. Estimated remaining: 7m 5s. Rate: 150.4 symbols/min [2025-10-06T22:40:27.337710] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:27.355985] [DEBUG] [LOCAL ] JELD: Loaded 46068 existing records from primary storage. [2025-10-06T22:40:27.356336] [INFO ] [MAIN ] JELD: Loaded 46068 primary data records. [2025-10-06T22:40:27.452225] [DEBUG] [LOCAL ] JEQ: Loaded 8651 existing records from primary storage. [2025-10-06T22:40:27.489954] [INFO ] [MAIN ] JEQ: Loaded 8651 primary data records. [2025-10-06T22:40:27.711282] [DEBUG] [LOCAL ] JFR: Loaded 30926 existing records from primary storage. [2025-10-06T22:40:27.844235] [INFO ] [MAIN ] JFR: Loaded 30926 primary data records. [2025-10-06T22:40:28.479417] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:28.480750] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46068 primary records. [2025-10-06T22:40:28.480967] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-06T22:40:28.518896] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:28.520368] [INFO ] [MAIN ] JEQ: Generated 1794 derivative records from 8651 primary records. [2025-10-06T22:40:28.521180] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-10-06T22:40:28.521275] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-10-06T22:40:28.522396] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-06T22:40:28.525215] [INFO ] [MAIN ] Derivative Progress: 973/2037 symbols completed. JELD took 1.3s. Estimated remaining: 7m 5s. Rate: 150.1 symbols/min [2025-10-06T22:40:28.544198] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1794 records). [2025-10-06T22:40:28.544513] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-10-06T22:40:28.548011] [INFO ] [MAIN ] Derivative Progress: 974/2037 symbols completed. JEQ took 1.2s. Estimated remaining: 7m 5s. Rate: 150.2 symbols/min [2025-10-06T22:40:28.561367] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:28.562121] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30926 primary records. [2025-10-06T22:40:28.562184] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-06T22:40:28.578679] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-10-06T22:40:28.578793] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-06T22:40:28.582004] [INFO ] [MAIN ] Derivative Progress: 975/2037 symbols completed. JFR took 1.2s. Estimated remaining: 7m 4s. Rate: 150.4 symbols/min [2025-10-06T22:40:28.582610] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:28.582745] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:28.582552] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:28.592600] [DEBUG] [LOCAL ] JHI: Loaded 3628 existing records from primary storage. [2025-10-06T22:40:28.592898] [INFO ] [MAIN ] JHI: Loaded 3628 primary data records. [2025-10-06T22:40:28.682232] [DEBUG] [LOCAL ] JGH: Loaded 11239 existing records from primary storage. [2025-10-06T22:40:28.710565] [INFO ] [MAIN ] JGH: Loaded 11239 primary data records. [2025-10-06T22:40:29.100082] [DEBUG] [LOCAL ] JHG: Loaded 47585 existing records from primary storage. [2025-10-06T22:40:29.120950] [INFO ] [MAIN ] JHG: Loaded 47585 primary data records. [2025-10-06T22:40:29.636901] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:29.638835] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3628 primary records. [2025-10-06T22:40:29.639070] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-06T22:40:29.677739] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:29.679432] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 11239 primary records. [2025-10-06T22:40:29.679536] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-06T22:40:29.679639] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-10-06T22:40:29.680929] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-06T22:40:29.684209] [INFO ] [MAIN ] Derivative Progress: 976/2037 symbols completed. JHI took 1.1s. Estimated remaining: 7m 4s. Rate: 150.1 symbols/min [2025-10-06T22:40:29.685217] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:29.710076] [DEBUG] [LOCAL ] JHS: Loaded 2874 existing records from primary storage. [2025-10-06T22:40:29.711017] [INFO ] [MAIN ] JHS: Loaded 2874 primary data records. [2025-10-06T22:40:29.739212] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-10-06T22:40:29.762465] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-06T22:40:29.765344] [INFO ] [MAIN ] Derivative Progress: 977/2037 symbols completed. JGH took 1.2s. Estimated remaining: 7m 3s. Rate: 150.2 symbols/min [2025-10-06T22:40:29.787139] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:29.819600] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:29.850068] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47585 primary records. [2025-10-06T22:40:29.850726] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-06T22:40:30.170763] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-10-06T22:40:30.171723] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-06T22:40:30.175752] [INFO ] [MAIN ] Derivative Progress: 978/2037 symbols completed. JHG took 1.6s. Estimated remaining: 7m 3s. Rate: 150.2 symbols/min [2025-10-06T22:40:30.176493] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:30.200474] [DEBUG] [LOCAL ] JHX: Loaded 52726 existing records from primary storage. [2025-10-06T22:40:30.201298] [INFO ] [MAIN ] JHX: Loaded 52726 primary data records. [2025-10-06T22:40:30.328169] [DEBUG] [LOCAL ] JILL: Loaded 16449 existing records from primary storage. [2025-10-06T22:40:30.354840] [INFO ] [MAIN ] JILL: Loaded 16449 primary data records. [2025-10-06T22:40:30.642531] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:30.672176] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2874 primary records. [2025-10-06T22:40:30.672569] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-06T22:40:30.771699] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-10-06T22:40:30.890492] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-06T22:40:30.893948] [INFO ] [MAIN ] Derivative Progress: 979/2037 symbols completed. JHS took 1.2s. Estimated remaining: 7m 3s. Rate: 150.1 symbols/min [2025-10-06T22:40:30.894640] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:30.922795] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:40:30.924090] [INFO ] [MAIN ] JHX: Generated 1793 derivative records from 52726 primary records. [2025-10-06T22:40:30.924327] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-06T22:40:30.967857] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:30.969742] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16449 primary records. [2025-10-06T22:40:30.971106] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-06T22:40:30.992872] [DEBUG] [LOCAL ] JHX: Derivative data saved (1793 records). [2025-10-06T22:40:30.998543] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-06T22:40:31.002095] [INFO ] [MAIN ] Derivative Progress: 980/2037 symbols completed. JHX took 1.2s. Estimated remaining: 7m 2s. Rate: 150.2 symbols/min [2025-10-06T22:40:31.002812] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:31.006259] [DEBUG] [LOCAL ] JKS: Loaded 40026 existing records from primary storage. [2025-10-06T22:40:31.009213] [INFO ] [MAIN ] JKS: Loaded 40026 primary data records. [2025-10-06T22:40:31.010003] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-10-06T22:40:31.010198] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-06T22:40:31.013514] [INFO ] [MAIN ] Derivative Progress: 981/2037 symbols completed. JILL took 0.8s. Estimated remaining: 7m 1s. Rate: 150.3 symbols/min [2025-10-06T22:40:31.013934] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:31.102340] [DEBUG] [LOCAL ] JLS: Loaded 4143 existing records from primary storage. [2025-10-06T22:40:31.122161] [INFO ] [MAIN ] JLS: Loaded 4143 primary data records. [2025-10-06T22:40:31.375106] [DEBUG] [LOCAL ] JLL: Loaded 31429 existing records from primary storage. [2025-10-06T22:40:31.505281] [INFO ] [MAIN ] JLL: Loaded 31429 primary data records. [2025-10-06T22:40:32.197339] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:32.201391] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 40026 primary records. [2025-10-06T22:40:32.203091] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-06T22:40:32.247265] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:32.249177] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4143 primary records. [2025-10-06T22:40:32.249347] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-06T22:40:32.273667] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-10-06T22:40:32.274374] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-06T22:40:32.278520] [INFO ] [MAIN ] Derivative Progress: 982/2037 symbols completed. JKS took 1.4s. Estimated remaining: 7m 2s. Rate: 150.0 symbols/min [2025-10-06T22:40:32.279667] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:32.289635] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-10-06T22:40:32.290268] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-06T22:40:32.312226] [INFO ] [MAIN ] Derivative Progress: 983/2037 symbols completed. JLS took 1.3s. Estimated remaining: 7m 1s. Rate: 150.2 symbols/min [2025-10-06T22:40:32.314258] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:32.316218] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:32.317378] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 31429 primary records. [2025-10-06T22:40:32.317688] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-06T22:40:32.363151] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-10-06T22:40:32.364213] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-06T22:40:32.368998] [INFO ] [MAIN ] Derivative Progress: 984/2037 symbols completed. JLL took 1.4s. Estimated remaining: 7m 0s. Rate: 150.3 symbols/min [2025-10-06T22:40:32.369524] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:32.397181] [DEBUG] [LOCAL ] JMIA: Loaded 50758 existing records from primary storage. [2025-10-06T22:40:32.397610] [INFO ] [MAIN ] JMIA: Loaded 50758 primary data records. [2025-10-06T22:40:32.612674] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-06T22:40:32.634905] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-06T22:40:32.788122] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-10-06T22:40:32.932877] [INFO ] [MAIN ] JOBY: Loaded 53799 primary data records. [2025-10-06T22:40:33.550941] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:33.551873] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 50758 primary records. [2025-10-06T22:40:33.552156] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-06T22:40:33.570933] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-10-06T22:40:33.571931] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-06T22:40:33.576369] [INFO ] [MAIN ] Derivative Progress: 985/2037 symbols completed. JMIA took 1.3s. Estimated remaining: 7m 1s. Rate: 150.0 symbols/min [2025-10-06T22:40:33.590017] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:33.597694] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:33.603381] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-10-06T22:40:33.603709] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:33.603830] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-06T22:40:33.605155] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53799 primary records. [2025-10-06T22:40:33.605435] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-06T22:40:33.622223] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-10-06T22:40:33.622387] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-06T22:40:33.626174] [INFO ] [MAIN ] Derivative Progress: 986/2037 symbols completed. JNJ took 1.3s. Estimated remaining: 7m 0s. Rate: 150.1 symbols/min [2025-10-06T22:40:33.626794] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:33.651057] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-10-06T22:40:33.654664] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-06T22:40:33.657611] [INFO ] [MAIN ] Derivative Progress: 987/2037 symbols completed. JOBY took 1.3s. Estimated remaining: 6m 59s. Rate: 150.3 symbols/min [2025-10-06T22:40:33.658176] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:33.658065] [DEBUG] [LOCAL ] JOF: Loaded 6919 existing records from primary storage. [2025-10-06T22:40:33.658599] [INFO ] [MAIN ] JOF: Loaded 6919 primary data records. [2025-10-06T22:40:33.699158] [DEBUG] [LOCAL ] JOE: Loaded 24003 existing records from primary storage. [2025-10-06T22:40:33.723627] [INFO ] [MAIN ] JOE: Loaded 24003 primary data records. [2025-10-06T22:40:34.153974] [DEBUG] [LOCAL ] JPC: Loaded 37181 existing records from primary storage. [2025-10-06T22:40:34.180683] [INFO ] [MAIN ] JPC: Loaded 37181 primary data records. [2025-10-06T22:40:34.673914] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:34.676913] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 6919 primary records. [2025-10-06T22:40:34.677996] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-06T22:40:34.692546] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:34.694456] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 24003 primary records. [2025-10-06T22:40:34.701795] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-06T22:40:34.723940] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-10-06T22:40:34.724918] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-06T22:40:34.729663] [INFO ] [MAIN ] Derivative Progress: 988/2037 symbols completed. JOE took 1.1s. Estimated remaining: 6m 60s. Rate: 150.0 symbols/min [2025-10-06T22:40:34.731149] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-10-06T22:40:34.731368] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-06T22:40:34.733715] [INFO ] [MAIN ] Derivative Progress: 989/2037 symbols completed. JOF took 1.1s. Estimated remaining: 6m 59s. Rate: 150.1 symbols/min [2025-10-06T22:40:34.749462] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:34.750143] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37181 primary records. [2025-10-06T22:40:34.750205] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-06T22:40:34.765376] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-10-06T22:40:34.765441] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-06T22:40:34.768489] [INFO ] [MAIN ] Derivative Progress: 990/2037 symbols completed. JPC took 1.1s. Estimated remaining: 6m 58s. Rate: 150.3 symbols/min [2025-10-06T22:40:34.769115] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:34.769229] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:34.769348] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:34.788165] [DEBUG] [LOCAL ] JRI: Loaded 15023 existing records from primary storage. [2025-10-06T22:40:34.788365] [INFO ] [MAIN ] JRI: Loaded 15023 primary data records. [2025-10-06T22:40:34.990094] [DEBUG] [LOCAL ] JQC: Loaded 34608 existing records from primary storage. [2025-10-06T22:40:35.017550] [INFO ] [MAIN ] JQC: Loaded 34608 primary data records. [2025-10-06T22:40:35.246415] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-06T22:40:35.258359] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-06T22:40:35.776825] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:35.778301] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 15023 primary records. [2025-10-06T22:40:35.778963] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-06T22:40:35.798761] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-10-06T22:40:35.800373] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-06T22:40:35.803364] [INFO ] [MAIN ] Derivative Progress: 991/2037 symbols completed. JRI took 1.0s. Estimated remaining: 6m 58s. Rate: 150.0 symbols/min [2025-10-06T22:40:35.803871] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:35.821028] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:35.821947] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 34608 primary records. [2025-10-06T22:40:35.822075] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-06T22:40:35.843068] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-10-06T22:40:35.843886] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-06T22:40:35.846811] [INFO ] [MAIN ] Derivative Progress: 992/2037 symbols completed. JQC took 1.1s. Estimated remaining: 6m 57s. Rate: 150.2 symbols/min [2025-10-06T22:40:35.847084] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:35.865932] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:35.866036] [DEBUG] [LOCAL ] JRS: Loaded 11438 existing records from primary storage. [2025-10-06T22:40:35.866971] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-10-06T22:40:35.867081] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-06T22:40:35.867177] [INFO ] [MAIN ] JRS: Loaded 11438 primary data records. [2025-10-06T22:40:35.938814] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-10-06T22:40:35.947509] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-06T22:40:35.978133] [INFO ] [MAIN ] Derivative Progress: 993/2037 symbols completed. JPM took 1.2s. Estimated remaining: 6m 57s. Rate: 150.3 symbols/min [2025-10-06T22:40:36.004166] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:36.242545] [DEBUG] [LOCAL ] JXN: Loaded 45324 existing records from primary storage. [2025-10-06T22:40:36.243717] [INFO ] [MAIN ] JXN: Loaded 45324 primary data records. [2025-10-06T22:40:36.616622] [DEBUG] [LOCAL ] K: Loaded 50092 existing records from primary storage. [2025-10-06T22:40:36.630387] [INFO ] [MAIN ] K: Loaded 50092 primary data records. [2025-10-06T22:40:36.793779] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:36.828450] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11438 primary records. [2025-10-06T22:40:36.941340] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-06T22:40:36.968454] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-10-06T22:40:36.969296] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-06T22:40:36.972161] [INFO ] [MAIN ] Derivative Progress: 994/2037 symbols completed. JRS took 1.2s. Estimated remaining: 6m 57s. Rate: 150.1 symbols/min [2025-10-06T22:40:36.972573] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:36.995190] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:37.000872] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 45324 primary records. [2025-10-06T22:40:37.001079] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-06T22:40:37.025067] [DEBUG] [LOCAL ] KAI: Loaded 13299 existing records from primary storage. [2025-10-06T22:40:37.025990] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-10-06T22:40:37.026476] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-06T22:40:37.029921] [INFO ] [MAIN ] Derivative Progress: 995/2037 symbols completed. JXN took 1.2s. Estimated remaining: 6m 56s. Rate: 150.2 symbols/min [2025-10-06T22:40:37.026602] [INFO ] [MAIN ] KAI: Loaded 13299 primary data records. [2025-10-06T22:40:37.043498] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:37.179864] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:37.210934] [INFO ] [MAIN ] K: Generated 1794 derivative records from 50092 primary records. [2025-10-06T22:40:37.228604] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-06T22:40:37.401504] [DEBUG] [LOCAL ] KAR: Loaded 40093 existing records from primary storage. [2025-10-06T22:40:37.402754] [INFO ] [MAIN ] KAR: Loaded 40093 primary data records. [2025-10-06T22:40:37.432389] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-10-06T22:40:37.491528] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-06T22:40:37.514864] [INFO ] [MAIN ] Derivative Progress: 996/2037 symbols completed. K took 1.5s. Estimated remaining: 6m 56s. Rate: 150.2 symbols/min [2025-10-06T22:40:37.523506] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:37.744711] [DEBUG] [LOCAL ] KB: Loaded 23697 existing records from primary storage. [2025-10-06T22:40:37.746238] [INFO ] [MAIN ] KB: Loaded 23697 primary data records. [2025-10-06T22:40:37.814315] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:37.861531] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13299 primary records. [2025-10-06T22:40:37.867630] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-06T22:40:38.074597] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-10-06T22:40:38.075114] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-06T22:40:38.078002] [INFO ] [MAIN ] Derivative Progress: 997/2037 symbols completed. KAI took 1.1s. Estimated remaining: 6m 56s. Rate: 150.1 symbols/min [2025-10-06T22:40:38.079101] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:38.094205] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:38.095363] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 40093 primary records. [2025-10-06T22:40:38.096021] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-06T22:40:38.114873] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-10-06T22:40:38.115370] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-06T22:40:38.118268] [INFO ] [MAIN ] Derivative Progress: 998/2037 symbols completed. KAR took 1.1s. Estimated remaining: 6m 55s. Rate: 150.2 symbols/min [2025-10-06T22:40:38.119177] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:38.154155] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:38.155075] [DEBUG] [LOCAL ] KBDC: Loaded 21396 existing records from primary storage. [2025-10-06T22:40:38.155490] [INFO ] [MAIN ] KBDC: Loaded 21396 primary data records. [2025-10-06T22:40:38.168714] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 23697 primary records. [2025-10-06T22:40:38.178561] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-06T22:40:38.292827] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-10-06T22:40:38.293160] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-06T22:40:38.296154] [INFO ] [MAIN ] Derivative Progress: 999/2037 symbols completed. KB took 0.8s. Estimated remaining: 6m 54s. Rate: 150.3 symbols/min [2025-10-06T22:40:38.302513] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:38.409987] [DEBUG] [LOCAL ] KBH: Loaded 48885 existing records from primary storage. [2025-10-06T22:40:38.559964] [INFO ] [MAIN ] KBH: Loaded 48885 primary data records. [2025-10-06T22:40:38.956093] [DEBUG] [LOCAL ] KBR: Loaded 47939 existing records from primary storage. [2025-10-06T22:40:38.956564] [INFO ] [MAIN ] KBR: Loaded 47939 primary data records. [2025-10-06T22:40:39.142785] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:39.175732] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 21396 primary records. [2025-10-06T22:40:39.176083] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-06T22:40:39.340056] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:39.341354] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48885 primary records. [2025-10-06T22:40:39.341491] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-06T22:40:39.339570] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-10-06T22:40:39.343898] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-06T22:40:39.364823] [INFO ] [MAIN ] Derivative Progress: 1000/2037 symbols completed. KBDC took 1.3s. Estimated remaining: 6m 55s. Rate: 150.1 symbols/min [2025-10-06T22:40:39.365817] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:39.372712] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-10-06T22:40:39.373059] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-06T22:40:39.376317] [INFO ] [MAIN ] Derivative Progress: 1001/2037 symbols completed. KBH took 1.3s. Estimated remaining: 6m 54s. Rate: 150.2 symbols/min [2025-10-06T22:40:39.376926] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:39.404394] [DEBUG] [LOCAL ] KEN: Loaded 4690 existing records from primary storage. [2025-10-06T22:40:39.404565] [INFO ] [MAIN ] KEN: Loaded 4690 primary data records. [2025-10-06T22:40:39.417417] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:39.423416] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 47939 primary records. [2025-10-06T22:40:39.442849] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-06T22:40:39.668219] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-10-06T22:40:39.798317] [DEBUG] [LOCAL ] KD: Loaded 52335 existing records from primary storage. [2025-10-06T22:40:39.808051] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-06T22:40:39.809069] [INFO ] [MAIN ] KD: Loaded 52335 primary data records. [2025-10-06T22:40:39.812044] [INFO ] [MAIN ] Derivative Progress: 1002/2037 symbols completed. KBR took 1.5s. Estimated remaining: 6m 53s. Rate: 150.2 symbols/min [2025-10-06T22:40:39.824784] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:40.161197] [DEBUG] [LOCAL ] KEP: Loaded 31302 existing records from primary storage. [2025-10-06T22:40:40.171194] [INFO ] [MAIN ] KEP: Loaded 31302 primary data records. [2025-10-06T22:40:40.177355] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:40.199460] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4690 primary records. [2025-10-06T22:40:40.221436] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-06T22:40:40.349204] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-10-06T22:40:40.373940] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-06T22:40:40.381454] [INFO ] [MAIN ] Derivative Progress: 1003/2037 symbols completed. KEN took 1.0s. Estimated remaining: 6m 53s. Rate: 150.1 symbols/min [2025-10-06T22:40:40.509560] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:40.510413] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52335 primary records. [2025-10-06T22:40:40.510590] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-06T22:40:40.532541] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-10-06T22:40:40.533186] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-06T22:40:40.536154] [INFO ] [MAIN ] Derivative Progress: 1004/2037 symbols completed. KD took 1.2s. Estimated remaining: 6m 53s. Rate: 150.2 symbols/min [2025-10-06T22:40:40.556729] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:40.557428] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 31302 primary records. [2025-10-06T22:40:40.557490] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-06T22:40:40.573468] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-10-06T22:40:40.573527] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-06T22:40:40.576264] [INFO ] [MAIN ] Derivative Progress: 1005/2037 symbols completed. KEP took 0.8s. Estimated remaining: 6m 52s. Rate: 150.4 symbols/min [2025-10-06T22:40:40.577025] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:40.577152] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:40.577224] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:40.583247] [DEBUG] [LOCAL ] KF: Loaded 2381 existing records from primary storage. [2025-10-06T22:40:40.583429] [INFO ] [MAIN ] KF: Loaded 2381 primary data records. [2025-10-06T22:40:40.954507] [DEBUG] [LOCAL ] KEX: Loaded 38317 existing records from primary storage. [2025-10-06T22:40:40.953436] [DEBUG] [LOCAL ] KEYS: Loaded 43173 existing records from primary storage. [2025-10-06T22:40:40.954808] [INFO ] [MAIN ] KEYS: Loaded 43173 primary data records. [2025-10-06T22:40:40.954687] [INFO ] [MAIN ] KEX: Loaded 38317 primary data records. [2025-10-06T22:40:41.578355] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:41.580696] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2381 primary records. [2025-10-06T22:40:41.580979] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-06T22:40:41.602491] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-10-06T22:40:41.602984] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-06T22:40:41.606568] [INFO ] [MAIN ] Derivative Progress: 1006/2037 symbols completed. KF took 1.0s. Estimated remaining: 6m 52s. Rate: 150.1 symbols/min [2025-10-06T22:40:41.606923] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:41.636430] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:41.652503] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43173 primary records. [2025-10-06T22:40:41.657861] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-06T22:40:41.657770] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:41.659198] [DEBUG] [LOCAL ] KFRC: Loaded 19767 existing records from primary storage. [2025-10-06T22:40:41.659996] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38317 primary records. [2025-10-06T22:40:41.660227] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-06T22:40:41.660171] [INFO ] [MAIN ] KFRC: Loaded 19767 primary data records. [2025-10-06T22:40:41.754930] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-10-06T22:40:41.784380] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-10-06T22:40:41.795597] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-06T22:40:41.798318] [INFO ] [MAIN ] Derivative Progress: 1007/2037 symbols completed. KEX took 1.2s. Estimated remaining: 6m 51s. Rate: 150.2 symbols/min [2025-10-06T22:40:41.792283] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-06T22:40:41.799017] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:41.813508] [INFO ] [MAIN ] Derivative Progress: 1008/2037 symbols completed. KEYS took 1.2s. Estimated remaining: 6m 51s. Rate: 150.3 symbols/min [2025-10-06T22:40:41.818915] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:41.993332] [DEBUG] [LOCAL ] KFS: Loaded 8470 existing records from primary storage. [2025-10-06T22:40:41.998852] [INFO ] [MAIN ] KFS: Loaded 8470 primary data records. [2025-10-06T22:40:42.149828] [DEBUG] [LOCAL ] KFY: Loaded 30008 existing records from primary storage. [2025-10-06T22:40:42.160621] [INFO ] [MAIN ] KFY: Loaded 30008 primary data records. [2025-10-06T22:40:42.729576] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:42.730633] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 19767 primary records. [2025-10-06T22:40:42.731014] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-06T22:40:42.769590] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-06T22:40:42.771146] [INFO ] [MAIN ] KFS: Generated 1792 derivative records from 8470 primary records. [2025-10-06T22:40:42.771770] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-10-06T22:40:42.771831] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-06T22:40:42.772119] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-06T22:40:42.775408] [INFO ] [MAIN ] Derivative Progress: 1009/2037 symbols completed. KFRC took 1.2s. Estimated remaining: 6m 51s. Rate: 150.1 symbols/min [2025-10-06T22:40:42.776275] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:42.793756] [DEBUG] [LOCAL ] KFS: Derivative data saved (1792 records). [2025-10-06T22:40:42.794123] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-06T22:40:42.797188] [INFO ] [MAIN ] Derivative Progress: 1010/2037 symbols completed. KFS took 1.0s. Estimated remaining: 6m 50s. Rate: 150.3 symbols/min [2025-10-06T22:40:42.797845] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:42.815753] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:42.816604] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 30008 primary records. [2025-10-06T22:40:42.816734] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-06T22:40:42.839263] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-10-06T22:40:42.839343] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-06T22:40:42.842405] [INFO ] [MAIN ] Derivative Progress: 1011/2037 symbols completed. KFY took 1.0s. Estimated remaining: 6m 49s. Rate: 150.4 symbols/min [2025-10-06T22:40:42.842765] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:42.889285] [DEBUG] [LOCAL ] KGS: Loaded 45788 existing records from primary storage. [2025-10-06T22:40:42.890158] [INFO ] [MAIN ] KGS: Loaded 45788 primary data records. [2025-10-06T22:40:43.000524] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-06T22:40:43.023785] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-10-06T22:40:43.211480] [DEBUG] [LOCAL ] KIM: Loaded 53032 existing records from primary storage. [2025-10-06T22:40:43.240594] [INFO ] [MAIN ] KIM: Loaded 53032 primary data records. [2025-10-06T22:40:43.903072] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:43.909373] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 45788 primary records. [2025-10-06T22:40:43.909934] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-06T22:40:43.909831] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:43.911186] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53699 primary records. [2025-10-06T22:40:43.911501] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-06T22:40:43.943317] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-10-06T22:40:43.957570] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:43.956545] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-06T22:40:43.959540] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53032 primary records. [2025-10-06T22:40:43.960380] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-06T22:40:43.963752] [INFO ] [MAIN ] Derivative Progress: 1012/2037 symbols completed. KGS took 1.2s. Estimated remaining: 6m 50s. Rate: 150.1 symbols/min [2025-10-06T22:40:43.964288] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:43.965335] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-10-06T22:40:43.978591] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-06T22:40:43.982488] [INFO ] [MAIN ] Derivative Progress: 1013/2037 symbols completed. KGC took 1.2s. Estimated remaining: 6m 49s. Rate: 150.3 symbols/min [2025-10-06T22:40:43.983277] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:43.994029] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-10-06T22:40:43.994190] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-06T22:40:43.999391] [INFO ] [MAIN ] Derivative Progress: 1014/2037 symbols completed. KIM took 1.2s. Estimated remaining: 6m 48s. Rate: 150.4 symbols/min [2025-10-06T22:40:43.999977] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:44.010815] [DEBUG] [LOCAL ] KIO: Loaded 21360 existing records from primary storage. [2025-10-06T22:40:44.012259] [INFO ] [MAIN ] KIO: Loaded 21360 primary data records. [2025-10-06T22:40:44.093571] [DEBUG] [LOCAL ] KKRS: Loaded 5713 existing records from primary storage. [2025-10-06T22:40:44.109346] [INFO ] [MAIN ] KKRS: Loaded 5713 primary data records. [2025-10-06T22:40:44.495526] [DEBUG] [LOCAL ] KKR: Loaded 53502 existing records from primary storage. [2025-10-06T22:40:44.578703] [INFO ] [MAIN ] KKR: Loaded 53502 primary data records. [2025-10-06T22:40:45.029720] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:45.035739] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21360 primary records. [2025-10-06T22:40:45.041259] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-06T22:40:45.057839] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:45.067813] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5713 primary records. [2025-10-06T22:40:45.068047] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-06T22:40:45.093153] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-10-06T22:40:45.093471] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-06T22:40:45.096743] [INFO ] [MAIN ] Derivative Progress: 1015/2037 symbols completed. KIO took 1.1s. Estimated remaining: 6m 48s. Rate: 150.2 symbols/min [2025-10-06T22:40:45.092971] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-10-06T22:40:45.097199] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-06T22:40:45.096961] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:45.100159] [INFO ] [MAIN ] Derivative Progress: 1016/2037 symbols completed. KKRS took 1.1s. Estimated remaining: 6m 48s. Rate: 150.3 symbols/min [2025-10-06T22:40:45.101263] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:45.121901] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:45.123006] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53502 primary records. [2025-10-06T22:40:45.123176] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-06T22:40:45.143626] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-10-06T22:40:45.152417] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-06T22:40:45.155817] [INFO ] [MAIN ] Derivative Progress: 1017/2037 symbols completed. KKR took 1.2s. Estimated remaining: 6m 47s. Rate: 150.4 symbols/min [2025-10-06T22:40:45.168886] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:45.188878] [DEBUG] [LOCAL ] KMPB: Loaded 3809 existing records from primary storage. [2025-10-06T22:40:45.191693] [DEBUG] [LOCAL ] KLC: Loaded 36821 existing records from primary storage. [2025-10-06T22:40:45.205962] [INFO ] [MAIN ] KMPB: Loaded 3809 primary data records. [2025-10-06T22:40:45.206207] [INFO ] [MAIN ] KLC: Loaded 36821 primary data records. [2025-10-06T22:40:45.262837] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-06T22:40:45.284451] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-06T22:40:46.259128] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:46.253154] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:46.260848] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-10-06T22:40:46.261289] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-06T22:40:46.263749] [INFO ] [MAIN ] KMPB: Generated 1794 derivative records from 3809 primary records. [2025-10-06T22:40:46.261735] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:46.263891] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-06T22:40:46.274297] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36821 primary records. [2025-10-06T22:40:46.279788] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-06T22:40:46.298774] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-10-06T22:40:46.308967] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-06T22:40:46.312025] [INFO ] [MAIN ] Derivative Progress: 1018/2037 symbols completed. KMI took 1.2s. Estimated remaining: 6m 47s. Rate: 150.2 symbols/min [2025-10-06T22:40:46.314334] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1794 records). [2025-10-06T22:40:46.319565] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-06T22:40:46.324930] [INFO ] [MAIN ] Derivative Progress: 1019/2037 symbols completed. KMPB took 1.2s. Estimated remaining: 6m 46s. Rate: 150.3 symbols/min [2025-10-06T22:40:46.332222] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-10-06T22:40:46.332459] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-06T22:40:46.335981] [INFO ] [MAIN ] Derivative Progress: 1020/2037 symbols completed. KLC took 1.2s. Estimated remaining: 6m 46s. Rate: 150.4 symbols/min [2025-10-06T22:40:46.336523] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:46.336680] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:46.337404] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:46.421703] [DEBUG] [LOCAL ] KMPR: Loaded 39148 existing records from primary storage. [2025-10-06T22:40:46.422740] [INFO ] [MAIN ] KMPR: Loaded 39148 primary data records. [2025-10-06T22:40:46.515235] [DEBUG] [LOCAL ] KMT: Loaded 43054 existing records from primary storage. [2025-10-06T22:40:46.542796] [INFO ] [MAIN ] KMT: Loaded 43054 primary data records. [2025-10-06T22:40:46.589493] [DEBUG] [LOCAL ] KMX: Loaded 53182 existing records from primary storage. [2025-10-06T22:40:46.628494] [INFO ] [MAIN ] KMX: Loaded 53182 primary data records. [2025-10-06T22:40:47.541613] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:47.542939] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 39148 primary records. [2025-10-06T22:40:47.543358] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-06T22:40:47.600387] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:47.600918] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:47.602063] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53182 primary records. [2025-10-06T22:40:47.603988] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 43054 primary records. [2025-10-06T22:40:47.602738] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-10-06T22:40:47.604216] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-06T22:40:47.604311] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-06T22:40:47.606694] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-06T22:40:47.606601] [INFO ] [MAIN ] Derivative Progress: 1021/2037 symbols completed. KMPR took 1.3s. Estimated remaining: 6m 46s. Rate: 150.1 symbols/min [2025-10-06T22:40:47.609792] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:47.636246] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-10-06T22:40:47.641715] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-06T22:40:47.647113] [INFO ] [MAIN ] Derivative Progress: 1022/2037 symbols completed. KMX took 1.3s. Estimated remaining: 6m 45s. Rate: 150.2 symbols/min [2025-10-06T22:40:47.648015] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:47.652127] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-10-06T22:40:47.653151] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-06T22:40:47.657332] [INFO ] [MAIN ] Derivative Progress: 1023/2037 symbols completed. KMT took 1.3s. Estimated remaining: 6m 45s. Rate: 150.4 symbols/min [2025-10-06T22:40:47.657848] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:47.693537] [DEBUG] [LOCAL ] KNOP: Loaded 10558 existing records from primary storage. [2025-10-06T22:40:47.693948] [INFO ] [MAIN ] KNOP: Loaded 10558 primary data records. [2025-10-06T22:40:47.776634] [DEBUG] [LOCAL ] KN: Loaded 38615 existing records from primary storage. [2025-10-06T22:40:47.803517] [DEBUG] [LOCAL ] KNF: Loaded 36090 existing records from primary storage. [2025-10-06T22:40:47.815849] [INFO ] [MAIN ] KN: Loaded 38615 primary data records. [2025-10-06T22:40:47.823897] [INFO ] [MAIN ] KNF: Loaded 36090 primary data records. [2025-10-06T22:40:48.733849] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:48.735417] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 10558 primary records. [2025-10-06T22:40:48.735627] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-06T22:40:48.759321] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-10-06T22:40:48.767801] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-06T22:40:48.776746] [INFO ] [MAIN ] Derivative Progress: 1024/2037 symbols completed. KNOP took 1.1s. Estimated remaining: 6m 45s. Rate: 150.1 symbols/min [2025-10-06T22:40:48.774362] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:48.778077] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38615 primary records. [2025-10-06T22:40:48.792157] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-06T22:40:48.786573] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:48.792788] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:48.795463] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 36090 primary records. [2025-10-06T22:40:48.795738] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-06T22:40:48.831902] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-10-06T22:40:48.833062] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-06T22:40:48.840549] [INFO ] [MAIN ] Derivative Progress: 1025/2037 symbols completed. KNF took 1.2s. Estimated remaining: 6m 44s. Rate: 150.3 symbols/min [2025-10-06T22:40:48.840784] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:48.842537] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-10-06T22:40:48.843212] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-06T22:40:48.847416] [INFO ] [MAIN ] Derivative Progress: 1026/2037 symbols completed. KN took 1.2s. Estimated remaining: 6m 43s. Rate: 150.4 symbols/min [2025-10-06T22:40:48.853891] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:48.866301] [DEBUG] [LOCAL ] KNSL: Loaded 18380 existing records from primary storage. [2025-10-06T22:40:48.866476] [INFO ] [MAIN ] KNSL: Loaded 18380 primary data records. [2025-10-06T22:40:49.311907] [DEBUG] [LOCAL ] KNTK: Loaded 46402 existing records from primary storage. [2025-10-06T22:40:49.312416] [INFO ] [MAIN ] KNTK: Loaded 46402 primary data records. [2025-10-06T22:40:49.337074] [DEBUG] [LOCAL ] KNX: Loaded 52594 existing records from primary storage. [2025-10-06T22:40:49.367448] [INFO ] [MAIN ] KNX: Loaded 52594 primary data records. [2025-10-06T22:40:50.046025] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:50.048295] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18380 primary records. [2025-10-06T22:40:50.048570] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-06T22:40:50.069279] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-10-06T22:40:50.069932] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-06T22:40:50.073376] [INFO ] [MAIN ] Derivative Progress: 1027/2037 symbols completed. KNSL took 1.3s. Estimated remaining: 6m 44s. Rate: 150.1 symbols/min [2025-10-06T22:40:50.074053] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:50.099879] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:50.114784] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:50.114256] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46402 primary records. [2025-10-06T22:40:50.115570] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52594 primary records. [2025-10-06T22:40:50.115744] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-06T22:40:50.116013] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-06T22:40:50.176836] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-10-06T22:40:50.177724] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-06T22:40:50.177587] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-10-06T22:40:50.181428] [INFO ] [MAIN ] Derivative Progress: 1028/2037 symbols completed. KNX took 1.3s. Estimated remaining: 6m 43s. Rate: 150.2 symbols/min [2025-10-06T22:40:50.181560] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-06T22:40:50.183074] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:50.186618] [INFO ] [MAIN ] Derivative Progress: 1029/2037 symbols completed. KNTK took 1.3s. Estimated remaining: 6m 42s. Rate: 150.3 symbols/min [2025-10-06T22:40:50.182802] [DEBUG] [LOCAL ] KODK: Loaded 43356 existing records from primary storage. [2025-10-06T22:40:50.187056] [INFO ] [MAIN ] KODK: Loaded 43356 primary data records. [2025-10-06T22:40:50.187266] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:50.383861] [DEBUG] [LOCAL ] KOP: Loaded 17533 existing records from primary storage. [2025-10-06T22:40:50.406942] [DEBUG] [LOCAL ] KOF: Loaded 26489 existing records from primary storage. [2025-10-06T22:40:50.411002] [INFO ] [MAIN ] KOP: Loaded 17533 primary data records. [2025-10-06T22:40:50.411157] [INFO ] [MAIN ] KOF: Loaded 26489 primary data records. [2025-10-06T22:40:51.221274] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:51.222748] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43356 primary records. [2025-10-06T22:40:51.223269] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-06T22:40:51.241860] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-10-06T22:40:51.242146] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-06T22:40:51.244593] [INFO ] [MAIN ] Derivative Progress: 1030/2037 symbols completed. KODK took 1.2s. Estimated remaining: 6m 43s. Rate: 150.1 symbols/min [2025-10-06T22:40:51.245206] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:51.276459] [DEBUG] [LOCAL ] KORE: Loaded 2056 existing records from primary storage. [2025-10-06T22:40:51.282529] [INFO ] [MAIN ] KORE: Loaded 2056 primary data records. [2025-10-06T22:40:51.306492] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:51.307485] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17533 primary records. [2025-10-06T22:40:51.296026] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:51.358686] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-06T22:40:51.378092] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 26489 primary records. [2025-10-06T22:40:51.390344] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-06T22:40:51.467930] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-10-06T22:40:51.502205] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-06T22:40:51.527792] [INFO ] [MAIN ] Derivative Progress: 1031/2037 symbols completed. KOF took 1.3s. Estimated remaining: 6m 42s. Rate: 150.1 symbols/min [2025-10-06T22:40:51.633180] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:51.529517] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-10-06T22:40:51.648354] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-06T22:40:51.653767] [INFO ] [MAIN ] Derivative Progress: 1032/2037 symbols completed. KOP took 1.5s. Estimated remaining: 6m 41s. Rate: 150.2 symbols/min [2025-10-06T22:40:51.654449] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:51.717241] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:51.732117] [INFO ] [MAIN ] KORE: Generated 1794 derivative records from 2056 primary records. [2025-10-06T22:40:51.732342] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-06T22:40:51.736443] [DEBUG] [LOCAL ] KOS: Loaded 53056 existing records from primary storage. [2025-10-06T22:40:51.746830] [INFO ] [MAIN ] KOS: Loaded 53056 primary data records. [2025-10-06T22:40:51.855946] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-06T22:40:51.856095] [DEBUG] [LOCAL ] KORE: Derivative data saved (1794 records). [2025-10-06T22:40:51.869178] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-10-06T22:40:51.872537] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-06T22:40:51.876387] [INFO ] [MAIN ] Derivative Progress: 1033/2037 symbols completed. KORE took 0.6s. Estimated remaining: 6m 41s. Rate: 150.3 symbols/min [2025-10-06T22:40:52.421183] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:52.422395] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53056 primary records. [2025-10-06T22:40:52.422735] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-06T22:40:52.439663] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-10-06T22:40:52.440817] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-06T22:40:52.444267] [INFO ] [MAIN ] Derivative Progress: 1034/2037 symbols completed. KOS took 0.8s. Estimated remaining: 6m 41s. Rate: 150.2 symbols/min [2025-10-06T22:40:52.458248] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:52.458999] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53681 primary records. [2025-10-06T22:40:52.459060] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-06T22:40:52.474253] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-10-06T22:40:52.474310] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-06T22:40:52.476569] [INFO ] [MAIN ] Derivative Progress: 1035/2037 symbols completed. KR took 0.8s. Estimated remaining: 6m 40s. Rate: 150.4 symbols/min [2025-10-06T22:40:52.477100] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:52.477217] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:52.477384] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:52.534555] [DEBUG] [LOCAL ] KREF: Loaded 37672 existing records from primary storage. [2025-10-06T22:40:52.549788] [INFO ] [MAIN ] KREF: Loaded 37672 primary data records. [2025-10-06T22:40:52.684085] [DEBUG] [LOCAL ] KRC: Loaded 48309 existing records from primary storage. [2025-10-06T22:40:52.698589] [DEBUG] [LOCAL ] KRG: Loaded 49220 existing records from primary storage. [2025-10-06T22:40:52.699007] [INFO ] [MAIN ] KRC: Loaded 48309 primary data records. [2025-10-06T22:40:52.699322] [INFO ] [MAIN ] KRG: Loaded 49220 primary data records. [2025-10-06T22:40:53.654892] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:53.657415] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 37672 primary records. [2025-10-06T22:40:53.657537] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-06T22:40:53.698884] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:53.705284] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:53.708542] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49220 primary records. [2025-10-06T22:40:53.708953] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-06T22:40:53.707075] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48309 primary records. [2025-10-06T22:40:53.709446] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-06T22:40:53.712817] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-10-06T22:40:53.720583] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-06T22:40:53.740773] [INFO ] [MAIN ] Derivative Progress: 1036/2037 symbols completed. KREF took 1.3s. Estimated remaining: 6m 40s. Rate: 150.1 symbols/min [2025-10-06T22:40:53.743030] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:53.750960] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-10-06T22:40:53.751768] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-06T22:40:53.755334] [INFO ] [MAIN ] Derivative Progress: 1037/2037 symbols completed. KRG took 1.3s. Estimated remaining: 6m 39s. Rate: 150.2 symbols/min [2025-10-06T22:40:53.756169] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:53.757411] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-10-06T22:40:53.758031] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-06T22:40:53.761012] [INFO ] [MAIN ] Derivative Progress: 1038/2037 symbols completed. KRC took 1.3s. Estimated remaining: 6m 39s. Rate: 150.3 symbols/min [2025-10-06T22:40:53.761363] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:53.791199] [DEBUG] [LOCAL ] KRO: Loaded 26092 existing records from primary storage. [2025-10-06T22:40:53.791506] [INFO ] [MAIN ] KRO: Loaded 26092 primary data records. [2025-10-06T22:40:54.014137] [DEBUG] [LOCAL ] KRP: Loaded 36809 existing records from primary storage. [2025-10-06T22:40:54.103635] [INFO ] [MAIN ] KRP: Loaded 36809 primary data records. [2025-10-06T22:40:54.241597] [DEBUG] [LOCAL ] KSS: Loaded 53600 existing records from primary storage. [2025-10-06T22:40:54.248017] [INFO ] [MAIN ] KSS: Loaded 53600 primary data records. [2025-10-06T22:40:54.792826] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:54.794441] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26092 primary records. [2025-10-06T22:40:54.794766] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-06T22:40:54.817694] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-10-06T22:40:54.818181] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-06T22:40:54.820972] [INFO ] [MAIN ] Derivative Progress: 1039/2037 symbols completed. KRO took 1.1s. Estimated remaining: 6m 39s. Rate: 150.1 symbols/min [2025-10-06T22:40:54.821248] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:54.837474] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:54.839268] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 36809 primary records. [2025-10-06T22:40:54.839609] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-06T22:40:54.861742] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-10-06T22:40:54.900988] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-06T22:40:54.904108] [INFO ] [MAIN ] Derivative Progress: 1040/2037 symbols completed. KRP took 1.1s. Estimated remaining: 6m 38s. Rate: 150.2 symbols/min [2025-10-06T22:40:54.901346] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:54.904388] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:54.905578] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53600 primary records. [2025-10-06T22:40:54.905740] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-06T22:40:54.933825] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-10-06T22:40:54.934023] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-06T22:40:54.938106] [INFO ] [MAIN ] Derivative Progress: 1041/2037 symbols completed. KSS took 1.2s. Estimated remaining: 6m 37s. Rate: 150.4 symbols/min [2025-10-06T22:40:54.938395] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:54.955618] [DEBUG] [LOCAL ] KT: Loaded 45572 existing records from primary storage. [2025-10-06T22:40:54.955834] [INFO ] [MAIN ] KT: Loaded 45572 primary data records. [2025-10-06T22:40:55.078476] [DEBUG] [LOCAL ] KTF: Loaded 12211 existing records from primary storage. [2025-10-06T22:40:55.089131] [INFO ] [MAIN ] KTF: Loaded 12211 primary data records. [2025-10-06T22:40:55.206524] [DEBUG] [LOCAL ] KTB: Loaded 40814 existing records from primary storage. [2025-10-06T22:40:55.231796] [INFO ] [MAIN ] KTB: Loaded 40814 primary data records. [2025-10-06T22:40:56.044006] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:56.046232] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45572 primary records. [2025-10-06T22:40:56.046525] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-06T22:40:56.076128] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:56.080304] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 12211 primary records. [2025-10-06T22:40:56.080877] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-06T22:40:56.105005] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-10-06T22:40:56.097528] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:56.109972] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-06T22:40:56.113532] [INFO ] [MAIN ] Derivative Progress: 1042/2037 symbols completed. KT took 1.3s. Estimated remaining: 6m 38s. Rate: 150.1 symbols/min [2025-10-06T22:40:56.115318] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:56.116816] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 40814 primary records. [2025-10-06T22:40:56.117903] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-10-06T22:40:56.118064] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-06T22:40:56.118226] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-06T22:40:56.121931] [INFO ] [MAIN ] Derivative Progress: 1043/2037 symbols completed. KTF took 1.2s. Estimated remaining: 6m 37s. Rate: 150.2 symbols/min [2025-10-06T22:40:56.123946] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:56.142505] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-10-06T22:40:56.142717] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-06T22:40:56.146848] [INFO ] [MAIN ] Derivative Progress: 1044/2037 symbols completed. KTB took 1.2s. Estimated remaining: 6m 36s. Rate: 150.4 symbols/min [2025-10-06T22:40:56.147477] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:56.236350] [DEBUG] [LOCAL ] KVYO: Loaded 50220 existing records from primary storage. [2025-10-06T22:40:56.237591] [INFO ] [MAIN ] KVYO: Loaded 50220 primary data records. [2025-10-06T22:40:56.361126] [DEBUG] [LOCAL ] KW: Loaded 40447 existing records from primary storage. [2025-10-06T22:40:56.348402] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-06T22:40:56.361365] [INFO ] [MAIN ] KW: Loaded 40447 primary data records. [2025-10-06T22:40:56.384581] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-06T22:40:57.371073] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:40:57.372263] [INFO ] [MAIN ] KVYO: Generated 1793 derivative records from 50220 primary records. [2025-10-06T22:40:57.372370] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-06T22:40:57.422394] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:57.424710] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1793 records). [2025-10-06T22:40:57.425147] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-06T22:40:57.425037] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:57.424092] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40447 primary records. [2025-10-06T22:40:57.428764] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-06T22:40:57.428700] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-10-06T22:40:57.427709] [INFO ] [MAIN ] Derivative Progress: 1045/2037 symbols completed. KVYO took 1.3s. Estimated remaining: 6m 37s. Rate: 150.0 symbols/min [2025-10-06T22:40:57.428943] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-06T22:40:57.429798] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:57.461446] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-10-06T22:40:57.463036] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-06T22:40:57.467891] [INFO ] [MAIN ] Derivative Progress: 1046/2037 symbols completed. KVUE took 1.4s. Estimated remaining: 6m 36s. Rate: 150.2 symbols/min [2025-10-06T22:40:57.468450] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:57.476830] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-10-06T22:40:57.477089] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-06T22:40:57.481580] [INFO ] [MAIN ] Derivative Progress: 1047/2037 symbols completed. KW took 1.3s. Estimated remaining: 6m 35s. Rate: 150.3 symbols/min [2025-10-06T22:40:57.482015] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:57.491606] [DEBUG] [LOCAL ] KWR: Loaded 16322 existing records from primary storage. [2025-10-06T22:40:57.491861] [INFO ] [MAIN ] KWR: Loaded 16322 primary data records. [2025-10-06T22:40:57.868564] [DEBUG] [LOCAL ] KYN: Loaded 29937 existing records from primary storage. [2025-10-06T22:40:57.915916] [INFO ] [MAIN ] KYN: Loaded 29937 primary data records. [2025-10-06T22:40:57.916946] [DEBUG] [LOCAL ] L: Loaded 41113 existing records from primary storage. [2025-10-06T22:40:57.922615] [INFO ] [MAIN ] L: Loaded 41113 primary data records. [2025-10-06T22:40:58.642449] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:58.643672] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16322 primary records. [2025-10-06T22:40:58.643843] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-06T22:40:58.667902] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-10-06T22:40:58.668104] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-06T22:40:58.671137] [INFO ] [MAIN ] Derivative Progress: 1048/2037 symbols completed. KWR took 1.2s. Estimated remaining: 6m 36s. Rate: 150.0 symbols/min [2025-10-06T22:40:58.692267] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:58.693390] [INFO ] [MAIN ] L: Generated 1794 derivative records from 41113 primary records. [2025-10-06T22:40:58.693577] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-06T22:40:58.707800] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:58.709343] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 29937 primary records. [2025-10-06T22:40:58.716620] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-06T22:40:58.742596] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-10-06T22:40:58.743682] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-06T22:40:58.744021] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-10-06T22:40:58.746997] [INFO ] [MAIN ] Derivative Progress: 1049/2037 symbols completed. L took 1.3s. Estimated remaining: 6m 35s. Rate: 150.1 symbols/min [2025-10-06T22:40:58.747156] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-06T22:40:58.751025] [INFO ] [MAIN ] Derivative Progress: 1050/2037 symbols completed. KYN took 1.3s. Estimated remaining: 6m 34s. Rate: 150.3 symbols/min [2025-10-06T22:40:58.751692] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:58.751844] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:58.752040] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:58.794702] [DEBUG] [LOCAL ] LAD: Loaded 23599 existing records from primary storage. [2025-10-06T22:40:58.794978] [INFO ] [MAIN ] LAD: Loaded 23599 primary data records. [2025-10-06T22:40:58.941130] [DEBUG] [LOCAL ] LADR: Loaded 39037 existing records from primary storage. [2025-10-06T22:40:58.942052] [INFO ] [MAIN ] LADR: Loaded 39037 primary data records. [2025-10-06T22:40:59.097600] [DEBUG] [LOCAL ] LAC: Loaded 52414 existing records from primary storage. [2025-10-06T22:40:59.107800] [INFO ] [MAIN ] LAC: Loaded 52414 primary data records. [2025-10-06T22:40:59.932001] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:59.933749] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 23599 primary records. [2025-10-06T22:40:59.934299] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-06T22:40:59.971745] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:40:59.973617] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-10-06T22:40:59.973790] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-06T22:40:59.977360] [INFO ] [MAIN ] Derivative Progress: 1051/2037 symbols completed. LAD took 1.2s. Estimated remaining: 6m 34s. Rate: 150.0 symbols/min [2025-10-06T22:40:59.974720] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 39037 primary records. [2025-10-06T22:40:59.977899] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:40:59.978110] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-06T22:41:00.001393] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-10-06T22:41:00.004619] [DEBUG] [LOCAL ] LANV: Loaded 2796 existing records from primary storage. [2025-10-06T22:41:00.005262] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-06T22:41:00.005344] [INFO ] [MAIN ] LANV: Loaded 2796 primary data records. [2025-10-06T22:41:00.050372] [INFO ] [MAIN ] Derivative Progress: 1052/2037 symbols completed. LADR took 1.3s. Estimated remaining: 6m 34s. Rate: 150.1 symbols/min [2025-10-06T22:41:00.067866] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:00.067103] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:00.082194] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52414 primary records. [2025-10-06T22:41:00.082723] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-06T22:41:00.165755] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-10-06T22:41:00.181901] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-06T22:41:00.250868] [DEBUG] [LOCAL ] LAW: Loaded 14213 existing records from primary storage. [2025-10-06T22:41:00.251121] [INFO ] [MAIN ] LAW: Loaded 14213 primary data records. [2025-10-06T22:41:00.297078] [INFO ] [MAIN ] Derivative Progress: 1053/2037 symbols completed. LAC took 1.5s. Estimated remaining: 6m 33s. Rate: 150.2 symbols/min [2025-10-06T22:41:00.414801] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:00.784424] [DEBUG] [LOCAL ] LAZ: Loaded 44824 existing records from primary storage. [2025-10-06T22:41:00.785296] [INFO ] [MAIN ] LAZ: Loaded 44824 primary data records. [2025-10-06T22:41:00.785219] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:00.791475] [INFO ] [MAIN ] LANV: Generated 1794 derivative records from 2796 primary records. [2025-10-06T22:41:00.807604] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-06T22:41:01.090296] [DEBUG] [LOCAL ] LANV: Derivative data saved (1794 records). [2025-10-06T22:41:01.105597] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-06T22:41:01.108155] [INFO ] [MAIN ] Derivative Progress: 1054/2037 symbols completed. LANV took 1.1s. Estimated remaining: 6m 33s. Rate: 150.0 symbols/min [2025-10-06T22:41:01.108363] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:01.126219] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:01.128065] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 14213 primary records. [2025-10-06T22:41:01.128619] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-06T22:41:01.158899] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-10-06T22:41:01.159468] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-06T22:41:01.172182] [INFO ] [MAIN ] Derivative Progress: 1055/2037 symbols completed. LAW took 1.1s. Estimated remaining: 6m 32s. Rate: 150.1 symbols/min [2025-10-06T22:41:01.172744] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:01.203897] [DEBUG] [LOCAL ] LB: Loaded 37793 existing records from primary storage. [2025-10-06T22:41:01.202777] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:01.205067] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 44824 primary records. [2025-10-06T22:41:01.205194] [INFO ] [MAIN ] LB: Loaded 37793 primary data records. [2025-10-06T22:41:01.205305] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-06T22:41:01.288900] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-10-06T22:41:01.294489] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-06T22:41:01.310220] [INFO ] [MAIN ] Derivative Progress: 1056/2037 symbols completed. LAZ took 0.9s. Estimated remaining: 6m 32s. Rate: 150.2 symbols/min [2025-10-06T22:41:01.320733] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:01.616225] [DEBUG] [LOCAL ] LBRT: Loaded 52930 existing records from primary storage. [2025-10-06T22:41:01.617993] [INFO ] [MAIN ] LBRT: Loaded 52930 primary data records. [2025-10-06T22:41:01.800608] [DEBUG] [LOCAL ] LC: Loaded 47861 existing records from primary storage. [2025-10-06T22:41:01.849043] [INFO ] [MAIN ] LC: Loaded 47861 primary data records. [2025-10-06T22:41:02.173095] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:02.194865] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37793 primary records. [2025-10-06T22:41:02.200585] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-06T22:41:02.423879] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-10-06T22:41:02.424059] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-06T22:41:02.426660] [INFO ] [MAIN ] Derivative Progress: 1057/2037 symbols completed. LB took 1.3s. Estimated remaining: 6m 32s. Rate: 150.0 symbols/min [2025-10-06T22:41:02.428279] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:02.447701] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:02.449117] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52930 primary records. [2025-10-06T22:41:02.449412] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-06T22:41:02.483425] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-10-06T22:41:02.484937] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-06T22:41:02.490013] [INFO ] [MAIN ] Derivative Progress: 1058/2037 symbols completed. LBRT took 1.3s. Estimated remaining: 6m 31s. Rate: 150.1 symbols/min [2025-10-06T22:41:02.490905] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:02.509573] [DEBUG] [LOCAL ] LCII: Loaded 27789 existing records from primary storage. [2025-10-06T22:41:02.515215] [INFO ] [MAIN ] LCII: Loaded 27789 primary data records. [2025-10-06T22:41:02.515598] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:02.548881] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 47861 primary records. [2025-10-06T22:41:02.574264] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-06T22:41:02.720350] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-10-06T22:41:02.833250] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-06T22:41:02.850639] [INFO ] [MAIN ] Derivative Progress: 1059/2037 symbols completed. LC took 1.5s. Estimated remaining: 6m 31s. Rate: 150.1 symbols/min [2025-10-06T22:41:02.851151] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:02.872744] [DEBUG] [LOCAL ] LDI: Loaded 44307 existing records from primary storage. [2025-10-06T22:41:02.872943] [INFO ] [MAIN ] LDI: Loaded 44307 primary data records. [2025-10-06T22:41:03.213695] [DEBUG] [LOCAL ] LDOS: Loaded 45514 existing records from primary storage. [2025-10-06T22:41:03.212778] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:03.216028] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 27789 primary records. [2025-10-06T22:41:03.215040] [INFO ] [MAIN ] LDOS: Loaded 45514 primary data records. [2025-10-06T22:41:03.216713] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-06T22:41:03.540674] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-10-06T22:41:03.541101] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-06T22:41:03.543622] [INFO ] [MAIN ] Derivative Progress: 1060/2037 symbols completed. LCII took 1.1s. Estimated remaining: 6m 31s. Rate: 150.0 symbols/min [2025-10-06T22:41:03.544159] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:03.566740] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:03.572989] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 44307 primary records. [2025-10-06T22:41:03.573334] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-06T22:41:03.600752] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-10-06T22:41:03.602077] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-06T22:41:03.602247] [DEBUG] [LOCAL ] LDP: Loaded 12935 existing records from primary storage. [2025-10-06T22:41:03.606146] [INFO ] [MAIN ] LDP: Loaded 12935 primary data records. [2025-10-06T22:41:03.605566] [INFO ] [MAIN ] Derivative Progress: 1061/2037 symbols completed. LDI took 1.1s. Estimated remaining: 6m 30s. Rate: 150.1 symbols/min [2025-10-06T22:41:03.606820] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:03.797791] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:03.820914] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 45514 primary records. [2025-10-06T22:41:03.957926] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-06T22:41:03.984706] [DEBUG] [LOCAL ] LEA: Loaded 41699 existing records from primary storage. [2025-10-06T22:41:03.986528] [INFO ] [MAIN ] LEA: Loaded 41699 primary data records. [2025-10-06T22:41:04.150296] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-10-06T22:41:04.161382] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-06T22:41:04.164278] [INFO ] [MAIN ] Derivative Progress: 1062/2037 symbols completed. LDOS took 1.3s. Estimated remaining: 6m 30s. Rate: 150.1 symbols/min [2025-10-06T22:41:04.164794] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:04.446518] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:04.449757] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12935 primary records. [2025-10-06T22:41:04.450879] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-06T22:41:04.492912] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-10-06T22:41:04.507208] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-06T22:41:04.513207] [DEBUG] [LOCAL ] LEG: Loaded 50198 existing records from primary storage. [2025-10-06T22:41:04.512149] [INFO ] [MAIN ] Derivative Progress: 1063/2037 symbols completed. LDP took 1.0s. Estimated remaining: 6m 29s. Rate: 150.1 symbols/min [2025-10-06T22:41:04.513937] [INFO ] [MAIN ] LEG: Loaded 50198 primary data records. [2025-10-06T22:41:04.733785] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:04.808427] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41699 primary records. [2025-10-06T22:41:04.839775] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-06T22:41:04.883338] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-10-06T22:41:04.883493] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-06T22:41:04.886967] [INFO ] [MAIN ] Derivative Progress: 1064/2037 symbols completed. LEA took 1.3s. Estimated remaining: 6m 29s. Rate: 150.1 symbols/min [2025-10-06T22:41:04.910560] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:04.911676] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50198 primary records. [2025-10-06T22:41:04.911751] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-06T22:41:04.929112] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-10-06T22:41:04.929303] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-06T22:41:04.932985] [INFO ] [MAIN ] Derivative Progress: 1065/2037 symbols completed. LEG took 0.8s. Estimated remaining: 6m 28s. Rate: 150.2 symbols/min [2025-10-06T22:41:04.933674] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:04.934034] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:04.933825] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:04.957701] [DEBUG] [LOCAL ] LEO: Loaded 16913 existing records from primary storage. [2025-10-06T22:41:04.958740] [INFO ] [MAIN ] LEO: Loaded 16913 primary data records. [2025-10-06T22:41:05.374036] [DEBUG] [LOCAL ] LEN: Loaded 53172 existing records from primary storage. [2025-10-06T22:41:05.375365] [DEBUG] [LOCAL ] LEVI: Loaded 51645 existing records from primary storage. [2025-10-06T22:41:05.375826] [INFO ] [MAIN ] LEN: Loaded 53172 primary data records. [2025-10-06T22:41:05.375980] [INFO ] [MAIN ] LEVI: Loaded 51645 primary data records. [2025-10-06T22:41:06.077330] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:06.079514] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 16913 primary records. [2025-10-06T22:41:06.081471] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-06T22:41:06.101092] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-10-06T22:41:06.101526] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-06T22:41:06.104881] [INFO ] [MAIN ] Derivative Progress: 1066/2037 symbols completed. LEO took 1.2s. Estimated remaining: 6m 29s. Rate: 149.9 symbols/min [2025-10-06T22:41:06.105367] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:06.144852] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:06.145263] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:06.146210] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51645 primary records. [2025-10-06T22:41:06.147079] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53172 primary records. [2025-10-06T22:41:06.146424] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-06T22:41:06.147937] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-06T22:41:06.169508] [DEBUG] [LOCAL ] LFT: Loaded 18421 existing records from primary storage. [2025-10-06T22:41:06.180356] [INFO ] [MAIN ] LFT: Loaded 18421 primary data records. [2025-10-06T22:41:06.252921] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-10-06T22:41:06.269170] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-06T22:41:06.285778] [INFO ] [MAIN ] Derivative Progress: 1067/2037 symbols completed. LEVI took 1.4s. Estimated remaining: 6m 28s. Rate: 150.0 symbols/min [2025-10-06T22:41:06.307334] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:06.325088] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-10-06T22:41:06.330527] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-06T22:41:06.333153] [INFO ] [MAIN ] Derivative Progress: 1068/2037 symbols completed. LEN took 1.4s. Estimated remaining: 6m 27s. Rate: 150.1 symbols/min [2025-10-06T22:41:06.344183] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:06.424318] [DEBUG] [LOCAL ] LGI: Loaded 9902 existing records from primary storage. [2025-10-06T22:41:06.592427] [INFO ] [MAIN ] LGI: Loaded 9902 primary data records. [2025-10-06T22:41:06.791405] [DEBUG] [LOCAL ] LH: Loaded 37790 existing records from primary storage. [2025-10-06T22:41:06.823977] [INFO ] [MAIN ] LH: Loaded 37790 primary data records. [2025-10-06T22:41:07.192852] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:07.316520] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18421 primary records. [2025-10-06T22:41:07.325873] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-06T22:41:07.366999] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:07.367883] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 9902 primary records. [2025-10-06T22:41:07.352282] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-10-06T22:41:07.368125] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-06T22:41:07.368218] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-06T22:41:07.371889] [INFO ] [MAIN ] Derivative Progress: 1069/2037 symbols completed. LFT took 1.3s. Estimated remaining: 6m 27s. Rate: 149.9 symbols/min [2025-10-06T22:41:07.373280] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:07.394359] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-10-06T22:41:07.394509] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-06T22:41:07.397625] [INFO ] [MAIN ] Derivative Progress: 1070/2037 symbols completed. LGI took 1.1s. Estimated remaining: 6m 27s. Rate: 150.0 symbols/min [2025-10-06T22:41:07.397906] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:07.412140] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:07.413054] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 37790 primary records. [2025-10-06T22:41:07.413169] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-06T22:41:07.431605] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-10-06T22:41:07.431921] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-06T22:41:07.435766] [INFO ] [MAIN ] Derivative Progress: 1071/2037 symbols completed. LH took 1.1s. Estimated remaining: 6m 26s. Rate: 150.2 symbols/min [2025-10-06T22:41:07.435995] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:07.471053] [DEBUG] [LOCAL ] LII: Loaded 28022 existing records from primary storage. [2025-10-06T22:41:07.490490] [INFO ] [MAIN ] LII: Loaded 28022 primary data records. [2025-10-06T22:41:07.517847] [DEBUG] [LOCAL ] LHX: Loaded 48609 existing records from primary storage. [2025-10-06T22:41:07.542893] [INFO ] [MAIN ] LHX: Loaded 48609 primary data records. [2025-10-06T22:41:07.962764] [DEBUG] [LOCAL ] LION: Loaded 44843 existing records from primary storage. [2025-10-06T22:41:08.019284] [INFO ] [MAIN ] LION: Loaded 44843 primary data records. [2025-10-06T22:41:08.481672] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:08.482290] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:08.483089] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48609 primary records. [2025-10-06T22:41:08.483743] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 28022 primary records. [2025-10-06T22:41:08.483796] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-06T22:41:08.483950] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-06T22:41:08.517667] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-10-06T22:41:08.518361] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-10-06T22:41:08.518467] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-06T22:41:08.520808] [INFO ] [MAIN ] Derivative Progress: 1072/2037 symbols completed. LII took 1.1s. Estimated remaining: 6m 26s. Rate: 149.9 symbols/min [2025-10-06T22:41:08.521123] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:08.521302] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-06T22:41:08.524948] [INFO ] [MAIN ] Derivative Progress: 1073/2037 symbols completed. LHX took 1.2s. Estimated remaining: 6m 25s. Rate: 150.1 symbols/min [2025-10-06T22:41:08.525360] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:08.546225] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:08.545919] [DEBUG] [LOCAL ] LITB: Loaded 4278 existing records from primary storage. [2025-10-06T22:41:08.547159] [INFO ] [MAIN ] LITB: Loaded 4278 primary data records. [2025-10-06T22:41:08.547081] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 44843 primary records. [2025-10-06T22:41:08.559805] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-06T22:41:08.940857] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-10-06T22:41:08.941038] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-06T22:41:08.944245] [INFO ] [MAIN ] Derivative Progress: 1074/2037 symbols completed. LION took 1.5s. Estimated remaining: 6m 25s. Rate: 150.1 symbols/min [2025-10-06T22:41:08.944792] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:08.971858] [DEBUG] [LOCAL ] LLY: Loaded 53304 existing records from primary storage. [2025-10-06T22:41:08.972435] [INFO ] [MAIN ] LLY: Loaded 53304 primary data records. [2025-10-06T22:41:09.097536] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:09.118066] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4278 primary records. [2025-10-06T22:41:09.140617] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-06T22:41:09.363560] [DEBUG] [LOCAL ] LMND: Loaded 51936 existing records from primary storage. [2025-10-06T22:41:09.364004] [INFO ] [MAIN ] LMND: Loaded 51936 primary data records. [2025-10-06T22:41:09.366138] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-10-06T22:41:09.366228] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-06T22:41:09.369419] [INFO ] [MAIN ] Derivative Progress: 1075/2037 symbols completed. LITB took 0.8s. Estimated remaining: 6m 25s. Rate: 150.1 symbols/min [2025-10-06T22:41:09.392497] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:09.728157] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:09.729201] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53304 primary records. [2025-10-06T22:41:09.731346] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-06T22:41:09.765278] [DEBUG] [LOCAL ] LMT: Loaded 49826 existing records from primary storage. [2025-10-06T22:41:09.767724] [INFO ] [MAIN ] LMT: Loaded 49826 primary data records. [2025-10-06T22:41:09.857679] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-10-06T22:41:09.864270] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-06T22:41:09.875197] [INFO ] [MAIN ] Derivative Progress: 1076/2037 symbols completed. LLY took 1.3s. Estimated remaining: 6m 24s. Rate: 150.0 symbols/min [2025-10-06T22:41:09.881699] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:09.953705] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:09.972831] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 51936 primary records. [2025-10-06T22:41:09.976143] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-06T22:41:10.109546] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-10-06T22:41:10.109875] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-06T22:41:10.112442] [INFO ] [MAIN ] Derivative Progress: 1077/2037 symbols completed. LMND took 1.2s. Estimated remaining: 6m 24s. Rate: 150.1 symbols/min [2025-10-06T22:41:10.113177] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:10.137197] [DEBUG] [LOCAL ] LND: Loaded 4946 existing records from primary storage. [2025-10-06T22:41:10.137638] [INFO ] [MAIN ] LND: Loaded 4946 primary data records. [2025-10-06T22:41:10.265518] [DEBUG] [LOCAL ] LNC: Loaded 51637 existing records from primary storage. [2025-10-06T22:41:10.271342] [INFO ] [MAIN ] LNC: Loaded 51637 primary data records. [2025-10-06T22:41:10.393165] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:10.420352] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49826 primary records. [2025-10-06T22:41:10.434668] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-06T22:41:10.787025] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-10-06T22:41:10.848436] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-06T22:41:10.851661] [INFO ] [MAIN ] Derivative Progress: 1078/2037 symbols completed. LMT took 1.5s. Estimated remaining: 6m 24s. Rate: 150.0 symbols/min [2025-10-06T22:41:10.875407] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:10.876250] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 4946 primary records. [2025-10-06T22:41:10.876397] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-06T22:41:10.904265] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:10.905491] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51637 primary records. [2025-10-06T22:41:10.906053] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-06T22:41:10.907834] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-10-06T22:41:10.914996] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-06T22:41:10.918447] [INFO ] [MAIN ] Derivative Progress: 1079/2037 symbols completed. LND took 0.8s. Estimated remaining: 6m 23s. Rate: 150.1 symbols/min [2025-10-06T22:41:10.925256] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-10-06T22:41:10.925318] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-06T22:41:10.928239] [INFO ] [MAIN ] Derivative Progress: 1080/2037 symbols completed. LNC took 1.0s. Estimated remaining: 6m 22s. Rate: 150.2 symbols/min [2025-10-06T22:41:10.928841] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:10.928951] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:10.929142] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:10.944165] [DEBUG] [LOCAL ] LNN: Loaded 11248 existing records from primary storage. [2025-10-06T22:41:10.944405] [INFO ] [MAIN ] LNN: Loaded 11248 primary data records. [2025-10-06T22:41:11.295611] [DEBUG] [LOCAL ] LOAR: Loaded 42004 existing records from primary storage. [2025-10-06T22:41:11.297238] [INFO ] [MAIN ] LOAR: Loaded 42004 primary data records. [2025-10-06T22:41:11.298131] [DEBUG] [LOCAL ] LNG: Loaded 51321 existing records from primary storage. [2025-10-06T22:41:11.319662] [INFO ] [MAIN ] LNG: Loaded 51321 primary data records. [2025-10-06T22:41:11.988136] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:11.989814] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11248 primary records. [2025-10-06T22:41:11.990492] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-06T22:41:12.010898] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-10-06T22:41:12.011030] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-06T22:41:12.014611] [INFO ] [MAIN ] Derivative Progress: 1081/2037 symbols completed. LNN took 1.1s. Estimated remaining: 6m 22s. Rate: 150.0 symbols/min [2025-10-06T22:41:12.016927] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:12.038805] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:12.039622] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 42004 primary records. [2025-10-06T22:41:12.040053] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-06T22:41:12.082175] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-10-06T22:41:12.083221] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-06T22:41:12.086109] [INFO ] [MAIN ] Derivative Progress: 1082/2037 symbols completed. LOAR took 1.2s. Estimated remaining: 6m 22s. Rate: 150.1 symbols/min [2025-10-06T22:41:12.086331] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:12.083115] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:12.087458] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51321 primary records. [2025-10-06T22:41:12.096115] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-06T22:41:12.100589] [DEBUG] [LOCAL ] LOB: Loaded 27291 existing records from primary storage. [2025-10-06T22:41:12.108848] [INFO ] [MAIN ] LOB: Loaded 27291 primary data records. [2025-10-06T22:41:12.126850] [DEBUG] [LOCAL ] LOCL: Loaded 3628 existing records from primary storage. [2025-10-06T22:41:12.128093] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-10-06T22:41:12.160342] [INFO ] [MAIN ] LOCL: Loaded 3628 primary data records. [2025-10-06T22:41:12.167226] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-06T22:41:12.229172] [INFO ] [MAIN ] Derivative Progress: 1083/2037 symbols completed. LNG took 1.3s. Estimated remaining: 6m 21s. Rate: 150.2 symbols/min [2025-10-06T22:41:12.241256] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:12.890499] [DEBUG] [LOCAL ] LOMA: Loaded 32055 existing records from primary storage. [2025-10-06T22:41:12.891114] [INFO ] [MAIN ] LOMA: Loaded 32055 primary data records. [2025-10-06T22:41:13.113132] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:13.242577] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 27291 primary records. [2025-10-06T22:41:13.259808] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-06T22:41:13.260239] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:13.262862] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3628 primary records. [2025-10-06T22:41:13.263036] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-06T22:41:13.294851] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-10-06T22:41:13.296438] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-06T22:41:13.299177] [INFO ] [MAIN ] Derivative Progress: 1084/2037 symbols completed. LOB took 1.3s. Estimated remaining: 6m 21s. Rate: 149.9 symbols/min [2025-10-06T22:41:13.300598] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:13.303831] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-10-06T22:41:13.304402] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-06T22:41:13.308621] [INFO ] [MAIN ] Derivative Progress: 1085/2037 symbols completed. LOCL took 1.2s. Estimated remaining: 6m 21s. Rate: 150.1 symbols/min [2025-10-06T22:41:13.309711] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:13.332076] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:13.337805] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 32055 primary records. [2025-10-06T22:41:13.338158] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-06T22:41:13.378745] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-10-06T22:41:13.378815] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-06T22:41:13.381398] [INFO ] [MAIN ] Derivative Progress: 1086/2037 symbols completed. LOMA took 1.1s. Estimated remaining: 6m 20s. Rate: 150.2 symbols/min [2025-10-06T22:41:13.381830] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:13.412689] [DEBUG] [LOCAL ] LPG: Loaded 39788 existing records from primary storage. [2025-10-06T22:41:13.413945] [DEBUG] [LOCAL ] LOW: Loaded 52956 existing records from primary storage. [2025-10-06T22:41:13.414437] [INFO ] [MAIN ] LOW: Loaded 52956 primary data records. [2025-10-06T22:41:13.414536] [INFO ] [MAIN ] LPG: Loaded 39788 primary data records. [2025-10-06T22:41:13.665106] [DEBUG] [LOCAL ] LPL: Loaded 26953 existing records from primary storage. [2025-10-06T22:41:13.681683] [INFO ] [MAIN ] LPL: Loaded 26953 primary data records. [2025-10-06T22:41:14.442530] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:14.443181] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:14.447434] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52956 primary records. [2025-10-06T22:41:14.447552] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-06T22:41:14.446218] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 39788 primary records. [2025-10-06T22:41:14.449006] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-06T22:41:14.479962] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-10-06T22:41:14.480847] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-06T22:41:14.480474] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:41:14.483754] [INFO ] [MAIN ] Derivative Progress: 1087/2037 symbols completed. LOW took 1.2s. Estimated remaining: 6m 20s. Rate: 149.9 symbols/min [2025-10-06T22:41:14.495035] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:14.496748] [INFO ] [MAIN ] LPL: Generated 1793 derivative records from 26953 primary records. [2025-10-06T22:41:14.497030] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-06T22:41:14.505078] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-10-06T22:41:14.512638] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-06T22:41:14.521262] [DEBUG] [LOCAL ] LPL: Derivative data saved (1793 records). [2025-10-06T22:41:14.524242] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-06T22:41:14.524039] [INFO ] [MAIN ] Derivative Progress: 1088/2037 symbols completed. LPG took 1.2s. Estimated remaining: 6m 19s. Rate: 150.1 symbols/min [2025-10-06T22:41:14.527633] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:14.527850] [INFO ] [MAIN ] Derivative Progress: 1089/2037 symbols completed. LPL took 1.1s. Estimated remaining: 6m 19s. Rate: 150.2 symbols/min [2025-10-06T22:41:14.528565] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:14.565477] [DEBUG] [LOCAL ] LPX: Loaded 39722 existing records from primary storage. [2025-10-06T22:41:14.575880] [INFO ] [MAIN ] LPX: Loaded 39722 primary data records. [2025-10-06T22:41:14.705170] [DEBUG] [LOCAL ] LRN: Loaded 39757 existing records from primary storage. [2025-10-06T22:41:14.706453] [INFO ] [MAIN ] LRN: Loaded 39757 primary data records. [2025-10-06T22:41:14.840305] [DEBUG] [LOCAL ] LSPD: Loaded 42804 existing records from primary storage. [2025-10-06T22:41:14.862421] [INFO ] [MAIN ] LSPD: Loaded 42804 primary data records. [2025-10-06T22:41:15.651885] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:15.652812] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 39722 primary records. [2025-10-06T22:41:15.653043] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-06T22:41:15.675519] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-10-06T22:41:15.675857] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-06T22:41:15.678085] [INFO ] [MAIN ] Derivative Progress: 1090/2037 symbols completed. LPX took 1.2s. Estimated remaining: 6m 19s. Rate: 149.9 symbols/min [2025-10-06T22:41:15.678483] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:15.694011] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:15.698068] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39757 primary records. [2025-10-06T22:41:15.698254] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-06T22:41:15.726947] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:15.730213] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-10-06T22:41:15.739525] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-06T22:41:15.731057] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 42804 primary records. [2025-10-06T22:41:15.742602] [INFO ] [MAIN ] Derivative Progress: 1091/2037 symbols completed. LRN took 1.2s. Estimated remaining: 6m 18s. Rate: 150.1 symbols/min [2025-10-06T22:41:15.742804] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-06T22:41:15.743029] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:15.769856] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-10-06T22:41:15.770111] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-06T22:41:15.773301] [INFO ] [MAIN ] Derivative Progress: 1092/2037 symbols completed. LSPD took 1.2s. Estimated remaining: 6m 18s. Rate: 150.2 symbols/min [2025-10-06T22:41:15.773545] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:15.774622] [DEBUG] [LOCAL ] LTC: Loaded 30240 existing records from primary storage. [2025-10-06T22:41:15.775070] [INFO ] [MAIN ] LTC: Loaded 30240 primary data records. [2025-10-06T22:41:16.123146] [DEBUG] [LOCAL ] LTM: Loaded 37442 existing records from primary storage. [2025-10-06T22:41:16.124227] [INFO ] [MAIN ] LTM: Loaded 37442 primary data records. [2025-10-06T22:41:16.125095] [DEBUG] [LOCAL ] LTH: Loaded 51720 existing records from primary storage. [2025-10-06T22:41:16.137153] [INFO ] [MAIN ] LTH: Loaded 51720 primary data records. [2025-10-06T22:41:16.815968] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:16.817221] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 30240 primary records. [2025-10-06T22:41:16.818274] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-06T22:41:16.844459] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-10-06T22:41:16.844949] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-06T22:41:16.849710] [INFO ] [MAIN ] Derivative Progress: 1093/2037 symbols completed. LTC took 1.2s. Estimated remaining: 6m 18s. Rate: 150.0 symbols/min [2025-10-06T22:41:16.892134] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:16.892635] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:16.895168] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 37442 primary records. [2025-10-06T22:41:16.895367] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51720 primary records. [2025-10-06T22:41:16.895509] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-06T22:41:16.895671] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-06T22:41:16.936732] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-10-06T22:41:16.938013] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-06T22:41:16.941914] [INFO ] [MAIN ] Derivative Progress: 1094/2037 symbols completed. LTH took 1.2s. Estimated remaining: 6m 17s. Rate: 150.1 symbols/min [2025-10-06T22:41:16.942688] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-10-06T22:41:16.943121] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-06T22:41:16.947471] [INFO ] [MAIN ] Derivative Progress: 1095/2037 symbols completed. LTM took 1.2s. Estimated remaining: 6m 16s. Rate: 150.2 symbols/min [2025-10-06T22:41:16.947893] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:16.948189] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:16.948041] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:16.974274] [DEBUG] [LOCAL ] LUCK: Loaded 24535 existing records from primary storage. [2025-10-06T22:41:16.974438] [INFO ] [MAIN ] LUCK: Loaded 24535 primary data records. [2025-10-06T22:41:17.370618] [DEBUG] [LOCAL ] LUMN: Loaded 53638 existing records from primary storage. [2025-10-06T22:41:17.371795] [DEBUG] [LOCAL ] LU: Loaded 48948 existing records from primary storage. [2025-10-06T22:41:17.372326] [INFO ] [MAIN ] LUMN: Loaded 53638 primary data records. [2025-10-06T22:41:17.372878] [INFO ] [MAIN ] LU: Loaded 48948 primary data records. [2025-10-06T22:41:18.018193] [DEBUG] [MAIN ] LUCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:18.019729] [INFO ] [MAIN ] LUCK: Generated 1794 derivative records from 24535 primary records. [2025-10-06T22:41:18.019905] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-06T22:41:18.039557] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1794 records). [2025-10-06T22:41:18.040194] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-06T22:41:18.043113] [INFO ] [MAIN ] Derivative Progress: 1096/2037 symbols completed. LUCK took 1.1s. Estimated remaining: 6m 17s. Rate: 150.0 symbols/min [2025-10-06T22:41:18.043548] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:18.063539] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:18.065353] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48948 primary records. [2025-10-06T22:41:18.066347] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-06T22:41:18.082949] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:18.094705] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53638 primary records. [2025-10-06T22:41:18.094905] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-06T22:41:18.118383] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-10-06T22:41:18.117820] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-10-06T22:41:18.118546] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-06T22:41:18.118665] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-06T22:41:18.122046] [INFO ] [MAIN ] Derivative Progress: 1097/2037 symbols completed. LU took 1.2s. Estimated remaining: 6m 16s. Rate: 150.1 symbols/min [2025-10-06T22:41:18.122229] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:18.125074] [INFO ] [MAIN ] Derivative Progress: 1098/2037 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 15s. Rate: 150.2 symbols/min [2025-10-06T22:41:18.125273] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:18.177103] [DEBUG] [LOCAL ] LVWR: Loaded 18041 existing records from primary storage. [2025-10-06T22:41:18.178416] [INFO ] [MAIN ] LVWR: Loaded 18041 primary data records. [2025-10-06T22:41:18.224989] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-06T22:41:18.265010] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-06T22:41:18.423057] [DEBUG] [LOCAL ] LVS: Loaded 53566 existing records from primary storage. [2025-10-06T22:41:18.445857] [INFO ] [MAIN ] LVS: Loaded 53566 primary data records. [2025-10-06T22:41:19.292547] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:19.293700] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 18041 primary records. [2025-10-06T22:41:19.295023] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-06T22:41:19.327014] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-10-06T22:41:19.327263] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-06T22:41:19.327741] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:19.331986] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-10-06T22:41:19.329964] [INFO ] [MAIN ] Derivative Progress: 1099/2037 symbols completed. LVWR took 1.2s. Estimated remaining: 6m 15s. Rate: 149.9 symbols/min [2025-10-06T22:41:19.332997] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-06T22:41:19.334815] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:19.361502] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:19.362866] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53566 primary records. [2025-10-06T22:41:19.363744] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-06T22:41:19.378864] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-10-06T22:41:19.383202] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-10-06T22:41:19.383564] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-06T22:41:19.383500] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-06T22:41:19.389380] [INFO ] [MAIN ] Derivative Progress: 1100/2037 symbols completed. LVS took 1.3s. Estimated remaining: 6m 15s. Rate: 150.0 symbols/min [2025-10-06T22:41:19.392859] [INFO ] [MAIN ] Derivative Progress: 1101/2037 symbols completed. LUV took 1.3s. Estimated remaining: 6m 14s. Rate: 150.2 symbols/min [2025-10-06T22:41:19.393228] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:19.389622] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:19.426237] [DEBUG] [LOCAL ] LXFR: Loaded 16808 existing records from primary storage. [2025-10-06T22:41:19.426382] [INFO ] [MAIN ] LXFR: Loaded 16808 primary data records. [2025-10-06T22:41:19.559385] [DEBUG] [LOCAL ] LW: Loaded 51196 existing records from primary storage. [2025-10-06T22:41:19.573549] [INFO ] [MAIN ] LW: Loaded 51196 primary data records. [2025-10-06T22:41:19.579962] [DEBUG] [LOCAL ] LXP: Loaded 50733 existing records from primary storage. [2025-10-06T22:41:19.590540] [INFO ] [MAIN ] LXP: Loaded 50733 primary data records. [2025-10-06T22:41:20.414609] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:20.415936] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 16808 primary records. [2025-10-06T22:41:20.416041] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-06T22:41:20.433392] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-10-06T22:41:20.433601] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-06T22:41:20.435886] [INFO ] [MAIN ] Derivative Progress: 1102/2037 symbols completed. LXFR took 1.0s. Estimated remaining: 6m 14s. Rate: 150.0 symbols/min [2025-10-06T22:41:20.436298] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:20.467811] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:20.468365] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:20.469166] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51196 primary records. [2025-10-06T22:41:20.469837] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50733 primary records. [2025-10-06T22:41:20.469881] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-06T22:41:20.470666] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-06T22:41:20.507264] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-10-06T22:41:20.517445] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-06T22:41:20.520980] [INFO ] [MAIN ] Derivative Progress: 1103/2037 symbols completed. LXP took 1.1s. Estimated remaining: 6m 13s. Rate: 150.1 symbols/min [2025-10-06T22:41:20.521855] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:20.523860] [DEBUG] [LOCAL ] LXU: Loaded 31804 existing records from primary storage. [2025-10-06T22:41:20.524208] [INFO ] [MAIN ] LXU: Loaded 31804 primary data records. [2025-10-06T22:41:20.546370] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-10-06T22:41:20.556566] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-06T22:41:20.565246] [INFO ] [MAIN ] Derivative Progress: 1104/2037 symbols completed. LW took 1.2s. Estimated remaining: 6m 13s. Rate: 150.2 symbols/min [2025-10-06T22:41:20.572305] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:20.898699] [DEBUG] [LOCAL ] LYB: Loaded 53609 existing records from primary storage. [2025-10-06T22:41:20.899203] [INFO ] [MAIN ] LYB: Loaded 53609 primary data records. [2025-10-06T22:41:20.900149] [DEBUG] [LOCAL ] LYG: Loaded 52778 existing records from primary storage. [2025-10-06T22:41:20.919813] [INFO ] [MAIN ] LYG: Loaded 52778 primary data records. [2025-10-06T22:41:21.449057] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:21.575624] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 31804 primary records. [2025-10-06T22:41:21.590805] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-06T22:41:21.624205] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-10-06T22:41:21.624471] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-06T22:41:21.630016] [INFO ] [MAIN ] Derivative Progress: 1105/2037 symbols completed. LXU took 1.2s. Estimated remaining: 6m 13s. Rate: 150.0 symbols/min [2025-10-06T22:41:21.630884] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:21.670275] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:21.671899] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52778 primary records. [2025-10-06T22:41:21.671992] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-06T22:41:21.670951] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:21.673822] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53609 primary records. [2025-10-06T22:41:21.673970] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-06T22:41:21.705123] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-10-06T22:41:21.705863] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-06T22:41:21.708236] [INFO ] [MAIN ] Derivative Progress: 1106/2037 symbols completed. LYB took 1.2s. Estimated remaining: 6m 12s. Rate: 150.1 symbols/min [2025-10-06T22:41:21.708904] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:21.711236] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-10-06T22:41:21.711496] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-06T22:41:21.714491] [INFO ] [MAIN ] Derivative Progress: 1107/2037 symbols completed. LYG took 1.1s. Estimated remaining: 6m 11s. Rate: 150.2 symbols/min [2025-10-06T22:41:21.715404] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:21.762204] [DEBUG] [LOCAL ] LYV: Loaded 51102 existing records from primary storage. [2025-10-06T22:41:21.768178] [INFO ] [MAIN ] LYV: Loaded 51102 primary data records. [2025-10-06T22:41:21.778024] [DEBUG] [LOCAL ] LZM: Loaded 14218 existing records from primary storage. [2025-10-06T22:41:21.817034] [INFO ] [MAIN ] LZM: Loaded 14218 primary data records. [2025-10-06T22:41:22.007139] [DEBUG] [LOCAL ] LZB: Loaded 35277 existing records from primary storage. [2025-10-06T22:41:22.045225] [INFO ] [MAIN ] LZB: Loaded 35277 primary data records. [2025-10-06T22:41:22.759100] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:22.773208] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51102 primary records. [2025-10-06T22:41:22.775022] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-06T22:41:22.774934] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:22.777836] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 14218 primary records. [2025-10-06T22:41:22.778308] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-06T22:41:22.815297] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:22.820165] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35277 primary records. [2025-10-06T22:41:22.820768] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-06T22:41:22.823115] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-10-06T22:41:22.823851] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-06T22:41:22.838121] [INFO ] [MAIN ] Derivative Progress: 1108/2037 symbols completed. LZM took 1.1s. Estimated remaining: 6m 12s. Rate: 150.0 symbols/min [2025-10-06T22:41:22.840412] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-10-06T22:41:22.840727] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-06T22:41:22.843160] [INFO ] [MAIN ] Derivative Progress: 1109/2037 symbols completed. LYV took 1.2s. Estimated remaining: 6m 11s. Rate: 150.1 symbols/min [2025-10-06T22:41:22.846122] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-10-06T22:41:22.846184] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-06T22:41:22.849082] [INFO ] [MAIN ] Derivative Progress: 1110/2037 symbols completed. LZB took 1.1s. Estimated remaining: 6m 10s. Rate: 150.2 symbols/min [2025-10-06T22:41:22.849433] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:22.849856] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:22.849731] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:22.931362] [DEBUG] [LOCAL ] MAA: Loaded 42633 existing records from primary storage. [2025-10-06T22:41:22.948531] [INFO ] [MAIN ] MAA: Loaded 42633 primary data records. [2025-10-06T22:41:23.021388] [DEBUG] [LOCAL ] MA: Loaded 52507 existing records from primary storage. [2025-10-06T22:41:23.052889] [INFO ] [MAIN ] MA: Loaded 52507 primary data records. [2025-10-06T22:41:23.060180] [DEBUG] [LOCAL ] M: Loaded 53539 existing records from primary storage. [2025-10-06T22:41:23.080881] [INFO ] [MAIN ] M: Loaded 53539 primary data records. [2025-10-06T22:41:23.994206] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:23.995348] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42633 primary records. [2025-10-06T22:41:23.995578] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-06T22:41:24.032695] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:24.034562] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52507 primary records. [2025-10-06T22:41:24.034951] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-06T22:41:24.052426] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:24.061475] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53539 primary records. [2025-10-06T22:41:24.061632] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-06T22:41:24.052092] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-10-06T22:41:24.067848] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-06T22:41:24.071858] [INFO ] [MAIN ] Derivative Progress: 1111/2037 symbols completed. MAA took 1.2s. Estimated remaining: 6m 11s. Rate: 150.0 symbols/min [2025-10-06T22:41:24.085748] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:24.089267] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-10-06T22:41:24.090246] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-06T22:41:24.094709] [INFO ] [MAIN ] Derivative Progress: 1112/2037 symbols completed. MA took 1.2s. Estimated remaining: 6m 10s. Rate: 150.1 symbols/min [2025-10-06T22:41:24.097868] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-10-06T22:41:24.098222] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-06T22:41:24.100894] [INFO ] [MAIN ] Derivative Progress: 1113/2037 symbols completed. M took 1.3s. Estimated remaining: 6m 9s. Rate: 150.2 symbols/min [2025-10-06T22:41:24.098062] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:24.101125] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:24.162310] [DEBUG] [LOCAL ] MAGN: Loaded 35395 existing records from primary storage. [2025-10-06T22:41:24.162493] [INFO ] [MAIN ] MAGN: Loaded 35395 primary data records. [2025-10-06T22:41:24.296715] [DEBUG] [LOCAL ] MAIN: Loaded 41171 existing records from primary storage. [2025-10-06T22:41:24.311875] [INFO ] [MAIN ] MAIN: Loaded 41171 primary data records. [2025-10-06T22:41:24.346262] [DEBUG] [LOCAL ] MAC: Loaded 49621 existing records from primary storage. [2025-10-06T22:41:24.374285] [INFO ] [MAIN ] MAC: Loaded 49621 primary data records. [2025-10-06T22:41:25.443995] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:25.446317] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 35395 primary records. [2025-10-06T22:41:25.447089] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-06T22:41:25.472235] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-10-06T22:41:25.485006] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-06T22:41:25.485618] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:25.486422] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41171 primary records. [2025-10-06T22:41:25.488662] [INFO ] [MAIN ] Derivative Progress: 1114/2037 symbols completed. MAGN took 1.4s. Estimated remaining: 6m 10s. Rate: 149.9 symbols/min [2025-10-06T22:41:25.488838] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:25.489218] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-06T22:41:25.516905] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-10-06T22:41:25.522227] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:25.523006] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49621 primary records. [2025-10-06T22:41:25.523104] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-06T22:41:25.523142] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-06T22:41:25.526519] [INFO ] [MAIN ] Derivative Progress: 1115/2037 symbols completed. MAIN took 1.4s. Estimated remaining: 6m 9s. Rate: 150.0 symbols/min [2025-10-06T22:41:25.526705] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:25.554305] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-10-06T22:41:25.554456] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-06T22:41:25.557209] [INFO ] [MAIN ] Derivative Progress: 1116/2037 symbols completed. MAC took 1.5s. Estimated remaining: 6m 8s. Rate: 150.1 symbols/min [2025-10-06T22:41:25.557581] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:25.580772] [DEBUG] [LOCAL ] MAN: Loaded 43603 existing records from primary storage. [2025-10-06T22:41:25.581066] [INFO ] [MAIN ] MAN: Loaded 43603 primary data records. [2025-10-06T22:41:25.693880] [DEBUG] [LOCAL ] MANU: Loaded 26710 existing records from primary storage. [2025-10-06T22:41:25.721050] [INFO ] [MAIN ] MANU: Loaded 26710 primary data records. [2025-10-06T22:41:26.129236] [DEBUG] [LOCAL ] MAS: Loaded 52301 existing records from primary storage. [2025-10-06T22:41:26.129624] [INFO ] [MAIN ] MAS: Loaded 52301 primary data records. [2025-10-06T22:41:26.581288] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:26.583486] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43603 primary records. [2025-10-06T22:41:26.583867] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-06T22:41:26.613863] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:26.615541] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 26710 primary records. [2025-10-06T22:41:26.615989] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-06T22:41:26.633194] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-10-06T22:41:26.634789] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-06T22:41:26.638099] [INFO ] [MAIN ] Derivative Progress: 1117/2037 symbols completed. MAN took 1.1s. Estimated remaining: 6m 8s. Rate: 149.9 symbols/min [2025-10-06T22:41:26.638246] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-10-06T22:41:26.638394] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:26.639356] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-06T22:41:26.642192] [INFO ] [MAIN ] Derivative Progress: 1118/2037 symbols completed. MANU took 1.1s. Estimated remaining: 6m 8s. Rate: 150.0 symbols/min [2025-10-06T22:41:26.642480] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:26.662272] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:26.663202] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52301 primary records. [2025-10-06T22:41:26.663352] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-06T22:41:26.681374] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-10-06T22:41:26.681730] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-06T22:41:26.684511] [INFO ] [MAIN ] Derivative Progress: 1119/2037 symbols completed. MAS took 1.1s. Estimated remaining: 6m 7s. Rate: 150.1 symbols/min [2025-10-06T22:41:26.685002] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:26.716625] [DEBUG] [LOCAL ] MATX: Loaded 31425 existing records from primary storage. [2025-10-06T22:41:26.716836] [INFO ] [MAIN ] MATX: Loaded 31425 primary data records. [2025-10-06T22:41:26.849628] [DEBUG] [LOCAL ] MATV: Loaded 36253 existing records from primary storage. [2025-10-06T22:41:26.877954] [INFO ] [MAIN ] MATV: Loaded 36253 primary data records. [2025-10-06T22:41:27.107482] [DEBUG] [LOCAL ] MAX: Loaded 30772 existing records from primary storage. [2025-10-06T22:41:27.119431] [INFO ] [MAIN ] MAX: Loaded 30772 primary data records. [2025-10-06T22:41:27.723182] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:27.724778] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31425 primary records. [2025-10-06T22:41:27.725206] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-06T22:41:27.750629] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-10-06T22:41:27.751078] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-06T22:41:27.766579] [INFO ] [MAIN ] Derivative Progress: 1120/2037 symbols completed. MATX took 1.1s. Estimated remaining: 6m 7s. Rate: 149.9 symbols/min [2025-10-06T22:41:27.767933] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:27.768432] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:27.772493] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 36253 primary records. [2025-10-06T22:41:27.772835] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-06T22:41:27.787057] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:27.787701] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30772 primary records. [2025-10-06T22:41:27.796333] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-06T22:41:27.822251] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-10-06T22:41:27.821806] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-10-06T22:41:27.822396] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-06T22:41:27.825301] [INFO ] [MAIN ] Derivative Progress: 1121/2037 symbols completed. MAX took 1.1s. Estimated remaining: 6m 6s. Rate: 150.0 symbols/min [2025-10-06T22:41:27.825565] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:27.825876] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-06T22:41:27.829083] [INFO ] [MAIN ] Derivative Progress: 1122/2037 symbols completed. MATV took 1.2s. Estimated remaining: 6m 6s. Rate: 150.2 symbols/min [2025-10-06T22:41:27.829320] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:27.863071] [DEBUG] [LOCAL ] MBI: Loaded 24233 existing records from primary storage. [2025-10-06T22:41:27.876380] [INFO ] [MAIN ] MBI: Loaded 24233 primary data records. [2025-10-06T22:41:27.877401] [DEBUG] [LOCAL ] MBC: Loaded 43410 existing records from primary storage. [2025-10-06T22:41:27.916431] [INFO ] [MAIN ] MBC: Loaded 43410 primary data records. [2025-10-06T22:41:28.112384] [DEBUG] [LOCAL ] MC: Loaded 44022 existing records from primary storage. [2025-10-06T22:41:28.143498] [INFO ] [MAIN ] MC: Loaded 44022 primary data records. [2025-10-06T22:41:28.930243] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:28.945280] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43410 primary records. [2025-10-06T22:41:28.945724] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-06T22:41:28.944360] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:28.947668] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24233 primary records. [2025-10-06T22:41:28.947765] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-06T22:41:28.978742] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-10-06T22:41:28.982974] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-06T22:41:28.987985] [INFO ] [MAIN ] Derivative Progress: 1123/2037 symbols completed. MBI took 1.2s. Estimated remaining: 6m 6s. Rate: 149.9 symbols/min [2025-10-06T22:41:28.984294] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-10-06T22:41:29.002810] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-06T22:41:29.003220] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:29.007111] [INFO ] [MAIN ] Derivative Progress: 1124/2037 symbols completed. MBC took 1.2s. Estimated remaining: 6m 5s. Rate: 150.0 symbols/min [2025-10-06T22:41:29.007325] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 44022 primary records. [2025-10-06T22:41:29.007636] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-06T22:41:29.026063] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-10-06T22:41:29.026262] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-06T22:41:29.029271] [INFO ] [MAIN ] Derivative Progress: 1125/2037 symbols completed. MC took 1.2s. Estimated remaining: 6m 4s. Rate: 150.2 symbols/min [2025-10-06T22:41:29.030070] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:29.030196] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:29.029960] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:29.046846] [DEBUG] [LOCAL ] MCI: Loaded 6457 existing records from primary storage. [2025-10-06T22:41:29.046957] [INFO ] [MAIN ] MCI: Loaded 6457 primary data records. [2025-10-06T22:41:29.145345] [DEBUG] [LOCAL ] MCB: Loaded 11254 existing records from primary storage. [2025-10-06T22:41:29.156332] [INFO ] [MAIN ] MCB: Loaded 11254 primary data records. [2025-10-06T22:41:29.535257] [DEBUG] [LOCAL ] MCK: Loaded 39017 existing records from primary storage. [2025-10-06T22:41:29.558629] [INFO ] [MAIN ] MCK: Loaded 39017 primary data records. [2025-10-06T22:41:30.150771] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:30.152575] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6457 primary records. [2025-10-06T22:41:30.152824] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-06T22:41:30.173883] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-10-06T22:41:30.187085] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:30.187152] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-06T22:41:30.190041] [INFO ] [MAIN ] Derivative Progress: 1126/2037 symbols completed. MCI took 1.2s. Estimated remaining: 6m 5s. Rate: 149.9 symbols/min [2025-10-06T22:41:30.191066] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11254 primary records. [2025-10-06T22:41:30.192263] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:30.192507] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-06T22:41:30.215137] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-10-06T22:41:30.221506] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-06T22:41:30.224676] [INFO ] [MAIN ] Derivative Progress: 1127/2037 symbols completed. MCB took 1.2s. Estimated remaining: 6m 4s. Rate: 150.0 symbols/min [2025-10-06T22:41:30.226709] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:30.221112] [DEBUG] [LOCAL ] MCN: Loaded 8160 existing records from primary storage. [2025-10-06T22:41:30.227313] [INFO ] [MAIN ] MCN: Loaded 8160 primary data records. [2025-10-06T22:41:30.270148] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:30.298281] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 39017 primary records. [2025-10-06T22:41:30.332320] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-06T22:41:30.399796] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-10-06T22:41:30.405384] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-06T22:41:30.447242] [INFO ] [MAIN ] Derivative Progress: 1128/2037 symbols completed. MCK took 1.4s. Estimated remaining: 6m 3s. Rate: 150.1 symbols/min [2025-10-06T22:41:30.550422] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:30.638796] [DEBUG] [LOCAL ] MCO: Loaded 39195 existing records from primary storage. [2025-10-06T22:41:30.641554] [INFO ] [MAIN ] MCO: Loaded 39195 primary data records. [2025-10-06T22:41:30.699498] [DEBUG] [LOCAL ] MCR: Loaded 8845 existing records from primary storage. [2025-10-06T22:41:30.743077] [INFO ] [MAIN ] MCR: Loaded 8845 primary data records. [2025-10-06T22:41:31.307301] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:31.309395] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8160 primary records. [2025-10-06T22:41:31.309822] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-06T22:41:31.332984] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-10-06T22:41:31.333912] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-06T22:41:31.337420] [INFO ] [MAIN ] Derivative Progress: 1129/2037 symbols completed. MCN took 1.1s. Estimated remaining: 6m 3s. Rate: 149.9 symbols/min [2025-10-06T22:41:31.337862] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:31.351914] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:31.353456] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39195 primary records. [2025-10-06T22:41:31.353684] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-06T22:41:31.374635] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-10-06T22:41:31.375093] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-06T22:41:31.378794] [INFO ] [MAIN ] Derivative Progress: 1130/2037 symbols completed. MCO took 1.2s. Estimated remaining: 6m 3s. Rate: 150.0 symbols/min [2025-10-06T22:41:31.379059] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:31.400872] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:31.401795] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8845 primary records. [2025-10-06T22:41:31.402016] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-06T22:41:31.425415] [DEBUG] [LOCAL ] MCS: Loaded 20959 existing records from primary storage. [2025-10-06T22:41:31.426153] [INFO ] [MAIN ] MCS: Loaded 20959 primary data records. [2025-10-06T22:41:31.503373] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-10-06T22:41:31.519165] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-06T22:41:31.530688] [INFO ] [MAIN ] Derivative Progress: 1131/2037 symbols completed. MCR took 1.0s. Estimated remaining: 6m 2s. Rate: 150.1 symbols/min [2025-10-06T22:41:31.576492] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:31.577623] [DEBUG] [LOCAL ] MCY: Loaded 24122 existing records from primary storage. [2025-10-06T22:41:31.584616] [INFO ] [MAIN ] MCY: Loaded 24122 primary data records. [2025-10-06T22:41:32.166850] [DEBUG] [LOCAL ] MD: Loaded 38383 existing records from primary storage. [2025-10-06T22:41:32.167111] [INFO ] [MAIN ] MD: Loaded 38383 primary data records. [2025-10-06T22:41:32.488916] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:32.490684] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 20959 primary records. [2025-10-06T22:41:32.491257] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-06T22:41:32.515731] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-10-06T22:41:32.528476] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-06T22:41:32.531526] [INFO ] [MAIN ] Derivative Progress: 1132/2037 symbols completed. MCS took 1.2s. Estimated remaining: 6m 2s. Rate: 149.9 symbols/min [2025-10-06T22:41:32.532027] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:32.532387] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:32.533317] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 24122 primary records. [2025-10-06T22:41:32.533611] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-06T22:41:32.552520] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-10-06T22:41:32.552719] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-06T22:41:32.555823] [INFO ] [MAIN ] Derivative Progress: 1133/2037 symbols completed. MCY took 1.2s. Estimated remaining: 6m 1s. Rate: 150.1 symbols/min [2025-10-06T22:41:32.556119] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:32.563445] [DEBUG] [LOCAL ] MDST: Loaded 5710 existing records from primary storage. [2025-10-06T22:41:32.563779] [INFO ] [MAIN ] MDST: Loaded 5710 primary data records. [2025-10-06T22:41:32.661025] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:32.680536] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38383 primary records. [2025-10-06T22:41:32.684431] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-06T22:41:32.913313] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-10-06T22:41:32.913475] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-06T22:41:32.916019] [INFO ] [MAIN ] Derivative Progress: 1134/2037 symbols completed. MD took 1.3s. Estimated remaining: 6m 1s. Rate: 150.1 symbols/min [2025-10-06T22:41:32.917027] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:32.940240] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-06T22:41:32.940817] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-06T22:41:33.149754] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:33.180948] [INFO ] [MAIN ] MDST: Generated 1794 derivative records from 5710 primary records. [2025-10-06T22:41:33.321244] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-06T22:41:33.337255] [DEBUG] [LOCAL ] MDU: Loaded 47982 existing records from primary storage. [2025-10-06T22:41:33.349703] [INFO ] [MAIN ] MDU: Loaded 47982 primary data records. [2025-10-06T22:41:33.385368] [DEBUG] [LOCAL ] MDST: Derivative data saved (1794 records). [2025-10-06T22:41:33.397997] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-06T22:41:33.412479] [INFO ] [MAIN ] Derivative Progress: 1135/2037 symbols completed. MDST took 0.9s. Estimated remaining: 6m 1s. Rate: 150.0 symbols/min [2025-10-06T22:41:33.438954] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:33.663908] [DEBUG] [LOCAL ] MDV: Loaded 8498 existing records from primary storage. [2025-10-06T22:41:33.664118] [INFO ] [MAIN ] MDV: Loaded 8498 primary data records. [2025-10-06T22:41:33.806020] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:33.886404] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-10-06T22:41:34.057799] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-06T22:41:34.095537] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-10-06T22:41:34.097803] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-06T22:41:34.100862] [INFO ] [MAIN ] Derivative Progress: 1136/2037 symbols completed. MDT took 1.5s. Estimated remaining: 6m 1s. Rate: 149.9 symbols/min [2025-10-06T22:41:34.101403] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:34.115166] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:34.117488] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 47982 primary records. [2025-10-06T22:41:34.117875] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-06T22:41:34.146189] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-10-06T22:41:34.146450] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-06T22:41:34.150498] [INFO ] [MAIN ] Derivative Progress: 1137/2037 symbols completed. MDU took 1.2s. Estimated remaining: 5m 60s. Rate: 150.1 symbols/min [2025-10-06T22:41:34.147823] [DEBUG] [LOCAL ] MEC: Loaded 16235 existing records from primary storage. [2025-10-06T22:41:34.150725] [INFO ] [MAIN ] MEC: Loaded 16235 primary data records. [2025-10-06T22:41:34.150928] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:34.270608] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:34.271520] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8498 primary records. [2025-10-06T22:41:34.271893] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-06T22:41:34.499400] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-10-06T22:41:34.501836] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-06T22:41:34.504697] [INFO ] [MAIN ] Derivative Progress: 1138/2037 symbols completed. MDV took 1.1s. Estimated remaining: 5m 59s. Rate: 150.1 symbols/min [2025-10-06T22:41:34.501558] [DEBUG] [LOCAL ] MED: Loaded 21460 existing records from primary storage. [2025-10-06T22:41:34.505427] [INFO ] [MAIN ] MED: Loaded 21460 primary data records. [2025-10-06T22:41:34.849482] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:34.852060] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16235 primary records. [2025-10-06T22:41:34.852406] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-06T22:41:34.870673] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-10-06T22:41:34.870956] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-06T22:41:34.873577] [INFO ] [MAIN ] Derivative Progress: 1139/2037 symbols completed. MEC took 0.8s. Estimated remaining: 5m 59s. Rate: 150.1 symbols/min [2025-10-06T22:41:34.895372] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:34.896188] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21460 primary records. [2025-10-06T22:41:34.896251] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-06T22:41:34.912624] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-10-06T22:41:34.912734] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-06T22:41:34.916117] [INFO ] [MAIN ] Derivative Progress: 1140/2037 symbols completed. MED took 0.8s. Estimated remaining: 5m 58s. Rate: 150.2 symbols/min [2025-10-06T22:41:34.917063] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:34.917324] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:34.916936] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:34.958908] [DEBUG] [LOCAL ] MEGI: Loaded 19965 existing records from primary storage. [2025-10-06T22:41:34.969191] [INFO ] [MAIN ] MEGI: Loaded 19965 primary data records. [2025-10-06T22:41:34.980961] [DEBUG] [LOCAL ] MEI: Loaded 31914 existing records from primary storage. [2025-10-06T22:41:34.981247] [INFO ] [MAIN ] MEI: Loaded 31914 primary data records. [2025-10-06T22:41:34.993824] [DEBUG] [LOCAL ] MEG: Loaded 31610 existing records from primary storage. [2025-10-06T22:41:35.077364] [INFO ] [MAIN ] MEG: Loaded 31610 primary data records. [2025-10-06T22:41:36.044760] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:36.046250] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 19965 primary records. [2025-10-06T22:41:36.046844] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-06T22:41:36.069867] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-10-06T22:41:36.070447] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-06T22:41:36.073059] [INFO ] [MAIN ] Derivative Progress: 1141/2037 symbols completed. MEGI took 1.2s. Estimated remaining: 5m 59s. Rate: 150.0 symbols/min [2025-10-06T22:41:36.101608] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:36.101481] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:36.103515] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31610 primary records. [2025-10-06T22:41:36.102097] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:36.104803] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-06T22:41:36.104702] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 31914 primary records. [2025-10-06T22:41:36.105130] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-06T22:41:36.132789] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-10-06T22:41:36.135794] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-06T22:41:36.142500] [INFO ] [MAIN ] Derivative Progress: 1142/2037 symbols completed. MEG took 1.2s. Estimated remaining: 5m 58s. Rate: 150.1 symbols/min [2025-10-06T22:41:36.142717] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:36.143851] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-10-06T22:41:36.144499] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-06T22:41:36.149358] [INFO ] [MAIN ] Derivative Progress: 1143/2037 symbols completed. MEI took 1.2s. Estimated remaining: 5m 57s. Rate: 150.2 symbols/min [2025-10-06T22:41:36.149615] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:36.159301] [DEBUG] [LOCAL ] MFAN: Loaded 4269 existing records from primary storage. [2025-10-06T22:41:36.159694] [INFO ] [MAIN ] MFAN: Loaded 4269 primary data records. [2025-10-06T22:41:36.357705] [DEBUG] [LOCAL ] MET: Loaded 53321 existing records from primary storage. [2025-10-06T22:41:36.374368] [INFO ] [MAIN ] MET: Loaded 53321 primary data records. [2025-10-06T22:41:36.669013] [DEBUG] [LOCAL ] MFA: Loaded 45559 existing records from primary storage. [2025-10-06T22:41:36.709953] [INFO ] [MAIN ] MFA: Loaded 45559 primary data records. [2025-10-06T22:41:37.277828] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:41:37.279877] [INFO ] [MAIN ] MFAN: Generated 1793 derivative records from 4269 primary records. [2025-10-06T22:41:37.280004] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-06T22:41:37.315332] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:37.316596] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1793 records). [2025-10-06T22:41:37.317883] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53321 primary records. [2025-10-06T22:41:37.318238] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-06T22:41:37.318174] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-06T22:41:37.321119] [INFO ] [MAIN ] Derivative Progress: 1144/2037 symbols completed. MFAN took 1.2s. Estimated remaining: 5m 57s. Rate: 149.9 symbols/min [2025-10-06T22:41:37.322315] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:37.357216] [DEBUG] [LOCAL ] MFAO: Loaded 3886 existing records from primary storage. [2025-10-06T22:41:37.357379] [INFO ] [MAIN ] MFAO: Loaded 3886 primary data records. [2025-10-06T22:41:37.353820] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:37.379855] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45559 primary records. [2025-10-06T22:41:37.405119] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-10-06T22:41:37.405356] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-06T22:41:37.440089] [INFO ] [MAIN ] Derivative Progress: 1145/2037 symbols completed. MET took 1.3s. Estimated remaining: 5m 57s. Rate: 150.0 symbols/min [2025-10-06T22:41:37.404961] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-06T22:41:37.464763] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:37.494959] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-10-06T22:41:37.505568] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-06T22:41:37.535772] [INFO ] [MAIN ] Derivative Progress: 1146/2037 symbols completed. MFA took 1.4s. Estimated remaining: 5m 56s. Rate: 150.1 symbols/min [2025-10-06T22:41:37.565603] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:37.726358] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:41:37.727972] [INFO ] [MAIN ] MFAO: Generated 1793 derivative records from 3886 primary records. [2025-10-06T22:41:37.728226] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-06T22:41:37.744233] [DEBUG] [LOCAL ] MFC: Loaded 51089 existing records from primary storage. [2025-10-06T22:41:37.763185] [INFO ] [MAIN ] MFC: Loaded 51089 primary data records. [2025-10-06T22:41:37.839098] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1793 records). [2025-10-06T22:41:37.877228] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-06T22:41:37.895870] [INFO ] [MAIN ] Derivative Progress: 1147/2037 symbols completed. MFAO took 0.6s. Estimated remaining: 5m 56s. Rate: 150.1 symbols/min [2025-10-06T22:41:37.897806] [DEBUG] [LOCAL ] MFG: Loaded 49260 existing records from primary storage. [2025-10-06T22:41:37.897928] [INFO ] [MAIN ] MFG: Loaded 49260 primary data records. [2025-10-06T22:41:37.896130] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:38.212479] [DEBUG] [LOCAL ] MFM: Loaded 14802 existing records from primary storage. [2025-10-06T22:41:38.221299] [INFO ] [MAIN ] MFM: Loaded 14802 primary data records. [2025-10-06T22:41:38.860913] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:38.863708] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51089 primary records. [2025-10-06T22:41:38.863907] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-06T22:41:38.903560] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-10-06T22:41:38.904045] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-06T22:41:38.904375] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:38.905177] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49260 primary records. [2025-10-06T22:41:38.907581] [INFO ] [MAIN ] Derivative Progress: 1148/2037 symbols completed. MFC took 1.4s. Estimated remaining: 5m 56s. Rate: 149.9 symbols/min [2025-10-06T22:41:38.908105] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:38.908218] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-06T22:41:38.943113] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-10-06T22:41:38.941373] [DEBUG] [LOCAL ] MFSG: Loaded 5492 existing records from primary storage. [2025-10-06T22:41:38.943346] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-06T22:41:38.948459] [INFO ] [MAIN ] MFSG: Loaded 5492 primary data records. [2025-10-06T22:41:38.948346] [INFO ] [MAIN ] Derivative Progress: 1149/2037 symbols completed. MFG took 1.4s. Estimated remaining: 5m 55s. Rate: 150.1 symbols/min [2025-10-06T22:41:38.974418] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:39.027077] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:39.075575] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14802 primary records. [2025-10-06T22:41:39.100847] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-06T22:41:39.139980] [DEBUG] [LOCAL ] MFSI: Loaded 11672 existing records from primary storage. [2025-10-06T22:41:39.150962] [INFO ] [MAIN ] MFSI: Loaded 11672 primary data records. [2025-10-06T22:41:39.443421] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-10-06T22:41:39.455066] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-06T22:41:39.458843] [INFO ] [MAIN ] Derivative Progress: 1150/2037 symbols completed. MFM took 1.6s. Estimated remaining: 5m 55s. Rate: 150.0 symbols/min [2025-10-06T22:41:39.459380] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:39.662013] [DEBUG] [LOCAL ] MFSV: Loaded 2634 existing records from primary storage. [2025-10-06T22:41:39.662480] [INFO ] [MAIN ] MFSV: Loaded 2634 primary data records. [2025-10-06T22:41:39.984178] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:41:39.986076] [INFO ] [MAIN ] MFSG: Generated 1793 derivative records from 5492 primary records. [2025-10-06T22:41:39.986926] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-06T22:41:40.030376] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1793 records). [2025-10-06T22:41:40.030520] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-06T22:41:40.029384] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:41:40.031375] [INFO ] [MAIN ] MFSI: Generated 1793 derivative records from 11672 primary records. [2025-10-06T22:41:40.031547] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-06T22:41:40.043116] [INFO ] [MAIN ] Derivative Progress: 1151/2037 symbols completed. MFSG took 1.1s. Estimated remaining: 5m 54s. Rate: 150.0 symbols/min [2025-10-06T22:41:40.044852] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:40.068816] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1793 records). [2025-10-06T22:41:40.073134] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:41:40.074142] [INFO ] [MAIN ] MFSV: Generated 1793 derivative records from 2634 primary records. [2025-10-06T22:41:40.073286] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-06T22:41:40.074269] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-06T22:41:40.077939] [INFO ] [MAIN ] Derivative Progress: 1152/2037 symbols completed. MFSI took 1.1s. Estimated remaining: 5m 54s. Rate: 150.1 symbols/min [2025-10-06T22:41:40.079275] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:40.098820] [DEBUG] [LOCAL ] MG: Loaded 16310 existing records from primary storage. [2025-10-06T22:41:40.099536] [INFO ] [MAIN ] MG: Loaded 16310 primary data records. [2025-10-06T22:41:40.138695] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1793 records). [2025-10-06T22:41:40.160538] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-06T22:41:40.169144] [INFO ] [MAIN ] Derivative Progress: 1153/2037 symbols completed. MFSV took 0.7s. Estimated remaining: 5m 53s. Rate: 150.2 symbols/min [2025-10-06T22:41:40.530387] [DEBUG] [LOCAL ] MGA: Loaded 50673 existing records from primary storage. [2025-10-06T22:41:40.540449] [INFO ] [MAIN ] MGA: Loaded 50673 primary data records. [2025-10-06T22:41:40.868211] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:40.869876] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 16310 primary records. [2025-10-06T22:41:40.869974] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-06T22:41:40.890025] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-10-06T22:41:40.890327] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-06T22:41:40.893682] [INFO ] [MAIN ] Derivative Progress: 1154/2037 symbols completed. MG took 0.8s. Estimated remaining: 5m 53s. Rate: 150.1 symbols/min [2025-10-06T22:41:40.909665] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:40.910432] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50673 primary records. [2025-10-06T22:41:40.910494] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-06T22:41:40.926402] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-10-06T22:41:40.926492] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-06T22:41:40.929254] [INFO ] [MAIN ] Derivative Progress: 1155/2037 symbols completed. MGA took 0.8s. Estimated remaining: 5m 52s. Rate: 150.2 symbols/min [2025-10-06T22:41:40.929849] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:40.930221] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:40.930027] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:40.943891] [DEBUG] [LOCAL ] MGR: Loaded 5620 existing records from primary storage. [2025-10-06T22:41:40.941043] [DEBUG] [LOCAL ] MGF: Loaded 4270 existing records from primary storage. [2025-10-06T22:41:40.944033] [INFO ] [MAIN ] MGR: Loaded 5620 primary data records. [2025-10-06T22:41:40.965078] [INFO ] [MAIN ] MGF: Loaded 4270 primary data records. [2025-10-06T22:41:41.578907] [DEBUG] [LOCAL ] MGM: Loaded 53607 existing records from primary storage. [2025-10-06T22:41:41.579457] [INFO ] [MAIN ] MGM: Loaded 53607 primary data records. [2025-10-06T22:41:41.937077] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:41.938910] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5620 primary records. [2025-10-06T22:41:41.951282] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-06T22:41:41.970107] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:41.973217] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4270 primary records. [2025-10-06T22:41:41.978504] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-06T22:41:41.993232] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-10-06T22:41:41.999518] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-06T22:41:42.002305] [INFO ] [MAIN ] Derivative Progress: 1156/2037 symbols completed. MGR took 1.1s. Estimated remaining: 5m 52s. Rate: 150.0 symbols/min [2025-10-06T22:41:42.008288] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:42.010045] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-10-06T22:41:42.010399] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-06T22:41:42.013831] [INFO ] [MAIN ] Derivative Progress: 1157/2037 symbols completed. MGF took 1.1s. Estimated remaining: 5m 52s. Rate: 150.1 symbols/min [2025-10-06T22:41:42.015334] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:42.023757] [DEBUG] [LOCAL ] MGRB: Loaded 4057 existing records from primary storage. [2025-10-06T22:41:42.037139] [INFO ] [MAIN ] MGRB: Loaded 4057 primary data records. [2025-10-06T22:41:42.049365] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:42.070352] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53607 primary records. [2025-10-06T22:41:42.094414] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-06T22:41:42.129545] [DEBUG] [LOCAL ] MGRD: Loaded 2227 existing records from primary storage. [2025-10-06T22:41:42.176146] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-10-06T22:41:42.187032] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-06T22:41:42.176348] [INFO ] [MAIN ] MGRD: Loaded 2227 primary data records. [2025-10-06T22:41:42.225158] [INFO ] [MAIN ] Derivative Progress: 1158/2037 symbols completed. MGM took 1.3s. Estimated remaining: 5m 51s. Rate: 150.2 symbols/min [2025-10-06T22:41:42.410442] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:42.584328] [DEBUG] [LOCAL ] MGRE: Loaded 6661 existing records from primary storage. [2025-10-06T22:41:42.624784] [INFO ] [MAIN ] MGRE: Loaded 6661 primary data records. [2025-10-06T22:41:43.082411] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:43.083516] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4057 primary records. [2025-10-06T22:41:43.083908] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-06T22:41:43.103959] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-10-06T22:41:43.106080] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-06T22:41:43.111051] [INFO ] [MAIN ] Derivative Progress: 1159/2037 symbols completed. MGRB took 1.1s. Estimated remaining: 5m 51s. Rate: 150.0 symbols/min [2025-10-06T22:41:43.112710] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:43.129116] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:43.130309] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2227 primary records. [2025-10-06T22:41:43.131025] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-06T22:41:43.148577] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-10-06T22:41:43.148879] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-06T22:41:43.156050] [INFO ] [MAIN ] Derivative Progress: 1160/2037 symbols completed. MGRD took 1.1s. Estimated remaining: 5m 51s. Rate: 150.1 symbols/min [2025-10-06T22:41:43.156914] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:43.171631] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:43.172676] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6661 primary records. [2025-10-06T22:41:43.172853] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-06T22:41:43.213686] [DEBUG] [LOCAL ] MHD: Loaded 12483 existing records from primary storage. [2025-10-06T22:41:43.215447] [INFO ] [MAIN ] MHD: Loaded 12483 primary data records. [2025-10-06T22:41:43.216434] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-10-06T22:41:43.222089] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-06T22:41:43.225326] [INFO ] [MAIN ] Derivative Progress: 1161/2037 symbols completed. MGRE took 0.8s. Estimated remaining: 5m 50s. Rate: 150.2 symbols/min [2025-10-06T22:41:43.276149] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:43.313036] [DEBUG] [LOCAL ] MGY: Loaded 52402 existing records from primary storage. [2025-10-06T22:41:43.333364] [INFO ] [MAIN ] MGY: Loaded 52402 primary data records. [2025-10-06T22:41:43.463045] [DEBUG] [LOCAL ] MHF: Loaded 8740 existing records from primary storage. [2025-10-06T22:41:43.468506] [INFO ] [MAIN ] MHF: Loaded 8740 primary data records. [2025-10-06T22:41:44.268616] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:44.270231] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52402 primary records. [2025-10-06T22:41:44.283861] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-06T22:41:44.285891] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:44.299053] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12483 primary records. [2025-10-06T22:41:44.299365] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-06T22:41:44.312483] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-10-06T22:41:44.312704] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-06T22:41:44.319033] [INFO ] [MAIN ] Derivative Progress: 1162/2037 symbols completed. MGY took 1.2s. Estimated remaining: 5m 50s. Rate: 150.0 symbols/min [2025-10-06T22:41:44.324077] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:44.341434] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:44.343827] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8740 primary records. [2025-10-06T22:41:44.344199] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-06T22:41:44.344823] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-10-06T22:41:44.345563] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-06T22:41:44.348296] [INFO ] [MAIN ] Derivative Progress: 1163/2037 symbols completed. MHD took 1.2s. Estimated remaining: 5m 49s. Rate: 150.1 symbols/min [2025-10-06T22:41:44.348885] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:44.375624] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-10-06T22:41:44.376240] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-06T22:41:44.375993] [DEBUG] [LOCAL ] MHN: Loaded 7620 existing records from primary storage. [2025-10-06T22:41:44.380092] [INFO ] [MAIN ] Derivative Progress: 1164/2037 symbols completed. MHF took 1.1s. Estimated remaining: 5m 49s. Rate: 150.2 symbols/min [2025-10-06T22:41:44.380486] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:44.380753] [INFO ] [MAIN ] MHN: Loaded 7620 primary data records. [2025-10-06T22:41:44.531985] [DEBUG] [LOCAL ] MHK: Loaded 42185 existing records from primary storage. [2025-10-06T22:41:44.538063] [INFO ] [MAIN ] MHK: Loaded 42185 primary data records. [2025-10-06T22:41:44.649739] [DEBUG] [LOCAL ] MHO: Loaded 23801 existing records from primary storage. [2025-10-06T22:41:44.694366] [INFO ] [MAIN ] MHO: Loaded 23801 primary data records. [2025-10-06T22:41:45.492774] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:45.494843] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7620 primary records. [2025-10-06T22:41:45.494988] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-06T22:41:45.533068] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-10-06T22:41:45.534009] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-06T22:41:45.537758] [INFO ] [MAIN ] Derivative Progress: 1165/2037 symbols completed. MHN took 1.2s. Estimated remaining: 5m 49s. Rate: 150.0 symbols/min [2025-10-06T22:41:45.533431] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:45.539766] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:45.539394] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42185 primary records. [2025-10-06T22:41:45.540105] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-06T22:41:45.576297] [DEBUG] [LOCAL ] MIN: Loaded 13381 existing records from primary storage. [2025-10-06T22:41:45.578350] [INFO ] [MAIN ] MIN: Loaded 13381 primary data records. [2025-10-06T22:41:45.584093] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-10-06T22:41:45.600049] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-06T22:41:45.631987] [INFO ] [MAIN ] Derivative Progress: 1166/2037 symbols completed. MHK took 1.3s. Estimated remaining: 5m 48s. Rate: 150.1 symbols/min [2025-10-06T22:41:45.632510] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:45.633105] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:45.653974] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 23801 primary records. [2025-10-06T22:41:45.674164] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-06T22:41:45.772171] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-10-06T22:41:45.795068] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-06T22:41:45.808816] [INFO ] [MAIN ] Derivative Progress: 1167/2037 symbols completed. MHO took 1.4s. Estimated remaining: 5m 48s. Rate: 150.2 symbols/min [2025-10-06T22:41:45.836558] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:45.992250] [DEBUG] [LOCAL ] MITP: Loaded 2376 existing records from primary storage. [2025-10-06T22:41:45.992527] [INFO ] [MAIN ] MITP: Loaded 2376 primary data records. [2025-10-06T22:41:46.128037] [DEBUG] [LOCAL ] MIR: Loaded 51113 existing records from primary storage. [2025-10-06T22:41:46.145034] [INFO ] [MAIN ] MIR: Loaded 51113 primary data records. [2025-10-06T22:41:46.772522] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:46.773782] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13381 primary records. [2025-10-06T22:41:46.774309] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-06T22:41:46.793763] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-10-06T22:41:46.794057] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-06T22:41:46.797608] [INFO ] [MAIN ] Derivative Progress: 1168/2037 symbols completed. MIN took 1.3s. Estimated remaining: 5m 48s. Rate: 150.0 symbols/min [2025-10-06T22:41:46.817695] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-06T22:41:46.818945] [INFO ] [MAIN ] MITP: Generated 1791 derivative records from 2376 primary records. [2025-10-06T22:41:46.819013] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-06T22:41:46.835830] [DEBUG] [LOCAL ] MITP: Derivative data saved (1791 records). [2025-10-06T22:41:46.837000] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-06T22:41:46.840218] [INFO ] [MAIN ] Derivative Progress: 1169/2037 symbols completed. MITP took 1.0s. Estimated remaining: 5m 47s. Rate: 150.1 symbols/min [2025-10-06T22:41:46.856122] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:46.857017] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 51113 primary records. [2025-10-06T22:41:46.857086] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-06T22:41:46.873871] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-10-06T22:41:46.873959] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-06T22:41:46.877765] [INFO ] [MAIN ] Derivative Progress: 1170/2037 symbols completed. MIR took 1.2s. Estimated remaining: 5m 46s. Rate: 150.2 symbols/min [2025-10-06T22:41:46.878745] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:46.878991] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:46.878570] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:46.894023] [DEBUG] [LOCAL ] MIY: Loaded 6044 existing records from primary storage. [2025-10-06T22:41:46.894314] [INFO ] [MAIN ] MIY: Loaded 6044 primary data records. [2025-10-06T22:41:47.039004] [DEBUG] [LOCAL ] MITT: Loaded 22783 existing records from primary storage. [2025-10-06T22:41:47.045062] [INFO ] [MAIN ] MITT: Loaded 22783 primary data records. [2025-10-06T22:41:47.436181] [DEBUG] [LOCAL ] MKC: Loaded 52489 existing records from primary storage. [2025-10-06T22:41:47.466014] [INFO ] [MAIN ] MKC: Loaded 52489 primary data records. [2025-10-06T22:41:47.928476] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:47.931345] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 6044 primary records. [2025-10-06T22:41:47.945313] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-06T22:41:47.945700] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:47.947863] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22783 primary records. [2025-10-06T22:41:47.948079] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-06T22:41:47.977807] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-10-06T22:41:47.978628] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-06T22:41:47.982616] [INFO ] [MAIN ] Derivative Progress: 1171/2037 symbols completed. MIY took 1.1s. Estimated remaining: 5m 46s. Rate: 150.0 symbols/min [2025-10-06T22:41:47.986210] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:47.988556] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-10-06T22:41:47.988831] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-06T22:41:47.991861] [INFO ] [MAIN ] Derivative Progress: 1172/2037 symbols completed. MITT took 1.1s. Estimated remaining: 5m 46s. Rate: 150.1 symbols/min [2025-10-06T22:41:47.992150] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:48.010271] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:48.011171] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52489 primary records. [2025-10-06T22:41:48.011278] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-06T22:41:48.029936] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-10-06T22:41:48.030158] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-06T22:41:48.033921] [INFO ] [MAIN ] Derivative Progress: 1173/2037 symbols completed. MKC took 1.2s. Estimated remaining: 5m 45s. Rate: 150.2 symbols/min [2025-10-06T22:41:48.034104] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:48.091893] [DEBUG] [LOCAL ] MLM: Loaded 29649 existing records from primary storage. [2025-10-06T22:41:48.093412] [DEBUG] [LOCAL ] MKL: Loaded 34057 existing records from primary storage. [2025-10-06T22:41:48.093543] [INFO ] [MAIN ] MLM: Loaded 29649 primary data records. [2025-10-06T22:41:48.141528] [INFO ] [MAIN ] MKL: Loaded 34057 primary data records. [2025-10-06T22:41:48.214860] [DEBUG] [LOCAL ] MLI: Loaded 43512 existing records from primary storage. [2025-10-06T22:41:48.237116] [INFO ] [MAIN ] MLI: Loaded 43512 primary data records. [2025-10-06T22:41:49.137213] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:49.138541] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 29649 primary records. [2025-10-06T22:41:49.138876] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-06T22:41:49.159938] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-10-06T22:41:49.160162] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-06T22:41:49.162436] [INFO ] [MAIN ] Derivative Progress: 1174/2037 symbols completed. MLM took 1.1s. Estimated remaining: 5m 45s. Rate: 150.0 symbols/min [2025-10-06T22:41:49.162691] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:49.178237] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:49.181264] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43512 primary records. [2025-10-06T22:41:49.181629] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-06T22:41:49.196075] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:49.204589] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34057 primary records. [2025-10-06T22:41:49.212059] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-06T22:41:49.250082] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-10-06T22:41:49.249524] [DEBUG] [LOCAL ] MLNK: Loaded 25617 existing records from primary storage. [2025-10-06T22:41:49.250327] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-06T22:41:49.248903] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-10-06T22:41:49.254139] [INFO ] [MAIN ] MLNK: Loaded 25617 primary data records. [2025-10-06T22:41:49.259624] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-06T22:41:49.254009] [INFO ] [MAIN ] Derivative Progress: 1175/2037 symbols completed. MLI took 1.3s. Estimated remaining: 5m 45s. Rate: 150.1 symbols/min [2025-10-06T22:41:49.259849] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:49.269670] [INFO ] [MAIN ] Derivative Progress: 1176/2037 symbols completed. MKL took 1.3s. Estimated remaining: 5m 44s. Rate: 150.2 symbols/min [2025-10-06T22:41:49.279221] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:49.364039] [DEBUG] [LOCAL ] MLP: Loaded 2980 existing records from primary storage. [2025-10-06T22:41:49.367023] [INFO ] [MAIN ] MLP: Loaded 2980 primary data records. [2025-10-06T22:41:49.496438] [DEBUG] [LOCAL ] MLR: Loaded 12339 existing records from primary storage. [2025-10-06T22:41:49.515610] [INFO ] [MAIN ] MLR: Loaded 12339 primary data records. [2025-10-06T22:41:50.233221] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:50.234154] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 25617 primary records. [2025-10-06T22:41:50.234434] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-06T22:41:50.269815] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7830 incomplete bins [2025-10-06T22:41:50.272590] [INFO ] [MAIN ] MLP: Generated 1784 derivative records from 2980 primary records. [2025-10-06T22:41:50.272481] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-10-06T22:41:50.273062] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-06T22:41:50.273451] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-06T22:41:50.276879] [INFO ] [MAIN ] Derivative Progress: 1177/2037 symbols completed. MLNK took 1.1s. Estimated remaining: 5m 44s. Rate: 150.0 symbols/min [2025-10-06T22:41:50.277247] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:50.293458] [DEBUG] [LOCAL ] MLP: Derivative data saved (1784 records). [2025-10-06T22:41:50.295571] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-06T22:41:50.299361] [INFO ] [MAIN ] Derivative Progress: 1178/2037 symbols completed. MLP took 1.0s. Estimated remaining: 5m 43s. Rate: 150.1 symbols/min [2025-10-06T22:41:50.299741] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:50.315314] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:50.316444] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12339 primary records. [2025-10-06T22:41:50.316590] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-06T22:41:50.345943] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-10-06T22:41:50.346560] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-06T22:41:50.350328] [INFO ] [MAIN ] Derivative Progress: 1179/2037 symbols completed. MLR took 1.1s. Estimated remaining: 5m 43s. Rate: 150.2 symbols/min [2025-10-06T22:41:50.346307] [DEBUG] [LOCAL ] MMD: Loaded 11253 existing records from primary storage. [2025-10-06T22:41:50.350712] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:50.350882] [INFO ] [MAIN ] MMD: Loaded 11253 primary data records. [2025-10-06T22:41:50.521138] [DEBUG] [LOCAL ] MMI: Loaded 15201 existing records from primary storage. [2025-10-06T22:41:50.558555] [INFO ] [MAIN ] MMI: Loaded 15201 primary data records. [2025-10-06T22:41:50.696861] [DEBUG] [LOCAL ] MMC: Loaded 51842 existing records from primary storage. [2025-10-06T22:41:50.719004] [INFO ] [MAIN ] MMC: Loaded 51842 primary data records. [2025-10-06T22:41:51.410375] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:51.413408] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 11253 primary records. [2025-10-06T22:41:51.413843] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-06T22:41:51.432255] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-10-06T22:41:51.434060] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-06T22:41:51.437622] [INFO ] [MAIN ] Derivative Progress: 1180/2037 symbols completed. MMD took 1.1s. Estimated remaining: 5m 43s. Rate: 150.0 symbols/min [2025-10-06T22:41:51.438397] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:51.459593] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:51.461467] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15201 primary records. [2025-10-06T22:41:51.461692] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-06T22:41:51.493304] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-10-06T22:41:51.492666] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:51.493523] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-06T22:41:51.497680] [INFO ] [MAIN ] Derivative Progress: 1181/2037 symbols completed. MMI took 1.1s. Estimated remaining: 5m 42s. Rate: 150.1 symbols/min [2025-10-06T22:41:51.494440] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51842 primary records. [2025-10-06T22:41:51.497874] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-06T22:41:51.498685] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:51.536815] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-10-06T22:41:51.536972] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-06T22:41:51.541186] [INFO ] [MAIN ] Derivative Progress: 1182/2037 symbols completed. MMC took 1.3s. Estimated remaining: 5m 41s. Rate: 150.2 symbols/min [2025-10-06T22:41:51.541547] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:51.550008] [DEBUG] [LOCAL ] MMT: Loaded 10528 existing records from primary storage. [2025-10-06T22:41:51.551192] [INFO ] [MAIN ] MMT: Loaded 10528 primary data records. [2025-10-06T22:41:51.647564] [DEBUG] [LOCAL ] MMM: Loaded 53158 existing records from primary storage. [2025-10-06T22:41:51.677973] [INFO ] [MAIN ] MMM: Loaded 53158 primary data records. [2025-10-06T22:41:51.716845] [DEBUG] [LOCAL ] MMU: Loaded 16750 existing records from primary storage. [2025-10-06T22:41:51.727926] [INFO ] [MAIN ] MMU: Loaded 16750 primary data records. [2025-10-06T22:41:52.636479] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:52.638012] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10528 primary records. [2025-10-06T22:41:52.640452] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-06T22:41:52.672756] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:52.673869] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53158 primary records. [2025-10-06T22:41:52.674086] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-06T22:41:52.692824] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-10-06T22:41:52.691101] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:52.694414] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16750 primary records. [2025-10-06T22:41:52.701999] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-06T22:41:52.706289] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-06T22:41:52.712288] [INFO ] [MAIN ] Derivative Progress: 1183/2037 symbols completed. MMT took 1.2s. Estimated remaining: 5m 42s. Rate: 150.0 symbols/min [2025-10-06T22:41:52.715043] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-10-06T22:41:52.715696] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-06T22:41:52.719379] [INFO ] [MAIN ] Derivative Progress: 1184/2037 symbols completed. MMM took 1.3s. Estimated remaining: 5m 41s. Rate: 150.1 symbols/min [2025-10-06T22:41:52.734767] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-10-06T22:41:52.734874] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-06T22:41:52.738563] [INFO ] [MAIN ] Derivative Progress: 1185/2037 symbols completed. MMU took 1.2s. Estimated remaining: 5m 40s. Rate: 150.2 symbols/min [2025-10-06T22:41:52.739342] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:52.739475] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:52.740404] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:52.777976] [DEBUG] [LOCAL ] MNR: Loaded 24503 existing records from primary storage. [2025-10-06T22:41:52.791331] [INFO ] [MAIN ] MNR: Loaded 24503 primary data records. [2025-10-06T22:41:52.969405] [DEBUG] [LOCAL ] MNSO: Loaded 44353 existing records from primary storage. [2025-10-06T22:41:52.975349] [DEBUG] [LOCAL ] MOD: Loaded 45092 existing records from primary storage. [2025-10-06T22:41:53.025671] [INFO ] [MAIN ] MOD: Loaded 45092 primary data records. [2025-10-06T22:41:53.025497] [INFO ] [MAIN ] MNSO: Loaded 44353 primary data records. [2025-10-06T22:41:53.905601] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:53.908265] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24503 primary records. [2025-10-06T22:41:53.908489] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-06T22:41:53.930571] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-10-06T22:41:53.931131] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-06T22:41:53.934059] [INFO ] [MAIN ] Derivative Progress: 1186/2037 symbols completed. MNR took 1.2s. Estimated remaining: 5m 40s. Rate: 150.0 symbols/min [2025-10-06T22:41:53.934740] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:53.952985] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:53.955808] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 45092 primary records. [2025-10-06T22:41:53.956704] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-06T22:41:53.985930] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:53.989535] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44353 primary records. [2025-10-06T22:41:53.988592] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-10-06T22:41:53.989828] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-06T22:41:53.990521] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-06T22:41:53.994268] [INFO ] [MAIN ] Derivative Progress: 1187/2037 symbols completed. MOD took 1.3s. Estimated remaining: 5m 40s. Rate: 150.1 symbols/min [2025-10-06T22:41:53.994476] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:54.028242] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-10-06T22:41:54.028325] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-06T22:41:54.031937] [INFO ] [MAIN ] Derivative Progress: 1188/2037 symbols completed. MNSO took 1.3s. Estimated remaining: 5m 39s. Rate: 150.2 symbols/min [2025-10-06T22:41:54.032128] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:54.061698] [DEBUG] [LOCAL ] MODG: Loaded 51533 existing records from primary storage. [2025-10-06T22:41:54.062125] [INFO ] [MAIN ] MODG: Loaded 51533 primary data records. [2025-10-06T22:41:54.261051] [DEBUG] [LOCAL ] MOH: Loaded 41935 existing records from primary storage. [2025-10-06T22:41:54.311743] [INFO ] [MAIN ] MOH: Loaded 41935 primary data records. [2025-10-06T22:41:54.540057] [DEBUG] [LOCAL ] MOS: Loaded 53499 existing records from primary storage. [2025-10-06T22:41:54.552196] [INFO ] [MAIN ] MOS: Loaded 53499 primary data records. [2025-10-06T22:41:55.173682] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:55.175498] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51533 primary records. [2025-10-06T22:41:55.175632] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-06T22:41:55.196528] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-10-06T22:41:55.196722] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-06T22:41:55.200089] [INFO ] [MAIN ] Derivative Progress: 1189/2037 symbols completed. MODG took 1.3s. Estimated remaining: 5m 39s. Rate: 150.0 symbols/min [2025-10-06T22:41:55.201418] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:55.217443] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:55.219349] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 41935 primary records. [2025-10-06T22:41:55.220436] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-06T22:41:55.251132] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:55.258293] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-10-06T22:41:55.259320] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53499 primary records. [2025-10-06T22:41:55.259576] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-06T22:41:55.259504] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-06T22:41:55.262886] [INFO ] [MAIN ] Derivative Progress: 1190/2037 symbols completed. MOH took 1.3s. Estimated remaining: 5m 39s. Rate: 150.1 symbols/min [2025-10-06T22:41:55.263606] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:55.287974] [DEBUG] [LOCAL ] MOV: Loaded 21809 existing records from primary storage. [2025-10-06T22:41:55.288298] [INFO ] [MAIN ] MOV: Loaded 21809 primary data records. [2025-10-06T22:41:55.395361] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-10-06T22:41:55.406511] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-06T22:41:55.447979] [INFO ] [MAIN ] Derivative Progress: 1191/2037 symbols completed. MOS took 1.4s. Estimated remaining: 5m 38s. Rate: 150.2 symbols/min [2025-10-06T22:41:55.493073] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:55.652564] [DEBUG] [LOCAL ] MP: Loaded 53686 existing records from primary storage. [2025-10-06T22:41:55.654984] [INFO ] [MAIN ] MP: Loaded 53686 primary data records. [2025-10-06T22:41:55.697018] [DEBUG] [LOCAL ] MPA: Loaded 5336 existing records from primary storage. [2025-10-06T22:41:55.705118] [INFO ] [MAIN ] MPA: Loaded 5336 primary data records. [2025-10-06T22:41:56.299117] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:56.301395] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 21809 primary records. [2025-10-06T22:41:56.301606] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-06T22:41:56.324316] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-10-06T22:41:56.324469] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-06T22:41:56.328248] [INFO ] [MAIN ] Derivative Progress: 1192/2037 symbols completed. MOV took 1.1s. Estimated remaining: 5m 38s. Rate: 150.0 symbols/min [2025-10-06T22:41:56.329092] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:56.350029] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:56.351144] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53686 primary records. [2025-10-06T22:41:56.351327] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-06T22:41:56.366973] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:56.368189] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5336 primary records. [2025-10-06T22:41:56.375743] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-06T22:41:56.392601] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-10-06T22:41:56.396880] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-06T22:41:56.400155] [INFO ] [MAIN ] Derivative Progress: 1193/2037 symbols completed. MP took 1.1s. Estimated remaining: 5m 37s. Rate: 150.1 symbols/min [2025-10-06T22:41:56.400385] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:56.418955] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-10-06T22:41:56.420568] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-06T22:41:56.423975] [INFO ] [MAIN ] Derivative Progress: 1194/2037 symbols completed. MPA took 0.9s. Estimated remaining: 5m 37s. Rate: 150.2 symbols/min [2025-10-06T22:41:56.424197] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:56.428756] [DEBUG] [LOCAL ] MPV: Loaded 4901 existing records from primary storage. [2025-10-06T22:41:56.429714] [INFO ] [MAIN ] MPV: Loaded 4901 primary data records. [2025-10-06T22:41:56.526974] [DEBUG] [LOCAL ] MPLX: Loaded 50717 existing records from primary storage. [2025-10-06T22:41:56.548390] [INFO ] [MAIN ] MPLX: Loaded 50717 primary data records. [2025-10-06T22:41:57.082432] [DEBUG] [LOCAL ] MPW: Loaded 53493 existing records from primary storage. [2025-10-06T22:41:57.084214] [INFO ] [MAIN ] MPW: Loaded 53493 primary data records. [2025-10-06T22:41:57.314000] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:57.315053] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 4901 primary records. [2025-10-06T22:41:57.315193] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-06T22:41:57.542515] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-10-06T22:41:57.543078] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-06T22:41:57.545835] [INFO ] [MAIN ] Derivative Progress: 1195/2037 symbols completed. MPV took 1.1s. Estimated remaining: 5m 37s. Rate: 150.0 symbols/min [2025-10-06T22:41:57.546477] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:57.559739] [DEBUG] [LOCAL ] MPX: Loaded 4038 existing records from primary storage. [2025-10-06T22:41:57.560174] [INFO ] [MAIN ] MPX: Loaded 4038 primary data records. [2025-10-06T22:41:57.604826] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:57.618009] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50717 primary records. [2025-10-06T22:41:57.618112] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-06T22:41:57.908663] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:57.911179] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53493 primary records. [2025-10-06T22:41:57.911379] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-06T22:41:57.912268] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-10-06T22:41:57.914041] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-06T22:41:57.921105] [INFO ] [MAIN ] Derivative Progress: 1196/2037 symbols completed. MPLX took 1.6s. Estimated remaining: 5m 36s. Rate: 150.0 symbols/min [2025-10-06T22:41:57.933967] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:57.938316] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-10-06T22:41:57.938568] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-06T22:41:57.942479] [INFO ] [MAIN ] Derivative Progress: 1197/2037 symbols completed. MPW took 1.5s. Estimated remaining: 5m 36s. Rate: 150.1 symbols/min [2025-10-06T22:41:57.942818] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:57.955037] [DEBUG] [LOCAL ] MQT: Loaded 8681 existing records from primary storage. [2025-10-06T22:41:57.955315] [INFO ] [MAIN ] MQT: Loaded 8681 primary data records. [2025-10-06T22:41:58.062420] [DEBUG] [LOCAL ] MQY: Loaded 16950 existing records from primary storage. [2025-10-06T22:41:58.077872] [INFO ] [MAIN ] MQY: Loaded 16950 primary data records. [2025-10-06T22:41:58.142613] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:58.165675] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 4038 primary records. [2025-10-06T22:41:58.182391] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-06T22:41:58.632720] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-10-06T22:41:58.635555] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-06T22:41:58.638911] [INFO ] [MAIN ] Derivative Progress: 1198/2037 symbols completed. MPX took 1.1s. Estimated remaining: 5m 36s. Rate: 150.0 symbols/min [2025-10-06T22:41:58.666917] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:58.679322] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:58.680030] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8681 primary records. [2025-10-06T22:41:58.680679] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16950 primary records. [2025-10-06T22:41:58.680847] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-06T22:41:58.680791] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-06T22:41:58.709379] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-10-06T22:41:58.709901] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-10-06T22:41:58.713346] [INFO ] [MAIN ] Derivative Progress: 1199/2037 symbols completed. MQY took 0.8s. Estimated remaining: 5m 35s. Rate: 150.1 symbols/min [2025-10-06T22:41:58.714889] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-10-06T22:41:58.714953] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-06T22:41:58.718137] [INFO ] [MAIN ] Derivative Progress: 1200/2037 symbols completed. MQT took 0.8s. Estimated remaining: 5m 34s. Rate: 150.3 symbols/min [2025-10-06T22:41:58.719338] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:58.719128] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:58.719272] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:58.733233] [DEBUG] [LOCAL ] MSB: Loaded 7857 existing records from primary storage. [2025-10-06T22:41:58.733418] [INFO ] [MAIN ] MSB: Loaded 7857 primary data records. [2025-10-06T22:41:58.872737] [DEBUG] [LOCAL ] MSA: Loaded 18886 existing records from primary storage. [2025-10-06T22:41:58.879135] [INFO ] [MAIN ] MSA: Loaded 18886 primary data records. [2025-10-06T22:41:59.214092] [DEBUG] [LOCAL ] MRC: Loaded 37156 existing records from primary storage. [2025-10-06T22:41:59.226404] [INFO ] [MAIN ] MRC: Loaded 37156 primary data records. [2025-10-06T22:41:59.834598] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:59.836137] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7857 primary records. [2025-10-06T22:41:59.836274] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-06T22:41:59.872758] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:59.874231] [INFO ] [MAIN ] MSA: Generated 1794 derivative records from 18886 primary records. [2025-10-06T22:41:59.876752] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-10-06T22:41:59.879808] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-10-06T22:41:59.887693] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-06T22:41:59.890915] [INFO ] [MAIN ] Derivative Progress: 1201/2037 symbols completed. MSB took 1.2s. Estimated remaining: 5m 34s. Rate: 150.0 symbols/min [2025-10-06T22:41:59.899106] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:59.911386] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:41:59.914389] [INFO ] [MAIN ] MRC: Generated 1794 derivative records from 37156 primary records. [2025-10-06T22:41:59.914820] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-10-06T22:41:59.916871] [DEBUG] [LOCAL ] MSA: Derivative data saved (1794 records). [2025-10-06T22:41:59.917171] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-10-06T22:41:59.921109] [INFO ] [MAIN ] Derivative Progress: 1202/2037 symbols completed. MSA took 1.2s. Estimated remaining: 5m 34s. Rate: 150.1 symbols/min [2025-10-06T22:41:59.921698] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:59.940077] [DEBUG] [LOCAL ] MRC: Derivative data saved (1794 records). [2025-10-06T22:41:59.940320] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-10-06T22:41:59.943862] [INFO ] [MAIN ] Derivative Progress: 1203/2037 symbols completed. MRC took 1.2s. Estimated remaining: 5m 33s. Rate: 150.2 symbols/min [2025-10-06T22:41:59.944245] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:41:59.982801] [DEBUG] [LOCAL ] MSGE: Loaded 26923 existing records from primary storage. [2025-10-06T22:41:59.982997] [INFO ] [MAIN ] MSGE: Loaded 26923 primary data records. [2025-10-06T22:42:00.075826] [DEBUG] [LOCAL ] MSGS: Loaded 17394 existing records from primary storage. [2025-10-06T22:42:00.087661] [INFO ] [MAIN ] MSGS: Loaded 17394 primary data records. [2025-10-06T22:42:00.099089] [DEBUG] [LOCAL ] MSDL: Loaded 38321 existing records from primary storage. [2025-10-06T22:42:00.110210] [INFO ] [MAIN ] MSDL: Loaded 38321 primary data records. [2025-10-06T22:42:01.033754] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:01.036630] [INFO ] [MAIN ] MSGE: Generated 1794 derivative records from 26923 primary records. [2025-10-06T22:42:01.037012] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-10-06T22:42:01.074186] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:01.076694] [INFO ] [MAIN ] MSGS: Generated 1794 derivative records from 17394 primary records. [2025-10-06T22:42:01.074338] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1794 records). [2025-10-06T22:42:01.078788] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-10-06T22:42:01.078686] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-10-06T22:42:01.081878] [INFO ] [MAIN ] Derivative Progress: 1204/2037 symbols completed. MSGE took 1.2s. Estimated remaining: 5m 33s. Rate: 150.0 symbols/min [2025-10-06T22:42:01.083265] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:01.110822] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:01.114512] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1794 records). [2025-10-06T22:42:01.115597] [INFO ] [MAIN ] MSDL: Generated 1794 derivative records from 38321 primary records. [2025-10-06T22:42:01.114746] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-10-06T22:42:01.116045] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-10-06T22:42:01.119559] [INFO ] [MAIN ] Derivative Progress: 1205/2037 symbols completed. MSGS took 1.2s. Estimated remaining: 5m 33s. Rate: 150.1 symbols/min [2025-10-06T22:42:01.120803] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:01.138816] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1794 records). [2025-10-06T22:42:01.139023] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-10-06T22:42:01.142694] [INFO ] [MAIN ] Derivative Progress: 1206/2037 symbols completed. MSDL took 1.2s. Estimated remaining: 5m 32s. Rate: 150.2 symbols/min [2025-10-06T22:42:01.142971] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:01.172800] [DEBUG] [LOCAL ] MSM: Loaded 35586 existing records from primary storage. [2025-10-06T22:42:01.173287] [INFO ] [MAIN ] MSM: Loaded 35586 primary data records. [2025-10-06T22:42:01.353633] [DEBUG] [LOCAL ] MTAL: Loaded 36676 existing records from primary storage. [2025-10-06T22:42:01.398191] [INFO ] [MAIN ] MTAL: Loaded 36676 primary data records. [2025-10-06T22:42:01.549279] [DEBUG] [LOCAL ] MT: Loaded 50558 existing records from primary storage. [2025-10-06T22:42:01.561291] [INFO ] [MAIN ] MT: Loaded 50558 primary data records. [2025-10-06T22:42:02.286826] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:02.288940] [INFO ] [MAIN ] MSM: Generated 1794 derivative records from 35586 primary records. [2025-10-06T22:42:02.289786] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-10-06T22:42:02.309874] [DEBUG] [LOCAL ] MSM: Derivative data saved (1794 records). [2025-10-06T22:42:02.310808] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-10-06T22:42:02.314168] [INFO ] [MAIN ] Derivative Progress: 1207/2037 symbols completed. MSM took 1.2s. Estimated remaining: 5m 32s. Rate: 150.0 symbols/min [2025-10-06T22:42:02.314602] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:02.340441] [DEBUG] [MAIN ] MTAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:02.341724] [INFO ] [MAIN ] MTAL: Generated 1794 derivative records from 36676 primary records. [2025-10-06T22:42:02.350749] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-10-06T22:42:02.357566] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:02.366172] [INFO ] [MAIN ] MT: Generated 1794 derivative records from 50558 primary records. [2025-10-06T22:42:02.370794] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-10-06T22:42:02.376195] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1794 records). [2025-10-06T22:42:02.376790] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-10-06T22:42:02.389043] [INFO ] [MAIN ] Derivative Progress: 1208/2037 symbols completed. MTAL took 1.2s. Estimated remaining: 5m 31s. Rate: 150.1 symbols/min [2025-10-06T22:42:02.394719] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:02.399018] [DEBUG] [LOCAL ] MT: Derivative data saved (1794 records). [2025-10-06T22:42:02.417222] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-10-06T22:42:02.421714] [INFO ] [MAIN ] Derivative Progress: 1209/2037 symbols completed. MT took 1.3s. Estimated remaining: 5m 31s. Rate: 150.2 symbols/min [2025-10-06T22:42:02.422130] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:02.450535] [DEBUG] [LOCAL ] MTDR: Loaded 51594 existing records from primary storage. [2025-10-06T22:42:02.450895] [INFO ] [MAIN ] MTDR: Loaded 51594 primary data records. [2025-10-06T22:42:02.714607] [DEBUG] [LOCAL ] MTG: Loaded 51229 existing records from primary storage. [2025-10-06T22:42:02.830806] [INFO ] [MAIN ] MTG: Loaded 51229 primary data records. [2025-10-06T22:42:02.877707] [DEBUG] [LOCAL ] MTH: Loaded 43591 existing records from primary storage. [2025-10-06T22:42:02.894249] [INFO ] [MAIN ] MTH: Loaded 43591 primary data records. [2025-10-06T22:42:03.505612] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:03.509170] [INFO ] [MAIN ] MTDR: Generated 1794 derivative records from 51594 primary records. [2025-10-06T22:42:03.509424] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-10-06T22:42:03.530225] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1794 records). [2025-10-06T22:42:03.530628] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-10-06T22:42:03.533395] [INFO ] [MAIN ] Derivative Progress: 1210/2037 symbols completed. MTDR took 1.2s. Estimated remaining: 5m 31s. Rate: 150.0 symbols/min [2025-10-06T22:42:03.533772] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:03.552776] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:03.555733] [INFO ] [MAIN ] MTG: Generated 1794 derivative records from 51229 primary records. [2025-10-06T22:42:03.556017] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-10-06T22:42:03.579814] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:03.583319] [INFO ] [MAIN ] MTH: Generated 1794 derivative records from 43591 primary records. [2025-10-06T22:42:03.584283] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-10-06T22:42:03.602744] [DEBUG] [LOCAL ] MTG: Derivative data saved (1794 records). [2025-10-06T22:42:03.603914] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-10-06T22:42:03.615956] [INFO ] [MAIN ] Derivative Progress: 1211/2037 symbols completed. MTG took 1.2s. Estimated remaining: 5m 30s. Rate: 150.1 symbols/min [2025-10-06T22:42:03.617112] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:03.618070] [DEBUG] [LOCAL ] MTH: Derivative data saved (1794 records). [2025-10-06T22:42:03.618462] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-10-06T22:42:03.622160] [INFO ] [MAIN ] Derivative Progress: 1212/2037 symbols completed. MTH took 1.2s. Estimated remaining: 5m 30s. Rate: 150.2 symbols/min [2025-10-06T22:42:03.622778] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:03.637275] [DEBUG] [LOCAL ] MTN: Loaded 39160 existing records from primary storage. [2025-10-06T22:42:03.637618] [INFO ] [MAIN ] MTN: Loaded 39160 primary data records. [2025-10-06T22:42:03.758868] [DEBUG] [LOCAL ] MTRN: Loaded 18041 existing records from primary storage. [2025-10-06T22:42:03.789606] [INFO ] [MAIN ] MTRN: Loaded 18041 primary data records. [2025-10-06T22:42:03.943970] [DEBUG] [LOCAL ] MTUS: Loaded 28073 existing records from primary storage. [2025-10-06T22:42:04.091386] [INFO ] [MAIN ] MTUS: Loaded 28073 primary data records. [2025-10-06T22:42:04.732740] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:04.735567] [INFO ] [MAIN ] MTN: Generated 1794 derivative records from 39160 primary records. [2025-10-06T22:42:04.735959] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-10-06T22:42:04.756623] [DEBUG] [LOCAL ] MTN: Derivative data saved (1794 records). [2025-10-06T22:42:04.764994] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-10-06T22:42:04.773528] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:04.773119] [INFO ] [MAIN ] Derivative Progress: 1213/2037 symbols completed. MTN took 1.2s. Estimated remaining: 5m 30s. Rate: 150.0 symbols/min [2025-10-06T22:42:04.774482] [INFO ] [MAIN ] MTRN: Generated 1794 derivative records from 18041 primary records. [2025-10-06T22:42:04.774947] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-10-06T22:42:04.793843] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1794 records). [2025-10-06T22:42:04.806349] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-10-06T22:42:04.809952] [INFO ] [MAIN ] Derivative Progress: 1214/2037 symbols completed. MTRN took 1.2s. Estimated remaining: 5m 29s. Rate: 150.1 symbols/min [2025-10-06T22:42:04.810367] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:04.811428] [INFO ] [MAIN ] MTUS: Generated 1794 derivative records from 28073 primary records. [2025-10-06T22:42:04.811633] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-10-06T22:42:04.827328] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1794 records). [2025-10-06T22:42:04.827392] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-10-06T22:42:04.830906] [INFO ] [MAIN ] Derivative Progress: 1215/2037 symbols completed. MTUS took 1.2s. Estimated remaining: 5m 28s. Rate: 150.2 symbols/min [2025-10-06T22:42:04.831564] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:04.831528] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:04.831471] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:04.862557] [DEBUG] [LOCAL ] MTX: Loaded 22651 existing records from primary storage. [2025-10-06T22:42:04.862794] [INFO ] [MAIN ] MTX: Loaded 22651 primary data records. [2025-10-06T22:42:04.951685] [DEBUG] [LOCAL ] MTW: Loaded 26466 existing records from primary storage. [2025-10-06T22:42:04.986988] [INFO ] [MAIN ] MTW: Loaded 26466 primary data records. [2025-10-06T22:42:05.301332] [DEBUG] [LOCAL ] MTZ: Loaded 43058 existing records from primary storage. [2025-10-06T22:42:05.305307] [INFO ] [MAIN ] MTZ: Loaded 43058 primary data records. [2025-10-06T22:42:05.911455] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:05.915116] [INFO ] [MAIN ] MTX: Generated 1794 derivative records from 22651 primary records. [2025-10-06T22:42:05.915308] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-10-06T22:42:05.929670] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:05.942742] [INFO ] [MAIN ] MTW: Generated 1794 derivative records from 26466 primary records. [2025-10-06T22:42:05.944055] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-10-06T22:42:05.947602] [DEBUG] [LOCAL ] MTX: Derivative data saved (1794 records). [2025-10-06T22:42:05.949182] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-10-06T22:42:05.951873] [INFO ] [MAIN ] Derivative Progress: 1216/2037 symbols completed. MTX took 1.1s. Estimated remaining: 5m 28s. Rate: 150.0 symbols/min [2025-10-06T22:42:05.952804] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:05.970108] [DEBUG] [LOCAL ] MTW: Derivative data saved (1794 records). [2025-10-06T22:42:05.970336] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-10-06T22:42:05.973606] [INFO ] [MAIN ] Derivative Progress: 1217/2037 symbols completed. MTW took 1.1s. Estimated remaining: 5m 28s. Rate: 150.1 symbols/min [2025-10-06T22:42:05.976306] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:05.995404] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:05.996309] [INFO ] [MAIN ] MTZ: Generated 1794 derivative records from 43058 primary records. [2025-10-06T22:42:05.996466] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-10-06T22:42:06.003230] [DEBUG] [LOCAL ] MUA: Loaded 11964 existing records from primary storage. [2025-10-06T22:42:06.015281] [INFO ] [MAIN ] MUA: Loaded 11964 primary data records. [2025-10-06T22:42:06.020005] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1794 records). [2025-10-06T22:42:06.057889] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-10-06T22:42:06.113120] [INFO ] [MAIN ] Derivative Progress: 1218/2037 symbols completed. MTZ took 1.3s. Estimated remaining: 5m 27s. Rate: 150.2 symbols/min [2025-10-06T22:42:06.147786] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:06.148453] [DEBUG] [LOCAL ] MUC: Loaded 20520 existing records from primary storage. [2025-10-06T22:42:06.149891] [INFO ] [MAIN ] MUC: Loaded 20520 primary data records. [2025-10-06T22:42:06.461240] [DEBUG] [LOCAL ] MUE: Loaded 11982 existing records from primary storage. [2025-10-06T22:42:06.465569] [INFO ] [MAIN ] MUE: Loaded 11982 primary data records. [2025-10-06T22:42:07.049585] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:07.050901] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 11964 primary records. [2025-10-06T22:42:07.052251] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-06T22:42:07.081702] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:07.089358] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-10-06T22:42:07.088698] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20520 primary records. [2025-10-06T22:42:07.089749] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-06T22:42:07.089871] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-06T22:42:07.094799] [INFO ] [MAIN ] Derivative Progress: 1219/2037 symbols completed. MUA took 1.1s. Estimated remaining: 5m 27s. Rate: 150.0 symbols/min [2025-10-06T22:42:07.095831] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:07.117139] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-10-06T22:42:07.117517] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-10-06T22:42:07.121467] [INFO ] [MAIN ] Derivative Progress: 1220/2037 symbols completed. MUC took 1.1s. Estimated remaining: 5m 27s. Rate: 150.1 symbols/min [2025-10-06T22:42:07.135349] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:07.136873] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:07.137820] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11982 primary records. [2025-10-06T22:42:07.138144] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-06T22:42:07.160408] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-10-06T22:42:07.160773] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-06T22:42:07.164149] [INFO ] [MAIN ] Derivative Progress: 1221/2037 symbols completed. MUE took 1.0s. Estimated remaining: 5m 26s. Rate: 150.2 symbols/min [2025-10-06T22:42:07.164518] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:07.172695] [DEBUG] [LOCAL ] MUJ: Loaded 13605 existing records from primary storage. [2025-10-06T22:42:07.173145] [INFO ] [MAIN ] MUJ: Loaded 13605 primary data records. [2025-10-06T22:42:07.345934] [DEBUG] [LOCAL ] MUFG: Loaded 52522 existing records from primary storage. [2025-10-06T22:42:07.382301] [INFO ] [MAIN ] MUFG: Loaded 52522 primary data records. [2025-10-06T22:42:07.774325] [DEBUG] [LOCAL ] MUR: Loaded 52925 existing records from primary storage. [2025-10-06T22:42:07.779525] [INFO ] [MAIN ] MUR: Loaded 52925 primary data records. [2025-10-06T22:42:08.300698] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:08.302758] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13605 primary records. [2025-10-06T22:42:08.303066] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-06T22:42:08.324713] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-10-06T22:42:08.325240] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-10-06T22:42:08.328557] [INFO ] [MAIN ] Derivative Progress: 1222/2037 symbols completed. MUJ took 1.2s. Estimated remaining: 5m 26s. Rate: 150.0 symbols/min [2025-10-06T22:42:08.343474] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:08.344184] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:08.346061] [INFO ] [MAIN ] MUFG: Generated 1794 derivative records from 52522 primary records. [2025-10-06T22:42:08.346326] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-10-06T22:42:08.367418] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1794 records). [2025-10-06T22:42:08.367781] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-10-06T22:42:08.378927] [INFO ] [MAIN ] Derivative Progress: 1223/2037 symbols completed. MUFG took 1.3s. Estimated remaining: 5m 25s. Rate: 150.1 symbols/min [2025-10-06T22:42:08.379216] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:08.394476] [DEBUG] [LOCAL ] MUSA: Loaded 24719 existing records from primary storage. [2025-10-06T22:42:08.403139] [INFO ] [MAIN ] MUSA: Loaded 24719 primary data records. [2025-10-06T22:42:08.408857] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:08.422940] [INFO ] [MAIN ] MUR: Generated 1794 derivative records from 52925 primary records. [2025-10-06T22:42:08.463291] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-10-06T22:42:08.643539] [DEBUG] [LOCAL ] MUX: Loaded 42939 existing records from primary storage. [2025-10-06T22:42:08.654930] [INFO ] [MAIN ] MUX: Loaded 42939 primary data records. [2025-10-06T22:42:08.673852] [DEBUG] [LOCAL ] MUR: Derivative data saved (1794 records). [2025-10-06T22:42:08.756131] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-10-06T22:42:08.862828] [INFO ] [MAIN ] Derivative Progress: 1224/2037 symbols completed. MUR took 1.7s. Estimated remaining: 5m 25s. Rate: 150.1 symbols/min [2025-10-06T22:42:08.885979] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:09.013519] [DEBUG] [LOCAL ] MVF: Loaded 13103 existing records from primary storage. [2025-10-06T22:42:09.033277] [INFO ] [MAIN ] MVF: Loaded 13103 primary data records. [2025-10-06T22:42:09.558815] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:09.579937] [INFO ] [MAIN ] MUSA: Generated 1794 derivative records from 24719 primary records. [2025-10-06T22:42:09.580288] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-10-06T22:42:09.600363] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1794 records). [2025-10-06T22:42:09.601193] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-10-06T22:42:09.604381] [INFO ] [MAIN ] Derivative Progress: 1225/2037 symbols completed. MUSA took 1.3s. Estimated remaining: 5m 25s. Rate: 150.0 symbols/min [2025-10-06T22:42:09.605172] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:09.634790] [DEBUG] [LOCAL ] MVO: Loaded 8813 existing records from primary storage. [2025-10-06T22:42:09.634497] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:09.635287] [INFO ] [MAIN ] MVO: Loaded 8813 primary data records. [2025-10-06T22:42:09.636156] [INFO ] [MAIN ] MUX: Generated 1794 derivative records from 42939 primary records. [2025-10-06T22:42:09.636360] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-10-06T22:42:09.709519] [DEBUG] [LOCAL ] MUX: Derivative data saved (1794 records). [2025-10-06T22:42:09.727147] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-10-06T22:42:09.740131] [INFO ] [MAIN ] Derivative Progress: 1226/2037 symbols completed. MUX took 1.4s. Estimated remaining: 5m 24s. Rate: 150.1 symbols/min [2025-10-06T22:42:09.768799] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:09.820179] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:09.858152] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 13103 primary records. [2025-10-06T22:42:09.886447] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-06T22:42:10.033288] [DEBUG] [LOCAL ] MVT: Loaded 10263 existing records from primary storage. [2025-10-06T22:42:10.033558] [INFO ] [MAIN ] MVT: Loaded 10263 primary data records. [2025-10-06T22:42:10.144226] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-10-06T22:42:10.168362] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-06T22:42:10.185452] [INFO ] [MAIN ] Derivative Progress: 1227/2037 symbols completed. MVF took 1.3s. Estimated remaining: 5m 24s. Rate: 150.0 symbols/min [2025-10-06T22:42:10.198604] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:10.494273] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:10.496119] [INFO ] [MAIN ] MVO: Generated 1794 derivative records from 8813 primary records. [2025-10-06T22:42:10.496299] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-06T22:42:10.526587] [DEBUG] [LOCAL ] MVO: Derivative data saved (1794 records). [2025-10-06T22:42:10.527346] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-06T22:42:10.530885] [INFO ] [MAIN ] Derivative Progress: 1228/2037 symbols completed. MVO took 0.9s. Estimated remaining: 5m 23s. Rate: 150.1 symbols/min [2025-10-06T22:42:10.564612] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:10.565541] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10263 primary records. [2025-10-06T22:42:10.565676] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-06T22:42:10.566930] [DEBUG] [LOCAL ] MWA: Loaded 46357 existing records from primary storage. [2025-10-06T22:42:10.567872] [INFO ] [MAIN ] MWA: Loaded 46357 primary data records. [2025-10-06T22:42:10.668300] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-10-06T22:42:10.688136] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-06T22:42:10.694605] [INFO ] [MAIN ] Derivative Progress: 1229/2037 symbols completed. MVT took 0.9s. Estimated remaining: 5m 23s. Rate: 150.1 symbols/min [2025-10-06T22:42:10.918318] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:10.919515] [INFO ] [MAIN ] MWA: Generated 1794 derivative records from 46357 primary records. [2025-10-06T22:42:10.919583] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-10-06T22:42:10.937449] [DEBUG] [LOCAL ] MWA: Derivative data saved (1794 records). [2025-10-06T22:42:10.937592] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-10-06T22:42:10.940477] [INFO ] [MAIN ] Derivative Progress: 1230/2037 symbols completed. MWA took 0.7s. Estimated remaining: 5m 22s. Rate: 150.2 symbols/min [2025-10-06T22:42:10.941048] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:10.941149] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:10.941212] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:10.957825] [DEBUG] [LOCAL ] MXF: Loaded 5678 existing records from primary storage. [2025-10-06T22:42:10.958036] [INFO ] [MAIN ] MXF: Loaded 5678 primary data records. [2025-10-06T22:42:11.025264] [DEBUG] [LOCAL ] MYD: Loaded 13443 existing records from primary storage. [2025-10-06T22:42:11.049688] [INFO ] [MAIN ] MYD: Loaded 13443 primary data records. [2025-10-06T22:42:11.209682] [DEBUG] [LOCAL ] MX: Loaded 22461 existing records from primary storage. [2025-10-06T22:42:11.291214] [INFO ] [MAIN ] MX: Loaded 22461 primary data records. [2025-10-06T22:42:12.008557] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:12.011107] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 5678 primary records. [2025-10-06T22:42:12.012909] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-06T22:42:12.030907] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-10-06T22:42:12.039340] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-06T22:42:12.042523] [INFO ] [MAIN ] Derivative Progress: 1231/2037 symbols completed. MXF took 1.1s. Estimated remaining: 5m 22s. Rate: 150.0 symbols/min [2025-10-06T22:42:12.048184] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:12.049432] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:12.051087] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13443 primary records. [2025-10-06T22:42:12.053390] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-06T22:42:12.076180] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:12.086791] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-10-06T22:42:12.085038] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 22461 primary records. [2025-10-06T22:42:12.087054] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-10-06T22:42:12.093937] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-06T22:42:12.097677] [INFO ] [MAIN ] Derivative Progress: 1232/2037 symbols completed. MYD took 1.2s. Estimated remaining: 5m 22s. Rate: 150.1 symbols/min [2025-10-06T22:42:12.099576] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:12.116005] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-10-06T22:42:12.116813] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-06T22:42:12.129517] [INFO ] [MAIN ] Derivative Progress: 1233/2037 symbols completed. MX took 1.2s. Estimated remaining: 5m 21s. Rate: 150.2 symbols/min [2025-10-06T22:42:12.130935] [DEBUG] [LOCAL ] MYE: Loaded 24450 existing records from primary storage. [2025-10-06T22:42:12.129933] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:12.131690] [INFO ] [MAIN ] MYE: Loaded 24450 primary data records. [2025-10-06T22:42:12.259067] [DEBUG] [LOCAL ] MYI: Loaded 19192 existing records from primary storage. [2025-10-06T22:42:12.280328] [INFO ] [MAIN ] MYI: Loaded 19192 primary data records. [2025-10-06T22:42:12.380424] [DEBUG] [LOCAL ] MYN: Loaded 9928 existing records from primary storage. [2025-10-06T22:42:12.417882] [INFO ] [MAIN ] MYN: Loaded 9928 primary data records. [2025-10-06T22:42:13.207333] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:13.209142] [INFO ] [MAIN ] MYE: Generated 1794 derivative records from 24450 primary records. [2025-10-06T22:42:13.209463] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-10-06T22:42:13.232222] [DEBUG] [LOCAL ] MYE: Derivative data saved (1794 records). [2025-10-06T22:42:13.246573] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:13.246773] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-10-06T22:42:13.250163] [INFO ] [MAIN ] Derivative Progress: 1234/2037 symbols completed. MYE took 1.2s. Estimated remaining: 5m 21s. Rate: 150.0 symbols/min [2025-10-06T22:42:13.251313] [INFO ] [MAIN ] MYI: Generated 1794 derivative records from 19192 primary records. [2025-10-06T22:42:13.251586] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-06T22:42:13.251846] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:13.279383] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:13.285397] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 9928 primary records. [2025-10-06T22:42:13.289492] [DEBUG] [LOCAL ] MYI: Derivative data saved (1794 records). [2025-10-06T22:42:13.289906] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-10-06T22:42:13.289616] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-06T22:42:13.293857] [INFO ] [MAIN ] Derivative Progress: 1235/2037 symbols completed. MYI took 1.2s. Estimated remaining: 5m 21s. Rate: 150.1 symbols/min [2025-10-06T22:42:13.295329] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:13.312400] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-10-06T22:42:13.312561] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-06T22:42:13.316438] [INFO ] [MAIN ] Derivative Progress: 1236/2037 symbols completed. MYN took 1.2s. Estimated remaining: 5m 20s. Rate: 150.2 symbols/min [2025-10-06T22:42:13.316784] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:13.363441] [DEBUG] [LOCAL ] NABL: Loaded 39223 existing records from primary storage. [2025-10-06T22:42:13.363793] [INFO ] [MAIN ] NABL: Loaded 39223 primary data records. [2025-10-06T22:42:13.364312] [DEBUG] [LOCAL ] NAC: Loaded 24781 existing records from primary storage. [2025-10-06T22:42:13.364695] [INFO ] [MAIN ] NAC: Loaded 24781 primary data records. [2025-10-06T22:42:13.641856] [DEBUG] [LOCAL ] NAD: Loaded 33873 existing records from primary storage. [2025-10-06T22:42:13.721911] [INFO ] [MAIN ] NAD: Loaded 33873 primary data records. [2025-10-06T22:42:14.460258] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:14.474936] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:14.475901] [INFO ] [MAIN ] NABL: Generated 1794 derivative records from 39223 primary records. [2025-10-06T22:42:14.477136] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24781 primary records. [2025-10-06T22:42:14.477249] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-06T22:42:14.477446] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-10-06T22:42:14.513109] [DEBUG] [LOCAL ] NABL: Derivative data saved (1794 records). [2025-10-06T22:42:14.515940] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-10-06T22:42:14.520523] [INFO ] [MAIN ] Derivative Progress: 1237/2037 symbols completed. NABL took 1.3s. Estimated remaining: 5m 20s. Rate: 149.9 symbols/min [2025-10-06T22:42:14.521639] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:14.523154] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-10-06T22:42:14.523573] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-10-06T22:42:14.534210] [INFO ] [MAIN ] Derivative Progress: 1238/2037 symbols completed. NAC took 1.2s. Estimated remaining: 5m 19s. Rate: 150.1 symbols/min [2025-10-06T22:42:14.540578] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:14.541819] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:14.543257] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 33873 primary records. [2025-10-06T22:42:14.547305] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-06T22:42:14.570974] [DEBUG] [LOCAL ] NAN: Loaded 8534 existing records from primary storage. [2025-10-06T22:42:14.571125] [INFO ] [MAIN ] NAN: Loaded 8534 primary data records. [2025-10-06T22:42:14.570459] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-10-06T22:42:14.571380] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-10-06T22:42:14.574908] [INFO ] [MAIN ] Derivative Progress: 1239/2037 symbols completed. NAD took 1.3s. Estimated remaining: 5m 19s. Rate: 150.2 symbols/min [2025-10-06T22:42:14.575185] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:14.811624] [DEBUG] [LOCAL ] NAT: Loaded 49148 existing records from primary storage. [2025-10-06T22:42:14.812749] [INFO ] [MAIN ] NAT: Loaded 49148 primary data records. [2025-10-06T22:42:14.923835] [DEBUG] [LOCAL ] NATL: Loaded 32488 existing records from primary storage. [2025-10-06T22:42:14.924229] [INFO ] [MAIN ] NATL: Loaded 32488 primary data records. [2025-10-06T22:42:15.587912] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:15.588937] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 8534 primary records. [2025-10-06T22:42:15.589191] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-06T22:42:15.625254] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:15.627293] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49148 primary records. [2025-10-06T22:42:15.627386] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-06T22:42:15.628940] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-10-06T22:42:15.629768] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-10-06T22:42:15.633144] [INFO ] [MAIN ] Derivative Progress: 1240/2037 symbols completed. NAN took 1.1s. Estimated remaining: 5m 19s. Rate: 150.0 symbols/min [2025-10-06T22:42:15.634842] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:15.650280] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-10-06T22:42:15.650449] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-06T22:42:15.656038] [INFO ] [MAIN ] Derivative Progress: 1241/2037 symbols completed. NAT took 1.1s. Estimated remaining: 5m 18s. Rate: 150.1 symbols/min [2025-10-06T22:42:15.656498] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:15.678486] [DEBUG] [LOCAL ] NAZ: Loaded 2663 existing records from primary storage. [2025-10-06T22:42:15.679097] [INFO ] [MAIN ] NAZ: Loaded 2663 primary data records. [2025-10-06T22:42:15.679040] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:15.712543] [INFO ] [MAIN ] NATL: Generated 1794 derivative records from 32488 primary records. [2025-10-06T22:42:15.744529] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-10-06T22:42:15.793443] [DEBUG] [LOCAL ] NBB: Loaded 9119 existing records from primary storage. [2025-10-06T22:42:15.797071] [INFO ] [MAIN ] NBB: Loaded 9119 primary data records. [2025-10-06T22:42:15.827000] [DEBUG] [LOCAL ] NATL: Derivative data saved (1794 records). [2025-10-06T22:42:15.827103] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-10-06T22:42:15.840100] [INFO ] [MAIN ] Derivative Progress: 1242/2037 symbols completed. NATL took 1.3s. Estimated remaining: 5m 18s. Rate: 150.1 symbols/min [2025-10-06T22:42:15.855704] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:16.343699] [DEBUG] [LOCAL ] NBHC: Loaded 23384 existing records from primary storage. [2025-10-06T22:42:16.344008] [INFO ] [MAIN ] NBHC: Loaded 23384 primary data records. [2025-10-06T22:42:16.760701] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:16.762564] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2663 primary records. [2025-10-06T22:42:16.764805] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-06T22:42:16.795030] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:16.797100] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 9119 primary records. [2025-10-06T22:42:16.798311] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-06T22:42:16.815151] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-10-06T22:42:16.816133] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-06T22:42:16.820208] [INFO ] [MAIN ] Derivative Progress: 1243/2037 symbols completed. NAZ took 1.2s. Estimated remaining: 5m 18s. Rate: 150.0 symbols/min [2025-10-06T22:42:16.823181] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-10-06T22:42:16.823385] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-06T22:42:16.829951] [INFO ] [MAIN ] Derivative Progress: 1244/2037 symbols completed. NBB took 1.2s. Estimated remaining: 5m 17s. Rate: 150.1 symbols/min [2025-10-06T22:42:16.849815] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:16.850664] [INFO ] [MAIN ] NBHC: Generated 1794 derivative records from 23384 primary records. [2025-10-06T22:42:16.850933] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-10-06T22:42:16.874325] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1794 records). [2025-10-06T22:42:16.874473] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-10-06T22:42:16.879046] [INFO ] [MAIN ] Derivative Progress: 1245/2037 symbols completed. NBHC took 1.0s. Estimated remaining: 5m 16s. Rate: 150.2 symbols/min [2025-10-06T22:42:16.879674] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:16.879968] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:16.880191] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:16.886199] [DEBUG] [LOCAL ] NC: Loaded 1932 existing records from primary storage. [2025-10-06T22:42:16.886544] [INFO ] [MAIN ] NC: Loaded 1932 primary data records. [2025-10-06T22:42:17.099560] [DEBUG] [LOCAL ] NBXG: Loaded 22167 existing records from primary storage. [2025-10-06T22:42:17.131252] [INFO ] [MAIN ] NBXG: Loaded 22167 primary data records. [2025-10-06T22:42:17.158185] [DEBUG] [LOCAL ] NBR: Loaded 34410 existing records from primary storage. [2025-10-06T22:42:17.193623] [INFO ] [MAIN ] NBR: Loaded 34410 primary data records. [2025-10-06T22:42:18.187425] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:42:18.189059] [INFO ] [MAIN ] NC: Generated 1793 derivative records from 1932 primary records. [2025-10-06T22:42:18.189367] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-06T22:42:18.209170] [DEBUG] [LOCAL ] NC: Derivative data saved (1793 records). [2025-10-06T22:42:18.209688] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-06T22:42:18.212585] [INFO ] [MAIN ] Derivative Progress: 1246/2037 symbols completed. NC took 1.3s. Estimated remaining: 5m 17s. Rate: 149.9 symbols/min [2025-10-06T22:42:18.213713] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:18.245069] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:18.251522] [INFO ] [MAIN ] NBR: Generated 1794 derivative records from 34410 primary records. [2025-10-06T22:42:18.251873] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:18.252110] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-10-06T22:42:18.253567] [INFO ] [MAIN ] NBXG: Generated 1794 derivative records from 22167 primary records. [2025-10-06T22:42:18.258753] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-10-06T22:42:18.258371] [DEBUG] [LOCAL ] NCA: Loaded 10104 existing records from primary storage. [2025-10-06T22:42:18.271325] [INFO ] [MAIN ] NCA: Loaded 10104 primary data records. [2025-10-06T22:42:18.403263] [DEBUG] [LOCAL ] NBR: Derivative data saved (1794 records). [2025-10-06T22:42:18.403489] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-10-06T22:42:18.407408] [INFO ] [MAIN ] Derivative Progress: 1247/2037 symbols completed. NBR took 1.5s. Estimated remaining: 5m 16s. Rate: 150.0 symbols/min [2025-10-06T22:42:18.416876] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:18.430524] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1794 records). [2025-10-06T22:42:18.451740] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-10-06T22:42:18.455591] [INFO ] [MAIN ] Derivative Progress: 1248/2037 symbols completed. NBXG took 1.6s. Estimated remaining: 5m 15s. Rate: 150.1 symbols/min [2025-10-06T22:42:18.461017] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:18.655635] [DEBUG] [LOCAL ] NCDL: Loaded 21643 existing records from primary storage. [2025-10-06T22:42:18.656053] [INFO ] [MAIN ] NCDL: Loaded 21643 primary data records. [2025-10-06T22:42:18.713349] [DEBUG] [LOCAL ] NCV: Loaded 13835 existing records from primary storage. [2025-10-06T22:42:18.734783] [INFO ] [MAIN ] NCV: Loaded 13835 primary data records. [2025-10-06T22:42:19.337215] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:19.339283] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 10104 primary records. [2025-10-06T22:42:19.340289] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-06T22:42:19.358968] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-10-06T22:42:19.359178] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-06T22:42:19.361958] [INFO ] [MAIN ] Derivative Progress: 1249/2037 symbols completed. NCA took 1.1s. Estimated remaining: 5m 15s. Rate: 149.9 symbols/min [2025-10-06T22:42:19.363550] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:19.409839] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:19.410367] [DEBUG] [LOCAL ] NCZ: Loaded 12075 existing records from primary storage. [2025-10-06T22:42:19.411410] [INFO ] [MAIN ] NCZ: Loaded 12075 primary data records. [2025-10-06T22:42:19.411352] [INFO ] [MAIN ] NCDL: Generated 1794 derivative records from 21643 primary records. [2025-10-06T22:42:19.443429] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-10-06T22:42:19.443948] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:19.527031] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13835 primary records. [2025-10-06T22:42:19.530345] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-06T22:42:19.587247] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1794 records). [2025-10-06T22:42:19.628854] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-10-06T22:42:19.632245] [INFO ] [MAIN ] Derivative Progress: 1250/2037 symbols completed. NCDL took 1.2s. Estimated remaining: 5m 15s. Rate: 150.0 symbols/min [2025-10-06T22:42:19.632717] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:19.752589] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-10-06T22:42:19.752980] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-06T22:42:19.756222] [INFO ] [MAIN ] Derivative Progress: 1251/2037 symbols completed. NCV took 1.3s. Estimated remaining: 5m 14s. Rate: 150.1 symbols/min [2025-10-06T22:42:19.756477] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:19.772953] [DEBUG] [LOCAL ] NDMO: Loaded 17000 existing records from primary storage. [2025-10-06T22:42:19.773158] [INFO ] [MAIN ] NDMO: Loaded 17000 primary data records. [2025-10-06T22:42:19.988678] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:20.090302] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 12075 primary records. [2025-10-06T22:42:20.105143] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-06T22:42:20.138791] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-10-06T22:42:20.139910] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-06T22:42:20.138682] [DEBUG] [LOCAL ] NE: Loaded 52386 existing records from primary storage. [2025-10-06T22:42:20.142583] [INFO ] [MAIN ] Derivative Progress: 1252/2037 symbols completed. NCZ took 0.8s. Estimated remaining: 5m 14s. Rate: 150.1 symbols/min [2025-10-06T22:42:20.142738] [INFO ] [MAIN ] NE: Loaded 52386 primary data records. [2025-10-06T22:42:20.143267] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:20.477143] [DEBUG] [LOCAL ] NEA: Loaded 35486 existing records from primary storage. [2025-10-06T22:42:20.479537] [INFO ] [MAIN ] NEA: Loaded 35486 primary data records. [2025-10-06T22:42:20.585379] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:20.597090] [INFO ] [MAIN ] NDMO: Generated 1794 derivative records from 17000 primary records. [2025-10-06T22:42:20.603811] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-10-06T22:42:20.871903] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1794 records). [2025-10-06T22:42:20.872075] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-10-06T22:42:20.875334] [INFO ] [MAIN ] Derivative Progress: 1253/2037 symbols completed. NDMO took 1.2s. Estimated remaining: 5m 14s. Rate: 150.0 symbols/min [2025-10-06T22:42:20.875495] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:20.894781] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:20.896245] [INFO ] [MAIN ] NE: Generated 1794 derivative records from 52386 primary records. [2025-10-06T22:42:20.896383] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-10-06T22:42:20.916228] [DEBUG] [LOCAL ] NE: Derivative data saved (1794 records). [2025-10-06T22:42:20.916572] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-10-06T22:42:20.919229] [INFO ] [MAIN ] Derivative Progress: 1254/2037 symbols completed. NE took 1.2s. Estimated remaining: 5m 13s. Rate: 150.1 symbols/min [2025-10-06T22:42:20.919504] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:20.950153] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:20.950887] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35486 primary records. [2025-10-06T22:42:20.952749] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-06T22:42:20.970038] [DEBUG] [LOCAL ] NEU: Loaded 8396 existing records from primary storage. [2025-10-06T22:42:20.971153] [INFO ] [MAIN ] NEU: Loaded 8396 primary data records. [2025-10-06T22:42:21.090347] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-10-06T22:42:21.095313] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-10-06T22:42:21.094909] [DEBUG] [LOCAL ] NET: Loaded 52971 existing records from primary storage. [2025-10-06T22:42:21.114224] [INFO ] [MAIN ] Derivative Progress: 1255/2037 symbols completed. NEA took 1.0s. Estimated remaining: 5m 13s. Rate: 150.1 symbols/min [2025-10-06T22:42:21.114352] [INFO ] [MAIN ] NET: Loaded 52971 primary data records. [2025-10-06T22:42:21.137733] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:21.381596] [DEBUG] [LOCAL ] NEXA: Loaded 4445 existing records from primary storage. [2025-10-06T22:42:21.398851] [INFO ] [MAIN ] NEXA: Loaded 4445 primary data records. [2025-10-06T22:42:21.941022] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:21.942337] [INFO ] [MAIN ] NEU: Generated 1794 derivative records from 8396 primary records. [2025-10-06T22:42:21.942432] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-10-06T22:42:21.963433] [DEBUG] [LOCAL ] NEU: Derivative data saved (1794 records). [2025-10-06T22:42:21.965520] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-10-06T22:42:21.968248] [INFO ] [MAIN ] Derivative Progress: 1256/2037 symbols completed. NEU took 1.0s. Estimated remaining: 5m 12s. Rate: 150.0 symbols/min [2025-10-06T22:42:21.968663] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:21.986778] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:42:21.994232] [INFO ] [MAIN ] NET: Generated 1793 derivative records from 52971 primary records. [2025-10-06T22:42:21.994344] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-10-06T22:42:22.016453] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:22.017412] [INFO ] [MAIN ] NEXA: Generated 1794 derivative records from 4445 primary records. [2025-10-06T22:42:22.018111] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-06T22:42:22.035914] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1794 records). [2025-10-06T22:42:22.036572] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-06T22:42:22.040268] [INFO ] [MAIN ] Derivative Progress: 1257/2037 symbols completed. NEXA took 0.9s. Estimated remaining: 5m 12s. Rate: 150.1 symbols/min [2025-10-06T22:42:22.041385] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:22.051325] [DEBUG] [LOCAL ] NET: Derivative data saved (1793 records). [2025-10-06T22:42:22.051536] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-10-06T22:42:22.055022] [INFO ] [MAIN ] Derivative Progress: 1258/2037 symbols completed. NET took 1.2s. Estimated remaining: 5m 11s. Rate: 150.2 symbols/min [2025-10-06T22:42:22.071577] [DEBUG] [LOCAL ] NFG: Loaded 38439 existing records from primary storage. [2025-10-06T22:42:22.071804] [INFO ] [MAIN ] NFG: Loaded 38439 primary data records. [2025-10-06T22:42:22.243389] [DEBUG] [LOCAL ] NFJ: Loaded 20410 existing records from primary storage. [2025-10-06T22:42:22.262125] [INFO ] [MAIN ] NFJ: Loaded 20410 primary data records. [2025-10-06T22:42:22.770424] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:22.771313] [INFO ] [MAIN ] NFG: Generated 1794 derivative records from 38439 primary records. [2025-10-06T22:42:22.771964] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-10-06T22:42:22.791934] [DEBUG] [LOCAL ] NFG: Derivative data saved (1794 records). [2025-10-06T22:42:22.791999] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-10-06T22:42:22.794518] [INFO ] [MAIN ] Derivative Progress: 1259/2037 symbols completed. NFG took 0.8s. Estimated remaining: 5m 11s. Rate: 150.1 symbols/min [2025-10-06T22:42:22.815852] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:22.816620] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 20410 primary records. [2025-10-06T22:42:22.816711] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-06T22:42:22.832873] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-10-06T22:42:22.832969] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-10-06T22:42:22.836016] [INFO ] [MAIN ] Derivative Progress: 1260/2037 symbols completed. NFJ took 0.8s. Estimated remaining: 5m 10s. Rate: 150.2 symbols/min [2025-10-06T22:42:22.836616] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:22.836912] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:22.836822] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:22.852335] [DEBUG] [LOCAL ] NGS: Loaded 11418 existing records from primary storage. [2025-10-06T22:42:22.852563] [INFO ] [MAIN ] NGS: Loaded 11418 primary data records. [2025-10-06T22:42:22.989144] [DEBUG] [LOCAL ] NGL: Loaded 30046 existing records from primary storage. [2025-10-06T22:42:23.005264] [INFO ] [MAIN ] NGL: Loaded 30046 primary data records. [2025-10-06T22:42:23.326550] [DEBUG] [LOCAL ] NGG: Loaded 46308 existing records from primary storage. [2025-10-06T22:42:23.338403] [INFO ] [MAIN ] NGG: Loaded 46308 primary data records. [2025-10-06T22:42:23.866766] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:23.868027] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11418 primary records. [2025-10-06T22:42:23.868527] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-06T22:42:23.905157] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-10-06T22:42:23.905322] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-06T22:42:23.904264] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:23.908351] [INFO ] [MAIN ] Derivative Progress: 1261/2037 symbols completed. NGS took 1.1s. Estimated remaining: 5m 10s. Rate: 150.0 symbols/min [2025-10-06T22:42:23.909824] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:23.909449] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 30046 primary records. [2025-10-06T22:42:23.910483] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-06T22:42:23.942328] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:23.944317] [INFO ] [MAIN ] NGG: Generated 1794 derivative records from 46308 primary records. [2025-10-06T22:42:23.945142] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-10-06T22:42:23.960538] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-10-06T22:42:23.960679] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-06T22:42:23.966936] [INFO ] [MAIN ] Derivative Progress: 1262/2037 symbols completed. NGL took 1.1s. Estimated remaining: 5m 10s. Rate: 150.1 symbols/min [2025-10-06T22:42:23.967391] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:23.978917] [DEBUG] [LOCAL ] NGVC: Loaded 22455 existing records from primary storage. [2025-10-06T22:42:23.980198] [INFO ] [MAIN ] NGVC: Loaded 22455 primary data records. [2025-10-06T22:42:24.001504] [DEBUG] [LOCAL ] NGG: Derivative data saved (1794 records). [2025-10-06T22:42:24.024106] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-10-06T22:42:24.055446] [INFO ] [MAIN ] Derivative Progress: 1263/2037 symbols completed. NGG took 1.2s. Estimated remaining: 5m 9s. Rate: 150.2 symbols/min [2025-10-06T22:42:24.072478] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:24.159226] [DEBUG] [LOCAL ] NGVT: Loaded 24179 existing records from primary storage. [2025-10-06T22:42:24.186167] [INFO ] [MAIN ] NGVT: Loaded 24179 primary data records. [2025-10-06T22:42:24.390898] [DEBUG] [LOCAL ] NHI: Loaded 21832 existing records from primary storage. [2025-10-06T22:42:24.403738] [INFO ] [MAIN ] NHI: Loaded 21832 primary data records. [2025-10-06T22:42:25.053732] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:25.055430] [INFO ] [MAIN ] NGVC: Generated 1794 derivative records from 22455 primary records. [2025-10-06T22:42:25.055537] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-10-06T22:42:25.074918] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1794 records). [2025-10-06T22:42:25.075248] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-10-06T22:42:25.077969] [INFO ] [MAIN ] Derivative Progress: 1264/2037 symbols completed. NGVC took 1.2s. Estimated remaining: 5m 9s. Rate: 150.0 symbols/min [2025-10-06T22:42:25.078575] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:25.096977] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:25.100324] [INFO ] [MAIN ] NGVT: Generated 1794 derivative records from 24179 primary records. [2025-10-06T22:42:25.102966] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-10-06T22:42:25.128028] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:25.129080] [INFO ] [MAIN ] NHI: Generated 1794 derivative records from 21832 primary records. [2025-10-06T22:42:25.129685] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-10-06T22:42:25.134837] [DEBUG] [LOCAL ] NIC: Loaded 8872 existing records from primary storage. [2025-10-06T22:42:25.135159] [INFO ] [MAIN ] NIC: Loaded 8872 primary data records. [2025-10-06T22:42:25.239161] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1794 records). [2025-10-06T22:42:25.246168] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-10-06T22:42:25.246098] [DEBUG] [LOCAL ] NHI: Derivative data saved (1794 records). [2025-10-06T22:42:25.260235] [INFO ] [MAIN ] Derivative Progress: 1265/2037 symbols completed. NGVT took 1.3s. Estimated remaining: 5m 9s. Rate: 150.1 symbols/min [2025-10-06T22:42:25.260484] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-10-06T22:42:25.260587] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:25.263975] [INFO ] [MAIN ] Derivative Progress: 1266/2037 symbols completed. NHI took 1.2s. Estimated remaining: 5m 8s. Rate: 150.2 symbols/min [2025-10-06T22:42:25.265395] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:25.473237] [DEBUG] [LOCAL ] NIM: Loaded 4024 existing records from primary storage. [2025-10-06T22:42:25.474100] [INFO ] [MAIN ] NIM: Loaded 4024 primary data records. [2025-10-06T22:42:25.518808] [DEBUG] [LOCAL ] NIE: Loaded 11940 existing records from primary storage. [2025-10-06T22:42:25.559741] [INFO ] [MAIN ] NIE: Loaded 11940 primary data records. [2025-10-06T22:42:26.142477] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:26.144411] [INFO ] [MAIN ] NIC: Generated 1794 derivative records from 8872 primary records. [2025-10-06T22:42:26.146085] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-10-06T22:42:26.170988] [DEBUG] [LOCAL ] NIC: Derivative data saved (1794 records). [2025-10-06T22:42:26.172062] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-10-06T22:42:26.175799] [INFO ] [MAIN ] Derivative Progress: 1267/2037 symbols completed. NIC took 1.1s. Estimated remaining: 5m 8s. Rate: 150.0 symbols/min [2025-10-06T22:42:26.176082] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:26.191662] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:26.193729] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 4024 primary records. [2025-10-06T22:42:26.195488] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-06T22:42:26.221565] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:26.223289] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11940 primary records. [2025-10-06T22:42:26.224012] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-06T22:42:26.246700] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-10-06T22:42:26.247358] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-06T22:42:26.251519] [INFO ] [MAIN ] Derivative Progress: 1268/2037 symbols completed. NIM took 1.0s. Estimated remaining: 5m 7s. Rate: 150.1 symbols/min [2025-10-06T22:42:26.259560] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:26.262534] [DEBUG] [LOCAL ] NINE: Loaded 28140 existing records from primary storage. [2025-10-06T22:42:26.263280] [INFO ] [MAIN ] NINE: Loaded 28140 primary data records. [2025-10-06T22:42:26.328122] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-10-06T22:42:26.339946] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-06T22:42:26.343167] [INFO ] [MAIN ] Derivative Progress: 1269/2037 symbols completed. NIE took 1.1s. Estimated remaining: 5m 7s. Rate: 150.2 symbols/min [2025-10-06T22:42:26.358678] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:26.635208] [DEBUG] [LOCAL ] NJR: Loaded 38271 existing records from primary storage. [2025-10-06T22:42:26.636791] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-06T22:42:26.636919] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-10-06T22:42:26.637216] [INFO ] [MAIN ] NJR: Loaded 38271 primary data records. [2025-10-06T22:42:27.269346] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:27.406824] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 28140 primary records. [2025-10-06T22:42:27.407968] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-06T22:42:27.434196] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-10-06T22:42:27.436936] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-06T22:42:27.441189] [INFO ] [MAIN ] Derivative Progress: 1270/2037 symbols completed. NINE took 1.3s. Estimated remaining: 5m 7s. Rate: 150.0 symbols/min [2025-10-06T22:42:27.442138] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:27.466215] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:27.473976] [INFO ] [MAIN ] NJR: Generated 1794 derivative records from 38271 primary records. [2025-10-06T22:42:27.475129] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-10-06T22:42:27.499050] [DEBUG] [LOCAL ] NKX: Loaded 13646 existing records from primary storage. [2025-10-06T22:42:27.509025] [INFO ] [MAIN ] NKX: Loaded 13646 primary data records. [2025-10-06T22:42:27.509888] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:27.517728] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-10-06T22:42:27.525932] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-06T22:42:27.635122] [DEBUG] [LOCAL ] NJR: Derivative data saved (1794 records). [2025-10-06T22:42:27.641338] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-10-06T22:42:27.645390] [INFO ] [MAIN ] Derivative Progress: 1271/2037 symbols completed. NJR took 1.3s. Estimated remaining: 5m 6s. Rate: 150.1 symbols/min [2025-10-06T22:42:27.651293] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:27.682683] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-10-06T22:42:27.682987] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-06T22:42:27.693594] [INFO ] [MAIN ] Derivative Progress: 1272/2037 symbols completed. NIO took 1.4s. Estimated remaining: 5m 6s. Rate: 150.2 symbols/min [2025-10-06T22:42:27.699054] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:27.796932] [DEBUG] [LOCAL ] NLOP: Loaded 11756 existing records from primary storage. [2025-10-06T22:42:27.903410] [INFO ] [MAIN ] NLOP: Loaded 11756 primary data records. [2025-10-06T22:42:28.323979] [DEBUG] [LOCAL ] NLY: Loaded 53575 existing records from primary storage. [2025-10-06T22:42:28.324586] [INFO ] [MAIN ] NLY: Loaded 53575 primary data records. [2025-10-06T22:42:28.514557] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:28.578233] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13646 primary records. [2025-10-06T22:42:28.710911] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-06T22:42:28.746827] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:28.749767] [INFO ] [MAIN ] NLOP: Generated 1794 derivative records from 11756 primary records. [2025-10-06T22:42:28.749868] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-10-06T22:42:28.754820] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-10-06T22:42:28.768375] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-06T22:42:28.773033] [INFO ] [MAIN ] Derivative Progress: 1273/2037 symbols completed. NKX took 1.3s. Estimated remaining: 5m 6s. Rate: 150.0 symbols/min [2025-10-06T22:42:28.777761] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1794 records). [2025-10-06T22:42:28.778069] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-10-06T22:42:28.783419] [INFO ] [MAIN ] Derivative Progress: 1274/2037 symbols completed. NLOP took 1.1s. Estimated remaining: 5m 5s. Rate: 150.1 symbols/min [2025-10-06T22:42:28.797917] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:28.798718] [INFO ] [MAIN ] NLY: Generated 1794 derivative records from 53575 primary records. [2025-10-06T22:42:28.798786] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-10-06T22:42:28.815314] [DEBUG] [LOCAL ] NLY: Derivative data saved (1794 records). [2025-10-06T22:42:28.815394] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-10-06T22:42:28.818503] [INFO ] [MAIN ] Derivative Progress: 1275/2037 symbols completed. NLY took 1.1s. Estimated remaining: 5m 4s. Rate: 150.2 symbols/min [2025-10-06T22:42:28.819114] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:28.819302] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:28.820307] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:28.842916] [DEBUG] [LOCAL ] NMG: Loaded 8586 existing records from primary storage. [2025-10-06T22:42:28.843212] [INFO ] [MAIN ] NMG: Loaded 8586 primary data records. [2025-10-06T22:42:28.929018] [DEBUG] [LOCAL ] NMCO: Loaded 16847 existing records from primary storage. [2025-10-06T22:42:28.942098] [INFO ] [MAIN ] NMCO: Loaded 16847 primary data records. [2025-10-06T22:42:28.960116] [DEBUG] [LOCAL ] NMAI: Loaded 12867 existing records from primary storage. [2025-10-06T22:42:29.060038] [INFO ] [MAIN ] NMAI: Loaded 12867 primary data records. [2025-10-06T22:42:29.947171] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:29.961985] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 8586 primary records. [2025-10-06T22:42:29.962272] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-06T22:42:29.971540] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:29.972883] [INFO ] [MAIN ] NMCO: Generated 1794 derivative records from 16847 primary records. [2025-10-06T22:42:29.978143] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-10-06T22:42:29.986231] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:29.992585] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 12867 primary records. [2025-10-06T22:42:29.994226] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-06T22:42:30.026786] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1794 records). [2025-10-06T22:42:30.027891] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-10-06T22:42:30.032163] [INFO ] [MAIN ] Derivative Progress: 1276/2037 symbols completed. NMCO took 1.2s. Estimated remaining: 5m 4s. Rate: 150.0 symbols/min [2025-10-06T22:42:30.032703] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:30.035810] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-10-06T22:42:30.036546] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-06T22:42:30.039837] [INFO ] [MAIN ] Derivative Progress: 1277/2037 symbols completed. NMG took 1.2s. Estimated remaining: 5m 4s. Rate: 150.1 symbols/min [2025-10-06T22:42:30.040156] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:30.045362] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-10-06T22:42:30.045625] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-06T22:42:30.049565] [INFO ] [MAIN ] Derivative Progress: 1278/2037 symbols completed. NMAI took 1.2s. Estimated remaining: 5m 3s. Rate: 150.2 symbols/min [2025-10-06T22:42:30.053451] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:30.053282] [DEBUG] [LOCAL ] NMI: Loaded 4055 existing records from primary storage. [2025-10-06T22:42:30.054301] [INFO ] [MAIN ] NMI: Loaded 4055 primary data records. [2025-10-06T22:42:30.181273] [DEBUG] [LOCAL ] NMM: Loaded 14408 existing records from primary storage. [2025-10-06T22:42:30.196128] [INFO ] [MAIN ] NMM: Loaded 14408 primary data records. [2025-10-06T22:42:30.439168] [DEBUG] [LOCAL ] NMR: Loaded 35092 existing records from primary storage. [2025-10-06T22:42:30.542278] [INFO ] [MAIN ] NMR: Loaded 35092 primary data records. [2025-10-06T22:42:31.109808] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:31.111849] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4055 primary records. [2025-10-06T22:42:31.112270] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-06T22:42:31.147577] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:31.134095] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-10-06T22:42:31.148235] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-06T22:42:31.149221] [INFO ] [MAIN ] NMM: Generated 1794 derivative records from 14408 primary records. [2025-10-06T22:42:31.152746] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-10-06T22:42:31.152380] [INFO ] [MAIN ] Derivative Progress: 1279/2037 symbols completed. NMI took 1.1s. Estimated remaining: 5m 3s. Rate: 150.0 symbols/min [2025-10-06T22:42:31.154155] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:31.178157] [DEBUG] [LOCAL ] NMS: Loaded 2855 existing records from primary storage. [2025-10-06T22:42:31.179005] [INFO ] [MAIN ] NMS: Loaded 2855 primary data records. [2025-10-06T22:42:31.234876] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:31.250016] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 35092 primary records. [2025-10-06T22:42:31.251158] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-06T22:42:31.283039] [DEBUG] [LOCAL ] NMM: Derivative data saved (1794 records). [2025-10-06T22:42:31.288347] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-10-06T22:42:31.296309] [INFO ] [MAIN ] Derivative Progress: 1280/2037 symbols completed. NMM took 1.3s. Estimated remaining: 5m 3s. Rate: 150.1 symbols/min [2025-10-06T22:42:31.304051] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:31.391971] [DEBUG] [LOCAL ] NMT: Loaded 2867 existing records from primary storage. [2025-10-06T22:42:31.565698] [INFO ] [MAIN ] NMT: Loaded 2867 primary data records. [2025-10-06T22:42:31.575123] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-10-06T22:42:31.586823] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-06T22:42:31.610552] [INFO ] [MAIN ] Derivative Progress: 1281/2037 symbols completed. NMR took 1.6s. Estimated remaining: 5m 2s. Rate: 150.1 symbols/min [2025-10-06T22:42:31.636579] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:31.913340] [DEBUG] [LOCAL ] NMZ: Loaded 21640 existing records from primary storage. [2025-10-06T22:42:31.914787] [INFO ] [MAIN ] NMZ: Loaded 21640 primary data records. [2025-10-06T22:42:32.105372] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:32.153203] [INFO ] [MAIN ] NMS: Generated 1794 derivative records from 2855 primary records. [2025-10-06T22:42:32.153318] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-06T22:42:32.314930] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-06T22:42:32.318623] [INFO ] [MAIN ] NMT: Generated 1792 derivative records from 2867 primary records. [2025-10-06T22:42:32.319482] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-06T22:42:32.321284] [DEBUG] [LOCAL ] NMS: Derivative data saved (1794 records). [2025-10-06T22:42:32.321704] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-06T22:42:32.325541] [INFO ] [MAIN ] Derivative Progress: 1282/2037 symbols completed. NMS took 1.2s. Estimated remaining: 5m 2s. Rate: 150.0 symbols/min [2025-10-06T22:42:32.333607] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:32.352265] [DEBUG] [LOCAL ] NMT: Derivative data saved (1792 records). [2025-10-06T22:42:32.352696] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-06T22:42:32.356536] [INFO ] [MAIN ] Derivative Progress: 1283/2037 symbols completed. NMT took 1.1s. Estimated remaining: 5m 1s. Rate: 150.1 symbols/min [2025-10-06T22:42:32.357022] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:32.362939] [DEBUG] [LOCAL ] NNI: Loaded 10305 existing records from primary storage. [2025-10-06T22:42:32.363130] [INFO ] [MAIN ] NNI: Loaded 10305 primary data records. [2025-10-06T22:42:32.486218] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:32.511166] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21640 primary records. [2025-10-06T22:42:32.516548] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-06T22:42:32.741118] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-10-06T22:42:32.742262] [DEBUG] [LOCAL ] NNN: Loaded 48402 existing records from primary storage. [2025-10-06T22:42:32.742813] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-10-06T22:42:32.743110] [INFO ] [MAIN ] NNN: Loaded 48402 primary data records. [2025-10-06T22:42:32.747373] [INFO ] [MAIN ] Derivative Progress: 1284/2037 symbols completed. NMZ took 1.1s. Estimated remaining: 5m 1s. Rate: 150.1 symbols/min [2025-10-06T22:42:32.747879] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:32.862410] [DEBUG] [LOCAL ] NNY: Loaded 5717 existing records from primary storage. [2025-10-06T22:42:32.862995] [INFO ] [MAIN ] NNY: Loaded 5717 primary data records. [2025-10-06T22:42:33.259666] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:33.389096] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 10305 primary records. [2025-10-06T22:42:33.485901] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-06T22:42:33.516368] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-10-06T22:42:33.518095] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-06T22:42:33.522827] [INFO ] [MAIN ] Derivative Progress: 1285/2037 symbols completed. NNI took 1.2s. Estimated remaining: 5m 1s. Rate: 150.0 symbols/min [2025-10-06T22:42:33.524593] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:33.540141] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:33.541218] [INFO ] [MAIN ] NNN: Generated 1794 derivative records from 48402 primary records. [2025-10-06T22:42:33.541497] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-10-06T22:42:33.574439] [DEBUG] [LOCAL ] NOA: Loaded 16143 existing records from primary storage. [2025-10-06T22:42:33.576054] [DEBUG] [LOCAL ] NNN: Derivative data saved (1794 records). [2025-10-06T22:42:33.576153] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-10-06T22:42:33.579212] [INFO ] [MAIN ] Derivative Progress: 1286/2037 symbols completed. NNN took 1.2s. Estimated remaining: 5m 0s. Rate: 150.1 symbols/min [2025-10-06T22:42:33.579767] [INFO ] [MAIN ] NOA: Loaded 16143 primary data records. [2025-10-06T22:42:33.579932] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:33.680951] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:33.701912] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5717 primary records. [2025-10-06T22:42:33.702189] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-06T22:42:33.796886] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-10-06T22:42:33.811839] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-06T22:42:33.815364] [INFO ] [MAIN ] Derivative Progress: 1287/2037 symbols completed. NNY took 1.1s. Estimated remaining: 4m 60s. Rate: 150.1 symbols/min [2025-10-06T22:42:33.815571] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:33.818316] [DEBUG] [LOCAL ] NOAH: Loaded 20440 existing records from primary storage. [2025-10-06T22:42:33.822315] [INFO ] [MAIN ] NOAH: Loaded 20440 primary data records. [2025-10-06T22:42:34.329187] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:34.328341] [DEBUG] [LOCAL ] NOG: Loaded 51233 existing records from primary storage. [2025-10-06T22:42:34.329581] [INFO ] [MAIN ] NOG: Loaded 51233 primary data records. [2025-10-06T22:42:34.330472] [INFO ] [MAIN ] NOA: Generated 1794 derivative records from 16143 primary records. [2025-10-06T22:42:34.330861] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-10-06T22:42:34.449664] [DEBUG] [LOCAL ] NOA: Derivative data saved (1794 records). [2025-10-06T22:42:34.455956] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-10-06T22:42:34.464097] [INFO ] [MAIN ] Derivative Progress: 1288/2037 symbols completed. NOA took 0.9s. Estimated remaining: 4m 59s. Rate: 150.1 symbols/min [2025-10-06T22:42:34.550750] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:34.676490] [INFO ] [MAIN ] NOAH: Generated 1794 derivative records from 20440 primary records. [2025-10-06T22:42:34.677103] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-10-06T22:42:34.695092] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1794 records). [2025-10-06T22:42:34.695400] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-10-06T22:42:34.698693] [INFO ] [MAIN ] Derivative Progress: 1289/2037 symbols completed. NOAH took 1.1s. Estimated remaining: 4m 59s. Rate: 150.1 symbols/min [2025-10-06T22:42:34.718884] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:34.719526] [INFO ] [MAIN ] NOG: Generated 1794 derivative records from 51233 primary records. [2025-10-06T22:42:34.719586] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-10-06T22:42:34.735756] [DEBUG] [LOCAL ] NOG: Derivative data saved (1794 records). [2025-10-06T22:42:34.735818] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-10-06T22:42:34.738437] [INFO ] [MAIN ] Derivative Progress: 1290/2037 symbols completed. NOG took 0.9s. Estimated remaining: 4m 58s. Rate: 150.2 symbols/min [2025-10-06T22:42:34.738968] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:34.739083] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:34.738894] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:34.816072] [DEBUG] [LOCAL ] NOMD: Loaded 41837 existing records from primary storage. [2025-10-06T22:42:34.816265] [INFO ] [MAIN ] NOMD: Loaded 41837 primary data records. [2025-10-06T22:42:34.828775] [DEBUG] [LOCAL ] NOTE: Loaded 41406 existing records from primary storage. [2025-10-06T22:42:34.880981] [INFO ] [MAIN ] NOTE: Loaded 41406 primary data records. [2025-10-06T22:42:34.986903] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-10-06T22:42:34.998064] [INFO ] [MAIN ] NOK: Loaded 53621 primary data records. [2025-10-06T22:42:35.875553] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:35.876343] [INFO ] [MAIN ] NOMD: Generated 1794 derivative records from 41837 primary records. [2025-10-06T22:42:35.876512] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-10-06T22:42:35.898093] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1794 records). [2025-10-06T22:42:35.899192] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-10-06T22:42:35.901262] [INFO ] [MAIN ] Derivative Progress: 1291/2037 symbols completed. NOMD took 1.2s. Estimated remaining: 4m 58s. Rate: 150.0 symbols/min [2025-10-06T22:42:35.901554] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:35.916120] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:35.918816] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 41406 primary records. [2025-10-06T22:42:35.919694] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-06T22:42:35.941705] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:35.945207] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53621 primary records. [2025-10-06T22:42:35.945323] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-06T22:42:35.963875] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-10-06T22:42:35.965462] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-06T22:42:35.971419] [INFO ] [MAIN ] Derivative Progress: 1292/2037 symbols completed. NOTE took 1.2s. Estimated remaining: 4m 58s. Rate: 150.1 symbols/min [2025-10-06T22:42:35.971916] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:35.985963] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-10-06T22:42:35.986261] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-06T22:42:35.989603] [INFO ] [MAIN ] Derivative Progress: 1293/2037 symbols completed. NOK took 1.3s. Estimated remaining: 4m 57s. Rate: 150.2 symbols/min [2025-10-06T22:42:35.990346] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:36.020783] [DEBUG] [LOCAL ] NOV: Loaded 53178 existing records from primary storage. [2025-10-06T22:42:36.021094] [INFO ] [MAIN ] NOV: Loaded 53178 primary data records. [2025-10-06T22:42:36.072068] [DEBUG] [LOCAL ] NPFD: Loaded 9877 existing records from primary storage. [2025-10-06T22:42:36.079402] [INFO ] [MAIN ] NPFD: Loaded 9877 primary data records. [2025-10-06T22:42:36.101361] [DEBUG] [LOCAL ] NPCT: Loaded 16956 existing records from primary storage. [2025-10-06T22:42:36.166786] [INFO ] [MAIN ] NPCT: Loaded 16956 primary data records. [2025-10-06T22:42:36.966306] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:36.967212] [INFO ] [MAIN ] NOV: Generated 1794 derivative records from 53178 primary records. [2025-10-06T22:42:36.967522] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-10-06T22:42:37.000288] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:37.003790] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 9877 primary records. [2025-10-06T22:42:37.004336] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-06T22:42:37.027109] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:37.027971] [INFO ] [MAIN ] NPCT: Generated 1794 derivative records from 16956 primary records. [2025-10-06T22:42:37.031532] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-10-06T22:42:37.026767] [DEBUG] [LOCAL ] NOV: Derivative data saved (1794 records). [2025-10-06T22:42:37.031709] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-10-06T22:42:37.034940] [INFO ] [MAIN ] Derivative Progress: 1294/2037 symbols completed. NOV took 1.1s. Estimated remaining: 4m 57s. Rate: 150.0 symbols/min [2025-10-06T22:42:37.035697] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:37.056880] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-10-06T22:42:37.057635] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-06T22:42:37.060854] [INFO ] [MAIN ] Derivative Progress: 1295/2037 symbols completed. NPFD took 1.1s. Estimated remaining: 4m 57s. Rate: 150.1 symbols/min [2025-10-06T22:42:37.061560] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:37.063236] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1794 records). [2025-10-06T22:42:37.063333] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-10-06T22:42:37.066795] [INFO ] [MAIN ] Derivative Progress: 1296/2037 symbols completed. NPCT took 1.1s. Estimated remaining: 4m 56s. Rate: 150.2 symbols/min [2025-10-06T22:42:37.066975] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:37.072385] [DEBUG] [LOCAL ] NPK: Loaded 8096 existing records from primary storage. [2025-10-06T22:42:37.072911] [INFO ] [MAIN ] NPK: Loaded 8096 primary data records. [2025-10-06T22:42:37.157029] [DEBUG] [LOCAL ] NPV: Loaded 5107 existing records from primary storage. [2025-10-06T22:42:37.197161] [INFO ] [MAIN ] NPV: Loaded 5107 primary data records. [2025-10-06T22:42:37.196942] [DEBUG] [LOCAL ] NPO: Loaded 13100 existing records from primary storage. [2025-10-06T22:42:37.197290] [INFO ] [MAIN ] NPO: Loaded 13100 primary data records. [2025-10-06T22:42:38.076665] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:38.078952] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8096 primary records. [2025-10-06T22:42:38.079095] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-06T22:42:38.102857] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:38.108018] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 5107 primary records. [2025-10-06T22:42:38.108150] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-06T22:42:38.135735] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:38.137936] [INFO ] [MAIN ] NPO: Generated 1794 derivative records from 13100 primary records. [2025-10-06T22:42:38.138814] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-10-06T22:42:38.141285] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-10-06T22:42:38.141421] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-06T22:42:38.144706] [INFO ] [MAIN ] Derivative Progress: 1297/2037 symbols completed. NPK took 1.1s. Estimated remaining: 4m 56s. Rate: 150.1 symbols/min [2025-10-06T22:42:38.152368] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:38.158046] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-10-06T22:42:38.158523] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-06T22:42:38.161778] [INFO ] [MAIN ] Derivative Progress: 1298/2037 symbols completed. NPV took 1.1s. Estimated remaining: 4m 55s. Rate: 150.2 symbols/min [2025-10-06T22:42:38.162447] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:38.169325] [DEBUG] [LOCAL ] NPO: Derivative data saved (1794 records). [2025-10-06T22:42:38.172169] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-10-06T22:42:38.175549] [INFO ] [MAIN ] Derivative Progress: 1299/2037 symbols completed. NPO took 1.1s. Estimated remaining: 4m 55s. Rate: 150.3 symbols/min [2025-10-06T22:42:38.175984] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:38.181969] [DEBUG] [LOCAL ] NQP: Loaded 9259 existing records from primary storage. [2025-10-06T22:42:38.182063] [INFO ] [MAIN ] NQP: Loaded 9259 primary data records. [2025-10-06T22:42:38.530170] [DEBUG] [LOCAL ] NPWR: Loaded 42902 existing records from primary storage. [2025-10-06T22:42:38.531023] [INFO ] [MAIN ] NPWR: Loaded 42902 primary data records. [2025-10-06T22:42:38.530916] [DEBUG] [LOCAL ] NRDY: Loaded 32547 existing records from primary storage. [2025-10-06T22:42:38.531441] [INFO ] [MAIN ] NRDY: Loaded 32547 primary data records. [2025-10-06T22:42:39.166848] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:39.168218] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9259 primary records. [2025-10-06T22:42:39.168440] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-06T22:42:39.188076] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-10-06T22:42:39.188430] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-06T22:42:39.190848] [INFO ] [MAIN ] Derivative Progress: 1300/2037 symbols completed. NQP took 1.0s. Estimated remaining: 4m 55s. Rate: 150.1 symbols/min [2025-10-06T22:42:39.191118] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:39.210248] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:39.213289] [INFO ] [MAIN ] NPWR: Generated 1794 derivative records from 42902 primary records. [2025-10-06T22:42:39.214690] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-10-06T22:42:39.230774] [DEBUG] [LOCAL ] NREF: Loaded 7894 existing records from primary storage. [2025-10-06T22:42:39.239614] [INFO ] [MAIN ] NREF: Loaded 7894 primary data records. [2025-10-06T22:42:39.276325] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:39.282186] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 32547 primary records. [2025-10-06T22:42:39.289959] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-06T22:42:39.340630] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1794 records). [2025-10-06T22:42:39.354111] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-10-06T22:42:39.368572] [INFO ] [MAIN ] Derivative Progress: 1301/2037 symbols completed. NPWR took 1.2s. Estimated remaining: 4m 54s. Rate: 150.2 symbols/min [2025-10-06T22:42:39.380587] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:39.460208] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-10-06T22:42:39.465286] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-06T22:42:39.621340] [INFO ] [MAIN ] Derivative Progress: 1302/2037 symbols completed. NRDY took 1.4s. Estimated remaining: 4m 54s. Rate: 150.2 symbols/min [2025-10-06T22:42:39.629373] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:39.662077] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:39.662917] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 7894 primary records. [2025-10-06T22:42:39.663146] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-06T22:42:39.688737] [DEBUG] [LOCAL ] NRK: Loaded 20025 existing records from primary storage. [2025-10-06T22:42:39.691954] [INFO ] [MAIN ] NRK: Loaded 20025 primary data records. [2025-10-06T22:42:39.810016] [DEBUG] [LOCAL ] NRGV: Loaded 43471 existing records from primary storage. [2025-10-06T22:42:39.822067] [INFO ] [MAIN ] NRGV: Loaded 43471 primary data records. [2025-10-06T22:42:39.821967] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-10-06T22:42:39.822406] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-06T22:42:39.861119] [INFO ] [MAIN ] Derivative Progress: 1303/2037 symbols completed. NREF took 0.7s. Estimated remaining: 4m 53s. Rate: 150.2 symbols/min [2025-10-06T22:42:40.344601] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:40.346180] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 20025 primary records. [2025-10-06T22:42:40.346481] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-06T22:42:40.366134] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-10-06T22:42:40.368054] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-10-06T22:42:40.370306] [INFO ] [MAIN ] Derivative Progress: 1304/2037 symbols completed. NRK took 0.7s. Estimated remaining: 4m 53s. Rate: 150.2 symbols/min [2025-10-06T22:42:40.383745] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:40.384312] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 43471 primary records. [2025-10-06T22:42:40.384370] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-06T22:42:40.399565] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-10-06T22:42:40.399624] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-06T22:42:40.402090] [INFO ] [MAIN ] Derivative Progress: 1305/2037 symbols completed. NRGV took 1.0s. Estimated remaining: 4m 52s. Rate: 150.3 symbols/min [2025-10-06T22:42:40.402475] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:40.402581] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:40.402888] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:40.414174] [DEBUG] [LOCAL ] NRUC: Loaded 3083 existing records from primary storage. [2025-10-06T22:42:40.413991] [DEBUG] [LOCAL ] NRP: Loaded 4101 existing records from primary storage. [2025-10-06T22:42:40.414449] [INFO ] [MAIN ] NRUC: Loaded 3083 primary data records. [2025-10-06T22:42:40.416845] [DEBUG] [LOCAL ] NRT: Loaded 4865 existing records from primary storage. [2025-10-06T22:42:40.416954] [INFO ] [MAIN ] NRT: Loaded 4865 primary data records. [2025-10-06T22:42:40.422187] [INFO ] [MAIN ] NRP: Loaded 4101 primary data records. [2025-10-06T22:42:41.451193] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:42:41.465487] [INFO ] [MAIN ] NRP: Generated 1793 derivative records from 4101 primary records. [2025-10-06T22:42:41.466132] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:41.467015] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4865 primary records. [2025-10-06T22:42:41.467196] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-06T22:42:41.467260] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-06T22:42:41.488420] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:41.499750] [INFO ] [MAIN ] NRUC: Generated 1794 derivative records from 3083 primary records. [2025-10-06T22:42:41.504376] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-10-06T22:42:41.523309] [DEBUG] [LOCAL ] NRP: Derivative data saved (1793 records). [2025-10-06T22:42:41.524241] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-06T22:42:41.527070] [INFO ] [MAIN ] Derivative Progress: 1306/2037 symbols completed. NRP took 1.1s. Estimated remaining: 4m 52s. Rate: 150.1 symbols/min [2025-10-06T22:42:41.527616] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:41.531187] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-10-06T22:42:41.531762] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-06T22:42:41.534560] [INFO ] [MAIN ] Derivative Progress: 1307/2037 symbols completed. NRT took 1.1s. Estimated remaining: 4m 52s. Rate: 150.2 symbols/min [2025-10-06T22:42:41.535129] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:41.537169] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1794 records). [2025-10-06T22:42:41.537513] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-10-06T22:42:41.541142] [INFO ] [MAIN ] Derivative Progress: 1308/2037 symbols completed. NRUC took 1.1s. Estimated remaining: 4m 51s. Rate: 150.3 symbols/min [2025-10-06T22:42:41.541516] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:41.565026] [DEBUG] [LOCAL ] NTB: Loaded 20092 existing records from primary storage. [2025-10-06T22:42:41.565284] [INFO ] [MAIN ] NTB: Loaded 20092 primary data records. [2025-10-06T22:42:41.741132] [DEBUG] [LOCAL ] NSP: Loaded 35149 existing records from primary storage. [2025-10-06T22:42:41.778632] [DEBUG] [LOCAL ] NSA: Loaded 44679 existing records from primary storage. [2025-10-06T22:42:41.799632] [INFO ] [MAIN ] NSP: Loaded 35149 primary data records. [2025-10-06T22:42:41.799950] [INFO ] [MAIN ] NSA: Loaded 44679 primary data records. [2025-10-06T22:42:42.656680] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:42.657828] [INFO ] [MAIN ] NTB: Generated 1794 derivative records from 20092 primary records. [2025-10-06T22:42:42.658105] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-10-06T22:42:42.697950] [DEBUG] [LOCAL ] NTB: Derivative data saved (1794 records). [2025-10-06T22:42:42.698551] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-10-06T22:42:42.701966] [INFO ] [MAIN ] Derivative Progress: 1309/2037 symbols completed. NTB took 1.2s. Estimated remaining: 4m 51s. Rate: 150.1 symbols/min [2025-10-06T22:42:42.702596] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:42.702743] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:42.704954] [INFO ] [MAIN ] NSA: Generated 1794 derivative records from 44679 primary records. [2025-10-06T22:42:42.705202] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-10-06T22:42:42.738622] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:42.740632] [INFO ] [MAIN ] NSP: Generated 1794 derivative records from 35149 primary records. [2025-10-06T22:42:42.741046] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-10-06T22:42:42.742638] [DEBUG] [LOCAL ] NSA: Derivative data saved (1794 records). [2025-10-06T22:42:42.743639] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-10-06T22:42:42.747590] [INFO ] [MAIN ] Derivative Progress: 1310/2037 symbols completed. NSA took 1.2s. Estimated remaining: 4m 50s. Rate: 150.2 symbols/min [2025-10-06T22:42:42.759325] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:42.766134] [DEBUG] [LOCAL ] NSP: Derivative data saved (1794 records). [2025-10-06T22:42:42.766216] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-10-06T22:42:42.769224] [INFO ] [MAIN ] Derivative Progress: 1311/2037 symbols completed. NSP took 1.2s. Estimated remaining: 4m 50s. Rate: 150.3 symbols/min [2025-10-06T22:42:42.769600] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:42.840524] [DEBUG] [LOCAL ] NTR: Loaded 52588 existing records from primary storage. [2025-10-06T22:42:42.840855] [INFO ] [MAIN ] NTR: Loaded 52588 primary data records. [2025-10-06T22:42:42.977750] [DEBUG] [LOCAL ] NTST: Loaded 43613 existing records from primary storage. [2025-10-06T22:42:42.989386] [INFO ] [MAIN ] NTST: Loaded 43613 primary data records. [2025-10-06T22:42:42.989261] [DEBUG] [LOCAL ] NUS: Loaded 36420 existing records from primary storage. [2025-10-06T22:42:42.995508] [INFO ] [MAIN ] NUS: Loaded 36420 primary data records. [2025-10-06T22:42:44.011269] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:44.018381] [INFO ] [MAIN ] NTST: Generated 1794 derivative records from 43613 primary records. [2025-10-06T22:42:44.018873] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:44.020572] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-10-06T22:42:44.020461] [INFO ] [MAIN ] NTR: Generated 1794 derivative records from 52588 primary records. [2025-10-06T22:42:44.021004] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-10-06T22:42:44.054397] [DEBUG] [LOCAL ] NTR: Derivative data saved (1794 records). [2025-10-06T22:42:44.054739] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-10-06T22:42:44.057389] [INFO ] [MAIN ] Derivative Progress: 1312/2037 symbols completed. NTR took 1.4s. Estimated remaining: 4m 50s. Rate: 150.1 symbols/min [2025-10-06T22:42:44.061508] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:44.063305] [DEBUG] [LOCAL ] NTST: Derivative data saved (1794 records). [2025-10-06T22:42:44.063972] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-10-06T22:42:44.067610] [INFO ] [MAIN ] Derivative Progress: 1313/2037 symbols completed. NTST took 1.3s. Estimated remaining: 4m 49s. Rate: 150.2 symbols/min [2025-10-06T22:42:44.067995] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:44.085291] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:44.086232] [INFO ] [MAIN ] NUS: Generated 1794 derivative records from 36420 primary records. [2025-10-06T22:42:44.086419] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-10-06T22:42:44.114064] [DEBUG] [LOCAL ] NUS: Derivative data saved (1794 records). [2025-10-06T22:42:44.114268] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-10-06T22:42:44.118012] [INFO ] [MAIN ] Derivative Progress: 1314/2037 symbols completed. NUS took 1.3s. Estimated remaining: 4m 49s. Rate: 150.3 symbols/min [2025-10-06T22:42:44.118418] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:44.129110] [DEBUG] [LOCAL ] NUV: Loaded 23678 existing records from primary storage. [2025-10-06T22:42:44.129298] [INFO ] [MAIN ] NUV: Loaded 23678 primary data records. [2025-10-06T22:42:44.231443] [DEBUG] [LOCAL ] NUW: Loaded 7214 existing records from primary storage. [2025-10-06T22:42:44.261469] [INFO ] [MAIN ] NUW: Loaded 7214 primary data records. [2025-10-06T22:42:44.330949] [DEBUG] [LOCAL ] NUVB: Loaded 51328 existing records from primary storage. [2025-10-06T22:42:44.336461] [INFO ] [MAIN ] NUVB: Loaded 51328 primary data records. [2025-10-06T22:42:45.222726] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:45.223895] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23678 primary records. [2025-10-06T22:42:45.224340] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-06T22:42:45.244617] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-10-06T22:42:45.244939] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-06T22:42:45.247722] [INFO ] [MAIN ] Derivative Progress: 1315/2037 symbols completed. NUV took 1.2s. Estimated remaining: 4m 49s. Rate: 150.1 symbols/min [2025-10-06T22:42:45.248065] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:45.274164] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:45.288309] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 7214 primary records. [2025-10-06T22:42:45.289176] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-06T22:42:45.289020] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:45.290675] [INFO ] [MAIN ] NUVB: Generated 1794 derivative records from 51328 primary records. [2025-10-06T22:42:45.291077] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-06T22:42:45.348759] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1794 records). [2025-10-06T22:42:45.349440] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-06T22:42:45.355317] [INFO ] [MAIN ] Derivative Progress: 1316/2037 symbols completed. NUVB took 1.3s. Estimated remaining: 4m 48s. Rate: 150.2 symbols/min [2025-10-06T22:42:45.350371] [DEBUG] [LOCAL ] NVG: Loaded 27517 existing records from primary storage. [2025-10-06T22:42:45.355998] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:45.356429] [INFO ] [MAIN ] NVG: Loaded 27517 primary data records. [2025-10-06T22:42:45.357887] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-10-06T22:42:45.363516] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-06T22:42:45.399503] [INFO ] [MAIN ] Derivative Progress: 1317/2037 symbols completed. NUW took 1.3s. Estimated remaining: 4m 47s. Rate: 150.3 symbols/min [2025-10-06T22:42:45.428773] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:45.713495] [DEBUG] [LOCAL ] NVGS: Loaded 30438 existing records from primary storage. [2025-10-06T22:42:45.713833] [INFO ] [MAIN ] NVGS: Loaded 30438 primary data records. [2025-10-06T22:42:46.120863] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-10-06T22:42:46.123364] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-10-06T22:42:46.172256] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:46.200900] [INFO ] [MAIN ] NVG: Generated 1794 derivative records from 27517 primary records. [2025-10-06T22:42:46.215995] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-06T22:42:46.364159] [DEBUG] [LOCAL ] NVG: Derivative data saved (1794 records). [2025-10-06T22:42:46.372339] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-10-06T22:42:46.375525] [INFO ] [MAIN ] Derivative Progress: 1318/2037 symbols completed. NVG took 1.1s. Estimated remaining: 4m 47s. Rate: 150.1 symbols/min [2025-10-06T22:42:46.518242] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:46.520220] [INFO ] [MAIN ] NVGS: Generated 1794 derivative records from 30438 primary records. [2025-10-06T22:42:46.520829] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-10-06T22:42:46.542494] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1794 records). [2025-10-06T22:42:46.542605] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-10-06T22:42:46.545672] [INFO ] [MAIN ] Derivative Progress: 1319/2037 symbols completed. NVGS took 1.2s. Estimated remaining: 4m 47s. Rate: 150.2 symbols/min [2025-10-06T22:42:46.564209] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:46.565059] [INFO ] [MAIN ] NVO: Generated 1794 derivative records from 53784 primary records. [2025-10-06T22:42:46.565128] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-10-06T22:42:46.582161] [DEBUG] [LOCAL ] NVO: Derivative data saved (1794 records). [2025-10-06T22:42:46.582258] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-10-06T22:42:46.586956] [INFO ] [MAIN ] Derivative Progress: 1320/2037 symbols completed. NVO took 1.2s. Estimated remaining: 4m 46s. Rate: 150.3 symbols/min [2025-10-06T22:42:46.587853] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:46.588078] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:46.588231] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:46.669769] [DEBUG] [LOCAL ] NVRI: Loaded 38760 existing records from primary storage. [2025-10-06T22:42:46.670970] [INFO ] [MAIN ] NVRI: Loaded 38760 primary data records. [2025-10-06T22:42:46.759996] [DEBUG] [LOCAL ] NVS: Loaded 51536 existing records from primary storage. [2025-10-06T22:42:46.806114] [INFO ] [MAIN ] NVS: Loaded 51536 primary data records. [2025-10-06T22:42:46.831298] [DEBUG] [LOCAL ] NVST: Loaded 51599 existing records from primary storage. [2025-10-06T22:42:46.919625] [INFO ] [MAIN ] NVST: Loaded 51599 primary data records. [2025-10-06T22:42:47.753177] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:47.769491] [INFO ] [MAIN ] NVRI: Generated 1794 derivative records from 38760 primary records. [2025-10-06T22:42:47.770255] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:47.770421] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-10-06T22:42:47.772915] [INFO ] [MAIN ] NVS: Generated 1794 derivative records from 51536 primary records. [2025-10-06T22:42:47.773241] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-10-06T22:42:47.810156] [DEBUG] [LOCAL ] NVS: Derivative data saved (1794 records). [2025-10-06T22:42:47.811911] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-10-06T22:42:47.814895] [INFO ] [MAIN ] Derivative Progress: 1321/2037 symbols completed. NVS took 1.2s. Estimated remaining: 4m 46s. Rate: 150.0 symbols/min [2025-10-06T22:42:47.815332] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:47.818409] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1794 records). [2025-10-06T22:42:47.819004] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-10-06T22:42:47.821450] [INFO ] [MAIN ] Derivative Progress: 1322/2037 symbols completed. NVRI took 1.2s. Estimated remaining: 4m 46s. Rate: 150.1 symbols/min [2025-10-06T22:42:47.830068] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:47.836356] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:47.842457] [INFO ] [MAIN ] NVST: Generated 1794 derivative records from 51599 primary records. [2025-10-06T22:42:47.842725] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-10-06T22:42:47.867570] [DEBUG] [LOCAL ] NVST: Derivative data saved (1794 records). [2025-10-06T22:42:47.869085] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-10-06T22:42:47.872747] [INFO ] [MAIN ] Derivative Progress: 1323/2037 symbols completed. NVST took 1.3s. Estimated remaining: 4m 45s. Rate: 150.2 symbols/min [2025-10-06T22:42:47.873324] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:47.956547] [DEBUG] [LOCAL ] NVT: Loaded 51506 existing records from primary storage. [2025-10-06T22:42:47.968011] [INFO ] [MAIN ] NVT: Loaded 51506 primary data records. [2025-10-06T22:42:47.969322] [DEBUG] [LOCAL ] NWG: Loaded 51460 existing records from primary storage. [2025-10-06T22:42:47.968576] [DEBUG] [LOCAL ] NWN: Loaded 26811 existing records from primary storage. [2025-10-06T22:42:47.969807] [INFO ] [MAIN ] NWG: Loaded 51460 primary data records. [2025-10-06T22:42:47.991374] [INFO ] [MAIN ] NWN: Loaded 26811 primary data records. [2025-10-06T22:42:49.101197] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:49.105301] [INFO ] [MAIN ] NVT: Generated 1794 derivative records from 51506 primary records. [2025-10-06T22:42:49.105834] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-10-06T22:42:49.135625] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:49.136686] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:49.148029] [INFO ] [MAIN ] NWN: Generated 1794 derivative records from 26811 primary records. [2025-10-06T22:42:49.146972] [INFO ] [MAIN ] NWG: Generated 1794 derivative records from 51460 primary records. [2025-10-06T22:42:49.152141] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-10-06T22:42:49.152291] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-10-06T22:42:49.192258] [DEBUG] [LOCAL ] NWG: Derivative data saved (1794 records). [2025-10-06T22:42:49.193823] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-10-06T22:42:49.199265] [INFO ] [MAIN ] Derivative Progress: 1324/2037 symbols completed. NWG took 1.4s. Estimated remaining: 4m 45s. Rate: 150.0 symbols/min [2025-10-06T22:42:49.199898] [DEBUG] [LOCAL ] NVT: Derivative data saved (1794 records). [2025-10-06T22:42:49.201708] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-10-06T22:42:49.201863] [DEBUG] [LOCAL ] NWN: Derivative data saved (1794 records). [2025-10-06T22:42:49.204246] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:49.204527] [INFO ] [MAIN ] Derivative Progress: 1325/2037 symbols completed. NVT took 1.4s. Estimated remaining: 4m 45s. Rate: 150.1 symbols/min [2025-10-06T22:42:49.205177] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:49.205001] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-10-06T22:42:49.209484] [INFO ] [MAIN ] Derivative Progress: 1326/2037 symbols completed. NWN took 1.3s. Estimated remaining: 4m 44s. Rate: 150.2 symbols/min [2025-10-06T22:42:49.210028] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:49.217299] [DEBUG] [LOCAL ] NXC: Loaded 4130 existing records from primary storage. [2025-10-06T22:42:49.217623] [INFO ] [MAIN ] NXC: Loaded 4130 primary data records. [2025-10-06T22:42:49.415587] [DEBUG] [LOCAL ] NXDT: Loaded 15527 existing records from primary storage. [2025-10-06T22:42:49.452509] [INFO ] [MAIN ] NXDT: Loaded 15527 primary data records. [2025-10-06T22:42:49.628561] [DEBUG] [LOCAL ] NX: Loaded 33137 existing records from primary storage. [2025-10-06T22:42:49.658499] [INFO ] [MAIN ] NX: Loaded 33137 primary data records. [2025-10-06T22:42:50.293347] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:50.296029] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4130 primary records. [2025-10-06T22:42:50.296186] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-06T22:42:50.319148] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-10-06T22:42:50.320057] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-06T22:42:50.323794] [INFO ] [MAIN ] Derivative Progress: 1327/2037 symbols completed. NXC took 1.1s. Estimated remaining: 4m 44s. Rate: 150.0 symbols/min [2025-10-06T22:42:50.324896] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:50.365804] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:50.366309] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:50.368749] [INFO ] [MAIN ] NX: Generated 1794 derivative records from 33137 primary records. [2025-10-06T22:42:50.368864] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-10-06T22:42:50.367786] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 15527 primary records. [2025-10-06T22:42:50.370037] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-06T22:42:50.418412] [DEBUG] [LOCAL ] NX: Derivative data saved (1794 records). [2025-10-06T22:42:50.418849] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-10-06T22:42:50.422058] [INFO ] [MAIN ] Derivative Progress: 1328/2037 symbols completed. NX took 1.2s. Estimated remaining: 4m 43s. Rate: 150.1 symbols/min [2025-10-06T22:42:50.422611] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:50.423527] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-10-06T22:42:50.424154] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-06T22:42:50.427515] [INFO ] [MAIN ] Derivative Progress: 1329/2037 symbols completed. NXDT took 1.2s. Estimated remaining: 4m 43s. Rate: 150.2 symbols/min [2025-10-06T22:42:50.428138] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:50.457588] [DEBUG] [LOCAL ] NXE: Loaded 53004 existing records from primary storage. [2025-10-06T22:42:50.458099] [INFO ] [MAIN ] NXE: Loaded 53004 primary data records. [2025-10-06T22:42:50.533254] [DEBUG] [LOCAL ] NXG: Loaded 10384 existing records from primary storage. [2025-10-06T22:42:50.570101] [INFO ] [MAIN ] NXG: Loaded 10384 primary data records. [2025-10-06T22:42:50.610782] [DEBUG] [LOCAL ] NXJ: Loaded 15010 existing records from primary storage. [2025-10-06T22:42:50.667839] [INFO ] [MAIN ] NXJ: Loaded 15010 primary data records. [2025-10-06T22:42:51.524114] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:51.525420] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 53004 primary records. [2025-10-06T22:42:51.525812] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-06T22:42:51.557728] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:51.564017] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10384 primary records. [2025-10-06T22:42:51.572407] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-06T22:42:51.578621] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:51.578169] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-10-06T22:42:51.580427] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 15010 primary records. [2025-10-06T22:42:51.579442] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-06T22:42:51.590554] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-06T22:42:51.590299] [INFO ] [MAIN ] Derivative Progress: 1330/2037 symbols completed. NXE took 1.3s. Estimated remaining: 4m 43s. Rate: 150.0 symbols/min [2025-10-06T22:42:51.610415] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:51.623330] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-10-06T22:42:51.623958] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-06T22:42:51.628435] [INFO ] [MAIN ] Derivative Progress: 1331/2037 symbols completed. NXG took 1.2s. Estimated remaining: 4m 42s. Rate: 150.1 symbols/min [2025-10-06T22:42:51.629490] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:51.631191] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-10-06T22:42:51.631382] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-10-06T22:42:51.635630] [INFO ] [MAIN ] Derivative Progress: 1332/2037 symbols completed. NXJ took 1.2s. Estimated remaining: 4m 42s. Rate: 150.2 symbols/min [2025-10-06T22:42:51.636185] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:51.638846] [DEBUG] [LOCAL ] NXN: Loaded 2315 existing records from primary storage. [2025-10-06T22:42:51.639360] [INFO ] [MAIN ] NXN: Loaded 2315 primary data records. [2025-10-06T22:42:51.780856] [DEBUG] [LOCAL ] NXP: Loaded 12444 existing records from primary storage. [2025-10-06T22:42:51.781802] [INFO ] [MAIN ] NXP: Loaded 12444 primary data records. [2025-10-06T22:42:51.923219] [DEBUG] [LOCAL ] NXRT: Loaded 18928 existing records from primary storage. [2025-10-06T22:42:51.961338] [INFO ] [MAIN ] NXRT: Loaded 18928 primary data records. [2025-10-06T22:42:52.749485] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:52.750541] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2315 primary records. [2025-10-06T22:42:52.751487] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-06T22:42:52.775324] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-10-06T22:42:52.775671] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-06T22:42:52.791476] [INFO ] [MAIN ] Derivative Progress: 1333/2037 symbols completed. NXN took 1.2s. Estimated remaining: 4m 42s. Rate: 150.0 symbols/min [2025-10-06T22:42:52.789035] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:52.792606] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12444 primary records. [2025-10-06T22:42:52.792779] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-06T22:42:52.822301] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:52.823205] [INFO ] [MAIN ] NXRT: Generated 1794 derivative records from 18928 primary records. [2025-10-06T22:42:52.823290] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-10-06T22:42:52.840244] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-10-06T22:42:52.840676] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-06T22:42:52.843943] [INFO ] [MAIN ] Derivative Progress: 1334/2037 symbols completed. NXP took 1.2s. Estimated remaining: 4m 41s. Rate: 150.1 symbols/min [2025-10-06T22:42:52.846400] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1794 records). [2025-10-06T22:42:52.846486] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-10-06T22:42:52.849824] [INFO ] [MAIN ] Derivative Progress: 1335/2037 symbols completed. NXRT took 1.2s. Estimated remaining: 4m 40s. Rate: 150.2 symbols/min [2025-10-06T22:42:52.850484] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:52.850905] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:52.850404] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:52.898682] [DEBUG] [LOCAL ] NZF: Loaded 29130 existing records from primary storage. [2025-10-06T22:42:52.899028] [INFO ] [MAIN ] NZF: Loaded 29130 primary data records. [2025-10-06T22:42:53.039858] [DEBUG] [LOCAL ] NYT: Loaded 49837 existing records from primary storage. [2025-10-06T22:42:53.055762] [INFO ] [MAIN ] NYT: Loaded 49837 primary data records. [2025-10-06T22:42:53.163211] [DEBUG] [LOCAL ] OBDC: Loaded 51661 existing records from primary storage. [2025-10-06T22:42:53.312015] [INFO ] [MAIN ] OBDC: Loaded 51661 primary data records. [2025-10-06T22:42:53.949919] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:53.951063] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 29130 primary records. [2025-10-06T22:42:53.951177] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-06T22:42:53.971777] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-10-06T22:42:53.972267] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-10-06T22:42:53.974928] [INFO ] [MAIN ] Derivative Progress: 1336/2037 symbols completed. NZF took 1.1s. Estimated remaining: 4m 40s. Rate: 150.0 symbols/min [2025-10-06T22:42:53.975121] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:53.997451] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:53.999465] [INFO ] [MAIN ] NYT: Generated 1794 derivative records from 49837 primary records. [2025-10-06T22:42:54.004082] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-10-06T22:42:54.018429] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:54.025860] [INFO ] [MAIN ] OBDC: Generated 1794 derivative records from 51661 primary records. [2025-10-06T22:42:54.026016] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-10-06T22:42:54.026435] [DEBUG] [LOCAL ] OBK: Loaded 16137 existing records from primary storage. [2025-10-06T22:42:54.038001] [INFO ] [MAIN ] OBK: Loaded 16137 primary data records. [2025-10-06T22:42:54.138309] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1794 records). [2025-10-06T22:42:54.144118] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-10-06T22:42:54.166044] [INFO ] [MAIN ] Derivative Progress: 1337/2037 symbols completed. OBDC took 1.3s. Estimated remaining: 4m 40s. Rate: 150.0 symbols/min [2025-10-06T22:42:54.167326] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:54.196903] [DEBUG] [LOCAL ] NYT: Derivative data saved (1794 records). [2025-10-06T22:42:54.249094] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-10-06T22:42:54.375889] [INFO ] [MAIN ] Derivative Progress: 1338/2037 symbols completed. NYT took 1.5s. Estimated remaining: 4m 39s. Rate: 150.1 symbols/min [2025-10-06T22:42:54.377339] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:54.393056] [DEBUG] [LOCAL ] OCFT: Loaded 7844 existing records from primary storage. [2025-10-06T22:42:54.393544] [INFO ] [MAIN ] OCFT: Loaded 7844 primary data records. [2025-10-06T22:42:54.567862] [DEBUG] [LOCAL ] OC: Loaded 44624 existing records from primary storage. [2025-10-06T22:42:54.634154] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:54.634282] [INFO ] [MAIN ] OC: Loaded 44624 primary data records. [2025-10-06T22:42:54.635120] [INFO ] [MAIN ] OBK: Generated 1794 derivative records from 16137 primary records. [2025-10-06T22:42:54.683960] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-10-06T22:42:54.984034] [DEBUG] [LOCAL ] OBK: Derivative data saved (1794 records). [2025-10-06T22:42:55.016862] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-10-06T22:42:55.048754] [INFO ] [MAIN ] Derivative Progress: 1339/2037 symbols completed. OBK took 1.1s. Estimated remaining: 4m 39s. Rate: 150.0 symbols/min [2025-10-06T22:42:55.155109] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:55.181691] [DEBUG] [LOCAL ] ODC: Loaded 8343 existing records from primary storage. [2025-10-06T22:42:55.182030] [INFO ] [MAIN ] ODC: Loaded 8343 primary data records. [2025-10-06T22:42:55.265870] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:55.297256] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 7844 primary records. [2025-10-06T22:42:55.305629] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-06T22:42:55.338029] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-10-06T22:42:55.338420] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-06T22:42:55.351770] [INFO ] [MAIN ] Derivative Progress: 1340/2037 symbols completed. OCFT took 1.0s. Estimated remaining: 4m 39s. Rate: 150.0 symbols/min [2025-10-06T22:42:55.381596] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:55.561218] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:55.562255] [INFO ] [MAIN ] OC: Generated 1794 derivative records from 44624 primary records. [2025-10-06T22:42:55.562983] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-10-06T22:42:55.593725] [DEBUG] [LOCAL ] OC: Derivative data saved (1794 records). [2025-10-06T22:42:55.594600] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-10-06T22:42:55.606743] [DEBUG] [LOCAL ] ODV: Loaded 27384 existing records from primary storage. [2025-10-06T22:42:55.605667] [INFO ] [MAIN ] Derivative Progress: 1341/2037 symbols completed. OC took 1.4s. Estimated remaining: 4m 38s. Rate: 150.1 symbols/min [2025-10-06T22:42:55.607180] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:55.607324] [INFO ] [MAIN ] ODV: Loaded 27384 primary data records. [2025-10-06T22:42:55.780460] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:55.833070] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8343 primary records. [2025-10-06T22:42:55.953385] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-06T22:42:55.980566] [DEBUG] [LOCAL ] OEC: Loaded 36886 existing records from primary storage. [2025-10-06T22:42:55.981676] [INFO ] [MAIN ] OEC: Loaded 36886 primary data records. [2025-10-06T22:42:56.029310] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-10-06T22:42:56.034905] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-06T22:42:56.054375] [INFO ] [MAIN ] Derivative Progress: 1342/2037 symbols completed. ODC took 0.9s. Estimated remaining: 4m 38s. Rate: 150.1 symbols/min [2025-10-06T22:42:56.094427] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:56.317347] [DEBUG] [LOCAL ] OFG: Loaded 21218 existing records from primary storage. [2025-10-06T22:42:56.317702] [INFO ] [MAIN ] OFG: Loaded 21218 primary data records. [2025-10-06T22:42:56.344815] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:56.357534] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 27384 primary records. [2025-10-06T22:42:56.374352] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-06T22:42:56.661833] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-10-06T22:42:56.661981] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-06T22:42:56.664715] [INFO ] [MAIN ] Derivative Progress: 1343/2037 symbols completed. ODV took 1.3s. Estimated remaining: 4m 38s. Rate: 150.0 symbols/min [2025-10-06T22:42:56.666068] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:56.687318] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:56.688160] [INFO ] [MAIN ] OEC: Generated 1794 derivative records from 36886 primary records. [2025-10-06T22:42:56.688288] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-10-06T22:42:56.709475] [DEBUG] [LOCAL ] OEC: Derivative data saved (1794 records). [2025-10-06T22:42:56.709907] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-10-06T22:42:56.712756] [INFO ] [MAIN ] Derivative Progress: 1344/2037 symbols completed. OEC took 1.1s. Estimated remaining: 4m 37s. Rate: 150.1 symbols/min [2025-10-06T22:42:56.712939] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:56.742152] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:56.742942] [INFO ] [MAIN ] OFG: Generated 1794 derivative records from 21218 primary records. [2025-10-06T22:42:56.743064] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-10-06T22:42:56.774806] [DEBUG] [LOCAL ] OGE: Loaded 46258 existing records from primary storage. [2025-10-06T22:42:56.782584] [INFO ] [MAIN ] OGE: Loaded 46258 primary data records. [2025-10-06T22:42:56.795613] [DEBUG] [LOCAL ] OFG: Derivative data saved (1794 records). [2025-10-06T22:42:56.820729] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-10-06T22:42:56.831216] [INFO ] [MAIN ] Derivative Progress: 1345/2037 symbols completed. OFG took 0.7s. Estimated remaining: 4m 36s. Rate: 150.2 symbols/min [2025-10-06T22:42:56.853411] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:56.907018] [DEBUG] [LOCAL ] OGS: Loaded 34301 existing records from primary storage. [2025-10-06T22:42:56.907440] [INFO ] [MAIN ] OGS: Loaded 34301 primary data records. [2025-10-06T22:42:57.496082] [DEBUG] [LOCAL ] OHI: Loaded 51954 existing records from primary storage. [2025-10-06T22:42:57.497521] [INFO ] [MAIN ] OHI: Loaded 51954 primary data records. [2025-10-06T22:42:57.701995] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:57.827009] [INFO ] [MAIN ] OGE: Generated 1794 derivative records from 46258 primary records. [2025-10-06T22:42:57.827352] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-10-06T22:42:57.863986] [DEBUG] [LOCAL ] OGE: Derivative data saved (1794 records). [2025-10-06T22:42:57.863537] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:57.864149] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-10-06T22:42:57.867502] [INFO ] [MAIN ] Derivative Progress: 1346/2037 symbols completed. OGE took 1.2s. Estimated remaining: 4m 36s. Rate: 150.0 symbols/min [2025-10-06T22:42:57.867746] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:57.864961] [INFO ] [MAIN ] OGS: Generated 1794 derivative records from 34301 primary records. [2025-10-06T22:42:57.868010] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-10-06T22:42:57.887841] [DEBUG] [LOCAL ] OGS: Derivative data saved (1794 records). [2025-10-06T22:42:57.888229] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-10-06T22:42:57.891431] [INFO ] [MAIN ] Derivative Progress: 1347/2037 symbols completed. OGS took 1.2s. Estimated remaining: 4m 36s. Rate: 150.1 symbols/min [2025-10-06T22:42:57.891937] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:57.909177] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:57.910064] [INFO ] [MAIN ] OHI: Generated 1794 derivative records from 51954 primary records. [2025-10-06T22:42:57.910245] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-10-06T22:42:57.945115] [DEBUG] [LOCAL ] OIA: Loaded 13637 existing records from primary storage. [2025-10-06T22:42:57.946103] [INFO ] [MAIN ] OIA: Loaded 13637 primary data records. [2025-10-06T22:42:57.959625] [DEBUG] [LOCAL ] OHI: Derivative data saved (1794 records). [2025-10-06T22:42:57.985924] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-10-06T22:42:58.023395] [INFO ] [MAIN ] Derivative Progress: 1348/2037 symbols completed. OHI took 1.2s. Estimated remaining: 4m 35s. Rate: 150.2 symbols/min [2025-10-06T22:42:58.069452] [DEBUG] [LOCAL ] OI: Loaded 47053 existing records from primary storage. [2025-10-06T22:42:58.072230] [INFO ] [MAIN ] OI: Loaded 47053 primary data records. [2025-10-06T22:42:58.599078] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:58.599925] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13637 primary records. [2025-10-06T22:42:58.600131] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-06T22:42:58.621631] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-10-06T22:42:58.621815] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-06T22:42:58.624218] [INFO ] [MAIN ] Derivative Progress: 1349/2037 symbols completed. OIA took 0.7s. Estimated remaining: 4m 35s. Rate: 150.1 symbols/min [2025-10-06T22:42:58.638009] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:58.639408] [INFO ] [MAIN ] OI: Generated 1794 derivative records from 47053 primary records. [2025-10-06T22:42:58.639511] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-10-06T22:42:58.656077] [DEBUG] [LOCAL ] OI: Derivative data saved (1794 records). [2025-10-06T22:42:58.656151] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-10-06T22:42:58.658847] [INFO ] [MAIN ] Derivative Progress: 1350/2037 symbols completed. OI took 0.8s. Estimated remaining: 4m 34s. Rate: 150.2 symbols/min [2025-10-06T22:42:58.659316] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:58.659423] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:58.659512] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:58.738639] [DEBUG] [LOCAL ] OIS: Loaded 40226 existing records from primary storage. [2025-10-06T22:42:58.738923] [INFO ] [MAIN ] OIS: Loaded 40226 primary data records. [2025-10-06T22:42:58.744871] [DEBUG] [LOCAL ] OII: Loaded 42297 existing records from primary storage. [2025-10-06T22:42:58.771749] [INFO ] [MAIN ] OII: Loaded 42297 primary data records. [2025-10-06T22:42:58.905612] [DEBUG] [LOCAL ] OLN: Loaded 51821 existing records from primary storage. [2025-10-06T22:42:58.953142] [INFO ] [MAIN ] OLN: Loaded 51821 primary data records. [2025-10-06T22:42:59.746426] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:59.746729] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:59.761194] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 40226 primary records. [2025-10-06T22:42:59.760253] [INFO ] [MAIN ] OII: Generated 1794 derivative records from 42297 primary records. [2025-10-06T22:42:59.760593] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:42:59.761305] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-10-06T22:42:59.761974] [INFO ] [MAIN ] OLN: Generated 1794 derivative records from 51821 primary records. [2025-10-06T22:42:59.762770] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-10-06T22:42:59.763398] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-06T22:42:59.790470] [DEBUG] [LOCAL ] OII: Derivative data saved (1794 records). [2025-10-06T22:42:59.790578] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-10-06T22:42:59.795242] [INFO ] [MAIN ] Derivative Progress: 1351/2037 symbols completed. OII took 1.1s. Estimated remaining: 4m 34s. Rate: 150.0 symbols/min [2025-10-06T22:42:59.803455] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:59.813962] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-10-06T22:42:59.815710] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-06T22:42:59.815770] [DEBUG] [LOCAL ] OLN: Derivative data saved (1794 records). [2025-10-06T22:42:59.817894] [INFO ] [MAIN ] Derivative Progress: 1352/2037 symbols completed. OIS took 1.2s. Estimated remaining: 4m 34s. Rate: 150.1 symbols/min [2025-10-06T22:42:59.817959] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-10-06T22:42:59.818141] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:59.821625] [INFO ] [MAIN ] Derivative Progress: 1353/2037 symbols completed. OLN took 1.2s. Estimated remaining: 4m 33s. Rate: 150.3 symbols/min [2025-10-06T22:42:59.822168] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:42:59.831788] [DEBUG] [LOCAL ] OLP: Loaded 9941 existing records from primary storage. [2025-10-06T22:42:59.832043] [INFO ] [MAIN ] OLP: Loaded 9941 primary data records. [2025-10-06T22:43:00.188627] [DEBUG] [LOCAL ] OMI: Loaded 45904 existing records from primary storage. [2025-10-06T22:43:00.190322] [DEBUG] [LOCAL ] OMF: Loaded 46267 existing records from primary storage. [2025-10-06T22:43:00.189522] [INFO ] [MAIN ] OMI: Loaded 45904 primary data records. [2025-10-06T22:43:00.191714] [INFO ] [MAIN ] OMF: Loaded 46267 primary data records. [2025-10-06T22:43:00.895147] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:00.897457] [INFO ] [MAIN ] OLP: Generated 1794 derivative records from 9941 primary records. [2025-10-06T22:43:00.897775] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-06T22:43:00.917688] [DEBUG] [LOCAL ] OLP: Derivative data saved (1794 records). [2025-10-06T22:43:00.919035] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-06T22:43:00.921689] [INFO ] [MAIN ] Derivative Progress: 1354/2037 symbols completed. OLP took 1.1s. Estimated remaining: 4m 33s. Rate: 150.1 symbols/min [2025-10-06T22:43:00.923537] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:00.940147] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:00.943957] [INFO ] [MAIN ] OMI: Generated 1794 derivative records from 45904 primary records. [2025-10-06T22:43:00.944253] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-10-06T22:43:00.975117] [DEBUG] [LOCAL ] ONIT: Loaded 7741 existing records from primary storage. [2025-10-06T22:43:00.977054] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:00.979259] [INFO ] [MAIN ] ONIT: Loaded 7741 primary data records. [2025-10-06T22:43:00.980385] [DEBUG] [LOCAL ] OMI: Derivative data saved (1794 records). [2025-10-06T22:43:01.002816] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-10-06T22:43:01.018466] [INFO ] [MAIN ] Derivative Progress: 1355/2037 symbols completed. OMI took 1.2s. Estimated remaining: 4m 33s. Rate: 150.1 symbols/min [2025-10-06T22:43:01.032158] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:01.002694] [INFO ] [MAIN ] OMF: Generated 1794 derivative records from 46267 primary records. [2025-10-06T22:43:01.055620] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-10-06T22:43:01.162638] [DEBUG] [LOCAL ] OMF: Derivative data saved (1794 records). [2025-10-06T22:43:01.330305] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-10-06T22:43:01.334626] [INFO ] [MAIN ] Derivative Progress: 1356/2037 symbols completed. OMF took 1.5s. Estimated remaining: 4m 32s. Rate: 150.2 symbols/min [2025-10-06T22:43:01.335004] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:01.347107] [DEBUG] [LOCAL ] ONL: Loaded 30131 existing records from primary storage. [2025-10-06T22:43:01.347325] [INFO ] [MAIN ] ONL: Loaded 30131 primary data records. [2025-10-06T22:43:01.702878] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-10-06T22:43:01.704813] [INFO ] [MAIN ] ONON: Loaded 53613 primary data records. [2025-10-06T22:43:01.807723] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:01.834998] [INFO ] [MAIN ] ONIT: Generated 1794 derivative records from 7741 primary records. [2025-10-06T22:43:01.852549] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-06T22:43:02.066673] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1794 records). [2025-10-06T22:43:02.073071] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:02.073325] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-06T22:43:02.077187] [INFO ] [MAIN ] Derivative Progress: 1357/2037 symbols completed. ONIT took 1.2s. Estimated remaining: 4m 32s. Rate: 150.1 symbols/min [2025-10-06T22:43:02.078112] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 30131 primary records. [2025-10-06T22:43:02.078364] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:02.079331] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-06T22:43:02.098411] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-10-06T22:43:02.098677] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-06T22:43:02.101906] [INFO ] [MAIN ] Derivative Progress: 1358/2037 symbols completed. ONL took 1.1s. Estimated remaining: 4m 31s. Rate: 150.2 symbols/min [2025-10-06T22:43:02.102075] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:02.121888] [DEBUG] [LOCAL ] ONTF: Loaded 22433 existing records from primary storage. [2025-10-06T22:43:02.122213] [INFO ] [MAIN ] ONTF: Loaded 22433 primary data records. [2025-10-06T22:43:02.278142] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:02.336560] [INFO ] [MAIN ] ONON: Generated 1794 derivative records from 53613 primary records. [2025-10-06T22:43:02.455517] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-10-06T22:43:02.487382] [DEBUG] [LOCAL ] ONON: Derivative data saved (1794 records). [2025-10-06T22:43:02.488964] [DEBUG] [LOCAL ] ONTO: Loaded 46896 existing records from primary storage. [2025-10-06T22:43:02.489240] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-10-06T22:43:02.492333] [INFO ] [MAIN ] Derivative Progress: 1359/2037 symbols completed. ONON took 1.2s. Estimated remaining: 4m 31s. Rate: 150.2 symbols/min [2025-10-06T22:43:02.489673] [INFO ] [MAIN ] ONTO: Loaded 46896 primary data records. [2025-10-06T22:43:02.492618] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:02.890344] [DEBUG] [LOCAL ] OOMA: Loaded 18660 existing records from primary storage. [2025-10-06T22:43:02.890548] [INFO ] [MAIN ] OOMA: Loaded 18660 primary data records. [2025-10-06T22:43:03.042034] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:03.064221] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 22433 primary records. [2025-10-06T22:43:03.064429] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-06T22:43:03.251452] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-10-06T22:43:03.251600] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-06T22:43:03.254392] [INFO ] [MAIN ] Derivative Progress: 1360/2037 symbols completed. ONTF took 1.2s. Estimated remaining: 4m 31s. Rate: 150.1 symbols/min [2025-10-06T22:43:03.254697] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:03.276435] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:03.278255] [INFO ] [MAIN ] ONTO: Generated 1794 derivative records from 46896 primary records. [2025-10-06T22:43:03.278536] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-10-06T22:43:03.308974] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1794 records). [2025-10-06T22:43:03.317412] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-10-06T22:43:03.326366] [DEBUG] [LOCAL ] OPAD: Loaded 22813 existing records from primary storage. [2025-10-06T22:43:03.335045] [INFO ] [MAIN ] OPAD: Loaded 22813 primary data records. [2025-10-06T22:43:03.334905] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:03.334198] [INFO ] [MAIN ] Derivative Progress: 1361/2037 symbols completed. ONTO took 1.2s. Estimated remaining: 4m 30s. Rate: 150.2 symbols/min [2025-10-06T22:43:03.340895] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:03.360846] [INFO ] [MAIN ] OOMA: Generated 1794 derivative records from 18660 primary records. [2025-10-06T22:43:03.372157] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-10-06T22:43:03.461024] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1794 records). [2025-10-06T22:43:03.461258] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-10-06T22:43:03.475006] [INFO ] [MAIN ] Derivative Progress: 1362/2037 symbols completed. OOMA took 1.0s. Estimated remaining: 4m 30s. Rate: 150.2 symbols/min [2025-10-06T22:43:03.480516] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:03.690494] [DEBUG] [LOCAL ] OPP: Loaded 11702 existing records from primary storage. [2025-10-06T22:43:03.690729] [INFO ] [MAIN ] OPP: Loaded 11702 primary data records. [2025-10-06T22:43:03.838100] [DEBUG] [LOCAL ] OPFI: Loaded 46414 existing records from primary storage. [2025-10-06T22:43:03.844481] [INFO ] [MAIN ] OPFI: Loaded 46414 primary data records. [2025-10-06T22:43:04.400990] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:04.402614] [INFO ] [MAIN ] OPAD: Generated 1794 derivative records from 22813 primary records. [2025-10-06T22:43:04.404149] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-06T22:43:04.425083] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1794 records). [2025-10-06T22:43:04.426222] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-06T22:43:04.429015] [INFO ] [MAIN ] Derivative Progress: 1363/2037 symbols completed. OPAD took 1.2s. Estimated remaining: 4m 29s. Rate: 150.1 symbols/min [2025-10-06T22:43:04.448831] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:04.449846] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 11702 primary records. [2025-10-06T22:43:04.450114] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-06T22:43:04.471550] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-10-06T22:43:04.471966] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-06T22:43:04.474718] [INFO ] [MAIN ] Derivative Progress: 1364/2037 symbols completed. OPP took 1.0s. Estimated remaining: 4m 29s. Rate: 150.2 symbols/min [2025-10-06T22:43:04.495469] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:04.496436] [INFO ] [MAIN ] OPFI: Generated 1794 derivative records from 46414 primary records. [2025-10-06T22:43:04.496520] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-10-06T22:43:04.512835] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1794 records). [2025-10-06T22:43:04.512953] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-10-06T22:43:04.515990] [INFO ] [MAIN ] Derivative Progress: 1365/2037 symbols completed. OPFI took 1.2s. Estimated remaining: 4m 28s. Rate: 150.3 symbols/min [2025-10-06T22:43:04.516533] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:04.516476] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:04.516787] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:04.590074] [DEBUG] [LOCAL ] ORA: Loaded 32689 existing records from primary storage. [2025-10-06T22:43:04.590462] [INFO ] [MAIN ] ORA: Loaded 32689 primary data records. [2025-10-06T22:43:04.700120] [DEBUG] [LOCAL ] OR: Loaded 46259 existing records from primary storage. [2025-10-06T22:43:04.734694] [INFO ] [MAIN ] OR: Loaded 46259 primary data records. [2025-10-06T22:43:04.747152] [DEBUG] [LOCAL ] ORC: Loaded 52443 existing records from primary storage. [2025-10-06T22:43:04.855440] [INFO ] [MAIN ] ORC: Loaded 52443 primary data records. [2025-10-06T22:43:05.652764] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:05.654214] [INFO ] [MAIN ] ORA: Generated 1794 derivative records from 32689 primary records. [2025-10-06T22:43:05.654567] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-10-06T22:43:05.674793] [DEBUG] [LOCAL ] ORA: Derivative data saved (1794 records). [2025-10-06T22:43:05.675264] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-10-06T22:43:05.679671] [INFO ] [MAIN ] Derivative Progress: 1366/2037 symbols completed. ORA took 1.2s. Estimated remaining: 4m 28s. Rate: 150.1 symbols/min [2025-10-06T22:43:05.680770] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:05.696179] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:05.697003] [INFO ] [MAIN ] OR: Generated 1794 derivative records from 46259 primary records. [2025-10-06T22:43:05.697345] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-10-06T22:43:05.716486] [DEBUG] [LOCAL ] OR: Derivative data saved (1794 records). [2025-10-06T22:43:05.717768] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-10-06T22:43:05.720975] [INFO ] [MAIN ] Derivative Progress: 1367/2037 symbols completed. OR took 1.2s. Estimated remaining: 4m 28s. Rate: 150.2 symbols/min [2025-10-06T22:43:05.722122] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:05.739027] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:05.749062] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52443 primary records. [2025-10-06T22:43:05.749316] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-06T22:43:05.776564] [DEBUG] [LOCAL ] ORN: Loaded 30826 existing records from primary storage. [2025-10-06T22:43:05.776827] [INFO ] [MAIN ] ORN: Loaded 30826 primary data records. [2025-10-06T22:43:05.776062] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-10-06T22:43:05.776971] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-06T22:43:05.785299] [INFO ] [MAIN ] Derivative Progress: 1368/2037 symbols completed. ORC took 1.3s. Estimated remaining: 4m 27s. Rate: 150.3 symbols/min [2025-10-06T22:43:05.806478] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:06.138623] [DEBUG] [LOCAL ] OUT: Loaded 47809 existing records from primary storage. [2025-10-06T22:43:06.139009] [INFO ] [MAIN ] OUT: Loaded 47809 primary data records. [2025-10-06T22:43:06.294798] [DEBUG] [LOCAL ] OVV: Loaded 53516 existing records from primary storage. [2025-10-06T22:43:06.316841] [INFO ] [MAIN ] OVV: Loaded 53516 primary data records. [2025-10-06T22:43:06.835309] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:06.836461] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 30826 primary records. [2025-10-06T22:43:06.836791] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-06T22:43:06.867281] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-10-06T22:43:06.867918] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-06T22:43:06.870743] [INFO ] [MAIN ] Derivative Progress: 1369/2037 symbols completed. ORN took 1.2s. Estimated remaining: 4m 27s. Rate: 150.1 symbols/min [2025-10-06T22:43:06.879618] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:06.886246] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:06.889099] [INFO ] [MAIN ] OUT: Generated 1794 derivative records from 47809 primary records. [2025-10-06T22:43:06.889305] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-10-06T22:43:06.922806] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:06.925456] [INFO ] [MAIN ] OVV: Generated 1794 derivative records from 53516 primary records. [2025-10-06T22:43:06.926244] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-10-06T22:43:06.938976] [DEBUG] [LOCAL ] OUT: Derivative data saved (1794 records). [2025-10-06T22:43:06.942994] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-10-06T22:43:06.946057] [INFO ] [MAIN ] Derivative Progress: 1370/2037 symbols completed. OUT took 1.2s. Estimated remaining: 4m 27s. Rate: 150.2 symbols/min [2025-10-06T22:43:06.946823] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:06.968034] [DEBUG] [LOCAL ] OVV: Derivative data saved (1794 records). [2025-10-06T22:43:06.968365] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-10-06T22:43:06.972028] [INFO ] [MAIN ] Derivative Progress: 1371/2037 symbols completed. OVV took 1.2s. Estimated remaining: 4m 26s. Rate: 150.3 symbols/min [2025-10-06T22:43:06.975388] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:06.982147] [DEBUG] [LOCAL ] OWLT: Loaded 8988 existing records from primary storage. [2025-10-06T22:43:06.982467] [INFO ] [MAIN ] OWLT: Loaded 8988 primary data records. [2025-10-06T22:43:07.116014] [DEBUG] [LOCAL ] OWL: Loaded 53556 existing records from primary storage. [2025-10-06T22:43:07.133179] [INFO ] [MAIN ] OWL: Loaded 53556 primary data records. [2025-10-06T22:43:07.501797] [DEBUG] [LOCAL ] OXM: Loaded 33171 existing records from primary storage. [2025-10-06T22:43:07.522975] [INFO ] [MAIN ] OXM: Loaded 33171 primary data records. [2025-10-06T22:43:08.073876] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:08.075484] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 8988 primary records. [2025-10-06T22:43:08.075592] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-06T22:43:08.099604] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-10-06T22:43:08.099998] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-06T22:43:08.102430] [INFO ] [MAIN ] Derivative Progress: 1372/2037 symbols completed. OWLT took 1.2s. Estimated remaining: 4m 26s. Rate: 150.1 symbols/min [2025-10-06T22:43:08.102804] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:08.119525] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:08.120950] [INFO ] [MAIN ] OWL: Generated 1794 derivative records from 53556 primary records. [2025-10-06T22:43:08.121345] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-10-06T22:43:08.165163] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:08.166826] [INFO ] [MAIN ] OXM: Generated 1794 derivative records from 33171 primary records. [2025-10-06T22:43:08.168261] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-10-06T22:43:08.178312] [DEBUG] [LOCAL ] OWL: Derivative data saved (1794 records). [2025-10-06T22:43:08.180339] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-10-06T22:43:08.186391] [INFO ] [MAIN ] Derivative Progress: 1373/2037 symbols completed. OWL took 1.3s. Estimated remaining: 4m 25s. Rate: 150.1 symbols/min [2025-10-06T22:43:08.186695] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:08.206721] [DEBUG] [LOCAL ] OXM: Derivative data saved (1794 records). [2025-10-06T22:43:08.210475] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-10-06T22:43:08.213325] [INFO ] [MAIN ] Derivative Progress: 1374/2037 symbols completed. OXM took 1.2s. Estimated remaining: 4m 25s. Rate: 150.2 symbols/min [2025-10-06T22:43:08.213594] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:08.222194] [DEBUG] [LOCAL ] PAC: Loaded 11550 existing records from primary storage. [2025-10-06T22:43:08.222456] [INFO ] [MAIN ] PAC: Loaded 11550 primary data records. [2025-10-06T22:43:08.276712] [DEBUG] [LOCAL ] PAAS: Loaded 53605 existing records from primary storage. [2025-10-06T22:43:08.306173] [INFO ] [MAIN ] PAAS: Loaded 53605 primary data records. [2025-10-06T22:43:08.596613] [DEBUG] [LOCAL ] PACK: Loaded 31829 existing records from primary storage. [2025-10-06T22:43:08.759556] [INFO ] [MAIN ] PACK: Loaded 31829 primary data records. [2025-10-06T22:43:09.334103] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:09.343048] [INFO ] [MAIN ] PAC: Generated 1794 derivative records from 11550 primary records. [2025-10-06T22:43:09.348594] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-06T22:43:09.348971] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:09.350485] [INFO ] [MAIN ] PAAS: Generated 1794 derivative records from 53605 primary records. [2025-10-06T22:43:09.352539] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-10-06T22:43:09.388517] [DEBUG] [LOCAL ] PAC: Derivative data saved (1794 records). [2025-10-06T22:43:09.389926] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-06T22:43:09.393020] [INFO ] [MAIN ] Derivative Progress: 1375/2037 symbols completed. PAC took 1.2s. Estimated remaining: 4m 25s. Rate: 150.0 symbols/min [2025-10-06T22:43:09.394350] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:09.396346] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1794 records). [2025-10-06T22:43:09.399015] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-10-06T22:43:09.402563] [INFO ] [MAIN ] Derivative Progress: 1376/2037 symbols completed. PAAS took 1.3s. Estimated remaining: 4m 24s. Rate: 150.1 symbols/min [2025-10-06T22:43:09.403210] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:09.419210] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:09.420575] [INFO ] [MAIN ] PACK: Generated 1794 derivative records from 31829 primary records. [2025-10-06T22:43:09.420872] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-06T22:43:09.445869] [DEBUG] [LOCAL ] PACK: Derivative data saved (1794 records). [2025-10-06T22:43:09.446144] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-06T22:43:09.449438] [INFO ] [MAIN ] Derivative Progress: 1377/2037 symbols completed. PACK took 1.2s. Estimated remaining: 4m 24s. Rate: 150.2 symbols/min [2025-10-06T22:43:09.449762] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:09.469433] [DEBUG] [LOCAL ] PAG: Loaded 21658 existing records from primary storage. [2025-10-06T22:43:09.469743] [INFO ] [MAIN ] PAG: Loaded 21658 primary data records. [2025-10-06T22:43:09.587338] [DEBUG] [LOCAL ] PACS: Loaded 34501 existing records from primary storage. [2025-10-06T22:43:09.604721] [INFO ] [MAIN ] PACS: Loaded 34501 primary data records. [2025-10-06T22:43:09.969868] [DEBUG] [LOCAL ] PAGS: Loaded 52717 existing records from primary storage. [2025-10-06T22:43:10.072182] [INFO ] [MAIN ] PAGS: Loaded 52717 primary data records. [2025-10-06T22:43:10.496880] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:10.498177] [INFO ] [MAIN ] PAG: Generated 1794 derivative records from 21658 primary records. [2025-10-06T22:43:10.498764] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-10-06T22:43:10.544077] [DEBUG] [LOCAL ] PAG: Derivative data saved (1794 records). [2025-10-06T22:43:10.544220] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-10-06T22:43:10.549533] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:10.551182] [INFO ] [MAIN ] PACS: Generated 1794 derivative records from 34501 primary records. [2025-10-06T22:43:10.551561] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-10-06T22:43:10.546889] [INFO ] [MAIN ] Derivative Progress: 1378/2037 symbols completed. PAG took 1.1s. Estimated remaining: 4m 24s. Rate: 150.0 symbols/min [2025-10-06T22:43:10.572202] [DEBUG] [LOCAL ] PACS: Derivative data saved (1794 records). [2025-10-06T22:43:10.572494] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-10-06T22:43:10.575498] [INFO ] [MAIN ] Derivative Progress: 1379/2037 symbols completed. PACS took 1.2s. Estimated remaining: 4m 23s. Rate: 150.1 symbols/min [2025-10-06T22:43:10.593134] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:10.593921] [INFO ] [MAIN ] PAGS: Generated 1794 derivative records from 52717 primary records. [2025-10-06T22:43:10.593983] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-10-06T22:43:10.610732] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1794 records). [2025-10-06T22:43:10.610842] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-10-06T22:43:10.614689] [INFO ] [MAIN ] Derivative Progress: 1380/2037 symbols completed. PAGS took 1.2s. Estimated remaining: 4m 22s. Rate: 150.2 symbols/min [2025-10-06T22:43:10.615345] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:10.615675] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:10.615505] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:10.623478] [DEBUG] [LOCAL ] PAI: Loaded 2671 existing records from primary storage. [2025-10-06T22:43:10.623707] [INFO ] [MAIN ] PAI: Loaded 2671 primary data records. [2025-10-06T22:43:10.849218] [DEBUG] [LOCAL ] PAM: Loaded 28113 existing records from primary storage. [2025-10-06T22:43:10.875414] [INFO ] [MAIN ] PAM: Loaded 28113 primary data records. [2025-10-06T22:43:10.898413] [DEBUG] [LOCAL ] PAR: Loaded 33107 existing records from primary storage. [2025-10-06T22:43:10.920868] [INFO ] [MAIN ] PAR: Loaded 33107 primary data records. [2025-10-06T22:43:11.711309] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:11.713156] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2671 primary records. [2025-10-06T22:43:11.714260] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-06T22:43:11.730247] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-10-06T22:43:11.731242] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-06T22:43:11.734451] [INFO ] [MAIN ] Derivative Progress: 1381/2037 symbols completed. PAI took 1.1s. Estimated remaining: 4m 22s. Rate: 150.1 symbols/min [2025-10-06T22:43:11.734859] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:11.749665] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:11.750454] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 28113 primary records. [2025-10-06T22:43:11.750680] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-06T22:43:11.770472] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-10-06T22:43:11.784362] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-10-06T22:43:11.788198] [INFO ] [MAIN ] Derivative Progress: 1382/2037 symbols completed. PAM took 1.2s. Estimated remaining: 4m 22s. Rate: 150.1 symbols/min [2025-10-06T22:43:11.788515] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:11.789300] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:11.790297] [INFO ] [MAIN ] PAR: Generated 1794 derivative records from 33107 primary records. [2025-10-06T22:43:11.790468] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-10-06T22:43:11.818758] [DEBUG] [LOCAL ] PAR: Derivative data saved (1794 records). [2025-10-06T22:43:11.819215] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-10-06T22:43:11.822694] [INFO ] [MAIN ] Derivative Progress: 1383/2037 symbols completed. PAR took 1.2s. Estimated remaining: 4m 21s. Rate: 150.2 symbols/min [2025-10-06T22:43:11.823223] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:11.843180] [DEBUG] [LOCAL ] PARR: Loaded 48330 existing records from primary storage. [2025-10-06T22:43:11.845317] [INFO ] [MAIN ] PARR: Loaded 48330 primary data records. [2025-10-06T22:43:12.036281] [DEBUG] [LOCAL ] PAXS: Loaded 20787 existing records from primary storage. [2025-10-06T22:43:12.185171] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-10-06T22:43:12.185410] [INFO ] [MAIN ] PAXS: Loaded 20787 primary data records. [2025-10-06T22:43:12.194317] [INFO ] [MAIN ] PATH: Loaded 53678 primary data records. [2025-10-06T22:43:12.936396] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:12.939537] [INFO ] [MAIN ] PARR: Generated 1794 derivative records from 48330 primary records. [2025-10-06T22:43:12.939795] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-10-06T22:43:12.962199] [DEBUG] [LOCAL ] PARR: Derivative data saved (1794 records). [2025-10-06T22:43:12.962463] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-10-06T22:43:12.965276] [INFO ] [MAIN ] Derivative Progress: 1384/2037 symbols completed. PARR took 1.2s. Estimated remaining: 4m 21s. Rate: 150.0 symbols/min [2025-10-06T22:43:12.966990] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:12.987807] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:12.988698] [INFO ] [MAIN ] PATH: Generated 1794 derivative records from 53678 primary records. [2025-10-06T22:43:12.988784] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-10-06T22:43:13.023867] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:13.025996] [DEBUG] [LOCAL ] PATH: Derivative data saved (1794 records). [2025-10-06T22:43:13.040509] [INFO ] [MAIN ] PAXS: Generated 1794 derivative records from 20787 primary records. [2025-10-06T22:43:13.040818] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-10-06T22:43:13.040687] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-10-06T22:43:13.044952] [INFO ] [MAIN ] Derivative Progress: 1385/2037 symbols completed. PATH took 1.3s. Estimated remaining: 4m 21s. Rate: 150.1 symbols/min [2025-10-06T22:43:13.052895] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:13.077511] [DEBUG] [LOCAL ] PAY: Loaded 37988 existing records from primary storage. [2025-10-06T22:43:13.078377] [INFO ] [MAIN ] PAY: Loaded 37988 primary data records. [2025-10-06T22:43:13.102177] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1794 records). [2025-10-06T22:43:13.127485] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-10-06T22:43:13.152495] [INFO ] [MAIN ] Derivative Progress: 1386/2037 symbols completed. PAXS took 1.3s. Estimated remaining: 4m 20s. Rate: 150.2 symbols/min [2025-10-06T22:43:13.157980] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:13.471971] [DEBUG] [LOCAL ] PBA: Loaded 48952 existing records from primary storage. [2025-10-06T22:43:13.472549] [INFO ] [MAIN ] PBA: Loaded 48952 primary data records. [2025-10-06T22:43:13.661464] [DEBUG] [LOCAL ] PBF: Loaded 53143 existing records from primary storage. [2025-10-06T22:43:13.719073] [INFO ] [MAIN ] PBF: Loaded 53143 primary data records. [2025-10-06T22:43:14.020770] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:14.071451] [INFO ] [MAIN ] PAY: Generated 1794 derivative records from 37988 primary records. [2025-10-06T22:43:14.081919] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-10-06T22:43:14.243609] [DEBUG] [LOCAL ] PAY: Derivative data saved (1794 records). [2025-10-06T22:43:14.243822] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-10-06T22:43:14.246308] [INFO ] [MAIN ] Derivative Progress: 1387/2037 symbols completed. PAY took 1.3s. Estimated remaining: 4m 20s. Rate: 150.0 symbols/min [2025-10-06T22:43:14.246587] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:14.270109] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:14.271021] [INFO ] [MAIN ] PBA: Generated 1794 derivative records from 48952 primary records. [2025-10-06T22:43:14.271228] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-10-06T22:43:14.301828] [DEBUG] [LOCAL ] PBA: Derivative data saved (1794 records). [2025-10-06T22:43:14.302413] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-10-06T22:43:14.305831] [INFO ] [MAIN ] Derivative Progress: 1388/2037 symbols completed. PBA took 1.3s. Estimated remaining: 4m 19s. Rate: 150.1 symbols/min [2025-10-06T22:43:14.306175] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:14.320747] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:14.322281] [INFO ] [MAIN ] PBF: Generated 1794 derivative records from 53143 primary records. [2025-10-06T22:43:14.330758] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-10-06T22:43:14.332380] [DEBUG] [LOCAL ] PBH: Loaded 32095 existing records from primary storage. [2025-10-06T22:43:14.333614] [INFO ] [MAIN ] PBH: Loaded 32095 primary data records. [2025-10-06T22:43:14.536885] [DEBUG] [LOCAL ] PBF: Derivative data saved (1794 records). [2025-10-06T22:43:14.643032] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-10-06T22:43:14.654298] [INFO ] [MAIN ] Derivative Progress: 1389/2037 symbols completed. PBF took 1.5s. Estimated remaining: 4m 19s. Rate: 150.1 symbols/min [2025-10-06T22:43:14.654852] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:14.691202] [DEBUG] [LOCAL ] PBI: Loaded 49909 existing records from primary storage. [2025-10-06T22:43:14.691775] [INFO ] [MAIN ] PBI: Loaded 49909 primary data records. [2025-10-06T22:43:14.892289] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:15.027961] [INFO ] [MAIN ] PBH: Generated 1794 derivative records from 32095 primary records. [2025-10-06T22:43:15.041832] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-10-06T22:43:15.044494] [DEBUG] [LOCAL ] PBR: Loaded 53710 existing records from primary storage. [2025-10-06T22:43:15.054153] [INFO ] [MAIN ] PBR: Loaded 53710 primary data records. [2025-10-06T22:43:15.173746] [DEBUG] [LOCAL ] PBH: Derivative data saved (1794 records). [2025-10-06T22:43:15.184979] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-10-06T22:43:15.218148] [INFO ] [MAIN ] Derivative Progress: 1390/2037 symbols completed. PBH took 1.0s. Estimated remaining: 4m 19s. Rate: 150.1 symbols/min [2025-10-06T22:43:15.227421] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:15.396214] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:15.403450] [INFO ] [MAIN ] PBI: Generated 1794 derivative records from 49909 primary records. [2025-10-06T22:43:15.403684] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-10-06T22:43:15.432819] [DEBUG] [LOCAL ] PBT: Loaded 17357 existing records from primary storage. [2025-10-06T22:43:15.433840] [INFO ] [MAIN ] PBT: Loaded 17357 primary data records. [2025-10-06T22:43:15.530011] [DEBUG] [LOCAL ] PBI: Derivative data saved (1794 records). [2025-10-06T22:43:15.551869] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-10-06T22:43:15.569178] [INFO ] [MAIN ] Derivative Progress: 1391/2037 symbols completed. PBI took 1.3s. Estimated remaining: 4m 18s. Rate: 150.1 symbols/min [2025-10-06T22:43:15.576036] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:15.581920] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:15.598918] [INFO ] [MAIN ] PBR: Generated 1794 derivative records from 53710 primary records. [2025-10-06T22:43:15.639554] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-10-06T22:43:15.684990] [DEBUG] [LOCAL ] PBR: Derivative data saved (1794 records). [2025-10-06T22:43:15.685200] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-10-06T22:43:15.688211] [INFO ] [MAIN ] Derivative Progress: 1392/2037 symbols completed. PBR took 1.0s. Estimated remaining: 4m 18s. Rate: 150.2 symbols/min [2025-10-06T22:43:15.688578] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:15.859809] [DEBUG] [LOCAL ] PCF: Loaded 8944 existing records from primary storage. [2025-10-06T22:43:15.871188] [INFO ] [MAIN ] PCF: Loaded 8944 primary data records. [2025-10-06T22:43:15.971786] [DEBUG] [LOCAL ] PCM: Loaded 6735 existing records from primary storage. [2025-10-06T22:43:15.990079] [INFO ] [MAIN ] PCM: Loaded 6735 primary data records. [2025-10-06T22:43:16.552538] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:16.569231] [INFO ] [MAIN ] PBT: Generated 1794 derivative records from 17357 primary records. [2025-10-06T22:43:16.569763] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-10-06T22:43:16.592384] [DEBUG] [LOCAL ] PBT: Derivative data saved (1794 records). [2025-10-06T22:43:16.592537] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-10-06T22:43:16.596978] [INFO ] [MAIN ] Derivative Progress: 1393/2037 symbols completed. PBT took 1.4s. Estimated remaining: 4m 18s. Rate: 150.0 symbols/min [2025-10-06T22:43:16.614706] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:16.615582] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 8944 primary records. [2025-10-06T22:43:16.615716] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-06T22:43:16.634770] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-10-06T22:43:16.635139] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-06T22:43:16.638896] [INFO ] [MAIN ] Derivative Progress: 1394/2037 symbols completed. PCF took 1.1s. Estimated remaining: 4m 17s. Rate: 150.1 symbols/min [2025-10-06T22:43:16.656301] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:16.657163] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6735 primary records. [2025-10-06T22:43:16.657233] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-06T22:43:16.673166] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-10-06T22:43:16.673274] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-06T22:43:16.676223] [INFO ] [MAIN ] Derivative Progress: 1395/2037 symbols completed. PCM took 1.0s. Estimated remaining: 4m 16s. Rate: 150.2 symbols/min [2025-10-06T22:43:16.676852] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:16.677077] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:16.677285] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:16.694406] [DEBUG] [LOCAL ] PCQ: Loaded 12075 existing records from primary storage. [2025-10-06T22:43:16.694638] [INFO ] [MAIN ] PCQ: Loaded 12075 primary data records. [2025-10-06T22:43:17.012386] [DEBUG] [LOCAL ] PCN: Loaded 24578 existing records from primary storage. [2025-10-06T22:43:17.026602] [INFO ] [MAIN ] PCN: Loaded 24578 primary data records. [2025-10-06T22:43:17.135081] [DEBUG] [LOCAL ] PCOR: Loaded 47854 existing records from primary storage. [2025-10-06T22:43:17.157473] [INFO ] [MAIN ] PCOR: Loaded 47854 primary data records. [2025-10-06T22:43:17.734967] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:17.736732] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 12075 primary records. [2025-10-06T22:43:17.737017] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-06T22:43:17.760527] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-10-06T22:43:17.762076] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-06T22:43:17.766578] [INFO ] [MAIN ] Derivative Progress: 1396/2037 symbols completed. PCQ took 1.1s. Estimated remaining: 4m 16s. Rate: 150.0 symbols/min [2025-10-06T22:43:17.766796] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:17.782678] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:17.783886] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 24578 primary records. [2025-10-06T22:43:17.784113] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-06T22:43:17.818068] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:17.819580] [INFO ] [MAIN ] PCOR: Generated 1794 derivative records from 47854 primary records. [2025-10-06T22:43:17.820015] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-10-06T22:43:17.822459] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-10-06T22:43:17.822703] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-10-06T22:43:17.826119] [INFO ] [MAIN ] Derivative Progress: 1397/2037 symbols completed. PCN took 1.1s. Estimated remaining: 4m 16s. Rate: 150.1 symbols/min [2025-10-06T22:43:17.833540] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:17.855146] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1794 records). [2025-10-06T22:43:17.855317] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-10-06T22:43:17.858349] [INFO ] [MAIN ] Derivative Progress: 1398/2037 symbols completed. PCOR took 1.2s. Estimated remaining: 4m 15s. Rate: 150.2 symbols/min [2025-10-06T22:43:17.858791] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:17.877632] [DEBUG] [LOCAL ] PD: Loaded 47928 existing records from primary storage. [2025-10-06T22:43:17.878032] [INFO ] [MAIN ] PD: Loaded 47928 primary data records. [2025-10-06T22:43:18.147177] [DEBUG] [LOCAL ] PDM: Loaded 39499 existing records from primary storage. [2025-10-06T22:43:18.264957] [INFO ] [MAIN ] PDM: Loaded 39499 primary data records. [2025-10-06T22:43:18.278185] [DEBUG] [LOCAL ] PDI: Loaded 50065 existing records from primary storage. [2025-10-06T22:43:18.299271] [INFO ] [MAIN ] PDI: Loaded 50065 primary data records. [2025-10-06T22:43:18.940881] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:18.943471] [INFO ] [MAIN ] PD: Generated 1794 derivative records from 47928 primary records. [2025-10-06T22:43:18.944516] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-10-06T22:43:18.971638] [DEBUG] [LOCAL ] PD: Derivative data saved (1794 records). [2025-10-06T22:43:18.972198] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-10-06T22:43:18.983616] [INFO ] [MAIN ] Derivative Progress: 1399/2037 symbols completed. PD took 1.2s. Estimated remaining: 4m 15s. Rate: 150.0 symbols/min [2025-10-06T22:43:18.989030] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:18.990130] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:18.992503] [INFO ] [MAIN ] PDM: Generated 1794 derivative records from 39499 primary records. [2025-10-06T22:43:18.992815] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-10-06T22:43:19.013729] [DEBUG] [LOCAL ] PDM: Derivative data saved (1794 records). [2025-10-06T22:43:19.014077] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-10-06T22:43:19.016707] [INFO ] [MAIN ] Derivative Progress: 1400/2037 symbols completed. PDM took 1.2s. Estimated remaining: 4m 15s. Rate: 150.1 symbols/min [2025-10-06T22:43:19.017186] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:19.032558] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:19.033693] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50065 primary records. [2025-10-06T22:43:19.033828] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-06T22:43:19.061187] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-10-06T22:43:19.061373] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-10-06T22:43:19.064307] [INFO ] [MAIN ] Derivative Progress: 1401/2037 symbols completed. PDI took 1.2s. Estimated remaining: 4m 14s. Rate: 150.2 symbols/min [2025-10-06T22:43:19.068318] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:19.088023] [DEBUG] [LOCAL ] PDS: Loaded 17468 existing records from primary storage. [2025-10-06T22:43:19.088418] [INFO ] [MAIN ] PDS: Loaded 17468 primary data records. [2025-10-06T22:43:19.089327] [DEBUG] [LOCAL ] PDO: Loaded 31295 existing records from primary storage. [2025-10-06T22:43:19.089981] [INFO ] [MAIN ] PDO: Loaded 31295 primary data records. [2025-10-06T22:43:19.256499] [DEBUG] [LOCAL ] PDT: Loaded 17389 existing records from primary storage. [2025-10-06T22:43:19.296208] [INFO ] [MAIN ] PDT: Loaded 17389 primary data records. [2025-10-06T22:43:20.158582] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:20.160437] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 17468 primary records. [2025-10-06T22:43:20.160580] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-06T22:43:20.187160] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:20.190667] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-10-06T22:43:20.190768] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-06T22:43:20.193186] [INFO ] [MAIN ] Derivative Progress: 1402/2037 symbols completed. PDS took 1.2s. Estimated remaining: 4m 14s. Rate: 150.0 symbols/min [2025-10-06T22:43:20.190616] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 31295 primary records. [2025-10-06T22:43:20.193399] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-10-06T22:43:20.193603] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:20.225869] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:20.227756] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17389 primary records. [2025-10-06T22:43:20.228097] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-06T22:43:20.233034] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-10-06T22:43:20.233426] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-10-06T22:43:20.243668] [INFO ] [MAIN ] Derivative Progress: 1403/2037 symbols completed. PDO took 1.3s. Estimated remaining: 4m 13s. Rate: 150.1 symbols/min [2025-10-06T22:43:20.243927] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:20.254062] [DEBUG] [LOCAL ] PDX: Loaded 14391 existing records from primary storage. [2025-10-06T22:43:20.254875] [INFO ] [MAIN ] PDX: Loaded 14391 primary data records. [2025-10-06T22:43:20.361447] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-10-06T22:43:20.371598] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-06T22:43:20.375198] [INFO ] [MAIN ] Derivative Progress: 1404/2037 symbols completed. PDT took 1.3s. Estimated remaining: 4m 13s. Rate: 150.2 symbols/min [2025-10-06T22:43:20.375564] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:20.628538] [DEBUG] [LOCAL ] PEB: Loaded 50658 existing records from primary storage. [2025-10-06T22:43:20.629227] [INFO ] [MAIN ] PEB: Loaded 50658 primary data records. [2025-10-06T22:43:20.748172] [DEBUG] [LOCAL ] PEN: Loaded 30168 existing records from primary storage. [2025-10-06T22:43:20.764846] [INFO ] [MAIN ] PEN: Loaded 30168 primary data records. [2025-10-06T22:43:21.171270] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:21.294702] [INFO ] [MAIN ] PDX: Generated 1794 derivative records from 14391 primary records. [2025-10-06T22:43:21.295519] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-10-06T22:43:21.318855] [DEBUG] [LOCAL ] PDX: Derivative data saved (1794 records). [2025-10-06T22:43:21.319442] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-10-06T22:43:21.322748] [INFO ] [MAIN ] Derivative Progress: 1405/2037 symbols completed. PDX took 1.1s. Estimated remaining: 4m 13s. Rate: 150.1 symbols/min [2025-10-06T22:43:21.323113] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:21.343114] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:21.347421] [INFO ] [MAIN ] PEB: Generated 1794 derivative records from 50658 primary records. [2025-10-06T22:43:21.347773] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-10-06T22:43:21.363183] [DEBUG] [LOCAL ] PEO: Loaded 11128 existing records from primary storage. [2025-10-06T22:43:21.365856] [INFO ] [MAIN ] PEO: Loaded 11128 primary data records. [2025-10-06T22:43:21.443697] [DEBUG] [LOCAL ] PEB: Derivative data saved (1794 records). [2025-10-06T22:43:21.444108] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-10-06T22:43:21.453291] [INFO ] [MAIN ] Derivative Progress: 1406/2037 symbols completed. PEB took 1.2s. Estimated remaining: 4m 12s. Rate: 150.1 symbols/min [2025-10-06T22:43:21.458578] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:21.544914] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:21.579389] [INFO ] [MAIN ] PEN: Generated 1794 derivative records from 30168 primary records. [2025-10-06T22:43:21.679980] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-10-06T22:43:21.701937] [DEBUG] [LOCAL ] PERF: Loaded 14234 existing records from primary storage. [2025-10-06T22:43:21.710278] [INFO ] [MAIN ] PERF: Loaded 14234 primary data records. [2025-10-06T22:43:21.829195] [DEBUG] [LOCAL ] PEN: Derivative data saved (1794 records). [2025-10-06T22:43:21.829715] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-10-06T22:43:21.834152] [INFO ] [MAIN ] Derivative Progress: 1407/2037 symbols completed. PEN took 1.5s. Estimated remaining: 4m 12s. Rate: 150.1 symbols/min [2025-10-06T22:43:21.840045] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:22.088548] [DEBUG] [LOCAL ] PFD: Loaded 5201 existing records from primary storage. [2025-10-06T22:43:22.091593] [INFO ] [MAIN ] PFD: Loaded 5201 primary data records. [2025-10-06T22:43:22.175004] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:22.193836] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 11128 primary records. [2025-10-06T22:43:22.214048] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-06T22:43:22.471475] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-10-06T22:43:22.472515] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-06T22:43:22.475774] [INFO ] [MAIN ] Derivative Progress: 1408/2037 symbols completed. PEO took 1.2s. Estimated remaining: 4m 11s. Rate: 150.1 symbols/min [2025-10-06T22:43:22.491742] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:22.493017] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14234 primary records. [2025-10-06T22:43:22.493575] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-06T22:43:22.512368] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-10-06T22:43:22.512632] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-06T22:43:22.516319] [INFO ] [MAIN ] Derivative Progress: 1409/2037 symbols completed. PERF took 1.1s. Estimated remaining: 4m 11s. Rate: 150.2 symbols/min [2025-10-06T22:43:22.534970] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:43:22.535871] [INFO ] [MAIN ] PFD: Generated 1793 derivative records from 5201 primary records. [2025-10-06T22:43:22.535936] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-06T22:43:22.551162] [DEBUG] [LOCAL ] PFD: Derivative data saved (1793 records). [2025-10-06T22:43:22.551231] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-06T22:43:22.554365] [INFO ] [MAIN ] Derivative Progress: 1410/2037 symbols completed. PFD took 0.7s. Estimated remaining: 4m 10s. Rate: 150.3 symbols/min [2025-10-06T22:43:22.555254] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:22.555405] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:22.555907] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:22.569054] [DEBUG] [LOCAL ] PFH: Loaded 6805 existing records from primary storage. [2025-10-06T22:43:22.569290] [INFO ] [MAIN ] PFH: Loaded 6805 primary data records. [2025-10-06T22:43:22.686613] [DEBUG] [LOCAL ] PFL: Loaded 13790 existing records from primary storage. [2025-10-06T22:43:22.711415] [INFO ] [MAIN ] PFL: Loaded 13790 primary data records. [2025-10-06T22:43:22.942931] [DEBUG] [LOCAL ] PFGC: Loaded 46910 existing records from primary storage. [2025-10-06T22:43:23.068038] [INFO ] [MAIN ] PFGC: Loaded 46910 primary data records. [2025-10-06T22:43:23.630382] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:23.631428] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6805 primary records. [2025-10-06T22:43:23.631680] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-06T22:43:23.663927] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-10-06T22:43:23.664334] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:23.664623] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-06T22:43:23.668047] [INFO ] [MAIN ] Derivative Progress: 1411/2037 symbols completed. PFH took 1.1s. Estimated remaining: 4m 10s. Rate: 150.1 symbols/min [2025-10-06T22:43:23.665519] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 13790 primary records. [2025-10-06T22:43:23.668357] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:23.668219] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-06T22:43:23.689862] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-10-06T22:43:23.690998] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-06T22:43:23.694259] [INFO ] [MAIN ] Derivative Progress: 1412/2037 symbols completed. PFL took 1.1s. Estimated remaining: 4m 10s. Rate: 150.2 symbols/min [2025-10-06T22:43:23.694697] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:23.709710] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:23.710560] [INFO ] [MAIN ] PFGC: Generated 1794 derivative records from 46910 primary records. [2025-10-06T22:43:23.710770] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-10-06T22:43:23.728769] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1794 records). [2025-10-06T22:43:23.728875] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-10-06T22:43:23.732106] [INFO ] [MAIN ] Derivative Progress: 1413/2037 symbols completed. PFGC took 1.2s. Estimated remaining: 4m 9s. Rate: 150.3 symbols/min [2025-10-06T22:43:23.740080] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:23.761106] [DEBUG] [LOCAL ] PFN: Loaded 21981 existing records from primary storage. [2025-10-06T22:43:23.763505] [INFO ] [MAIN ] PFN: Loaded 21981 primary data records. [2025-10-06T22:43:23.801065] [DEBUG] [LOCAL ] PFO: Loaded 6020 existing records from primary storage. [2025-10-06T22:43:23.837271] [INFO ] [MAIN ] PFO: Loaded 6020 primary data records. [2025-10-06T22:43:23.980993] [DEBUG] [LOCAL ] PFLT: Loaded 43861 existing records from primary storage. [2025-10-06T22:43:24.014266] [INFO ] [MAIN ] PFLT: Loaded 43861 primary data records. [2025-10-06T22:43:24.850442] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:24.865556] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 6020 primary records. [2025-10-06T22:43:24.865837] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-06T22:43:24.868575] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:24.871770] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 21981 primary records. [2025-10-06T22:43:24.883625] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-06T22:43:24.901469] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-10-06T22:43:24.902281] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-06T22:43:24.902193] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:24.905060] [INFO ] [MAIN ] Derivative Progress: 1414/2037 symbols completed. PFO took 1.2s. Estimated remaining: 4m 9s. Rate: 150.1 symbols/min [2025-10-06T22:43:24.906621] [INFO ] [MAIN ] PFLT: Generated 1794 derivative records from 43861 primary records. [2025-10-06T22:43:24.907144] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-10-06T22:43:24.907829] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:24.935722] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-10-06T22:43:24.938739] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-06T22:43:24.942173] [INFO ] [MAIN ] Derivative Progress: 1415/2037 symbols completed. PFN took 1.2s. Estimated remaining: 4m 9s. Rate: 150.2 symbols/min [2025-10-06T22:43:24.944244] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:24.947929] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1794 records). [2025-10-06T22:43:24.948090] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-10-06T22:43:24.951363] [INFO ] [MAIN ] Derivative Progress: 1416/2037 symbols completed. PFLT took 1.3s. Estimated remaining: 4m 8s. Rate: 150.3 symbols/min [2025-10-06T22:43:24.951791] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:24.973039] [DEBUG] [LOCAL ] PGP: Loaded 5591 existing records from primary storage. [2025-10-06T22:43:24.973250] [INFO ] [MAIN ] PGP: Loaded 5591 primary data records. [2025-10-06T22:43:25.104586] [DEBUG] [LOCAL ] PFS: Loaded 35572 existing records from primary storage. [2025-10-06T22:43:25.112688] [INFO ] [MAIN ] PFS: Loaded 35572 primary data records. [2025-10-06T22:43:25.464565] [DEBUG] [LOCAL ] PFSI: Loaded 28803 existing records from primary storage. [2025-10-06T22:43:25.486170] [INFO ] [MAIN ] PFSI: Loaded 28803 primary data records. [2025-10-06T22:43:26.060851] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:26.062205] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5591 primary records. [2025-10-06T22:43:26.062464] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-06T22:43:26.100595] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:26.102299] [INFO ] [MAIN ] PFS: Generated 1794 derivative records from 35572 primary records. [2025-10-06T22:43:26.102544] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-10-06T22:43:26.102952] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-10-06T22:43:26.104001] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-06T22:43:26.122948] [INFO ] [MAIN ] Derivative Progress: 1417/2037 symbols completed. PGP took 1.2s. Estimated remaining: 4m 8s. Rate: 150.1 symbols/min [2025-10-06T22:43:26.120185] [DEBUG] [LOCAL ] PFS: Derivative data saved (1794 records). [2025-10-06T22:43:26.123506] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:26.123873] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-10-06T22:43:26.127176] [INFO ] [MAIN ] Derivative Progress: 1418/2037 symbols completed. PFS took 1.2s. Estimated remaining: 4m 7s. Rate: 150.2 symbols/min [2025-10-06T22:43:26.127555] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:26.147491] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:26.148481] [INFO ] [MAIN ] PFSI: Generated 1794 derivative records from 28803 primary records. [2025-10-06T22:43:26.148548] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-10-06T22:43:26.152825] [DEBUG] [LOCAL ] PGZ: Loaded 5468 existing records from primary storage. [2025-10-06T22:43:26.153199] [INFO ] [MAIN ] PGZ: Loaded 5468 primary data records. [2025-10-06T22:43:26.237429] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1794 records). [2025-10-06T22:43:26.249063] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-10-06T22:43:26.264734] [INFO ] [MAIN ] Derivative Progress: 1419/2037 symbols completed. PFSI took 1.3s. Estimated remaining: 4m 7s. Rate: 150.2 symbols/min [2025-10-06T22:43:26.275816] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:26.465863] [DEBUG] [LOCAL ] PGRE: Loaded 46751 existing records from primary storage. [2025-10-06T22:43:26.543439] [INFO ] [MAIN ] PGRE: Loaded 46751 primary data records. [2025-10-06T22:43:26.534342] [DEBUG] [LOCAL ] PHD: Loaded 10767 existing records from primary storage. [2025-10-06T22:43:26.549048] [INFO ] [MAIN ] PHD: Loaded 10767 primary data records. [2025-10-06T22:43:27.193245] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:27.195179] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5468 primary records. [2025-10-06T22:43:27.195366] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-06T22:43:27.218485] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-10-06T22:43:27.219025] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-06T22:43:27.221899] [INFO ] [MAIN ] Derivative Progress: 1420/2037 symbols completed. PGZ took 1.1s. Estimated remaining: 4m 7s. Rate: 150.1 symbols/min [2025-10-06T22:43:27.222346] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:27.236453] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:27.237691] [INFO ] [MAIN ] PHD: Generated 1794 derivative records from 10767 primary records. [2025-10-06T22:43:27.238036] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-10-06T22:43:27.259139] [DEBUG] [LOCAL ] PHD: Derivative data saved (1794 records). [2025-10-06T22:43:27.259514] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-10-06T22:43:27.262763] [INFO ] [MAIN ] Derivative Progress: 1421/2037 symbols completed. PHD took 1.0s. Estimated remaining: 4m 6s. Rate: 150.2 symbols/min [2025-10-06T22:43:27.263216] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:27.277974] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:27.279030] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46751 primary records. [2025-10-06T22:43:27.279153] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-06T22:43:27.319680] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-10-06T22:43:27.334026] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-06T22:43:27.340185] [INFO ] [MAIN ] Derivative Progress: 1422/2037 symbols completed. PGRE took 1.2s. Estimated remaining: 4m 6s. Rate: 150.3 symbols/min [2025-10-06T22:43:27.336580] [DEBUG] [LOCAL ] PHI: Loaded 15090 existing records from primary storage. [2025-10-06T22:43:27.340672] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:27.341388] [INFO ] [MAIN ] PHI: Loaded 15090 primary data records. [2025-10-06T22:43:27.342723] [DEBUG] [LOCAL ] PHG: Loaded 45936 existing records from primary storage. [2025-10-06T22:43:27.356374] [INFO ] [MAIN ] PHG: Loaded 45936 primary data records. [2025-10-06T22:43:27.831257] [DEBUG] [LOCAL ] PHIN: Loaded 32374 existing records from primary storage. [2025-10-06T22:43:27.837097] [INFO ] [MAIN ] PHIN: Loaded 32374 primary data records. [2025-10-06T22:43:28.395107] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:28.634843] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 15090 primary records. [2025-10-06T22:43:28.660056] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-06T22:43:28.684099] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-10-06T22:43:28.685557] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-06T22:43:28.689074] [INFO ] [MAIN ] Derivative Progress: 1423/2037 symbols completed. PHI took 1.4s. Estimated remaining: 4m 6s. Rate: 150.0 symbols/min [2025-10-06T22:43:28.709103] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:28.710763] [INFO ] [MAIN ] PHG: Generated 1794 derivative records from 45936 primary records. [2025-10-06T22:43:28.711623] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-10-06T22:43:28.735621] [DEBUG] [LOCAL ] PHG: Derivative data saved (1794 records). [2025-10-06T22:43:28.736168] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-10-06T22:43:28.740273] [INFO ] [MAIN ] Derivative Progress: 1424/2037 symbols completed. PHG took 1.5s. Estimated remaining: 4m 5s. Rate: 150.1 symbols/min [2025-10-06T22:43:28.759108] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:28.759912] [INFO ] [MAIN ] PHIN: Generated 1794 derivative records from 32374 primary records. [2025-10-06T22:43:28.759975] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-10-06T22:43:28.776081] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1794 records). [2025-10-06T22:43:28.776255] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-10-06T22:43:28.779821] [INFO ] [MAIN ] Derivative Progress: 1425/2037 symbols completed. PHIN took 1.4s. Estimated remaining: 4m 4s. Rate: 150.2 symbols/min [2025-10-06T22:43:28.780481] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:28.780424] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:28.781137] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:28.811832] [DEBUG] [LOCAL ] PHK: Loaded 26508 existing records from primary storage. [2025-10-06T22:43:28.826627] [INFO ] [MAIN ] PHK: Loaded 26508 primary data records. [2025-10-06T22:43:28.975201] [DEBUG] [LOCAL ] PHR: Loaded 37515 existing records from primary storage. [2025-10-06T22:43:28.980768] [INFO ] [MAIN ] PHR: Loaded 37515 primary data records. [2025-10-06T22:43:29.278002] [DEBUG] [LOCAL ] PII: Loaded 48885 existing records from primary storage. [2025-10-06T22:43:29.295495] [INFO ] [MAIN ] PII: Loaded 48885 primary data records. [2025-10-06T22:43:29.835325] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:29.837303] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26508 primary records. [2025-10-06T22:43:29.837534] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-06T22:43:29.859785] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-10-06T22:43:29.860091] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-06T22:43:29.862949] [INFO ] [MAIN ] Derivative Progress: 1426/2037 symbols completed. PHK took 1.1s. Estimated remaining: 4m 4s. Rate: 150.0 symbols/min [2025-10-06T22:43:29.863318] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:29.878615] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:29.879964] [INFO ] [MAIN ] PHR: Generated 1794 derivative records from 37515 primary records. [2025-10-06T22:43:29.880345] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-10-06T22:43:29.900833] [DEBUG] [LOCAL ] PHR: Derivative data saved (1794 records). [2025-10-06T22:43:29.902121] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-10-06T22:43:29.905108] [INFO ] [MAIN ] Derivative Progress: 1427/2037 symbols completed. PHR took 1.1s. Estimated remaining: 4m 4s. Rate: 150.1 symbols/min [2025-10-06T22:43:29.906557] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:29.910380] [DEBUG] [LOCAL ] PIM: Loaded 4804 existing records from primary storage. [2025-10-06T22:43:29.911488] [INFO ] [MAIN ] PIM: Loaded 4804 primary data records. [2025-10-06T22:43:29.964775] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:30.020555] [INFO ] [MAIN ] PII: Generated 1794 derivative records from 48885 primary records. [2025-10-06T22:43:30.020769] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-10-06T22:43:30.072512] [DEBUG] [LOCAL ] PINE: Loaded 14143 existing records from primary storage. [2025-10-06T22:43:30.098243] [INFO ] [MAIN ] PINE: Loaded 14143 primary data records. [2025-10-06T22:43:30.119069] [DEBUG] [LOCAL ] PII: Derivative data saved (1794 records). [2025-10-06T22:43:30.156249] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-10-06T22:43:30.174532] [INFO ] [MAIN ] Derivative Progress: 1428/2037 symbols completed. PII took 1.4s. Estimated remaining: 4m 3s. Rate: 150.1 symbols/min [2025-10-06T22:43:30.295870] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:30.661790] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:30.664741] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-10-06T22:43:30.666273] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4804 primary records. [2025-10-06T22:43:30.665152] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-10-06T22:43:30.666727] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-06T22:43:30.768184] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:30.793487] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14143 primary records. [2025-10-06T22:43:30.830403] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-06T22:43:30.836525] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-10-06T22:43:30.836771] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-06T22:43:30.927107] [INFO ] [MAIN ] Derivative Progress: 1429/2037 symbols completed. PIM took 1.1s. Estimated remaining: 4m 3s. Rate: 150.1 symbols/min [2025-10-06T22:43:30.938301] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:31.026124] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-10-06T22:43:31.144463] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-06T22:43:31.157556] [INFO ] [MAIN ] Derivative Progress: 1430/2037 symbols completed. PINE took 1.3s. Estimated remaining: 4m 3s. Rate: 150.1 symbols/min [2025-10-06T22:43:31.157976] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:31.165070] [DEBUG] [LOCAL ] PIPR: Loaded 14899 existing records from primary storage. [2025-10-06T22:43:31.166219] [INFO ] [MAIN ] PIPR: Loaded 14899 primary data records. [2025-10-06T22:43:31.479806] [DEBUG] [LOCAL ] PJT: Loaded 21570 existing records from primary storage. [2025-10-06T22:43:31.480047] [INFO ] [MAIN ] PJT: Loaded 21570 primary data records. [2025-10-06T22:43:31.648947] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:31.656363] [INFO ] [MAIN ] PINS: Generated 1794 derivative records from 53693 primary records. [2025-10-06T22:43:31.662011] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-10-06T22:43:31.736372] [DEBUG] [LOCAL ] PINS: Derivative data saved (1794 records). [2025-10-06T22:43:31.773453] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-10-06T22:43:31.876742] [INFO ] [MAIN ] Derivative Progress: 1431/2037 symbols completed. PINS took 1.6s. Estimated remaining: 4m 2s. Rate: 150.0 symbols/min [2025-10-06T22:43:31.910928] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:31.930038] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:31.932350] [INFO ] [MAIN ] PIPR: Generated 1794 derivative records from 14899 primary records. [2025-10-06T22:43:31.932958] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-10-06T22:43:31.955345] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1794 records). [2025-10-06T22:43:31.955732] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-10-06T22:43:31.959185] [INFO ] [MAIN ] Derivative Progress: 1432/2037 symbols completed. PIPR took 1.0s. Estimated remaining: 4m 2s. Rate: 150.1 symbols/min [2025-10-06T22:43:31.959553] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:31.997301] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:31.998867] [INFO ] [MAIN ] PJT: Generated 1794 derivative records from 21570 primary records. [2025-10-06T22:43:31.999051] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-10-06T22:43:32.022203] [DEBUG] [LOCAL ] PJT: Derivative data saved (1794 records). [2025-10-06T22:43:32.017793] [DEBUG] [LOCAL ] PKE: Loaded 13242 existing records from primary storage. [2025-10-06T22:43:32.022424] [INFO ] [MAIN ] PKE: Loaded 13242 primary data records. [2025-10-06T22:43:32.022677] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-10-06T22:43:32.047145] [INFO ] [MAIN ] Derivative Progress: 1433/2037 symbols completed. PJT took 0.9s. Estimated remaining: 4m 1s. Rate: 150.2 symbols/min [2025-10-06T22:43:32.070849] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:32.157634] [DEBUG] [LOCAL ] PK: Loaded 52805 existing records from primary storage. [2025-10-06T22:43:32.174196] [INFO ] [MAIN ] PK: Loaded 52805 primary data records. [2025-10-06T22:43:32.468270] [DEBUG] [LOCAL ] PKST: Loaded 18746 existing records from primary storage. [2025-10-06T22:43:32.487766] [INFO ] [MAIN ] PKST: Loaded 18746 primary data records. [2025-10-06T22:43:33.092953] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:33.094231] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 13242 primary records. [2025-10-06T22:43:33.094383] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-06T22:43:33.116747] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-10-06T22:43:33.117178] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-06T22:43:33.119976] [INFO ] [MAIN ] Derivative Progress: 1434/2037 symbols completed. PKE took 1.2s. Estimated remaining: 4m 1s. Rate: 150.0 symbols/min [2025-10-06T22:43:33.120384] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:33.134434] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:33.135418] [INFO ] [MAIN ] PK: Generated 1794 derivative records from 52805 primary records. [2025-10-06T22:43:33.135713] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-10-06T22:43:33.169250] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:33.171072] [INFO ] [MAIN ] PKST: Generated 1794 derivative records from 18746 primary records. [2025-10-06T22:43:33.177549] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-10-06T22:43:33.193804] [DEBUG] [LOCAL ] PK: Derivative data saved (1794 records). [2025-10-06T22:43:33.203220] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-10-06T22:43:33.207004] [INFO ] [MAIN ] Derivative Progress: 1435/2037 symbols completed. PK took 1.3s. Estimated remaining: 4m 1s. Rate: 150.1 symbols/min [2025-10-06T22:43:33.208182] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:33.209680] [DEBUG] [LOCAL ] PKST: Derivative data saved (1794 records). [2025-10-06T22:43:33.210513] [DEBUG] [LOCAL ] PKX: Loaded 24067 existing records from primary storage. [2025-10-06T22:43:33.210737] [INFO ] [MAIN ] PKX: Loaded 24067 primary data records. [2025-10-06T22:43:33.210948] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-10-06T22:43:33.225939] [INFO ] [MAIN ] Derivative Progress: 1436/2037 symbols completed. PKST took 1.2s. Estimated remaining: 4m 0s. Rate: 150.2 symbols/min [2025-10-06T22:43:33.260223] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:33.609481] [DEBUG] [LOCAL ] PL: Loaded 53152 existing records from primary storage. [2025-10-06T22:43:33.610190] [INFO ] [MAIN ] PL: Loaded 53152 primary data records. [2025-10-06T22:43:33.732449] [DEBUG] [LOCAL ] PLNT: Loaded 48202 existing records from primary storage. [2025-10-06T22:43:33.754477] [INFO ] [MAIN ] PLNT: Loaded 48202 primary data records. [2025-10-06T22:43:34.064881] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:34.075252] [INFO ] [MAIN ] PKX: Generated 1794 derivative records from 24067 primary records. [2025-10-06T22:43:34.092123] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-10-06T22:43:34.309120] [DEBUG] [LOCAL ] PKX: Derivative data saved (1794 records). [2025-10-06T22:43:34.310099] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-10-06T22:43:34.313360] [INFO ] [MAIN ] Derivative Progress: 1437/2037 symbols completed. PKX took 1.2s. Estimated remaining: 3m 60s. Rate: 150.0 symbols/min [2025-10-06T22:43:34.313570] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:34.332817] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:34.333823] [INFO ] [MAIN ] PL: Generated 1794 derivative records from 53152 primary records. [2025-10-06T22:43:34.334040] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-10-06T22:43:34.372799] [DEBUG] [LOCAL ] PL: Derivative data saved (1794 records). [2025-10-06T22:43:34.397421] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-10-06T22:43:34.398058] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:34.402022] [DEBUG] [LOCAL ] PLYM: Loaded 33649 existing records from primary storage. [2025-10-06T22:43:34.402299] [INFO ] [MAIN ] PLYM: Loaded 33649 primary data records. [2025-10-06T22:43:34.400714] [INFO ] [MAIN ] Derivative Progress: 1438/2037 symbols completed. PL took 1.2s. Estimated remaining: 3m 59s. Rate: 150.1 symbols/min [2025-10-06T22:43:34.403335] [INFO ] [MAIN ] PLNT: Generated 1794 derivative records from 48202 primary records. [2025-10-06T22:43:34.448794] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-10-06T22:43:34.732369] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1794 records). [2025-10-06T22:43:34.732778] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-10-06T22:43:34.736970] [INFO ] [MAIN ] Derivative Progress: 1439/2037 symbols completed. PLNT took 1.5s. Estimated remaining: 3m 59s. Rate: 150.1 symbols/min [2025-10-06T22:43:34.762575] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:34.763238] [INFO ] [MAIN ] PLYM: Generated 1794 derivative records from 33649 primary records. [2025-10-06T22:43:34.763298] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-10-06T22:43:34.779593] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1794 records). [2025-10-06T22:43:34.779678] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-10-06T22:43:34.782379] [INFO ] [MAIN ] Derivative Progress: 1440/2037 symbols completed. PLYM took 0.5s. Estimated remaining: 3m 58s. Rate: 150.2 symbols/min [2025-10-06T22:43:34.783049] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:34.782965] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:34.783521] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:34.797007] [DEBUG] [LOCAL ] PMM: Loaded 10754 existing records from primary storage. [2025-10-06T22:43:34.797322] [INFO ] [MAIN ] PMM: Loaded 10754 primary data records. [2025-10-06T22:43:34.900822] [DEBUG] [LOCAL ] PMO: Loaded 10208 existing records from primary storage. [2025-10-06T22:43:34.928991] [INFO ] [MAIN ] PMO: Loaded 10208 primary data records. [2025-10-06T22:43:34.935345] [DEBUG] [LOCAL ] PML: Loaded 21461 existing records from primary storage. [2025-10-06T22:43:34.962738] [INFO ] [MAIN ] PML: Loaded 21461 primary data records. [2025-10-06T22:43:35.894127] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:35.895430] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10754 primary records. [2025-10-06T22:43:35.896235] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-06T22:43:35.921928] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-10-06T22:43:35.922822] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-06T22:43:35.926226] [INFO ] [MAIN ] Derivative Progress: 1441/2037 symbols completed. PMM took 1.1s. Estimated remaining: 3m 58s. Rate: 150.0 symbols/min [2025-10-06T22:43:35.926909] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:35.954191] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:35.953967] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:35.955241] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 10208 primary records. [2025-10-06T22:43:35.955891] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 21461 primary records. [2025-10-06T22:43:35.956021] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-06T22:43:35.956119] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-06T22:43:35.989136] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-10-06T22:43:35.989374] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-06T22:43:35.989051] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-10-06T22:43:35.992431] [INFO ] [MAIN ] Derivative Progress: 1442/2037 symbols completed. PMO took 1.2s. Estimated remaining: 3m 58s. Rate: 150.1 symbols/min [2025-10-06T22:43:35.993069] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:35.993262] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-06T22:43:35.996612] [INFO ] [MAIN ] Derivative Progress: 1443/2037 symbols completed. PML took 1.2s. Estimated remaining: 3m 57s. Rate: 150.2 symbols/min [2025-10-06T22:43:35.997253] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:36.016570] [DEBUG] [LOCAL ] PNI: Loaded 6790 existing records from primary storage. [2025-10-06T22:43:36.016924] [INFO ] [MAIN ] PNI: Loaded 6790 primary data records. [2025-10-06T22:43:36.131345] [DEBUG] [LOCAL ] PMT: Loaded 40380 existing records from primary storage. [2025-10-06T22:43:36.152044] [INFO ] [MAIN ] PMT: Loaded 40380 primary data records. [2025-10-06T22:43:36.311079] [DEBUG] [LOCAL ] PNNT: Loaded 32938 existing records from primary storage. [2025-10-06T22:43:36.367689] [INFO ] [MAIN ] PNNT: Loaded 32938 primary data records. [2025-10-06T22:43:37.036110] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:37.037329] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6790 primary records. [2025-10-06T22:43:37.038582] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-06T22:43:37.069462] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:37.071030] [INFO ] [MAIN ] PMT: Generated 1794 derivative records from 40380 primary records. [2025-10-06T22:43:37.071449] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-10-06T22:43:37.074271] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-10-06T22:43:37.082981] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-06T22:43:37.087107] [INFO ] [MAIN ] Derivative Progress: 1444/2037 symbols completed. PNI took 1.1s. Estimated remaining: 3m 57s. Rate: 150.0 symbols/min [2025-10-06T22:43:37.090744] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:37.107365] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:37.109381] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 32938 primary records. [2025-10-06T22:43:37.109901] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-06T22:43:37.126704] [DEBUG] [LOCAL ] PMT: Derivative data saved (1794 records). [2025-10-06T22:43:37.128879] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-10-06T22:43:37.132562] [INFO ] [MAIN ] Derivative Progress: 1445/2037 symbols completed. PMT took 1.2s. Estimated remaining: 3m 57s. Rate: 150.1 symbols/min [2025-10-06T22:43:37.132917] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-10-06T22:43:37.133075] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:37.133206] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-06T22:43:37.136626] [INFO ] [MAIN ] Derivative Progress: 1446/2037 symbols completed. PNNT took 1.1s. Estimated remaining: 3m 56s. Rate: 150.2 symbols/min [2025-10-06T22:43:37.137296] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:37.190052] [DEBUG] [LOCAL ] PPT: Loaded 19961 existing records from primary storage. [2025-10-06T22:43:37.198326] [INFO ] [MAIN ] PPT: Loaded 19961 primary data records. [2025-10-06T22:43:37.199937] [DEBUG] [LOCAL ] POR: Loaded 47006 existing records from primary storage. [2025-10-06T22:43:37.238896] [INFO ] [MAIN ] POR: Loaded 47006 primary data records. [2025-10-06T22:43:37.351224] [DEBUG] [LOCAL ] POST: Loaded 38793 existing records from primary storage. [2025-10-06T22:43:37.442907] [INFO ] [MAIN ] POST: Loaded 38793 primary data records. [2025-10-06T22:43:38.186524] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:38.191589] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 19961 primary records. [2025-10-06T22:43:38.191792] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-06T22:43:38.222879] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:38.229314] [INFO ] [MAIN ] POR: Generated 1794 derivative records from 47006 primary records. [2025-10-06T22:43:38.228103] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-10-06T22:43:38.229742] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-10-06T22:43:38.229955] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-06T22:43:38.233288] [INFO ] [MAIN ] Derivative Progress: 1447/2037 symbols completed. PPT took 1.1s. Estimated remaining: 3m 56s. Rate: 150.0 symbols/min [2025-10-06T22:43:38.234324] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:38.256566] [DEBUG] [LOCAL ] POR: Derivative data saved (1794 records). [2025-10-06T22:43:38.256925] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-10-06T22:43:38.260243] [INFO ] [MAIN ] Derivative Progress: 1448/2037 symbols completed. POR took 1.2s. Estimated remaining: 3m 55s. Rate: 150.1 symbols/min [2025-10-06T22:43:38.260815] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:38.275232] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:38.276269] [INFO ] [MAIN ] POST: Generated 1794 derivative records from 38793 primary records. [2025-10-06T22:43:38.276492] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-10-06T22:43:38.296783] [DEBUG] [LOCAL ] POST: Derivative data saved (1794 records). [2025-10-06T22:43:38.297587] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-10-06T22:43:38.301369] [INFO ] [MAIN ] Derivative Progress: 1449/2037 symbols completed. POST took 1.2s. Estimated remaining: 3m 55s. Rate: 150.2 symbols/min [2025-10-06T22:43:38.316355] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:38.330092] [DEBUG] [LOCAL ] PRCS: Loaded 2758 existing records from primary storage. [2025-10-06T22:43:38.330337] [INFO ] [MAIN ] PRCS: Loaded 2758 primary data records. [2025-10-06T22:43:38.425003] [DEBUG] [LOCAL ] PRA: Loaded 35372 existing records from primary storage. [2025-10-06T22:43:38.431712] [INFO ] [MAIN ] PRA: Loaded 35372 primary data records. [2025-10-06T22:43:38.482882] [DEBUG] [LOCAL ] PR: Loaded 53611 existing records from primary storage. [2025-10-06T22:43:38.518966] [INFO ] [MAIN ] PR: Loaded 53611 primary data records. [2025-10-06T22:43:39.442345] [DEBUG] [MAIN ] PRCS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:43:39.443227] [INFO ] [MAIN ] PRCS: Generated 1793 derivative records from 2758 primary records. [2025-10-06T22:43:39.443522] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-06T22:43:39.463397] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1793 records). [2025-10-06T22:43:39.476676] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-06T22:43:39.479135] [INFO ] [MAIN ] Derivative Progress: 1450/2037 symbols completed. PRCS took 1.2s. Estimated remaining: 3m 55s. Rate: 150.0 symbols/min [2025-10-06T22:43:39.476575] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:39.480206] [INFO ] [MAIN ] PRA: Generated 1794 derivative records from 35372 primary records. [2025-10-06T22:43:39.480360] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:39.489472] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-10-06T22:43:39.497123] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:39.510076] [INFO ] [MAIN ] PR: Generated 1794 derivative records from 53611 primary records. [2025-10-06T22:43:39.510837] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-10-06T22:43:39.514604] [DEBUG] [LOCAL ] PRA: Derivative data saved (1794 records). [2025-10-06T22:43:39.515567] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-10-06T22:43:39.518623] [INFO ] [MAIN ] Derivative Progress: 1451/2037 symbols completed. PRA took 1.3s. Estimated remaining: 3m 54s. Rate: 150.1 symbols/min [2025-10-06T22:43:39.519294] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:39.549873] [DEBUG] [LOCAL ] PR: Derivative data saved (1794 records). [2025-10-06T22:43:39.550165] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-10-06T22:43:39.553991] [INFO ] [MAIN ] Derivative Progress: 1452/2037 symbols completed. PR took 1.3s. Estimated remaining: 3m 54s. Rate: 150.2 symbols/min [2025-10-06T22:43:39.554320] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:39.569349] [DEBUG] [LOCAL ] PRG: Loaded 29868 existing records from primary storage. [2025-10-06T22:43:39.569727] [INFO ] [MAIN ] PRG: Loaded 29868 primary data records. [2025-10-06T22:43:39.594355] [DEBUG] [LOCAL ] PRH: Loaded 4780 existing records from primary storage. [2025-10-06T22:43:39.655616] [INFO ] [MAIN ] PRH: Loaded 4780 primary data records. [2025-10-06T22:43:39.858308] [DEBUG] [LOCAL ] PRGO: Loaded 46941 existing records from primary storage. [2025-10-06T22:43:40.003239] [INFO ] [MAIN ] PRGO: Loaded 46941 primary data records. [2025-10-06T22:43:40.529278] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:40.531131] [INFO ] [MAIN ] PRG: Generated 1794 derivative records from 29868 primary records. [2025-10-06T22:43:40.531584] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-10-06T22:43:40.551025] [DEBUG] [LOCAL ] PRG: Derivative data saved (1794 records). [2025-10-06T22:43:40.552359] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-10-06T22:43:40.555920] [INFO ] [MAIN ] Derivative Progress: 1453/2037 symbols completed. PRG took 1.1s. Estimated remaining: 3m 54s. Rate: 150.0 symbols/min [2025-10-06T22:43:40.570089] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:40.571251] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4780 primary records. [2025-10-06T22:43:40.571489] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-06T22:43:40.589074] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-10-06T22:43:40.601751] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-06T22:43:40.604859] [INFO ] [MAIN ] Derivative Progress: 1454/2037 symbols completed. PRH took 1.1s. Estimated remaining: 3m 53s. Rate: 150.1 symbols/min [2025-10-06T22:43:40.601698] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:40.605910] [INFO ] [MAIN ] PRGO: Generated 1794 derivative records from 46941 primary records. [2025-10-06T22:43:40.605978] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-10-06T22:43:40.621631] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1794 records). [2025-10-06T22:43:40.621719] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-10-06T22:43:40.625352] [INFO ] [MAIN ] Derivative Progress: 1455/2037 symbols completed. PRGO took 1.1s. Estimated remaining: 3m 52s. Rate: 150.2 symbols/min [2025-10-06T22:43:40.625837] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:40.626016] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:40.626154] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:40.651077] [DEBUG] [LOCAL ] PRI: Loaded 18263 existing records from primary storage. [2025-10-06T22:43:40.651307] [INFO ] [MAIN ] PRI: Loaded 18263 primary data records. [2025-10-06T22:43:40.801247] [DEBUG] [LOCAL ] PRIM: Loaded 44236 existing records from primary storage. [2025-10-06T22:43:40.812545] [INFO ] [MAIN ] PRIM: Loaded 44236 primary data records. [2025-10-06T22:43:40.918004] [DEBUG] [LOCAL ] PRKS: Loaded 42476 existing records from primary storage. [2025-10-06T22:43:40.934073] [INFO ] [MAIN ] PRKS: Loaded 42476 primary data records. [2025-10-06T22:43:41.706559] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:41.707752] [INFO ] [MAIN ] PRI: Generated 1794 derivative records from 18263 primary records. [2025-10-06T22:43:41.708017] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-10-06T22:43:41.735487] [DEBUG] [LOCAL ] PRI: Derivative data saved (1794 records). [2025-10-06T22:43:41.740833] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-10-06T22:43:41.743764] [INFO ] [MAIN ] Derivative Progress: 1456/2037 symbols completed. PRI took 1.1s. Estimated remaining: 3m 52s. Rate: 150.0 symbols/min [2025-10-06T22:43:41.744051] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:41.745087] [INFO ] [MAIN ] PRIM: Generated 1794 derivative records from 44236 primary records. [2025-10-06T22:43:41.745316] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-10-06T22:43:41.745236] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:41.776432] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:41.777827] [INFO ] [MAIN ] PRKS: Generated 1794 derivative records from 42476 primary records. [2025-10-06T22:43:41.783296] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-10-06T22:43:41.793048] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1794 records). [2025-10-06T22:43:41.796744] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-10-06T22:43:41.800275] [INFO ] [MAIN ] Derivative Progress: 1457/2037 symbols completed. PRIM took 1.2s. Estimated remaining: 3m 52s. Rate: 150.1 symbols/min [2025-10-06T22:43:41.800452] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:41.809503] [DEBUG] [LOCAL ] PRLB: Loaded 20362 existing records from primary storage. [2025-10-06T22:43:41.810094] [INFO ] [MAIN ] PRLB: Loaded 20362 primary data records. [2025-10-06T22:43:41.891965] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1794 records). [2025-10-06T22:43:41.909605] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-10-06T22:43:41.933299] [INFO ] [MAIN ] Derivative Progress: 1458/2037 symbols completed. PRKS took 1.3s. Estimated remaining: 3m 51s. Rate: 150.2 symbols/min [2025-10-06T22:43:41.943792] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:42.171673] [DEBUG] [LOCAL ] PRM: Loaded 44679 existing records from primary storage. [2025-10-06T22:43:42.172980] [INFO ] [MAIN ] PRM: Loaded 44679 primary data records. [2025-10-06T22:43:42.539279] [DEBUG] [LOCAL ] PRMB: Loaded 53159 existing records from primary storage. [2025-10-06T22:43:42.540109] [INFO ] [MAIN ] PRMB: Loaded 53159 primary data records. [2025-10-06T22:43:42.671423] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:42.693711] [INFO ] [MAIN ] PRLB: Generated 1794 derivative records from 20362 primary records. [2025-10-06T22:43:42.747548] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-10-06T22:43:42.883381] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1794 records). [2025-10-06T22:43:42.883876] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-10-06T22:43:42.886792] [INFO ] [MAIN ] Derivative Progress: 1459/2037 symbols completed. PRLB took 1.1s. Estimated remaining: 3m 51s. Rate: 150.1 symbols/min [2025-10-06T22:43:42.887388] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:42.907821] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:42.908895] [INFO ] [MAIN ] PRM: Generated 1794 derivative records from 44679 primary records. [2025-10-06T22:43:42.909179] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-10-06T22:43:42.929384] [DEBUG] [LOCAL ] PRM: Derivative data saved (1794 records). [2025-10-06T22:43:42.929783] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-10-06T22:43:42.932702] [INFO ] [MAIN ] Derivative Progress: 1460/2037 symbols completed. PRM took 1.1s. Estimated remaining: 3m 51s. Rate: 150.2 symbols/min [2025-10-06T22:43:42.933274] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:42.962532] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:42.963431] [INFO ] [MAIN ] PRMB: Generated 1794 derivative records from 53159 primary records. [2025-10-06T22:43:42.966270] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-10-06T22:43:42.966527] [DEBUG] [LOCAL ] PRT: Loaded 5232 existing records from primary storage. [2025-10-06T22:43:42.966905] [INFO ] [MAIN ] PRT: Loaded 5232 primary data records. [2025-10-06T22:43:43.074205] [DEBUG] [LOCAL ] PRO: Loaded 38575 existing records from primary storage. [2025-10-06T22:43:43.083176] [INFO ] [MAIN ] PRO: Loaded 38575 primary data records. [2025-10-06T22:43:43.083716] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1794 records). [2025-10-06T22:43:43.106132] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-10-06T22:43:43.108985] [INFO ] [MAIN ] Derivative Progress: 1461/2037 symbols completed. PRMB took 1.2s. Estimated remaining: 3m 50s. Rate: 150.2 symbols/min [2025-10-06T22:43:43.116075] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:43.360154] [DEBUG] [LOCAL ] PSBD: Loaded 7270 existing records from primary storage. [2025-10-06T22:43:43.467594] [INFO ] [MAIN ] PSBD: Loaded 7270 primary data records. [2025-10-06T22:43:44.084702] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:44.086168] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5232 primary records. [2025-10-06T22:43:44.086758] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-06T22:43:44.104759] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-10-06T22:43:44.106195] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-06T22:43:44.109363] [INFO ] [MAIN ] Derivative Progress: 1462/2037 symbols completed. PRT took 1.2s. Estimated remaining: 3m 50s. Rate: 150.1 symbols/min [2025-10-06T22:43:44.109913] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:44.125046] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:44.126180] [INFO ] [MAIN ] PRO: Generated 1794 derivative records from 38575 primary records. [2025-10-06T22:43:44.126312] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-10-06T22:43:44.149354] [DEBUG] [LOCAL ] PSF: Loaded 6963 existing records from primary storage. [2025-10-06T22:43:44.150303] [INFO ] [MAIN ] PSF: Loaded 6963 primary data records. [2025-10-06T22:43:44.226458] [DEBUG] [LOCAL ] PRO: Derivative data saved (1794 records). [2025-10-06T22:43:44.256526] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-10-06T22:43:44.283895] [INFO ] [MAIN ] Derivative Progress: 1463/2037 symbols completed. PRO took 1.4s. Estimated remaining: 3m 49s. Rate: 150.1 symbols/min [2025-10-06T22:43:44.277264] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:44.285242] [INFO ] [MAIN ] PSBD: Generated 1794 derivative records from 7270 primary records. [2025-10-06T22:43:44.285901] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:44.291381] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-06T22:43:44.539040] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1794 records). [2025-10-06T22:43:44.539433] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-06T22:43:44.542703] [INFO ] [MAIN ] Derivative Progress: 1464/2037 symbols completed. PSBD took 1.4s. Estimated remaining: 3m 49s. Rate: 150.1 symbols/min [2025-10-06T22:43:44.542912] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:44.557359] [DEBUG] [LOCAL ] PSFE: Loaded 29798 existing records from primary storage. [2025-10-06T22:43:44.558391] [INFO ] [MAIN ] PSFE: Loaded 29798 primary data records. [2025-10-06T22:43:44.904339] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:44.905753] [DEBUG] [LOCAL ] PSN: Loaded 45927 existing records from primary storage. [2025-10-06T22:43:44.906398] [INFO ] [MAIN ] PSN: Loaded 45927 primary data records. [2025-10-06T22:43:44.907243] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6963 primary records. [2025-10-06T22:43:44.913066] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-06T22:43:45.064192] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-10-06T22:43:45.095140] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-06T22:43:45.097735] [INFO ] [MAIN ] Derivative Progress: 1465/2037 symbols completed. PSF took 1.0s. Estimated remaining: 3m 49s. Rate: 150.1 symbols/min [2025-10-06T22:43:45.120404] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:45.254590] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:45.255405] [INFO ] [MAIN ] PSFE: Generated 1794 derivative records from 29798 primary records. [2025-10-06T22:43:45.256020] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-10-06T22:43:45.278107] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1794 records). [2025-10-06T22:43:45.286957] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-10-06T22:43:45.290227] [INFO ] [MAIN ] Derivative Progress: 1466/2037 symbols completed. PSFE took 1.0s. Estimated remaining: 3m 48s. Rate: 150.2 symbols/min [2025-10-06T22:43:45.290996] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:45.309950] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:45.322563] [INFO ] [MAIN ] PSN: Generated 1794 derivative records from 45927 primary records. [2025-10-06T22:43:45.322697] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-10-06T22:43:45.324174] [DEBUG] [LOCAL ] PSO: Loaded 36922 existing records from primary storage. [2025-10-06T22:43:45.324350] [INFO ] [MAIN ] PSO: Loaded 36922 primary data records. [2025-10-06T22:43:45.490355] [DEBUG] [LOCAL ] PSQH: Loaded 34901 existing records from primary storage. [2025-10-06T22:43:45.509368] [INFO ] [MAIN ] PSQH: Loaded 34901 primary data records. [2025-10-06T22:43:45.565423] [DEBUG] [LOCAL ] PSN: Derivative data saved (1794 records). [2025-10-06T22:43:45.673282] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-10-06T22:43:45.682744] [INFO ] [MAIN ] Derivative Progress: 1467/2037 symbols completed. PSN took 1.1s. Estimated remaining: 3m 48s. Rate: 150.2 symbols/min [2025-10-06T22:43:45.793198] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:46.071058] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:46.072281] [INFO ] [MAIN ] PSO: Generated 1794 derivative records from 36922 primary records. [2025-10-06T22:43:46.072497] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-10-06T22:43:46.119383] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:46.120443] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 34901 primary records. [2025-10-06T22:43:46.119044] [DEBUG] [LOCAL ] PSTG: Loaded 52841 existing records from primary storage. [2025-10-06T22:43:46.120853] [INFO ] [MAIN ] PSTG: Loaded 52841 primary data records. [2025-10-06T22:43:46.120905] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-06T22:43:46.211523] [DEBUG] [LOCAL ] PSO: Derivative data saved (1794 records). [2025-10-06T22:43:46.222618] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-10-06T22:43:46.241294] [INFO ] [MAIN ] Derivative Progress: 1468/2037 symbols completed. PSO took 1.1s. Estimated remaining: 3m 47s. Rate: 150.1 symbols/min [2025-10-06T22:43:46.249878] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-10-06T22:43:46.271137] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-06T22:43:46.300793] [INFO ] [MAIN ] Derivative Progress: 1469/2037 symbols completed. PSQH took 1.0s. Estimated remaining: 3m 47s. Rate: 150.2 symbols/min [2025-10-06T22:43:46.475399] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:46.476348] [INFO ] [MAIN ] PSTG: Generated 1794 derivative records from 52841 primary records. [2025-10-06T22:43:46.476416] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-10-06T22:43:46.492918] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1794 records). [2025-10-06T22:43:46.493013] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-10-06T22:43:46.495750] [INFO ] [MAIN ] Derivative Progress: 1470/2037 symbols completed. PSTG took 0.7s. Estimated remaining: 3m 46s. Rate: 150.3 symbols/min [2025-10-06T22:43:46.496595] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:46.496439] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:46.496704] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:46.523625] [DEBUG] [LOCAL ] PTA: Loaded 14982 existing records from primary storage. [2025-10-06T22:43:46.530302] [INFO ] [MAIN ] PTA: Loaded 14982 primary data records. [2025-10-06T22:43:46.577517] [DEBUG] [LOCAL ] PSTL: Loaded 20041 existing records from primary storage. [2025-10-06T22:43:46.585091] [INFO ] [MAIN ] PSTL: Loaded 20041 primary data records. [2025-10-06T22:43:46.770280] [DEBUG] [LOCAL ] PTY: Loaded 37336 existing records from primary storage. [2025-10-06T22:43:46.821479] [INFO ] [MAIN ] PTY: Loaded 37336 primary data records. [2025-10-06T22:43:47.564280] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:47.566162] [INFO ] [MAIN ] PSTL: Generated 1794 derivative records from 20041 primary records. [2025-10-06T22:43:47.566351] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-10-06T22:43:47.567360] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:47.569427] [INFO ] [MAIN ] PTA: Generated 1794 derivative records from 14982 primary records. [2025-10-06T22:43:47.569866] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-10-06T22:43:47.587066] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1794 records). [2025-10-06T22:43:47.595334] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-10-06T22:43:47.598253] [INFO ] [MAIN ] Derivative Progress: 1471/2037 symbols completed. PSTL took 1.1s. Estimated remaining: 3m 46s. Rate: 150.1 symbols/min [2025-10-06T22:43:47.598444] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:47.626093] [DEBUG] [LOCAL ] PTA: Derivative data saved (1794 records). [2025-10-06T22:43:47.626371] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-10-06T22:43:47.625773] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:47.629185] [INFO ] [MAIN ] Derivative Progress: 1472/2037 symbols completed. PTA took 1.1s. Estimated remaining: 3m 46s. Rate: 150.2 symbols/min [2025-10-06T22:43:47.629386] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:47.630359] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37336 primary records. [2025-10-06T22:43:47.631015] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-06T22:43:47.659166] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-10-06T22:43:47.659461] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-10-06T22:43:47.662901] [INFO ] [MAIN ] Derivative Progress: 1473/2037 symbols completed. PTY took 1.2s. Estimated remaining: 3m 45s. Rate: 150.3 symbols/min [2025-10-06T22:43:47.663138] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:47.679238] [DEBUG] [LOCAL ] PUK: Loaded 44658 existing records from primary storage. [2025-10-06T22:43:47.679552] [INFO ] [MAIN ] PUK: Loaded 44658 primary data records. [2025-10-06T22:43:47.898167] [DEBUG] [LOCAL ] PUMP: Loaded 49373 existing records from primary storage. [2025-10-06T22:43:47.903492] [INFO ] [MAIN ] PUMP: Loaded 49373 primary data records. [2025-10-06T22:43:48.129776] [DEBUG] [LOCAL ] PVH: Loaded 50263 existing records from primary storage. [2025-10-06T22:43:48.145330] [INFO ] [MAIN ] PVH: Loaded 50263 primary data records. [2025-10-06T22:43:48.671915] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:48.673534] [INFO ] [MAIN ] PUK: Generated 1794 derivative records from 44658 primary records. [2025-10-06T22:43:48.673938] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-10-06T22:43:48.691559] [DEBUG] [LOCAL ] PUK: Derivative data saved (1794 records). [2025-10-06T22:43:48.692229] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-10-06T22:43:48.695630] [INFO ] [MAIN ] Derivative Progress: 1474/2037 symbols completed. PUK took 1.1s. Estimated remaining: 3m 45s. Rate: 150.1 symbols/min [2025-10-06T22:43:48.695810] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:48.705857] [DEBUG] [LOCAL ] PVL: Loaded 4697 existing records from primary storage. [2025-10-06T22:43:48.718545] [INFO ] [MAIN ] PVL: Loaded 4697 primary data records. [2025-10-06T22:43:48.719070] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:48.740157] [INFO ] [MAIN ] PUMP: Generated 1794 derivative records from 49373 primary records. [2025-10-06T22:43:48.750181] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-10-06T22:43:48.859894] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:48.872488] [INFO ] [MAIN ] PVH: Generated 1794 derivative records from 50263 primary records. [2025-10-06T22:43:48.872984] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1794 records). [2025-10-06T22:43:48.878361] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-10-06T22:43:48.873161] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-10-06T22:43:48.902184] [INFO ] [MAIN ] Derivative Progress: 1475/2037 symbols completed. PUMP took 1.3s. Estimated remaining: 3m 45s. Rate: 150.2 symbols/min [2025-10-06T22:43:49.030418] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:49.064092] [DEBUG] [LOCAL ] PVH: Derivative data saved (1794 records). [2025-10-06T22:43:49.064738] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-10-06T22:43:49.067609] [INFO ] [MAIN ] Derivative Progress: 1476/2037 symbols completed. PVH took 1.4s. Estimated remaining: 3m 44s. Rate: 150.2 symbols/min [2025-10-06T22:43:49.067981] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:49.091568] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:49.101501] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4697 primary records. [2025-10-06T22:43:49.101741] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-06T22:43:49.126975] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-10-06T22:43:49.128045] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-06T22:43:49.139576] [INFO ] [MAIN ] Derivative Progress: 1477/2037 symbols completed. PVL took 0.4s. Estimated remaining: 3m 44s. Rate: 150.3 symbols/min [2025-10-06T22:43:49.141036] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:49.142219] [DEBUG] [LOCAL ] PX: Loaded 34376 existing records from primary storage. [2025-10-06T22:43:49.142399] [INFO ] [MAIN ] PX: Loaded 34376 primary data records. [2025-10-06T22:43:49.262487] [DEBUG] [LOCAL ] QD: Loaded 27749 existing records from primary storage. [2025-10-06T22:43:49.285553] [INFO ] [MAIN ] QD: Loaded 27749 primary data records. [2025-10-06T22:43:49.839153] [DEBUG] [LOCAL ] QGEN: Loaded 49157 existing records from primary storage. [2025-10-06T22:43:49.839376] [INFO ] [MAIN ] QGEN: Loaded 49157 primary data records. [2025-10-06T22:43:50.163611] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:50.164895] [INFO ] [MAIN ] PX: Generated 1794 derivative records from 34376 primary records. [2025-10-06T22:43:50.165082] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-10-06T22:43:50.186606] [DEBUG] [LOCAL ] PX: Derivative data saved (1794 records). [2025-10-06T22:43:50.195368] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-10-06T22:43:50.203555] [INFO ] [MAIN ] Derivative Progress: 1478/2037 symbols completed. PX took 1.2s. Estimated remaining: 3m 43s. Rate: 150.1 symbols/min [2025-10-06T22:43:50.204253] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:50.203968] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:50.205325] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 27749 primary records. [2025-10-06T22:43:50.205923] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-06T22:43:50.225681] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-10-06T22:43:50.225897] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-06T22:43:50.236561] [INFO ] [MAIN ] Derivative Progress: 1479/2037 symbols completed. QD took 1.2s. Estimated remaining: 3m 43s. Rate: 150.2 symbols/min [2025-10-06T22:43:50.242174] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:50.242065] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:50.243307] [INFO ] [MAIN ] QGEN: Generated 1794 derivative records from 49157 primary records. [2025-10-06T22:43:50.243385] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-10-06T22:43:50.260990] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1794 records). [2025-10-06T22:43:50.261144] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-10-06T22:43:50.263905] [INFO ] [MAIN ] Derivative Progress: 1480/2037 symbols completed. QGEN took 1.1s. Estimated remaining: 3m 42s. Rate: 150.3 symbols/min [2025-10-06T22:43:50.264212] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:50.306138] [DEBUG] [LOCAL ] QS: Loaded 53745 existing records from primary storage. [2025-10-06T22:43:50.326572] [INFO ] [MAIN ] QS: Loaded 53745 primary data records. [2025-10-06T22:43:50.483700] [DEBUG] [LOCAL ] QTWO: Loaded 39198 existing records from primary storage. [2025-10-06T22:43:50.498350] [DEBUG] [LOCAL ] QSR: Loaded 52452 existing records from primary storage. [2025-10-06T22:43:50.531336] [INFO ] [MAIN ] QTWO: Loaded 39198 primary data records. [2025-10-06T22:43:50.542918] [INFO ] [MAIN ] QSR: Loaded 52452 primary data records. [2025-10-06T22:43:51.272894] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:51.274791] [INFO ] [MAIN ] QS: Generated 1794 derivative records from 53745 primary records. [2025-10-06T22:43:51.275096] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-10-06T22:43:51.293090] [DEBUG] [LOCAL ] QS: Derivative data saved (1794 records). [2025-10-06T22:43:51.294144] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-10-06T22:43:51.299145] [INFO ] [MAIN ] Derivative Progress: 1481/2037 symbols completed. QS took 1.1s. Estimated remaining: 3m 42s. Rate: 150.2 symbols/min [2025-10-06T22:43:51.300169] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:51.330460] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:51.330212] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:51.331342] [INFO ] [MAIN ] QTWO: Generated 1794 derivative records from 39198 primary records. [2025-10-06T22:43:51.331430] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-10-06T22:43:51.332097] [INFO ] [MAIN ] QSR: Generated 1794 derivative records from 52452 primary records. [2025-10-06T22:43:51.332944] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-10-06T22:43:51.366677] [DEBUG] [LOCAL ] QSR: Derivative data saved (1794 records). [2025-10-06T22:43:51.367568] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-10-06T22:43:51.370676] [INFO ] [MAIN ] Derivative Progress: 1482/2037 symbols completed. QSR took 1.1s. Estimated remaining: 3m 42s. Rate: 150.2 symbols/min [2025-10-06T22:43:51.370849] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:51.381935] [DEBUG] [LOCAL ] QUAD: Loaded 23420 existing records from primary storage. [2025-10-06T22:43:51.381442] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1794 records). [2025-10-06T22:43:51.382109] [INFO ] [MAIN ] QUAD: Loaded 23420 primary data records. [2025-10-06T22:43:51.382398] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-10-06T22:43:51.406809] [INFO ] [MAIN ] Derivative Progress: 1483/2037 symbols completed. QTWO took 1.1s. Estimated remaining: 3m 41s. Rate: 150.3 symbols/min [2025-10-06T22:43:51.483685] [DEBUG] [LOCAL ] QVCC: Loaded 8892 existing records from primary storage. [2025-10-06T22:43:51.495160] [INFO ] [MAIN ] QVCC: Loaded 8892 primary data records. [2025-10-06T22:43:52.036393] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:52.037145] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 23420 primary records. [2025-10-06T22:43:52.037299] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-06T22:43:52.065886] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:52.067175] [INFO ] [MAIN ] QVCC: Generated 1794 derivative records from 8892 primary records. [2025-10-06T22:43:52.067456] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-10-06T22:43:52.069237] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-10-06T22:43:52.076586] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-06T22:43:52.082460] [INFO ] [MAIN ] Derivative Progress: 1484/2037 symbols completed. QUAD took 0.8s. Estimated remaining: 3m 41s. Rate: 150.3 symbols/min [2025-10-06T22:43:52.087007] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1794 records). [2025-10-06T22:43:52.087072] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-10-06T22:43:52.090069] [INFO ] [MAIN ] Derivative Progress: 1485/2037 symbols completed. QVCC took 0.7s. Estimated remaining: 3m 40s. Rate: 150.4 symbols/min [2025-10-06T22:43:52.090529] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:52.090667] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:52.090473] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:52.100957] [DEBUG] [LOCAL ] QVCD: Loaded 4548 existing records from primary storage. [2025-10-06T22:43:52.101114] [INFO ] [MAIN ] QVCD: Loaded 4548 primary data records. [2025-10-06T22:43:52.384592] [DEBUG] [LOCAL ] R: Loaded 28763 existing records from primary storage. [2025-10-06T22:43:52.451631] [INFO ] [MAIN ] R: Loaded 28763 primary data records. [2025-10-06T22:43:52.529397] [DEBUG] [LOCAL ] QXO: Loaded 53309 existing records from primary storage. [2025-10-06T22:43:52.559566] [INFO ] [MAIN ] QXO: Loaded 53309 primary data records. [2025-10-06T22:43:53.114048] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:43:53.115952] [INFO ] [MAIN ] QVCD: Generated 1793 derivative records from 4548 primary records. [2025-10-06T22:43:53.116524] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-06T22:43:53.148168] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:53.149246] [INFO ] [MAIN ] R: Generated 1794 derivative records from 28763 primary records. [2025-10-06T22:43:53.149751] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-10-06T22:43:53.150995] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1793 records). [2025-10-06T22:43:53.159671] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-06T22:43:53.163546] [INFO ] [MAIN ] Derivative Progress: 1486/2037 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 40s. Rate: 150.2 symbols/min [2025-10-06T22:43:53.166456] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:53.173237] [DEBUG] [LOCAL ] R: Derivative data saved (1794 records). [2025-10-06T22:43:53.173564] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-10-06T22:43:53.176095] [INFO ] [MAIN ] Derivative Progress: 1487/2037 symbols completed. R took 1.1s. Estimated remaining: 3m 40s. Rate: 150.3 symbols/min [2025-10-06T22:43:53.176276] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:53.196050] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:53.196954] [INFO ] [MAIN ] QXO: Generated 1794 derivative records from 53309 primary records. [2025-10-06T22:43:53.202513] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-10-06T22:43:53.227512] [DEBUG] [LOCAL ] RA: Loaded 21763 existing records from primary storage. [2025-10-06T22:43:53.228360] [INFO ] [MAIN ] RA: Loaded 21763 primary data records. [2025-10-06T22:43:53.231836] [DEBUG] [LOCAL ] QXO: Derivative data saved (1794 records). [2025-10-06T22:43:53.285200] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-10-06T22:43:53.340219] [INFO ] [MAIN ] Derivative Progress: 1488/2037 symbols completed. QXO took 1.2s. Estimated remaining: 3m 39s. Rate: 150.3 symbols/min [2025-10-06T22:43:53.359752] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:53.375907] [DEBUG] [LOCAL ] RACE: Loaded 32600 existing records from primary storage. [2025-10-06T22:43:53.381620] [INFO ] [MAIN ] RACE: Loaded 32600 primary data records. [2025-10-06T22:43:54.012095] [DEBUG] [LOCAL ] RAMP: Loaded 37446 existing records from primary storage. [2025-10-06T22:43:54.013318] [INFO ] [MAIN ] RAMP: Loaded 37446 primary data records. [2025-10-06T22:43:54.354897] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:54.356581] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21763 primary records. [2025-10-06T22:43:54.357166] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-06T22:43:54.394305] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:54.396404] [INFO ] [MAIN ] RACE: Generated 1794 derivative records from 32600 primary records. [2025-10-06T22:43:54.397558] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-10-06T22:43:54.400017] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-10-06T22:43:54.400400] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-10-06T22:43:54.402867] [INFO ] [MAIN ] Derivative Progress: 1489/2037 symbols completed. RA took 1.2s. Estimated remaining: 3m 39s. Rate: 150.2 symbols/min [2025-10-06T22:43:54.410259] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:54.421757] [DEBUG] [LOCAL ] RACE: Derivative data saved (1794 records). [2025-10-06T22:43:54.423139] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-10-06T22:43:54.427777] [INFO ] [MAIN ] Derivative Progress: 1490/2037 symbols completed. RACE took 1.3s. Estimated remaining: 3m 38s. Rate: 150.3 symbols/min [2025-10-06T22:43:54.428242] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:54.443426] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:54.444260] [INFO ] [MAIN ] RAMP: Generated 1794 derivative records from 37446 primary records. [2025-10-06T22:43:54.444384] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-10-06T22:43:54.466388] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1794 records). [2025-10-06T22:43:54.466767] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-10-06T22:43:54.469716] [INFO ] [MAIN ] Derivative Progress: 1491/2037 symbols completed. RAMP took 1.1s. Estimated remaining: 3m 38s. Rate: 150.4 symbols/min [2025-10-06T22:43:54.469903] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:54.477772] [DEBUG] [LOCAL ] RBC: Loaded 15284 existing records from primary storage. [2025-10-06T22:43:54.478097] [INFO ] [MAIN ] RBC: Loaded 15284 primary data records. [2025-10-06T22:43:54.672503] [DEBUG] [LOCAL ] RBA: Loaded 45793 existing records from primary storage. [2025-10-06T22:43:54.820608] [INFO ] [MAIN ] RBA: Loaded 45793 primary data records. [2025-10-06T22:43:54.956206] [DEBUG] [LOCAL ] RBLX: Loaded 53714 existing records from primary storage. [2025-10-06T22:43:54.956983] [INFO ] [MAIN ] RBLX: Loaded 53714 primary data records. [2025-10-06T22:43:55.490175] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:55.491449] [INFO ] [MAIN ] RBC: Generated 1794 derivative records from 15284 primary records. [2025-10-06T22:43:55.492292] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-10-06T22:43:55.511754] [DEBUG] [LOCAL ] RBC: Derivative data saved (1794 records). [2025-10-06T22:43:55.512074] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-10-06T22:43:55.514824] [INFO ] [MAIN ] Derivative Progress: 1492/2037 symbols completed. RBC took 1.1s. Estimated remaining: 3m 38s. Rate: 150.2 symbols/min [2025-10-06T22:43:55.515124] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:55.536330] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:55.537212] [INFO ] [MAIN ] RBA: Generated 1794 derivative records from 45793 primary records. [2025-10-06T22:43:55.537632] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-10-06T22:43:55.540847] [DEBUG] [LOCAL ] RBOT: Loaded 5599 existing records from primary storage. [2025-10-06T22:43:55.541563] [INFO ] [MAIN ] RBOT: Loaded 5599 primary data records. [2025-10-06T22:43:55.681469] [DEBUG] [LOCAL ] RBA: Derivative data saved (1794 records). [2025-10-06T22:43:55.681012] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:55.752048] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-10-06T22:43:55.772246] [INFO ] [MAIN ] Derivative Progress: 1493/2037 symbols completed. RBA took 1.4s. Estimated remaining: 3m 37s. Rate: 150.2 symbols/min [2025-10-06T22:43:55.769190] [INFO ] [MAIN ] RBLX: Generated 1794 derivative records from 53714 primary records. [2025-10-06T22:43:55.813135] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-10-06T22:43:55.813010] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:55.981528] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1794 records). [2025-10-06T22:43:55.981754] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-10-06T22:43:55.986165] [INFO ] [MAIN ] Derivative Progress: 1494/2037 symbols completed. RBLX took 1.5s. Estimated remaining: 3m 37s. Rate: 150.3 symbols/min [2025-10-06T22:43:55.986529] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:56.009033] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:56.009980] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 5599 primary records. [2025-10-06T22:43:56.010083] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-06T22:43:56.041772] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-10-06T22:43:56.042067] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-06T22:43:56.044458] [INFO ] [MAIN ] Derivative Progress: 1495/2037 symbols completed. RBOT took 0.5s. Estimated remaining: 3m 36s. Rate: 150.4 symbols/min [2025-10-06T22:43:56.044838] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:56.078532] [DEBUG] [LOCAL ] RC: Loaded 48920 existing records from primary storage. [2025-10-06T22:43:56.078787] [INFO ] [MAIN ] RC: Loaded 48920 primary data records. [2025-10-06T22:43:56.140421] [DEBUG] [LOCAL ] RCS: Loaded 11893 existing records from primary storage. [2025-10-06T22:43:56.176963] [INFO ] [MAIN ] RCS: Loaded 11893 primary data records. [2025-10-06T22:43:56.188392] [DEBUG] [LOCAL ] RCI: Loaded 48598 existing records from primary storage. [2025-10-06T22:43:56.188524] [INFO ] [MAIN ] RCI: Loaded 48598 primary data records. [2025-10-06T22:43:57.111176] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:57.113383] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 48920 primary records. [2025-10-06T22:43:57.114832] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-06T22:43:57.145292] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:57.160071] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 11893 primary records. [2025-10-06T22:43:57.162667] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:57.164384] [INFO ] [MAIN ] RCI: Generated 1794 derivative records from 48598 primary records. [2025-10-06T22:43:57.163429] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-06T22:43:57.165513] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-10-06T22:43:57.166212] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-10-06T22:43:57.168363] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-06T22:43:57.171337] [INFO ] [MAIN ] Derivative Progress: 1496/2037 symbols completed. RC took 1.4s. Estimated remaining: 3m 36s. Rate: 150.2 symbols/min [2025-10-06T22:43:57.195738] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:57.208808] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-10-06T22:43:57.210168] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-06T22:43:57.214478] [INFO ] [MAIN ] Derivative Progress: 1497/2037 symbols completed. RCS took 1.2s. Estimated remaining: 3m 36s. Rate: 150.3 symbols/min [2025-10-06T22:43:57.214827] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:57.217060] [DEBUG] [LOCAL ] RCI: Derivative data saved (1794 records). [2025-10-06T22:43:57.217199] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-10-06T22:43:57.220533] [INFO ] [MAIN ] Derivative Progress: 1498/2037 symbols completed. RCI took 1.2s. Estimated remaining: 3m 35s. Rate: 150.4 symbols/min [2025-10-06T22:43:57.257802] [DEBUG] [LOCAL ] RDN: Loaded 44886 existing records from primary storage. [2025-10-06T22:43:57.257972] [INFO ] [MAIN ] RDN: Loaded 44886 primary data records. [2025-10-06T22:43:57.566574] [DEBUG] [LOCAL ] RDW: Loaded 52096 existing records from primary storage. [2025-10-06T22:43:57.592805] [INFO ] [MAIN ] RDW: Loaded 52096 primary data records. [2025-10-06T22:43:58.000307] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:58.001911] [INFO ] [MAIN ] RDN: Generated 1794 derivative records from 44886 primary records. [2025-10-06T22:43:58.002223] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-10-06T22:43:58.022936] [DEBUG] [LOCAL ] RDN: Derivative data saved (1794 records). [2025-10-06T22:43:58.023122] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-10-06T22:43:58.025791] [INFO ] [MAIN ] Derivative Progress: 1499/2037 symbols completed. RDN took 0.8s. Estimated remaining: 3m 35s. Rate: 150.3 symbols/min [2025-10-06T22:43:58.043893] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:58.044692] [INFO ] [MAIN ] RDW: Generated 1794 derivative records from 52096 primary records. [2025-10-06T22:43:58.044759] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-10-06T22:43:58.061016] [DEBUG] [LOCAL ] RDW: Derivative data saved (1794 records). [2025-10-06T22:43:58.061086] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-10-06T22:43:58.063922] [INFO ] [MAIN ] Derivative Progress: 1500/2037 symbols completed. RDW took 0.8s. Estimated remaining: 3m 34s. Rate: 150.4 symbols/min [2025-10-06T22:43:58.064621] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:58.064735] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:58.064980] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:58.158020] [DEBUG] [LOCAL ] RELX: Loaded 48055 existing records from primary storage. [2025-10-06T22:43:58.159764] [DEBUG] [LOCAL ] RERE: Loaded 41085 existing records from primary storage. [2025-10-06T22:43:58.159162] [DEBUG] [LOCAL ] RDY: Loaded 46845 existing records from primary storage. [2025-10-06T22:43:58.160274] [INFO ] [MAIN ] RDY: Loaded 46845 primary data records. [2025-10-06T22:43:58.160199] [INFO ] [MAIN ] RELX: Loaded 48055 primary data records. [2025-10-06T22:43:58.160108] [INFO ] [MAIN ] RERE: Loaded 41085 primary data records. [2025-10-06T22:43:59.167471] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:59.170410] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 41085 primary records. [2025-10-06T22:43:59.172267] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-06T22:43:59.204838] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:59.206799] [INFO ] [MAIN ] RDY: Generated 1794 derivative records from 46845 primary records. [2025-10-06T22:43:59.210793] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-10-06T22:43:59.215904] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-10-06T22:43:59.235335] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-06T22:43:59.246702] [INFO ] [MAIN ] Derivative Progress: 1501/2037 symbols completed. RERE took 1.2s. Estimated remaining: 3m 34s. Rate: 150.2 symbols/min [2025-10-06T22:43:59.254244] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:59.258068] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:43:59.260274] [INFO ] [MAIN ] RELX: Generated 1794 derivative records from 48055 primary records. [2025-10-06T22:43:59.260985] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-10-06T22:43:59.277362] [DEBUG] [LOCAL ] RDY: Derivative data saved (1794 records). [2025-10-06T22:43:59.283330] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-10-06T22:43:59.286933] [INFO ] [MAIN ] Derivative Progress: 1502/2037 symbols completed. RDY took 1.2s. Estimated remaining: 3m 34s. Rate: 150.3 symbols/min [2025-10-06T22:43:59.287853] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:59.296782] [DEBUG] [LOCAL ] RELX: Derivative data saved (1794 records). [2025-10-06T22:43:59.297085] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-10-06T22:43:59.304547] [INFO ] [MAIN ] Derivative Progress: 1503/2037 symbols completed. RELX took 1.2s. Estimated remaining: 3m 33s. Rate: 150.4 symbols/min [2025-10-06T22:43:59.305161] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:43:59.368284] [DEBUG] [LOCAL ] RES: Loaded 47230 existing records from primary storage. [2025-10-06T22:43:59.381208] [INFO ] [MAIN ] RES: Loaded 47230 primary data records. [2025-10-06T22:43:59.368567] [DEBUG] [LOCAL ] REX: Loaded 14253 existing records from primary storage. [2025-10-06T22:43:59.381762] [INFO ] [MAIN ] REX: Loaded 14253 primary data records. [2025-10-06T22:43:59.395020] [DEBUG] [LOCAL ] REVG: Loaded 40624 existing records from primary storage. [2025-10-06T22:43:59.464407] [INFO ] [MAIN ] REVG: Loaded 40624 primary data records. [2025-10-06T22:44:00.545610] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:00.547524] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 47230 primary records. [2025-10-06T22:44:00.548322] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-06T22:44:00.574795] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-10-06T22:44:00.575203] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-06T22:44:00.586671] [INFO ] [MAIN ] Derivative Progress: 1504/2037 symbols completed. RES took 1.3s. Estimated remaining: 3m 33s. Rate: 150.1 symbols/min [2025-10-06T22:44:00.593287] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:00.602129] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:00.609797] [INFO ] [MAIN ] REVG: Generated 1794 derivative records from 40624 primary records. [2025-10-06T22:44:00.610309] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-10-06T22:44:00.611865] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:00.620518] [INFO ] [MAIN ] REX: Generated 1794 derivative records from 14253 primary records. [2025-10-06T22:44:00.627960] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-10-06T22:44:00.632422] [DEBUG] [LOCAL ] REVG: Derivative data saved (1794 records). [2025-10-06T22:44:00.640179] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-10-06T22:44:00.645837] [INFO ] [MAIN ] Derivative Progress: 1505/2037 symbols completed. REVG took 1.4s. Estimated remaining: 3m 32s. Rate: 150.2 symbols/min [2025-10-06T22:44:00.648967] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:00.654388] [DEBUG] [LOCAL ] REX: Derivative data saved (1794 records). [2025-10-06T22:44:00.654776] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-10-06T22:44:00.657890] [INFO ] [MAIN ] Derivative Progress: 1506/2037 symbols completed. REX took 1.4s. Estimated remaining: 3m 32s. Rate: 150.3 symbols/min [2025-10-06T22:44:00.658432] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:00.694145] [DEBUG] [LOCAL ] RFI: Loaded 10454 existing records from primary storage. [2025-10-06T22:44:00.694456] [INFO ] [MAIN ] RFI: Loaded 10454 primary data records. [2025-10-06T22:44:00.821500] [DEBUG] [LOCAL ] REXR: Loaded 52097 existing records from primary storage. [2025-10-06T22:44:00.834862] [INFO ] [MAIN ] REXR: Loaded 52097 primary data records. [2025-10-06T22:44:01.042044] [DEBUG] [LOCAL ] REZI: Loaded 47026 existing records from primary storage. [2025-10-06T22:44:01.071600] [INFO ] [MAIN ] REZI: Loaded 47026 primary data records. [2025-10-06T22:44:01.786410] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:01.789588] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10454 primary records. [2025-10-06T22:44:01.803930] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-06T22:44:01.805237] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:01.807697] [INFO ] [MAIN ] REXR: Generated 1794 derivative records from 52097 primary records. [2025-10-06T22:44:01.808087] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-10-06T22:44:01.843063] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-10-06T22:44:01.846695] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-06T22:44:01.846550] [DEBUG] [LOCAL ] REXR: Derivative data saved (1794 records). [2025-10-06T22:44:01.851568] [INFO ] [MAIN ] Derivative Progress: 1507/2037 symbols completed. RFI took 1.2s. Estimated remaining: 3m 32s. Rate: 150.1 symbols/min [2025-10-06T22:44:01.851865] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-10-06T22:44:01.853371] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:01.867106] [INFO ] [MAIN ] Derivative Progress: 1508/2037 symbols completed. REXR took 1.3s. Estimated remaining: 3m 31s. Rate: 150.2 symbols/min [2025-10-06T22:44:01.872876] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:01.874203] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:01.875170] [INFO ] [MAIN ] REZI: Generated 1794 derivative records from 47026 primary records. [2025-10-06T22:44:01.875237] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-10-06T22:44:01.904611] [DEBUG] [LOCAL ] REZI: Derivative data saved (1794 records). [2025-10-06T22:44:01.904482] [DEBUG] [LOCAL ] RFM: Loaded 4146 existing records from primary storage. [2025-10-06T22:44:01.905255] [INFO ] [MAIN ] RFM: Loaded 4146 primary data records. [2025-10-06T22:44:01.910096] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-10-06T22:44:01.947057] [DEBUG] [LOCAL ] RFL: Loaded 11280 existing records from primary storage. [2025-10-06T22:44:01.974792] [INFO ] [MAIN ] RFL: Loaded 11280 primary data records. [2025-10-06T22:44:01.992474] [INFO ] [MAIN ] Derivative Progress: 1509/2037 symbols completed. REZI took 1.3s. Estimated remaining: 3m 31s. Rate: 150.3 symbols/min [2025-10-06T22:44:02.030503] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:02.430788] [DEBUG] [LOCAL ] RFMZ: Loaded 8713 existing records from primary storage. [2025-10-06T22:44:02.435769] [INFO ] [MAIN ] RFMZ: Loaded 8713 primary data records. [2025-10-06T22:44:02.976703] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:02.979182] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4146 primary records. [2025-10-06T22:44:02.979486] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-06T22:44:03.007145] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:03.011849] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 11280 primary records. [2025-10-06T22:44:03.011956] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-06T22:44:03.016099] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-10-06T22:44:03.024630] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-06T22:44:03.030403] [INFO ] [MAIN ] Derivative Progress: 1510/2037 symbols completed. RFM took 1.2s. Estimated remaining: 3m 31s. Rate: 150.1 symbols/min [2025-10-06T22:44:03.031721] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:03.047402] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:03.049080] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 8713 primary records. [2025-10-06T22:44:03.051437] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-06T22:44:03.053734] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-10-06T22:44:03.061012] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-06T22:44:03.069313] [INFO ] [MAIN ] Derivative Progress: 1511/2037 symbols completed. RFL took 1.2s. Estimated remaining: 3m 30s. Rate: 150.2 symbols/min [2025-10-06T22:44:03.069794] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:03.073125] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-10-06T22:44:03.073288] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-06T22:44:03.076453] [INFO ] [MAIN ] Derivative Progress: 1512/2037 symbols completed. RFMZ took 1.0s. Estimated remaining: 3m 30s. Rate: 150.3 symbols/min [2025-10-06T22:44:03.076922] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:03.093839] [DEBUG] [LOCAL ] RGT: Loaded 2739 existing records from primary storage. [2025-10-06T22:44:03.094074] [INFO ] [MAIN ] RGT: Loaded 2739 primary data records. [2025-10-06T22:44:03.229258] [DEBUG] [LOCAL ] RGA: Loaded 29656 existing records from primary storage. [2025-10-06T22:44:03.241510] [INFO ] [MAIN ] RGA: Loaded 29656 primary data records. [2025-10-06T22:44:03.241436] [DEBUG] [LOCAL ] RGR: Loaded 20697 existing records from primary storage. [2025-10-06T22:44:03.246907] [INFO ] [MAIN ] RGR: Loaded 20697 primary data records. [2025-10-06T22:44:04.083992] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-06T22:44:04.085408] [INFO ] [MAIN ] RGT: Generated 1792 derivative records from 2739 primary records. [2025-10-06T22:44:04.085706] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-06T22:44:04.105767] [DEBUG] [LOCAL ] RGT: Derivative data saved (1792 records). [2025-10-06T22:44:04.106109] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-06T22:44:04.108828] [INFO ] [MAIN ] Derivative Progress: 1513/2037 symbols completed. RGT took 1.0s. Estimated remaining: 3m 29s. Rate: 150.2 symbols/min [2025-10-06T22:44:04.141369] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:04.141127] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:04.142280] [INFO ] [MAIN ] RGR: Generated 1794 derivative records from 20697 primary records. [2025-10-06T22:44:04.142888] [INFO ] [MAIN ] RGA: Generated 1794 derivative records from 29656 primary records. [2025-10-06T22:44:04.143020] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-10-06T22:44:04.142965] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-10-06T22:44:04.173309] [DEBUG] [LOCAL ] RGR: Derivative data saved (1794 records). [2025-10-06T22:44:04.173710] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-10-06T22:44:04.179382] [INFO ] [MAIN ] Derivative Progress: 1514/2037 symbols completed. RGR took 1.1s. Estimated remaining: 3m 29s. Rate: 150.2 symbols/min [2025-10-06T22:44:04.180163] [DEBUG] [LOCAL ] RGA: Derivative data saved (1794 records). [2025-10-06T22:44:04.180234] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-10-06T22:44:04.183398] [INFO ] [MAIN ] Derivative Progress: 1515/2037 symbols completed. RGA took 1.2s. Estimated remaining: 3m 28s. Rate: 150.3 symbols/min [2025-10-06T22:44:04.183911] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:04.183971] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:04.183837] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:04.336230] [DEBUG] [LOCAL ] RHP: Loaded 41067 existing records from primary storage. [2025-10-06T22:44:04.334627] [DEBUG] [LOCAL ] RIG: Loaded 53670 existing records from primary storage. [2025-10-06T22:44:04.350740] [INFO ] [MAIN ] RHP: Loaded 41067 primary data records. [2025-10-06T22:44:04.350617] [INFO ] [MAIN ] RIG: Loaded 53670 primary data records. [2025-10-06T22:44:04.388798] [DEBUG] [LOCAL ] RH: Loaded 47481 existing records from primary storage. [2025-10-06T22:44:04.407103] [INFO ] [MAIN ] RH: Loaded 47481 primary data records. [2025-10-06T22:44:05.406632] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:05.413533] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:05.415270] [INFO ] [MAIN ] RHP: Generated 1794 derivative records from 41067 primary records. [2025-10-06T22:44:05.416219] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-10-06T22:44:05.416119] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53670 primary records. [2025-10-06T22:44:05.417387] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-06T22:44:05.464806] [DEBUG] [LOCAL ] RHP: Derivative data saved (1794 records). [2025-10-06T22:44:05.465994] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-10-06T22:44:05.462411] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:05.468238] [INFO ] [MAIN ] Derivative Progress: 1516/2037 symbols completed. RHP took 1.3s. Estimated remaining: 3m 28s. Rate: 150.1 symbols/min [2025-10-06T22:44:05.471499] [INFO ] [MAIN ] RH: Generated 1794 derivative records from 47481 primary records. [2025-10-06T22:44:05.471631] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-10-06T22:44:05.470109] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:05.471981] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-06T22:44:05.472103] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-10-06T22:44:05.476178] [INFO ] [MAIN ] Derivative Progress: 1517/2037 symbols completed. RIG took 1.3s. Estimated remaining: 3m 28s. Rate: 150.2 symbols/min [2025-10-06T22:44:05.486100] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:05.496192] [DEBUG] [LOCAL ] RH: Derivative data saved (1794 records). [2025-10-06T22:44:05.496404] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-10-06T22:44:05.500121] [INFO ] [MAIN ] Derivative Progress: 1518/2037 symbols completed. RH took 1.3s. Estimated remaining: 3m 27s. Rate: 150.3 symbols/min [2025-10-06T22:44:05.500697] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:05.522243] [DEBUG] [LOCAL ] RIV: Loaded 12420 existing records from primary storage. [2025-10-06T22:44:05.522674] [INFO ] [MAIN ] RIV: Loaded 12420 primary data records. [2025-10-06T22:44:05.725141] [DEBUG] [LOCAL ] RIO: Loaded 53393 existing records from primary storage. [2025-10-06T22:44:05.732416] [INFO ] [MAIN ] RIO: Loaded 53393 primary data records. [2025-10-06T22:44:05.760936] [DEBUG] [LOCAL ] RITM: Loaded 52870 existing records from primary storage. [2025-10-06T22:44:05.799037] [INFO ] [MAIN ] RITM: Loaded 52870 primary data records. [2025-10-06T22:44:06.690062] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:44:06.691447] [INFO ] [MAIN ] RIV: Generated 1793 derivative records from 12420 primary records. [2025-10-06T22:44:06.691989] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-06T22:44:06.729021] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:06.730191] [INFO ] [MAIN ] RIO: Generated 1794 derivative records from 53393 primary records. [2025-10-06T22:44:06.728556] [DEBUG] [LOCAL ] RIV: Derivative data saved (1793 records). [2025-10-06T22:44:06.730429] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-10-06T22:44:06.730505] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-10-06T22:44:06.732973] [INFO ] [MAIN ] Derivative Progress: 1519/2037 symbols completed. RIV took 1.2s. Estimated remaining: 3m 27s. Rate: 150.1 symbols/min [2025-10-06T22:44:06.734043] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:06.766850] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:06.769427] [INFO ] [MAIN ] RITM: Generated 1794 derivative records from 52870 primary records. [2025-10-06T22:44:06.770500] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-10-06T22:44:06.773533] [DEBUG] [LOCAL ] RIO: Derivative data saved (1794 records). [2025-10-06T22:44:06.774127] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-10-06T22:44:06.777103] [INFO ] [MAIN ] Derivative Progress: 1520/2037 symbols completed. RIO took 1.3s. Estimated remaining: 3m 27s. Rate: 150.2 symbols/min [2025-10-06T22:44:06.785395] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:06.795775] [DEBUG] [LOCAL ] RITM: Derivative data saved (1794 records). [2025-10-06T22:44:06.796097] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-10-06T22:44:06.800807] [INFO ] [MAIN ] Derivative Progress: 1521/2037 symbols completed. RITM took 1.3s. Estimated remaining: 3m 26s. Rate: 150.3 symbols/min [2025-10-06T22:44:06.801147] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:06.855538] [DEBUG] [LOCAL ] RKT: Loaded 53723 existing records from primary storage. [2025-10-06T22:44:06.856003] [INFO ] [MAIN ] RKT: Loaded 53723 primary data records. [2025-10-06T22:44:06.995405] [DEBUG] [LOCAL ] RLI: Loaded 33924 existing records from primary storage. [2025-10-06T22:44:07.001370] [INFO ] [MAIN ] RLI: Loaded 33924 primary data records. [2025-10-06T22:44:07.118170] [DEBUG] [LOCAL ] RLJ: Loaded 48114 existing records from primary storage. [2025-10-06T22:44:07.220968] [INFO ] [MAIN ] RLJ: Loaded 48114 primary data records. [2025-10-06T22:44:07.928586] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:07.930369] [INFO ] [MAIN ] RKT: Generated 1794 derivative records from 53723 primary records. [2025-10-06T22:44:07.931106] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-10-06T22:44:07.951069] [DEBUG] [LOCAL ] RKT: Derivative data saved (1794 records). [2025-10-06T22:44:07.951774] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-10-06T22:44:07.954276] [INFO ] [MAIN ] Derivative Progress: 1522/2037 symbols completed. RKT took 1.2s. Estimated remaining: 3m 26s. Rate: 150.1 symbols/min [2025-10-06T22:44:07.954986] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:07.975860] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:07.981264] [INFO ] [MAIN ] RLI: Generated 1794 derivative records from 33924 primary records. [2025-10-06T22:44:07.981617] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-10-06T22:44:08.000983] [DEBUG] [LOCAL ] RLTY: Loaded 11206 existing records from primary storage. [2025-10-06T22:44:08.022099] [DEBUG] [LOCAL ] RLI: Derivative data saved (1794 records). [2025-10-06T22:44:08.022899] [INFO ] [MAIN ] RLTY: Loaded 11206 primary data records. [2025-10-06T22:44:08.023100] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-10-06T22:44:08.022681] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:08.027701] [INFO ] [MAIN ] Derivative Progress: 1523/2037 symbols completed. RLI took 1.2s. Estimated remaining: 3m 25s. Rate: 150.2 symbols/min [2025-10-06T22:44:08.033360] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:08.051856] [INFO ] [MAIN ] RLJ: Generated 1794 derivative records from 48114 primary records. [2025-10-06T22:44:08.074296] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-10-06T22:44:08.179158] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1794 records). [2025-10-06T22:44:08.196868] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-10-06T22:44:08.205872] [INFO ] [MAIN ] Derivative Progress: 1524/2037 symbols completed. RLJ took 1.4s. Estimated remaining: 3m 25s. Rate: 150.2 symbols/min [2025-10-06T22:44:08.228463] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:08.422955] [DEBUG] [LOCAL ] RM: Loaded 7565 existing records from primary storage. [2025-10-06T22:44:08.424437] [INFO ] [MAIN ] RM: Loaded 7565 primary data records. [2025-10-06T22:44:08.459261] [DEBUG] [LOCAL ] RLX: Loaded 48160 existing records from primary storage. [2025-10-06T22:44:08.478456] [INFO ] [MAIN ] RLX: Loaded 48160 primary data records. [2025-10-06T22:44:09.078271] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:09.080079] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11206 primary records. [2025-10-06T22:44:09.080485] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-06T22:44:09.229217] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-10-06T22:44:09.229557] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-06T22:44:09.232061] [INFO ] [MAIN ] Derivative Progress: 1525/2037 symbols completed. RLTY took 1.3s. Estimated remaining: 3m 25s. Rate: 150.1 symbols/min [2025-10-06T22:44:09.233260] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:09.265395] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:09.274089] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7565 primary records. [2025-10-06T22:44:09.274263] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-06T22:44:09.274672] [DEBUG] [LOCAL ] RMAX: Loaded 21508 existing records from primary storage. [2025-10-06T22:44:09.274921] [INFO ] [MAIN ] RMAX: Loaded 21508 primary data records. [2025-10-06T22:44:09.360535] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-10-06T22:44:09.396115] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:09.407883] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-06T22:44:09.422356] [INFO ] [MAIN ] Derivative Progress: 1526/2037 symbols completed. RM took 1.2s. Estimated remaining: 3m 24s. Rate: 150.1 symbols/min [2025-10-06T22:44:09.423789] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48160 primary records. [2025-10-06T22:44:09.424227] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:09.425042] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-06T22:44:09.643333] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-10-06T22:44:09.648230] [DEBUG] [LOCAL ] RMI: Loaded 4694 existing records from primary storage. [2025-10-06T22:44:09.648704] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-06T22:44:09.648861] [INFO ] [MAIN ] RMI: Loaded 4694 primary data records. [2025-10-06T22:44:09.657888] [INFO ] [MAIN ] Derivative Progress: 1527/2037 symbols completed. RLX took 1.6s. Estimated remaining: 3m 24s. Rate: 150.2 symbols/min [2025-10-06T22:44:09.671038] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:09.864318] [DEBUG] [LOCAL ] RMM: Loaded 10607 existing records from primary storage. [2025-10-06T22:44:09.982686] [INFO ] [MAIN ] RMM: Loaded 10607 primary data records. [2025-10-06T22:44:10.123090] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:10.153513] [INFO ] [MAIN ] RMAX: Generated 1794 derivative records from 21508 primary records. [2025-10-06T22:44:10.180418] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-10-06T22:44:10.352271] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1794 records). [2025-10-06T22:44:10.353092] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-10-06T22:44:10.355781] [INFO ] [MAIN ] Derivative Progress: 1528/2037 symbols completed. RMAX took 1.1s. Estimated remaining: 3m 23s. Rate: 150.1 symbols/min [2025-10-06T22:44:10.379415] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:10.380484] [INFO ] [MAIN ] RMI: Generated 1794 derivative records from 4694 primary records. [2025-10-06T22:44:10.380579] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-10-06T22:44:10.398943] [DEBUG] [LOCAL ] RMI: Derivative data saved (1794 records). [2025-10-06T22:44:10.399195] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-10-06T22:44:10.402545] [INFO ] [MAIN ] Derivative Progress: 1529/2037 symbols completed. RMI took 1.0s. Estimated remaining: 3m 23s. Rate: 150.2 symbols/min [2025-10-06T22:44:10.420465] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:10.421660] [INFO ] [MAIN ] RMM: Generated 1794 derivative records from 10607 primary records. [2025-10-06T22:44:10.421734] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-10-06T22:44:10.439113] [DEBUG] [LOCAL ] RMM: Derivative data saved (1794 records). [2025-10-06T22:44:10.439181] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-10-06T22:44:10.443101] [INFO ] [MAIN ] Derivative Progress: 1530/2037 symbols completed. RMM took 0.8s. Estimated remaining: 3m 22s. Rate: 150.3 symbols/min [2025-10-06T22:44:10.443765] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:10.443686] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:10.444007] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:10.455192] [DEBUG] [LOCAL ] RMMZ: Loaded 4816 existing records from primary storage. [2025-10-06T22:44:10.455538] [INFO ] [MAIN ] RMMZ: Loaded 4816 primary data records. [2025-10-06T22:44:10.585198] [DEBUG] [LOCAL ] RMT: Loaded 17391 existing records from primary storage. [2025-10-06T22:44:10.585585] [INFO ] [MAIN ] RMT: Loaded 17391 primary data records. [2025-10-06T22:44:10.943328] [DEBUG] [LOCAL ] RNG: Loaded 47976 existing records from primary storage. [2025-10-06T22:44:10.950346] [INFO ] [MAIN ] RNG: Loaded 47976 primary data records. [2025-10-06T22:44:11.561562] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:11.564134] [INFO ] [MAIN ] RMMZ: Generated 1794 derivative records from 4816 primary records. [2025-10-06T22:44:11.565011] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-06T22:44:11.584002] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1794 records). [2025-10-06T22:44:11.586096] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-06T22:44:11.589265] [INFO ] [MAIN ] Derivative Progress: 1531/2037 symbols completed. RMMZ took 1.1s. Estimated remaining: 3m 22s. Rate: 150.1 symbols/min [2025-10-06T22:44:11.605017] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:11.604854] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:11.606420] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17391 primary records. [2025-10-06T22:44:11.607224] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-06T22:44:11.630118] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-10-06T22:44:11.630630] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-06T22:44:11.640110] [INFO ] [MAIN ] Derivative Progress: 1532/2037 symbols completed. RMT took 1.2s. Estimated remaining: 3m 22s. Rate: 150.2 symbols/min [2025-10-06T22:44:11.653869] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:11.654404] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:11.655848] [INFO ] [MAIN ] RNG: Generated 1794 derivative records from 47976 primary records. [2025-10-06T22:44:11.655945] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-10-06T22:44:11.680542] [DEBUG] [LOCAL ] RNGR: Loaded 20390 existing records from primary storage. [2025-10-06T22:44:11.681661] [INFO ] [MAIN ] RNGR: Loaded 20390 primary data records. [2025-10-06T22:44:11.684129] [DEBUG] [LOCAL ] RNG: Derivative data saved (1794 records). [2025-10-06T22:44:11.694210] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-10-06T22:44:11.705085] [INFO ] [MAIN ] Derivative Progress: 1533/2037 symbols completed. RNG took 1.3s. Estimated remaining: 3m 21s. Rate: 150.2 symbols/min [2025-10-06T22:44:11.716059] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:11.776375] [DEBUG] [LOCAL ] RNP: Loaded 15983 existing records from primary storage. [2025-10-06T22:44:11.788947] [INFO ] [MAIN ] RNP: Loaded 15983 primary data records. [2025-10-06T22:44:12.194495] [DEBUG] [LOCAL ] RNR: Loaded 33812 existing records from primary storage. [2025-10-06T22:44:12.195222] [INFO ] [MAIN ] RNR: Loaded 33812 primary data records. [2025-10-06T22:44:12.773740] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:12.775708] [INFO ] [MAIN ] RNGR: Generated 1794 derivative records from 20390 primary records. [2025-10-06T22:44:12.776175] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-10-06T22:44:12.817484] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:12.821408] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 15983 primary records. [2025-10-06T22:44:12.821737] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-06T22:44:12.832254] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1794 records). [2025-10-06T22:44:12.849696] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-10-06T22:44:12.853476] [INFO ] [MAIN ] Derivative Progress: 1534/2037 symbols completed. RNGR took 1.2s. Estimated remaining: 3m 21s. Rate: 150.1 symbols/min [2025-10-06T22:44:12.854026] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:12.854583] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:12.857051] [INFO ] [MAIN ] RNR: Generated 1794 derivative records from 33812 primary records. [2025-10-06T22:44:12.857396] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-10-06T22:44:12.877512] [DEBUG] [LOCAL ] RNR: Derivative data saved (1794 records). [2025-10-06T22:44:12.877786] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-10-06T22:44:12.877395] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-10-06T22:44:12.882008] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-06T22:44:12.881636] [INFO ] [MAIN ] Derivative Progress: 1535/2037 symbols completed. RNR took 1.2s. Estimated remaining: 3m 21s. Rate: 150.2 symbols/min [2025-10-06T22:44:12.886032] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:12.886407] [INFO ] [MAIN ] Derivative Progress: 1536/2037 symbols completed. RNP took 1.2s. Estimated remaining: 3m 20s. Rate: 150.3 symbols/min [2025-10-06T22:44:12.887005] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:12.935543] [DEBUG] [LOCAL ] RNST: Loaded 36974 existing records from primary storage. [2025-10-06T22:44:12.936079] [DEBUG] [LOCAL ] ROG: Loaded 22753 existing records from primary storage. [2025-10-06T22:44:12.936634] [INFO ] [MAIN ] ROG: Loaded 22753 primary data records. [2025-10-06T22:44:12.936940] [INFO ] [MAIN ] RNST: Loaded 36974 primary data records. [2025-10-06T22:44:13.186184] [DEBUG] [LOCAL ] RPM: Loaded 41589 existing records from primary storage. [2025-10-06T22:44:13.190785] [INFO ] [MAIN ] RPM: Loaded 41589 primary data records. [2025-10-06T22:44:14.004785] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:14.020998] [INFO ] [MAIN ] RNST: Generated 1794 derivative records from 36974 primary records. [2025-10-06T22:44:14.022231] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-10-06T22:44:14.021953] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:14.024905] [INFO ] [MAIN ] ROG: Generated 1794 derivative records from 22753 primary records. [2025-10-06T22:44:14.025318] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-10-06T22:44:14.077338] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:14.081980] [INFO ] [MAIN ] RPM: Generated 1794 derivative records from 41589 primary records. [2025-10-06T22:44:14.082351] [DEBUG] [LOCAL ] RNST: Derivative data saved (1794 records). [2025-10-06T22:44:14.082773] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-10-06T22:44:14.086714] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-10-06T22:44:14.083406] [DEBUG] [LOCAL ] ROG: Derivative data saved (1794 records). [2025-10-06T22:44:14.086980] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-10-06T22:44:14.086594] [INFO ] [MAIN ] Derivative Progress: 1537/2037 symbols completed. RNST took 1.2s. Estimated remaining: 3m 20s. Rate: 150.1 symbols/min [2025-10-06T22:44:14.090367] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:14.091195] [INFO ] [MAIN ] Derivative Progress: 1538/2037 symbols completed. ROG took 1.2s. Estimated remaining: 3m 19s. Rate: 150.2 symbols/min [2025-10-06T22:44:14.092579] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:14.137052] [DEBUG] [LOCAL ] RPM: Derivative data saved (1794 records). [2025-10-06T22:44:14.137248] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-10-06T22:44:14.141618] [INFO ] [MAIN ] Derivative Progress: 1539/2037 symbols completed. RPM took 1.3s. Estimated remaining: 3m 19s. Rate: 150.2 symbols/min [2025-10-06T22:44:14.141876] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:14.160687] [DEBUG] [LOCAL ] RPT: Loaded 18988 existing records from primary storage. [2025-10-06T22:44:14.160950] [INFO ] [MAIN ] RPT: Loaded 18988 primary data records. [2025-10-06T22:44:14.280309] [DEBUG] [LOCAL ] RQI: Loaded 29074 existing records from primary storage. [2025-10-06T22:44:14.280902] [INFO ] [MAIN ] RQI: Loaded 29074 primary data records. [2025-10-06T22:44:14.694773] [DEBUG] [LOCAL ] RRC: Loaded 52852 existing records from primary storage. [2025-10-06T22:44:14.724938] [INFO ] [MAIN ] RRC: Loaded 52852 primary data records. [2025-10-06T22:44:15.271160] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:15.272940] [INFO ] [MAIN ] RPT: Generated 1794 derivative records from 18988 primary records. [2025-10-06T22:44:15.273206] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-06T22:44:15.287626] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:15.288680] [INFO ] [MAIN ] RQI: Generated 1794 derivative records from 29074 primary records. [2025-10-06T22:44:15.295508] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-10-06T22:44:15.323171] [DEBUG] [LOCAL ] RQI: Derivative data saved (1794 records). [2025-10-06T22:44:15.323880] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-10-06T22:44:15.327664] [INFO ] [MAIN ] Derivative Progress: 1540/2037 symbols completed. RQI took 1.2s. Estimated remaining: 3m 19s. Rate: 150.0 symbols/min [2025-10-06T22:44:15.328299] [DEBUG] [LOCAL ] RPT: Derivative data saved (1794 records). [2025-10-06T22:44:15.328576] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:15.328962] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-06T22:44:15.332195] [INFO ] [MAIN ] Derivative Progress: 1541/2037 symbols completed. RPT took 1.2s. Estimated remaining: 3m 18s. Rate: 150.1 symbols/min [2025-10-06T22:44:15.332517] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:15.352701] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:15.353815] [INFO ] [MAIN ] RRC: Generated 1794 derivative records from 52852 primary records. [2025-10-06T22:44:15.354004] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-10-06T22:44:15.387556] [DEBUG] [LOCAL ] RRC: Derivative data saved (1794 records). [2025-10-06T22:44:15.387751] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-10-06T22:44:15.391768] [INFO ] [MAIN ] Derivative Progress: 1542/2037 symbols completed. RRC took 1.2s. Estimated remaining: 3m 18s. Rate: 150.2 symbols/min [2025-10-06T22:44:15.392104] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:15.402069] [DEBUG] [LOCAL ] RS: Loaded 25118 existing records from primary storage. [2025-10-06T22:44:15.402200] [INFO ] [MAIN ] RS: Loaded 25118 primary data records. [2025-10-06T22:44:15.444224] [DEBUG] [LOCAL ] RSF: Loaded 4284 existing records from primary storage. [2025-10-06T22:44:15.479886] [INFO ] [MAIN ] RSF: Loaded 4284 primary data records. [2025-10-06T22:44:15.534366] [DEBUG] [LOCAL ] RRX: Loaded 41022 existing records from primary storage. [2025-10-06T22:44:15.587839] [INFO ] [MAIN ] RRX: Loaded 41022 primary data records. [2025-10-06T22:44:16.392359] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-06T22:44:16.392770] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:16.393699] [INFO ] [MAIN ] RS: Generated 1794 derivative records from 25118 primary records. [2025-10-06T22:44:16.394327] [INFO ] [MAIN ] RSF: Generated 1791 derivative records from 4284 primary records. [2025-10-06T22:44:16.394463] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-10-06T22:44:16.394533] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-06T22:44:16.424535] [DEBUG] [LOCAL ] RS: Derivative data saved (1794 records). [2025-10-06T22:44:16.428462] [DEBUG] [LOCAL ] RSF: Derivative data saved (1791 records). [2025-10-06T22:44:16.428759] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-10-06T22:44:16.428567] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-06T22:44:16.431875] [INFO ] [MAIN ] Derivative Progress: 1543/2037 symbols completed. RSF took 1.0s. Estimated remaining: 3m 18s. Rate: 150.1 symbols/min [2025-10-06T22:44:16.448061] [INFO ] [MAIN ] Derivative Progress: 1544/2037 symbols completed. RS took 1.1s. Estimated remaining: 3m 17s. Rate: 150.2 symbols/min [2025-10-06T22:44:16.447869] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:16.448911] [INFO ] [MAIN ] RRX: Generated 1794 derivative records from 41022 primary records. [2025-10-06T22:44:16.448998] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-10-06T22:44:16.464173] [DEBUG] [LOCAL ] RRX: Derivative data saved (1794 records). [2025-10-06T22:44:16.464232] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-10-06T22:44:16.467431] [INFO ] [MAIN ] Derivative Progress: 1545/2037 symbols completed. RRX took 1.1s. Estimated remaining: 3m 16s. Rate: 150.3 symbols/min [2025-10-06T22:44:16.468009] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:16.467931] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:16.467880] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:16.549473] [DEBUG] [LOCAL ] RTO: Loaded 40048 existing records from primary storage. [2025-10-06T22:44:16.550920] [DEBUG] [LOCAL ] RSI: Loaded 46819 existing records from primary storage. [2025-10-06T22:44:16.551115] [INFO ] [MAIN ] RTO: Loaded 40048 primary data records. [2025-10-06T22:44:16.551205] [INFO ] [MAIN ] RSI: Loaded 46819 primary data records. [2025-10-06T22:44:16.750162] [DEBUG] [LOCAL ] RSKD: Loaded 33490 existing records from primary storage. [2025-10-06T22:44:16.773462] [INFO ] [MAIN ] RSKD: Loaded 33490 primary data records. [2025-10-06T22:44:17.601453] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:17.602540] [INFO ] [MAIN ] RSI: Generated 1794 derivative records from 46819 primary records. [2025-10-06T22:44:17.602750] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-10-06T22:44:17.603180] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:17.604554] [INFO ] [MAIN ] RTO: Generated 1794 derivative records from 40048 primary records. [2025-10-06T22:44:17.604929] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-10-06T22:44:17.637379] [DEBUG] [LOCAL ] RSI: Derivative data saved (1794 records). [2025-10-06T22:44:17.640065] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-10-06T22:44:17.642988] [INFO ] [MAIN ] Derivative Progress: 1546/2037 symbols completed. RSI took 1.2s. Estimated remaining: 3m 16s. Rate: 150.1 symbols/min [2025-10-06T22:44:17.643709] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:17.660240] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:17.661697] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 33490 primary records. [2025-10-06T22:44:17.662696] [DEBUG] [LOCAL ] RTO: Derivative data saved (1794 records). [2025-10-06T22:44:17.662779] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-10-06T22:44:17.666930] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-06T22:44:17.666850] [INFO ] [MAIN ] Derivative Progress: 1547/2037 symbols completed. RTO took 1.2s. Estimated remaining: 3m 16s. Rate: 150.2 symbols/min [2025-10-06T22:44:17.668272] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:17.683038] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-10-06T22:44:17.683293] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-06T22:44:17.687306] [INFO ] [MAIN ] Derivative Progress: 1548/2037 symbols completed. RSKD took 1.2s. Estimated remaining: 3m 15s. Rate: 150.3 symbols/min [2025-10-06T22:44:17.687837] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:17.727738] [DEBUG] [LOCAL ] RVT: Loaded 26395 existing records from primary storage. [2025-10-06T22:44:17.741266] [INFO ] [MAIN ] RVT: Loaded 26395 primary data records. [2025-10-06T22:44:17.753794] [DEBUG] [LOCAL ] RVLV: Loaded 47506 existing records from primary storage. [2025-10-06T22:44:17.787910] [INFO ] [MAIN ] RVLV: Loaded 47506 primary data records. [2025-10-06T22:44:17.997862] [DEBUG] [LOCAL ] RWT: Loaded 40852 existing records from primary storage. [2025-10-06T22:44:18.028887] [INFO ] [MAIN ] RWT: Loaded 40852 primary data records. [2025-10-06T22:44:18.747799] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:18.751319] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 26395 primary records. [2025-10-06T22:44:18.751950] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-06T22:44:18.786429] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:18.789057] [INFO ] [MAIN ] RVLV: Generated 1794 derivative records from 47506 primary records. [2025-10-06T22:44:18.790226] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-10-06T22:44:18.795151] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-10-06T22:44:18.796933] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-10-06T22:44:18.806750] [INFO ] [MAIN ] Derivative Progress: 1549/2037 symbols completed. RVT took 1.1s. Estimated remaining: 3m 15s. Rate: 150.1 symbols/min [2025-10-06T22:44:18.808084] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:18.829434] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:18.831121] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40852 primary records. [2025-10-06T22:44:18.831486] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-06T22:44:18.850685] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-10-06T22:44:18.851147] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-06T22:44:18.855175] [INFO ] [MAIN ] Derivative Progress: 1550/2037 symbols completed. RWT took 1.2s. Estimated remaining: 3m 15s. Rate: 150.2 symbols/min [2025-10-06T22:44:18.855638] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1794 records). [2025-10-06T22:44:18.856124] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:18.856491] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-10-06T22:44:18.859877] [INFO ] [MAIN ] Derivative Progress: 1551/2037 symbols completed. RVLV took 1.2s. Estimated remaining: 3m 14s. Rate: 150.3 symbols/min [2025-10-06T22:44:18.860704] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:18.915702] [DEBUG] [LOCAL ] RXO: Loaded 47976 existing records from primary storage. [2025-10-06T22:44:18.916085] [INFO ] [MAIN ] RXO: Loaded 47976 primary data records. [2025-10-06T22:44:19.083769] [DEBUG] [LOCAL ] RYAM: Loaded 35095 existing records from primary storage. [2025-10-06T22:44:19.096189] [DEBUG] [LOCAL ] RY: Loaded 47823 existing records from primary storage. [2025-10-06T22:44:19.116599] [INFO ] [MAIN ] RYAM: Loaded 35095 primary data records. [2025-10-06T22:44:19.125107] [INFO ] [MAIN ] RY: Loaded 47823 primary data records. [2025-10-06T22:44:20.068668] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:20.069841] [INFO ] [MAIN ] RXO: Generated 1794 derivative records from 47976 primary records. [2025-10-06T22:44:20.070470] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-06T22:44:20.092249] [DEBUG] [LOCAL ] RXO: Derivative data saved (1794 records). [2025-10-06T22:44:20.092809] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-10-06T22:44:20.096134] [INFO ] [MAIN ] Derivative Progress: 1552/2037 symbols completed. RXO took 1.3s. Estimated remaining: 3m 14s. Rate: 150.1 symbols/min [2025-10-06T22:44:20.096731] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:20.133115] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:20.134973] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 47823 primary records. [2025-10-06T22:44:20.135481] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-06T22:44:20.135360] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:20.136155] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35095 primary records. [2025-10-06T22:44:20.137013] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-06T22:44:20.178303] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-10-06T22:44:20.178535] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-06T22:44:20.184212] [INFO ] [MAIN ] Derivative Progress: 1553/2037 symbols completed. RY took 1.3s. Estimated remaining: 3m 13s. Rate: 150.1 symbols/min [2025-10-06T22:44:20.184559] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:20.200431] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-10-06T22:44:20.200738] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-06T22:44:20.204433] [INFO ] [MAIN ] Derivative Progress: 1554/2037 symbols completed. RYAM took 1.3s. Estimated remaining: 3m 13s. Rate: 150.2 symbols/min [2025-10-06T22:44:20.204974] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:20.231936] [DEBUG] [LOCAL ] RYAN: Loaded 44584 existing records from primary storage. [2025-10-06T22:44:20.239266] [INFO ] [MAIN ] RYAN: Loaded 44584 primary data records. [2025-10-06T22:44:20.241361] [DEBUG] [LOCAL ] RYI: Loaded 21616 existing records from primary storage. [2025-10-06T22:44:20.260419] [INFO ] [MAIN ] RYI: Loaded 21616 primary data records. [2025-10-06T22:44:20.581521] [DEBUG] [LOCAL ] RYN: Loaded 45522 existing records from primary storage. [2025-10-06T22:44:20.633859] [INFO ] [MAIN ] RYN: Loaded 45522 primary data records. [2025-10-06T22:44:21.524153] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:21.526344] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 44584 primary records. [2025-10-06T22:44:21.526537] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-06T22:44:21.556874] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:21.561493] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21616 primary records. [2025-10-06T22:44:21.561673] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-06T22:44:21.564151] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-10-06T22:44:21.565568] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-06T22:44:21.568051] [INFO ] [MAIN ] Derivative Progress: 1555/2037 symbols completed. RYAN took 1.5s. Estimated remaining: 3m 13s. Rate: 150.0 symbols/min [2025-10-06T22:44:21.568948] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:21.599309] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-10-06T22:44:21.608305] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-06T22:44:21.605337] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:21.608625] [DEBUG] [LOCAL ] RZB: Loaded 6105 existing records from primary storage. [2025-10-06T22:44:21.611787] [INFO ] [MAIN ] RZB: Loaded 6105 primary data records. [2025-10-06T22:44:21.611527] [INFO ] [MAIN ] Derivative Progress: 1556/2037 symbols completed. RYI took 1.4s. Estimated remaining: 3m 12s. Rate: 150.1 symbols/min [2025-10-06T22:44:21.612915] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45522 primary records. [2025-10-06T22:44:21.634679] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:21.634772] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-06T22:44:21.732077] [DEBUG] [LOCAL ] RZC: Loaded 6753 existing records from primary storage. [2025-10-06T22:44:21.748883] [INFO ] [MAIN ] RZC: Loaded 6753 primary data records. [2025-10-06T22:44:21.856969] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-10-06T22:44:21.881298] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-06T22:44:21.930560] [INFO ] [MAIN ] Derivative Progress: 1557/2037 symbols completed. RYN took 1.7s. Estimated remaining: 3m 12s. Rate: 150.1 symbols/min [2025-10-06T22:44:21.983481] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:22.429732] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:22.430572] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 6105 primary records. [2025-10-06T22:44:22.431822] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-06T22:44:22.456273] [DEBUG] [LOCAL ] S: Loaded 53532 existing records from primary storage. [2025-10-06T22:44:22.464396] [INFO ] [MAIN ] S: Loaded 53532 primary data records. [2025-10-06T22:44:22.490686] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-10-06T22:44:22.501293] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-06T22:44:22.509218] [INFO ] [MAIN ] Derivative Progress: 1558/2037 symbols completed. RZB took 0.9s. Estimated remaining: 3m 12s. Rate: 150.1 symbols/min [2025-10-06T22:44:22.563995] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:22.591395] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6753 primary records. [2025-10-06T22:44:22.613094] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-06T22:44:22.827487] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-10-06T22:44:22.827840] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-06T22:44:22.830830] [INFO ] [MAIN ] Derivative Progress: 1559/2037 symbols completed. RZC took 1.2s. Estimated remaining: 3m 11s. Rate: 150.1 symbols/min [2025-10-06T22:44:22.855521] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:22.856469] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53532 primary records. [2025-10-06T22:44:22.856538] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-06T22:44:22.874187] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-10-06T22:44:22.874303] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-06T22:44:22.876884] [INFO ] [MAIN ] Derivative Progress: 1560/2037 symbols completed. S took 0.9s. Estimated remaining: 3m 11s. Rate: 150.2 symbols/min [2025-10-06T22:44:22.877476] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:22.877403] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:22.878033] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:22.891511] [DEBUG] [LOCAL ] SABA: Loaded 9269 existing records from primary storage. [2025-10-06T22:44:22.891871] [INFO ] [MAIN ] SABA: Loaded 9269 primary data records. [2025-10-06T22:44:23.126741] [DEBUG] [LOCAL ] SA: Loaded 43688 existing records from primary storage. [2025-10-06T22:44:23.236103] [INFO ] [MAIN ] SA: Loaded 43688 primary data records. [2025-10-06T22:44:23.241983] [DEBUG] [LOCAL ] SAFE: Loaded 30265 existing records from primary storage. [2025-10-06T22:44:23.262380] [INFO ] [MAIN ] SAFE: Loaded 30265 primary data records. [2025-10-06T22:44:23.956164] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:23.957588] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9269 primary records. [2025-10-06T22:44:23.958022] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-06T22:44:23.977823] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-10-06T22:44:23.979673] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-06T22:44:23.982396] [INFO ] [MAIN ] Derivative Progress: 1561/2037 symbols completed. SABA took 1.1s. Estimated remaining: 3m 10s. Rate: 150.0 symbols/min [2025-10-06T22:44:23.982863] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:23.998031] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:23.999073] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 43688 primary records. [2025-10-06T22:44:23.999285] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-06T22:44:24.039741] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-10-06T22:44:24.046034] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:24.047070] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-06T22:44:24.047879] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30265 primary records. [2025-10-06T22:44:24.051085] [INFO ] [MAIN ] Derivative Progress: 1562/2037 symbols completed. SA took 1.2s. Estimated remaining: 3m 10s. Rate: 150.1 symbols/min [2025-10-06T22:44:24.048372] [DEBUG] [LOCAL ] SAH: Loaded 21715 existing records from primary storage. [2025-10-06T22:44:24.048449] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-06T22:44:24.051260] [INFO ] [MAIN ] SAH: Loaded 21715 primary data records. [2025-10-06T22:44:24.052479] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:24.228201] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-10-06T22:44:24.261914] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-06T22:44:24.272802] [INFO ] [MAIN ] Derivative Progress: 1563/2037 symbols completed. SAFE took 1.4s. Estimated remaining: 3m 9s. Rate: 150.1 symbols/min [2025-10-06T22:44:24.291014] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:24.416810] [DEBUG] [LOCAL ] SAM: Loaded 21406 existing records from primary storage. [2025-10-06T22:44:24.417761] [INFO ] [MAIN ] SAM: Loaded 21406 primary data records. [2025-10-06T22:44:24.794311] [DEBUG] [LOCAL ] SAN: Loaded 52977 existing records from primary storage. [2025-10-06T22:44:24.801259] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:24.802791] [INFO ] [MAIN ] SAN: Loaded 52977 primary data records. [2025-10-06T22:44:24.802699] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 21715 primary records. [2025-10-06T22:44:24.803769] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-06T22:44:25.127439] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-10-06T22:44:25.138315] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-06T22:44:25.141260] [INFO ] [MAIN ] Derivative Progress: 1564/2037 symbols completed. SAH took 1.2s. Estimated remaining: 3m 9s. Rate: 150.0 symbols/min [2025-10-06T22:44:25.141724] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:25.161997] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:25.163531] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21406 primary records. [2025-10-06T22:44:25.163739] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-06T22:44:25.189590] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-10-06T22:44:25.190145] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-06T22:44:25.194329] [INFO ] [MAIN ] Derivative Progress: 1565/2037 symbols completed. SAM took 1.1s. Estimated remaining: 3m 9s. Rate: 150.1 symbols/min [2025-10-06T22:44:25.196227] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:25.210535] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:25.227841] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 52977 primary records. [2025-10-06T22:44:25.228022] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-06T22:44:25.247197] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-10-06T22:44:25.247632] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-06T22:44:25.265315] [INFO ] [MAIN ] Derivative Progress: 1566/2037 symbols completed. SAN took 1.0s. Estimated remaining: 3m 8s. Rate: 150.2 symbols/min [2025-10-06T22:44:25.267230] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:25.269242] [DEBUG] [LOCAL ] SAND: Loaded 51800 existing records from primary storage. [2025-10-06T22:44:25.269574] [INFO ] [MAIN ] SAND: Loaded 51800 primary data records. [2025-10-06T22:44:25.451388] [DEBUG] [LOCAL ] SAR: Loaded 16460 existing records from primary storage. [2025-10-06T22:44:25.468472] [INFO ] [MAIN ] SAR: Loaded 16460 primary data records. [2025-10-06T22:44:25.475273] [DEBUG] [LOCAL ] SAP: Loaded 49939 existing records from primary storage. [2025-10-06T22:44:25.518630] [INFO ] [MAIN ] SAP: Loaded 49939 primary data records. [2025-10-06T22:44:26.356196] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:26.357470] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51800 primary records. [2025-10-06T22:44:26.357785] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-06T22:44:26.375909] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-10-06T22:44:26.376153] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-06T22:44:26.378963] [INFO ] [MAIN ] Derivative Progress: 1567/2037 symbols completed. SAND took 1.2s. Estimated remaining: 3m 8s. Rate: 150.0 symbols/min [2025-10-06T22:44:26.379320] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:26.398803] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:26.401519] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 16460 primary records. [2025-10-06T22:44:26.401749] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-06T22:44:26.423533] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:26.428518] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 49939 primary records. [2025-10-06T22:44:26.428729] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-06T22:44:26.450398] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-10-06T22:44:26.451429] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-06T22:44:26.455098] [INFO ] [MAIN ] Derivative Progress: 1568/2037 symbols completed. SAP took 1.3s. Estimated remaining: 3m 8s. Rate: 150.1 symbols/min [2025-10-06T22:44:26.455278] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-10-06T22:44:26.455470] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:26.455920] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-06T22:44:26.471021] [INFO ] [MAIN ] Derivative Progress: 1569/2037 symbols completed. SAR took 1.2s. Estimated remaining: 3m 7s. Rate: 150.2 symbols/min [2025-10-06T22:44:26.471502] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:26.491947] [DEBUG] [LOCAL ] SARO: Loaded 48593 existing records from primary storage. [2025-10-06T22:44:26.492217] [INFO ] [MAIN ] SARO: Loaded 48593 primary data records. [2025-10-06T22:44:26.620335] [DEBUG] [LOCAL ] SB: Loaded 33086 existing records from primary storage. [2025-10-06T22:44:26.648572] [INFO ] [MAIN ] SB: Loaded 33086 primary data records. [2025-10-06T22:44:26.800268] [DEBUG] [LOCAL ] SBH: Loaded 49800 existing records from primary storage. [2025-10-06T22:44:26.957957] [INFO ] [MAIN ] SBH: Loaded 49800 primary data records. [2025-10-06T22:44:27.501942] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:27.503393] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48593 primary records. [2025-10-06T22:44:27.503924] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-06T22:44:27.538528] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:27.540012] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33086 primary records. [2025-10-06T22:44:27.540819] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-06T22:44:27.557032] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-10-06T22:44:27.559282] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-06T22:44:27.562588] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-10-06T22:44:27.566052] [INFO ] [MAIN ] Derivative Progress: 1570/2037 symbols completed. SARO took 1.2s. Estimated remaining: 3m 7s. Rate: 150.0 symbols/min [2025-10-06T22:44:27.567521] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-06T22:44:27.572270] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:27.572392] [INFO ] [MAIN ] Derivative Progress: 1571/2037 symbols completed. SB took 1.1s. Estimated remaining: 3m 6s. Rate: 150.1 symbols/min [2025-10-06T22:44:27.573300] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:27.593797] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:27.594918] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49800 primary records. [2025-10-06T22:44:27.597634] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-06T22:44:27.602057] [DEBUG] [LOCAL ] SBI: Loaded 7412 existing records from primary storage. [2025-10-06T22:44:27.602435] [INFO ] [MAIN ] SBI: Loaded 7412 primary data records. [2025-10-06T22:44:27.639249] [DEBUG] [LOCAL ] SBR: Loaded 7502 existing records from primary storage. [2025-10-06T22:44:27.673242] [INFO ] [MAIN ] SBR: Loaded 7502 primary data records. [2025-10-06T22:44:27.950469] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-10-06T22:44:28.100983] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-06T22:44:28.132001] [INFO ] [MAIN ] Derivative Progress: 1572/2037 symbols completed. SBH took 1.7s. Estimated remaining: 3m 6s. Rate: 150.0 symbols/min [2025-10-06T22:44:28.340492] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:28.384946] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:28.385908] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7412 primary records. [2025-10-06T22:44:28.386162] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-06T22:44:28.404459] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-10-06T22:44:28.404728] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-06T22:44:28.407096] [INFO ] [MAIN ] Derivative Progress: 1573/2037 symbols completed. SBI took 0.8s. Estimated remaining: 3m 6s. Rate: 150.1 symbols/min [2025-10-06T22:44:28.422859] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:28.423618] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7502 primary records. [2025-10-06T22:44:28.423791] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-06T22:44:28.453423] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-10-06T22:44:28.453609] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-06T22:44:28.457011] [INFO ] [MAIN ] Derivative Progress: 1574/2037 symbols completed. SBR took 0.9s. Estimated remaining: 3m 5s. Rate: 150.2 symbols/min [2025-10-06T22:44:28.472076] [DEBUG] [LOCAL ] SBS: Loaded 49382 existing records from primary storage. [2025-10-06T22:44:28.472199] [INFO ] [MAIN ] SBS: Loaded 49382 primary data records. [2025-10-06T22:44:28.775011] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:28.775744] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49382 primary records. [2025-10-06T22:44:28.775812] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-06T22:44:28.791276] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-10-06T22:44:28.791349] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-06T22:44:28.794034] [INFO ] [MAIN ] Derivative Progress: 1575/2037 symbols completed. SBS took 0.5s. Estimated remaining: 3m 5s. Rate: 150.2 symbols/min [2025-10-06T22:44:28.794480] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:28.794672] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:28.794584] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:28.817468] [DEBUG] [LOCAL ] SBSI: Loaded 14853 existing records from primary storage. [2025-10-06T22:44:28.817711] [INFO ] [MAIN ] SBSI: Loaded 14853 primary data records. [2025-10-06T22:44:29.184963] [DEBUG] [LOCAL ] SCCO: Loaded 49525 existing records from primary storage. [2025-10-06T22:44:29.185302] [INFO ] [MAIN ] SCCO: Loaded 49525 primary data records. [2025-10-06T22:44:29.186287] [DEBUG] [LOCAL ] SBSW: Loaded 53054 existing records from primary storage. [2025-10-06T22:44:29.218293] [INFO ] [MAIN ] SBSW: Loaded 53054 primary data records. [2025-10-06T22:44:29.829252] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:29.831583] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14853 primary records. [2025-10-06T22:44:29.831792] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-06T22:44:29.855482] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-10-06T22:44:29.856528] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-06T22:44:29.859813] [INFO ] [MAIN ] Derivative Progress: 1576/2037 symbols completed. SBSI took 1.1s. Estimated remaining: 3m 4s. Rate: 150.0 symbols/min [2025-10-06T22:44:29.860960] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:29.885967] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:29.888848] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49525 primary records. [2025-10-06T22:44:29.889129] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-06T22:44:29.924825] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:29.931858] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 53054 primary records. [2025-10-06T22:44:29.931634] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-10-06T22:44:29.932273] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-06T22:44:29.932158] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-06T22:44:29.936410] [INFO ] [MAIN ] Derivative Progress: 1577/2037 symbols completed. SCCO took 1.1s. Estimated remaining: 3m 4s. Rate: 150.1 symbols/min [2025-10-06T22:44:29.942281] [DEBUG] [LOCAL ] SCD: Loaded 12993 existing records from primary storage. [2025-10-06T22:44:29.949577] [INFO ] [MAIN ] SCD: Loaded 12993 primary data records. [2025-10-06T22:44:29.966553] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:30.081006] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-10-06T22:44:30.102290] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-06T22:44:30.130140] [INFO ] [MAIN ] Derivative Progress: 1578/2037 symbols completed. SBSW took 1.3s. Estimated remaining: 3m 3s. Rate: 150.1 symbols/min [2025-10-06T22:44:30.134005] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:30.362231] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-06T22:44:30.362953] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-10-06T22:44:30.605966] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:30.606971] [DEBUG] [LOCAL ] SCI: Loaded 46518 existing records from primary storage. [2025-10-06T22:44:30.607322] [INFO ] [MAIN ] SCI: Loaded 46518 primary data records. [2025-10-06T22:44:30.608292] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 12993 primary records. [2025-10-06T22:44:30.620172] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-06T22:44:30.945458] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-10-06T22:44:30.970050] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-06T22:44:31.079625] [INFO ] [MAIN ] Derivative Progress: 1579/2037 symbols completed. SCD took 1.2s. Estimated remaining: 3m 3s. Rate: 150.0 symbols/min [2025-10-06T22:44:31.080085] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:31.135673] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:31.136427] [DEBUG] [LOCAL ] SCL: Loaded 14883 existing records from primary storage. [2025-10-06T22:44:31.138311] [INFO ] [MAIN ] SCL: Loaded 14883 primary data records. [2025-10-06T22:44:31.138008] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-10-06T22:44:31.160177] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-06T22:44:31.283004] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-10-06T22:44:31.308691] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-06T22:44:31.320460] [INFO ] [MAIN ] Derivative Progress: 1580/2037 symbols completed. SCHW took 1.4s. Estimated remaining: 3m 3s. Rate: 150.0 symbols/min [2025-10-06T22:44:31.347232] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:31.483398] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:31.484353] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46518 primary records. [2025-10-06T22:44:31.484998] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-06T22:44:31.511210] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-10-06T22:44:31.511350] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-06T22:44:31.514549] [INFO ] [MAIN ] Derivative Progress: 1581/2037 symbols completed. SCI took 1.4s. Estimated remaining: 3m 2s. Rate: 150.1 symbols/min [2025-10-06T22:44:31.515097] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:31.523691] [DEBUG] [LOCAL ] SCM: Loaded 19758 existing records from primary storage. [2025-10-06T22:44:31.523957] [INFO ] [MAIN ] SCM: Loaded 19758 primary data records. [2025-10-06T22:44:31.659252] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:31.699387] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14883 primary records. [2025-10-06T22:44:31.715448] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-06T22:44:31.878839] [DEBUG] [LOCAL ] SCS: Loaded 43586 existing records from primary storage. [2025-10-06T22:44:31.879540] [INFO ] [MAIN ] SCS: Loaded 43586 primary data records. [2025-10-06T22:44:31.927551] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-10-06T22:44:31.948961] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-06T22:44:31.988679] [INFO ] [MAIN ] Derivative Progress: 1582/2037 symbols completed. SCL took 0.9s. Estimated remaining: 3m 2s. Rate: 150.1 symbols/min [2025-10-06T22:44:31.992803] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:32.234967] [DEBUG] [LOCAL ] SD: Loaded 28759 existing records from primary storage. [2025-10-06T22:44:32.235955] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:32.237277] [INFO ] [MAIN ] SD: Loaded 28759 primary data records. [2025-10-06T22:44:32.238689] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 19758 primary records. [2025-10-06T22:44:32.239062] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-06T22:44:32.342769] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-10-06T22:44:32.348272] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-06T22:44:32.356986] [INFO ] [MAIN ] Derivative Progress: 1583/2037 symbols completed. SCM took 1.0s. Estimated remaining: 3m 1s. Rate: 150.1 symbols/min [2025-10-06T22:44:32.369005] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:32.534087] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:32.652504] [DEBUG] [LOCAL ] SDHC: Loaded 10336 existing records from primary storage. [2025-10-06T22:44:32.652074] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43586 primary records. [2025-10-06T22:44:32.652679] [INFO ] [MAIN ] SDHC: Loaded 10336 primary data records. [2025-10-06T22:44:32.652753] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-06T22:44:32.980805] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-10-06T22:44:32.992005] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-06T22:44:32.996169] [INFO ] [MAIN ] Derivative Progress: 1584/2037 symbols completed. SCS took 1.5s. Estimated remaining: 3m 1s. Rate: 150.0 symbols/min [2025-10-06T22:44:32.996950] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:33.024511] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:33.025578] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 28759 primary records. [2025-10-06T22:44:33.025777] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-06T22:44:33.046128] [DEBUG] [LOCAL ] SDHY: Loaded 10632 existing records from primary storage. [2025-10-06T22:44:33.049173] [INFO ] [MAIN ] SDHY: Loaded 10632 primary data records. [2025-10-06T22:44:33.149405] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-10-06T22:44:33.170905] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-06T22:44:33.176387] [INFO ] [MAIN ] Derivative Progress: 1585/2037 symbols completed. SD took 1.2s. Estimated remaining: 3m 1s. Rate: 150.1 symbols/min [2025-10-06T22:44:33.182072] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:33.276441] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:33.392237] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10336 primary records. [2025-10-06T22:44:33.392626] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-06T22:44:33.431330] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-10-06T22:44:33.431940] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-06T22:44:33.436117] [INFO ] [MAIN ] Derivative Progress: 1586/2037 symbols completed. SDHC took 1.1s. Estimated remaining: 3m 0s. Rate: 150.1 symbols/min [2025-10-06T22:44:33.436944] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:33.466355] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:33.469044] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 10632 primary records. [2025-10-06T22:44:33.469151] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-06T22:44:33.478370] [DEBUG] [LOCAL ] SDRL: Loaded 41480 existing records from primary storage. [2025-10-06T22:44:33.483489] [INFO ] [MAIN ] SDRL: Loaded 41480 primary data records. [2025-10-06T22:44:33.595960] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-10-06T22:44:33.596299] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-06T22:44:33.599435] [INFO ] [MAIN ] Derivative Progress: 1587/2037 symbols completed. SDHY took 0.6s. Estimated remaining: 2m 60s. Rate: 150.2 symbols/min [2025-10-06T22:44:33.605024] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:33.856582] [DEBUG] [LOCAL ] SE: Loaded 53346 existing records from primary storage. [2025-10-06T22:44:33.857091] [INFO ] [MAIN ] SE: Loaded 53346 primary data records. [2025-10-06T22:44:34.159920] [DEBUG] [LOCAL ] SEE: Loaded 48238 existing records from primary storage. [2025-10-06T22:44:34.223222] [INFO ] [MAIN ] SEE: Loaded 48238 primary data records. [2025-10-06T22:44:34.469342] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:34.653777] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41480 primary records. [2025-10-06T22:44:34.664049] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-06T22:44:34.702425] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:34.704195] [INFO ] [MAIN ] SE: Generated 1794 derivative records from 53346 primary records. [2025-10-06T22:44:34.704819] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-06T22:44:34.705614] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-10-06T22:44:34.706235] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-06T22:44:34.709435] [INFO ] [MAIN ] Derivative Progress: 1588/2037 symbols completed. SDRL took 1.5s. Estimated remaining: 2m 60s. Rate: 150.0 symbols/min [2025-10-06T22:44:34.729202] [DEBUG] [LOCAL ] SE: Derivative data saved (1794 records). [2025-10-06T22:44:34.729433] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-06T22:44:34.732415] [INFO ] [MAIN ] Derivative Progress: 1589/2037 symbols completed. SE took 1.3s. Estimated remaining: 2m 59s. Rate: 150.1 symbols/min [2025-10-06T22:44:34.750022] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:34.750906] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48238 primary records. [2025-10-06T22:44:34.750973] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-06T22:44:34.767713] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-10-06T22:44:34.767861] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-06T22:44:34.771585] [INFO ] [MAIN ] Derivative Progress: 1590/2037 symbols completed. SEE took 1.2s. Estimated remaining: 2m 59s. Rate: 150.2 symbols/min [2025-10-06T22:44:34.772354] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:34.772271] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:34.772450] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:34.792106] [DEBUG] [LOCAL ] SEG: Loaded 13325 existing records from primary storage. [2025-10-06T22:44:34.792357] [INFO ] [MAIN ] SEG: Loaded 13325 primary data records. [2025-10-06T22:44:35.179431] [DEBUG] [LOCAL ] SEM: Loaded 42846 existing records from primary storage. [2025-10-06T22:44:35.179769] [INFO ] [MAIN ] SEM: Loaded 42846 primary data records. [2025-10-06T22:44:35.186019] [DEBUG] [LOCAL ] SEI: Loaded 49660 existing records from primary storage. [2025-10-06T22:44:35.221790] [INFO ] [MAIN ] SEI: Loaded 49660 primary data records. [2025-10-06T22:44:35.886877] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:35.888953] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13325 primary records. [2025-10-06T22:44:35.889133] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-06T22:44:35.916252] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-10-06T22:44:35.917684] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-06T22:44:35.922071] [INFO ] [MAIN ] Derivative Progress: 1591/2037 symbols completed. SEG took 1.1s. Estimated remaining: 2m 58s. Rate: 150.0 symbols/min [2025-10-06T22:44:35.936490] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:35.937891] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:35.939006] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 42846 primary records. [2025-10-06T22:44:35.939264] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-06T22:44:35.977893] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:35.979516] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49660 primary records. [2025-10-06T22:44:35.979747] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-06T22:44:35.981682] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-10-06T22:44:35.982144] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-06T22:44:35.984883] [INFO ] [MAIN ] Derivative Progress: 1592/2037 symbols completed. SEM took 1.2s. Estimated remaining: 2m 58s. Rate: 150.1 symbols/min [2025-10-06T22:44:35.994442] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:36.014723] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-10-06T22:44:36.014863] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-06T22:44:36.017849] [INFO ] [MAIN ] Derivative Progress: 1593/2037 symbols completed. SEI took 1.2s. Estimated remaining: 2m 57s. Rate: 150.2 symbols/min [2025-10-06T22:44:36.018364] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:36.035736] [DEBUG] [LOCAL ] SEMR: Loaded 41760 existing records from primary storage. [2025-10-06T22:44:36.036347] [INFO ] [MAIN ] SEMR: Loaded 41760 primary data records. [2025-10-06T22:44:36.442577] [DEBUG] [LOCAL ] SES: Loaded 51560 existing records from primary storage. [2025-10-06T22:44:36.443162] [INFO ] [MAIN ] SES: Loaded 51560 primary data records. [2025-10-06T22:44:36.445170] [DEBUG] [LOCAL ] SF: Loaded 41566 existing records from primary storage. [2025-10-06T22:44:36.456331] [INFO ] [MAIN ] SF: Loaded 41566 primary data records. [2025-10-06T22:44:37.209326] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:37.210528] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41760 primary records. [2025-10-06T22:44:37.210783] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-06T22:44:37.237256] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-10-06T22:44:37.237632] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-06T22:44:37.241261] [INFO ] [MAIN ] Derivative Progress: 1594/2037 symbols completed. SEMR took 1.3s. Estimated remaining: 2m 57s. Rate: 150.0 symbols/min [2025-10-06T22:44:37.241750] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:37.265551] [DEBUG] [LOCAL ] SFB: Loaded 4152 existing records from primary storage. [2025-10-06T22:44:37.284755] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:37.285923] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:37.284239] [INFO ] [MAIN ] SFB: Loaded 4152 primary data records. [2025-10-06T22:44:37.291926] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51560 primary records. [2025-10-06T22:44:37.292048] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-06T22:44:37.285577] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41566 primary records. [2025-10-06T22:44:37.322563] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-06T22:44:37.438375] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-10-06T22:44:37.444122] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-06T22:44:37.458460] [INFO ] [MAIN ] Derivative Progress: 1595/2037 symbols completed. SF took 1.4s. Estimated remaining: 2m 57s. Rate: 150.0 symbols/min [2025-10-06T22:44:37.469597] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:37.579880] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-10-06T22:44:37.644223] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-06T22:44:37.659441] [INFO ] [MAIN ] Derivative Progress: 1596/2037 symbols completed. SES took 1.7s. Estimated remaining: 2m 56s. Rate: 150.1 symbols/min [2025-10-06T22:44:37.660179] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:37.680265] [DEBUG] [LOCAL ] SFBS: Loaded 21134 existing records from primary storage. [2025-10-06T22:44:37.680466] [INFO ] [MAIN ] SFBS: Loaded 21134 primary data records. [2025-10-06T22:44:38.070449] [DEBUG] [LOCAL ] SFL: Loaded 45117 existing records from primary storage. [2025-10-06T22:44:38.071037] [INFO ] [MAIN ] SFL: Loaded 45117 primary data records. [2025-10-06T22:44:38.099362] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:38.132253] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 4152 primary records. [2025-10-06T22:44:38.166743] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-06T22:44:38.256188] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-10-06T22:44:38.290612] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-06T22:44:38.320876] [INFO ] [MAIN ] Derivative Progress: 1597/2037 symbols completed. SFB took 1.1s. Estimated remaining: 2m 56s. Rate: 150.0 symbols/min [2025-10-06T22:44:38.449978] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:38.477449] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:38.478864] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21134 primary records. [2025-10-06T22:44:38.479440] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-06T22:44:38.504831] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-10-06T22:44:38.505297] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-06T22:44:38.508545] [INFO ] [MAIN ] Derivative Progress: 1598/2037 symbols completed. SFBS took 1.0s. Estimated remaining: 2m 56s. Rate: 150.1 symbols/min [2025-10-06T22:44:38.509404] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:38.530603] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:38.532335] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45117 primary records. [2025-10-06T22:44:38.532478] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-06T22:44:38.585603] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-10-06T22:44:38.587234] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-06T22:44:38.590581] [INFO ] [MAIN ] Derivative Progress: 1599/2037 symbols completed. SFL took 0.9s. Estimated remaining: 2m 55s. Rate: 150.1 symbols/min [2025-10-06T22:44:38.592518] [DEBUG] [LOCAL ] SG: Loaded 53460 existing records from primary storage. [2025-10-06T22:44:38.593021] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:38.607259] [INFO ] [MAIN ] SG: Loaded 53460 primary data records. [2025-10-06T22:44:38.719687] [DEBUG] [LOCAL ] SGU: Loaded 6656 existing records from primary storage. [2025-10-06T22:44:38.742637] [DEBUG] [LOCAL ] SGHC: Loaded 46270 existing records from primary storage. [2025-10-06T22:44:38.742819] [INFO ] [MAIN ] SGU: Loaded 6656 primary data records. [2025-10-06T22:44:38.743055] [INFO ] [MAIN ] SGHC: Loaded 46270 primary data records. [2025-10-06T22:44:39.710033] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:39.714309] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53460 primary records. [2025-10-06T22:44:39.714613] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-06T22:44:39.742485] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:39.745271] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 46270 primary records. [2025-10-06T22:44:39.746096] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-06T22:44:39.762114] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-10-06T22:44:39.765131] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-06T22:44:39.769725] [INFO ] [MAIN ] Derivative Progress: 1600/2037 symbols completed. SG took 1.3s. Estimated remaining: 2m 55s. Rate: 149.9 symbols/min [2025-10-06T22:44:39.770933] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:39.787146] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:39.789199] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6656 primary records. [2025-10-06T22:44:39.789287] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-06T22:44:39.791768] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-10-06T22:44:39.791934] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-06T22:44:39.798704] [INFO ] [MAIN ] Derivative Progress: 1601/2037 symbols completed. SGHC took 1.3s. Estimated remaining: 2m 54s. Rate: 150.0 symbols/min [2025-10-06T22:44:39.798931] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:39.821667] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-10-06T22:44:39.821852] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-06T22:44:39.824908] [INFO ] [MAIN ] Derivative Progress: 1602/2037 symbols completed. SGU took 1.2s. Estimated remaining: 2m 54s. Rate: 150.1 symbols/min [2025-10-06T22:44:39.825237] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:39.857801] [DEBUG] [LOCAL ] SHCO: Loaded 25527 existing records from primary storage. [2025-10-06T22:44:39.858094] [INFO ] [MAIN ] SHCO: Loaded 25527 primary data records. [2025-10-06T22:44:39.986991] [DEBUG] [LOCAL ] SHAK: Loaded 48933 existing records from primary storage. [2025-10-06T22:44:40.009100] [INFO ] [MAIN ] SHAK: Loaded 48933 primary data records. [2025-10-06T22:44:40.333044] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-10-06T22:44:40.339597] [INFO ] [MAIN ] SHEL: Loaded 53672 primary data records. [2025-10-06T22:44:40.891248] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:40.893304] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 25527 primary records. [2025-10-06T22:44:40.893950] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-06T22:44:40.918136] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-10-06T22:44:40.918374] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-06T22:44:40.922865] [INFO ] [MAIN ] Derivative Progress: 1603/2037 symbols completed. SHCO took 1.1s. Estimated remaining: 2m 54s. Rate: 150.0 symbols/min [2025-10-06T22:44:40.938231] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:40.939250] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 48933 primary records. [2025-10-06T22:44:40.939508] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-06T22:44:40.972032] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:40.974004] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53672 primary records. [2025-10-06T22:44:40.973919] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-10-06T22:44:40.974113] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-06T22:44:40.974201] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-06T22:44:40.978219] [INFO ] [MAIN ] Derivative Progress: 1604/2037 symbols completed. SHAK took 1.2s. Estimated remaining: 2m 53s. Rate: 150.0 symbols/min [2025-10-06T22:44:40.994748] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-10-06T22:44:40.994822] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-06T22:44:40.998489] [INFO ] [MAIN ] Derivative Progress: 1605/2037 symbols completed. SHEL took 1.2s. Estimated remaining: 2m 53s. Rate: 150.1 symbols/min [2025-10-06T22:44:40.999137] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:40.999033] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:40.999307] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:41.009507] [DEBUG] [LOCAL ] SHOC: Loaded 3381 existing records from primary storage. [2025-10-06T22:44:41.009764] [INFO ] [MAIN ] SHOC: Loaded 3381 primary data records. [2025-10-06T22:44:41.349238] [DEBUG] [LOCAL ] SHG: Loaded 26257 existing records from primary storage. [2025-10-06T22:44:41.396549] [INFO ] [MAIN ] SHG: Loaded 26257 primary data records. [2025-10-06T22:44:41.464136] [DEBUG] [LOCAL ] SHO: Loaded 49635 existing records from primary storage. [2025-10-06T22:44:41.486202] [INFO ] [MAIN ] SHO: Loaded 49635 primary data records. [2025-10-06T22:44:42.113989] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:42.116183] [INFO ] [MAIN ] SHOC: Generated 1794 derivative records from 3381 primary records. [2025-10-06T22:44:42.116886] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-06T22:44:42.142354] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1794 records). [2025-10-06T22:44:42.143800] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-06T22:44:42.148000] [INFO ] [MAIN ] Derivative Progress: 1606/2037 symbols completed. SHOC took 1.1s. Estimated remaining: 2m 52s. Rate: 149.9 symbols/min [2025-10-06T22:44:42.148575] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:42.164319] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:42.165553] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26257 primary records. [2025-10-06T22:44:42.165695] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-06T22:44:42.189447] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-10-06T22:44:42.189878] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-06T22:44:42.192853] [INFO ] [MAIN ] Derivative Progress: 1607/2037 symbols completed. SHG took 1.2s. Estimated remaining: 2m 52s. Rate: 150.0 symbols/min [2025-10-06T22:44:42.193418] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:42.211544] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:42.212761] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49635 primary records. [2025-10-06T22:44:42.212965] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-06T22:44:42.230953] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-10-06T22:44:42.231149] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-06T22:44:42.234480] [INFO ] [MAIN ] Derivative Progress: 1608/2037 symbols completed. SHO took 1.2s. Estimated remaining: 2m 51s. Rate: 150.1 symbols/min [2025-10-06T22:44:42.234763] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:42.282393] [DEBUG] [LOCAL ] SHW: Loaded 50294 existing records from primary storage. [2025-10-06T22:44:42.282690] [INFO ] [MAIN ] SHW: Loaded 50294 primary data records. [2025-10-06T22:44:42.397493] [DEBUG] [LOCAL ] SID: Loaded 42284 existing records from primary storage. [2025-10-06T22:44:42.415810] [INFO ] [MAIN ] SID: Loaded 42284 primary data records. [2025-10-06T22:44:42.764082] [DEBUG] [LOCAL ] SIG: Loaded 45999 existing records from primary storage. [2025-10-06T22:44:42.790060] [INFO ] [MAIN ] SIG: Loaded 45999 primary data records. [2025-10-06T22:44:43.429837] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:43.431242] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50294 primary records. [2025-10-06T22:44:43.432555] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-06T22:44:43.473592] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-10-06T22:44:43.474354] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-06T22:44:43.474237] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:43.477442] [INFO ] [MAIN ] Derivative Progress: 1609/2037 symbols completed. SHW took 1.3s. Estimated remaining: 2m 51s. Rate: 149.9 symbols/min [2025-10-06T22:44:43.478051] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:43.480146] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42284 primary records. [2025-10-06T22:44:43.480419] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-06T22:44:43.511076] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-10-06T22:44:43.511240] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-06T22:44:43.514841] [INFO ] [MAIN ] Derivative Progress: 1610/2037 symbols completed. SID took 1.3s. Estimated remaining: 2m 51s. Rate: 150.0 symbols/min [2025-10-06T22:44:43.515273] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:43.533039] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:43.534121] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 45999 primary records. [2025-10-06T22:44:43.534288] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-06T22:44:43.558713] [DEBUG] [LOCAL ] SII: Loaded 23694 existing records from primary storage. [2025-10-06T22:44:43.559917] [INFO ] [MAIN ] SII: Loaded 23694 primary data records. [2025-10-06T22:44:43.677428] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-10-06T22:44:43.690845] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-06T22:44:43.694490] [INFO ] [MAIN ] Derivative Progress: 1611/2037 symbols completed. SIG took 1.5s. Estimated remaining: 2m 50s. Rate: 150.1 symbols/min [2025-10-06T22:44:43.696002] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:43.761942] [DEBUG] [LOCAL ] SILA: Loaded 30652 existing records from primary storage. [2025-10-06T22:44:43.801963] [INFO ] [MAIN ] SILA: Loaded 30652 primary data records. [2025-10-06T22:44:44.214502] [DEBUG] [LOCAL ] SITC: Loaded 41598 existing records from primary storage. [2025-10-06T22:44:44.304367] [INFO ] [MAIN ] SITC: Loaded 41598 primary data records. [2025-10-06T22:44:44.513427] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:44.654569] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23694 primary records. [2025-10-06T22:44:44.660577] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-06T22:44:44.711026] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-10-06T22:44:44.711910] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-06T22:44:44.715589] [INFO ] [MAIN ] Derivative Progress: 1612/2037 symbols completed. SII took 1.2s. Estimated remaining: 2m 50s. Rate: 149.9 symbols/min [2025-10-06T22:44:44.717265] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:44.717952] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:44.720003] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 30652 primary records. [2025-10-06T22:44:44.720315] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-06T22:44:44.745240] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-10-06T22:44:44.745431] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-06T22:44:44.749050] [INFO ] [MAIN ] Derivative Progress: 1613/2037 symbols completed. SILA took 1.2s. Estimated remaining: 2m 50s. Rate: 150.0 symbols/min [2025-10-06T22:44:44.749753] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:44.782514] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:44.783447] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41598 primary records. [2025-10-06T22:44:44.783639] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-06T22:44:44.813151] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-10-06T22:44:44.813535] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-06T22:44:44.816997] [INFO ] [MAIN ] Derivative Progress: 1614/2037 symbols completed. SITC took 1.1s. Estimated remaining: 2m 49s. Rate: 150.1 symbols/min [2025-10-06T22:44:44.817258] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:44.818976] [DEBUG] [LOCAL ] SITE: Loaded 35180 existing records from primary storage. [2025-10-06T22:44:44.819356] [INFO ] [MAIN ] SITE: Loaded 35180 primary data records. [2025-10-06T22:44:45.028053] [DEBUG] [LOCAL ] SJT: Loaded 22376 existing records from primary storage. [2025-10-06T22:44:45.030422] [DEBUG] [LOCAL ] SJM: Loaded 50126 existing records from primary storage. [2025-10-06T22:44:45.030622] [INFO ] [MAIN ] SJT: Loaded 22376 primary data records. [2025-10-06T22:44:45.059837] [INFO ] [MAIN ] SJM: Loaded 50126 primary data records. [2025-10-06T22:44:45.939403] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:45.942934] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35180 primary records. [2025-10-06T22:44:45.943296] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-06T22:44:45.965863] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-10-06T22:44:45.966218] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-06T22:44:45.968766] [INFO ] [MAIN ] Derivative Progress: 1615/2037 symbols completed. SITE took 1.3s. Estimated remaining: 2m 49s. Rate: 149.9 symbols/min [2025-10-06T22:44:45.969322] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:46.003328] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:46.011264] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22376 primary records. [2025-10-06T22:44:46.012246] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-06T22:44:46.011989] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:46.013953] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50126 primary records. [2025-10-06T22:44:46.014470] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-06T22:44:46.053468] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-10-06T22:44:46.054474] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-06T22:44:46.058866] [INFO ] [MAIN ] Derivative Progress: 1616/2037 symbols completed. SJT took 1.2s. Estimated remaining: 2m 48s. Rate: 150.0 symbols/min [2025-10-06T22:44:46.059049] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:46.078583] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-10-06T22:44:46.078896] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-06T22:44:46.083630] [INFO ] [MAIN ] Derivative Progress: 1617/2037 symbols completed. SJM took 1.3s. Estimated remaining: 2m 48s. Rate: 150.1 symbols/min [2025-10-06T22:44:46.083925] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:46.079623] [DEBUG] [LOCAL ] SKE: Loaded 36125 existing records from primary storage. [2025-10-06T22:44:46.084967] [INFO ] [MAIN ] SKE: Loaded 36125 primary data records. [2025-10-06T22:44:46.089619] [DEBUG] [LOCAL ] SKIL: Loaded 6442 existing records from primary storage. [2025-10-06T22:44:46.101669] [INFO ] [MAIN ] SKIL: Loaded 6442 primary data records. [2025-10-06T22:44:46.263616] [DEBUG] [LOCAL ] SKLZ: Loaded 11641 existing records from primary storage. [2025-10-06T22:44:46.271613] [INFO ] [MAIN ] SKLZ: Loaded 11641 primary data records. [2025-10-06T22:44:47.159728] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:47.160492] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:47.162802] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6442 primary records. [2025-10-06T22:44:47.162917] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 36125 primary records. [2025-10-06T22:44:47.163075] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-06T22:44:47.163582] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-06T22:44:47.196861] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-10-06T22:44:47.201463] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-10-06T22:44:47.200509] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-06T22:44:47.220049] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-06T22:44:47.223904] [INFO ] [MAIN ] Derivative Progress: 1618/2037 symbols completed. SKE took 1.3s. Estimated remaining: 2m 48s. Rate: 149.9 symbols/min [2025-10-06T22:44:47.228367] [INFO ] [MAIN ] Derivative Progress: 1619/2037 symbols completed. SKIL took 1.2s. Estimated remaining: 2m 47s. Rate: 150.0 symbols/min [2025-10-06T22:44:47.228026] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:47.229557] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11641 primary records. [2025-10-06T22:44:47.229673] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-06T22:44:47.245960] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-10-06T22:44:47.246047] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-06T22:44:47.250679] [INFO ] [MAIN ] Derivative Progress: 1620/2037 symbols completed. SKLZ took 1.2s. Estimated remaining: 2m 47s. Rate: 150.1 symbols/min [2025-10-06T22:44:47.251234] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:47.251323] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:47.251475] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:47.332036] [DEBUG] [LOCAL ] SKM: Loaded 34925 existing records from primary storage. [2025-10-06T22:44:47.332930] [DEBUG] [LOCAL ] SKY: Loaded 37908 existing records from primary storage. [2025-10-06T22:44:47.333065] [INFO ] [MAIN ] SKM: Loaded 34925 primary data records. [2025-10-06T22:44:47.333516] [INFO ] [MAIN ] SKY: Loaded 37908 primary data records. [2025-10-06T22:44:47.512865] [DEBUG] [LOCAL ] SKT: Loaded 42500 existing records from primary storage. [2025-10-06T22:44:47.559810] [INFO ] [MAIN ] SKT: Loaded 42500 primary data records. [2025-10-06T22:44:48.438508] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:48.442001] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 34925 primary records. [2025-10-06T22:44:48.442813] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-06T22:44:48.475715] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-10-06T22:44:48.476299] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:48.478048] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 37908 primary records. [2025-10-06T22:44:48.476865] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-06T22:44:48.480384] [INFO ] [MAIN ] Derivative Progress: 1621/2037 symbols completed. SKM took 1.2s. Estimated remaining: 2m 47s. Rate: 149.9 symbols/min [2025-10-06T22:44:48.480564] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-06T22:44:48.480756] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:48.503552] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-10-06T22:44:48.504092] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-06T22:44:48.507593] [INFO ] [MAIN ] Derivative Progress: 1622/2037 symbols completed. SKY took 1.3s. Estimated remaining: 2m 46s. Rate: 150.0 symbols/min [2025-10-06T22:44:48.521375] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:48.527841] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:48.529057] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42500 primary records. [2025-10-06T22:44:48.529488] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-06T22:44:48.553462] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-10-06T22:44:48.555404] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-06T22:44:48.560383] [INFO ] [MAIN ] Derivative Progress: 1623/2037 symbols completed. SKT took 1.3s. Estimated remaining: 2m 46s. Rate: 150.0 symbols/min [2025-10-06T22:44:48.556015] [DEBUG] [LOCAL ] SKYH: Loaded 16590 existing records from primary storage. [2025-10-06T22:44:48.560941] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:48.561081] [INFO ] [MAIN ] SKYH: Loaded 16590 primary data records. [2025-10-06T22:44:48.929287] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-06T22:44:48.944518] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-10-06T22:44:49.004127] [DEBUG] [LOCAL ] SLF: Loaded 38714 existing records from primary storage. [2025-10-06T22:44:49.011330] [INFO ] [MAIN ] SLF: Loaded 38714 primary data records. [2025-10-06T22:44:49.641964] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:49.644556] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16590 primary records. [2025-10-06T22:44:49.645028] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-06T22:44:49.664507] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-10-06T22:44:49.664907] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-06T22:44:49.669105] [INFO ] [MAIN ] Derivative Progress: 1624/2037 symbols completed. SKYH took 1.2s. Estimated remaining: 2m 45s. Rate: 149.9 symbols/min [2025-10-06T22:44:49.670572] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:49.686775] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:49.687896] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-10-06T22:44:49.688278] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-06T22:44:49.705963] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-10-06T22:44:49.706320] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-06T22:44:49.709100] [INFO ] [MAIN ] Derivative Progress: 1625/2037 symbols completed. SLB took 1.2s. Estimated remaining: 2m 45s. Rate: 150.0 symbols/min [2025-10-06T22:44:49.710535] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:49.727440] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:49.728261] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38714 primary records. [2025-10-06T22:44:49.728754] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-06T22:44:49.757713] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-10-06T22:44:49.758075] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-06T22:44:49.761448] [INFO ] [MAIN ] Derivative Progress: 1626/2037 symbols completed. SLF took 1.2s. Estimated remaining: 2m 44s. Rate: 150.0 symbols/min [2025-10-06T22:44:49.761802] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:49.789204] [DEBUG] [LOCAL ] SLG: Loaded 45223 existing records from primary storage. [2025-10-06T22:44:49.789619] [INFO ] [MAIN ] SLG: Loaded 45223 primary data records. [2025-10-06T22:44:49.921104] [DEBUG] [LOCAL ] SLGN: Loaded 40550 existing records from primary storage. [2025-10-06T22:44:49.949882] [INFO ] [MAIN ] SLGN: Loaded 40550 primary data records. [2025-10-06T22:44:50.308378] [DEBUG] [LOCAL ] SLQT: Loaded 43497 existing records from primary storage. [2025-10-06T22:44:50.389023] [INFO ] [MAIN ] SLQT: Loaded 43497 primary data records. [2025-10-06T22:44:50.935896] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:50.938430] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45223 primary records. [2025-10-06T22:44:50.938956] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-06T22:44:50.969685] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:50.972820] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40550 primary records. [2025-10-06T22:44:50.973302] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-06T22:44:50.975398] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-10-06T22:44:50.984711] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-06T22:44:50.992621] [INFO ] [MAIN ] Derivative Progress: 1627/2037 symbols completed. SLG took 1.3s. Estimated remaining: 2m 44s. Rate: 149.8 symbols/min [2025-10-06T22:44:50.994204] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:50.998638] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-10-06T22:44:50.998847] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-06T22:44:51.014955] [INFO ] [MAIN ] Derivative Progress: 1628/2037 symbols completed. SLGN took 1.3s. Estimated remaining: 2m 44s. Rate: 149.9 symbols/min [2025-10-06T22:44:51.015583] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:51.016284] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:51.017206] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43497 primary records. [2025-10-06T22:44:51.017500] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-06T22:44:51.034210] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-10-06T22:44:51.034455] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-06T22:44:51.037997] [INFO ] [MAIN ] Derivative Progress: 1629/2037 symbols completed. SLQT took 1.3s. Estimated remaining: 2m 43s. Rate: 150.0 symbols/min [2025-10-06T22:44:51.038308] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:51.066078] [DEBUG] [LOCAL ] SMC: Loaded 11311 existing records from primary storage. [2025-10-06T22:44:51.075798] [INFO ] [MAIN ] SMC: Loaded 11311 primary data records. [2025-10-06T22:44:51.114188] [DEBUG] [LOCAL ] SLVM: Loaded 28017 existing records from primary storage. [2025-10-06T22:44:51.141141] [INFO ] [MAIN ] SLVM: Loaded 28017 primary data records. [2025-10-06T22:44:51.332881] [DEBUG] [LOCAL ] SM: Loaded 52319 existing records from primary storage. [2025-10-06T22:44:51.360326] [INFO ] [MAIN ] SM: Loaded 52319 primary data records. [2025-10-06T22:44:52.167467] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:52.168692] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11311 primary records. [2025-10-06T22:44:52.169224] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-06T22:44:52.192189] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-10-06T22:44:52.192750] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-06T22:44:52.195924] [INFO ] [MAIN ] Derivative Progress: 1630/2037 symbols completed. SMC took 1.2s. Estimated remaining: 2m 43s. Rate: 149.8 symbols/min [2025-10-06T22:44:52.204251] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:52.210787] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:52.213192] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 28017 primary records. [2025-10-06T22:44:52.214242] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-06T22:44:52.240543] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:52.245515] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52319 primary records. [2025-10-06T22:44:52.245959] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-10-06T22:44:52.246036] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-06T22:44:52.246509] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-06T22:44:52.249509] [INFO ] [MAIN ] Derivative Progress: 1631/2037 symbols completed. SLVM took 1.3s. Estimated remaining: 2m 42s. Rate: 149.9 symbols/min [2025-10-06T22:44:52.249894] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:52.269850] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-10-06T22:44:52.270182] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-06T22:44:52.273902] [INFO ] [MAIN ] Derivative Progress: 1632/2037 symbols completed. SM took 1.3s. Estimated remaining: 2m 42s. Rate: 150.0 symbols/min [2025-10-06T22:44:52.274221] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:52.307472] [DEBUG] [LOCAL ] SMHI: Loaded 13105 existing records from primary storage. [2025-10-06T22:44:52.307843] [INFO ] [MAIN ] SMHI: Loaded 13105 primary data records. [2025-10-06T22:44:52.424776] [DEBUG] [LOCAL ] SMFG: Loaded 48122 existing records from primary storage. [2025-10-06T22:44:52.425389] [INFO ] [MAIN ] SMFG: Loaded 48122 primary data records. [2025-10-06T22:44:52.567750] [DEBUG] [LOCAL ] SMG: Loaded 43667 existing records from primary storage. [2025-10-06T22:44:52.628854] [INFO ] [MAIN ] SMG: Loaded 43667 primary data records. [2025-10-06T22:44:53.411042] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:53.412287] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 13105 primary records. [2025-10-06T22:44:53.412566] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-06T22:44:53.432927] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-10-06T22:44:53.434682] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-06T22:44:53.437762] [INFO ] [MAIN ] Derivative Progress: 1633/2037 symbols completed. SMHI took 1.2s. Estimated remaining: 2m 42s. Rate: 149.8 symbols/min [2025-10-06T22:44:53.460672] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:53.471853] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:53.472867] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 43667 primary records. [2025-10-06T22:44:53.472128] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48122 primary records. [2025-10-06T22:44:53.473154] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-06T22:44:53.473298] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-06T22:44:53.500126] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-10-06T22:44:53.503098] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-06T22:44:53.506570] [INFO ] [MAIN ] Derivative Progress: 1634/2037 symbols completed. SMG took 1.3s. Estimated remaining: 2m 41s. Rate: 149.9 symbols/min [2025-10-06T22:44:53.511157] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-10-06T22:44:53.511310] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-06T22:44:53.515438] [INFO ] [MAIN ] Derivative Progress: 1635/2037 symbols completed. SMFG took 1.3s. Estimated remaining: 2m 41s. Rate: 150.0 symbols/min [2025-10-06T22:44:53.516101] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:53.516184] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:53.516462] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:53.541427] [DEBUG] [LOCAL ] SMP: Loaded 19113 existing records from primary storage. [2025-10-06T22:44:53.541612] [INFO ] [MAIN ] SMP: Loaded 19113 primary data records. [2025-10-06T22:44:53.916545] [DEBUG] [LOCAL ] SMRT: Loaded 43940 existing records from primary storage. [2025-10-06T22:44:53.916820] [INFO ] [MAIN ] SMRT: Loaded 43940 primary data records. [2025-10-06T22:44:53.917729] [DEBUG] [LOCAL ] SMR: Loaded 53798 existing records from primary storage. [2025-10-06T22:44:53.940118] [INFO ] [MAIN ] SMR: Loaded 53798 primary data records. [2025-10-06T22:44:54.687247] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:54.690240] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 19113 primary records. [2025-10-06T22:44:54.690579] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-06T22:44:54.708864] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-10-06T22:44:54.710347] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-06T22:44:54.714370] [INFO ] [MAIN ] Derivative Progress: 1636/2037 symbols completed. SMP took 1.2s. Estimated remaining: 2m 41s. Rate: 149.8 symbols/min [2025-10-06T22:44:54.715378] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:54.735309] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:54.736408] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 43940 primary records. [2025-10-06T22:44:54.736871] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-06T22:44:54.767791] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:54.784416] [INFO ] [MAIN ] SMR: Generated 1794 derivative records from 53798 primary records. [2025-10-06T22:44:54.785698] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-06T22:44:54.787054] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-10-06T22:44:54.789320] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-06T22:44:54.812501] [INFO ] [MAIN ] Derivative Progress: 1637/2037 symbols completed. SMRT took 1.3s. Estimated remaining: 2m 40s. Rate: 149.9 symbols/min [2025-10-06T22:44:54.819187] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:54.820389] [DEBUG] [LOCAL ] SMWB: Loaded 32296 existing records from primary storage. [2025-10-06T22:44:54.823192] [DEBUG] [LOCAL ] SMR: Derivative data saved (1794 records). [2025-10-06T22:44:54.823723] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-06T22:44:54.828521] [INFO ] [MAIN ] SMWB: Loaded 32296 primary data records. [2025-10-06T22:44:54.828389] [INFO ] [MAIN ] Derivative Progress: 1638/2037 symbols completed. SMR took 1.3s. Estimated remaining: 2m 40s. Rate: 150.0 symbols/min [2025-10-06T22:44:54.834543] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:55.174936] [DEBUG] [LOCAL ] SNA: Loaded 25712 existing records from primary storage. [2025-10-06T22:44:55.176750] [INFO ] [MAIN ] SNA: Loaded 25712 primary data records. [2025-10-06T22:44:55.264040] [DEBUG] [LOCAL ] SN: Loaded 49897 existing records from primary storage. [2025-10-06T22:44:55.282516] [INFO ] [MAIN ] SN: Loaded 49897 primary data records. [2025-10-06T22:44:55.869736] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:55.872388] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 32296 primary records. [2025-10-06T22:44:55.872692] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-06T22:44:55.898285] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-10-06T22:44:55.898422] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-06T22:44:55.901573] [INFO ] [MAIN ] Derivative Progress: 1639/2037 symbols completed. SMWB took 1.2s. Estimated remaining: 2m 39s. Rate: 149.8 symbols/min [2025-10-06T22:44:55.902056] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:55.918264] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:55.919525] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 25712 primary records. [2025-10-06T22:44:55.919626] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-06T22:44:55.940020] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-10-06T22:44:55.940201] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-06T22:44:55.942997] [INFO ] [MAIN ] Derivative Progress: 1640/2037 symbols completed. SNA took 1.1s. Estimated remaining: 2m 39s. Rate: 149.9 symbols/min [2025-10-06T22:44:55.943426] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:55.957545] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:55.958522] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49897 primary records. [2025-10-06T22:44:55.960068] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-06T22:44:55.976386] [DEBUG] [LOCAL ] SNDA: Loaded 4441 existing records from primary storage. [2025-10-06T22:44:55.980950] [INFO ] [MAIN ] SNDA: Loaded 4441 primary data records. [2025-10-06T22:44:55.980782] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-10-06T22:44:56.037454] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-06T22:44:56.096965] [INFO ] [MAIN ] Derivative Progress: 1641/2037 symbols completed. SN took 1.3s. Estimated remaining: 2m 38s. Rate: 150.0 symbols/min [2025-10-06T22:44:56.101070] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:56.175390] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-06T22:44:56.206245] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-06T22:44:56.549778] [DEBUG] [LOCAL ] SNDR: Loaded 40957 existing records from primary storage. [2025-10-06T22:44:56.738793] [INFO ] [MAIN ] SNDR: Loaded 40957 primary data records. [2025-10-06T22:44:56.929362] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:44:56.986485] [INFO ] [MAIN ] SNDA: Generated 1793 derivative records from 4441 primary records. [2025-10-06T22:44:57.066268] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-06T22:44:57.104406] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1793 records). [2025-10-06T22:44:57.119008] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-06T22:44:57.121914] [INFO ] [MAIN ] Derivative Progress: 1642/2037 symbols completed. SNDA took 1.2s. Estimated remaining: 2m 38s. Rate: 149.8 symbols/min [2025-10-06T22:44:57.122527] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:57.123910] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:57.123757] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-10-06T22:44:57.124582] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-06T22:44:57.145371] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-10-06T22:44:57.145566] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-06T22:44:57.148845] [INFO ] [MAIN ] Derivative Progress: 1643/2037 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 38s. Rate: 149.9 symbols/min [2025-10-06T22:44:57.149243] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:57.170807] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:57.171520] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 40957 primary records. [2025-10-06T22:44:57.171580] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-06T22:44:57.188834] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-10-06T22:44:57.188926] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-06T22:44:57.192045] [INFO ] [MAIN ] Derivative Progress: 1644/2037 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 37s. Rate: 150.0 symbols/min [2025-10-06T22:44:57.192370] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:57.244244] [DEBUG] [LOCAL ] SNN: Loaded 44125 existing records from primary storage. [2025-10-06T22:44:57.244520] [INFO ] [MAIN ] SNN: Loaded 44125 primary data records. [2025-10-06T22:44:57.382353] [DEBUG] [LOCAL ] SNOW: Loaded 53593 existing records from primary storage. [2025-10-06T22:44:57.386515] [INFO ] [MAIN ] SNOW: Loaded 53593 primary data records. [2025-10-06T22:44:57.730195] [DEBUG] [LOCAL ] SNV: Loaded 48866 existing records from primary storage. [2025-10-06T22:44:57.737381] [INFO ] [MAIN ] SNV: Loaded 48866 primary data records. [2025-10-06T22:44:58.277376] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:58.278389] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44125 primary records. [2025-10-06T22:44:58.280776] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-06T22:44:58.304852] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-10-06T22:44:58.308375] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-06T22:44:58.310937] [INFO ] [MAIN ] Derivative Progress: 1645/2037 symbols completed. SNN took 1.2s. Estimated remaining: 2m 37s. Rate: 149.8 symbols/min [2025-10-06T22:44:58.311268] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:58.326592] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:58.327476] [INFO ] [MAIN ] SNOW: Generated 1794 derivative records from 53593 primary records. [2025-10-06T22:44:58.328090] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-06T22:44:58.354892] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1794 records). [2025-10-06T22:44:58.356093] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-06T22:44:58.359582] [INFO ] [MAIN ] Derivative Progress: 1646/2037 symbols completed. SNOW took 1.2s. Estimated remaining: 2m 37s. Rate: 149.9 symbols/min [2025-10-06T22:44:58.359999] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:58.374526] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:58.375334] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48866 primary records. [2025-10-06T22:44:58.375399] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-06T22:44:58.392850] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-10-06T22:44:58.393005] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-06T22:44:58.396939] [INFO ] [MAIN ] Derivative Progress: 1647/2037 symbols completed. SNV took 1.2s. Estimated remaining: 2m 36s. Rate: 150.0 symbols/min [2025-10-06T22:44:58.397279] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:58.445730] [DEBUG] [LOCAL ] SNX: Loaded 40138 existing records from primary storage. [2025-10-06T22:44:58.446146] [INFO ] [MAIN ] SNX: Loaded 40138 primary data records. [2025-10-06T22:44:58.610777] [DEBUG] [LOCAL ] SO: Loaded 53607 existing records from primary storage. [2025-10-06T22:44:58.611571] [INFO ] [MAIN ] SO: Loaded 53607 primary data records. [2025-10-06T22:44:58.706502] [DEBUG] [LOCAL ] SOBO: Loaded 39388 existing records from primary storage. [2025-10-06T22:44:58.749919] [INFO ] [MAIN ] SOBO: Loaded 39388 primary data records. [2025-10-06T22:44:59.613786] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:59.614951] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 40138 primary records. [2025-10-06T22:44:59.615120] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-06T22:44:59.638522] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:59.640456] [INFO ] [MAIN ] SO: Generated 1794 derivative records from 53607 primary records. [2025-10-06T22:44:59.645128] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-06T22:44:59.667668] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-10-06T22:44:59.668362] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-06T22:44:59.671589] [INFO ] [MAIN ] Derivative Progress: 1648/2037 symbols completed. SNX took 1.4s. Estimated remaining: 2m 36s. Rate: 149.8 symbols/min [2025-10-06T22:44:59.676933] [DEBUG] [LOCAL ] SO: Derivative data saved (1794 records). [2025-10-06T22:44:59.677630] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-06T22:44:59.681187] [INFO ] [MAIN ] Derivative Progress: 1649/2037 symbols completed. SO took 1.3s. Estimated remaining: 2m 35s. Rate: 149.9 symbols/min [2025-10-06T22:44:59.696912] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:44:59.697603] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39388 primary records. [2025-10-06T22:44:59.697694] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-06T22:44:59.714035] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-10-06T22:44:59.714103] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-06T22:44:59.717624] [INFO ] [MAIN ] Derivative Progress: 1650/2037 symbols completed. SOBO took 1.3s. Estimated remaining: 2m 35s. Rate: 150.0 symbols/min [2025-10-06T22:44:59.718297] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:59.718407] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:59.718154] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:44:59.735327] [DEBUG] [LOCAL ] SOJC: Loaded 4991 existing records from primary storage. [2025-10-06T22:44:59.735691] [INFO ] [MAIN ] SOJC: Loaded 4991 primary data records. [2025-10-06T22:44:59.767496] [DEBUG] [LOCAL ] SOJD: Loaded 13021 existing records from primary storage. [2025-10-06T22:44:59.792193] [INFO ] [MAIN ] SOJD: Loaded 13021 primary data records. [2025-10-06T22:45:00.245557] [DEBUG] [LOCAL ] SOC: Loaded 50526 existing records from primary storage. [2025-10-06T22:45:00.299356] [INFO ] [MAIN ] SOC: Loaded 50526 primary data records. [2025-10-06T22:45:00.782897] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:00.785238] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 4991 primary records. [2025-10-06T22:45:00.785465] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-06T22:45:00.805863] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-10-06T22:45:00.806447] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-06T22:45:00.809183] [INFO ] [MAIN ] Derivative Progress: 1651/2037 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 35s. Rate: 149.8 symbols/min [2025-10-06T22:45:00.809587] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:00.823424] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:00.824361] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 13021 primary records. [2025-10-06T22:45:00.824635] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-06T22:45:00.845666] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-10-06T22:45:00.845885] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-06T22:45:00.848690] [INFO ] [MAIN ] Derivative Progress: 1652/2037 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 34s. Rate: 149.9 symbols/min [2025-10-06T22:45:00.849040] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:00.854091] [DEBUG] [LOCAL ] SOJE: Loaded 9191 existing records from primary storage. [2025-10-06T22:45:00.854408] [INFO ] [MAIN ] SOJE: Loaded 9191 primary data records. [2025-10-06T22:45:01.070445] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:01.069923] [DEBUG] [LOCAL ] SOL: Loaded 12968 existing records from primary storage. [2025-10-06T22:45:01.076713] [INFO ] [MAIN ] SOL: Loaded 12968 primary data records. [2025-10-06T22:45:01.076570] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50526 primary records. [2025-10-06T22:45:01.087092] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-06T22:45:01.401248] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-10-06T22:45:01.402196] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-06T22:45:01.411963] [INFO ] [MAIN ] Derivative Progress: 1653/2037 symbols completed. SOC took 1.7s. Estimated remaining: 2m 34s. Rate: 149.8 symbols/min [2025-10-06T22:45:01.429730] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:01.673987] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:01.675122] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 9191 primary records. [2025-10-06T22:45:01.676037] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-06T22:45:01.709176] [DEBUG] [LOCAL ] SOLV: Loaded 44006 existing records from primary storage. [2025-10-06T22:45:01.711498] [INFO ] [MAIN ] SOLV: Loaded 44006 primary data records. [2025-10-06T22:45:01.711389] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-10-06T22:45:01.711791] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-06T22:45:01.745774] [INFO ] [MAIN ] Derivative Progress: 1654/2037 symbols completed. SOJE took 0.9s. Estimated remaining: 2m 33s. Rate: 149.9 symbols/min [2025-10-06T22:45:01.758840] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:01.785383] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:01.808858] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 12968 primary records. [2025-10-06T22:45:01.820128] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-06T22:45:02.057974] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-10-06T22:45:02.058187] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-06T22:45:02.061043] [INFO ] [MAIN ] Derivative Progress: 1655/2037 symbols completed. SOL took 1.2s. Estimated remaining: 2m 33s. Rate: 149.9 symbols/min [2025-10-06T22:45:02.061404] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:02.094078] [DEBUG] [LOCAL ] SON: Loaded 43043 existing records from primary storage. [2025-10-06T22:45:02.094364] [INFO ] [MAIN ] SON: Loaded 43043 primary data records. [2025-10-06T22:45:02.329194] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:02.468944] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 44006 primary records. [2025-10-06T22:45:02.469158] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-06T22:45:02.471208] [DEBUG] [LOCAL ] SONY: Loaded 53364 existing records from primary storage. [2025-10-06T22:45:02.471738] [INFO ] [MAIN ] SONY: Loaded 53364 primary data records. [2025-10-06T22:45:02.521981] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-10-06T22:45:02.583406] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-06T22:45:02.602236] [INFO ] [MAIN ] Derivative Progress: 1656/2037 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 33s. Rate: 149.8 symbols/min [2025-10-06T22:45:02.614599] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:02.702614] [DEBUG] [LOCAL ] SOR: Loaded 2872 existing records from primary storage. [2025-10-06T22:45:02.818735] [INFO ] [MAIN ] SOR: Loaded 2872 primary data records. [2025-10-06T22:45:03.194118] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:03.196367] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 43043 primary records. [2025-10-06T22:45:03.196498] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-06T22:45:03.220978] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-10-06T22:45:03.221877] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-06T22:45:03.224780] [INFO ] [MAIN ] Derivative Progress: 1657/2037 symbols completed. SON took 1.5s. Estimated remaining: 2m 32s. Rate: 149.8 symbols/min [2025-10-06T22:45:03.225108] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:03.239620] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:03.241084] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53364 primary records. [2025-10-06T22:45:03.241351] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-06T22:45:03.268421] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-10-06T22:45:03.269457] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-06T22:45:03.268041] [DEBUG] [LOCAL ] SOS: Loaded 8998 existing records from primary storage. [2025-10-06T22:45:03.273030] [INFO ] [MAIN ] Derivative Progress: 1658/2037 symbols completed. SONY took 1.2s. Estimated remaining: 2m 32s. Rate: 149.9 symbols/min [2025-10-06T22:45:03.275141] [INFO ] [MAIN ] SOS: Loaded 8998 primary data records. [2025-10-06T22:45:03.275308] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:03.339118] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:03.358000] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2872 primary records. [2025-10-06T22:45:03.363301] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-06T22:45:03.418246] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-10-06T22:45:03.418550] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-06T22:45:03.422205] [INFO ] [MAIN ] Derivative Progress: 1659/2037 symbols completed. SOR took 0.8s. Estimated remaining: 2m 31s. Rate: 149.9 symbols/min [2025-10-06T22:45:03.433944] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:03.663121] [DEBUG] [LOCAL ] SPB: Loaded 34161 existing records from primary storage. [2025-10-06T22:45:03.664519] [INFO ] [MAIN ] SPB: Loaded 34161 primary data records. [2025-10-06T22:45:03.999516] [DEBUG] [LOCAL ] SPCE: Loaded 49925 existing records from primary storage. [2025-10-06T22:45:04.000477] [INFO ] [MAIN ] SPCE: Loaded 49925 primary data records. [2025-10-06T22:45:04.314176] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-10-06T22:45:04.329308] [INFO ] [MAIN ] SOS: Generated 1789 derivative records from 8998 primary records. [2025-10-06T22:45:04.330472] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-06T22:45:04.367596] [DEBUG] [LOCAL ] SOS: Derivative data saved (1789 records). [2025-10-06T22:45:04.368372] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-06T22:45:04.374445] [INFO ] [MAIN ] Derivative Progress: 1660/2037 symbols completed. SOS took 1.1s. Estimated remaining: 2m 31s. Rate: 149.8 symbols/min [2025-10-06T22:45:04.368165] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:04.376520] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:04.377979] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34161 primary records. [2025-10-06T22:45:04.378808] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-06T22:45:04.399390] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-10-06T22:45:04.399626] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-06T22:45:04.402638] [INFO ] [MAIN ] Derivative Progress: 1661/2037 symbols completed. SPB took 1.1s. Estimated remaining: 2m 31s. Rate: 149.9 symbols/min [2025-10-06T22:45:04.403387] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:04.407559] [DEBUG] [LOCAL ] SPE: Loaded 6283 existing records from primary storage. [2025-10-06T22:45:04.408531] [INFO ] [MAIN ] SPE: Loaded 6283 primary data records. [2025-10-06T22:45:04.562753] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:04.575698] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49925 primary records. [2025-10-06T22:45:04.575978] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-06T22:45:04.759907] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-10-06T22:45:04.761308] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-06T22:45:04.764375] [INFO ] [MAIN ] Derivative Progress: 1662/2037 symbols completed. SPCE took 1.3s. Estimated remaining: 2m 30s. Rate: 149.9 symbols/min [2025-10-06T22:45:04.764974] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:04.792836] [DEBUG] [LOCAL ] SPG: Loaded 50257 existing records from primary storage. [2025-10-06T22:45:04.793452] [INFO ] [MAIN ] SPG: Loaded 50257 primary data records. [2025-10-06T22:45:04.994039] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:05.007711] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6283 primary records. [2025-10-06T22:45:05.013832] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-06T22:45:05.055395] [DEBUG] [LOCAL ] SPGI: Loaded 45769 existing records from primary storage. [2025-10-06T22:45:05.055536] [INFO ] [MAIN ] SPGI: Loaded 45769 primary data records. [2025-10-06T22:45:05.337145] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-10-06T22:45:05.358573] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-06T22:45:05.400812] [INFO ] [MAIN ] Derivative Progress: 1663/2037 symbols completed. SPE took 1.0s. Estimated remaining: 2m 30s. Rate: 149.8 symbols/min [2025-10-06T22:45:05.562612] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:05.563723] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50257 primary records. [2025-10-06T22:45:05.563864] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-06T22:45:05.599247] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:05.600793] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45769 primary records. [2025-10-06T22:45:05.600868] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-06T22:45:05.611701] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-10-06T22:45:05.614863] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-06T22:45:05.617708] [INFO ] [MAIN ] Derivative Progress: 1664/2037 symbols completed. SPG took 1.2s. Estimated remaining: 2m 29s. Rate: 149.9 symbols/min [2025-10-06T22:45:05.621868] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-10-06T22:45:05.621951] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-06T22:45:05.624824] [INFO ] [MAIN ] Derivative Progress: 1665/2037 symbols completed. SPGI took 0.9s. Estimated remaining: 2m 29s. Rate: 150.0 symbols/min [2025-10-06T22:45:05.625376] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:05.625481] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:05.625290] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:05.647726] [DEBUG] [LOCAL ] SPH: Loaded 17090 existing records from primary storage. [2025-10-06T22:45:05.648000] [INFO ] [MAIN ] SPH: Loaded 17090 primary data records. [2025-10-06T22:45:05.847057] [DEBUG] [LOCAL ] SPIR: Loaded 37153 existing records from primary storage. [2025-10-06T22:45:05.874456] [DEBUG] [LOCAL ] SPHR: Loaded 40196 existing records from primary storage. [2025-10-06T22:45:05.871736] [INFO ] [MAIN ] SPIR: Loaded 37153 primary data records. [2025-10-06T22:45:05.878324] [INFO ] [MAIN ] SPHR: Loaded 40196 primary data records. [2025-10-06T22:45:06.637247] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:06.638743] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 17090 primary records. [2025-10-06T22:45:06.639170] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-06T22:45:06.677066] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-10-06T22:45:06.677569] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-06T22:45:06.677921] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:06.681429] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37153 primary records. [2025-10-06T22:45:06.680564] [INFO ] [MAIN ] Derivative Progress: 1666/2037 symbols completed. SPH took 1.1s. Estimated remaining: 2m 29s. Rate: 149.8 symbols/min [2025-10-06T22:45:06.681664] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-06T22:45:06.681823] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:06.695559] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:06.697073] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40196 primary records. [2025-10-06T22:45:06.697258] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-06T22:45:06.726782] [DEBUG] [LOCAL ] SPMC: Loaded 5327 existing records from primary storage. [2025-10-06T22:45:06.727930] [INFO ] [MAIN ] SPMC: Loaded 5327 primary data records. [2025-10-06T22:45:06.730369] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-10-06T22:45:06.730468] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-06T22:45:06.733351] [INFO ] [MAIN ] Derivative Progress: 1667/2037 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 28s. Rate: 149.9 symbols/min [2025-10-06T22:45:06.733789] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:06.779060] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-10-06T22:45:06.779374] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-06T22:45:06.803339] [INFO ] [MAIN ] Derivative Progress: 1668/2037 symbols completed. SPHR took 1.2s. Estimated remaining: 2m 28s. Rate: 150.0 symbols/min [2025-10-06T22:45:06.808699] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:07.062540] [DEBUG] [LOCAL ] SPNT: Loaded 34818 existing records from primary storage. [2025-10-06T22:45:07.063169] [INFO ] [MAIN ] SPNT: Loaded 34818 primary data records. [2025-10-06T22:45:07.310002] [DEBUG] [LOCAL ] SPOT: Loaded 50495 existing records from primary storage. [2025-10-06T22:45:07.427334] [INFO ] [MAIN ] SPOT: Loaded 50495 primary data records. [2025-10-06T22:45:07.655941] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:07.743609] [INFO ] [MAIN ] SPMC: Generated 1794 derivative records from 5327 primary records. [2025-10-06T22:45:07.744689] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-06T22:45:07.773265] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1794 records). [2025-10-06T22:45:07.782583] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-06T22:45:07.785435] [INFO ] [MAIN ] Derivative Progress: 1669/2037 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 27s. Rate: 149.9 symbols/min [2025-10-06T22:45:07.791467] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:07.791860] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:07.793887] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34818 primary records. [2025-10-06T22:45:07.794473] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-06T22:45:07.817709] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-10-06T22:45:07.831883] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-06T22:45:07.831766] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:07.835166] [INFO ] [MAIN ] Derivative Progress: 1670/2037 symbols completed. SPNT took 1.1s. Estimated remaining: 2m 27s. Rate: 149.9 symbols/min [2025-10-06T22:45:07.835440] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:07.837019] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 50495 primary records. [2025-10-06T22:45:07.837274] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-06T22:45:07.875899] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-10-06T22:45:07.875356] [DEBUG] [LOCAL ] SPRU: Loaded 9368 existing records from primary storage. [2025-10-06T22:45:07.876325] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-06T22:45:07.876455] [INFO ] [MAIN ] SPRU: Loaded 9368 primary data records. [2025-10-06T22:45:07.879814] [INFO ] [MAIN ] Derivative Progress: 1671/2037 symbols completed. SPOT took 1.1s. Estimated remaining: 2m 26s. Rate: 150.0 symbols/min [2025-10-06T22:45:07.885224] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:08.023077] [DEBUG] [LOCAL ] SPR: Loaded 41111 existing records from primary storage. [2025-10-06T22:45:08.029364] [INFO ] [MAIN ] SPR: Loaded 41111 primary data records. [2025-10-06T22:45:08.371043] [DEBUG] [LOCAL ] SPXC: Loaded 23358 existing records from primary storage. [2025-10-06T22:45:08.383403] [INFO ] [MAIN ] SPXC: Loaded 23358 primary data records. [2025-10-06T22:45:08.952935] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:08.953912] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 9368 primary records. [2025-10-06T22:45:08.954320] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-06T22:45:08.978244] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-10-06T22:45:08.978938] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-06T22:45:08.982348] [INFO ] [MAIN ] Derivative Progress: 1672/2037 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 26s. Rate: 149.9 symbols/min [2025-10-06T22:45:08.984687] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:08.999209] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:09.008206] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41111 primary records. [2025-10-06T22:45:09.008361] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-06T22:45:09.017382] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:09.018920] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23358 primary records. [2025-10-06T22:45:09.019013] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-06T22:45:09.052373] [DEBUG] [LOCAL ] SPXX: Loaded 9334 existing records from primary storage. [2025-10-06T22:45:09.052754] [INFO ] [MAIN ] SPXX: Loaded 9334 primary data records. [2025-10-06T22:45:09.052869] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-10-06T22:45:09.056715] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-10-06T22:45:09.068038] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-06T22:45:09.071003] [INFO ] [MAIN ] Derivative Progress: 1673/2037 symbols completed. SPR took 1.3s. Estimated remaining: 2m 26s. Rate: 149.9 symbols/min [2025-10-06T22:45:09.071251] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:09.071144] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-06T22:45:09.093460] [INFO ] [MAIN ] Derivative Progress: 1674/2037 symbols completed. SPXC took 1.2s. Estimated remaining: 2m 25s. Rate: 150.0 symbols/min [2025-10-06T22:45:09.098759] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:09.415707] [DEBUG] [LOCAL ] SQNS: Loaded 26701 existing records from primary storage. [2025-10-06T22:45:09.416532] [INFO ] [MAIN ] SQNS: Loaded 26701 primary data records. [2025-10-06T22:45:09.542248] [DEBUG] [LOCAL ] SQM: Loaded 48603 existing records from primary storage. [2025-10-06T22:45:09.543285] [INFO ] [MAIN ] SQM: Loaded 48603 primary data records. [2025-10-06T22:45:10.037547] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:10.047784] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 9334 primary records. [2025-10-06T22:45:10.047945] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-06T22:45:10.068246] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-10-06T22:45:10.068897] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-06T22:45:10.072001] [INFO ] [MAIN ] Derivative Progress: 1675/2037 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 25s. Rate: 149.9 symbols/min [2025-10-06T22:45:10.072635] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:10.096481] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:10.097970] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 26701 primary records. [2025-10-06T22:45:10.098093] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-06T22:45:10.119106] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-10-06T22:45:10.136159] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-06T22:45:10.143587] [INFO ] [MAIN ] Derivative Progress: 1676/2037 symbols completed. SQNS took 1.0s. Estimated remaining: 2m 24s. Rate: 150.0 symbols/min [2025-10-06T22:45:10.144482] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:10.144706] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:10.146098] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48603 primary records. [2025-10-06T22:45:10.146280] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-06T22:45:10.170974] [DEBUG] [LOCAL ] SR: Loaded 32753 existing records from primary storage. [2025-10-06T22:45:10.171793] [INFO ] [MAIN ] SR: Loaded 32753 primary data records. [2025-10-06T22:45:10.247600] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-10-06T22:45:10.254033] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-06T22:45:10.280711] [INFO ] [MAIN ] Derivative Progress: 1677/2037 symbols completed. SQM took 1.2s. Estimated remaining: 2m 24s. Rate: 150.0 symbols/min [2025-10-06T22:45:10.284709] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:10.527864] [DEBUG] [LOCAL ] SREA: Loaded 10272 existing records from primary storage. [2025-10-06T22:45:10.530099] [INFO ] [MAIN ] SREA: Loaded 10272 primary data records. [2025-10-06T22:45:10.553610] [DEBUG] [LOCAL ] SRE: Loaded 53416 existing records from primary storage. [2025-10-06T22:45:10.570214] [INFO ] [MAIN ] SRE: Loaded 53416 primary data records. [2025-10-06T22:45:11.203247] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:11.204882] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32753 primary records. [2025-10-06T22:45:11.205474] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-06T22:45:11.226614] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-10-06T22:45:11.227320] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-06T22:45:11.230103] [INFO ] [MAIN ] Derivative Progress: 1678/2037 symbols completed. SR took 1.2s. Estimated remaining: 2m 24s. Rate: 149.9 symbols/min [2025-10-06T22:45:11.250566] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:11.263358] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10272 primary records. [2025-10-06T22:45:11.263518] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-06T22:45:11.263779] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:11.264944] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53416 primary records. [2025-10-06T22:45:11.265182] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-06T22:45:11.293043] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-10-06T22:45:11.293334] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-06T22:45:11.296282] [INFO ] [MAIN ] Derivative Progress: 1679/2037 symbols completed. SREA took 1.0s. Estimated remaining: 2m 23s. Rate: 150.0 symbols/min [2025-10-06T22:45:11.298460] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-10-06T22:45:11.298523] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-06T22:45:11.302330] [INFO ] [MAIN ] Derivative Progress: 1680/2037 symbols completed. SRE took 1.2s. Estimated remaining: 2m 23s. Rate: 150.0 symbols/min [2025-10-06T22:45:11.302790] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:11.302842] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:11.302725] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:11.328870] [DEBUG] [LOCAL ] SRG: Loaded 15472 existing records from primary storage. [2025-10-06T22:45:11.329015] [INFO ] [MAIN ] SRG: Loaded 15472 primary data records. [2025-10-06T22:45:11.457627] [DEBUG] [LOCAL ] SRI: Loaded 26878 existing records from primary storage. [2025-10-06T22:45:11.458423] [INFO ] [MAIN ] SRI: Loaded 26878 primary data records. [2025-10-06T22:45:11.560430] [DEBUG] [LOCAL ] SRFM: Loaded 37346 existing records from primary storage. [2025-10-06T22:45:11.698568] [INFO ] [MAIN ] SRFM: Loaded 37346 primary data records. [2025-10-06T22:45:12.332908] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:12.334197] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 15472 primary records. [2025-10-06T22:45:12.334538] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-06T22:45:12.352691] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-10-06T22:45:12.353039] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-06T22:45:12.355554] [INFO ] [MAIN ] Derivative Progress: 1681/2037 symbols completed. SRG took 1.1s. Estimated remaining: 2m 22s. Rate: 149.9 symbols/min [2025-10-06T22:45:12.356147] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:12.374066] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:12.377006] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 26878 primary records. [2025-10-06T22:45:12.377164] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-06T22:45:12.395135] [DEBUG] [LOCAL ] SRV: Loaded 7343 existing records from primary storage. [2025-10-06T22:45:12.399283] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-10-06T22:45:12.399390] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-06T22:45:12.399577] [INFO ] [MAIN ] SRV: Loaded 7343 primary data records. [2025-10-06T22:45:12.402407] [INFO ] [MAIN ] Derivative Progress: 1682/2037 symbols completed. SRI took 1.1s. Estimated remaining: 2m 22s. Rate: 150.0 symbols/min [2025-10-06T22:45:12.414056] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:12.459539] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:12.472409] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 37346 primary records. [2025-10-06T22:45:12.472523] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-06T22:45:12.619671] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-10-06T22:45:12.626496] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-06T22:45:12.768891] [INFO ] [MAIN ] Derivative Progress: 1683/2037 symbols completed. SRFM took 1.5s. Estimated remaining: 2m 22s. Rate: 150.0 symbols/min [2025-10-06T22:45:12.780205] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:12.805333] [DEBUG] [LOCAL ] SSB: Loaded 42698 existing records from primary storage. [2025-10-06T22:45:12.806189] [INFO ] [MAIN ] SSB: Loaded 42698 primary data records. [2025-10-06T22:45:12.918925] [DEBUG] [LOCAL ] SSD: Loaded 22478 existing records from primary storage. [2025-10-06T22:45:12.940266] [INFO ] [MAIN ] SSD: Loaded 22478 primary data records. [2025-10-06T22:45:13.052393] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:13.080432] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7343 primary records. [2025-10-06T22:45:13.170561] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-06T22:45:13.756117] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-10-06T22:45:13.756459] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-06T22:45:13.760264] [INFO ] [MAIN ] Derivative Progress: 1684/2037 symbols completed. SRV took 1.4s. Estimated remaining: 2m 21s. Rate: 149.9 symbols/min [2025-10-06T22:45:13.761267] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:13.803390] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:13.804741] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42698 primary records. [2025-10-06T22:45:13.805131] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-06T22:45:13.858303] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:13.859833] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22478 primary records. [2025-10-06T22:45:13.860894] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-06T22:45:13.877032] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-10-06T22:45:13.877241] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-06T22:45:13.880911] [INFO ] [MAIN ] Derivative Progress: 1685/2037 symbols completed. SSB took 1.5s. Estimated remaining: 2m 21s. Rate: 149.9 symbols/min [2025-10-06T22:45:13.890754] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:13.890440] [DEBUG] [LOCAL ] SSL: Loaded 41242 existing records from primary storage. [2025-10-06T22:45:13.895137] [INFO ] [MAIN ] SSL: Loaded 41242 primary data records. [2025-10-06T22:45:14.020280] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-10-06T22:45:14.021203] [DEBUG] [LOCAL ] SST: Loaded 11840 existing records from primary storage. [2025-10-06T22:45:14.027118] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-06T22:45:14.041305] [INFO ] [MAIN ] Derivative Progress: 1686/2037 symbols completed. SSD took 1.3s. Estimated remaining: 2m 20s. Rate: 150.0 symbols/min [2025-10-06T22:45:14.046707] [INFO ] [MAIN ] SST: Loaded 11840 primary data records. [2025-10-06T22:45:14.065889] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:14.559061] [DEBUG] [LOCAL ] SSTK: Loaded 25655 existing records from primary storage. [2025-10-06T22:45:14.560169] [INFO ] [MAIN ] SSTK: Loaded 25655 primary data records. [2025-10-06T22:45:14.758918] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:14.879962] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41242 primary records. [2025-10-06T22:45:14.880958] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-06T22:45:14.919725] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-10-06T22:45:14.920075] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:14.920268] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-06T22:45:14.922795] [INFO ] [MAIN ] Derivative Progress: 1687/2037 symbols completed. SSL took 1.2s. Estimated remaining: 2m 20s. Rate: 149.9 symbols/min [2025-10-06T22:45:14.925059] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 11840 primary records. [2025-10-06T22:45:14.925377] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-06T22:45:14.924141] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:14.945117] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-10-06T22:45:14.945316] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-06T22:45:14.948191] [INFO ] [MAIN ] Derivative Progress: 1688/2037 symbols completed. SST took 1.1s. Estimated remaining: 2m 20s. Rate: 150.0 symbols/min [2025-10-06T22:45:14.951123] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:14.966819] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:14.967592] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 25655 primary records. [2025-10-06T22:45:14.967771] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-06T22:45:14.997350] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-10-06T22:45:14.997522] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-06T22:45:15.000775] [INFO ] [MAIN ] Derivative Progress: 1689/2037 symbols completed. SSTK took 0.9s. Estimated remaining: 2m 19s. Rate: 150.0 symbols/min [2025-10-06T22:45:15.001128] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:15.030605] [DEBUG] [LOCAL ] ST: Loaded 49761 existing records from primary storage. [2025-10-06T22:45:15.031017] [INFO ] [MAIN ] ST: Loaded 49761 primary data records. [2025-10-06T22:45:15.161299] [DEBUG] [LOCAL ] STC: Loaded 17440 existing records from primary storage. [2025-10-06T22:45:15.161601] [INFO ] [MAIN ] STC: Loaded 17440 primary data records. [2025-10-06T22:45:15.168443] [DEBUG] [LOCAL ] STAG: Loaded 50094 existing records from primary storage. [2025-10-06T22:45:15.182478] [INFO ] [MAIN ] STAG: Loaded 50094 primary data records. [2025-10-06T22:45:16.092003] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:16.093020] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49761 primary records. [2025-10-06T22:45:16.095772] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-06T22:45:16.124979] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:16.126102] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-10-06T22:45:16.126941] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50094 primary records. [2025-10-06T22:45:16.127262] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-06T22:45:16.127215] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-06T22:45:16.130320] [INFO ] [MAIN ] Derivative Progress: 1690/2037 symbols completed. ST took 1.2s. Estimated remaining: 2m 19s. Rate: 149.9 symbols/min [2025-10-06T22:45:16.130817] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:16.162417] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:16.163946] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17440 primary records. [2025-10-06T22:45:16.164287] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-06T22:45:16.166735] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-10-06T22:45:16.173948] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-06T22:45:16.180071] [INFO ] [MAIN ] Derivative Progress: 1691/2037 symbols completed. STAG took 1.2s. Estimated remaining: 2m 18s. Rate: 149.9 symbols/min [2025-10-06T22:45:16.180332] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:16.187078] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-10-06T22:45:16.187376] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-06T22:45:16.199188] [INFO ] [MAIN ] Derivative Progress: 1692/2037 symbols completed. STC took 1.2s. Estimated remaining: 2m 18s. Rate: 150.0 symbols/min [2025-10-06T22:45:16.199507] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:16.219733] [DEBUG] [LOCAL ] STE: Loaded 35488 existing records from primary storage. [2025-10-06T22:45:16.219970] [INFO ] [MAIN ] STE: Loaded 35488 primary data records. [2025-10-06T22:45:16.305292] [DEBUG] [LOCAL ] STEL: Loaded 23004 existing records from primary storage. [2025-10-06T22:45:16.351975] [INFO ] [MAIN ] STEL: Loaded 23004 primary data records. [2025-10-06T22:45:16.546298] [DEBUG] [LOCAL ] STEM: Loaded 39194 existing records from primary storage. [2025-10-06T22:45:16.661306] [INFO ] [MAIN ] STEM: Loaded 39194 primary data records. [2025-10-06T22:45:17.183213] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:17.184109] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35488 primary records. [2025-10-06T22:45:17.184361] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-06T22:45:17.203271] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-10-06T22:45:17.205727] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-06T22:45:17.208267] [INFO ] [MAIN ] Derivative Progress: 1693/2037 symbols completed. STE took 1.1s. Estimated remaining: 2m 18s. Rate: 149.9 symbols/min [2025-10-06T22:45:17.222423] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:17.223101] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 23004 primary records. [2025-10-06T22:45:17.223246] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-06T22:45:17.253417] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:17.254530] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 39194 primary records. [2025-10-06T22:45:17.255144] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-10-06T22:45:17.255245] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-06T22:45:17.255327] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-06T22:45:17.258058] [INFO ] [MAIN ] Derivative Progress: 1694/2037 symbols completed. STEL took 1.1s. Estimated remaining: 2m 17s. Rate: 150.0 symbols/min [2025-10-06T22:45:17.273803] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-10-06T22:45:17.273863] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-06T22:45:17.276900] [INFO ] [MAIN ] Derivative Progress: 1695/2037 symbols completed. STEM took 1.1s. Estimated remaining: 2m 17s. Rate: 150.1 symbols/min [2025-10-06T22:45:17.277325] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:17.277424] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:17.277482] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:17.295031] [DEBUG] [LOCAL ] STK: Loaded 9525 existing records from primary storage. [2025-10-06T22:45:17.295228] [INFO ] [MAIN ] STK: Loaded 9525 primary data records. [2025-10-06T22:45:17.378815] [DEBUG] [LOCAL ] STEW: Loaded 16142 existing records from primary storage. [2025-10-06T22:45:17.406138] [INFO ] [MAIN ] STEW: Loaded 16142 primary data records. [2025-10-06T22:45:17.789762] [DEBUG] [LOCAL ] STLA: Loaded 53551 existing records from primary storage. [2025-10-06T22:45:17.807106] [INFO ] [MAIN ] STLA: Loaded 53551 primary data records. [2025-10-06T22:45:18.348817] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:18.350119] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9525 primary records. [2025-10-06T22:45:18.352472] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-06T22:45:18.383895] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:18.388157] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-10-06T22:45:18.388777] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-06T22:45:18.390064] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 16142 primary records. [2025-10-06T22:45:18.393388] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-06T22:45:18.393239] [INFO ] [MAIN ] Derivative Progress: 1696/2037 symbols completed. STK took 1.1s. Estimated remaining: 2m 16s. Rate: 149.9 symbols/min [2025-10-06T22:45:18.395037] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:18.414830] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-10-06T22:45:18.415390] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-06T22:45:18.419956] [INFO ] [MAIN ] Derivative Progress: 1697/2037 symbols completed. STEW took 1.1s. Estimated remaining: 2m 16s. Rate: 150.0 symbols/min [2025-10-06T22:45:18.422687] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:18.439345] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:18.440535] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53551 primary records. [2025-10-06T22:45:18.440716] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-06T22:45:18.466243] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-10-06T22:45:18.466541] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-06T22:45:18.470456] [INFO ] [MAIN ] Derivative Progress: 1698/2037 symbols completed. STLA took 1.2s. Estimated remaining: 2m 16s. Rate: 150.1 symbols/min [2025-10-06T22:45:18.470928] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:18.496081] [DEBUG] [LOCAL ] STN: Loaded 22823 existing records from primary storage. [2025-10-06T22:45:18.496278] [INFO ] [MAIN ] STN: Loaded 22823 primary data records. [2025-10-06T22:45:18.618015] [DEBUG] [LOCAL ] STM: Loaded 53574 existing records from primary storage. [2025-10-06T22:45:18.621866] [INFO ] [MAIN ] STM: Loaded 53574 primary data records. [2025-10-06T22:45:19.048879] [DEBUG] [LOCAL ] STNG: Loaded 43684 existing records from primary storage. [2025-10-06T22:45:19.073175] [INFO ] [MAIN ] STNG: Loaded 43684 primary data records. [2025-10-06T22:45:19.632746] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:19.634889] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 22823 primary records. [2025-10-06T22:45:19.636365] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-06T22:45:19.657529] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-10-06T22:45:19.657941] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-06T22:45:19.660698] [INFO ] [MAIN ] Derivative Progress: 1699/2037 symbols completed. STN took 1.2s. Estimated remaining: 2m 15s. Rate: 149.9 symbols/min [2025-10-06T22:45:19.661151] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:19.682965] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:19.685055] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53574 primary records. [2025-10-06T22:45:19.685406] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-06T22:45:19.708872] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-10-06T22:45:19.709678] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-06T22:45:19.712736] [INFO ] [MAIN ] Derivative Progress: 1700/2037 symbols completed. STM took 1.3s. Estimated remaining: 2m 15s. Rate: 150.0 symbols/min [2025-10-06T22:45:19.713039] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:19.723115] [DEBUG] [LOCAL ] STRV: Loaded 11323 existing records from primary storage. [2025-10-06T22:45:19.723435] [INFO ] [MAIN ] STRV: Loaded 11323 primary data records. [2025-10-06T22:45:19.772185] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:19.807491] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 43684 primary records. [2025-10-06T22:45:19.838542] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-06T22:45:19.923974] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-10-06T22:45:19.956855] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-06T22:45:19.960691] [INFO ] [MAIN ] Derivative Progress: 1701/2037 symbols completed. STNG took 1.5s. Estimated remaining: 2m 14s. Rate: 150.0 symbols/min [2025-10-06T22:45:20.098785] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:20.123243] [DEBUG] [LOCAL ] STT: Loaded 50958 existing records from primary storage. [2025-10-06T22:45:20.132926] [INFO ] [MAIN ] STT: Loaded 50958 primary data records. [2025-10-06T22:45:20.232855] [DEBUG] [LOCAL ] STVN: Loaded 26428 existing records from primary storage. [2025-10-06T22:45:20.249553] [INFO ] [MAIN ] STVN: Loaded 26428 primary data records. [2025-10-06T22:45:20.528035] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:45:20.559776] [INFO ] [MAIN ] STRV: Generated 1793 derivative records from 11323 primary records. [2025-10-06T22:45:20.571073] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-06T22:45:20.774508] [DEBUG] [LOCAL ] STRV: Derivative data saved (1793 records). [2025-10-06T22:45:20.774899] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-06T22:45:20.777548] [INFO ] [MAIN ] Derivative Progress: 1702/2037 symbols completed. STRV took 1.1s. Estimated remaining: 2m 14s. Rate: 149.9 symbols/min [2025-10-06T22:45:20.778933] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:20.800325] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:20.801155] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 50958 primary records. [2025-10-06T22:45:20.801424] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-06T22:45:20.819829] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-10-06T22:45:20.820136] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-06T22:45:20.823568] [INFO ] [MAIN ] Derivative Progress: 1703/2037 symbols completed. STT took 1.1s. Estimated remaining: 2m 14s. Rate: 150.0 symbols/min [2025-10-06T22:45:20.824459] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:20.843928] [DEBUG] [LOCAL ] STXD: Loaded 1275 existing records from primary storage. [2025-10-06T22:45:20.842022] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:20.858514] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26428 primary records. [2025-10-06T22:45:20.857528] [INFO ] [MAIN ] STXD: Loaded 1275 primary data records. [2025-10-06T22:45:20.879998] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-06T22:45:20.997996] [DEBUG] [LOCAL ] STWD: Loaded 51917 existing records from primary storage. [2025-10-06T22:45:21.019058] [INFO ] [MAIN ] STWD: Loaded 51917 primary data records. [2025-10-06T22:45:21.296247] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-10-06T22:45:21.305703] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-06T22:45:21.313673] [INFO ] [MAIN ] Derivative Progress: 1704/2037 symbols completed. STVN took 1.2s. Estimated remaining: 2m 13s. Rate: 150.0 symbols/min [2025-10-06T22:45:21.319010] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:21.499293] [DEBUG] [LOCAL ] STXE: Loaded 2119 existing records from primary storage. [2025-10-06T22:45:21.499923] [INFO ] [MAIN ] STXE: Loaded 2119 primary data records. [2025-10-06T22:45:21.883724] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:45:21.884910] [INFO ] [MAIN ] STXD: Generated 1793 derivative records from 1275 primary records. [2025-10-06T22:45:21.885303] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-06T22:45:21.902521] [DEBUG] [LOCAL ] STXD: Derivative data saved (1793 records). [2025-10-06T22:45:21.903268] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-06T22:45:21.906960] [INFO ] [MAIN ] Derivative Progress: 1705/2037 symbols completed. STXD took 1.1s. Estimated remaining: 2m 13s. Rate: 149.9 symbols/min [2025-10-06T22:45:21.908494] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:21.924451] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:21.927478] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51917 primary records. [2025-10-06T22:45:21.927743] [DEBUG] [LOCAL ] STXG: Loaded 2476 existing records from primary storage. [2025-10-06T22:45:21.928013] [INFO ] [MAIN ] STXG: Loaded 2476 primary data records. [2025-10-06T22:45:21.927568] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-06T22:45:22.037503] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-10-06T22:45:22.048914] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-06T22:45:22.062330] [INFO ] [MAIN ] Derivative Progress: 1706/2037 symbols completed. STWD took 1.3s. Estimated remaining: 2m 12s. Rate: 150.0 symbols/min [2025-10-06T22:45:22.072942] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:22.262278] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:45:22.264240] [DEBUG] [LOCAL ] STXK: Loaded 1497 existing records from primary storage. [2025-10-06T22:45:22.264999] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2119 primary records. [2025-10-06T22:45:22.265189] [INFO ] [MAIN ] STXK: Loaded 1497 primary data records. [2025-10-06T22:45:22.265133] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-06T22:45:22.467918] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-10-06T22:45:22.585333] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-06T22:45:22.588552] [INFO ] [MAIN ] Derivative Progress: 1707/2037 symbols completed. STXE took 1.3s. Estimated remaining: 2m 12s. Rate: 149.9 symbols/min [2025-10-06T22:45:22.589184] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:22.611267] [DEBUG] [LOCAL ] STXT: Loaded 2508 existing records from primary storage. [2025-10-06T22:45:22.611843] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:45:22.611973] [INFO ] [MAIN ] STXT: Loaded 2508 primary data records. [2025-10-06T22:45:22.634276] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2476 primary records. [2025-10-06T22:45:22.634694] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-06T22:45:22.722906] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-10-06T22:45:22.736264] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-06T22:45:22.739465] [INFO ] [MAIN ] Derivative Progress: 1708/2037 symbols completed. STXG took 0.8s. Estimated remaining: 2m 12s. Rate: 150.0 symbols/min [2025-10-06T22:45:22.974988] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-06T22:45:22.975884] [INFO ] [MAIN ] STXK: Generated 1792 derivative records from 1497 primary records. [2025-10-06T22:45:22.976123] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-06T22:45:22.992920] [DEBUG] [LOCAL ] STXK: Derivative data saved (1792 records). [2025-10-06T22:45:22.993156] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-06T22:45:22.996343] [INFO ] [MAIN ] Derivative Progress: 1709/2037 symbols completed. STXK took 0.9s. Estimated remaining: 2m 11s. Rate: 150.0 symbols/min [2025-10-06T22:45:23.019527] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-06T22:45:23.020327] [INFO ] [MAIN ] STXT: Generated 1792 derivative records from 2508 primary records. [2025-10-06T22:45:23.020394] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-06T22:45:23.035568] [DEBUG] [LOCAL ] STXT: Derivative data saved (1792 records). [2025-10-06T22:45:23.035633] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-06T22:45:23.038459] [INFO ] [MAIN ] Derivative Progress: 1710/2037 symbols completed. STXT took 0.4s. Estimated remaining: 2m 11s. Rate: 150.1 symbols/min [2025-10-06T22:45:23.039243] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:23.039162] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:23.039403] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:23.044618] [DEBUG] [LOCAL ] STXV: Loaded 1556 existing records from primary storage. [2025-10-06T22:45:23.044901] [INFO ] [MAIN ] STXV: Loaded 1556 primary data records. [2025-10-06T22:45:23.391900] [DEBUG] [LOCAL ] SU: Loaded 53436 existing records from primary storage. [2025-10-06T22:45:23.392555] [INFO ] [MAIN ] SU: Loaded 53436 primary data records. [2025-10-06T22:45:23.511950] [DEBUG] [LOCAL ] STZ: Loaded 52309 existing records from primary storage. [2025-10-06T22:45:23.523019] [INFO ] [MAIN ] STZ: Loaded 52309 primary data records. [2025-10-06T22:45:23.979989] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-06T22:45:23.980787] [INFO ] [MAIN ] STXV: Generated 1792 derivative records from 1556 primary records. [2025-10-06T22:45:24.100146] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-06T22:45:24.118600] [DEBUG] [LOCAL ] STXV: Derivative data saved (1792 records). [2025-10-06T22:45:24.119813] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-06T22:45:24.123239] [INFO ] [MAIN ] Derivative Progress: 1711/2037 symbols completed. STXV took 1.1s. Estimated remaining: 2m 10s. Rate: 150.0 symbols/min [2025-10-06T22:45:24.124185] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:24.144975] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:24.145742] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53436 primary records. [2025-10-06T22:45:24.145921] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-06T22:45:24.170567] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-10-06T22:45:24.170796] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-06T22:45:24.173060] [INFO ] [MAIN ] Derivative Progress: 1712/2037 symbols completed. SU took 1.1s. Estimated remaining: 2m 10s. Rate: 150.0 symbols/min [2025-10-06T22:45:24.173425] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:24.197885] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:24.199207] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52309 primary records. [2025-10-06T22:45:24.199318] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-06T22:45:24.219696] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-10-06T22:45:24.219955] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-06T22:45:24.223427] [INFO ] [MAIN ] Derivative Progress: 1713/2037 symbols completed. STZ took 1.2s. Estimated remaining: 2m 10s. Rate: 150.1 symbols/min [2025-10-06T22:45:24.237685] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:24.239639] [DEBUG] [LOCAL ] SUI: Loaded 41603 existing records from primary storage. [2025-10-06T22:45:24.240040] [INFO ] [MAIN ] SUI: Loaded 41603 primary data records. [2025-10-06T22:45:24.397982] [DEBUG] [LOCAL ] SUN: Loaded 37773 existing records from primary storage. [2025-10-06T22:45:24.447764] [INFO ] [MAIN ] SUN: Loaded 37773 primary data records. [2025-10-06T22:45:24.714532] [DEBUG] [LOCAL ] SUPV: Loaded 47383 existing records from primary storage. [2025-10-06T22:45:24.725621] [INFO ] [MAIN ] SUPV: Loaded 47383 primary data records. [2025-10-06T22:45:25.303533] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:25.304733] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 41603 primary records. [2025-10-06T22:45:25.305552] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-06T22:45:25.326070] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-10-06T22:45:25.326569] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-06T22:45:25.330086] [INFO ] [MAIN ] Derivative Progress: 1714/2037 symbols completed. SUI took 1.2s. Estimated remaining: 2m 9s. Rate: 150.0 symbols/min [2025-10-06T22:45:25.331131] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:25.356273] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:25.357548] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 37773 primary records. [2025-10-06T22:45:25.357829] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-06T22:45:25.412837] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-10-06T22:45:25.412733] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:25.413866] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47383 primary records. [2025-10-06T22:45:25.414112] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-06T22:45:25.414001] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-06T22:45:25.416588] [INFO ] [MAIN ] Derivative Progress: 1715/2037 symbols completed. SUN took 1.2s. Estimated remaining: 2m 9s. Rate: 150.0 symbols/min [2025-10-06T22:45:25.428201] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:25.453395] [DEBUG] [LOCAL ] SUZ: Loaded 45512 existing records from primary storage. [2025-10-06T22:45:25.455132] [INFO ] [MAIN ] SUZ: Loaded 45512 primary data records. [2025-10-06T22:45:25.455481] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-10-06T22:45:25.475339] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-06T22:45:25.490294] [INFO ] [MAIN ] Derivative Progress: 1716/2037 symbols completed. SUPV took 1.3s. Estimated remaining: 2m 8s. Rate: 150.1 symbols/min [2025-10-06T22:45:25.525715] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:25.852163] [DEBUG] [LOCAL ] SVV: Loaded 39823 existing records from primary storage. [2025-10-06T22:45:25.865945] [INFO ] [MAIN ] SVV: Loaded 39823 primary data records. [2025-10-06T22:45:26.203716] [DEBUG] [LOCAL ] SW: Loaded 53169 existing records from primary storage. [2025-10-06T22:45:26.204200] [INFO ] [MAIN ] SW: Loaded 53169 primary data records. [2025-10-06T22:45:26.519607] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:26.520557] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45512 primary records. [2025-10-06T22:45:26.521637] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-06T22:45:26.544348] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-10-06T22:45:26.544804] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-06T22:45:26.548300] [INFO ] [MAIN ] Derivative Progress: 1717/2037 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 8s. Rate: 150.0 symbols/min [2025-10-06T22:45:26.561730] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:26.562052] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:26.563356] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 39823 primary records. [2025-10-06T22:45:26.563525] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-06T22:45:26.583771] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-10-06T22:45:26.597669] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-06T22:45:26.597901] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:26.601507] [INFO ] [MAIN ] Derivative Progress: 1718/2037 symbols completed. SVV took 1.2s. Estimated remaining: 2m 8s. Rate: 150.0 symbols/min [2025-10-06T22:45:26.598752] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53169 primary records. [2025-10-06T22:45:26.601776] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-06T22:45:26.601884] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:26.618883] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-10-06T22:45:26.619135] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-06T22:45:26.622599] [INFO ] [MAIN ] Derivative Progress: 1719/2037 symbols completed. SW took 1.1s. Estimated remaining: 2m 7s. Rate: 150.1 symbols/min [2025-10-06T22:45:26.622985] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:26.645702] [DEBUG] [LOCAL ] SWZ: Loaded 6036 existing records from primary storage. [2025-10-06T22:45:26.645965] [INFO ] [MAIN ] SWZ: Loaded 6036 primary data records. [2025-10-06T22:45:26.747711] [DEBUG] [LOCAL ] SWK: Loaded 52429 existing records from primary storage. [2025-10-06T22:45:26.776231] [INFO ] [MAIN ] SWK: Loaded 52429 primary data records. [2025-10-06T22:45:26.910440] [DEBUG] [LOCAL ] SWX: Loaded 31186 existing records from primary storage. [2025-10-06T22:45:26.954269] [INFO ] [MAIN ] SWX: Loaded 31186 primary data records. [2025-10-06T22:45:27.662621] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-06T22:45:27.663719] [INFO ] [MAIN ] SWZ: Generated 1791 derivative records from 6036 primary records. [2025-10-06T22:45:27.664363] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-06T22:45:27.680822] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1791 records). [2025-10-06T22:45:27.681095] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-06T22:45:27.683732] [INFO ] [MAIN ] Derivative Progress: 1720/2037 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 7s. Rate: 150.0 symbols/min [2025-10-06T22:45:27.683964] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:27.701965] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:27.703002] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52429 primary records. [2025-10-06T22:45:27.703448] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-06T22:45:27.731208] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-10-06T22:45:27.736573] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-06T22:45:27.739769] [INFO ] [MAIN ] Derivative Progress: 1721/2037 symbols completed. SWK took 1.2s. Estimated remaining: 2m 6s. Rate: 150.0 symbols/min [2025-10-06T22:45:27.740121] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:27.740515] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:27.741403] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31186 primary records. [2025-10-06T22:45:27.741574] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-06T22:45:27.784156] [DEBUG] [LOCAL ] SXC: Loaded 41383 existing records from primary storage. [2025-10-06T22:45:27.784526] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-10-06T22:45:27.785057] [INFO ] [MAIN ] SXC: Loaded 41383 primary data records. [2025-10-06T22:45:27.784916] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-06T22:45:27.792952] [DEBUG] [LOCAL ] SXI: Loaded 11660 existing records from primary storage. [2025-10-06T22:45:27.792605] [INFO ] [MAIN ] Derivative Progress: 1722/2037 symbols completed. SWX took 1.2s. Estimated remaining: 2m 6s. Rate: 150.1 symbols/min [2025-10-06T22:45:27.805202] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:27.805322] [INFO ] [MAIN ] SXI: Loaded 11660 primary data records. [2025-10-06T22:45:28.315291] [DEBUG] [LOCAL ] SXT: Loaded 29788 existing records from primary storage. [2025-10-06T22:45:28.339990] [INFO ] [MAIN ] SXT: Loaded 29788 primary data records. [2025-10-06T22:45:28.811527] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:28.828681] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41383 primary records. [2025-10-06T22:45:28.829564] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-06T22:45:28.829495] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:28.831131] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11660 primary records. [2025-10-06T22:45:28.831365] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-06T22:45:28.861942] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-10-06T22:45:28.862212] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-06T22:45:28.865415] [INFO ] [MAIN ] Derivative Progress: 1723/2037 symbols completed. SXI took 1.1s. Estimated remaining: 2m 6s. Rate: 150.0 symbols/min [2025-10-06T22:45:28.869698] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-10-06T22:45:28.871500] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-06T22:45:28.874578] [INFO ] [MAIN ] Derivative Progress: 1724/2037 symbols completed. SXC took 1.2s. Estimated remaining: 2m 5s. Rate: 150.1 symbols/min [2025-10-06T22:45:28.887629] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:28.888426] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29788 primary records. [2025-10-06T22:45:28.888502] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-06T22:45:28.904941] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-10-06T22:45:28.905047] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-06T22:45:28.908155] [INFO ] [MAIN ] Derivative Progress: 1725/2037 symbols completed. SXT took 1.1s. Estimated remaining: 2m 5s. Rate: 150.1 symbols/min [2025-10-06T22:45:28.908733] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:28.908831] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:28.909093] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:29.024365] [DEBUG] [LOCAL ] SYF: Loaded 53443 existing records from primary storage. [2025-10-06T22:45:29.025833] [INFO ] [MAIN ] SYF: Loaded 53443 primary data records. [2025-10-06T22:45:29.032123] [DEBUG] [LOCAL ] SYK: Loaded 46889 existing records from primary storage. [2025-10-06T22:45:29.048490] [INFO ] [MAIN ] SYK: Loaded 46889 primary data records. [2025-10-06T22:45:29.059598] [DEBUG] [LOCAL ] SYY: Loaded 53232 existing records from primary storage. [2025-10-06T22:45:29.099021] [INFO ] [MAIN ] SYY: Loaded 53232 primary data records. [2025-10-06T22:45:30.190520] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:30.196228] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53443 primary records. [2025-10-06T22:45:30.196525] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:30.204928] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-06T22:45:30.197241] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 46889 primary records. [2025-10-06T22:45:30.210751] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:30.210845] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-06T22:45:30.211694] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53232 primary records. [2025-10-06T22:45:30.223163] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-06T22:45:30.253660] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-10-06T22:45:30.254020] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-06T22:45:30.257271] [INFO ] [MAIN ] Derivative Progress: 1726/2037 symbols completed. SYF took 1.3s. Estimated remaining: 2m 4s. Rate: 149.9 symbols/min [2025-10-06T22:45:30.257970] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:30.261345] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-10-06T22:45:30.261769] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-06T22:45:30.264678] [INFO ] [MAIN ] Derivative Progress: 1727/2037 symbols completed. SYK took 1.4s. Estimated remaining: 2m 4s. Rate: 150.0 symbols/min [2025-10-06T22:45:30.265391] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:30.266515] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-10-06T22:45:30.266685] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-06T22:45:30.269962] [INFO ] [MAIN ] Derivative Progress: 1728/2037 symbols completed. SYY took 1.4s. Estimated remaining: 2m 4s. Rate: 150.1 symbols/min [2025-10-06T22:45:30.270343] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:30.337371] [DEBUG] [LOCAL ] TAC: Loaded 42564 existing records from primary storage. [2025-10-06T22:45:30.350528] [INFO ] [MAIN ] TAC: Loaded 42564 primary data records. [2025-10-06T22:45:30.385027] [DEBUG] [LOCAL ] TAK: Loaded 49941 existing records from primary storage. [2025-10-06T22:45:30.436713] [INFO ] [MAIN ] TAK: Loaded 49941 primary data records. [2025-10-06T22:45:30.437551] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-06T22:45:30.471001] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-06T22:45:31.389263] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:31.391114] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 49941 primary records. [2025-10-06T22:45:31.390055] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:31.391313] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-06T22:45:31.393934] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 42564 primary records. [2025-10-06T22:45:31.395399] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-06T22:45:31.439776] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:31.438695] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-10-06T22:45:31.444190] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-10-06T22:45:31.441976] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-06T22:45:31.443333] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-10-06T22:45:31.444440] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-06T22:45:31.444581] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-06T22:45:31.446684] [INFO ] [MAIN ] Derivative Progress: 1729/2037 symbols completed. TAC took 1.2s. Estimated remaining: 2m 3s. Rate: 149.9 symbols/min [2025-10-06T22:45:31.446937] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:31.450303] [INFO ] [MAIN ] Derivative Progress: 1730/2037 symbols completed. TAK took 1.2s. Estimated remaining: 2m 3s. Rate: 150.0 symbols/min [2025-10-06T22:45:31.462743] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:31.473126] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-10-06T22:45:31.473474] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-06T22:45:31.476342] [INFO ] [MAIN ] Derivative Progress: 1731/2037 symbols completed. T took 1.2s. Estimated remaining: 2m 2s. Rate: 150.1 symbols/min [2025-10-06T22:45:31.476632] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:31.569420] [DEBUG] [LOCAL ] TALO: Loaded 50811 existing records from primary storage. [2025-10-06T22:45:31.569813] [INFO ] [MAIN ] TALO: Loaded 50811 primary data records. [2025-10-06T22:45:31.571286] [DEBUG] [LOCAL ] TAL: Loaded 51886 existing records from primary storage. [2025-10-06T22:45:31.571831] [INFO ] [MAIN ] TAL: Loaded 51886 primary data records. [2025-10-06T22:45:31.795637] [DEBUG] [LOCAL ] TAP: Loaded 52911 existing records from primary storage. [2025-10-06T22:45:31.811811] [INFO ] [MAIN ] TAP: Loaded 52911 primary data records. [2025-10-06T22:45:32.667977] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:32.682367] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:32.683092] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50811 primary records. [2025-10-06T22:45:32.682092] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 51886 primary records. [2025-10-06T22:45:32.683294] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-06T22:45:32.683231] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-06T22:45:32.718908] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-10-06T22:45:32.717490] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-10-06T22:45:32.719175] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-06T22:45:32.721904] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-06T22:45:32.721812] [INFO ] [MAIN ] Derivative Progress: 1732/2037 symbols completed. TALO took 1.3s. Estimated remaining: 2m 2s. Rate: 149.9 symbols/min [2025-10-06T22:45:32.726670] [INFO ] [MAIN ] Derivative Progress: 1733/2037 symbols completed. TAL took 1.3s. Estimated remaining: 2m 2s. Rate: 150.0 symbols/min [2025-10-06T22:45:32.727774] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:32.726438] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:32.743953] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:32.744892] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52911 primary records. [2025-10-06T22:45:32.745081] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-06T22:45:32.765307] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-10-06T22:45:32.770230] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-06T22:45:32.773723] [INFO ] [MAIN ] Derivative Progress: 1734/2037 symbols completed. TAP took 1.3s. Estimated remaining: 2m 1s. Rate: 150.1 symbols/min [2025-10-06T22:45:32.773988] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:32.770571] [DEBUG] [LOCAL ] TBB: Loaded 11690 existing records from primary storage. [2025-10-06T22:45:32.774392] [INFO ] [MAIN ] TBB: Loaded 11690 primary data records. [2025-10-06T22:45:32.991807] [DEBUG] [LOCAL ] TBBB: Loaded 35724 existing records from primary storage. [2025-10-06T22:45:32.991963] [DEBUG] [LOCAL ] TBI: Loaded 22537 existing records from primary storage. [2025-10-06T22:45:33.018880] [INFO ] [MAIN ] TBBB: Loaded 35724 primary data records. [2025-10-06T22:45:33.018753] [INFO ] [MAIN ] TBI: Loaded 22537 primary data records. [2025-10-06T22:45:33.795385] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:33.796407] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11690 primary records. [2025-10-06T22:45:33.796773] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-06T22:45:33.834076] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-10-06T22:45:33.847862] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:33.847042] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-06T22:45:33.849990] [INFO ] [MAIN ] Derivative Progress: 1735/2037 symbols completed. TBB took 1.1s. Estimated remaining: 2m 1s. Rate: 149.9 symbols/min [2025-10-06T22:45:33.847420] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:33.850949] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35724 primary records. [2025-10-06T22:45:33.851927] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22537 primary records. [2025-10-06T22:45:33.852067] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:33.852199] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-06T22:45:33.852407] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-06T22:45:33.882170] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-10-06T22:45:33.886352] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-10-06T22:45:33.883854] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-06T22:45:33.889302] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-06T22:45:33.889195] [INFO ] [MAIN ] Derivative Progress: 1736/2037 symbols completed. TBBB took 1.2s. Estimated remaining: 2m 0s. Rate: 150.0 symbols/min [2025-10-06T22:45:33.892335] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:33.892608] [INFO ] [MAIN ] Derivative Progress: 1737/2037 symbols completed. TBI took 1.1s. Estimated remaining: 1m 60s. Rate: 150.1 symbols/min [2025-10-06T22:45:33.896210] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:33.896088] [DEBUG] [LOCAL ] TBN: Loaded 3788 existing records from primary storage. [2025-10-06T22:45:33.896579] [INFO ] [MAIN ] TBN: Loaded 3788 primary data records. [2025-10-06T22:45:34.004351] [DEBUG] [LOCAL ] TCBX: Loaded 10223 existing records from primary storage. [2025-10-06T22:45:34.029836] [INFO ] [MAIN ] TCBX: Loaded 10223 primary data records. [2025-10-06T22:45:34.519491] [DEBUG] [LOCAL ] TD: Loaded 52331 existing records from primary storage. [2025-10-06T22:45:34.627244] [INFO ] [MAIN ] TD: Loaded 52331 primary data records. [2025-10-06T22:45:34.960298] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:34.961618] [INFO ] [MAIN ] TBN: Generated 1794 derivative records from 3788 primary records. [2025-10-06T22:45:34.961839] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-06T22:45:34.979578] [DEBUG] [LOCAL ] TBN: Derivative data saved (1794 records). [2025-10-06T22:45:34.979857] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-06T22:45:34.982204] [INFO ] [MAIN ] Derivative Progress: 1738/2037 symbols completed. TBN took 1.1s. Estimated remaining: 1m 60s. Rate: 149.9 symbols/min [2025-10-06T22:45:34.997345] [DEBUG] [MAIN ] TCBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:34.998248] [INFO ] [MAIN ] TCBX: Generated 1794 derivative records from 10223 primary records. [2025-10-06T22:45:34.998482] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-06T22:45:35.015396] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1794 records). [2025-10-06T22:45:35.015605] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-06T22:45:35.018447] [INFO ] [MAIN ] Derivative Progress: 1739/2037 symbols completed. TCBX took 1.1s. Estimated remaining: 1m 59s. Rate: 150.0 symbols/min [2025-10-06T22:45:35.033674] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:35.034332] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52331 primary records. [2025-10-06T22:45:35.034393] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-06T22:45:35.050042] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-10-06T22:45:35.050103] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-06T22:45:35.053045] [INFO ] [MAIN ] Derivative Progress: 1740/2037 symbols completed. TD took 1.2s. Estimated remaining: 1m 59s. Rate: 150.1 symbols/min [2025-10-06T22:45:35.053874] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:35.053740] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:35.054082] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:35.065276] [DEBUG] [LOCAL ] TDF: Loaded 6274 existing records from primary storage. [2025-10-06T22:45:35.065486] [INFO ] [MAIN ] TDF: Loaded 6274 primary data records. [2025-10-06T22:45:35.183570] [DEBUG] [LOCAL ] TDG: Loaded 22087 existing records from primary storage. [2025-10-06T22:45:35.233940] [INFO ] [MAIN ] TDG: Loaded 22087 primary data records. [2025-10-06T22:45:35.498193] [DEBUG] [LOCAL ] TDC: Loaded 46567 existing records from primary storage. [2025-10-06T22:45:35.512846] [INFO ] [MAIN ] TDC: Loaded 46567 primary data records. [2025-10-06T22:45:36.068808] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:36.070340] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6274 primary records. [2025-10-06T22:45:36.071447] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-06T22:45:36.091373] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-10-06T22:45:36.099445] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-06T22:45:36.108957] [INFO ] [MAIN ] Derivative Progress: 1741/2037 symbols completed. TDF took 1.1s. Estimated remaining: 1m 58s. Rate: 150.0 symbols/min [2025-10-06T22:45:36.110101] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:36.109901] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:36.111880] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22087 primary records. [2025-10-06T22:45:36.124241] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-06T22:45:36.124858] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:36.126497] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46567 primary records. [2025-10-06T22:45:36.137911] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-06T22:45:36.142234] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-10-06T22:45:36.142667] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-06T22:45:36.145522] [INFO ] [MAIN ] Derivative Progress: 1742/2037 symbols completed. TDG took 1.1s. Estimated remaining: 1m 58s. Rate: 150.0 symbols/min [2025-10-06T22:45:36.145721] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:36.163267] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-10-06T22:45:36.163538] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-06T22:45:36.167562] [INFO ] [MAIN ] Derivative Progress: 1743/2037 symbols completed. TDC took 1.1s. Estimated remaining: 1m 58s. Rate: 150.1 symbols/min [2025-10-06T22:45:36.167938] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:36.238286] [DEBUG] [LOCAL ] TDOC: Loaded 53348 existing records from primary storage. [2025-10-06T22:45:36.249896] [DEBUG] [LOCAL ] TDS: Loaded 42760 existing records from primary storage. [2025-10-06T22:45:36.250333] [INFO ] [MAIN ] TDS: Loaded 42760 primary data records. [2025-10-06T22:45:36.250563] [INFO ] [MAIN ] TDOC: Loaded 53348 primary data records. [2025-10-06T22:45:36.465070] [DEBUG] [LOCAL ] TDW: Loaded 45112 existing records from primary storage. [2025-10-06T22:45:36.545516] [INFO ] [MAIN ] TDW: Loaded 45112 primary data records. [2025-10-06T22:45:37.306053] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:37.307532] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42760 primary records. [2025-10-06T22:45:37.307746] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-06T22:45:37.327734] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-10-06T22:45:37.336603] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-06T22:45:37.344456] [INFO ] [MAIN ] Derivative Progress: 1744/2037 symbols completed. TDS took 1.2s. Estimated remaining: 1m 57s. Rate: 150.0 symbols/min [2025-10-06T22:45:37.341998] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:37.345085] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:37.346219] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53348 primary records. [2025-10-06T22:45:37.346984] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-06T22:45:37.367635] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-10-06T22:45:37.367795] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-06T22:45:37.373369] [INFO ] [MAIN ] Derivative Progress: 1745/2037 symbols completed. TDOC took 1.3s. Estimated remaining: 1m 57s. Rate: 150.0 symbols/min [2025-10-06T22:45:37.373683] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:37.393932] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:37.394880] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45112 primary records. [2025-10-06T22:45:37.395030] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-06T22:45:37.418946] [DEBUG] [LOCAL ] TDY: Loaded 22512 existing records from primary storage. [2025-10-06T22:45:37.424122] [INFO ] [MAIN ] TDY: Loaded 22512 primary data records. [2025-10-06T22:45:37.424359] [DEBUG] [LOCAL ] TEAF: Loaded 7509 existing records from primary storage. [2025-10-06T22:45:37.436783] [INFO ] [MAIN ] TEAF: Loaded 7509 primary data records. [2025-10-06T22:45:37.501732] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-10-06T22:45:37.540140] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-06T22:45:37.560192] [INFO ] [MAIN ] Derivative Progress: 1746/2037 symbols completed. TDW took 1.4s. Estimated remaining: 1m 56s. Rate: 150.1 symbols/min [2025-10-06T22:45:37.623938] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:38.091894] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:38.092893] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22512 primary records. [2025-10-06T22:45:38.092999] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-06T22:45:38.094077] [DEBUG] [LOCAL ] TECK: Loaded 53440 existing records from primary storage. [2025-10-06T22:45:38.117984] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:38.117569] [INFO ] [MAIN ] TECK: Loaded 53440 primary data records. [2025-10-06T22:45:38.119140] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7509 primary records. [2025-10-06T22:45:38.121949] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-06T22:45:38.248272] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-10-06T22:45:38.253804] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-06T22:45:38.257217] [INFO ] [MAIN ] Derivative Progress: 1747/2037 symbols completed. TEAF took 0.9s. Estimated remaining: 1m 56s. Rate: 150.0 symbols/min [2025-10-06T22:45:38.263170] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:38.291845] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-10-06T22:45:38.349049] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-06T22:45:38.528941] [INFO ] [MAIN ] Derivative Progress: 1748/2037 symbols completed. TDY took 1.2s. Estimated remaining: 1m 56s. Rate: 150.0 symbols/min [2025-10-06T22:45:38.543386] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:38.583791] [DEBUG] [LOCAL ] TEF: Loaded 37269 existing records from primary storage. [2025-10-06T22:45:38.584240] [INFO ] [MAIN ] TEF: Loaded 37269 primary data records. [2025-10-06T22:45:38.672527] [DEBUG] [LOCAL ] TEI: Loaded 21220 existing records from primary storage. [2025-10-06T22:45:38.685012] [INFO ] [MAIN ] TEI: Loaded 21220 primary data records. [2025-10-06T22:45:38.838509] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:38.909793] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53440 primary records. [2025-10-06T22:45:38.909944] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-06T22:45:39.256037] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-10-06T22:45:39.256816] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-06T22:45:39.259265] [INFO ] [MAIN ] Derivative Progress: 1749/2037 symbols completed. TECK took 1.6s. Estimated remaining: 1m 55s. Rate: 150.0 symbols/min [2025-10-06T22:45:39.259443] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:39.288945] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:39.290790] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37269 primary records. [2025-10-06T22:45:39.292974] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-06T22:45:39.319321] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:39.321904] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 21220 primary records. [2025-10-06T22:45:39.322037] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-06T22:45:39.350496] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-10-06T22:45:39.351399] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-06T22:45:39.354230] [INFO ] [MAIN ] Derivative Progress: 1750/2037 symbols completed. TEF took 1.1s. Estimated remaining: 1m 55s. Rate: 150.0 symbols/min [2025-10-06T22:45:39.354780] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:39.361847] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-10-06T22:45:39.362119] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-06T22:45:39.365912] [INFO ] [MAIN ] Derivative Progress: 1751/2037 symbols completed. TEI took 0.8s. Estimated remaining: 1m 54s. Rate: 150.1 symbols/min [2025-10-06T22:45:39.366409] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:39.383889] [DEBUG] [LOCAL ] TEL: Loaded 51119 existing records from primary storage. [2025-10-06T22:45:39.384118] [INFO ] [MAIN ] TEL: Loaded 51119 primary data records. [2025-10-06T22:45:39.521208] [DEBUG] [LOCAL ] TEN: Loaded 30442 existing records from primary storage. [2025-10-06T22:45:39.543540] [INFO ] [MAIN ] TEN: Loaded 30442 primary data records. [2025-10-06T22:45:39.562447] [DEBUG] [LOCAL ] TEO: Loaded 22228 existing records from primary storage. [2025-10-06T22:45:39.576245] [INFO ] [MAIN ] TEO: Loaded 22228 primary data records. [2025-10-06T22:45:40.395790] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:40.396891] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51119 primary records. [2025-10-06T22:45:40.397218] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-06T22:45:40.426903] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:40.428765] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 22228 primary records. [2025-10-06T22:45:40.429736] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-06T22:45:40.443983] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-10-06T22:45:40.447399] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-06T22:45:40.449794] [INFO ] [MAIN ] Derivative Progress: 1752/2037 symbols completed. TEL took 1.2s. Estimated remaining: 1m 54s. Rate: 150.0 symbols/min [2025-10-06T22:45:40.450131] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:40.466867] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-10-06T22:45:40.466984] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-06T22:45:40.466784] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:40.470123] [INFO ] [MAIN ] Derivative Progress: 1753/2037 symbols completed. TEO took 1.1s. Estimated remaining: 1m 54s. Rate: 150.1 symbols/min [2025-10-06T22:45:40.471195] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 30442 primary records. [2025-10-06T22:45:40.471367] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-06T22:45:40.487120] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-10-06T22:45:40.487213] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-06T22:45:40.489972] [INFO ] [MAIN ] Derivative Progress: 1754/2037 symbols completed. TEN took 1.1s. Estimated remaining: 1m 53s. Rate: 150.1 symbols/min [2025-10-06T22:45:40.537152] [DEBUG] [LOCAL ] TEVA: Loaded 53633 existing records from primary storage. [2025-10-06T22:45:40.537307] [INFO ] [MAIN ] TEVA: Loaded 53633 primary data records. [2025-10-06T22:45:40.874158] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:40.874841] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53633 primary records. [2025-10-06T22:45:40.874946] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-06T22:45:40.890683] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-10-06T22:45:40.890742] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-06T22:45:40.893115] [INFO ] [MAIN ] Derivative Progress: 1755/2037 symbols completed. TEVA took 0.4s. Estimated remaining: 1m 53s. Rate: 150.1 symbols/min [2025-10-06T22:45:40.893924] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:40.894128] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:40.894044] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:40.942322] [DEBUG] [LOCAL ] TFII: Loaded 33524 existing records from primary storage. [2025-10-06T22:45:40.942639] [INFO ] [MAIN ] TFII: Loaded 33524 primary data records. [2025-10-06T22:45:41.141003] [DEBUG] [LOCAL ] TEX: Loaded 44084 existing records from primary storage. [2025-10-06T22:45:41.164105] [INFO ] [MAIN ] TEX: Loaded 44084 primary data records. [2025-10-06T22:45:41.269512] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-06T22:45:41.298589] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-10-06T22:45:41.901235] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:41.902266] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 33524 primary records. [2025-10-06T22:45:41.906131] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-06T22:45:41.931967] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:41.933954] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 44084 primary records. [2025-10-06T22:45:41.934215] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-06T22:45:41.953093] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-10-06T22:45:41.953636] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-06T22:45:41.957442] [INFO ] [MAIN ] Derivative Progress: 1756/2037 symbols completed. TEX took 1.1s. Estimated remaining: 1m 52s. Rate: 150.0 symbols/min [2025-10-06T22:45:41.958126] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:41.958280] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-10-06T22:45:41.959415] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-06T22:45:41.961731] [INFO ] [MAIN ] Derivative Progress: 1757/2037 symbols completed. TFII took 1.1s. Estimated remaining: 1m 52s. Rate: 150.1 symbols/min [2025-10-06T22:45:41.963252] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:41.977829] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:41.978632] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-10-06T22:45:41.978894] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-06T22:45:42.010498] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-10-06T22:45:42.010745] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-06T22:45:42.014117] [INFO ] [MAIN ] Derivative Progress: 1758/2037 symbols completed. TFC took 1.1s. Estimated remaining: 1m 51s. Rate: 150.2 symbols/min [2025-10-06T22:45:42.011278] [DEBUG] [LOCAL ] TFIN: Loaded 23423 existing records from primary storage. [2025-10-06T22:45:42.014486] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:42.014752] [INFO ] [MAIN ] TFIN: Loaded 23423 primary data records. [2025-10-06T22:45:42.178412] [DEBUG] [LOCAL ] TFPM: Loaded 38273 existing records from primary storage. [2025-10-06T22:45:42.195842] [INFO ] [MAIN ] TFPM: Loaded 38273 primary data records. [2025-10-06T22:45:42.531713] [DEBUG] [LOCAL ] TFX: Loaded 36998 existing records from primary storage. [2025-10-06T22:45:42.534475] [INFO ] [MAIN ] TFX: Loaded 36998 primary data records. [2025-10-06T22:45:43.046476] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:43.048501] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23423 primary records. [2025-10-06T22:45:43.049708] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-06T22:45:43.069424] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-10-06T22:45:43.070666] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-06T22:45:43.074213] [INFO ] [MAIN ] Derivative Progress: 1759/2037 symbols completed. TFIN took 1.1s. Estimated remaining: 1m 51s. Rate: 150.0 symbols/min [2025-10-06T22:45:43.076858] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:43.092681] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:43.093559] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 38273 primary records. [2025-10-06T22:45:43.093767] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-06T22:45:43.116296] [DEBUG] [LOCAL ] TG: Loaded 10390 existing records from primary storage. [2025-10-06T22:45:43.118463] [INFO ] [MAIN ] TG: Loaded 10390 primary data records. [2025-10-06T22:45:43.172599] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-10-06T22:45:43.172918] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:43.194102] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 36998 primary records. [2025-10-06T22:45:43.203486] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-06T22:45:43.203426] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-06T22:45:43.212259] [INFO ] [MAIN ] Derivative Progress: 1760/2037 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 51s. Rate: 150.1 symbols/min [2025-10-06T22:45:43.227385] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:43.357512] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-10-06T22:45:43.473029] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-06T22:45:43.476348] [INFO ] [MAIN ] Derivative Progress: 1761/2037 symbols completed. TFX took 1.5s. Estimated remaining: 1m 50s. Rate: 150.1 symbols/min [2025-10-06T22:45:43.476852] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:43.491017] [DEBUG] [LOCAL ] TGLS: Loaded 27798 existing records from primary storage. [2025-10-06T22:45:43.491380] [INFO ] [MAIN ] TGLS: Loaded 27798 primary data records. [2025-10-06T22:45:43.854042] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:43.855324] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10390 primary records. [2025-10-06T22:45:43.856973] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-06T22:45:43.856882] [DEBUG] [LOCAL ] TGNA: Loaded 48647 existing records from primary storage. [2025-10-06T22:45:43.858225] [INFO ] [MAIN ] TGNA: Loaded 48647 primary data records. [2025-10-06T22:45:43.975113] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-10-06T22:45:43.980783] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-06T22:45:43.983466] [INFO ] [MAIN ] Derivative Progress: 1762/2037 symbols completed. TG took 0.9s. Estimated remaining: 1m 50s. Rate: 150.1 symbols/min [2025-10-06T22:45:43.988916] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:44.281839] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:44.282957] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 27798 primary records. [2025-10-06T22:45:44.283761] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-06T22:45:44.311558] [DEBUG] [LOCAL ] TGS: Loaded 32864 existing records from primary storage. [2025-10-06T22:45:44.312362] [INFO ] [MAIN ] TGS: Loaded 32864 primary data records. [2025-10-06T22:45:44.392254] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-10-06T22:45:44.393266] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-06T22:45:44.415766] [INFO ] [MAIN ] Derivative Progress: 1763/2037 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 50s. Rate: 150.1 symbols/min [2025-10-06T22:45:44.435004] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:44.705815] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:44.707829] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48647 primary records. [2025-10-06T22:45:44.708822] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-06T22:45:44.728218] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-10-06T22:45:44.742201] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-06T22:45:44.745001] [INFO ] [MAIN ] Derivative Progress: 1764/2037 symbols completed. TGNA took 1.3s. Estimated remaining: 1m 49s. Rate: 150.1 symbols/min [2025-10-06T22:45:44.745907] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:44.764750] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:44.765634] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 32864 primary records. [2025-10-06T22:45:44.765786] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-06T22:45:44.796691] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-10-06T22:45:44.798276] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-06T22:45:44.798185] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-06T22:45:44.801323] [INFO ] [MAIN ] Derivative Progress: 1765/2037 symbols completed. TGS took 0.8s. Estimated remaining: 1m 49s. Rate: 150.2 symbols/min [2025-10-06T22:45:44.801607] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-10-06T22:45:44.801717] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:45.129020] [DEBUG] [LOCAL ] THG: Loaded 21672 existing records from primary storage. [2025-10-06T22:45:45.135689] [INFO ] [MAIN ] THG: Loaded 21672 primary data records. [2025-10-06T22:45:45.135561] [DEBUG] [LOCAL ] THC: Loaded 47514 existing records from primary storage. [2025-10-06T22:45:45.145479] [INFO ] [MAIN ] THC: Loaded 47514 primary data records. [2025-10-06T22:45:45.767706] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:45.770150] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-10-06T22:45:45.770696] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-06T22:45:45.793001] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-10-06T22:45:45.806392] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:45.806464] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-06T22:45:45.807250] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21672 primary records. [2025-10-06T22:45:45.810234] [INFO ] [MAIN ] Derivative Progress: 1766/2037 symbols completed. TGT took 1.4s. Estimated remaining: 1m 48s. Rate: 150.0 symbols/min [2025-10-06T22:45:45.810624] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:45.807433] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-06T22:45:45.830089] [DEBUG] [LOCAL ] THIR: Loaded 2258 existing records from primary storage. [2025-10-06T22:45:45.831048] [INFO ] [MAIN ] THIR: Loaded 2258 primary data records. [2025-10-06T22:45:45.879490] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-10-06T22:45:45.884734] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-06T22:45:45.879103] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:45.906415] [INFO ] [MAIN ] Derivative Progress: 1767/2037 symbols completed. THG took 1.1s. Estimated remaining: 1m 48s. Rate: 150.1 symbols/min [2025-10-06T22:45:45.920510] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:45.933192] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 47514 primary records. [2025-10-06T22:45:45.956059] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-06T22:45:46.023768] [DEBUG] [LOCAL ] THLV: Loaded 1539 existing records from primary storage. [2025-10-06T22:45:46.153941] [INFO ] [MAIN ] THLV: Loaded 1539 primary data records. [2025-10-06T22:45:46.213386] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-10-06T22:45:46.247947] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-06T22:45:46.267743] [INFO ] [MAIN ] Derivative Progress: 1768/2037 symbols completed. THC took 1.5s. Estimated remaining: 1m 48s. Rate: 150.1 symbols/min [2025-10-06T22:45:46.538184] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-06T22:45:46.539148] [INFO ] [MAIN ] THIR: Generated 1792 derivative records from 2258 primary records. [2025-10-06T22:45:46.540038] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-06T22:45:46.556756] [DEBUG] [LOCAL ] THIR: Derivative data saved (1792 records). [2025-10-06T22:45:46.556990] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-06T22:45:46.559892] [INFO ] [MAIN ] Derivative Progress: 1769/2037 symbols completed. THIR took 0.7s. Estimated remaining: 1m 47s. Rate: 150.1 symbols/min [2025-10-06T22:45:46.575335] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:45:46.575942] [INFO ] [MAIN ] THLV: Generated 1793 derivative records from 1539 primary records. [2025-10-06T22:45:46.576004] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-06T22:45:46.589018] [DEBUG] [LOCAL ] THLV: Derivative data saved (1793 records). [2025-10-06T22:45:46.589077] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-06T22:45:46.591635] [INFO ] [MAIN ] Derivative Progress: 1770/2037 symbols completed. THLV took 0.7s. Estimated remaining: 1m 47s. Rate: 150.2 symbols/min [2025-10-06T22:45:46.592177] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:46.592734] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:46.592112] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:46.616049] [DEBUG] [LOCAL ] THR: Loaded 19831 existing records from primary storage. [2025-10-06T22:45:46.616210] [INFO ] [MAIN ] THR: Loaded 19831 primary data records. [2025-10-06T22:45:46.765710] [DEBUG] [LOCAL ] THQ: Loaded 25145 existing records from primary storage. [2025-10-06T22:45:46.828277] [INFO ] [MAIN ] THQ: Loaded 25145 primary data records. [2025-10-06T22:45:46.935415] [DEBUG] [LOCAL ] THO: Loaded 41813 existing records from primary storage. [2025-10-06T22:45:46.960894] [INFO ] [MAIN ] THO: Loaded 41813 primary data records. [2025-10-06T22:45:47.607774] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:47.610482] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19831 primary records. [2025-10-06T22:45:47.610966] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-06T22:45:47.631213] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-10-06T22:45:47.631636] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-06T22:45:47.635255] [INFO ] [MAIN ] Derivative Progress: 1771/2037 symbols completed. THR took 1.0s. Estimated remaining: 1m 46s. Rate: 150.1 symbols/min [2025-10-06T22:45:47.635575] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:47.658394] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:47.661545] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 25145 primary records. [2025-10-06T22:45:47.661807] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-06T22:45:47.687330] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:47.691732] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 41813 primary records. [2025-10-06T22:45:47.692379] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-06T22:45:47.729231] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-10-06T22:45:47.729417] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-10-06T22:45:47.729744] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-06T22:45:47.732573] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-06T22:45:47.732469] [INFO ] [MAIN ] Derivative Progress: 1772/2037 symbols completed. THQ took 1.1s. Estimated remaining: 1m 46s. Rate: 150.1 symbols/min [2025-10-06T22:45:47.736080] [INFO ] [MAIN ] Derivative Progress: 1773/2037 symbols completed. THO took 1.1s. Estimated remaining: 1m 45s. Rate: 150.2 symbols/min [2025-10-06T22:45:47.736415] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:47.735990] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:47.751165] [DEBUG] [LOCAL ] THS: Loaded 38439 existing records from primary storage. [2025-10-06T22:45:47.752335] [INFO ] [MAIN ] THS: Loaded 38439 primary data records. [2025-10-06T22:45:47.922755] [DEBUG] [LOCAL ] THW: Loaded 19586 existing records from primary storage. [2025-10-06T22:45:47.928162] [INFO ] [MAIN ] THW: Loaded 19586 primary data records. [2025-10-06T22:45:48.231403] [DEBUG] [LOCAL ] TIMB: Loaded 35773 existing records from primary storage. [2025-10-06T22:45:48.243737] [INFO ] [MAIN ] TIMB: Loaded 35773 primary data records. [2025-10-06T22:45:48.837314] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:48.839727] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38439 primary records. [2025-10-06T22:45:48.840203] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-06T22:45:48.875277] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:48.877382] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19586 primary records. [2025-10-06T22:45:48.877819] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-06T22:45:48.878305] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-10-06T22:45:48.878905] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-06T22:45:48.881513] [INFO ] [MAIN ] Derivative Progress: 1774/2037 symbols completed. THS took 1.2s. Estimated remaining: 1m 45s. Rate: 150.1 symbols/min [2025-10-06T22:45:48.881838] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:48.905499] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-10-06T22:45:48.924058] [DEBUG] [LOCAL ] TISI: Loaded 3590 existing records from primary storage. [2025-10-06T22:45:48.923864] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-06T22:45:48.924561] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:48.928109] [INFO ] [MAIN ] TISI: Loaded 3590 primary data records. [2025-10-06T22:45:48.927904] [INFO ] [MAIN ] Derivative Progress: 1775/2037 symbols completed. THW took 1.2s. Estimated remaining: 1m 45s. Rate: 150.1 symbols/min [2025-10-06T22:45:48.929417] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 35773 primary records. [2025-10-06T22:45:48.934961] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:48.941743] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-06T22:45:49.053915] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-10-06T22:45:49.060020] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-06T22:45:49.079778] [INFO ] [MAIN ] Derivative Progress: 1776/2037 symbols completed. TIMB took 1.3s. Estimated remaining: 1m 44s. Rate: 150.2 symbols/min [2025-10-06T22:45:49.119810] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:49.284285] [DEBUG] [LOCAL ] TIXT: Loaded 31721 existing records from primary storage. [2025-10-06T22:45:49.284988] [INFO ] [MAIN ] TIXT: Loaded 31721 primary data records. [2025-10-06T22:45:49.643872] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:49.647198] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3590 primary records. [2025-10-06T22:45:49.645158] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-06T22:45:49.647317] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-06T22:45:49.647596] [INFO ] [MAIN ] TJX: Loaded 53668 primary data records. [2025-10-06T22:45:49.672484] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-10-06T22:45:49.677909] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-06T22:45:49.690058] [INFO ] [MAIN ] Derivative Progress: 1777/2037 symbols completed. TISI took 0.8s. Estimated remaining: 1m 44s. Rate: 150.1 symbols/min [2025-10-06T22:45:49.701578] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:49.890899] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:50.028286] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 31721 primary records. [2025-10-06T22:45:50.050275] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-06T22:45:50.052020] [DEBUG] [LOCAL ] TK: Loaded 39303 existing records from primary storage. [2025-10-06T22:45:50.059466] [INFO ] [MAIN ] TK: Loaded 39303 primary data records. [2025-10-06T22:45:50.126299] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-10-06T22:45:50.152970] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-06T22:45:50.167614] [INFO ] [MAIN ] Derivative Progress: 1778/2037 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 44s. Rate: 150.1 symbols/min [2025-10-06T22:45:50.178904] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:50.429099] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:50.431353] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53668 primary records. [2025-10-06T22:45:50.431488] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-06T22:45:50.433046] [DEBUG] [LOCAL ] TKC: Loaded 39044 existing records from primary storage. [2025-10-06T22:45:50.441129] [INFO ] [MAIN ] TKC: Loaded 39044 primary data records. [2025-10-06T22:45:50.587581] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-10-06T22:45:50.641166] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-06T22:45:50.652222] [INFO ] [MAIN ] Derivative Progress: 1779/2037 symbols completed. TJX took 1.5s. Estimated remaining: 1m 43s. Rate: 150.1 symbols/min [2025-10-06T22:45:50.657908] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:50.658422] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:50.774266] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39303 primary records. [2025-10-06T22:45:50.815742] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-06T22:45:50.850111] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-10-06T22:45:50.850675] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-06T22:45:50.853564] [INFO ] [MAIN ] Derivative Progress: 1780/2037 symbols completed. TK took 1.2s. Estimated remaining: 1m 43s. Rate: 150.1 symbols/min [2025-10-06T22:45:50.853844] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:50.888778] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:50.889543] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 39044 primary records. [2025-10-06T22:45:50.889793] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-06T22:45:50.914685] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-10-06T22:45:50.914908] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-06T22:45:50.917804] [INFO ] [MAIN ] Derivative Progress: 1781/2037 symbols completed. TKC took 0.7s. Estimated remaining: 1m 42s. Rate: 150.2 symbols/min [2025-10-06T22:45:50.930857] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:50.949521] [DEBUG] [LOCAL ] TKR: Loaded 39996 existing records from primary storage. [2025-10-06T22:45:50.949723] [INFO ] [MAIN ] TKR: Loaded 39996 primary data records. [2025-10-06T22:45:51.012026] [DEBUG] [LOCAL ] TKO: Loaded 43958 existing records from primary storage. [2025-10-06T22:45:51.021290] [INFO ] [MAIN ] TKO: Loaded 43958 primary data records. [2025-10-06T22:45:51.607675] [DEBUG] [LOCAL ] TLK: Loaded 38913 existing records from primary storage. [2025-10-06T22:45:51.629401] [INFO ] [MAIN ] TLK: Loaded 38913 primary data records. [2025-10-06T22:45:52.013575] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:52.023393] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 43958 primary records. [2025-10-06T22:45:52.023777] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-06T22:45:52.029932] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:52.030857] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 39996 primary records. [2025-10-06T22:45:52.038312] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-06T22:45:52.068913] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-10-06T22:45:52.069842] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-06T22:45:52.073122] [INFO ] [MAIN ] Derivative Progress: 1782/2037 symbols completed. TKO took 1.4s. Estimated remaining: 1m 42s. Rate: 150.1 symbols/min [2025-10-06T22:45:52.073776] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:52.074399] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-10-06T22:45:52.076530] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-06T22:45:52.080472] [INFO ] [MAIN ] Derivative Progress: 1783/2037 symbols completed. TKR took 1.2s. Estimated remaining: 1m 42s. Rate: 150.1 symbols/min [2025-10-06T22:45:52.095692] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:52.096515] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 38913 primary records. [2025-10-06T22:45:52.096576] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-06T22:45:52.123685] [DEBUG] [LOCAL ] TLYS: Loaded 16492 existing records from primary storage. [2025-10-06T22:45:52.123301] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-10-06T22:45:52.124031] [INFO ] [MAIN ] TLYS: Loaded 16492 primary data records. [2025-10-06T22:45:52.124123] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-06T22:45:52.127408] [INFO ] [MAIN ] Derivative Progress: 1784/2037 symbols completed. TLK took 1.2s. Estimated remaining: 1m 41s. Rate: 150.2 symbols/min [2025-10-06T22:45:52.458411] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:52.459196] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16492 primary records. [2025-10-06T22:45:52.459262] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-06T22:45:52.480113] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-10-06T22:45:52.480286] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-06T22:45:52.482934] [INFO ] [MAIN ] Derivative Progress: 1785/2037 symbols completed. TLYS took 0.4s. Estimated remaining: 1m 41s. Rate: 150.2 symbols/min [2025-10-06T22:45:52.483865] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:52.483753] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:52.483982] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:52.565124] [DEBUG] [LOCAL ] TMHC: Loaded 45310 existing records from primary storage. [2025-10-06T22:45:52.566762] [INFO ] [MAIN ] TMHC: Loaded 45310 primary data records. [2025-10-06T22:45:52.645713] [DEBUG] [LOCAL ] TM: Loaded 36326 existing records from primary storage. [2025-10-06T22:45:52.647077] [INFO ] [MAIN ] TM: Loaded 36326 primary data records. [2025-10-06T22:45:52.646909] [DEBUG] [LOCAL ] TME: Loaded 53181 existing records from primary storage. [2025-10-06T22:45:52.664939] [INFO ] [MAIN ] TME: Loaded 53181 primary data records. [2025-10-06T22:45:53.613213] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:53.614604] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45310 primary records. [2025-10-06T22:45:53.614859] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-06T22:45:53.658024] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:53.665404] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53181 primary records. [2025-10-06T22:45:53.665519] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-06T22:45:53.664510] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-10-06T22:45:53.665991] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:53.667766] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36326 primary records. [2025-10-06T22:45:53.666938] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-06T22:45:53.675414] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-06T22:45:53.681537] [INFO ] [MAIN ] Derivative Progress: 1786/2037 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 40s. Rate: 150.1 symbols/min [2025-10-06T22:45:53.684370] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:53.704463] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-10-06T22:45:53.704834] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-06T22:45:53.708988] [INFO ] [MAIN ] Derivative Progress: 1787/2037 symbols completed. TME took 1.2s. Estimated remaining: 1m 40s. Rate: 150.1 symbols/min [2025-10-06T22:45:53.705773] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-10-06T22:45:53.709469] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:53.709355] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-06T22:45:53.712855] [INFO ] [MAIN ] Derivative Progress: 1788/2037 symbols completed. TM took 1.2s. Estimated remaining: 1m 39s. Rate: 150.2 symbols/min [2025-10-06T22:45:53.713163] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:53.733147] [DEBUG] [LOCAL ] TNC: Loaded 14740 existing records from primary storage. [2025-10-06T22:45:53.733292] [INFO ] [MAIN ] TNC: Loaded 14740 primary data records. [2025-10-06T22:45:53.910990] [DEBUG] [LOCAL ] TNET: Loaded 28367 existing records from primary storage. [2025-10-06T22:45:53.949879] [INFO ] [MAIN ] TNET: Loaded 28367 primary data records. [2025-10-06T22:45:53.961106] [DEBUG] [LOCAL ] TMO: Loaded 52412 existing records from primary storage. [2025-10-06T22:45:54.005246] [INFO ] [MAIN ] TMO: Loaded 52412 primary data records. [2025-10-06T22:45:54.740286] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:54.742761] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 14740 primary records. [2025-10-06T22:45:54.743260] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-06T22:45:54.764804] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-10-06T22:45:54.765369] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-06T22:45:54.769603] [INFO ] [MAIN ] Derivative Progress: 1789/2037 symbols completed. TNC took 1.1s. Estimated remaining: 1m 39s. Rate: 150.1 symbols/min [2025-10-06T22:45:54.770851] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:54.787934] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:54.789786] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52412 primary records. [2025-10-06T22:45:54.790127] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-06T22:45:54.804879] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:54.813211] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28367 primary records. [2025-10-06T22:45:54.814630] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-06T22:45:54.835597] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-10-06T22:45:54.836326] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-06T22:45:54.840317] [INFO ] [MAIN ] Derivative Progress: 1790/2037 symbols completed. TMO took 1.2s. Estimated remaining: 1m 39s. Rate: 150.1 symbols/min [2025-10-06T22:45:54.850568] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:54.854153] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-10-06T22:45:54.854977] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-06T22:45:54.858549] [INFO ] [MAIN ] Derivative Progress: 1791/2037 symbols completed. TNET took 1.1s. Estimated remaining: 1m 38s. Rate: 150.2 symbols/min [2025-10-06T22:45:54.869548] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:54.870834] [DEBUG] [LOCAL ] TNK: Loaded 35140 existing records from primary storage. [2025-10-06T22:45:54.871076] [INFO ] [MAIN ] TNK: Loaded 35140 primary data records. [2025-10-06T22:45:55.243413] [DEBUG] [LOCAL ] TNL: Loaded 41732 existing records from primary storage. [2025-10-06T22:45:55.243735] [INFO ] [MAIN ] TNL: Loaded 41732 primary data records. [2025-10-06T22:45:55.365242] [DEBUG] [LOCAL ] TOL: Loaded 50761 existing records from primary storage. [2025-10-06T22:45:55.371860] [INFO ] [MAIN ] TOL: Loaded 50761 primary data records. [2025-10-06T22:45:55.889842] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:55.891892] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35140 primary records. [2025-10-06T22:45:55.892515] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-06T22:45:55.916238] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-10-06T22:45:55.924614] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-06T22:45:55.932392] [INFO ] [MAIN ] Derivative Progress: 1792/2037 symbols completed. TNK took 1.2s. Estimated remaining: 1m 38s. Rate: 150.1 symbols/min [2025-10-06T22:45:55.932792] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:55.934857] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41732 primary records. [2025-10-06T22:45:55.933200] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:55.936291] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-06T22:45:55.959958] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:55.963396] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 50761 primary records. [2025-10-06T22:45:55.963771] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-06T22:45:55.982921] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-10-06T22:45:55.984013] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-10-06T22:45:55.984177] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-06T22:45:55.984237] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-06T22:45:55.987170] [INFO ] [MAIN ] Derivative Progress: 1793/2037 symbols completed. TOL took 1.1s. Estimated remaining: 1m 37s. Rate: 150.2 symbols/min [2025-10-06T22:45:55.989962] [INFO ] [MAIN ] Derivative Progress: 1794/2037 symbols completed. TNL took 1.1s. Estimated remaining: 1m 37s. Rate: 150.2 symbols/min [2025-10-06T22:45:55.990172] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:55.989822] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:56.048567] [DEBUG] [LOCAL ] TPB: Loaded 25415 existing records from primary storage. [2025-10-06T22:45:56.050311] [INFO ] [MAIN ] TPB: Loaded 25415 primary data records. [2025-10-06T22:45:56.080820] [DEBUG] [LOCAL ] TOST: Loaded 53682 existing records from primary storage. [2025-10-06T22:45:56.123974] [INFO ] [MAIN ] TOST: Loaded 53682 primary data records. [2025-10-06T22:45:56.249487] [DEBUG] [LOCAL ] TPC: Loaded 38891 existing records from primary storage. [2025-10-06T22:45:56.293586] [INFO ] [MAIN ] TPC: Loaded 38891 primary data records. [2025-10-06T22:45:57.109777] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:57.110418] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:57.111609] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53682 primary records. [2025-10-06T22:45:57.111906] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-06T22:45:57.112922] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 25415 primary records. [2025-10-06T22:45:57.113958] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-06T22:45:57.161403] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:57.162456] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-10-06T22:45:57.164409] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-06T22:45:57.163976] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 38891 primary records. [2025-10-06T22:45:57.164840] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-06T22:45:57.169155] [INFO ] [MAIN ] Derivative Progress: 1795/2037 symbols completed. TOST took 1.2s. Estimated remaining: 1m 37s. Rate: 150.1 symbols/min [2025-10-06T22:45:57.169552] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-10-06T22:45:57.169915] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-06T22:45:57.169738] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:57.172159] [INFO ] [MAIN ] Derivative Progress: 1796/2037 symbols completed. TPB took 1.2s. Estimated remaining: 1m 36s. Rate: 150.2 symbols/min [2025-10-06T22:45:57.172955] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:57.201093] [DEBUG] [LOCAL ] TPL: Loaded 12376 existing records from primary storage. [2025-10-06T22:45:57.201936] [INFO ] [MAIN ] TPL: Loaded 12376 primary data records. [2025-10-06T22:45:57.233562] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-10-06T22:45:57.258529] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-06T22:45:57.283291] [INFO ] [MAIN ] Derivative Progress: 1797/2037 symbols completed. TPC took 1.3s. Estimated remaining: 1m 36s. Rate: 150.2 symbols/min [2025-10-06T22:45:57.310361] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:57.536976] [DEBUG] [LOCAL ] TPH: Loaded 44873 existing records from primary storage. [2025-10-06T22:45:57.537682] [INFO ] [MAIN ] TPH: Loaded 44873 primary data records. [2025-10-06T22:45:57.884510] [DEBUG] [LOCAL ] TPR: Loaded 53453 existing records from primary storage. [2025-10-06T22:45:57.884879] [INFO ] [MAIN ] TPR: Loaded 53453 primary data records. [2025-10-06T22:45:58.091169] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:58.206154] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12376 primary records. [2025-10-06T22:45:58.206450] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-06T22:45:58.227531] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-10-06T22:45:58.227839] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-06T22:45:58.230798] [INFO ] [MAIN ] Derivative Progress: 1798/2037 symbols completed. TPL took 1.1s. Estimated remaining: 1m 36s. Rate: 150.1 symbols/min [2025-10-06T22:45:58.249271] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:58.250186] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 44873 primary records. [2025-10-06T22:45:58.250332] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-06T22:45:58.270434] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-10-06T22:45:58.270708] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-06T22:45:58.273262] [INFO ] [MAIN ] Derivative Progress: 1799/2037 symbols completed. TPH took 1.1s. Estimated remaining: 1m 35s. Rate: 150.2 symbols/min [2025-10-06T22:45:58.286371] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:58.287052] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53453 primary records. [2025-10-06T22:45:58.287114] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-06T22:45:58.302538] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-10-06T22:45:58.302603] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-06T22:45:58.305599] [INFO ] [MAIN ] Derivative Progress: 1800/2037 symbols completed. TPR took 1.0s. Estimated remaining: 1m 35s. Rate: 150.3 symbols/min [2025-10-06T22:45:58.306069] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:58.306233] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:58.306166] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:58.320930] [DEBUG] [LOCAL ] TPZ: Loaded 4838 existing records from primary storage. [2025-10-06T22:45:58.320712] [DEBUG] [LOCAL ] TPYP: Loaded 7900 existing records from primary storage. [2025-10-06T22:45:58.321095] [INFO ] [MAIN ] TPZ: Loaded 4838 primary data records. [2025-10-06T22:45:58.332395] [INFO ] [MAIN ] TPYP: Loaded 7900 primary data records. [2025-10-06T22:45:58.674023] [DEBUG] [LOCAL ] TPVG: Loaded 26934 existing records from primary storage. [2025-10-06T22:45:58.674264] [INFO ] [MAIN ] TPVG: Loaded 26934 primary data records. [2025-10-06T22:45:59.334891] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:59.348745] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7900 primary records. [2025-10-06T22:45:59.349163] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-06T22:45:59.350337] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:45:59.352117] [INFO ] [MAIN ] TPZ: Generated 1793 derivative records from 4838 primary records. [2025-10-06T22:45:59.352676] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-06T22:45:59.375851] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-10-06T22:45:59.377582] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-06T22:45:59.382806] [INFO ] [MAIN ] Derivative Progress: 1801/2037 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 34s. Rate: 150.1 symbols/min [2025-10-06T22:45:59.383206] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:59.392263] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1793 records). [2025-10-06T22:45:59.392574] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-06T22:45:59.394796] [INFO ] [MAIN ] Derivative Progress: 1802/2037 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 34s. Rate: 150.2 symbols/min [2025-10-06T22:45:59.395114] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:59.414312] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:45:59.415338] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 26934 primary records. [2025-10-06T22:45:59.415500] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-06T22:45:59.439901] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-10-06T22:45:59.440101] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-06T22:45:59.443326] [INFO ] [MAIN ] Derivative Progress: 1803/2037 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 33s. Rate: 150.3 symbols/min [2025-10-06T22:45:59.444029] [DEBUG] [LOCAL ] TR: Loaded 18711 existing records from primary storage. [2025-10-06T22:45:59.444235] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:45:59.444597] [INFO ] [MAIN ] TR: Loaded 18711 primary data records. [2025-10-06T22:45:59.460585] [DEBUG] [LOCAL ] TRAK: Loaded 9451 existing records from primary storage. [2025-10-06T22:45:59.480705] [INFO ] [MAIN ] TRAK: Loaded 9451 primary data records. [2025-10-06T22:45:59.712320] [DEBUG] [LOCAL ] TRC: Loaded 15620 existing records from primary storage. [2025-10-06T22:45:59.751911] [INFO ] [MAIN ] TRC: Loaded 15620 primary data records. [2025-10-06T22:46:00.467025] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:00.467384] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:00.468687] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18711 primary records. [2025-10-06T22:46:00.469041] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-06T22:46:00.470983] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9451 primary records. [2025-10-06T22:46:00.471670] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-06T22:46:00.521055] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-10-06T22:46:00.521503] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:00.522141] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-06T22:46:00.525933] [INFO ] [MAIN ] Derivative Progress: 1804/2037 symbols completed. TR took 1.1s. Estimated remaining: 1m 33s. Rate: 150.1 symbols/min [2025-10-06T22:46:00.523205] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15620 primary records. [2025-10-06T22:46:00.526937] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-06T22:46:00.526673] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:00.528285] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-10-06T22:46:00.529484] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-06T22:46:00.532329] [INFO ] [MAIN ] Derivative Progress: 1805/2037 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 33s. Rate: 150.2 symbols/min [2025-10-06T22:46:00.532605] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:00.548741] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-10-06T22:46:00.548905] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-06T22:46:00.552834] [INFO ] [MAIN ] Derivative Progress: 1806/2037 symbols completed. TRC took 1.1s. Estimated remaining: 1m 32s. Rate: 150.3 symbols/min [2025-10-06T22:46:00.553243] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:00.622869] [DEBUG] [LOCAL ] TRN: Loaded 36817 existing records from primary storage. [2025-10-06T22:46:00.623078] [INFO ] [MAIN ] TRN: Loaded 36817 primary data records. [2025-10-06T22:46:00.759409] [DEBUG] [LOCAL ] TRGP: Loaded 50742 existing records from primary storage. [2025-10-06T22:46:00.781492] [INFO ] [MAIN ] TRGP: Loaded 50742 primary data records. [2025-10-06T22:46:00.776255] [DEBUG] [LOCAL ] TREX: Loaded 49941 existing records from primary storage. [2025-10-06T22:46:00.781728] [INFO ] [MAIN ] TREX: Loaded 49941 primary data records. [2025-10-06T22:46:01.651556] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:01.652598] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 36817 primary records. [2025-10-06T22:46:01.655140] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-06T22:46:01.685207] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-10-06T22:46:01.685407] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-06T22:46:01.683885] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:01.688918] [INFO ] [MAIN ] Derivative Progress: 1807/2037 symbols completed. TRN took 1.1s. Estimated remaining: 1m 32s. Rate: 150.1 symbols/min [2025-10-06T22:46:01.687008] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49941 primary records. [2025-10-06T22:46:01.689073] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:01.691090] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-06T22:46:01.705073] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:01.716872] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50742 primary records. [2025-10-06T22:46:01.718965] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-06T22:46:01.722535] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-10-06T22:46:01.722634] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-06T22:46:01.725606] [INFO ] [MAIN ] Derivative Progress: 1808/2037 symbols completed. TREX took 1.2s. Estimated remaining: 1m 31s. Rate: 150.2 symbols/min [2025-10-06T22:46:01.737163] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:01.744790] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-10-06T22:46:01.745046] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-06T22:46:01.748401] [INFO ] [MAIN ] Derivative Progress: 1809/2037 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 31s. Rate: 150.3 symbols/min [2025-10-06T22:46:01.748628] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:01.790445] [DEBUG] [LOCAL ] TRNO: Loaded 43997 existing records from primary storage. [2025-10-06T22:46:01.790756] [INFO ] [MAIN ] TRNO: Loaded 43997 primary data records. [2025-10-06T22:46:02.033391] [DEBUG] [LOCAL ] TROX: Loaded 51930 existing records from primary storage. [2025-10-06T22:46:02.189341] [INFO ] [MAIN ] TROX: Loaded 51930 primary data records. [2025-10-06T22:46:02.205367] [DEBUG] [LOCAL ] TRP: Loaded 52121 existing records from primary storage. [2025-10-06T22:46:02.227807] [INFO ] [MAIN ] TRP: Loaded 52121 primary data records. [2025-10-06T22:46:02.868906] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:02.870198] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 43997 primary records. [2025-10-06T22:46:02.870671] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-06T22:46:02.891330] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-10-06T22:46:02.891752] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-06T22:46:02.894083] [INFO ] [MAIN ] Derivative Progress: 1810/2037 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 31s. Rate: 150.1 symbols/min [2025-10-06T22:46:02.894423] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:02.932471] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:02.932887] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:02.933945] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 51930 primary records. [2025-10-06T22:46:02.934823] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52121 primary records. [2025-10-06T22:46:02.935019] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-06T22:46:02.935155] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-06T22:46:02.976419] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-10-06T22:46:02.977387] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-06T22:46:02.981091] [INFO ] [MAIN ] Derivative Progress: 1811/2037 symbols completed. TRP took 1.2s. Estimated remaining: 1m 30s. Rate: 150.2 symbols/min [2025-10-06T22:46:02.982062] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:02.995079] [DEBUG] [LOCAL ] TRTX: Loaded 37492 existing records from primary storage. [2025-10-06T22:46:02.996861] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-10-06T22:46:02.997082] [INFO ] [MAIN ] TRTX: Loaded 37492 primary data records. [2025-10-06T22:46:02.997333] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-06T22:46:03.005151] [INFO ] [MAIN ] Derivative Progress: 1812/2037 symbols completed. TROX took 1.3s. Estimated remaining: 1m 30s. Rate: 150.3 symbols/min [2025-10-06T22:46:03.005429] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:03.375332] [DEBUG] [LOCAL ] TRU: Loaded 51302 existing records from primary storage. [2025-10-06T22:46:03.376424] [INFO ] [MAIN ] TRU: Loaded 51302 primary data records. [2025-10-06T22:46:03.498408] [DEBUG] [LOCAL ] TRV: Loaded 47616 existing records from primary storage. [2025-10-06T22:46:03.539745] [INFO ] [MAIN ] TRV: Loaded 47616 primary data records. [2025-10-06T22:46:03.910191] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:04.031140] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37492 primary records. [2025-10-06T22:46:04.033549] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-06T22:46:04.056806] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-10-06T22:46:04.057248] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-06T22:46:04.059940] [INFO ] [MAIN ] Derivative Progress: 1813/2037 symbols completed. TRTX took 1.2s. Estimated remaining: 1m 30s. Rate: 150.1 symbols/min [2025-10-06T22:46:04.080695] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:04.082211] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51302 primary records. [2025-10-06T22:46:04.082307] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-06T22:46:04.116925] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:04.118939] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 47616 primary records. [2025-10-06T22:46:04.118027] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-10-06T22:46:04.119136] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-06T22:46:04.122014] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-06T22:46:04.121898] [INFO ] [MAIN ] Derivative Progress: 1814/2037 symbols completed. TRU took 1.1s. Estimated remaining: 1m 29s. Rate: 150.2 symbols/min [2025-10-06T22:46:04.138213] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-10-06T22:46:04.138370] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-06T22:46:04.141700] [INFO ] [MAIN ] Derivative Progress: 1815/2037 symbols completed. TRV took 1.1s. Estimated remaining: 1m 29s. Rate: 150.3 symbols/min [2025-10-06T22:46:04.142340] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:04.142244] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:04.142670] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:04.153392] [DEBUG] [LOCAL ] TSI: Loaded 7300 existing records from primary storage. [2025-10-06T22:46:04.153619] [INFO ] [MAIN ] TSI: Loaded 7300 primary data records. [2025-10-06T22:46:04.375671] [DEBUG] [LOCAL ] TSE: Loaded 28026 existing records from primary storage. [2025-10-06T22:46:04.481936] [INFO ] [MAIN ] TSE: Loaded 28026 primary data records. [2025-10-06T22:46:04.594144] [DEBUG] [LOCAL ] TS: Loaded 51681 existing records from primary storage. [2025-10-06T22:46:04.611148] [INFO ] [MAIN ] TS: Loaded 51681 primary data records. [2025-10-06T22:46:05.224855] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:05.226997] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 7300 primary records. [2025-10-06T22:46:05.227293] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-06T22:46:05.250157] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-10-06T22:46:05.250402] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-06T22:46:05.252735] [INFO ] [MAIN ] Derivative Progress: 1816/2037 symbols completed. TSI took 1.1s. Estimated remaining: 1m 28s. Rate: 150.1 symbols/min [2025-10-06T22:46:05.252902] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:05.268285] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:05.269263] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 28026 primary records. [2025-10-06T22:46:05.269485] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-06T22:46:05.306312] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:05.308560] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51681 primary records. [2025-10-06T22:46:05.308752] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-06T22:46:05.310427] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-10-06T22:46:05.310873] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-06T22:46:05.313702] [INFO ] [MAIN ] Derivative Progress: 1817/2037 symbols completed. TSE took 1.2s. Estimated remaining: 1m 28s. Rate: 150.2 symbols/min [2025-10-06T22:46:05.321283] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:05.341166] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-10-06T22:46:05.341355] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-06T22:46:05.344941] [INFO ] [MAIN ] Derivative Progress: 1818/2037 symbols completed. TS took 1.2s. Estimated remaining: 1m 27s. Rate: 150.3 symbols/min [2025-10-06T22:46:05.346011] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:05.358210] [DEBUG] [LOCAL ] TSLX: Loaded 35340 existing records from primary storage. [2025-10-06T22:46:05.358517] [INFO ] [MAIN ] TSLX: Loaded 35340 primary data records. [2025-10-06T22:46:05.800595] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-06T22:46:05.820505] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-06T22:46:05.847414] [DEBUG] [LOCAL ] TSN: Loaded 52935 existing records from primary storage. [2025-10-06T22:46:05.848591] [INFO ] [MAIN ] TSN: Loaded 52935 primary data records. [2025-10-06T22:46:06.672466] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:06.673892] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35340 primary records. [2025-10-06T22:46:06.674038] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-06T22:46:06.706852] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-10-06T22:46:06.707044] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-06T22:46:06.710380] [INFO ] [MAIN ] Derivative Progress: 1819/2037 symbols completed. TSLX took 1.5s. Estimated remaining: 1m 27s. Rate: 150.1 symbols/min [2025-10-06T22:46:06.712481] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:06.737008] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:06.739626] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-10-06T22:46:06.739778] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-06T22:46:06.748530] [DEBUG] [LOCAL ] TSQ: Loaded 11828 existing records from primary storage. [2025-10-06T22:46:06.749260] [INFO ] [MAIN ] TSQ: Loaded 11828 primary data records. [2025-10-06T22:46:06.801799] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:06.818580] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 52935 primary records. [2025-10-06T22:46:06.831794] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-06T22:46:06.911415] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-10-06T22:46:06.912262] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-06T22:46:06.915693] [INFO ] [MAIN ] Derivative Progress: 1820/2037 symbols completed. TSM took 1.6s. Estimated remaining: 1m 27s. Rate: 150.1 symbols/min [2025-10-06T22:46:06.927019] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:06.996322] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-10-06T22:46:07.103022] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-06T22:46:07.121980] [INFO ] [MAIN ] Derivative Progress: 1821/2037 symbols completed. TSN took 1.8s. Estimated remaining: 1m 26s. Rate: 150.2 symbols/min [2025-10-06T22:46:07.122435] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:07.169751] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:07.171067] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 11828 primary records. [2025-10-06T22:46:07.171382] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-06T22:46:07.196048] [DEBUG] [LOCAL ] TT: Loaded 47541 existing records from primary storage. [2025-10-06T22:46:07.196524] [INFO ] [MAIN ] TT: Loaded 47541 primary data records. [2025-10-06T22:46:07.313803] [DEBUG] [LOCAL ] TTC: Loaded 42038 existing records from primary storage. [2025-10-06T22:46:07.334779] [INFO ] [MAIN ] TTC: Loaded 42038 primary data records. [2025-10-06T22:46:07.334847] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-10-06T22:46:07.371839] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-06T22:46:07.666017] [INFO ] [MAIN ] Derivative Progress: 1822/2037 symbols completed. TSQ took 1.0s. Estimated remaining: 1m 26s. Rate: 150.1 symbols/min [2025-10-06T22:46:07.684268] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:07.924040] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:07.925199] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 47541 primary records. [2025-10-06T22:46:07.925441] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-06T22:46:07.960364] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-10-06T22:46:07.960764] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-06T22:46:07.963963] [INFO ] [MAIN ] Derivative Progress: 1823/2037 symbols completed. TT took 1.0s. Estimated remaining: 1m 26s. Rate: 150.2 symbols/min [2025-10-06T22:46:07.965027] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:07.980315] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:07.981165] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 42038 primary records. [2025-10-06T22:46:07.981290] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-06T22:46:08.021630] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-10-06T22:46:08.021953] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-06T22:46:08.025957] [DEBUG] [LOCAL ] TTE: Loaded 51598 existing records from primary storage. [2025-10-06T22:46:08.024364] [INFO ] [MAIN ] Derivative Progress: 1824/2037 symbols completed. TTC took 0.9s. Estimated remaining: 1m 25s. Rate: 150.2 symbols/min [2025-10-06T22:46:08.026434] [INFO ] [MAIN ] TTE: Loaded 51598 primary data records. [2025-10-06T22:46:08.026291] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:08.377979] [DEBUG] [LOCAL ] TTI: Loaded 45750 existing records from primary storage. [2025-10-06T22:46:08.378845] [INFO ] [MAIN ] TTI: Loaded 45750 primary data records. [2025-10-06T22:46:08.501968] [DEBUG] [LOCAL ] TU: Loaded 49840 existing records from primary storage. [2025-10-06T22:46:08.502387] [INFO ] [MAIN ] TU: Loaded 49840 primary data records. [2025-10-06T22:46:09.036679] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:09.037916] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51598 primary records. [2025-10-06T22:46:09.038135] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-06T22:46:09.056073] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-10-06T22:46:09.056532] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-06T22:46:09.059171] [INFO ] [MAIN ] Derivative Progress: 1825/2037 symbols completed. TTE took 1.4s. Estimated remaining: 1m 25s. Rate: 150.1 symbols/min [2025-10-06T22:46:09.059513] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:09.078407] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:09.079308] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 45750 primary records. [2025-10-06T22:46:09.079500] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-06T22:46:09.110730] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-10-06T22:46:09.111080] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-06T22:46:09.113861] [INFO ] [MAIN ] Derivative Progress: 1826/2037 symbols completed. TTI took 1.1s. Estimated remaining: 1m 24s. Rate: 150.2 symbols/min [2025-10-06T22:46:09.111428] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:09.115316] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49840 primary records. [2025-10-06T22:46:09.114122] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:09.115464] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-06T22:46:09.143159] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-10-06T22:46:09.143359] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-06T22:46:09.146784] [INFO ] [MAIN ] Derivative Progress: 1827/2037 symbols completed. TU took 1.1s. Estimated remaining: 1m 24s. Rate: 150.2 symbols/min [2025-10-06T22:46:09.147190] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:09.165543] [DEBUG] [LOCAL ] TUYA: Loaded 46148 existing records from primary storage. [2025-10-06T22:46:09.165944] [INFO ] [MAIN ] TUYA: Loaded 46148 primary data records. [2025-10-06T22:46:09.179804] [DEBUG] [LOCAL ] TVC: Loaded 3311 existing records from primary storage. [2025-10-06T22:46:09.199735] [INFO ] [MAIN ] TVC: Loaded 3311 primary data records. [2025-10-06T22:46:09.412464] [DEBUG] [LOCAL ] TV: Loaded 42263 existing records from primary storage. [2025-10-06T22:46:09.452940] [INFO ] [MAIN ] TV: Loaded 42263 primary data records. [2025-10-06T22:46:10.199497] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:10.201188] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 46148 primary records. [2025-10-06T22:46:10.201378] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-06T22:46:10.216878] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:10.217970] [INFO ] [MAIN ] TVC: Generated 1794 derivative records from 3311 primary records. [2025-10-06T22:46:10.232964] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-06T22:46:10.239982] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:10.243876] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 42263 primary records. [2025-10-06T22:46:10.254855] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-06T22:46:10.267536] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-10-06T22:46:10.267874] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-06T22:46:10.277143] [INFO ] [MAIN ] Derivative Progress: 1828/2037 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 24s. Rate: 150.1 symbols/min [2025-10-06T22:46:10.278960] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-10-06T22:46:10.279064] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-06T22:46:10.282327] [INFO ] [MAIN ] Derivative Progress: 1829/2037 symbols completed. TV took 1.2s. Estimated remaining: 1m 23s. Rate: 150.2 symbols/min [2025-10-06T22:46:10.283232] [DEBUG] [LOCAL ] TVC: Derivative data saved (1794 records). [2025-10-06T22:46:10.283352] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-06T22:46:10.285946] [INFO ] [MAIN ] Derivative Progress: 1830/2037 symbols completed. TVC took 1.1s. Estimated remaining: 1m 23s. Rate: 150.3 symbols/min [2025-10-06T22:46:10.286480] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:10.286626] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:10.286537] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:10.293917] [DEBUG] [LOCAL ] TWN: Loaded 3201 existing records from primary storage. [2025-10-06T22:46:10.294776] [INFO ] [MAIN ] TWN: Loaded 3201 primary data records. [2025-10-06T22:46:10.330242] [DEBUG] [LOCAL ] TVE: Loaded 2786 existing records from primary storage. [2025-10-06T22:46:10.354488] [INFO ] [MAIN ] TVE: Loaded 2786 primary data records. [2025-10-06T22:46:10.932199] [DEBUG] [LOCAL ] TWLO: Loaded 52735 existing records from primary storage. [2025-10-06T22:46:10.941891] [INFO ] [MAIN ] TWLO: Loaded 52735 primary data records. [2025-10-06T22:46:11.331915] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:11.332750] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:11.333578] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3201 primary records. [2025-10-06T22:46:11.334326] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-06T22:46:11.334257] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2786 primary records. [2025-10-06T22:46:11.342327] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-06T22:46:11.364491] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-10-06T22:46:11.365051] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-06T22:46:11.368099] [INFO ] [MAIN ] Derivative Progress: 1831/2037 symbols completed. TVE took 1.1s. Estimated remaining: 1m 22s. Rate: 150.1 symbols/min [2025-10-06T22:46:11.368497] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:11.370536] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-10-06T22:46:11.370770] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-06T22:46:11.373060] [INFO ] [MAIN ] Derivative Progress: 1832/2037 symbols completed. TWN took 1.1s. Estimated remaining: 1m 22s. Rate: 150.2 symbols/min [2025-10-06T22:46:11.373455] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:11.391740] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:11.392611] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52735 primary records. [2025-10-06T22:46:11.392830] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-06T22:46:11.415411] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-10-06T22:46:11.415763] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-06T22:46:11.418361] [INFO ] [MAIN ] Derivative Progress: 1833/2037 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 21s. Rate: 150.3 symbols/min [2025-10-06T22:46:11.418692] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:11.429888] [DEBUG] [LOCAL ] TX: Loaded 23453 existing records from primary storage. [2025-10-06T22:46:11.430053] [INFO ] [MAIN ] TX: Loaded 23453 primary data records. [2025-10-06T22:46:11.660057] [DEBUG] [LOCAL ] TWO: Loaded 48448 existing records from primary storage. [2025-10-06T22:46:11.725840] [INFO ] [MAIN ] TWO: Loaded 48448 primary data records. [2025-10-06T22:46:11.863994] [DEBUG] [LOCAL ] TXNM: Loaded 43375 existing records from primary storage. [2025-10-06T22:46:11.876879] [INFO ] [MAIN ] TXNM: Loaded 43375 primary data records. [2025-10-06T22:46:12.472146] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:12.473912] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23453 primary records. [2025-10-06T22:46:12.474174] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-06T22:46:12.499981] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-10-06T22:46:12.500594] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-06T22:46:12.503670] [INFO ] [MAIN ] Derivative Progress: 1834/2037 symbols completed. TX took 1.1s. Estimated remaining: 1m 21s. Rate: 150.1 symbols/min [2025-10-06T22:46:12.509427] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:12.527845] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:12.542091] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:12.543389] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48448 primary records. [2025-10-06T22:46:12.544613] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 43375 primary records. [2025-10-06T22:46:12.543853] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-06T22:46:12.544813] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-06T22:46:12.580978] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-10-06T22:46:12.581630] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-06T22:46:12.585130] [INFO ] [MAIN ] Derivative Progress: 1835/2037 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 21s. Rate: 150.2 symbols/min [2025-10-06T22:46:12.586495] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:12.594944] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-10-06T22:46:12.596189] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-06T22:46:12.598843] [INFO ] [MAIN ] Derivative Progress: 1836/2037 symbols completed. TWO took 1.2s. Estimated remaining: 1m 20s. Rate: 150.3 symbols/min [2025-10-06T22:46:12.599024] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:12.600153] [DEBUG] [LOCAL ] TXO: Loaded 19114 existing records from primary storage. [2025-10-06T22:46:12.600495] [INFO ] [MAIN ] TXO: Loaded 19114 primary data records. [2025-10-06T22:46:12.715682] [DEBUG] [LOCAL ] TY: Loaded 7552 existing records from primary storage. [2025-10-06T22:46:12.731811] [INFO ] [MAIN ] TY: Loaded 7552 primary data records. [2025-10-06T22:46:13.175422] [DEBUG] [LOCAL ] TXT: Loaded 49722 existing records from primary storage. [2025-10-06T22:46:13.303519] [INFO ] [MAIN ] TXT: Loaded 49722 primary data records. [2025-10-06T22:46:13.719722] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:13.733554] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:13.735639] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7552 primary records. [2025-10-06T22:46:13.734583] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 19114 primary records. [2025-10-06T22:46:13.736886] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-06T22:46:13.736743] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-06T22:46:13.773727] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-10-06T22:46:13.774061] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-06T22:46:13.772203] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-10-06T22:46:13.777805] [INFO ] [MAIN ] Derivative Progress: 1837/2037 symbols completed. TY took 1.2s. Estimated remaining: 1m 20s. Rate: 150.1 symbols/min [2025-10-06T22:46:13.779185] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:13.779004] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-06T22:46:13.794913] [INFO ] [MAIN ] Derivative Progress: 1838/2037 symbols completed. TXO took 1.3s. Estimated remaining: 1m 19s. Rate: 150.2 symbols/min [2025-10-06T22:46:13.795747] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:13.796799] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49722 primary records. [2025-10-06T22:46:13.797032] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-06T22:46:13.795994] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:13.827294] [DEBUG] [LOCAL ] TYG: Loaded 13929 existing records from primary storage. [2025-10-06T22:46:13.828363] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-10-06T22:46:13.828274] [INFO ] [MAIN ] TYG: Loaded 13929 primary data records. [2025-10-06T22:46:13.828529] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-06T22:46:13.871553] [INFO ] [MAIN ] Derivative Progress: 1839/2037 symbols completed. TXT took 1.3s. Estimated remaining: 1m 19s. Rate: 150.3 symbols/min [2025-10-06T22:46:13.877493] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:13.956333] [DEBUG] [LOCAL ] TYL: Loaded 22200 existing records from primary storage. [2025-10-06T22:46:13.960105] [INFO ] [MAIN ] TYL: Loaded 22200 primary data records. [2025-10-06T22:46:14.519320] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-06T22:46:14.533826] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-06T22:46:14.895466] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:14.897523] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 13929 primary records. [2025-10-06T22:46:14.897990] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-06T22:46:14.938597] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:14.940347] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22200 primary records. [2025-10-06T22:46:14.940770] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-06T22:46:14.955405] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-10-06T22:46:14.956106] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-06T22:46:14.959118] [INFO ] [MAIN ] Derivative Progress: 1840/2037 symbols completed. TYG took 1.2s. Estimated remaining: 1m 19s. Rate: 150.1 symbols/min [2025-10-06T22:46:14.959805] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:14.964678] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-10-06T22:46:14.965939] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-06T22:46:14.968757] [INFO ] [MAIN ] Derivative Progress: 1841/2037 symbols completed. TYL took 1.2s. Estimated remaining: 1m 18s. Rate: 150.2 symbols/min [2025-10-06T22:46:14.968970] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:14.986026] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:14.986806] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-10-06T22:46:14.986929] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-06T22:46:15.020108] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-10-06T22:46:15.020274] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-06T22:46:15.023190] [INFO ] [MAIN ] Derivative Progress: 1842/2037 symbols completed. U took 1.1s. Estimated remaining: 1m 18s. Rate: 150.3 symbols/min [2025-10-06T22:46:15.023437] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:15.044722] [DEBUG] [LOCAL ] UAN: Loaded 5444 existing records from primary storage. [2025-10-06T22:46:15.044908] [INFO ] [MAIN ] UAN: Loaded 5444 primary data records. [2025-10-06T22:46:15.081728] [DEBUG] [LOCAL ] UA: Loaded 50458 existing records from primary storage. [2025-10-06T22:46:15.099063] [INFO ] [MAIN ] UA: Loaded 50458 primary data records. [2025-10-06T22:46:15.263344] [DEBUG] [LOCAL ] UAA: Loaded 53509 existing records from primary storage. [2025-10-06T22:46:15.297788] [INFO ] [MAIN ] UAA: Loaded 53509 primary data records. [2025-10-06T22:46:16.072635] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:16.073691] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5444 primary records. [2025-10-06T22:46:16.088201] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:16.088692] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-06T22:46:16.090720] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50458 primary records. [2025-10-06T22:46:16.091820] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-06T22:46:16.126561] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:16.130773] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53509 primary records. [2025-10-06T22:46:16.131611] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-06T22:46:16.143245] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-10-06T22:46:16.147201] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-06T22:46:16.149751] [INFO ] [MAIN ] Derivative Progress: 1843/2037 symbols completed. UAN took 1.1s. Estimated remaining: 1m 18s. Rate: 150.1 symbols/min [2025-10-06T22:46:16.153630] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-10-06T22:46:16.154482] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-06T22:46:16.157636] [INFO ] [MAIN ] Derivative Progress: 1844/2037 symbols completed. UA took 1.2s. Estimated remaining: 1m 17s. Rate: 150.2 symbols/min [2025-10-06T22:46:16.159552] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-10-06T22:46:16.159617] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-06T22:46:16.163478] [INFO ] [MAIN ] Derivative Progress: 1845/2037 symbols completed. UAA took 1.2s. Estimated remaining: 1m 17s. Rate: 150.3 symbols/min [2025-10-06T22:46:16.163853] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:16.164385] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:16.163987] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:16.250427] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-06T22:46:16.250892] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-06T22:46:16.389627] [DEBUG] [LOCAL ] UBS: Loaded 52358 existing records from primary storage. [2025-10-06T22:46:16.406635] [DEBUG] [LOCAL ] UDR: Loaded 51872 existing records from primary storage. [2025-10-06T22:46:16.412048] [INFO ] [MAIN ] UBS: Loaded 52358 primary data records. [2025-10-06T22:46:16.412320] [INFO ] [MAIN ] UDR: Loaded 51872 primary data records. [2025-10-06T22:46:17.245003] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:17.246768] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-10-06T22:46:17.247088] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-06T22:46:17.287682] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-10-06T22:46:17.288122] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:17.288764] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-06T22:46:17.289697] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52358 primary records. [2025-10-06T22:46:17.289904] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-06T22:46:17.304946] [INFO ] [MAIN ] Derivative Progress: 1846/2037 symbols completed. UBER took 1.1s. Estimated remaining: 1m 16s. Rate: 150.1 symbols/min [2025-10-06T22:46:17.306096] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:17.307499] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 51872 primary records. [2025-10-06T22:46:17.306379] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:17.307703] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-06T22:46:17.338160] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-10-06T22:46:17.338788] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-06T22:46:17.341394] [INFO ] [MAIN ] Derivative Progress: 1847/2037 symbols completed. UBS took 1.2s. Estimated remaining: 1m 16s. Rate: 150.2 symbols/min [2025-10-06T22:46:17.341864] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:17.350188] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-10-06T22:46:17.350456] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-06T22:46:17.354587] [INFO ] [MAIN ] Derivative Progress: 1848/2037 symbols completed. UDR took 1.2s. Estimated remaining: 1m 15s. Rate: 150.3 symbols/min [2025-10-06T22:46:17.354953] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:17.360337] [DEBUG] [LOCAL ] UFI: Loaded 8150 existing records from primary storage. [2025-10-06T22:46:17.360701] [INFO ] [MAIN ] UFI: Loaded 8150 primary data records. [2025-10-06T22:46:17.571403] [DEBUG] [LOCAL ] UE: Loaded 42666 existing records from primary storage. [2025-10-06T22:46:17.571734] [INFO ] [MAIN ] UE: Loaded 42666 primary data records. [2025-10-06T22:46:17.928955] [DEBUG] [LOCAL ] UGI: Loaded 50537 existing records from primary storage. [2025-10-06T22:46:17.929422] [INFO ] [MAIN ] UGI: Loaded 50537 primary data records. [2025-10-06T22:46:18.423226] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:18.423943] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8150 primary records. [2025-10-06T22:46:18.424008] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-06T22:46:18.457406] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:18.459384] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42666 primary records. [2025-10-06T22:46:18.459637] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-06T22:46:18.473988] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-10-06T22:46:18.476925] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-06T22:46:18.479407] [INFO ] [MAIN ] Derivative Progress: 1849/2037 symbols completed. UFI took 1.1s. Estimated remaining: 1m 15s. Rate: 150.1 symbols/min [2025-10-06T22:46:18.479875] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:18.481910] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-10-06T22:46:18.482011] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-06T22:46:18.484660] [INFO ] [MAIN ] Derivative Progress: 1850/2037 symbols completed. UE took 1.2s. Estimated remaining: 1m 15s. Rate: 150.2 symbols/min [2025-10-06T22:46:18.485001] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:18.504800] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:18.505949] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50537 primary records. [2025-10-06T22:46:18.506089] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-06T22:46:18.541524] [DEBUG] [LOCAL ] UHAL: Loaded 16673 existing records from primary storage. [2025-10-06T22:46:18.543318] [INFO ] [MAIN ] UHAL: Loaded 16673 primary data records. [2025-10-06T22:46:18.543671] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-10-06T22:46:18.543772] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-06T22:46:18.547980] [INFO ] [MAIN ] Derivative Progress: 1851/2037 symbols completed. UGI took 1.2s. Estimated remaining: 1m 14s. Rate: 150.3 symbols/min [2025-10-06T22:46:18.548396] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:18.667126] [DEBUG] [LOCAL ] UGP: Loaded 42832 existing records from primary storage. [2025-10-06T22:46:18.667514] [INFO ] [MAIN ] UGP: Loaded 42832 primary data records. [2025-10-06T22:46:19.062890] [DEBUG] [LOCAL ] UHS: Loaded 40758 existing records from primary storage. [2025-10-06T22:46:19.082700] [INFO ] [MAIN ] UHS: Loaded 40758 primary data records. [2025-10-06T22:46:19.512277] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:19.514530] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16673 primary records. [2025-10-06T22:46:19.515060] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-06T22:46:19.552317] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:19.554205] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42832 primary records. [2025-10-06T22:46:19.555278] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-10-06T22:46:19.554584] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-06T22:46:19.555815] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-06T22:46:19.560059] [INFO ] [MAIN ] Derivative Progress: 1852/2037 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 14s. Rate: 150.2 symbols/min [2025-10-06T22:46:19.574479] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:19.580927] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-10-06T22:46:19.581941] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-06T22:46:19.585027] [INFO ] [MAIN ] Derivative Progress: 1853/2037 symbols completed. UGP took 1.1s. Estimated remaining: 1m 13s. Rate: 150.2 symbols/min [2025-10-06T22:46:19.599297] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:19.600157] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:19.601175] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 40758 primary records. [2025-10-06T22:46:19.601239] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-06T22:46:19.624144] [DEBUG] [LOCAL ] UHT: Loaded 9990 existing records from primary storage. [2025-10-06T22:46:19.625454] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-10-06T22:46:19.628813] [INFO ] [MAIN ] UHT: Loaded 9990 primary data records. [2025-10-06T22:46:19.625615] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-06T22:46:19.638184] [INFO ] [MAIN ] Derivative Progress: 1854/2037 symbols completed. UHS took 1.1s. Estimated remaining: 1m 13s. Rate: 150.3 symbols/min [2025-10-06T22:46:19.666520] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:19.690299] [DEBUG] [LOCAL ] UI: Loaded 13266 existing records from primary storage. [2025-10-06T22:46:19.712540] [INFO ] [MAIN ] UI: Loaded 13266 primary data records. [2025-10-06T22:46:20.300275] [DEBUG] [LOCAL ] UIS: Loaded 37035 existing records from primary storage. [2025-10-06T22:46:20.300916] [INFO ] [MAIN ] UIS: Loaded 37035 primary data records. [2025-10-06T22:46:20.639443] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:20.653810] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:20.653462] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 9990 primary records. [2025-10-06T22:46:20.654881] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-06T22:46:20.655638] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 13266 primary records. [2025-10-06T22:46:20.655840] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-06T22:46:20.685570] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-10-06T22:46:20.686758] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-06T22:46:20.689388] [INFO ] [MAIN ] Derivative Progress: 1855/2037 symbols completed. UHT took 1.1s. Estimated remaining: 1m 13s. Rate: 150.2 symbols/min [2025-10-06T22:46:20.689815] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:20.694634] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-10-06T22:46:20.694934] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-06T22:46:20.697706] [INFO ] [MAIN ] Derivative Progress: 1856/2037 symbols completed. UI took 1.1s. Estimated remaining: 1m 12s. Rate: 150.2 symbols/min [2025-10-06T22:46:20.698016] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:20.711678] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:20.712309] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 37035 primary records. [2025-10-06T22:46:20.712419] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-06T22:46:20.730090] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-10-06T22:46:20.730273] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-06T22:46:20.733610] [INFO ] [MAIN ] Derivative Progress: 1857/2037 symbols completed. UIS took 1.1s. Estimated remaining: 1m 12s. Rate: 150.3 symbols/min [2025-10-06T22:46:20.733968] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:20.803420] [DEBUG] [LOCAL ] ULS: Loaded 39399 existing records from primary storage. [2025-10-06T22:46:20.804981] [DEBUG] [LOCAL ] UL: Loaded 53070 existing records from primary storage. [2025-10-06T22:46:20.805116] [INFO ] [MAIN ] UL: Loaded 53070 primary data records. [2025-10-06T22:46:20.803621] [INFO ] [MAIN ] ULS: Loaded 39399 primary data records. [2025-10-06T22:46:21.304168] [DEBUG] [LOCAL ] UMC: Loaded 52712 existing records from primary storage. [2025-10-06T22:46:21.432201] [INFO ] [MAIN ] UMC: Loaded 52712 primary data records. [2025-10-06T22:46:21.764075] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:21.765417] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39399 primary records. [2025-10-06T22:46:21.767680] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-06T22:46:21.796370] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:21.799295] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53070 primary records. [2025-10-06T22:46:21.799398] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-06T22:46:21.816686] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-10-06T22:46:21.819210] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-06T22:46:21.819464] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-10-06T22:46:21.821980] [INFO ] [MAIN ] Derivative Progress: 1858/2037 symbols completed. ULS took 1.1s. Estimated remaining: 1m 12s. Rate: 150.2 symbols/min [2025-10-06T22:46:21.822548] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-06T22:46:21.825772] [INFO ] [MAIN ] Derivative Progress: 1859/2037 symbols completed. UL took 1.1s. Estimated remaining: 1m 11s. Rate: 150.3 symbols/min [2025-10-06T22:46:21.842795] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:21.843363] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52712 primary records. [2025-10-06T22:46:21.843422] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-06T22:46:21.859086] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-10-06T22:46:21.859149] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-06T22:46:21.862567] [INFO ] [MAIN ] Derivative Progress: 1860/2037 symbols completed. UMC took 1.1s. Estimated remaining: 1m 11s. Rate: 150.3 symbols/min [2025-10-06T22:46:21.863025] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:21.863082] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:21.862979] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:21.879202] [DEBUG] [LOCAL ] UNF: Loaded 12103 existing records from primary storage. [2025-10-06T22:46:21.879422] [INFO ] [MAIN ] UNF: Loaded 12103 primary data records. [2025-10-06T22:46:22.134330] [DEBUG] [LOCAL ] UNFI: Loaded 42224 existing records from primary storage. [2025-10-06T22:46:22.136044] [DEBUG] [LOCAL ] UMH: Loaded 33730 existing records from primary storage. [2025-10-06T22:46:22.299363] [INFO ] [MAIN ] UMH: Loaded 33730 primary data records. [2025-10-06T22:46:22.299623] [INFO ] [MAIN ] UNFI: Loaded 42224 primary data records. [2025-10-06T22:46:22.983968] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:22.985245] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 12103 primary records. [2025-10-06T22:46:22.985398] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-06T22:46:23.004347] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-10-06T22:46:23.004975] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-06T22:46:23.007233] [INFO ] [MAIN ] Derivative Progress: 1861/2037 symbols completed. UNF took 1.1s. Estimated remaining: 1m 10s. Rate: 150.2 symbols/min [2025-10-06T22:46:23.007565] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:23.041901] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:23.048576] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 42224 primary records. [2025-10-06T22:46:23.048729] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-06T22:46:23.047579] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:23.050505] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 33730 primary records. [2025-10-06T22:46:23.050986] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-06T22:46:23.083932] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-10-06T22:46:23.098304] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-06T22:46:23.102314] [INFO ] [MAIN ] Derivative Progress: 1862/2037 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 10s. Rate: 150.2 symbols/min [2025-10-06T22:46:23.103110] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:23.105120] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-10-06T22:46:23.105278] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-06T22:46:23.108190] [INFO ] [MAIN ] Derivative Progress: 1863/2037 symbols completed. UMH took 1.2s. Estimated remaining: 1m 9s. Rate: 150.3 symbols/min [2025-10-06T22:46:23.108587] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:23.130661] [DEBUG] [LOCAL ] UNMA: Loaded 3501 existing records from primary storage. [2025-10-06T22:46:23.131713] [DEBUG] [LOCAL ] UNH: Loaded 53801 existing records from primary storage. [2025-10-06T22:46:23.131960] [INFO ] [MAIN ] UNH: Loaded 53801 primary data records. [2025-10-06T22:46:23.132050] [INFO ] [MAIN ] UNMA: Loaded 3501 primary data records. [2025-10-06T22:46:23.764517] [DEBUG] [LOCAL ] UNM: Loaded 48326 existing records from primary storage. [2025-10-06T22:46:23.764882] [INFO ] [MAIN ] UNM: Loaded 48326 primary data records. [2025-10-06T22:46:24.181894] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:24.182392] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-10-06T22:46:24.184338] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53801 primary records. [2025-10-06T22:46:24.183604] [INFO ] [MAIN ] UNMA: Generated 1789 derivative records from 3501 primary records. [2025-10-06T22:46:24.184749] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-06T22:46:24.185056] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-06T22:46:24.222377] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-10-06T22:46:24.222694] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-06T22:46:24.226358] [INFO ] [MAIN ] Derivative Progress: 1864/2037 symbols completed. UNH took 1.2s. Estimated remaining: 1m 9s. Rate: 150.2 symbols/min [2025-10-06T22:46:24.221235] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1789 records). [2025-10-06T22:46:24.226743] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-06T22:46:24.229902] [INFO ] [MAIN ] Derivative Progress: 1865/2037 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 9s. Rate: 150.3 symbols/min [2025-10-06T22:46:24.230226] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:24.226999] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:24.249695] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:24.250699] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48326 primary records. [2025-10-06T22:46:24.250930] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-06T22:46:24.268810] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-10-06T22:46:24.269163] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-06T22:46:24.272000] [INFO ] [MAIN ] Derivative Progress: 1866/2037 symbols completed. UNM took 1.2s. Estimated remaining: 1m 8s. Rate: 150.3 symbols/min [2025-10-06T22:46:24.272381] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:24.313348] [DEBUG] [LOCAL ] UP: Loaded 43406 existing records from primary storage. [2025-10-06T22:46:24.328038] [INFO ] [MAIN ] UP: Loaded 43406 primary data records. [2025-10-06T22:46:24.482398] [DEBUG] [LOCAL ] UNP: Loaded 53295 existing records from primary storage. [2025-10-06T22:46:24.499451] [INFO ] [MAIN ] UNP: Loaded 53295 primary data records. [2025-10-06T22:46:24.811345] [DEBUG] [LOCAL ] UPS: Loaded 53714 existing records from primary storage. [2025-10-06T22:46:24.811664] [INFO ] [MAIN ] UPS: Loaded 53714 primary data records. [2025-10-06T22:46:25.359765] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:25.361254] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 43406 primary records. [2025-10-06T22:46:25.361693] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-06T22:46:25.398681] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-10-06T22:46:25.399364] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-06T22:46:25.399291] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:25.400467] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53295 primary records. [2025-10-06T22:46:25.403402] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-06T22:46:25.403305] [INFO ] [MAIN ] Derivative Progress: 1867/2037 symbols completed. UP took 1.2s. Estimated remaining: 1m 8s. Rate: 150.2 symbols/min [2025-10-06T22:46:25.404834] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:25.438218] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:46:25.438716] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-10-06T22:46:25.439952] [INFO ] [MAIN ] UPS: Generated 1793 derivative records from 53714 primary records. [2025-10-06T22:46:25.439064] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-06T22:46:25.442536] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-06T22:46:25.442427] [INFO ] [MAIN ] Derivative Progress: 1868/2037 symbols completed. UNP took 1.2s. Estimated remaining: 1m 7s. Rate: 150.3 symbols/min [2025-10-06T22:46:25.443739] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:25.483246] [DEBUG] [LOCAL ] UPS: Derivative data saved (1793 records). [2025-10-06T22:46:25.483417] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-06T22:46:25.487060] [INFO ] [MAIN ] Derivative Progress: 1869/2037 symbols completed. UPS took 1.2s. Estimated remaining: 1m 7s. Rate: 150.3 symbols/min [2025-10-06T22:46:25.488152] [DEBUG] [LOCAL ] USA: Loaded 35963 existing records from primary storage. [2025-10-06T22:46:25.487306] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:25.488575] [INFO ] [MAIN ] USA: Loaded 35963 primary data records. [2025-10-06T22:46:25.609626] [DEBUG] [LOCAL ] USAC: Loaded 21843 existing records from primary storage. [2025-10-06T22:46:25.625490] [INFO ] [MAIN ] USAC: Loaded 21843 primary data records. [2025-10-06T22:46:26.134790] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-06T22:46:26.179731] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-06T22:46:26.508039] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:26.508990] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 35963 primary records. [2025-10-06T22:46:26.509103] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-06T22:46:26.532360] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-10-06T22:46:26.532571] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-06T22:46:26.535162] [INFO ] [MAIN ] Derivative Progress: 1870/2037 symbols completed. USA took 1.1s. Estimated remaining: 1m 7s. Rate: 150.2 symbols/min [2025-10-06T22:46:26.550549] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:26.549731] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:26.551543] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 21843 primary records. [2025-10-06T22:46:26.551812] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-06T22:46:26.575398] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-10-06T22:46:26.576821] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-06T22:46:26.579926] [INFO ] [MAIN ] Derivative Progress: 1871/2037 symbols completed. USAC took 1.1s. Estimated remaining: 1m 6s. Rate: 150.3 symbols/min [2025-10-06T22:46:26.581340] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:26.597338] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:26.598461] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-10-06T22:46:26.598607] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-06T22:46:26.642850] [DEBUG] [LOCAL ] USNA: Loaded 17731 existing records from primary storage. [2025-10-06T22:46:26.642994] [INFO ] [MAIN ] USNA: Loaded 17731 primary data records. [2025-10-06T22:46:26.642420] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-10-06T22:46:26.648448] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-06T22:46:26.669474] [INFO ] [MAIN ] Derivative Progress: 1872/2037 symbols completed. USB took 1.2s. Estimated remaining: 1m 6s. Rate: 150.3 symbols/min [2025-10-06T22:46:26.700568] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:26.789909] [DEBUG] [LOCAL ] USFD: Loaded 51207 existing records from primary storage. [2025-10-06T22:46:26.802082] [INFO ] [MAIN ] USFD: Loaded 51207 primary data records. [2025-10-06T22:46:27.073685] [DEBUG] [LOCAL ] USPH: Loaded 16926 existing records from primary storage. [2025-10-06T22:46:27.080617] [INFO ] [MAIN ] USPH: Loaded 16926 primary data records. [2025-10-06T22:46:27.655917] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:27.657695] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 17731 primary records. [2025-10-06T22:46:27.657977] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-06T22:46:27.685515] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-10-06T22:46:27.685860] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-06T22:46:27.688464] [INFO ] [MAIN ] Derivative Progress: 1873/2037 symbols completed. USNA took 1.1s. Estimated remaining: 1m 6s. Rate: 150.2 symbols/min [2025-10-06T22:46:27.701924] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:27.703117] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51207 primary records. [2025-10-06T22:46:27.703276] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-06T22:46:27.732142] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:27.733182] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 16926 primary records. [2025-10-06T22:46:27.733469] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-06T22:46:27.748838] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-10-06T22:46:27.749476] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-06T22:46:27.752904] [INFO ] [MAIN ] Derivative Progress: 1874/2037 symbols completed. USFD took 1.2s. Estimated remaining: 1m 5s. Rate: 150.3 symbols/min [2025-10-06T22:46:27.754273] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-10-06T22:46:27.754338] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-06T22:46:27.757399] [INFO ] [MAIN ] Derivative Progress: 1875/2037 symbols completed. USPH took 1.1s. Estimated remaining: 1m 5s. Rate: 150.4 symbols/min [2025-10-06T22:46:27.757873] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:27.758178] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:27.757802] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:27.776404] [DEBUG] [LOCAL ] UTL: Loaded 11483 existing records from primary storage. [2025-10-06T22:46:27.776632] [INFO ] [MAIN ] UTL: Loaded 11483 primary data records. [2025-10-06T22:46:28.110687] [DEBUG] [LOCAL ] UTI: Loaded 40526 existing records from primary storage. [2025-10-06T22:46:28.123918] [INFO ] [MAIN ] UTI: Loaded 40526 primary data records. [2025-10-06T22:46:28.125087] [DEBUG] [LOCAL ] UTF: Loaded 29779 existing records from primary storage. [2025-10-06T22:46:28.136533] [INFO ] [MAIN ] UTF: Loaded 29779 primary data records. [2025-10-06T22:46:28.796702] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:28.798872] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11483 primary records. [2025-10-06T22:46:28.799355] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-06T22:46:28.829977] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:28.831212] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 29779 primary records. [2025-10-06T22:46:28.831395] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-06T22:46:28.847711] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-10-06T22:46:28.848518] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-06T22:46:28.852397] [INFO ] [MAIN ] Derivative Progress: 1876/2037 symbols completed. UTL took 1.1s. Estimated remaining: 1m 4s. Rate: 150.2 symbols/min [2025-10-06T22:46:28.867488] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:28.868032] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:28.869475] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40526 primary records. [2025-10-06T22:46:28.869570] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-06T22:46:28.871264] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-10-06T22:46:28.871989] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-06T22:46:28.874223] [INFO ] [MAIN ] Derivative Progress: 1877/2037 symbols completed. UTF took 1.1s. Estimated remaining: 1m 4s. Rate: 150.3 symbols/min [2025-10-06T22:46:28.874835] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:28.891281] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-10-06T22:46:28.891359] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-06T22:46:28.894274] [INFO ] [MAIN ] Derivative Progress: 1878/2037 symbols completed. UTI took 1.1s. Estimated remaining: 1m 3s. Rate: 150.4 symbols/min [2025-10-06T22:46:28.894515] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:28.936006] [DEBUG] [LOCAL ] UVE: Loaded 21954 existing records from primary storage. [2025-10-06T22:46:28.936245] [INFO ] [MAIN ] UVE: Loaded 21954 primary data records. [2025-10-06T22:46:29.024995] [DEBUG] [LOCAL ] UVV: Loaded 22592 existing records from primary storage. [2025-10-06T22:46:29.058544] [INFO ] [MAIN ] UVV: Loaded 22592 primary data records. [2025-10-06T22:46:29.059843] [DEBUG] [LOCAL ] UTZ: Loaded 44696 existing records from primary storage. [2025-10-06T22:46:29.101680] [INFO ] [MAIN ] UTZ: Loaded 44696 primary data records. [2025-10-06T22:46:29.896258] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:29.897270] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21954 primary records. [2025-10-06T22:46:29.897570] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-06T22:46:29.911678] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:29.921317] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22592 primary records. [2025-10-06T22:46:29.924055] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-06T22:46:29.929213] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-10-06T22:46:29.936369] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-06T22:46:29.939868] [INFO ] [MAIN ] Derivative Progress: 1879/2037 symbols completed. UVE took 1.1s. Estimated remaining: 1m 3s. Rate: 150.2 symbols/min [2025-10-06T22:46:29.945923] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:29.951084] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-10-06T22:46:29.951229] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-06T22:46:29.955110] [INFO ] [MAIN ] Derivative Progress: 1880/2037 symbols completed. UVV took 1.1s. Estimated remaining: 1m 3s. Rate: 150.3 symbols/min [2025-10-06T22:46:29.955493] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:29.969214] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:29.970387] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44696 primary records. [2025-10-06T22:46:29.970571] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-06T22:46:29.991003] [DEBUG] [LOCAL ] UZD: Loaded 6429 existing records from primary storage. [2025-10-06T22:46:29.991465] [INFO ] [MAIN ] UZD: Loaded 6429 primary data records. [2025-10-06T22:46:30.114334] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-10-06T22:46:30.114624] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-06T22:46:30.118009] [INFO ] [MAIN ] Derivative Progress: 1881/2037 symbols completed. UTZ took 1.3s. Estimated remaining: 1m 2s. Rate: 150.4 symbols/min [2025-10-06T22:46:30.123503] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:30.358872] [DEBUG] [LOCAL ] UWMC: Loaded 52835 existing records from primary storage. [2025-10-06T22:46:30.369457] [INFO ] [MAIN ] UWMC: Loaded 52835 primary data records. [2025-10-06T22:46:30.430090] [DEBUG] [LOCAL ] UZE: Loaded 7430 existing records from primary storage. [2025-10-06T22:46:30.461905] [INFO ] [MAIN ] UZE: Loaded 7430 primary data records. [2025-10-06T22:46:31.022550] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:31.024846] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6429 primary records. [2025-10-06T22:46:31.025504] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-06T22:46:31.043634] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-10-06T22:46:31.043993] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-06T22:46:31.047764] [INFO ] [MAIN ] Derivative Progress: 1882/2037 symbols completed. UZD took 1.1s. Estimated remaining: 1m 2s. Rate: 150.3 symbols/min [2025-10-06T22:46:31.049702] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:31.066331] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:31.067211] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52835 primary records. [2025-10-06T22:46:31.067559] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-06T22:46:31.103807] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-10-06T22:46:31.103974] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-06T22:46:31.104211] [DEBUG] [LOCAL ] UZF: Loaded 6382 existing records from primary storage. [2025-10-06T22:46:31.107185] [INFO ] [MAIN ] UZF: Loaded 6382 primary data records. [2025-10-06T22:46:31.106666] [INFO ] [MAIN ] Derivative Progress: 1883/2037 symbols completed. UWMC took 1.2s. Estimated remaining: 1m 1s. Rate: 150.3 symbols/min [2025-10-06T22:46:31.108024] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:31.107820] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:31.114228] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7430 primary records. [2025-10-06T22:46:31.120725] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-06T22:46:31.251912] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-10-06T22:46:31.270037] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-06T22:46:31.317610] [INFO ] [MAIN ] Derivative Progress: 1884/2037 symbols completed. UZE took 1.2s. Estimated remaining: 1m 1s. Rate: 150.4 symbols/min [2025-10-06T22:46:31.434680] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:31.478423] [DEBUG] [LOCAL ] V: Loaded 53754 existing records from primary storage. [2025-10-06T22:46:31.479050] [INFO ] [MAIN ] V: Loaded 53754 primary data records. [2025-10-06T22:46:31.568423] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:31.592437] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6382 primary records. [2025-10-06T22:46:31.619809] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-10-06T22:46:31.645599] [DEBUG] [LOCAL ] VAC: Loaded 34336 existing records from primary storage. [2025-10-06T22:46:31.671418] [INFO ] [MAIN ] VAC: Loaded 34336 primary data records. [2025-10-06T22:46:31.947112] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-10-06T22:46:31.947610] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-10-06T22:46:31.950339] [INFO ] [MAIN ] Derivative Progress: 1885/2037 symbols completed. UZF took 0.9s. Estimated remaining: 1m 1s. Rate: 150.3 symbols/min [2025-10-06T22:46:31.950844] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:32.248668] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:32.250173] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53754 primary records. [2025-10-06T22:46:32.250279] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-06T22:46:32.298196] [DEBUG] [LOCAL ] VAL: Loaded 50256 existing records from primary storage. [2025-10-06T22:46:32.299020] [INFO ] [MAIN ] VAL: Loaded 50256 primary data records. [2025-10-06T22:46:32.299289] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-10-06T22:46:32.299478] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-06T22:46:32.302277] [INFO ] [MAIN ] Derivative Progress: 1886/2037 symbols completed. V took 1.2s. Estimated remaining: 1m 0s. Rate: 150.3 symbols/min [2025-10-06T22:46:32.302723] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:32.444775] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:32.489512] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34336 primary records. [2025-10-06T22:46:32.613027] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-06T22:46:32.678995] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-10-06T22:46:32.679985] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-06T22:46:32.683418] [INFO ] [MAIN ] Derivative Progress: 1887/2037 symbols completed. VAC took 1.2s. Estimated remaining: 59.9s. Rate: 150.3 symbols/min [2025-10-06T22:46:32.685710] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-06T22:46:32.684074] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:32.686436] [INFO ] [MAIN ] VALE: Loaded 53693 primary data records. [2025-10-06T22:46:32.783441] [DEBUG] [LOCAL ] VATE: Loaded 5258 existing records from primary storage. [2025-10-06T22:46:32.797928] [INFO ] [MAIN ] VATE: Loaded 5258 primary data records. [2025-10-06T22:46:32.977694] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:32.992372] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50256 primary records. [2025-10-06T22:46:33.121369] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-06T22:46:33.345148] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-10-06T22:46:33.345461] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-06T22:46:33.348628] [INFO ] [MAIN ] Derivative Progress: 1888/2037 symbols completed. VAL took 1.4s. Estimated remaining: 59.5s. Rate: 150.3 symbols/min [2025-10-06T22:46:33.373096] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:33.374129] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53693 primary records. [2025-10-06T22:46:33.374355] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-06T22:46:33.391502] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-10-06T22:46:33.391782] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-06T22:46:33.396419] [INFO ] [MAIN ] Derivative Progress: 1889/2037 symbols completed. VALE took 1.1s. Estimated remaining: 59.1s. Rate: 150.3 symbols/min [2025-10-06T22:46:33.410608] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:33.411380] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5258 primary records. [2025-10-06T22:46:33.411441] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-06T22:46:33.426041] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-10-06T22:46:33.426139] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-06T22:46:33.429155] [INFO ] [MAIN ] Derivative Progress: 1890/2037 symbols completed. VATE took 0.7s. Estimated remaining: 58.6s. Rate: 150.4 symbols/min [2025-10-06T22:46:33.430000] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:33.429905] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:33.430728] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:33.447559] [DEBUG] [LOCAL ] VBF: Loaded 6830 existing records from primary storage. [2025-10-06T22:46:33.448050] [INFO ] [MAIN ] VBF: Loaded 6830 primary data records. [2025-10-06T22:46:33.510228] [DEBUG] [LOCAL ] VCV: Loaded 13605 existing records from primary storage. [2025-10-06T22:46:33.530876] [INFO ] [MAIN ] VCV: Loaded 13605 primary data records. [2025-10-06T22:46:33.997375] [DEBUG] [LOCAL ] VEEV: Loaded 47135 existing records from primary storage. [2025-10-06T22:46:34.037420] [INFO ] [MAIN ] VEEV: Loaded 47135 primary data records. [2025-10-06T22:46:34.550244] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:34.552409] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 6830 primary records. [2025-10-06T22:46:34.553712] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-06T22:46:34.582016] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:34.585156] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13605 primary records. [2025-10-06T22:46:34.585262] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-06T22:46:34.584245] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-10-06T22:46:34.586165] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-06T22:46:34.596870] [INFO ] [MAIN ] Derivative Progress: 1891/2037 symbols completed. VBF took 1.2s. Estimated remaining: 58.3s. Rate: 150.3 symbols/min [2025-10-06T22:46:34.598512] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:34.609560] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-10-06T22:46:34.610053] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-06T22:46:34.612718] [INFO ] [MAIN ] Derivative Progress: 1892/2037 symbols completed. VCV took 1.2s. Estimated remaining: 57.9s. Rate: 150.3 symbols/min [2025-10-06T22:46:34.616217] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:34.626263] [DEBUG] [LOCAL ] VEL: Loaded 12584 existing records from primary storage. [2025-10-06T22:46:34.626532] [INFO ] [MAIN ] VEL: Loaded 12584 primary data records. [2025-10-06T22:46:34.684202] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:34.718437] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47135 primary records. [2025-10-06T22:46:34.728902] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-06T22:46:34.994928] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-10-06T22:46:34.997365] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-06T22:46:35.000447] [INFO ] [MAIN ] Derivative Progress: 1893/2037 symbols completed. VEEV took 1.6s. Estimated remaining: 57.5s. Rate: 150.3 symbols/min [2025-10-06T22:46:35.000714] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:35.005067] [DEBUG] [LOCAL ] VET: Loaded 43963 existing records from primary storage. [2025-10-06T22:46:35.005910] [INFO ] [MAIN ] VET: Loaded 43963 primary data records. [2025-10-06T22:46:35.349954] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:35.351504] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 12584 primary records. [2025-10-06T22:46:35.351910] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-06T22:46:35.382175] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-06T22:46:35.383619] [INFO ] [MAIN ] VFC: Loaded 53607 primary data records. [2025-10-06T22:46:35.475528] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-10-06T22:46:35.491886] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-06T22:46:35.500358] [INFO ] [MAIN ] Derivative Progress: 1894/2037 symbols completed. VEL took 0.9s. Estimated remaining: 57.1s. Rate: 150.3 symbols/min [2025-10-06T22:46:35.511166] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:35.704724] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:35.716339] [DEBUG] [LOCAL ] VGI: Loaded 5152 existing records from primary storage. [2025-10-06T22:46:35.717611] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 43963 primary records. [2025-10-06T22:46:35.717963] [INFO ] [MAIN ] VGI: Loaded 5152 primary data records. [2025-10-06T22:46:35.717897] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-06T22:46:36.040177] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-10-06T22:46:36.040920] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-06T22:46:36.043697] [INFO ] [MAIN ] Derivative Progress: 1895/2037 symbols completed. VET took 1.4s. Estimated remaining: 56.7s. Rate: 150.3 symbols/min [2025-10-06T22:46:36.044111] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:36.072338] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:36.073213] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53607 primary records. [2025-10-06T22:46:36.073523] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-06T22:46:36.092900] [DEBUG] [LOCAL ] VGM: Loaded 18356 existing records from primary storage. [2025-10-06T22:46:36.094083] [INFO ] [MAIN ] VGM: Loaded 18356 primary data records. [2025-10-06T22:46:36.194229] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-10-06T22:46:36.202496] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-06T22:46:36.205133] [INFO ] [MAIN ] Derivative Progress: 1896/2037 symbols completed. VFC took 1.2s. Estimated remaining: 56.3s. Rate: 150.3 symbols/min [2025-10-06T22:46:36.208530] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:36.282938] [DEBUG] [LOCAL ] VHI: Loaded 2741 existing records from primary storage. [2025-10-06T22:46:36.303710] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:36.297816] [INFO ] [MAIN ] VHI: Loaded 2741 primary data records. [2025-10-06T22:46:36.304513] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5152 primary records. [2025-10-06T22:46:36.471845] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-06T22:46:36.779235] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-10-06T22:46:36.789384] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-06T22:46:36.792555] [INFO ] [MAIN ] Derivative Progress: 1897/2037 symbols completed. VGI took 1.3s. Estimated remaining: 55.9s. Rate: 150.3 symbols/min [2025-10-06T22:46:36.793886] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:36.816754] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:36.817572] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18356 primary records. [2025-10-06T22:46:36.817734] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-06T22:46:36.839032] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-10-06T22:46:36.851731] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-06T22:46:36.868608] [INFO ] [MAIN ] Derivative Progress: 1898/2037 symbols completed. VGM took 0.8s. Estimated remaining: 55.5s. Rate: 150.4 symbols/min [2025-10-06T22:46:36.869243] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:36.869127] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:36.870211] [INFO ] [MAIN ] VHI: Generated 1794 derivative records from 2741 primary records. [2025-10-06T22:46:36.870636] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-06T22:46:36.901969] [DEBUG] [LOCAL ] VHI: Derivative data saved (1794 records). [2025-10-06T22:46:36.902847] [DEBUG] [LOCAL ] VICI: Loaded 53647 existing records from primary storage. [2025-10-06T22:46:36.903253] [INFO ] [MAIN ] VICI: Loaded 53647 primary data records. [2025-10-06T22:46:36.903053] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-06T22:46:36.906554] [INFO ] [MAIN ] Derivative Progress: 1899/2037 symbols completed. VHI took 0.7s. Estimated remaining: 55.0s. Rate: 150.4 symbols/min [2025-10-06T22:46:36.907019] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:37.254106] [DEBUG] [LOCAL ] VIK: Loaded 52458 existing records from primary storage. [2025-10-06T22:46:37.254378] [INFO ] [MAIN ] VIK: Loaded 52458 primary data records. [2025-10-06T22:46:37.359085] [DEBUG] [LOCAL ] VIPS: Loaded 51264 existing records from primary storage. [2025-10-06T22:46:37.379897] [INFO ] [MAIN ] VIPS: Loaded 51264 primary data records. [2025-10-06T22:46:37.898902] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:37.900433] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53647 primary records. [2025-10-06T22:46:37.901051] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-06T22:46:37.937214] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-10-06T22:46:37.942774] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:37.942885] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-06T22:46:37.945632] [INFO ] [MAIN ] Derivative Progress: 1900/2037 symbols completed. VICI took 1.2s. Estimated remaining: 54.7s. Rate: 150.3 symbols/min [2025-10-06T22:46:37.946678] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52458 primary records. [2025-10-06T22:46:37.946973] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:37.947548] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-06T22:46:37.981044] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:37.982685] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51264 primary records. [2025-10-06T22:46:37.981796] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-10-06T22:46:37.982938] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-06T22:46:37.983216] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-06T22:46:37.986142] [INFO ] [MAIN ] Derivative Progress: 1901/2037 symbols completed. VIK took 1.1s. Estimated remaining: 54.3s. Rate: 150.4 symbols/min [2025-10-06T22:46:37.986671] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:38.004036] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-10-06T22:46:38.004187] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-06T22:46:38.006905] [INFO ] [MAIN ] Derivative Progress: 1902/2037 symbols completed. VIPS took 1.1s. Estimated remaining: 53.8s. Rate: 150.5 symbols/min [2025-10-06T22:46:38.007165] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:38.039061] [DEBUG] [LOCAL ] VIRT: Loaded 46743 existing records from primary storage. [2025-10-06T22:46:38.043158] [INFO ] [MAIN ] VIRT: Loaded 46743 primary data records. [2025-10-06T22:46:38.205140] [DEBUG] [LOCAL ] VIST: Loaded 46052 existing records from primary storage. [2025-10-06T22:46:38.215823] [INFO ] [MAIN ] VIST: Loaded 46052 primary data records. [2025-10-06T22:46:38.357057] [DEBUG] [LOCAL ] VIV: Loaded 44822 existing records from primary storage. [2025-10-06T22:46:38.501299] [INFO ] [MAIN ] VIV: Loaded 44822 primary data records. [2025-10-06T22:46:39.060242] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:39.061570] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46743 primary records. [2025-10-06T22:46:39.061845] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-06T22:46:39.083777] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-10-06T22:46:39.085585] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-06T22:46:39.088117] [INFO ] [MAIN ] Derivative Progress: 1903/2037 symbols completed. VIRT took 1.1s. Estimated remaining: 53.5s. Rate: 150.3 symbols/min [2025-10-06T22:46:39.115201] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:39.115596] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:39.116355] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 46052 primary records. [2025-10-06T22:46:39.117041] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-06T22:46:39.116996] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 44822 primary records. [2025-10-06T22:46:39.117825] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-06T22:46:39.146441] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-10-06T22:46:39.147040] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-06T22:46:39.150230] [INFO ] [MAIN ] Derivative Progress: 1904/2037 symbols completed. VIV took 1.1s. Estimated remaining: 53.1s. Rate: 150.4 symbols/min [2025-10-06T22:46:39.152214] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-10-06T22:46:39.152438] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-06T22:46:39.155124] [INFO ] [MAIN ] Derivative Progress: 1905/2037 symbols completed. VIST took 1.2s. Estimated remaining: 52.6s. Rate: 150.5 symbols/min [2025-10-06T22:46:39.155721] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:39.155589] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:39.155809] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:39.175864] [DEBUG] [LOCAL ] VKQ: Loaded 17502 existing records from primary storage. [2025-10-06T22:46:39.176093] [INFO ] [MAIN ] VKQ: Loaded 17502 primary data records. [2025-10-06T22:46:39.308232] [DEBUG] [LOCAL ] VLN: Loaded 29417 existing records from primary storage. [2025-10-06T22:46:39.324036] [INFO ] [MAIN ] VLN: Loaded 29417 primary data records. [2025-10-06T22:46:39.649282] [DEBUG] [LOCAL ] VLO: Loaded 53078 existing records from primary storage. [2025-10-06T22:46:39.649536] [INFO ] [MAIN ] VLO: Loaded 53078 primary data records. [2025-10-06T22:46:40.226604] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:40.228200] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17502 primary records. [2025-10-06T22:46:40.228624] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-06T22:46:40.247010] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-10-06T22:46:40.247245] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-06T22:46:40.249788] [INFO ] [MAIN ] Derivative Progress: 1906/2037 symbols completed. VKQ took 1.1s. Estimated remaining: 52.3s. Rate: 150.3 symbols/min [2025-10-06T22:46:40.253086] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:40.266811] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:40.268002] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 29417 primary records. [2025-10-06T22:46:40.268184] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-06T22:46:40.288748] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-10-06T22:46:40.288891] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-06T22:46:40.291429] [INFO ] [MAIN ] Derivative Progress: 1907/2037 symbols completed. VLN took 1.1s. Estimated remaining: 51.9s. Rate: 150.4 symbols/min [2025-10-06T22:46:40.305311] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:40.305178] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:40.306696] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53078 primary records. [2025-10-06T22:46:40.306843] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-06T22:46:40.334080] [DEBUG] [LOCAL ] VLT: Loaded 4567 existing records from primary storage. [2025-10-06T22:46:40.334461] [INFO ] [MAIN ] VLT: Loaded 4567 primary data records. [2025-10-06T22:46:40.437200] [DEBUG] [LOCAL ] VLRS: Loaded 40255 existing records from primary storage. [2025-10-06T22:46:40.457996] [INFO ] [MAIN ] VLRS: Loaded 40255 primary data records. [2025-10-06T22:46:40.489597] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-10-06T22:46:40.522347] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-06T22:46:40.559048] [INFO ] [MAIN ] Derivative Progress: 1908/2037 symbols completed. VLO took 1.4s. Estimated remaining: 51.5s. Rate: 150.4 symbols/min [2025-10-06T22:46:40.564433] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:41.034302] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:41.035346] [DEBUG] [LOCAL ] VLTO: Loaded 46078 existing records from primary storage. [2025-10-06T22:46:41.037173] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4567 primary records. [2025-10-06T22:46:41.037399] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-06T22:46:41.037268] [INFO ] [MAIN ] VLTO: Loaded 46078 primary data records. [2025-10-06T22:46:41.129767] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-10-06T22:46:41.147696] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-06T22:46:41.169470] [INFO ] [MAIN ] Derivative Progress: 1909/2037 symbols completed. VLT took 0.9s. Estimated remaining: 51.1s. Rate: 150.4 symbols/min [2025-10-06T22:46:41.170154] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:41.169997] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:41.175589] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 40255 primary records. [2025-10-06T22:46:41.191392] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-06T22:46:41.392932] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-10-06T22:46:41.393236] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-06T22:46:41.396414] [INFO ] [MAIN ] Derivative Progress: 1910/2037 symbols completed. VLRS took 1.1s. Estimated remaining: 50.7s. Rate: 150.4 symbols/min [2025-10-06T22:46:41.396801] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:41.429863] [DEBUG] [LOCAL ] VMC: Loaded 43049 existing records from primary storage. [2025-10-06T22:46:41.434584] [INFO ] [MAIN ] VMC: Loaded 43049 primary data records. [2025-10-06T22:46:41.529145] [DEBUG] [LOCAL ] VMI: Loaded 15475 existing records from primary storage. [2025-10-06T22:46:41.548423] [INFO ] [MAIN ] VMI: Loaded 15475 primary data records. [2025-10-06T22:46:41.693287] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:41.739191] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46078 primary records. [2025-10-06T22:46:41.876312] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-06T22:46:42.088889] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-10-06T22:46:42.089229] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-06T22:46:42.092103] [INFO ] [MAIN ] Derivative Progress: 1911/2037 symbols completed. VLTO took 1.5s. Estimated remaining: 50.3s. Rate: 150.4 symbols/min [2025-10-06T22:46:42.093054] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:42.116213] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:42.119883] [DEBUG] [LOCAL ] VNCE: Loaded 8381 existing records from primary storage. [2025-10-06T22:46:42.120186] [INFO ] [MAIN ] VNCE: Loaded 8381 primary data records. [2025-10-06T22:46:42.120954] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 43049 primary records. [2025-10-06T22:46:42.182427] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-06T22:46:42.271460] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:42.277832] [INFO ] [MAIN ] VMI: Generated 1794 derivative records from 15475 primary records. [2025-10-06T22:46:42.283245] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-06T22:46:42.533774] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-10-06T22:46:42.534762] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-06T22:46:42.539814] [INFO ] [MAIN ] Derivative Progress: 1912/2037 symbols completed. VMC took 1.4s. Estimated remaining: 49.9s. Rate: 150.4 symbols/min [2025-10-06T22:46:42.541851] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:42.549485] [DEBUG] [LOCAL ] VMI: Derivative data saved (1794 records). [2025-10-06T22:46:42.550581] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-06T22:46:42.553699] [INFO ] [MAIN ] Derivative Progress: 1913/2037 symbols completed. VMI took 1.2s. Estimated remaining: 49.5s. Rate: 150.4 symbols/min [2025-10-06T22:46:42.553953] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:42.585762] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:42.586876] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 8381 primary records. [2025-10-06T22:46:42.586988] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-06T22:46:42.626494] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-10-06T22:46:42.626695] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-06T22:46:42.630217] [INFO ] [MAIN ] Derivative Progress: 1914/2037 symbols completed. VNCE took 0.5s. Estimated remaining: 49.0s. Rate: 150.5 symbols/min [2025-10-06T22:46:42.630574] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:42.666076] [DEBUG] [LOCAL ] VNT: Loaded 43570 existing records from primary storage. [2025-10-06T22:46:42.666541] [INFO ] [MAIN ] VNT: Loaded 43570 primary data records. [2025-10-06T22:46:42.679390] [DEBUG] [LOCAL ] VNO: Loaded 48836 existing records from primary storage. [2025-10-06T22:46:42.702511] [INFO ] [MAIN ] VNO: Loaded 48836 primary data records. [2025-10-06T22:46:42.827027] [DEBUG] [LOCAL ] VOC: Loaded 8980 existing records from primary storage. [2025-10-06T22:46:42.840580] [INFO ] [MAIN ] VOC: Loaded 8980 primary data records. [2025-10-06T22:46:43.677772] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:43.678848] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43570 primary records. [2025-10-06T22:46:43.679027] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-06T22:46:43.710549] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:43.712890] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48836 primary records. [2025-10-06T22:46:43.714923] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-06T22:46:43.716680] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-10-06T22:46:43.717046] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-06T22:46:43.719836] [INFO ] [MAIN ] Derivative Progress: 1915/2037 symbols completed. VNT took 1.2s. Estimated remaining: 48.7s. Rate: 150.4 symbols/min [2025-10-06T22:46:43.730868] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:43.745926] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:43.747368] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 8980 primary records. [2025-10-06T22:46:43.747950] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-06T22:46:43.762345] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-10-06T22:46:43.763223] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-06T22:46:43.766825] [INFO ] [MAIN ] Derivative Progress: 1916/2037 symbols completed. VNO took 1.2s. Estimated remaining: 48.3s. Rate: 150.4 symbols/min [2025-10-06T22:46:43.767743] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:43.770308] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-10-06T22:46:43.770455] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-06T22:46:43.773188] [INFO ] [MAIN ] Derivative Progress: 1917/2037 symbols completed. VOC took 1.1s. Estimated remaining: 47.8s. Rate: 150.5 symbols/min [2025-10-06T22:46:43.773408] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:43.807874] [DEBUG] [LOCAL ] VPV: Loaded 5347 existing records from primary storage. [2025-10-06T22:46:43.808858] [DEBUG] [LOCAL ] VOYA: Loaded 42371 existing records from primary storage. [2025-10-06T22:46:43.814454] [INFO ] [MAIN ] VPV: Loaded 5347 primary data records. [2025-10-06T22:46:43.809008] [INFO ] [MAIN ] VOYA: Loaded 42371 primary data records. [2025-10-06T22:46:43.850961] [DEBUG] [LOCAL ] VPG: Loaded 17118 existing records from primary storage. [2025-10-06T22:46:43.900438] [INFO ] [MAIN ] VPG: Loaded 17118 primary data records. [2025-10-06T22:46:44.801699] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:44.808211] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5347 primary records. [2025-10-06T22:46:44.808553] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-06T22:46:44.810125] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:44.811162] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17118 primary records. [2025-10-06T22:46:44.819341] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-06T22:46:44.836137] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:44.844602] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42371 primary records. [2025-10-06T22:46:44.848914] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-06T22:46:44.862013] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-10-06T22:46:44.865059] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-06T22:46:44.867659] [INFO ] [MAIN ] Derivative Progress: 1918/2037 symbols completed. VPV took 1.1s. Estimated remaining: 47.5s. Rate: 150.4 symbols/min [2025-10-06T22:46:44.875203] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-10-06T22:46:44.875308] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-06T22:46:44.877931] [INFO ] [MAIN ] Derivative Progress: 1919/2037 symbols completed. VOYA took 1.1s. Estimated remaining: 47.1s. Rate: 150.4 symbols/min [2025-10-06T22:46:44.874862] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-10-06T22:46:44.878192] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-06T22:46:44.881403] [INFO ] [MAIN ] Derivative Progress: 1920/2037 symbols completed. VPG took 1.1s. Estimated remaining: 46.6s. Rate: 150.5 symbols/min [2025-10-06T22:46:44.881868] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:44.882016] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:44.881939] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:44.897156] [DEBUG] [LOCAL ] VRTS: Loaded 9309 existing records from primary storage. [2025-10-06T22:46:44.897299] [INFO ] [MAIN ] VRTS: Loaded 9309 primary data records. [2025-10-06T22:46:45.116942] [DEBUG] [LOCAL ] VRE: Loaded 35130 existing records from primary storage. [2025-10-06T22:46:45.232575] [INFO ] [MAIN ] VRE: Loaded 35130 primary data records. [2025-10-06T22:46:45.357891] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-06T22:46:45.368187] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-10-06T22:46:45.906299] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:45.907856] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9309 primary records. [2025-10-06T22:46:45.908168] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-06T22:46:45.929991] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-10-06T22:46:45.930721] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-06T22:46:45.933869] [INFO ] [MAIN ] Derivative Progress: 1921/2037 symbols completed. VRTS took 1.1s. Estimated remaining: 46.3s. Rate: 150.4 symbols/min [2025-10-06T22:46:45.934410] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:45.949043] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:45.950034] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 35130 primary records. [2025-10-06T22:46:45.950183] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-06T22:46:45.967750] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-10-06T22:46:45.968720] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-06T22:46:45.971714] [INFO ] [MAIN ] Derivative Progress: 1922/2037 symbols completed. VRE took 1.1s. Estimated remaining: 45.9s. Rate: 150.5 symbols/min [2025-10-06T22:46:45.972867] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:45.986928] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:45.987625] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-10-06T22:46:45.987774] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-06T22:46:46.007528] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-10-06T22:46:46.007970] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-06T22:46:46.010874] [INFO ] [MAIN ] Derivative Progress: 1923/2037 symbols completed. VRT took 1.1s. Estimated remaining: 45.4s. Rate: 150.5 symbols/min [2025-10-06T22:46:46.011338] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:46.079702] [DEBUG] [LOCAL ] VSCO: Loaded 52754 existing records from primary storage. [2025-10-06T22:46:46.080779] [DEBUG] [LOCAL ] VSH: Loaded 48303 existing records from primary storage. [2025-10-06T22:46:46.080102] [INFO ] [MAIN ] VSCO: Loaded 52754 primary data records. [2025-10-06T22:46:46.081264] [INFO ] [MAIN ] VSH: Loaded 48303 primary data records. [2025-10-06T22:46:46.475963] [DEBUG] [LOCAL ] VST: Loaded 53718 existing records from primary storage. [2025-10-06T22:46:46.486056] [INFO ] [MAIN ] VST: Loaded 53718 primary data records. [2025-10-06T22:46:47.122901] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:47.123779] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52754 primary records. [2025-10-06T22:46:47.123974] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-06T22:46:47.124217] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:47.126685] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48303 primary records. [2025-10-06T22:46:47.138275] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-06T22:46:47.158007] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-10-06T22:46:47.158251] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-06T22:46:47.162269] [INFO ] [MAIN ] Derivative Progress: 1924/2037 symbols completed. VSH took 1.2s. Estimated remaining: 45.1s. Rate: 150.4 symbols/min [2025-10-06T22:46:47.162712] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:47.163956] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-10-06T22:46:47.165184] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-06T22:46:47.169100] [INFO ] [MAIN ] Derivative Progress: 1925/2037 symbols completed. VSCO took 1.2s. Estimated remaining: 44.7s. Rate: 150.5 symbols/min [2025-10-06T22:46:47.170389] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:47.184345] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:47.185242] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53718 primary records. [2025-10-06T22:46:47.185307] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-06T22:46:47.204609] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-10-06T22:46:47.204914] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-06T22:46:47.209083] [INFO ] [MAIN ] Derivative Progress: 1926/2037 symbols completed. VST took 1.2s. Estimated remaining: 44.2s. Rate: 150.5 symbols/min [2025-10-06T22:46:47.209421] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:47.264393] [DEBUG] [LOCAL ] VTEX: Loaded 43018 existing records from primary storage. [2025-10-06T22:46:47.263795] [DEBUG] [LOCAL ] VSTS: Loaded 49025 existing records from primary storage. [2025-10-06T22:46:47.264713] [INFO ] [MAIN ] VSTS: Loaded 49025 primary data records. [2025-10-06T22:46:47.264812] [INFO ] [MAIN ] VTEX: Loaded 43018 primary data records. [2025-10-06T22:46:47.770451] [DEBUG] [LOCAL ] VTLE: Loaded 48355 existing records from primary storage. [2025-10-06T22:46:47.885018] [INFO ] [MAIN ] VTLE: Loaded 48355 primary data records. [2025-10-06T22:46:48.214772] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:48.216611] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 43018 primary records. [2025-10-06T22:46:48.217247] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-06T22:46:48.250508] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:48.252153] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 49025 primary records. [2025-10-06T22:46:48.252717] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-06T22:46:48.253307] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-10-06T22:46:48.254347] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-06T22:46:48.267985] [INFO ] [MAIN ] Derivative Progress: 1927/2037 symbols completed. VTEX took 1.1s. Estimated remaining: 43.9s. Rate: 150.4 symbols/min [2025-10-06T22:46:48.268520] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:48.289441] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-10-06T22:46:48.289861] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:48.295200] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48355 primary records. [2025-10-06T22:46:48.289922] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-06T22:46:48.297875] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-06T22:46:48.297771] [INFO ] [MAIN ] Derivative Progress: 1928/2037 symbols completed. VSTS took 1.1s. Estimated remaining: 43.5s. Rate: 150.5 symbols/min [2025-10-06T22:46:48.298578] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:48.307104] [DEBUG] [LOCAL ] VTMX: Loaded 17569 existing records from primary storage. [2025-10-06T22:46:48.307236] [INFO ] [MAIN ] VTMX: Loaded 17569 primary data records. [2025-10-06T22:46:48.429872] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-10-06T22:46:48.430148] [DEBUG] [LOCAL ] VTN: Loaded 7017 existing records from primary storage. [2025-10-06T22:46:48.430872] [INFO ] [MAIN ] VTN: Loaded 7017 primary data records. [2025-10-06T22:46:48.430372] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-06T22:46:48.445194] [INFO ] [MAIN ] Derivative Progress: 1929/2037 symbols completed. VTLE took 1.2s. Estimated remaining: 43.1s. Rate: 150.5 symbols/min [2025-10-06T22:46:48.475296] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:48.917316] [DEBUG] [LOCAL ] VTOL: Loaded 19528 existing records from primary storage. [2025-10-06T22:46:48.977482] [INFO ] [MAIN ] VTOL: Loaded 19528 primary data records. [2025-10-06T22:46:49.324903] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:49.327717] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17569 primary records. [2025-10-06T22:46:49.328020] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-06T22:46:49.356601] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:49.359223] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-10-06T22:46:49.359400] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-06T22:46:49.362364] [INFO ] [MAIN ] Derivative Progress: 1930/2037 symbols completed. VTMX took 1.1s. Estimated remaining: 42.7s. Rate: 150.4 symbols/min [2025-10-06T22:46:49.363553] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7017 primary records. [2025-10-06T22:46:49.362629] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:49.363828] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-06T22:46:49.396345] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-10-06T22:46:49.396878] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:49.397054] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-06T22:46:49.400263] [INFO ] [MAIN ] Derivative Progress: 1931/2037 symbols completed. VTN took 1.1s. Estimated remaining: 42.3s. Rate: 150.5 symbols/min [2025-10-06T22:46:49.400507] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:49.401109] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19528 primary records. [2025-10-06T22:46:49.401176] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-06T22:46:49.419825] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-10-06T22:46:49.420121] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-06T22:46:49.423224] [INFO ] [MAIN ] Derivative Progress: 1932/2037 symbols completed. VTOL took 0.9s. Estimated remaining: 41.8s. Rate: 150.6 symbols/min [2025-10-06T22:46:49.423482] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:49.480443] [DEBUG] [LOCAL ] VTR: Loaded 52807 existing records from primary storage. [2025-10-06T22:46:49.480836] [INFO ] [MAIN ] VTR: Loaded 52807 primary data records. [2025-10-06T22:46:49.605008] [DEBUG] [LOCAL ] VVR: Loaded 31678 existing records from primary storage. [2025-10-06T22:46:49.604500] [DEBUG] [LOCAL ] VTS: Loaded 30296 existing records from primary storage. [2025-10-06T22:46:49.605251] [INFO ] [MAIN ] VVR: Loaded 31678 primary data records. [2025-10-06T22:46:49.605326] [INFO ] [MAIN ] VTS: Loaded 30296 primary data records. [2025-10-06T22:46:50.500543] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:50.501968] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52807 primary records. [2025-10-06T22:46:50.502352] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-06T22:46:50.536369] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:50.545338] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-10-06T22:46:50.546095] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 31678 primary records. [2025-10-06T22:46:50.546216] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-06T22:46:50.546324] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-06T22:46:50.553410] [INFO ] [MAIN ] Derivative Progress: 1933/2037 symbols completed. VTR took 1.2s. Estimated remaining: 41.5s. Rate: 150.4 symbols/min [2025-10-06T22:46:50.565713] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:50.566833] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30296 primary records. [2025-10-06T22:46:50.567124] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-06T22:46:50.586204] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-10-06T22:46:50.586478] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-10-06T22:46:50.586616] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-06T22:46:50.586555] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-06T22:46:50.590377] [INFO ] [MAIN ] Derivative Progress: 1934/2037 symbols completed. VTS took 1.2s. Estimated remaining: 41.1s. Rate: 150.5 symbols/min [2025-10-06T22:46:50.593819] [INFO ] [MAIN ] Derivative Progress: 1935/2037 symbols completed. VVR took 1.2s. Estimated remaining: 40.6s. Rate: 150.6 symbols/min [2025-10-06T22:46:50.594249] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:50.594185] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:50.594363] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:50.635993] [DEBUG] [LOCAL ] VVX: Loaded 23022 existing records from primary storage. [2025-10-06T22:46:50.636177] [INFO ] [MAIN ] VVX: Loaded 23022 primary data records. [2025-10-06T22:46:50.769253] [DEBUG] [LOCAL ] VYX: Loaded 48663 existing records from primary storage. [2025-10-06T22:46:50.783248] [INFO ] [MAIN ] VYX: Loaded 48663 primary data records. [2025-10-06T22:46:50.795815] [DEBUG] [LOCAL ] VVV: Loaded 50235 existing records from primary storage. [2025-10-06T22:46:50.846673] [INFO ] [MAIN ] VVV: Loaded 50235 primary data records. [2025-10-06T22:46:51.617377] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:51.618940] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 23022 primary records. [2025-10-06T22:46:51.619083] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-06T22:46:51.638825] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-10-06T22:46:51.640671] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-06T22:46:51.646154] [INFO ] [MAIN ] Derivative Progress: 1936/2037 symbols completed. VVX took 1.1s. Estimated remaining: 40.3s. Rate: 150.4 symbols/min [2025-10-06T22:46:51.646828] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:51.668235] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:51.674550] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 48663 primary records. [2025-10-06T22:46:51.675001] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-06T22:46:51.674898] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:51.676227] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50235 primary records. [2025-10-06T22:46:51.676679] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-06T22:46:51.716704] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-10-06T22:46:51.718122] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-10-06T22:46:51.718230] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-06T22:46:51.717462] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-06T22:46:51.721213] [INFO ] [MAIN ] Derivative Progress: 1937/2037 symbols completed. VVV took 1.1s. Estimated remaining: 39.9s. Rate: 150.5 symbols/min [2025-10-06T22:46:51.724810] [INFO ] [MAIN ] Derivative Progress: 1938/2037 symbols completed. VYX took 1.1s. Estimated remaining: 39.4s. Rate: 150.6 symbols/min [2025-10-06T22:46:51.725058] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:51.724736] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:51.768316] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-06T22:46:51.768596] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-06T22:46:52.013230] [DEBUG] [LOCAL ] W: Loaded 53449 existing records from primary storage. [2025-10-06T22:46:52.120806] [INFO ] [MAIN ] W: Loaded 53449 primary data records. [2025-10-06T22:46:52.120532] [DEBUG] [LOCAL ] WAB: Loaded 44071 existing records from primary storage. [2025-10-06T22:46:52.153248] [INFO ] [MAIN ] WAB: Loaded 44071 primary data records. [2025-10-06T22:46:52.834890] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:52.836991] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-10-06T22:46:52.837225] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-06T22:46:52.855021] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-10-06T22:46:52.855628] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-06T22:46:52.858132] [INFO ] [MAIN ] Derivative Progress: 1939/2037 symbols completed. VZ took 1.2s. Estimated remaining: 39.1s. Rate: 150.4 symbols/min [2025-10-06T22:46:52.858453] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:52.878774] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:52.879600] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53449 primary records. [2025-10-06T22:46:52.879840] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-06T22:46:52.893367] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:52.901360] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44071 primary records. [2025-10-06T22:46:52.905019] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-06T22:46:52.920991] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-10-06T22:46:52.924943] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-06T22:46:52.928307] [INFO ] [MAIN ] Derivative Progress: 1940/2037 symbols completed. W took 1.2s. Estimated remaining: 38.7s. Rate: 150.5 symbols/min [2025-10-06T22:46:52.928513] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:52.934260] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-10-06T22:46:52.944419] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-06T22:46:52.947370] [INFO ] [MAIN ] Derivative Progress: 1941/2037 symbols completed. WAB took 1.2s. Estimated remaining: 38.3s. Rate: 150.6 symbols/min [2025-10-06T22:46:52.947697] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:52.967860] [DEBUG] [LOCAL ] WAL: Loaded 45159 existing records from primary storage. [2025-10-06T22:46:52.968171] [INFO ] [MAIN ] WAL: Loaded 45159 primary data records. [2025-10-06T22:46:53.162890] [DEBUG] [LOCAL ] WAT: Loaded 35451 existing records from primary storage. [2025-10-06T22:46:53.307203] [INFO ] [MAIN ] WAT: Loaded 35451 primary data records. [2025-10-06T22:46:53.411339] [DEBUG] [LOCAL ] WBS: Loaded 48718 existing records from primary storage. [2025-10-06T22:46:53.433838] [INFO ] [MAIN ] WBS: Loaded 48718 primary data records. [2025-10-06T22:46:53.947786] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:53.948896] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45159 primary records. [2025-10-06T22:46:53.949357] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-06T22:46:53.967343] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-10-06T22:46:53.968371] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-06T22:46:53.971780] [INFO ] [MAIN ] Derivative Progress: 1942/2037 symbols completed. WAL took 1.1s. Estimated remaining: 37.9s. Rate: 150.5 symbols/min [2025-10-06T22:46:53.974121] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:53.988923] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:53.989774] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35451 primary records. [2025-10-06T22:46:53.990285] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-06T22:46:54.025145] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:54.025889] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48718 primary records. [2025-10-06T22:46:54.024777] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-10-06T22:46:54.025983] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-06T22:46:54.030372] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-06T22:46:54.034066] [DEBUG] [LOCAL ] WBX: Loaded 11130 existing records from primary storage. [2025-10-06T22:46:54.033661] [INFO ] [MAIN ] Derivative Progress: 1943/2037 symbols completed. WAT took 1.1s. Estimated remaining: 37.5s. Rate: 150.5 symbols/min [2025-10-06T22:46:54.034293] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:54.042022] [INFO ] [MAIN ] WBX: Loaded 11130 primary data records. [2025-10-06T22:46:54.175408] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-10-06T22:46:54.186442] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-06T22:46:54.238294] [INFO ] [MAIN ] Derivative Progress: 1944/2037 symbols completed. WBS took 1.3s. Estimated remaining: 37.1s. Rate: 150.6 symbols/min [2025-10-06T22:46:54.265524] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:54.407715] [DEBUG] [LOCAL ] WCC: Loaded 39285 existing records from primary storage. [2025-10-06T22:46:54.408689] [INFO ] [MAIN ] WCC: Loaded 39285 primary data records. [2025-10-06T22:46:54.778789] [DEBUG] [LOCAL ] WCN: Loaded 47931 existing records from primary storage. [2025-10-06T22:46:54.782795] [INFO ] [MAIN ] WCN: Loaded 47931 primary data records. [2025-10-06T22:46:54.900830] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:54.901730] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 11130 primary records. [2025-10-06T22:46:54.901978] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-06T22:46:55.117322] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-10-06T22:46:55.117962] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-06T22:46:55.121748] [INFO ] [MAIN ] Derivative Progress: 1945/2037 symbols completed. WBX took 1.1s. Estimated remaining: 36.7s. Rate: 150.5 symbols/min [2025-10-06T22:46:55.123157] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:55.138973] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:55.140254] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 39285 primary records. [2025-10-06T22:46:55.140558] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-06T22:46:55.160246] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-10-06T22:46:55.160386] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-06T22:46:55.163323] [INFO ] [MAIN ] Derivative Progress: 1946/2037 symbols completed. WCC took 1.1s. Estimated remaining: 36.3s. Rate: 150.5 symbols/min [2025-10-06T22:46:55.169187] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:55.184253] [DEBUG] [LOCAL ] WD: Loaded 23201 existing records from primary storage. [2025-10-06T22:46:55.197372] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:55.197158] [INFO ] [MAIN ] WD: Loaded 23201 primary data records. [2025-10-06T22:46:55.198170] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 47931 primary records. [2025-10-06T22:46:55.198276] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-06T22:46:55.319281] [DEBUG] [LOCAL ] WDH: Loaded 17903 existing records from primary storage. [2025-10-06T22:46:55.340237] [INFO ] [MAIN ] WDH: Loaded 17903 primary data records. [2025-10-06T22:46:55.440487] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-10-06T22:46:55.489463] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-06T22:46:55.504776] [INFO ] [MAIN ] Derivative Progress: 1947/2037 symbols completed. WCN took 1.2s. Estimated remaining: 35.9s. Rate: 150.5 symbols/min [2025-10-06T22:46:55.640022] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:55.875944] [DEBUG] [LOCAL ] WDI: Loaded 21121 existing records from primary storage. [2025-10-06T22:46:55.877326] [INFO ] [MAIN ] WDI: Loaded 21121 primary data records. [2025-10-06T22:46:56.198747] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:56.199690] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23201 primary records. [2025-10-06T22:46:56.200549] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-06T22:46:56.231227] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:56.235304] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 17903 primary records. [2025-10-06T22:46:56.236596] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-06T22:46:56.236426] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-10-06T22:46:56.237593] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-06T22:46:56.240567] [INFO ] [MAIN ] Derivative Progress: 1948/2037 symbols completed. WD took 1.1s. Estimated remaining: 35.5s. Rate: 150.5 symbols/min [2025-10-06T22:46:56.256503] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-10-06T22:46:56.256718] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-06T22:46:56.259461] [INFO ] [MAIN ] Derivative Progress: 1949/2037 symbols completed. WDH took 1.1s. Estimated remaining: 35.1s. Rate: 150.6 symbols/min [2025-10-06T22:46:56.274361] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:56.274935] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21121 primary records. [2025-10-06T22:46:56.274995] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-06T22:46:56.290293] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-10-06T22:46:56.290353] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-06T22:46:56.293233] [INFO ] [MAIN ] Derivative Progress: 1950/2037 symbols completed. WDI took 0.7s. Estimated remaining: 34.7s. Rate: 150.6 symbols/min [2025-10-06T22:46:56.293705] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:56.293797] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:56.293897] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:56.307598] [DEBUG] [LOCAL ] WEA: Loaded 7348 existing records from primary storage. [2025-10-06T22:46:56.307976] [INFO ] [MAIN ] WEA: Loaded 7348 primary data records. [2025-10-06T22:46:56.540156] [DEBUG] [LOCAL ] WEAV: Loaded 41857 existing records from primary storage. [2025-10-06T22:46:56.615252] [INFO ] [MAIN ] WEAV: Loaded 41857 primary data records. [2025-10-06T22:46:56.729871] [DEBUG] [LOCAL ] WDS: Loaded 43125 existing records from primary storage. [2025-10-06T22:46:56.748512] [INFO ] [MAIN ] WDS: Loaded 43125 primary data records. [2025-10-06T22:46:57.328189] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:57.329338] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7348 primary records. [2025-10-06T22:46:57.329532] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-06T22:46:57.363179] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:57.363967] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 41857 primary records. [2025-10-06T22:46:57.362739] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-10-06T22:46:57.364062] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-06T22:46:57.364217] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-06T22:46:57.367053] [INFO ] [MAIN ] Derivative Progress: 1951/2037 symbols completed. WEA took 1.1s. Estimated remaining: 34.3s. Rate: 150.5 symbols/min [2025-10-06T22:46:57.367220] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:57.399406] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:57.400727] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43125 primary records. [2025-10-06T22:46:57.401275] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-06T22:46:57.412493] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-10-06T22:46:57.415234] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-06T22:46:57.417918] [INFO ] [MAIN ] Derivative Progress: 1952/2037 symbols completed. WEAV took 1.1s. Estimated remaining: 33.9s. Rate: 150.6 symbols/min [2025-10-06T22:46:57.418446] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:57.428030] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-10-06T22:46:57.428241] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-06T22:46:57.432616] [INFO ] [MAIN ] Derivative Progress: 1953/2037 symbols completed. WDS took 1.1s. Estimated remaining: 33.5s. Rate: 150.6 symbols/min [2025-10-06T22:46:57.433185] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:57.499806] [DEBUG] [LOCAL ] WEC: Loaded 52183 existing records from primary storage. [2025-10-06T22:46:57.500141] [INFO ] [MAIN ] WEC: Loaded 52183 primary data records. [2025-10-06T22:46:57.629082] [DEBUG] [LOCAL ] WELL: Loaded 52352 existing records from primary storage. [2025-10-06T22:46:57.629291] [INFO ] [MAIN ] WELL: Loaded 52352 primary data records. [2025-10-06T22:46:57.816110] [DEBUG] [LOCAL ] WES: Loaded 48203 existing records from primary storage. [2025-10-06T22:46:57.951282] [INFO ] [MAIN ] WES: Loaded 48203 primary data records. [2025-10-06T22:46:58.565130] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:58.568566] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52183 primary records. [2025-10-06T22:46:58.568875] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-06T22:46:58.601974] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:46:58.605174] [INFO ] [MAIN ] WELL: Generated 1793 derivative records from 52352 primary records. [2025-10-06T22:46:58.605853] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-06T22:46:58.642137] [DEBUG] [LOCAL ] WELL: Derivative data saved (1793 records). [2025-10-06T22:46:58.642751] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-06T22:46:58.641683] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-10-06T22:46:58.643030] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-06T22:46:58.646163] [INFO ] [MAIN ] Derivative Progress: 1954/2037 symbols completed. WELL took 1.2s. Estimated remaining: 33.1s. Rate: 150.5 symbols/min [2025-10-06T22:46:58.642578] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:58.646335] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:58.648926] [INFO ] [MAIN ] Derivative Progress: 1955/2037 symbols completed. WEC took 1.3s. Estimated remaining: 32.7s. Rate: 150.6 symbols/min [2025-10-06T22:46:58.649098] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:58.650385] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48203 primary records. [2025-10-06T22:46:58.651346] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-06T22:46:58.679088] [DEBUG] [LOCAL ] WF: Loaded 10717 existing records from primary storage. [2025-10-06T22:46:58.680183] [INFO ] [MAIN ] WF: Loaded 10717 primary data records. [2025-10-06T22:46:58.738797] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-10-06T22:46:58.781361] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-06T22:46:58.808160] [INFO ] [MAIN ] Derivative Progress: 1956/2037 symbols completed. WES took 1.4s. Estimated remaining: 32.3s. Rate: 150.6 symbols/min [2025-10-06T22:46:58.814399] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:58.872935] [DEBUG] [LOCAL ] WEX: Loaded 34032 existing records from primary storage. [2025-10-06T22:46:58.909445] [INFO ] [MAIN ] WEX: Loaded 34032 primary data records. [2025-10-06T22:46:59.403359] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-06T22:46:59.404191] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-06T22:46:59.551949] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:59.571119] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10717 primary records. [2025-10-06T22:46:59.596964] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-06T22:46:59.788276] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-10-06T22:46:59.789027] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-06T22:46:59.793038] [INFO ] [MAIN ] Derivative Progress: 1957/2037 symbols completed. WF took 1.1s. Estimated remaining: 31.9s. Rate: 150.5 symbols/min [2025-10-06T22:46:59.795216] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:59.814294] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:59.815429] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 34032 primary records. [2025-10-06T22:46:59.815596] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-06T22:46:59.845154] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-10-06T22:46:59.845357] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-06T22:46:59.849178] [INFO ] [MAIN ] Derivative Progress: 1958/2037 symbols completed. WEX took 1.2s. Estimated remaining: 31.5s. Rate: 150.6 symbols/min [2025-10-06T22:46:59.850674] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:46:59.863206] [DEBUG] [LOCAL ] WFG: Loaded 24705 existing records from primary storage. [2025-10-06T22:46:59.863622] [INFO ] [MAIN ] WFG: Loaded 24705 primary data records. [2025-10-06T22:46:59.899976] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:46:59.917411] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-10-06T22:46:59.947492] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-06T22:47:00.251887] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-10-06T22:47:00.252897] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-06T22:47:00.256950] [INFO ] [MAIN ] Derivative Progress: 1959/2037 symbols completed. WFC took 1.4s. Estimated remaining: 31.1s. Rate: 150.6 symbols/min [2025-10-06T22:47:00.257415] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:00.271504] [DEBUG] [LOCAL ] WGO: Loaded 38647 existing records from primary storage. [2025-10-06T22:47:00.272637] [INFO ] [MAIN ] WGO: Loaded 38647 primary data records. [2025-10-06T22:47:00.639532] [DEBUG] [LOCAL ] WH: Loaded 45361 existing records from primary storage. [2025-10-06T22:47:00.641089] [INFO ] [MAIN ] WH: Loaded 45361 primary data records. [2025-10-06T22:47:00.753757] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:00.773519] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24705 primary records. [2025-10-06T22:47:00.867174] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-06T22:47:01.122415] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-10-06T22:47:01.122875] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-06T22:47:01.122730] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:01.126303] [INFO ] [MAIN ] Derivative Progress: 1960/2037 symbols completed. WFG took 1.3s. Estimated remaining: 30.7s. Rate: 150.5 symbols/min [2025-10-06T22:47:01.123728] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 38647 primary records. [2025-10-06T22:47:01.127326] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:01.127844] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-06T22:47:01.149661] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-10-06T22:47:01.149970] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-06T22:47:01.153071] [INFO ] [MAIN ] Derivative Progress: 1961/2037 symbols completed. WGO took 1.3s. Estimated remaining: 30.3s. Rate: 150.5 symbols/min [2025-10-06T22:47:01.153669] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:01.177908] [DEBUG] [LOCAL ] WHG: Loaded 3259 existing records from primary storage. [2025-10-06T22:47:01.178634] [INFO ] [MAIN ] WHG: Loaded 3259 primary data records. [2025-10-06T22:47:01.178565] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:01.200327] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45361 primary records. [2025-10-06T22:47:01.200563] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-06T22:47:01.529913] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-10-06T22:47:01.532504] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-06T22:47:01.535731] [INFO ] [MAIN ] Derivative Progress: 1962/2037 symbols completed. WH took 1.3s. Estimated remaining: 29.9s. Rate: 150.5 symbols/min [2025-10-06T22:47:01.532364] [DEBUG] [LOCAL ] WHD: Loaded 40133 existing records from primary storage. [2025-10-06T22:47:01.535981] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:01.536368] [INFO ] [MAIN ] WHD: Loaded 40133 primary data records. [2025-10-06T22:47:01.896289] [DEBUG] [LOCAL ] WHR: Loaded 48229 existing records from primary storage. [2025-10-06T22:47:01.911024] [INFO ] [MAIN ] WHR: Loaded 48229 primary data records. [2025-10-06T22:47:01.911383] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:01.924433] [INFO ] [MAIN ] WHG: Generated 1794 derivative records from 3259 primary records. [2025-10-06T22:47:01.924557] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-06T22:47:02.244961] [DEBUG] [LOCAL ] WHG: Derivative data saved (1794 records). [2025-10-06T22:47:02.246298] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-06T22:47:02.251912] [INFO ] [MAIN ] Derivative Progress: 1963/2037 symbols completed. WHG took 1.1s. Estimated remaining: 29.5s. Rate: 150.5 symbols/min [2025-10-06T22:47:02.267524] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:02.268806] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40133 primary records. [2025-10-06T22:47:02.269150] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-06T22:47:02.290057] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-10-06T22:47:02.290288] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-06T22:47:02.293538] [INFO ] [MAIN ] Derivative Progress: 1964/2037 symbols completed. WHD took 1.2s. Estimated remaining: 29.1s. Rate: 150.5 symbols/min [2025-10-06T22:47:02.310803] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:02.311629] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48229 primary records. [2025-10-06T22:47:02.311719] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-06T22:47:02.329334] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-10-06T22:47:02.329412] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-06T22:47:02.332733] [INFO ] [MAIN ] Derivative Progress: 1965/2037 symbols completed. WHR took 0.8s. Estimated remaining: 28.7s. Rate: 150.6 symbols/min [2025-10-06T22:47:02.333368] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:02.333724] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:02.333572] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:02.343098] [DEBUG] [LOCAL ] WIA: Loaded 4878 existing records from primary storage. [2025-10-06T22:47:02.343388] [INFO ] [MAIN ] WIA: Loaded 4878 primary data records. [2025-10-06T22:47:02.474897] [DEBUG] [LOCAL ] WINN: Loaded 11587 existing records from primary storage. [2025-10-06T22:47:02.475160] [INFO ] [MAIN ] WINN: Loaded 11587 primary data records. [2025-10-06T22:47:02.933334] [DEBUG] [LOCAL ] WIT: Loaded 52389 existing records from primary storage. [2025-10-06T22:47:02.934779] [INFO ] [MAIN ] WIT: Loaded 52389 primary data records. [2025-10-06T22:47:03.539753] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:03.541154] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:47:03.543259] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4878 primary records. [2025-10-06T22:47:03.544521] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11587 primary records. [2025-10-06T22:47:03.544896] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-06T22:47:03.545352] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-06T22:47:03.580589] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-10-06T22:47:03.583943] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-06T22:47:03.586534] [INFO ] [MAIN ] Derivative Progress: 1966/2037 symbols completed. WIA took 1.3s. Estimated remaining: 28.3s. Rate: 150.4 symbols/min [2025-10-06T22:47:03.587835] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:03.587531] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-10-06T22:47:03.588288] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-06T22:47:03.592348] [INFO ] [MAIN ] Derivative Progress: 1967/2037 symbols completed. WINN took 1.3s. Estimated remaining: 27.9s. Rate: 150.5 symbols/min [2025-10-06T22:47:03.605252] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:03.607022] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:03.608011] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52389 primary records. [2025-10-06T22:47:03.608077] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-06T22:47:03.632757] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-10-06T22:47:03.632841] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-06T22:47:03.635868] [INFO ] [MAIN ] Derivative Progress: 1968/2037 symbols completed. WIT took 1.3s. Estimated remaining: 27.5s. Rate: 150.6 symbols/min [2025-10-06T22:47:03.636173] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:03.645634] [DEBUG] [LOCAL ] WIW: Loaded 20445 existing records from primary storage. [2025-10-06T22:47:03.645890] [INFO ] [MAIN ] WIW: Loaded 20445 primary data records. [2025-10-06T22:47:03.832591] [DEBUG] [LOCAL ] WK: Loaded 37239 existing records from primary storage. [2025-10-06T22:47:03.838371] [DEBUG] [LOCAL ] WKC: Loaded 34752 existing records from primary storage. [2025-10-06T22:47:03.868238] [INFO ] [MAIN ] WKC: Loaded 34752 primary data records. [2025-10-06T22:47:03.877673] [INFO ] [MAIN ] WK: Loaded 37239 primary data records. [2025-10-06T22:47:04.691854] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:04.693059] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20445 primary records. [2025-10-06T22:47:04.693736] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-06T22:47:04.724144] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:04.731560] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 34752 primary records. [2025-10-06T22:47:04.732494] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-06T22:47:04.757415] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-10-06T22:47:04.767407] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-06T22:47:04.777054] [INFO ] [MAIN ] Derivative Progress: 1969/2037 symbols completed. WIW took 1.2s. Estimated remaining: 27.1s. Rate: 150.4 symbols/min [2025-10-06T22:47:04.777855] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:04.781023] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 37239 primary records. [2025-10-06T22:47:04.781248] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:04.781399] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-10-06T22:47:04.782162] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-06T22:47:04.781870] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-06T22:47:04.787513] [INFO ] [MAIN ] Derivative Progress: 1970/2037 symbols completed. WKC took 1.2s. Estimated remaining: 26.7s. Rate: 150.5 symbols/min [2025-10-06T22:47:04.787906] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:04.814089] [DEBUG] [LOCAL ] WLKP: Loaded 6895 existing records from primary storage. [2025-10-06T22:47:04.814936] [INFO ] [MAIN ] WLKP: Loaded 6895 primary data records. [2025-10-06T22:47:04.851262] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-10-06T22:47:04.870558] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-06T22:47:04.882574] [INFO ] [MAIN ] Derivative Progress: 1971/2037 symbols completed. WK took 1.3s. Estimated remaining: 26.3s. Rate: 150.6 symbols/min [2025-10-06T22:47:04.882798] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:05.236497] [DEBUG] [LOCAL ] WLK: Loaded 45531 existing records from primary storage. [2025-10-06T22:47:05.257472] [DEBUG] [LOCAL ] WLY: Loaded 29517 existing records from primary storage. [2025-10-06T22:47:05.257066] [INFO ] [MAIN ] WLK: Loaded 45531 primary data records. [2025-10-06T22:47:05.258676] [INFO ] [MAIN ] WLY: Loaded 29517 primary data records. [2025-10-06T22:47:05.920867] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:05.923509] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6895 primary records. [2025-10-06T22:47:05.923886] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-06T22:47:05.945373] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-10-06T22:47:05.946419] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-06T22:47:05.950449] [INFO ] [MAIN ] Derivative Progress: 1972/2037 symbols completed. WLKP took 1.2s. Estimated remaining: 25.9s. Rate: 150.5 symbols/min [2025-10-06T22:47:05.950804] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:05.972464] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:05.975574] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45531 primary records. [2025-10-06T22:47:05.975705] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-06T22:47:06.005620] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:06.007411] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-10-06T22:47:06.007981] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-06T22:47:06.008943] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 29517 primary records. [2025-10-06T22:47:06.012726] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-06T22:47:06.012553] [INFO ] [MAIN ] Derivative Progress: 1973/2037 symbols completed. WLK took 1.2s. Estimated remaining: 25.5s. Rate: 150.5 symbols/min [2025-10-06T22:47:06.013043] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:06.047136] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-10-06T22:47:06.047356] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-06T22:47:06.050581] [INFO ] [MAIN ] Derivative Progress: 1974/2037 symbols completed. WLY took 1.2s. Estimated remaining: 25.1s. Rate: 150.6 symbols/min [2025-10-06T22:47:06.051584] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:06.085616] [DEBUG] [LOCAL ] WM: Loaded 50929 existing records from primary storage. [2025-10-06T22:47:06.086270] [INFO ] [MAIN ] WM: Loaded 50929 primary data records. [2025-10-06T22:47:06.205100] [DEBUG] [LOCAL ] WMK: Loaded 14518 existing records from primary storage. [2025-10-06T22:47:06.224619] [INFO ] [MAIN ] WMK: Loaded 14518 primary data records. [2025-10-06T22:47:06.326806] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-10-06T22:47:06.346297] [INFO ] [MAIN ] WMB: Loaded 53671 primary data records. [2025-10-06T22:47:07.232164] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:07.234510] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50929 primary records. [2025-10-06T22:47:07.234668] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-06T22:47:07.254861] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-10-06T22:47:07.257377] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-06T22:47:07.261430] [INFO ] [MAIN ] Derivative Progress: 1975/2037 symbols completed. WM took 1.3s. Estimated remaining: 24.7s. Rate: 150.4 symbols/min [2025-10-06T22:47:07.277152] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:07.276481] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:07.278478] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14518 primary records. [2025-10-06T22:47:07.279023] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-06T22:47:07.300608] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-10-06T22:47:07.301686] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-06T22:47:07.305513] [INFO ] [MAIN ] Derivative Progress: 1976/2037 symbols completed. WMK took 1.3s. Estimated remaining: 24.3s. Rate: 150.5 symbols/min [2025-10-06T22:47:07.305861] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:07.321053] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:07.322143] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53671 primary records. [2025-10-06T22:47:07.322410] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-06T22:47:07.343285] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-10-06T22:47:07.343575] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-06T22:47:07.348550] [INFO ] [MAIN ] Derivative Progress: 1977/2037 symbols completed. WMB took 1.3s. Estimated remaining: 23.9s. Rate: 150.6 symbols/min [2025-10-06T22:47:07.348982] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:07.403177] [DEBUG] [LOCAL ] WMS: Loaded 39588 existing records from primary storage. [2025-10-06T22:47:07.415230] [INFO ] [MAIN ] WMS: Loaded 39588 primary data records. [2025-10-06T22:47:07.503286] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-06T22:47:07.523187] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-06T22:47:07.559158] [DEBUG] [LOCAL ] WNC: Loaded 39061 existing records from primary storage. [2025-10-06T22:47:07.613860] [INFO ] [MAIN ] WNC: Loaded 39061 primary data records. [2025-10-06T22:47:08.486076] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:08.495409] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39588 primary records. [2025-10-06T22:47:08.501221] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-06T22:47:08.501516] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:08.502443] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-10-06T22:47:08.503935] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-06T22:47:08.538836] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-10-06T22:47:08.540919] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-06T22:47:08.547394] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-10-06T22:47:08.547870] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-06T22:47:08.546203] [INFO ] [MAIN ] Derivative Progress: 1978/2037 symbols completed. WMT took 1.2s. Estimated remaining: 23.5s. Rate: 150.4 symbols/min [2025-10-06T22:47:08.551716] [INFO ] [MAIN ] Derivative Progress: 1979/2037 symbols completed. WMS took 1.3s. Estimated remaining: 23.1s. Rate: 150.5 symbols/min [2025-10-06T22:47:08.565923] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:08.566764] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 39061 primary records. [2025-10-06T22:47:08.566828] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-06T22:47:08.583829] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-10-06T22:47:08.583928] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-06T22:47:08.587588] [INFO ] [MAIN ] Derivative Progress: 1980/2037 symbols completed. WNC took 1.2s. Estimated remaining: 22.7s. Rate: 150.6 symbols/min [2025-10-06T22:47:08.588393] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:08.588562] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:08.589076] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:08.628745] [DEBUG] [LOCAL ] WOR: Loaded 24870 existing records from primary storage. [2025-10-06T22:47:08.629396] [INFO ] [MAIN ] WOR: Loaded 24870 primary data records. [2025-10-06T22:47:08.811850] [DEBUG] [LOCAL ] WNS: Loaded 39934 existing records from primary storage. [2025-10-06T22:47:08.851812] [INFO ] [MAIN ] WNS: Loaded 39934 primary data records. [2025-10-06T22:47:08.885132] [DEBUG] [LOCAL ] WOLF: Loaded 53177 existing records from primary storage. [2025-10-06T22:47:09.017822] [INFO ] [MAIN ] WOLF: Loaded 53177 primary data records. [2025-10-06T22:47:09.800875] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:09.803131] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24870 primary records. [2025-10-06T22:47:09.803927] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-06T22:47:09.831298] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-10-06T22:47:09.831931] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-06T22:47:09.835017] [INFO ] [MAIN ] Derivative Progress: 1981/2037 symbols completed. WOR took 1.2s. Estimated remaining: 22.3s. Rate: 150.4 symbols/min [2025-10-06T22:47:09.835387] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:09.875613] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:09.876493] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 39934 primary records. [2025-10-06T22:47:09.876783] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-06T22:47:09.877705] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:09.879114] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53177 primary records. [2025-10-06T22:47:09.901952] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-06T22:47:09.939196] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-10-06T22:47:09.939038] [DEBUG] [LOCAL ] WOW: Loaded 30471 existing records from primary storage. [2025-10-06T22:47:09.939538] [INFO ] [MAIN ] WOW: Loaded 30471 primary data records. [2025-10-06T22:47:09.939443] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-06T22:47:09.944533] [INFO ] [MAIN ] Derivative Progress: 1982/2037 symbols completed. WOLF took 1.4s. Estimated remaining: 21.9s. Rate: 150.5 symbols/min [2025-10-06T22:47:09.945530] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:09.979423] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-10-06T22:47:09.979858] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-06T22:47:10.033528] [INFO ] [MAIN ] Derivative Progress: 1983/2037 symbols completed. WNS took 1.4s. Estimated remaining: 21.5s. Rate: 150.5 symbols/min [2025-10-06T22:47:10.045342] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:10.367086] [DEBUG] [LOCAL ] WPM: Loaded 52735 existing records from primary storage. [2025-10-06T22:47:10.368507] [DEBUG] [LOCAL ] WPC: Loaded 48342 existing records from primary storage. [2025-10-06T22:47:10.369354] [INFO ] [MAIN ] WPM: Loaded 52735 primary data records. [2025-10-06T22:47:10.369595] [INFO ] [MAIN ] WPC: Loaded 48342 primary data records. [2025-10-06T22:47:10.768021] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:10.792937] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 30471 primary records. [2025-10-06T22:47:10.793077] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-06T22:47:11.061240] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-10-06T22:47:11.063015] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-06T22:47:11.065802] [INFO ] [MAIN ] Derivative Progress: 1984/2037 symbols completed. WOW took 1.2s. Estimated remaining: 21.1s. Rate: 150.4 symbols/min [2025-10-06T22:47:11.066678] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:11.132008] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:11.133629] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:11.145550] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48342 primary records. [2025-10-06T22:47:11.147044] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-06T22:47:11.147793] [DEBUG] [LOCAL ] WPP: Loaded 33995 existing records from primary storage. [2025-10-06T22:47:11.146926] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52735 primary records. [2025-10-06T22:47:11.148932] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-06T22:47:11.149044] [INFO ] [MAIN ] WPP: Loaded 33995 primary data records. [2025-10-06T22:47:11.257365] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-10-06T22:47:11.275243] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-06T22:47:11.300011] [INFO ] [MAIN ] Derivative Progress: 1985/2037 symbols completed. WPC took 1.4s. Estimated remaining: 20.7s. Rate: 150.4 symbols/min [2025-10-06T22:47:11.296001] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-10-06T22:47:11.300566] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:11.301732] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-06T22:47:11.310423] [INFO ] [MAIN ] Derivative Progress: 1986/2037 symbols completed. WPM took 1.3s. Estimated remaining: 20.3s. Rate: 150.5 symbols/min [2025-10-06T22:47:11.320996] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:11.604259] [DEBUG] [LOCAL ] WRBY: Loaded 50718 existing records from primary storage. [2025-10-06T22:47:11.605050] [INFO ] [MAIN ] WRBY: Loaded 50718 primary data records. [2025-10-06T22:47:11.605732] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:11.630208] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 33995 primary records. [2025-10-06T22:47:11.657883] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-06T22:47:11.749439] [DEBUG] [LOCAL ] WRB: Loaded 50616 existing records from primary storage. [2025-10-06T22:47:11.756722] [INFO ] [MAIN ] WRB: Loaded 50616 primary data records. [2025-10-06T22:47:11.908133] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-10-06T22:47:11.923128] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-06T22:47:11.925748] [INFO ] [MAIN ] Derivative Progress: 1987/2037 symbols completed. WPP took 0.9s. Estimated remaining: 19.9s. Rate: 150.5 symbols/min [2025-10-06T22:47:12.050932] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:12.364385] [DEBUG] [LOCAL ] WS: Loaded 23846 existing records from primary storage. [2025-10-06T22:47:12.365199] [INFO ] [MAIN ] WS: Loaded 23846 primary data records. [2025-10-06T22:47:12.501489] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:12.542516] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50718 primary records. [2025-10-06T22:47:12.583737] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-06T22:47:12.741819] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-10-06T22:47:12.742972] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-06T22:47:12.742894] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:12.745833] [INFO ] [MAIN ] Derivative Progress: 1988/2037 symbols completed. WRBY took 1.4s. Estimated remaining: 19.6s. Rate: 150.4 symbols/min [2025-10-06T22:47:12.746142] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:12.747723] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50616 primary records. [2025-10-06T22:47:12.748162] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-06T22:47:12.767852] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-10-06T22:47:12.768060] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-06T22:47:12.770899] [INFO ] [MAIN ] Derivative Progress: 1989/2037 symbols completed. WRB took 1.5s. Estimated remaining: 19.1s. Rate: 150.4 symbols/min [2025-10-06T22:47:12.771532] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:12.792912] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:12.793855] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23846 primary records. [2025-10-06T22:47:12.793920] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-06T22:47:12.828381] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-10-06T22:47:12.828676] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-06T22:47:12.832388] [INFO ] [MAIN ] Derivative Progress: 1990/2037 symbols completed. WS took 0.8s. Estimated remaining: 18.7s. Rate: 150.5 symbols/min [2025-10-06T22:47:12.832817] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:12.846480] [DEBUG] [LOCAL ] WSO: Loaded 24867 existing records from primary storage. [2025-10-06T22:47:12.847464] [INFO ] [MAIN ] WSO: Loaded 24867 primary data records. [2025-10-06T22:47:12.896098] [DEBUG] [LOCAL ] WSM: Loaded 49433 existing records from primary storage. [2025-10-06T22:47:12.911109] [INFO ] [MAIN ] WSM: Loaded 49433 primary data records. [2025-10-06T22:47:13.124043] [DEBUG] [LOCAL ] WSR: Loaded 22909 existing records from primary storage. [2025-10-06T22:47:13.200738] [INFO ] [MAIN ] WSR: Loaded 22909 primary data records. [2025-10-06T22:47:13.979627] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:13.981245] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 24867 primary records. [2025-10-06T22:47:13.983120] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-06T22:47:14.017243] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:14.019430] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49433 primary records. [2025-10-06T22:47:14.019904] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-06T22:47:14.032558] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-10-06T22:47:14.035719] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-06T22:47:14.039258] [INFO ] [MAIN ] Derivative Progress: 1991/2037 symbols completed. WSO took 1.3s. Estimated remaining: 18.4s. Rate: 150.4 symbols/min [2025-10-06T22:47:14.040491] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:14.046592] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-10-06T22:47:14.048912] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-06T22:47:14.052064] [INFO ] [MAIN ] Derivative Progress: 1992/2037 symbols completed. WSM took 1.3s. Estimated remaining: 17.9s. Rate: 150.4 symbols/min [2025-10-06T22:47:14.052444] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:14.068834] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:14.069975] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 22909 primary records. [2025-10-06T22:47:14.070101] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-06T22:47:14.090117] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-10-06T22:47:14.090452] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-06T22:47:14.096273] [INFO ] [MAIN ] Derivative Progress: 1993/2037 symbols completed. WSR took 1.3s. Estimated remaining: 17.5s. Rate: 150.5 symbols/min [2025-10-06T22:47:14.135487] [DEBUG] [LOCAL ] WST: Loaded 37060 existing records from primary storage. [2025-10-06T22:47:14.135736] [INFO ] [MAIN ] WST: Loaded 37060 primary data records. [2025-10-06T22:47:14.266996] [DEBUG] [LOCAL ] WT: Loaded 47859 existing records from primary storage. [2025-10-06T22:47:14.277532] [INFO ] [MAIN ] WT: Loaded 47859 primary data records. [2025-10-06T22:47:14.913484] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:14.916134] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 37060 primary records. [2025-10-06T22:47:14.917109] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-06T22:47:14.977166] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-10-06T22:47:14.977637] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:14.977986] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-06T22:47:14.979312] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47859 primary records. [2025-10-06T22:47:14.983328] [INFO ] [MAIN ] Derivative Progress: 1994/2037 symbols completed. WST took 0.9s. Estimated remaining: 17.2s. Rate: 150.4 symbols/min [2025-10-06T22:47:14.984266] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-06T22:47:15.013685] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-10-06T22:47:15.013895] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-06T22:47:15.017481] [INFO ] [MAIN ] Derivative Progress: 1995/2037 symbols completed. WT took 1.0s. Estimated remaining: 16.7s. Rate: 150.5 symbols/min [2025-10-06T22:47:15.018402] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:15.018583] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:15.019330] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:15.088695] [DEBUG] [LOCAL ] WTS: Loaded 17987 existing records from primary storage. [2025-10-06T22:47:15.089127] [INFO ] [MAIN ] WTS: Loaded 17987 primary data records. [2025-10-06T22:47:15.254916] [DEBUG] [LOCAL ] WTRG: Loaded 50948 existing records from primary storage. [2025-10-06T22:47:15.261576] [DEBUG] [LOCAL ] WTI: Loaded 43945 existing records from primary storage. [2025-10-06T22:47:15.267458] [INFO ] [MAIN ] WTRG: Loaded 50948 primary data records. [2025-10-06T22:47:15.267202] [INFO ] [MAIN ] WTI: Loaded 43945 primary data records. [2025-10-06T22:47:16.313447] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:16.314552] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 17987 primary records. [2025-10-06T22:47:16.314780] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-06T22:47:16.332322] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-10-06T22:47:16.332968] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-06T22:47:16.334943] [INFO ] [MAIN ] Derivative Progress: 1996/2037 symbols completed. WTS took 1.3s. Estimated remaining: 16.4s. Rate: 150.3 symbols/min [2025-10-06T22:47:16.335416] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:16.366821] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:16.366575] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:16.367685] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50948 primary records. [2025-10-06T22:47:16.368397] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 43945 primary records. [2025-10-06T22:47:16.368481] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-06T22:47:16.368568] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-06T22:47:16.402967] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-10-06T22:47:16.403681] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-06T22:47:16.407533] [INFO ] [MAIN ] Derivative Progress: 1997/2037 symbols completed. WTRG took 1.4s. Estimated remaining: 16.0s. Rate: 150.4 symbols/min [2025-10-06T22:47:16.407977] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:16.408693] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-10-06T22:47:16.409063] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-06T22:47:16.411712] [INFO ] [MAIN ] Derivative Progress: 1998/2037 symbols completed. WTI took 1.4s. Estimated remaining: 15.6s. Rate: 150.4 symbols/min [2025-10-06T22:47:16.411997] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:16.444395] [DEBUG] [LOCAL ] WTTR: Loaded 44812 existing records from primary storage. [2025-10-06T22:47:16.444699] [INFO ] [MAIN ] WTTR: Loaded 44812 primary data records. [2025-10-06T22:47:16.843114] [DEBUG] [LOCAL ] WWW: Loaded 49236 existing records from primary storage. [2025-10-06T22:47:16.843309] [INFO ] [MAIN ] WWW: Loaded 49236 primary data records. [2025-10-06T22:47:16.885866] [DEBUG] [LOCAL ] WU: Loaded 53462 existing records from primary storage. [2025-10-06T22:47:16.898313] [INFO ] [MAIN ] WU: Loaded 53462 primary data records. [2025-10-06T22:47:17.502459] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:17.503962] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 44812 primary records. [2025-10-06T22:47:17.504399] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-06T22:47:17.546897] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:17.546354] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-10-06T22:47:17.548106] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49236 primary records. [2025-10-06T22:47:17.548219] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-06T22:47:17.548319] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-06T22:47:17.552482] [INFO ] [MAIN ] Derivative Progress: 1999/2037 symbols completed. WTTR took 1.2s. Estimated remaining: 15.2s. Rate: 150.3 symbols/min [2025-10-06T22:47:17.552953] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:17.585789] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:17.587725] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53462 primary records. [2025-10-06T22:47:17.588089] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-06T22:47:17.589870] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-10-06T22:47:17.590185] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-06T22:47:17.592262] [INFO ] [MAIN ] Derivative Progress: 2000/2037 symbols completed. WWW took 1.2s. Estimated remaining: 14.8s. Rate: 150.4 symbols/min [2025-10-06T22:47:17.592766] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:17.609618] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-10-06T22:47:17.610079] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-06T22:47:17.614892] [INFO ] [MAIN ] Derivative Progress: 2001/2037 symbols completed. WU took 1.2s. Estimated remaining: 14.4s. Rate: 150.4 symbols/min [2025-10-06T22:47:17.615189] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:17.669848] [DEBUG] [LOCAL ] WY: Loaded 53136 existing records from primary storage. [2025-10-06T22:47:17.670685] [INFO ] [MAIN ] WY: Loaded 53136 primary data records. [2025-10-06T22:47:17.725171] [DEBUG] [LOCAL ] XFLT: Loaded 29684 existing records from primary storage. [2025-10-06T22:47:17.757272] [INFO ] [MAIN ] XFLT: Loaded 29684 primary data records. [2025-10-06T22:47:17.944310] [DEBUG] [LOCAL ] XHR: Loaded 43728 existing records from primary storage. [2025-10-06T22:47:18.093787] [INFO ] [MAIN ] XHR: Loaded 43728 primary data records. [2025-10-06T22:47:18.694378] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:18.696134] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53136 primary records. [2025-10-06T22:47:18.696284] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-06T22:47:18.711406] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:18.712451] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29684 primary records. [2025-10-06T22:47:18.720011] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-06T22:47:18.745129] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-10-06T22:47:18.746272] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-06T22:47:18.750287] [INFO ] [MAIN ] Derivative Progress: 2002/2037 symbols completed. WY took 1.2s. Estimated remaining: 14.0s. Rate: 150.3 symbols/min [2025-10-06T22:47:18.750618] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:18.752256] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-10-06T22:47:18.752399] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-06T22:47:18.754897] [INFO ] [MAIN ] Derivative Progress: 2003/2037 symbols completed. XFLT took 1.2s. Estimated remaining: 13.6s. Rate: 150.4 symbols/min [2025-10-06T22:47:18.768285] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:18.768136] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:18.769626] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 43728 primary records. [2025-10-06T22:47:18.769756] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-06T22:47:18.790159] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-10-06T22:47:18.790241] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-06T22:47:18.793270] [INFO ] [MAIN ] Derivative Progress: 2004/2037 symbols completed. XHR took 1.2s. Estimated remaining: 13.2s. Rate: 150.4 symbols/min [2025-10-06T22:47:18.793539] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:18.829112] [DEBUG] [LOCAL ] XPER: Loaded 30037 existing records from primary storage. [2025-10-06T22:47:18.829351] [INFO ] [MAIN ] XPER: Loaded 30037 primary data records. [2025-10-06T22:47:18.938828] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-06T22:47:18.950897] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-06T22:47:19.162094] [DEBUG] [LOCAL ] XPEV: Loaded 53634 existing records from primary storage. [2025-10-06T22:47:19.180306] [INFO ] [MAIN ] XPEV: Loaded 53634 primary data records. [2025-10-06T22:47:19.830976] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:19.832533] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 30037 primary records. [2025-10-06T22:47:19.832829] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-06T22:47:19.865233] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:19.866155] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-10-06T22:47:19.866684] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-06T22:47:19.889092] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-10-06T22:47:19.889495] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-06T22:47:19.891805] [INFO ] [MAIN ] Derivative Progress: 2005/2037 symbols completed. XPER took 1.1s. Estimated remaining: 12.8s. Rate: 150.3 symbols/min [2025-10-06T22:47:19.892461] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:19.907852] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:19.909843] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53634 primary records. [2025-10-06T22:47:19.910721] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-06T22:47:19.911463] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-10-06T22:47:19.912346] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-06T22:47:19.915755] [INFO ] [MAIN ] Derivative Progress: 2006/2037 symbols completed. XOM took 1.2s. Estimated remaining: 12.4s. Rate: 150.4 symbols/min [2025-10-06T22:47:19.923879] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:19.934901] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-10-06T22:47:19.935036] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-06T22:47:19.939182] [INFO ] [MAIN ] Derivative Progress: 2007/2037 symbols completed. XPEV took 1.1s. Estimated remaining: 12.0s. Rate: 150.4 symbols/min [2025-10-06T22:47:19.939500] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:19.993884] [DEBUG] [LOCAL ] XPO: Loaded 47822 existing records from primary storage. [2025-10-06T22:47:20.005119] [INFO ] [MAIN ] XPO: Loaded 47822 primary data records. [2025-10-06T22:47:20.132684] [DEBUG] [LOCAL ] XPOF: Loaded 37750 existing records from primary storage. [2025-10-06T22:47:20.132919] [INFO ] [MAIN ] XPOF: Loaded 37750 primary data records. [2025-10-06T22:47:20.134036] [DEBUG] [LOCAL ] XPRO: Loaded 45841 existing records from primary storage. [2025-10-06T22:47:20.160896] [INFO ] [MAIN ] XPRO: Loaded 45841 primary data records. [2025-10-06T22:47:21.032093] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:21.033952] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 47822 primary records. [2025-10-06T22:47:21.034353] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-06T22:47:21.055091] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-10-06T22:47:21.056351] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-06T22:47:21.059874] [INFO ] [MAIN ] Derivative Progress: 2008/2037 symbols completed. XPO took 1.2s. Estimated remaining: 11.6s. Rate: 150.3 symbols/min [2025-10-06T22:47:21.075195] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:21.076167] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 37750 primary records. [2025-10-06T22:47:21.088135] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-06T22:47:21.088880] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:21.089843] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45841 primary records. [2025-10-06T22:47:21.090100] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-06T22:47:21.119451] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-10-06T22:47:21.120249] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-10-06T22:47:21.120339] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-06T22:47:21.123388] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-06T22:47:21.123308] [INFO ] [MAIN ] Derivative Progress: 2009/2037 symbols completed. XPOF took 1.2s. Estimated remaining: 11.2s. Rate: 150.4 symbols/min [2025-10-06T22:47:21.126498] [INFO ] [MAIN ] Derivative Progress: 2010/2037 symbols completed. XPRO took 1.2s. Estimated remaining: 10.8s. Rate: 150.4 symbols/min [2025-10-06T22:47:21.127218] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:21.127158] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:21.127381] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:21.178350] [DEBUG] [LOCAL ] XYF: Loaded 28488 existing records from primary storage. [2025-10-06T22:47:21.190674] [INFO ] [MAIN ] XYF: Loaded 28488 primary data records. [2025-10-06T22:47:21.213198] [DEBUG] [LOCAL ] YALA: Loaded 37065 existing records from primary storage. [2025-10-06T22:47:21.249619] [INFO ] [MAIN ] YALA: Loaded 37065 primary data records. [2025-10-06T22:47:21.342182] [DEBUG] [LOCAL ] XYL: Loaded 47926 existing records from primary storage. [2025-10-06T22:47:21.386629] [INFO ] [MAIN ] XYL: Loaded 47926 primary data records. [2025-10-06T22:47:22.180900] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:22.181747] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 28488 primary records. [2025-10-06T22:47:22.181928] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-06T22:47:22.216268] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-10-06T22:47:22.217573] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:22.218382] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 37065 primary records. [2025-10-06T22:47:22.217283] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-06T22:47:22.218556] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-06T22:47:22.244959] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:22.245788] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 47926 primary records. [2025-10-06T22:47:22.246727] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-06T22:47:22.233739] [INFO ] [MAIN ] Derivative Progress: 2011/2037 symbols completed. XYF took 1.1s. Estimated remaining: 10.4s. Rate: 150.3 symbols/min [2025-10-06T22:47:22.247718] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:22.266907] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-10-06T22:47:22.267535] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-06T22:47:22.270474] [INFO ] [MAIN ] Derivative Progress: 2012/2037 symbols completed. YALA took 1.1s. Estimated remaining: 10.0s. Rate: 150.4 symbols/min [2025-10-06T22:47:22.270933] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:22.274693] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-10-06T22:47:22.274874] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-06T22:47:22.278961] [INFO ] [MAIN ] Derivative Progress: 2013/2037 symbols completed. XYL took 1.2s. Estimated remaining: 9.6s. Rate: 150.5 symbols/min [2025-10-06T22:47:22.279366] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:22.320424] [DEBUG] [LOCAL ] YELP: Loaded 45396 existing records from primary storage. [2025-10-06T22:47:22.332947] [INFO ] [MAIN ] YELP: Loaded 45396 primary data records. [2025-10-06T22:47:22.541863] [DEBUG] [LOCAL ] YEXT: Loaded 43092 existing records from primary storage. [2025-10-06T22:47:22.574816] [DEBUG] [LOCAL ] YETI: Loaded 52473 existing records from primary storage. [2025-10-06T22:47:22.570239] [INFO ] [MAIN ] YEXT: Loaded 43092 primary data records. [2025-10-06T22:47:22.574976] [INFO ] [MAIN ] YETI: Loaded 52473 primary data records. [2025-10-06T22:47:23.438257] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:23.439343] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45396 primary records. [2025-10-06T22:47:23.439783] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-06T22:47:23.457583] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-10-06T22:47:23.459190] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-06T22:47:23.461677] [INFO ] [MAIN ] Derivative Progress: 2014/2037 symbols completed. YELP took 1.2s. Estimated remaining: 9.2s. Rate: 150.3 symbols/min [2025-10-06T22:47:23.461989] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:23.480958] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:23.481874] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43092 primary records. [2025-10-06T22:47:23.481949] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-06T22:47:23.510906] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-10-06T22:47:23.516288] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:23.517178] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52473 primary records. [2025-10-06T22:47:23.517245] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-06T22:47:23.520377] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-06T22:47:23.520296] [INFO ] [MAIN ] Derivative Progress: 2015/2037 symbols completed. YEXT took 1.2s. Estimated remaining: 8.8s. Rate: 150.4 symbols/min [2025-10-06T22:47:23.521182] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:23.538090] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-10-06T22:47:23.538320] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-06T22:47:23.541513] [INFO ] [MAIN ] Derivative Progress: 2016/2037 symbols completed. YETI took 1.3s. Estimated remaining: 8.4s. Rate: 150.4 symbols/min [2025-10-06T22:47:23.556363] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:23.581061] [DEBUG] [LOCAL ] YMM: Loaded 52621 existing records from primary storage. [2025-10-06T22:47:23.581687] [INFO ] [MAIN ] YMM: Loaded 52621 primary data records. [2025-10-06T22:47:23.719285] [DEBUG] [LOCAL ] YOU: Loaded 49674 existing records from primary storage. [2025-10-06T22:47:23.740924] [INFO ] [MAIN ] YOU: Loaded 49674 primary data records. [2025-10-06T22:47:23.938557] [DEBUG] [LOCAL ] YPF: Loaded 50487 existing records from primary storage. [2025-10-06T22:47:24.070083] [INFO ] [MAIN ] YPF: Loaded 50487 primary data records. [2025-10-06T22:47:24.612629] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:24.613507] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52621 primary records. [2025-10-06T22:47:24.613866] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-06T22:47:24.647695] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-10-06T22:47:24.648306] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:24.648538] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-06T22:47:24.650572] [INFO ] [MAIN ] Derivative Progress: 2017/2037 symbols completed. YMM took 1.2s. Estimated remaining: 8.0s. Rate: 150.3 symbols/min [2025-10-06T22:47:24.650856] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:24.651580] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49674 primary records. [2025-10-06T22:47:24.652107] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-06T22:47:24.665770] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:24.666523] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50487 primary records. [2025-10-06T22:47:24.666843] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-06T22:47:24.698741] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-10-06T22:47:24.700740] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-06T22:47:24.701923] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-10-06T22:47:24.705218] [INFO ] [MAIN ] Derivative Progress: 2018/2037 symbols completed. YOU took 1.2s. Estimated remaining: 7.6s. Rate: 150.4 symbols/min [2025-10-06T22:47:24.710276] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:24.710746] [DEBUG] [LOCAL ] YRD: Loaded 12286 existing records from primary storage. [2025-10-06T22:47:24.710414] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-06T22:47:24.714102] [INFO ] [MAIN ] Derivative Progress: 2019/2037 symbols completed. YPF took 1.2s. Estimated remaining: 7.2s. Rate: 150.4 symbols/min [2025-10-06T22:47:24.710868] [INFO ] [MAIN ] YRD: Loaded 12286 primary data records. [2025-10-06T22:47:24.714361] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:25.064025] [DEBUG] [LOCAL ] YSG: Loaded 25288 existing records from primary storage. [2025-10-06T22:47:25.064345] [INFO ] [MAIN ] YSG: Loaded 25288 primary data records. [2025-10-06T22:47:25.260758] [DEBUG] [LOCAL ] YUM: Loaded 51208 existing records from primary storage. [2025-10-06T22:47:25.382580] [INFO ] [MAIN ] YUM: Loaded 51208 primary data records. [2025-10-06T22:47:25.603262] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:47:25.605101] [INFO ] [MAIN ] YRD: Generated 1793 derivative records from 12286 primary records. [2025-10-06T22:47:25.712934] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-06T22:47:25.740990] [DEBUG] [LOCAL ] YRD: Derivative data saved (1793 records). [2025-10-06T22:47:25.741817] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-06T22:47:25.744111] [INFO ] [MAIN ] Derivative Progress: 2020/2037 symbols completed. YRD took 1.1s. Estimated remaining: 6.8s. Rate: 150.3 symbols/min [2025-10-06T22:47:25.744492] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:25.763965] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:25.765111] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 25288 primary records. [2025-10-06T22:47:25.765399] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-06T22:47:25.782226] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-10-06T22:47:25.782495] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-06T22:47:25.785225] [INFO ] [MAIN ] Derivative Progress: 2021/2037 symbols completed. YSG took 1.1s. Estimated remaining: 6.4s. Rate: 150.4 symbols/min [2025-10-06T22:47:25.785497] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:25.802619] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:25.803433] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51208 primary records. [2025-10-06T22:47:25.803566] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-06T22:47:25.835353] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-10-06T22:47:25.835510] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-06T22:47:25.840168] [INFO ] [MAIN ] Derivative Progress: 2022/2037 symbols completed. YUM took 1.1s. Estimated remaining: 6.0s. Rate: 150.5 symbols/min [2025-10-06T22:47:25.840674] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:25.858627] [DEBUG] [LOCAL ] YUMC: Loaded 52614 existing records from primary storage. [2025-10-06T22:47:25.858935] [INFO ] [MAIN ] YUMC: Loaded 52614 primary data records. [2025-10-06T22:47:26.018088] [DEBUG] [LOCAL ] ZEPP: Loaded 17976 existing records from primary storage. [2025-10-06T22:47:26.012321] [DEBUG] [LOCAL ] ZBH: Loaded 50961 existing records from primary storage. [2025-10-06T22:47:26.028783] [INFO ] [MAIN ] ZEPP: Loaded 17976 primary data records. [2025-10-06T22:47:26.039309] [INFO ] [MAIN ] ZBH: Loaded 50961 primary data records. [2025-10-06T22:47:26.904174] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:26.906777] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52614 primary records. [2025-10-06T22:47:26.907295] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-06T22:47:26.940057] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-06T22:47:26.941972] [INFO ] [MAIN ] ZEPP: Generated 1791 derivative records from 17976 primary records. [2025-10-06T22:47:26.942385] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-06T22:47:26.946579] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-10-06T22:47:26.955372] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-06T22:47:26.960298] [INFO ] [MAIN ] Derivative Progress: 2023/2037 symbols completed. YUMC took 1.2s. Estimated remaining: 5.6s. Rate: 150.3 symbols/min [2025-10-06T22:47:26.979468] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1791 records). [2025-10-06T22:47:26.978014] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:26.980526] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 50961 primary records. [2025-10-06T22:47:26.980627] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-06T22:47:26.979616] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-06T22:47:26.983451] [INFO ] [MAIN ] Derivative Progress: 2024/2037 symbols completed. ZEPP took 1.1s. Estimated remaining: 5.2s. Rate: 150.4 symbols/min [2025-10-06T22:47:26.999947] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-10-06T22:47:27.000008] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-06T22:47:27.004205] [INFO ] [MAIN ] Derivative Progress: 2025/2037 symbols completed. ZBH took 1.2s. Estimated remaining: 4.8s. Rate: 150.5 symbols/min [2025-10-06T22:47:27.005251] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:27.005399] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:27.005124] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:27.057850] [DEBUG] [LOCAL ] ZH: Loaded 26140 existing records from primary storage. [2025-10-06T22:47:27.058009] [INFO ] [MAIN ] ZH: Loaded 26140 primary data records. [2025-10-06T22:47:27.257142] [DEBUG] [LOCAL ] ZGN: Loaded 40770 existing records from primary storage. [2025-10-06T22:47:27.266009] [INFO ] [MAIN ] ZGN: Loaded 40770 primary data records. [2025-10-06T22:47:27.443822] [DEBUG] [LOCAL ] ZETA: Loaded 53601 existing records from primary storage. [2025-10-06T22:47:27.470523] [INFO ] [MAIN ] ZETA: Loaded 53601 primary data records. [2025-10-06T22:47:28.078452] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:28.079378] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 26140 primary records. [2025-10-06T22:47:28.080049] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-06T22:47:28.098365] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-10-06T22:47:28.098731] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-06T22:47:28.101185] [INFO ] [MAIN ] Derivative Progress: 2026/2037 symbols completed. ZH took 1.1s. Estimated remaining: 4.4s. Rate: 150.3 symbols/min [2025-10-06T22:47:28.101351] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:28.119314] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:28.120245] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40770 primary records. [2025-10-06T22:47:28.120341] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-06T22:47:28.153018] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-10-06T22:47:28.153229] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:28.153379] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-06T22:47:28.155883] [INFO ] [MAIN ] Derivative Progress: 2027/2037 symbols completed. ZGN took 1.2s. Estimated remaining: 4.0s. Rate: 150.4 symbols/min [2025-10-06T22:47:28.156960] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53601 primary records. [2025-10-06T22:47:28.156048] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:28.157151] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-06T22:47:28.188524] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-10-06T22:47:28.188797] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-06T22:47:28.192099] [INFO ] [MAIN ] Derivative Progress: 2028/2037 symbols completed. ZETA took 1.2s. Estimated remaining: 3.6s. Rate: 150.5 symbols/min [2025-10-06T22:47:28.193282] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:28.211858] [DEBUG] [LOCAL ] ZIM: Loaded 53507 existing records from primary storage. [2025-10-06T22:47:28.212266] [INFO ] [MAIN ] ZIM: Loaded 53507 primary data records. [2025-10-06T22:47:28.385709] [DEBUG] [LOCAL ] ZIP: Loaded 43976 existing records from primary storage. [2025-10-06T22:47:28.406338] [INFO ] [MAIN ] ZIP: Loaded 43976 primary data records. [2025-10-06T22:47:28.674277] [DEBUG] [LOCAL ] ZK: Loaded 39361 existing records from primary storage. [2025-10-06T22:47:28.690716] [INFO ] [MAIN ] ZK: Loaded 39361 primary data records. [2025-10-06T22:47:29.304050] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:29.305252] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53507 primary records. [2025-10-06T22:47:29.305694] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-06T22:47:29.329759] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-10-06T22:47:29.330488] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-06T22:47:29.334628] [INFO ] [MAIN ] Derivative Progress: 2029/2037 symbols completed. ZIM took 1.2s. Estimated remaining: 3.2s. Rate: 150.3 symbols/min [2025-10-06T22:47:29.335945] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:29.351626] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:29.352949] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 43976 primary records. [2025-10-06T22:47:29.357734] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-06T22:47:29.375535] [DEBUG] [LOCAL ] ZKH: Loaded 7634 existing records from primary storage. [2025-10-06T22:47:29.387235] [INFO ] [MAIN ] ZKH: Loaded 7634 primary data records. [2025-10-06T22:47:29.398587] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:29.407103] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 39361 primary records. [2025-10-06T22:47:29.407796] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-06T22:47:29.492444] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-10-06T22:47:29.498225] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-06T22:47:29.502447] [INFO ] [MAIN ] Derivative Progress: 2030/2037 symbols completed. ZIP took 1.3s. Estimated remaining: 2.8s. Rate: 150.4 symbols/min [2025-10-06T22:47:29.512872] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:29.607073] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-10-06T22:47:29.613552] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-06T22:47:29.658800] [INFO ] [MAIN ] Derivative Progress: 2031/2037 symbols completed. ZK took 1.4s. Estimated remaining: 2.4s. Rate: 150.4 symbols/min [2025-10-06T22:47:29.792770] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:29.844323] [DEBUG] [LOCAL ] ZTR: Loaded 16726 existing records from primary storage. [2025-10-06T22:47:29.844481] [INFO ] [MAIN ] ZTR: Loaded 16726 primary data records. [2025-10-06T22:47:29.951035] [DEBUG] [LOCAL ] ZTO: Loaded 49704 existing records from primary storage. [2025-10-06T22:47:29.957679] [INFO ] [MAIN ] ZTO: Loaded 49704 primary data records. [2025-10-06T22:47:30.276434] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-06T22:47:30.314809] [INFO ] [MAIN ] ZKH: Generated 1793 derivative records from 7634 primary records. [2025-10-06T22:47:30.323460] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-06T22:47:30.375073] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1793 records). [2025-10-06T22:47:30.380743] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-06T22:47:30.406951] [INFO ] [MAIN ] Derivative Progress: 2032/2037 symbols completed. ZKH took 1.1s. Estimated remaining: 2.0s. Rate: 150.4 symbols/min [2025-10-06T22:47:30.407176] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:30.598587] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:30.600222] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16726 primary records. [2025-10-06T22:47:30.600395] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-06T22:47:30.634789] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-10-06T22:47:30.634964] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-06T22:47:30.638258] [INFO ] [MAIN ] Derivative Progress: 2033/2037 symbols completed. ZTR took 0.8s. Estimated remaining: 1.6s. Rate: 150.4 symbols/min [2025-10-06T22:47:30.638769] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:30.667222] [DEBUG] [LOCAL ] ZTS: Loaded 53037 existing records from primary storage. [2025-10-06T22:47:30.672766] [INFO ] [MAIN ] ZTS: Loaded 53037 primary data records. [2025-10-06T22:47:30.672543] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:30.673613] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49704 primary records. [2025-10-06T22:47:30.694706] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-06T22:47:30.773768] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-10-06T22:47:30.779104] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-06T22:47:30.814442] [INFO ] [MAIN ] Derivative Progress: 2034/2037 symbols completed. ZTO took 1.3s. Estimated remaining: 1.2s. Rate: 150.4 symbols/min [2025-10-06T22:47:30.814722] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-06T22:47:30.911176] [DEBUG] [LOCAL ] ZVIA: Loaded 35380 existing records from primary storage. [2025-10-06T22:47:30.979931] [INFO ] [MAIN ] ZVIA: Loaded 35380 primary data records. [2025-10-06T22:47:31.263723] [DEBUG] [LOCAL ] ZWS: Loaded 42305 existing records from primary storage. [2025-10-06T22:47:31.291306] [INFO ] [MAIN ] ZWS: Loaded 42305 primary data records. [2025-10-06T22:47:31.942345] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:31.943834] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 53037 primary records. [2025-10-06T22:47:31.944316] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-06T22:47:31.970594] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-10-06T22:47:31.970860] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-06T22:47:31.973801] [INFO ] [MAIN ] Derivative Progress: 2035/2037 symbols completed. ZTS took 1.6s. Estimated remaining: 0.8s. Rate: 150.3 symbols/min [2025-10-06T22:47:31.995009] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:31.996358] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35380 primary records. [2025-10-06T22:47:31.996444] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-06T22:47:32.016010] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-10-06T22:47:32.018163] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-06T22:47:32.022407] [INFO ] [MAIN ] Derivative Progress: 2036/2037 symbols completed. ZVIA took 1.4s. Estimated remaining: 0.4s. Rate: 150.4 symbols/min [2025-10-06T22:47:32.038495] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-06T22:47:32.039330] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42305 primary records. [2025-10-06T22:47:32.039399] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-06T22:47:32.057887] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-10-06T22:47:32.057963] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-06T22:47:32.061273] [INFO ] [MAIN ] Derivative Progress: 2037/2037 symbols completed. ZWS took 1.2s. Estimated remaining: 0.0s. Rate: 150.4 symbols/min [2025-10-06T22:47:32.062492] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 33s [2025-10-06T22:47:32.062608] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2037/2037 symbols) [2025-10-06T22:47:32.663031] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2037/2037 @ 100.00%)' [2025-10-06T22:47:32.663790] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-06T22:47:32.665161] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-06T22:47:32.665499] [INFO ] [STATE ] Last completion updated: 2025-10-06T22:47:32.665251